Back to list

XLA:TPU Compiler Bug Affecting Token Selection

8/10 High

A precision mismatch bug in the XLA:TPU compiler caused incorrect token selection by the approximate top-k operation, affecting Haiku 3.5 and potentially Sonnet 4 and Opus 3. The issue was masked by a previous workaround that was inadvertently removed.

Claude Haiku 3.5Claude Sonnet 4Claude Opus 3XLATPU
Category
performance
Workaround
none
Stage
deploy
Freshness
declining
Scope
single_lib
Upstream
wontfix
Recurring
No
Buyer Type
team
Maintainer
active

Sources

Collection History

Query: “What are the most common pain points with Anthropic API for developers in 2025?”3/30/2026

This change inadvertently triggered a latent bug in the XLA:TPU compiler... This caused a mismatch: operations that should have agreed on the highest probability token were running at different precision levels.

Created: 3/30/2026Updated: 3/30/2026