Post

Zyphra发布首个MI355X推理评测：长文本直逼B200

币界网
币界网
币界网消息，Zyphra发布了基于AMD旗舰芯片MI355X的端到端大模型推理实测，测试在真实单节点环境下运行DeepSeek V3.2、Kimi K2.6与GLM-5.1，并对标NVIDIA B200。实测显示，AMD的288GB显存远超B200的180GB，使其在处理超长文本时能更高效地利用缓存，降低硬件成本。然而，AMD在芯片间互联上处于劣势，B200通过NVLink交换机实现900GB/s带宽，而MI355X采用点对点直连，通信效率较低。为弥补这一短板，Zyphra开发了张量序列并行(TSP)与树状注意力(Tree Attention)算法。最终结果显示，尽管在单请求速度上NVIDIA B200仍领先，但在长文本场景下，Zyphra推理栈的吞吐量逐渐逼近B200，证明AMD在长文本生产环境中具备竞争力。
18:44 · 19/05/26·4.79K views·
Visit source
0
0

Disclaimer: OKX Orbit content is provided for informational purposes only. Learn more

Replies

No comments yet. Be the first to reply!

Related Flash News

Source avatarChainCatcher•17m ago

Grafana: The investigation found that recent security incidents have not affected customers' production systems or operations

Source avatarChainCatcher•46m ago

Huatai Securities: The Federal Reserve may raise interest rates twice next year

Source avatarChainCatcher•51m ago

Trump signed an executive order to review restrictions on crypto companies' access to U.S. payment systems

Source avatarChainCatcher•53m ago

Irish drug dealer Bitcoin address transferred 500 BTC again

Source avatarChainCatcher•1h ago

Paulson: Keep interest rates steady to assess economic conditions

Source avatarChainCatcher•1h ago

Paulson: The market considers a scenario where rates remain unchanged or rise is "healthy"

Source avatarChainCatcher•1h ago

Paulson: Current policy rates are appropriate, continuing to exert downward pressure on inflation

Source avatar币界网•2h ago

On-chain RWA market cap surpasses $65 billion, with Ethereum accounting for 33%

Source avatarChainCatcher•3h ago

Data: Tokenized stocks hit a record high in single-day trading volume, reaching $3.57 billion

Source avatarChainCatcher•3h ago

Deloitte effectively acquired the Blocknative team, which will stop API and Gas Network services