Taalas 芯片速度达 16k tps —— 但它们锁定单一模型
amd 收购了 taalas，其芯片通过硬编码大模型权重实现了 16k tokens/秒 的速度。这种以灵活性换取极致速度的方案，预示着向模型专用硬件的转变。
amd acquired toronto-based taalas, which hard-codes ai model architecture and parameters directly into silicon to maximize inference speed. a demo chip running llama 3.1-8b achieved over 16,000 tokens per second per user, significantly outpacing standard gpus. the technology will be integrated into amd's accelerator roadmap, offering a specialized solution alongside its general-purpose instinct cards. this move signals a potential diversification in hardware design, balancing general-purpose compute with model-specific accelerators.