Taalas 晶片速度達 16k tps —— 但它們鎖定單一模型
amd 收購了 taalas，其晶片透過硬編碼大模型權重實現了 16k tokens/秒 的速度。這種以靈活性換取極致速度的方案，預示著向模型專用硬體的轉變。
amd acquired toronto-based taalas, which hard-codes ai model architecture and parameters directly into silicon to maximize inference speed. a demo chip running llama 3.1-8b achieved over 16,000 tokens per second per user, significantly outpacing standard gpus. the technology will be integrated into amd's accelerator roadmap, offering a specialized solution alongside its general-purpose instinct cards. this move signals a potential diversification in hardware design, balancing general-purpose compute with model-specific accelerators.