rotative
the decoder · July 30, 2026

Is a $100B data bet the only way past GPT's skill ceiling

andrew ho left openai to launch a data startup, arguing that scaling alone hits diminishing returns and labs must spend $100b on specialized datasets to fix reliability.

read in 简体中文 · 繁體中文 · 日本語 · 한국어

andrew ho departed openai after eight months to found a data company focused on high-value, missing skills like bioinformatics and lab evaluation, citing that current models like gpt-5.6 sol fail at these tasks 70% of the time. ho contends that simply scaling compute won't yield true generalization or reliability, forcing the industry to invest over $100b in specialized data acquisition. he is joined by skepticism from cambridge and google deepmind researchers who observe that new models are becoming more specialized rather than versatile, with capabilities in language and logic stagnating while coding improves. ho also criticized valuations of frontier labs as unsustainable given the rising costs of competing with efficient open-source models like qwen. this pivot implies that future ai advances depend less on parameter counts and more on curating expensive, domain-specific signal.

read at source ↗

← rotative