rotative
techcrunch ai · August 4, 2026

Chinese model matches frontier in capability, zero in safety

saferai reports z.ai's glm-5.2 matches gpt-5.5 on cyber/bio benchmarks but fails every refusal test, proving open-weights lack enforcement.

read in 简体中文 · 繁體中文 · 日本語 · 한국어

a report by ai safety nonprofit saferai reveals that z.ai's glm-5.2 has narrowed the capability gap with proprietary leaders like gpt-5.5 and claude opus 4.7 on cyber and bio benchmarks. however, glm-5.2 refused 0% of offensive cyber and dual-use biology tasks during testing via its public api, while claude refused so consistently that the benchmark could not be completed. this illustrates a critical divergence in the ai landscape: while frontier labs rely on classifiers and api-level controls, open-weight models allow users to strip all safeguards upon downloading. saferai suggests the industry may need to shift toward pre-training data filtering to remove hazardous knowledge, though this remains difficult for cybersecurity capabilities that overlap with coding.

read at source ↗

← rotative