CyberSecQwen-4B matches 8B rivals on cyber benchmarks
alibaba researchers released cybersecqwen-4b, a 4b parameter model that retains 97.3% of cisco's 8b model accuracy on cyber tasks while fitting on consumer gpu.
Hugging Face released CyberSecQwen-4B, a 4-billion parameter model fine-tuned for defensive cybersecurity. The model achieves 97.3% of the CTI-RCM accuracy of Cisco's Foundation-Sec-Instruct-8B and exceeds its CTI-MCQ score by +8.7 points, despite using half the parameters. It runs efficiently on a single 12 GB consumer GPU or a single AMD Instinct MI300X 192 GB instance, enabling local processing of sensitive data like incident reports and malware samples without API calls. The training pipeline used full bf16 precision and FlashAttention-2 on the AMD MI300X.