CyberSecQwen-4B, 사이버 벤치마크에서 8B 경쟁 모델에 필적
Alibaba 연구진이 CyberSecQwen-4B를 공개했습니다. 이 40억(4B) 파라미터 모델은 소비자용 GPU에서 구동 가능하면서도 사이버 작업에서 Cisco의 80억(8B) 모델 정확도의 97.3%를 유지합니다.
Hugging Face released CyberSecQwen-4B, a 4-billion parameter model fine-tuned for defensive cybersecurity. The model achieves 97.3% of the CTI-RCM accuracy of Cisco's Foundation-Sec-Instruct-8B and exceeds its CTI-MCQ score by +8.7 points, despite using half the parameters. It runs efficiently on a single 12 GB consumer GPU or a single AMD Instinct MI300X 192 GB instance, enabling local processing of sensitive data like incident reports and malware samples without API calls. The training pipeline used full bf16 precision and FlashAttention-2 on the AMD MI300X.