MiST: Mid-Training LLMs for Cybersecurity
Cybersecurity combines high-stakes analysis with complex technical language, making it an impactful and challenging domain for LLMs. We present MiST (Mid-trained Security Transformer), a suite of 8B and 32B models that achieve strong performance on public cybersecurity benchmarks. We use mid-training as an intermediate...
O. Ovadia, Elad Ben Zaken, Elad Guttman et al.
· 0 citations