Mistral open-sources AI model despite warning it could aid cyberattacks

Publisher excerpt From CSO Online

A trillion-parameter AI model that its developer says could help attackers carry out real cyberattacks is now free to download, modify and run outside the developer’s control. Mistral AI released the open weights of Mistral Large 4, which it calls “Le Chonk,” on Thursday, weeks after putting the multimodal model into public preview. The Paris-based company said it had monitored cybersecurity-related use of the preview in live traffic. “Though we observed the model refusing to comply with black-box attacks against live targets, we see a potential for uplift to conduct real attacks,” the company wrote in a blog post announcing the release. Mistral is modifying the model’s guardrails and will keep updating them in the coming months, the post added. Guardrails stop at the API Those updates can reach only users of Mistral’s API and hosted services. Mistral did not say how those updates would apply to weights already downloaded. Its post says organizations can run and improve Large 4 on their own infrastructure without depending on Mistral to serve it through an API. Hugging Face, which hosts the weights, noted in its own launch post that open weights put both the usage policy and the deployment under the user’s control. In July, the UK’s AI Security Institute reported that leading open-weight models trailed the closed frontier on cyber tasks by four to seven months. For highly cyber-capable models, open release creates “a persistent and irreversible risk of misuse,” the ins…

Excerpt only, shown with attribution. This content belongs to the original publisher and has not been independently verified by CyberSecurity.pk.