Mistral Releases Le Chonk, a New AI Model Competing with Top-End Models

·

Mistral has released a new artificial intelligence model called Le Chonk, which the company claims can compete with top-end models from the US and China. The model is currently available in preview and will be finalized by the end of this month.

The new AI model, known as Mistral Large 4 or Le Chonk for short, has a massive 1 trillion parameters. This makes it one of the largest open-weight models developed outside of China, according to Mistral.

Le Chonk is designed to be highly versatile and can be used in various domains such as coding, cyberdefense, manufacturing, finance, electrical engineering, and more. The model’s capabilities are optimized for these specific areas, allowing it to perform well on tasks that might not be a priority for other top-end models.

Guillaume Lample, cofounder and chief scientist at Mistral, emphasized the potential of Le Chonk in an interview with WIRED. He noted that there are many domains where current AI models may struggle or lack focus, providing opportunities for improvement.

Mistral claims to have trained its model from scratch without relying on distillation techniques used by some Chinese labs. This approach allows Mistral to avoid potential issues related to the training of smaller models on larger ones’ outputs.

Le Chonk is an open-weight model, which means it can be run and customized by anyone with access to sufficient compute resources. The cost of running such a model is directly tied to the amount of computing power consumed, making it significantly cheaper than proprietary models from top-end labs like OpenAI and Anthropic.

Mistral’s release of Le Chonk aims to bridge the performance gap between open-source and proprietary AI models. By providing a competitive alternative to releases from China, Mistral hopes to eliminate any remaining reasons businesses might hesitate to choose an open-source model.

Lample highlighted that with less capital and fewer compute resources than OpenAI and Anthropic, Mistral has traditionally lagged behind in terms of model performance, revenue, and release frequency. However, the company’s recent $3.3 billion funding round at a $24 billion valuation suggests it is gaining ground.

Discussion

No messages yet. Be the first to write.