The chatbot still remains the most popular AI assistant worldwide with over 1.1 billion monthly users, followed by Gemini with 662 million and Claude with 245 million.
Subjectively, it feels similar to models we used a year or two ago. Not that drastically different from what Anthropic and OpenAI offer today, but slightly worse. For instance, for complex coding tasks it offers basic solutions, while Claude often offers more options and details - as if it knows more.
Objectively, benchmarks. Mistral looks comparable to other open weight models (as another user mentioned), but not as good otherwise.
I see, that’s about the time they all got so good that I stopped trying to keep up with the latest benchmarks. It works perfectly for my needs so I definitely wouldn’t dismiss it for anyone wanting to switch to a European alternative.
Mistral has recently shown a good trajectory of improvement. It is already an important thing that there is a European mid range open weight model that can compete. (Frontier models need a lot more resources, it is important to compare apples with apples) This is good enough for many applications were data security and sovereignity are prime concerns. Of course, it would be good to have a frontier model, lets see how Large 4 will perform when we get there.
Subjectively, it feels similar to models we used a year or two ago. Not that drastically different from what Anthropic and OpenAI offer today, but slightly worse. For instance, for complex coding tasks it offers basic solutions, while Claude often offers more options and details - as if it knows more.
Objectively, benchmarks. Mistral looks comparable to other open weight models (as another user mentioned), but not as good otherwise.
With the results of chat out of the box I kind of agree with you that mistral feels behind.
However, there are some features that I really like and make the experience even better than chatgpt.
(I have never tried the paid version of any LLM chat so I can only compare free tiers)
I see, that’s about the time they all got so good that I stopped trying to keep up with the latest benchmarks. It works perfectly for my needs so I definitely wouldn’t dismiss it for anyone wanting to switch to a European alternative.
Sure, totally depends on your needs. But it’d be great if we had one of them frontier models in Europe.
Mistral has recently shown a good trajectory of improvement. It is already an important thing that there is a European mid range open weight model that can compete. (Frontier models need a lot more resources, it is important to compare apples with apples) This is good enough for many applications were data security and sovereignity are prime concerns. Of course, it would be good to have a frontier model, lets see how Large 4 will perform when we get there.