Muse Spark Open outperforms Mistral Large 4 on benchmark, but loses on agent tasks
In brief
- Muse Spark Open (Meta) leads Mistral Large 4 by 1 point on the Artificial Analysis index.
- Mistral Large 4 outperforms Muse Spark Open on five benchmarks, including Terminal-Bench and AutomationBench.
- Execution cost: $1,607 for Large 4 vs. $1,183 for Muse Spark Open at launch.
Meta's Muse Spark Open scores 39 compared to 38 for Mistral Large 4 on the Artificial Analysis index. However, Mistral's model outperforms Muse Spark Open on five benchmarks, including Terminal-Bench and AutomationBench. Execution costs and licensing terms for both models are also compared.
This summary gives you the essentials. The full article, its figures and quotes are on ActuIA.
Read the original articleAI-generated summary of the source, checked by rules. Report an error