Built with Muse Publish a workflow
Social · Benchmarks & research

Muse for benchmarks & research.

Evals, comparisons and research findings about Muse models.

61 posts · page 1 of 3

Muse Voice Transcribe

Mark Zuckerberg@finkd · 1 Sept

Muse Voice Transcribe is MSL's first real-time audio perception model -- rolling out today. SOTA in streaming speech-to-text, it handles speaker diarization, and endpointing natively in a single model. https://t.co/LViMDSkbim

Artificial Analysis scores Muse Spark 1.3

Artificial Analysis@ArtificialAnlys · 2 Sept

Meta has released Muse Spark 1.3, their fourth Muse Spark model release in five months. Muse Spark 1.3 (max), which is in limited preview for Meta’s partners, scores 62 on the Artificial Analysis Intelligence Index, behind only Claude Fable 5.1 and Claude Opus 5. The variant https://t.co/D7eL8bGwAU

Original Muse Spark scores 52

Artificial Analysis@ArtificialAnlys · 8 Apr

Meta is back! Muse Spark scores 52 on the Artificial Analysis Intelligence Index, behind only Gemini 3.1 Pro, GPT-5.4, and Claude Opus 4.6. Muse Spark is the first new release since Llama 4 in April 2025 and also Meta's first release that is not open weights Muse Spark is a new https://t.co/HdzxubOFi3

Raschka on Glimmer's Gemma-like design

Sebastian Raschka@rasbt · 11 Aug

Whoa, Meta released a new open-weight LLM yesterday, something that hasn't happened since the good old Llama days. Their Meta Muse Glimmer model is a 30B multimodal reasoning model with a Gemma-like architecture design. (“Glimmer” is probably a wordplay on “Spark,” the more https://t.co/HcV1eHAeXb

Muse Image takes #2 in Image Arena

Arena.ai@arena · 7 Jul

Exciting news: Meta’s Muse Image just claimed #2 in the Image Arena! Muse Image from @AIatMeta now ranks second only to OpenAI's GPT Image 2, outperforming Nano Banana, Grok Imagine, MAI Image, and many other leading image models. It holds #2 across the board: Text-to-Image, https://t.co/577214iiqj

Spark 1.1 tops MedScribe and TaxEval

Vals AI@ValsAI · 9 Jul

Meta just released Muse Spark 1.1 and is the new SOTA on MedScribe and TaxEval, taking the top spot from Fable 5 while being 10x cheaper and twice as fast. Meta currently holds the top 2 spots on TaxEval It is also the new #1 on Harvey's Legal Agent Bench, dethroning Grok 4.5 https://t.co/0IjinLA6lq

Muse models take five STEM Olympiads

AI at Meta@AIatMeta · 6 Aug

To understand whether we're making genuine progress on reasoning, we entered our AI models in five STEM Olympiad competitions. The results: 🏅 Asian Physics Olympiad (APhO): Perfect score, theory exam 🏅 International Physics Olympiad (IPhO): Perfect score, theory exam 🥇 https://t.co/fh1h8I1d3S

20 self-improvement loops for under $1

Iam_@SPAC89 · 2 Sept

Muse Spark 1.3 Ultra Contributor vs Fable 5.1 xHigh Same prompt, both ran for roughly 2 hours The prompt had a self improvement rule: if the independent judges scored the result below 9.5/10, it had to keep improving and try again, What shocked me most was that Muse Spark just https://t.co/6fk99q5ZJI

Spark 1.2 scores 54 on the Intelligence Index

Artificial Analysis@ArtificialAnlys · 5 Aug

Meta has released Muse Spark 1.2. It's their third release in four months and scores 54 on the Artificial Analysis Intelligence Index, significantly improving agentic knowledge work capabilities over prior releases and putting Meta next to SpaceXAI in a tie for third place https://t.co/460hp9zIxB

Spark 1.3 tops Website Arena

Design Arena@DesignArena · 9 Sept

BREAKING: Muse Spark 1.3 (xhigh) takes 1st overall on Website Arena with an Elo of 1362! This is a jump of 5 positions from Muse Spark 1.2, establishing a new Pareto frontier for Speed and Price. Only a month after the release of Muse Spark 1.2, @AIatMeta has topped this https://t.co/FObUHjHTsj

Glimmer scores 35 on the Intelligence Index

Artificial Analysis@ArtificialAnlys · 10 Aug

Meta returns to open weights: Muse Glimmer, its first open-weights release since Llama 4, scores 35 on the Artificial Analysis Intelligence Index. It is a 30B-parameter model, and the first from Meta to be released under Apache 2.0 Muse Glimmer (high) arrives 16 months after https://t.co/W7rzNI15PX

Muse Spark 1.2 enters Vals Index top 5

Vals AI@ValsAI · 6 Aug

Muse Spark 1.2 just cracked the top 5 on the Vals Index, at just $0.69 per test. This is 3x cheaper than Kimi and 10x or more cheaper than Fable, Opus, and 5.6 Sol. https://t.co/E2pFFqQiBI

Meta's OpenCode token share hits 45%

Tom Collins@thetomcollins · 9 Sept

$META just went from 3.5% to 45.4% token share on OpenCode in just over two weeks Muse Spark 1.3 being good + free is enough to become the default for most users Default gets you usage → usage gets you data → data makes the next model better Anthropic and OpenAI can’t afford https://t.co/Vktxt3pgXI

Spark 1.3 moves the cost Pareto frontier

Artificial Analysis@ArtificialAnlys · 9 Sept

Last week the Intelligence Index vs Cost Pareto frontier moved out substantially. Claude Fable 5.1, Muse Spark 1.3, and GPT-6 Astra each set a new point in efficient intelligence Link to analysis: https://t.co/CoUVoX9XNT https://t.co/lu5PvRLt89

Spark 1.1 scores 51 on the Intelligence Index

Artificial Analysis@ArtificialAnlys · 10 Jul

Meta's Muse Spark 1.1 scores 51 on the Artificial Analysis Intelligence Index and is cost and token efficient compared to its peers Muse Spark 1.1 (xhigh) improves 8 points over Muse Spark 1.0 (43) in three months. It is effectively tied with GLM-5.2 (max), GPT-5.4 (xhigh), and https://t.co/f2NmTlrTDZ

105 planted bugs: Spark 1.3 vs frontier

Paweł Huryn@PawelHuryn · 13 Sept

So, I finally tested Muse Spark 1.3. 2 real repos, 105 planted bugs, find and fix what you can. Original harness and API. Big surprise: Muse Spark 1.3 (max): 33 Fable 5.1 (high): 33 Grok 4.6 (xhigh): 27 Opus 5 (max): 27 Muse Spark 1.3 (high): 19 Meta joined the frontier. https://t.co/eADWZly21Q

WildArtifactBench agent eval preview

AI at Meta@AIatMeta · 20 Aug

Today we’re also previewing WildArtifactBench, an internal evaluation framework designed to assess agents on complex, real-world tasks across diverse deliverable formats. By using win rates and Elo scores from human and agentic preference judges rather than strict ground-truth https://t.co/eXWkTrOmPo

Muse Video enters Video Arena at #3

Arena.ai@arena · 7 Jul

Meta Muse Video just entered the Video Arena at #3. @AIatMeta’s new video model scored 1459 in the Text-to-Video Arena. It outperforms Alibaba’s HappyHorse 1.0 by +30pts and ranks ahead of Grok Imagine, Sora 2 Pro and Google Veo-3.1 models. Meta has now reached the video AI https://t.co/zxDd2B0hwG

Spark 1.3 in Code Arena: WebDev top 10

Arena.ai@arena · 3 Sept

Muse Spark 1.3 (xHigh) just landed @AIatMeta back in the top 10 models for Code Arena: WebDev! This release is ~#10 in Code Arena: WebDev with 1623 pts (AutoEval). It’s performance is par with Claude Fable 5 at #8 (1628 pts) and GPT-5.6 Sol at #11 (1616 pts). Muse Spark 1.3 https://t.co/UJzY006sJi

Century of global GDP share analysis

Alexandr Wang@alexandr_wang · 12 Apr

i find muse spark is very good at data analysis—both finding relevant open-source data and analyzing it. for example, here's my results for analyzing global share of GDP over past century: https://t.co/pD4q7n7mqX https://t.co/xHcZTIgAl4

Glimmer architecture teardown

elie@eliebakouch · 10 Aug

extremely exciting to see meta getting back into open weight models with a 30B dense first, and soon muse spark 1.2 they used knowledge distillation from muse spark, architecture wise it's similar to gemma 4 (which is llama 3 + swa (again!) + vision encoder), with scale free QK https://t.co/tgNZsHgkxU

Simon Willison's notes on Muse Glimmer

Simon Willison@simonw · 11 Aug

I few notes on Meta's new Muse Glimmer 30B - their first Apache 2.0 licensed open weight model (the Llama models had a janky non-OSI license) https://t.co/dTWUxch85k

Top 100 open immunology questions via Muse + Jev

Derya Unutmaz, MD@DeryaTR_ · 18 Sept

Here is a crazy Jev @typesafeai example that I’m betting nobody has thought about: I asked @Muse from @Meta to use Jev to select the top 100 unanswered questions in immunology from 10,000 literature-grounded candidates. A few minutes later, it came back with some of the best

Spark 1.2 reaches #4 in Text Arena

Arena.ai@arena · 7 Aug

Exciting news: Muse Spark 1.2 (xHigh) by @AIatMeta is #4 in the Text Arena (1498 pts), and has reshaped the Pareto frontier! It is priced at $1.25/$4.25 per MToken. Congrats again to the @AIatMeta team on this release! https://t.co/fdw9iT5BvF

Questions

What have people actually used Muse for when it comes to benchmarks & research?

61 public posts describe it. Evals, comparisons and research findings about Muse models. Each card above quotes the poster or condenses their post, and links to the original.

Are these results verified?

No. Outcomes are what each poster reported. Built with Muse did not verify the savings, bookings or completions. 61 of the 61 posts are in the poster's own words; the rest are condensed summaries with a link back.

Can I try the same thing?

0 of these posts come with a prompt you can copy and adapt. Open Try the prompt on a card, paste it into Muse, and replace the bracketed parts with your own details.

How do I get Muse?

Muse is invite only in most places. Built with Muse runs a community pool of invite codes: take one, redeem it in the Muse app, then add your own for the next person.

Outcomes are what the poster reported. Built with Muse did not verify the savings, bookings, or completions. Posts with text_source tweet are the author's own words. Posts with text_source field-guide-summary are condensed from the public post by the EveryAI Muse field guide (snapshot 2026-09-14) and link back to the original. Some entries were first catalogued by shipwithmuse.live. Data updated 2026-10-09.