Read-only mirror of the MIREX Wiki, snapshot of 29 October 2026.
Open this page on the original wiki to edit it or to see newer changes.
2025:Music Reasoning QA Results
From MIREX Wiki
MMAR Results[edit]
| System | ACC | music ACC | mix-sound-music | mix-music-speech | mix-sound-music-speech |
|---|---|---|---|---|---|
| SAR-LM (w/ Qwen2.5-Omni) | 40.00% | 33.98% | 27.27% | 48.78% | 37.50% |
| Qwen2.5-Omni | 56.70% | 40.78% | 54.55% | 67.07% | 58.33% |
OMniBench Results[edit]
| System | ACC | music ACC |
|---|---|---|
| SAR-LM (w/ Qwen2.5-Omni) | 31.26% | 41.50% |
| Qwen2-Audio-7B-Instruct | 40.72% | 38.68% |