From 0673be955a574daecffcab95501aa922225dc40a Mon Sep 17 00:00:00 2001 From: Michael Neale Date: Fri, 8 May 2026 02:17:18 +1000 Subject: [PATCH] [blog] new post on findings with minimax and office QA benchmark (#8984) --- .../2026-05-04-officeqa-minimax-m25/index.md | 25 +++++++++++++++++++ 1 file changed, 25 insertions(+) create mode 100644 documentation/blog/2026-05-04-officeqa-minimax-m25/index.md diff --git a/documentation/blog/2026-05-04-officeqa-minimax-m25/index.md b/documentation/blog/2026-05-04-officeqa-minimax-m25/index.md new file mode 100644 index 0000000000..319177e111 --- /dev/null +++ b/documentation/blog/2026-05-04-officeqa-minimax-m25/index.md @@ -0,0 +1,25 @@ +--- +title: "Approaching frontier performance for 1/30th the cost" +description: "Using goose with MiniMax M2.5 on the Databricks OfficeQA benchmark" +authors: + - mic +--- + +Quick highlight: [Sentient AGI](https://x.com/SentientAGI/status/2046967422004154739) recently shared with us some results with a challenge called "Grounded Reasoning" where teams tackled the Databricks OfficeQA benchmark using the MiniMax (2.5) open model. + +Highlights from the linked article: + +> * Using goose with [MiniMax M2.5](https://www.minimax.io/) on the [OfficeQA benchmark from Databricks](https://www.databricks.com/blog/officeqa), we're seeing results approaching frontier model performance for **1/30th of the cost**. +> * Closed-source wins on accuracy (~80% vs ~70%), but MiniMax M2.5 ran at an average of $1.74 per run versus $56.53 for Opus 4.5. That's roughly 30× cheaper. +> * Switching to the @goose_oss harness beat alternatives by ~10% in accuracy and was 8× cheaper than the next option. We decided to further investigate this with independent testing. On Terminal Bench 2.0, we found a similar story—goose was 20x more token efficient (and cheaper) than OpenHands, and more than 40x cheaper than OpenCode. + +Check out the full post and results here: + +> **[https://x.com/SentientAGI/status/2046967422004154739](https://x.com/SentientAGI/status/2046967422004154739)** + + + + + + +