MiniMax M2.5 on DTP Benchmark

At a glance

Good enough on 3/35 tasks at the 95% bar. Cheapest qualifier on 0 tasks. Doesn't qualify on any: Financial Analysis & Trading Decisions, Content Summarization & Synthesis, Long-form Content Generation, Social & Promotional Content, Topic Organization & Clustering, Infrastructure & Utility.

Provider: MiniMax
Model name: MiniMax-M2.5
Qualifies on: 3 / 35 tasks (at 90% bar)
Cheapest qualifier on: 0 tasks

Cost vs quality across all tasks

qualifies at 90% bar · doesn't qualify · ★ this model is the best on that task. Lower + further right = cheaper + higher quality. Y-axis is log-scaled.

Per-task breakdown

Category	Task	Quality	Confidence	Cost / call	vs best	Qualifies @ 90%
Structured Data & Fact Extraction	claim_extraction autogenerated	5.90	high · n=100	$0.001534	-180%	no
Structured Data & Fact Extraction	Generic TOC Extraction	0.00	low · n=0	$0.000900	—	no
Structured Data & Fact Extraction	region_identification autogenerated	6.53	low · n=33	$0.002057	70%	no
Structured Data & Fact Extraction	S1 TOC extraction	0.00	low · n=0	$0.003431	—	no
Structured Data & Fact Extraction	structured_output_extraction autogenerated	9.71	medium · n=85	$0.002152	30%	✓
Financial Analysis & Trading Decisions	onboarding_prospect_analysis autogenerated	0.00	low · n=0	$0.002314	—	no
Financial Analysis & Trading Decisions	SEC Filling Analysis	5.05	medium · n=100	$0.005987	92%	no
Financial Analysis & Trading Decisions	sec-s1-chunk-analysis autogenerated	7.66	high · n=100	$0.010393	91%	no
Financial Analysis & Trading Decisions	synthesis_analysis autogenerated	7.26	medium · n=40	$0.012527	81%	no
Financial Analysis & Trading Decisions	Trading Recommendation	6.48	high · n=100	$0.022478	84%	no
Infrastructure & Utility	claim_refinement autogenerated	6.38	high · n=100	$0.001584	24%	no
Infrastructure & Utility	image_prompt_generation autogenerated	7.21	ranked · n=100	$0.002711	90%	no
Infrastructure & Utility	LLM Prompt Adaptation	6.83	high · n=100	$0.007227	84%	no
Infrastructure & Utility	markdown_newline_repair autogenerated	0.00	low · n=0	$0.027260	—	no
Infrastructure & Utility	metadata_paragraph_improvement autogenerated	7.06	medium · n=100	$0.000538	34%	no
Infrastructure & Utility	onboarding_chapter_prompt_generation autogenerated	7.13	medium · n=91	$0.035164	92%	no
Infrastructure & Utility	query_generation autogenerated	7.30	medium · n=95	$0.002149	90%	no
Infrastructure & Utility	query_validation autogenerated	7.09	medium · n=100	$0.000896	-430%	no
Infrastructure & Utility	Translation	6.19	medium · n=100	$0.002668	92%	no
Long-form Content Generation	author_soul_generation autogenerated	7.83	high · n=100	$0.005806	95%	no
Long-form Content Generation	Claim-Referenced Analyst Writing (pooled)	7.84	high · n=99	$0.009454	82%	no
Long-form Content Generation	onboarding_chapter_generation autogenerated	0.00	low · n=0	$0.015548	—	no
Long-form Content Generation	section_generation autogenerated	7.81	low · n=8	$0.003040	37%	no
Long-form Content Generation	Substack Newsletter (pooled)	7.75	low · n=6	$0.002672	95%	no
Long-form Content Generation	theme_generation autogenerated	0.00	low · n=0	$0.005728	—	no
Relevance, Classification & Matching	at_content_domain_suggest autogenerated	0.00	low · n=0	$0.001656	—	no
Relevance, Classification & Matching	Author Matching	6.15	high · n=100	$0.004280	83%	no
Relevance, Classification & Matching	Language Detection	10.00	ranked · n=100	$0.000121	-8%	✓
Relevance, Classification & Matching	Relevance Scoring (POST)	2.97	high · n=100	$0.000900	78%	no
Relevance, Classification & Matching	Relevance Scoring (Topic Report)	8.44	medium · n=60	$0.000900	-462%	✓
Relevance, Classification & Matching	Relevance Scoring (X Post)	5.90	low · n=14	$0.000900	—	no
Relevance, Classification & Matching	subreddit_selection autogenerated	4.13	ranked · n=84	$0.002192	90%	no
Relevance, Classification & Matching	subreddit_vetting autogenerated	0.00	low · n=0	$0.001517	—	no
Relevance, Classification & Matching	topic_client_matching autogenerated	5.10	medium · n=100	$0.009896	-221%	no
Relevance, Classification & Matching	vetted_site_selection autogenerated	0.00	low · n=0	$0.012278	—	no
Relevance, Classification & Matching	x_post_selection autogenerated	7.55	high · n=100	$0.000953	94%	no
Social & Promotional Content	auto_reddit_post_generation autogenerated	6.44	high · n=100	$0.015139	70%	no
Social & Promotional Content	Social Post Promo (pooled)	6.04	high · n=100	$0.001007	-640%	no
Social & Promotional Content	x_com_messages_for_promotion autogenerated	9.50	low · n=1	$0.017963	—	no
Content Summarization & Synthesis	content-summarization autogenerated	6.19	high · n=100	$0.004388	-114%	no
Content Summarization & Synthesis	executive_summary_generation autogenerated	8.20	low · n=1	$0.018734	—	no
Content Summarization & Synthesis	synthesis_of_titles_for_publication autogenerated	7.09	high · n=81	$0.003053	70%	no
Topic Organization & Clustering	ps_section_reassignment autogenerated	0.00	low · n=0	$0.002329	—	no
Topic Organization & Clustering	Topic Discovery Clustering (pooled)	4.13	medium · n=100	$0.033016	89%	no
Topic Organization & Clustering	topic_cluster_naming autogenerated	7.40	high · n=100	$0.003952	89%	no
Topic Organization & Clustering	topic_clustering_assign_sections autogenerated	8.29	medium · n=100	$0.000760	89%	no
Topic Organization & Clustering	topic_sequence_determination autogenerated	0.00	low · n=0	$0.003519	—	no