DTP LLM Benchmark

DTP LLM Benchmarkhttps://llm-bench.kapualabs.com/Recent content on DTP LLM BenchmarkHugoenThu, 21 May 2026 17:20:36 +0000DTP LLM Benchmark launcheshttps://llm-bench.kapualabs.com/journal/launch/Thu, 21 May 2026 17:20:36 +0000https://llm-bench.kapualabs.com/journal/launch/<p>We’re launching the DTP LLM Benchmark — independent rankings of leading LLMs on real production tasks from our financial-analyst pipeline at Nova.</p> <p>The premise is simple: most LLM tasks have a quality <em>threshold</em>, not a quality <em>maximum</em>. The best-performing model is overkill for most steps. We show you which models actually clear your quality bar on each task, and rank them by cost ascending. The cheapest qualifier wins — not the highest-scoring one.</p>About — DTP LLM Benchmarkhttps://llm-bench.kapualabs.com/about/Mon, 01 Jan 0001 00:00:00 +0000https://llm-bench.kapualabs.com/about/<h2 id="what-this-is">What this is</h2> <p>An independent, transparent LLM benchmark scoped to the work of building LLM-backed business processes. Every score on this site is derived from production workloads run by Capua Labs through DTP — not from synthetic test sets, not from customer data, not from self-reported model numbers.</p> <h2 id="methodology">Methodology</h2> <p>Full methodology lives at <a href="https://llm-bench.kapualabs.com/methodology/">/methodology/</a> — what the quality score is, how confidence is gated, what fan-out and judging means, why the slider default moves week to week.</p>Best LLMs for activity_promo_generation autogenerated — DTP Benchmarkhttps://llm-bench.kapualabs.com/task/activity_promo_generation/Mon, 01 Jan 0001 00:00:00 +0000https://llm-bench.kapualabs.com/task/activity_promo_generation/Best LLMs for at_content_domain_suggest autogenerated — DTP Benchmarkhttps://llm-bench.kapualabs.com/task/at_content_domain_suggest/Mon, 01 Jan 0001 00:00:00 +0000https://llm-bench.kapualabs.com/task/at_content_domain_suggest/Best LLMs for Author Matching — DTP Benchmarkhttps://llm-bench.kapualabs.com/task/author_matching/Mon, 01 Jan 0001 00:00:00 +0000https://llm-bench.kapualabs.com/task/author_matching/Best LLMs for author_living_check autogenerated — DTP Benchmarkhttps://llm-bench.kapualabs.com/task/author_living_check/Mon, 01 Jan 0001 00:00:00 +0000https://llm-bench.kapualabs.com/task/author_living_check/Best LLMs for author_soul_generation autogenerated — DTP Benchmarkhttps://llm-bench.kapualabs.com/task/author_soul_generation/Mon, 01 Jan 0001 00:00:00 +0000https://llm-bench.kapualabs.com/task/author_soul_generation/Best LLMs for auto_reddit_post_generation autogenerated — DTP Benchmarkhttps://llm-bench.kapualabs.com/task/auto_reddit_post_generation/Mon, 01 Jan 0001 00:00:00 +0000https://llm-bench.kapualabs.com/task/auto_reddit_post_generation/Best LLMs for claim_extraction autogenerated — DTP Benchmarkhttps://llm-bench.kapualabs.com/task/claim_extraction/Mon, 01 Jan 0001 00:00:00 +0000https://llm-bench.kapualabs.com/task/claim_extraction/Best LLMs for claim_refinement autogenerated — DTP Benchmarkhttps://llm-bench.kapualabs.com/task/claim_refinement/Mon, 01 Jan 0001 00:00:00 +0000https://llm-bench.kapualabs.com/task/claim_refinement/Best LLMs for Claim-Referenced Analyst Writing (pooled) — DTP Benchmarkhttps://llm-bench.kapualabs.com/task/claim_referenced_analyst_writing/Mon, 01 Jan 0001 00:00:00 +0000https://llm-bench.kapualabs.com/task/claim_referenced_analyst_writing/Best LLMs for Content Summarization & Synthesis — DTP Benchmarkhttps://llm-bench.kapualabs.com/category/summarization_and_synthesis/Mon, 01 Jan 0001 00:00:00 +0000https://llm-bench.kapualabs.com/category/summarization_and_synthesis/Best LLMs for content-summarization autogenerated — DTP Benchmarkhttps://llm-bench.kapualabs.com/task/content-summarization/Mon, 01 Jan 0001 00:00:00 +0000https://llm-bench.kapualabs.com/task/content-summarization/Best LLMs for Direct Browse Content Synthesis — DTP Benchmarkhttps://llm-bench.kapualabs.com/task/direct-browse-content-synthesis/Mon, 01 Jan 0001 00:00:00 +0000https://llm-bench.kapualabs.com/task/direct-browse-content-synthesis/Best LLMs for executive_summary_generation autogenerated — DTP Benchmarkhttps://llm-bench.kapualabs.com/task/executive_summary_generation/Mon, 01 Jan 0001 00:00:00 +0000https://llm-bench.kapualabs.com/task/executive_summary_generation/Best LLMs for Financial Analysis & Trading Decisions — DTP Benchmarkhttps://llm-bench.kapualabs.com/category/financial_analysis_and_trading/Mon, 01 Jan 0001 00:00:00 +0000https://llm-bench.kapualabs.com/category/financial_analysis_and_trading/Best LLMs for Generic TOC Extraction — DTP Benchmarkhttps://llm-bench.kapualabs.com/task/generic-toc-extraction/Mon, 01 Jan 0001 00:00:00 +0000https://llm-bench.kapualabs.com/task/generic-toc-extraction/Best LLMs for image_prompt_generation autogenerated — DTP Benchmarkhttps://llm-bench.kapualabs.com/task/image_prompt_generation/Mon, 01 Jan 0001 00:00:00 +0000https://llm-bench.kapualabs.com/task/image_prompt_generation/Best LLMs for Infrastructure & Utility — DTP Benchmarkhttps://llm-bench.kapualabs.com/category/infrastructure_and_utility/Mon, 01 Jan 0001 00:00:00 +0000https://llm-bench.kapualabs.com/category/infrastructure_and_utility/Best LLMs for Language Detection — DTP Benchmarkhttps://llm-bench.kapualabs.com/task/language-detection/Mon, 01 Jan 0001 00:00:00 +0000https://llm-bench.kapualabs.com/task/language-detection/Best LLMs for LLM Prompt Adaptation — DTP Benchmarkhttps://llm-bench.kapualabs.com/task/prompt-adaptation/Mon, 01 Jan 0001 00:00:00 +0000https://llm-bench.kapualabs.com/task/prompt-adaptation/Best LLMs for Long-form Content Generation — DTP Benchmarkhttps://llm-bench.kapualabs.com/category/long_form_writing/Mon, 01 Jan 0001 00:00:00 +0000https://llm-bench.kapualabs.com/category/long_form_writing/Best LLMs for markdown_newline_repair autogenerated — DTP Benchmarkhttps://llm-bench.kapualabs.com/task/markdown_newline_repair/Mon, 01 Jan 0001 00:00:00 +0000https://llm-bench.kapualabs.com/task/markdown_newline_repair/Best LLMs for metadata_paragraph_improvement autogenerated — DTP Benchmarkhttps://llm-bench.kapualabs.com/task/metadata_paragraph_improvement/Mon, 01 Jan 0001 00:00:00 +0000https://llm-bench.kapualabs.com/task/metadata_paragraph_improvement/Best LLMs for onboarding_chapter_generation autogenerated — DTP Benchmarkhttps://llm-bench.kapualabs.com/task/onboarding_chapter_generation/Mon, 01 Jan 0001 00:00:00 +0000https://llm-bench.kapualabs.com/task/onboarding_chapter_generation/Best LLMs for onboarding_chapter_prompt_generation autogenerated — DTP Benchmarkhttps://llm-bench.kapualabs.com/task/onboarding_chapter_prompt_generation/Mon, 01 Jan 0001 00:00:00 +0000https://llm-bench.kapualabs.com/task/onboarding_chapter_prompt_generation/Best LLMs for onboarding_prospect_analysis autogenerated — DTP Benchmarkhttps://llm-bench.kapualabs.com/task/onboarding_prospect_analysis/Mon, 01 Jan 0001 00:00:00 +0000https://llm-bench.kapualabs.com/task/onboarding_prospect_analysis/Best LLMs for ps_section_reassignment autogenerated — DTP Benchmarkhttps://llm-bench.kapualabs.com/task/ps_section_reassignment/Mon, 01 Jan 0001 00:00:00 +0000https://llm-bench.kapualabs.com/task/ps_section_reassignment/Best LLMs for query_generation autogenerated — DTP Benchmarkhttps://llm-bench.kapualabs.com/task/query_generation/Mon, 01 Jan 0001 00:00:00 +0000https://llm-bench.kapualabs.com/task/query_generation/Best LLMs for query_validation autogenerated — DTP Benchmarkhttps://llm-bench.kapualabs.com/task/query_validation/Mon, 01 Jan 0001 00:00:00 +0000https://llm-bench.kapualabs.com/task/query_validation/Best LLMs for region_identification autogenerated — DTP Benchmarkhttps://llm-bench.kapualabs.com/task/region_identification/Mon, 01 Jan 0001 00:00:00 +0000https://llm-bench.kapualabs.com/task/region_identification/Best LLMs for Relevance Scoring (POST) — DTP Benchmarkhttps://llm-bench.kapualabs.com/task/relevance_scoring_post/Mon, 01 Jan 0001 00:00:00 +0000https://llm-bench.kapualabs.com/task/relevance_scoring_post/Best LLMs for Relevance Scoring (Topic Report) — DTP Benchmarkhttps://llm-bench.kapualabs.com/task/relevance_scoring_topic_report/Mon, 01 Jan 0001 00:00:00 +0000https://llm-bench.kapualabs.com/task/relevance_scoring_topic_report/Best LLMs for Relevance Scoring (X Post) — DTP Benchmarkhttps://llm-bench.kapualabs.com/task/relevance_scoring_x_post/Mon, 01 Jan 0001 00:00:00 +0000https://llm-bench.kapualabs.com/task/relevance_scoring_x_post/Best LLMs for Relevance, Classification & Matching — DTP Benchmarkhttps://llm-bench.kapualabs.com/category/relevance_and_classification/Mon, 01 Jan 0001 00:00:00 +0000https://llm-bench.kapualabs.com/category/relevance_and_classification/Best LLMs for report_image_generation autogenerated — DTP Benchmarkhttps://llm-bench.kapualabs.com/task/report_image_generation/Mon, 01 Jan 0001 00:00:00 +0000https://llm-bench.kapualabs.com/task/report_image_generation/Best LLMs for S1 TOC extraction — DTP Benchmarkhttps://llm-bench.kapualabs.com/task/s1-toc-extraction/Mon, 01 Jan 0001 00:00:00 +0000https://llm-bench.kapualabs.com/task/s1-toc-extraction/Best LLMs for SEC Filling Analysis — DTP Benchmarkhttps://llm-bench.kapualabs.com/task/sec-filling-analysis/Mon, 01 Jan 0001 00:00:00 +0000https://llm-bench.kapualabs.com/task/sec-filling-analysis/Best LLMs for sec-s1-chunk-analysis autogenerated — DTP Benchmarkhttps://llm-bench.kapualabs.com/task/sec-s1-chunk-analysis/Mon, 01 Jan 0001 00:00:00 +0000https://llm-bench.kapualabs.com/task/sec-s1-chunk-analysis/Best LLMs for section_generation autogenerated — DTP Benchmarkhttps://llm-bench.kapualabs.com/task/section_generation/Mon, 01 Jan 0001 00:00:00 +0000https://llm-bench.kapualabs.com/task/section_generation/Best LLMs for Social & Promotional Content — DTP Benchmarkhttps://llm-bench.kapualabs.com/category/social_and_promotional/Mon, 01 Jan 0001 00:00:00 +0000https://llm-bench.kapualabs.com/category/social_and_promotional/Best LLMs for Social Post Promo (pooled) — DTP Benchmarkhttps://llm-bench.kapualabs.com/task/social_post_promo/Mon, 01 Jan 0001 00:00:00 +0000https://llm-bench.kapualabs.com/task/social_post_promo/Best LLMs for Structured Data & Fact Extraction — DTP Benchmarkhttps://llm-bench.kapualabs.com/category/extraction_and_parsing/Mon, 01 Jan 0001 00:00:00 +0000https://llm-bench.kapualabs.com/category/extraction_and_parsing/Best LLMs for structured_output_extraction autogenerated — DTP Benchmarkhttps://llm-bench.kapualabs.com/task/structured_output_extraction/Mon, 01 Jan 0001 00:00:00 +0000https://llm-bench.kapualabs.com/task/structured_output_extraction/Best LLMs for subreddit_selection autogenerated — DTP Benchmarkhttps://llm-bench.kapualabs.com/task/subreddit_selection/Mon, 01 Jan 0001 00:00:00 +0000https://llm-bench.kapualabs.com/task/subreddit_selection/Best LLMs for subreddit_vetting autogenerated — DTP Benchmarkhttps://llm-bench.kapualabs.com/task/subreddit_vetting/Mon, 01 Jan 0001 00:00:00 +0000https://llm-bench.kapualabs.com/task/subreddit_vetting/Best LLMs for Substack Newsletter (pooled) — DTP Benchmarkhttps://llm-bench.kapualabs.com/task/substack_newsletter/Mon, 01 Jan 0001 00:00:00 +0000https://llm-bench.kapualabs.com/task/substack_newsletter/Best LLMs for synthesis_analysis autogenerated — DTP Benchmarkhttps://llm-bench.kapualabs.com/task/synthesis_analysis/Mon, 01 Jan 0001 00:00:00 +0000https://llm-bench.kapualabs.com/task/synthesis_analysis/Best LLMs for synthesis_of_titles_for_publication autogenerated — DTP Benchmarkhttps://llm-bench.kapualabs.com/task/synthesis_of_titles_for_publication/Mon, 01 Jan 0001 00:00:00 +0000https://llm-bench.kapualabs.com/task/synthesis_of_titles_for_publication/Best LLMs for theme_generation autogenerated — DTP Benchmarkhttps://llm-bench.kapualabs.com/task/theme_generation/Mon, 01 Jan 0001 00:00:00 +0000https://llm-bench.kapualabs.com/task/theme_generation/Best LLMs for Topic Discovery Clustering (pooled) — DTP Benchmarkhttps://llm-bench.kapualabs.com/task/topic_discovery_clustering/Mon, 01 Jan 0001 00:00:00 +0000https://llm-bench.kapualabs.com/task/topic_discovery_clustering/Best LLMs for Topic Organization & Clustering — DTP Benchmarkhttps://llm-bench.kapualabs.com/category/topic_organization/Mon, 01 Jan 0001 00:00:00 +0000https://llm-bench.kapualabs.com/category/topic_organization/Best LLMs for topic_client_matching autogenerated — DTP Benchmarkhttps://llm-bench.kapualabs.com/task/topic_client_matching/Mon, 01 Jan 0001 00:00:00 +0000https://llm-bench.kapualabs.com/task/topic_client_matching/Best LLMs for topic_cluster_naming autogenerated — DTP Benchmarkhttps://llm-bench.kapualabs.com/task/topic_cluster_naming/Mon, 01 Jan 0001 00:00:00 +0000https://llm-bench.kapualabs.com/task/topic_cluster_naming/Best LLMs for topic_clustering_assign_sections autogenerated — DTP Benchmarkhttps://llm-bench.kapualabs.com/task/topic_clustering_assign_sections/Mon, 01 Jan 0001 00:00:00 +0000https://llm-bench.kapualabs.com/task/topic_clustering_assign_sections/Best LLMs for topic_sequence_determination autogenerated — DTP Benchmarkhttps://llm-bench.kapualabs.com/task/topic_sequence_determination/Mon, 01 Jan 0001 00:00:00 +0000https://llm-bench.kapualabs.com/task/topic_sequence_determination/Best LLMs for Trading Recommendation — DTP Benchmarkhttps://llm-bench.kapualabs.com/task/trading_recommendation/Mon, 01 Jan 0001 00:00:00 +0000https://llm-bench.kapualabs.com/task/trading_recommendation/Best LLMs for Translation — DTP Benchmarkhttps://llm-bench.kapualabs.com/task/translation/Mon, 01 Jan 0001 00:00:00 +0000https://llm-bench.kapualabs.com/task/translation/Best LLMs for vetted_site_selection autogenerated — DTP Benchmarkhttps://llm-bench.kapualabs.com/task/vetted_site_selection/Mon, 01 Jan 0001 00:00:00 +0000https://llm-bench.kapualabs.com/task/vetted_site_selection/Best LLMs for x_com_messages_for_promotion autogenerated — DTP Benchmarkhttps://llm-bench.kapualabs.com/task/x_com_messages_for_promotion/Mon, 01 Jan 0001 00:00:00 +0000https://llm-bench.kapualabs.com/task/x_com_messages_for_promotion/Best LLMs for x_post_selection autogenerated — DTP Benchmarkhttps://llm-bench.kapualabs.com/task/x_post_selection/Mon, 01 Jan 0001 00:00:00 +0000https://llm-bench.kapualabs.com/task/x_post_selection/Claude Opus 4.7 on DTP Benchmarkhttps://llm-bench.kapualabs.com/model/claude-opus-47/Mon, 01 Jan 0001 00:00:00 +0000https://llm-bench.kapualabs.com/model/claude-opus-47/Claude Sonnet 4.6 on DTP Benchmarkhttps://llm-bench.kapualabs.com/model/claude-sonnet-46/Mon, 01 Jan 0001 00:00:00 +0000https://llm-bench.kapualabs.com/model/claude-sonnet-46/DeepSeek V4 Flash on DTP Benchmarkhttps://llm-bench.kapualabs.com/model/deepseek-v4-flash/Mon, 01 Jan 0001 00:00:00 +0000https://llm-bench.kapualabs.com/model/deepseek-v4-flash/DeepSeek V4 Pro on DTP Benchmarkhttps://llm-bench.kapualabs.com/model/deepseek-v4-pro/Mon, 01 Jan 0001 00:00:00 +0000https://llm-bench.kapualabs.com/model/deepseek-v4-pro/Gemini 3 Flash Preview on DTP Benchmarkhttps://llm-bench.kapualabs.com/model/gemini-3-flash-preview/Mon, 01 Jan 0001 00:00:00 +0000https://llm-bench.kapualabs.com/model/gemini-3-flash-preview/Gemini 3 Pro Image Preview on DTP Benchmarkhttps://llm-bench.kapualabs.com/model/gemini-3-pro-image-preview/Mon, 01 Jan 0001 00:00:00 +0000https://llm-bench.kapualabs.com/model/gemini-3-pro-image-preview/Gemini 3.1 Flash Image Preview on DTP Benchmarkhttps://llm-bench.kapualabs.com/model/gemini-31-flash-image-preview/Mon, 01 Jan 0001 00:00:00 +0000https://llm-bench.kapualabs.com/model/gemini-31-flash-image-preview/Gemini 3.1 Flash Lite on DTP Benchmarkhttps://llm-bench.kapualabs.com/model/gemini-31-flash-lite/Mon, 01 Jan 0001 00:00:00 +0000https://llm-bench.kapualabs.com/model/gemini-31-flash-lite/Gemini 3.1 Pro Preview on DTP Benchmarkhttps://llm-bench.kapualabs.com/model/gemini-31-pro-preview/Mon, 01 Jan 0001 00:00:00 +0000https://llm-bench.kapualabs.com/model/gemini-31-pro-preview/GPT-5.4 mini on DTP Benchmarkhttps://llm-bench.kapualabs.com/model/gpt-54-mini/Mon, 01 Jan 0001 00:00:00 +0000https://llm-bench.kapualabs.com/model/gpt-54-mini/GPT-5.4 nano on DTP Benchmarkhttps://llm-bench.kapualabs.com/model/gpt-54-nano/Mon, 01 Jan 0001 00:00:00 +0000https://llm-bench.kapualabs.com/model/gpt-54-nano/GPT-5.5 on DTP Benchmarkhttps://llm-bench.kapualabs.com/model/gpt-55/Mon, 01 Jan 0001 00:00:00 +0000https://llm-bench.kapualabs.com/model/gpt-55/GPT-image-1.5 on DTP Benchmarkhttps://llm-bench.kapualabs.com/model/gpt-image-15/Mon, 01 Jan 0001 00:00:00 +0000https://llm-bench.kapualabs.com/model/gpt-image-15/Haiku 4.5 on DTP Benchmarkhttps://llm-bench.kapualabs.com/model/haiku-45/Mon, 01 Jan 0001 00:00:00 +0000https://llm-bench.kapualabs.com/model/haiku-45/Imagen 4.0 Fast on DTP Benchmarkhttps://llm-bench.kapualabs.com/model/imagen-40-fast/Mon, 01 Jan 0001 00:00:00 +0000https://llm-bench.kapualabs.com/model/imagen-40-fast/Imagen 4.0 on DTP Benchmarkhttps://llm-bench.kapualabs.com/model/imagen-40/Mon, 01 Jan 0001 00:00:00 +0000https://llm-bench.kapualabs.com/model/imagen-40/Imagen 4.0 Ultra on DTP Benchmarkhttps://llm-bench.kapualabs.com/model/imagen-40-ultra/Mon, 01 Jan 0001 00:00:00 +0000https://llm-bench.kapualabs.com/model/imagen-40-ultra/Kimi K2.6 on DTP Benchmarkhttps://llm-bench.kapualabs.com/model/kimi-k26/Mon, 01 Jan 0001 00:00:00 +0000https://llm-bench.kapualabs.com/model/kimi-k26/Methodology — DTP LLM Benchmarkhttps://llm-bench.kapualabs.com/methodology/Mon, 01 Jan 0001 00:00:00 +0000https://llm-bench.kapualabs.com/methodology/<h2 id="what-this-site-does">What this site does</h2> <p>Most production LLM tasks have a quality <em>threshold</em>, not a quality <em>maximum</em>. Once a model clears the bar, additional capability is unused — you’re paying for headroom your pipeline doesn’t exercise. This site shows you which models clear your quality bar on each step of your pipeline, and ranks them by cost ascending so you can pick the right-sized model rather than reaching for the best-performing model by default.</p>MiniMax M2.5 on DTP Benchmarkhttps://llm-bench.kapualabs.com/model/minimax-m25/Mon, 01 Jan 0001 00:00:00 +0000https://llm-bench.kapualabs.com/model/minimax-m25/Qwen 3.5 Flash on DTP Benchmarkhttps://llm-bench.kapualabs.com/model/qwen-35-flash/Mon, 01 Jan 0001 00:00:00 +0000https://llm-bench.kapualabs.com/model/qwen-35-flash/Qwen 3.6 Plus on DTP Benchmarkhttps://llm-bench.kapualabs.com/model/qwen-36-plus/Mon, 01 Jan 0001 00:00:00 +0000https://llm-bench.kapualabs.com/model/qwen-36-plus/Subscribe — DTP LLM Benchmarkhttps://llm-bench.kapualabs.com/subscribe/Mon, 01 Jan 0001 00:00:00 +0000https://llm-bench.kapualabs.com/subscribe/<h2 id="subscribe-to-the-journal">Subscribe to the journal</h2> <p>Once a week, we publish a short writeup of what changed in the snapshot — new models that landed, rank shifts on tasks that matter, what the slider’s default movement implies. Occasional deeper dives on methodology, judge mechanics, and what we’re learning about model selection at scale.</p> <p>No marketing, no upsells. You can unsubscribe at any time.</p> <form action="https://buttondown.com/api/emails/embed-subscribe/dtp-llm-bench" method="post" target="popupwindow" onsubmit="window.open('https://buttondown.com/dtp-llm-bench', 'popupwindow')" class="subscribe-form" > <label for="bd-email" class="visually-hidden">Email</label> <input type="email" name="email" id="bd-email" placeholder="you@example.com" required > <input type="hidden" name="tag" value="bench-site"> <button type="submit">Subscribe</button> </form> <p>Already use RSS? Same content lives at <a href="https://llm-bench.kapualabs.com/journal/index.xml">/journal/index.xml</a>.</p>