Logo16x Eval

16x Eval Blog

Read the latest blog posts from 16x Eval.

Grok 4 Evaluation Results: Strong Performance with Reasoning Trade-offs

Grok 4 Evaluation Results: Strong Performance with Reasoning Trade-offs

July 16, 2025

Comprehensive evaluation of xAI Grok 4 model performance on coding, writing, and image analysis tasks, comparing against Claude 4, Gemini 2.5 Pro, and other leading models.

9.9 vs 9.11: Which One is Bigger? It Depends on Context

9.9 vs 9.11: Which One is Bigger? It Depends on Context

July 5, 2025

Why do some AI models get the simple comparison between 9.9 and 9.11 wrong? We take a look at the math, versioning and book chapters, and why context matters for both people and language models.

Claude 4, Gemini 2.5 Pro, and GPT-4.1: Understanding Their Unique Quirks

Claude 4, Gemini 2.5 Pro, and GPT-4.1: Understanding Their Unique Quirks

July 1, 2025

A practical guide to the quirks of top LLMs: Claude 4, Gemini 2.5 Pro, and GPT-4.1. Learn how their traits affect output and how you can adapt prompts for best results.

New Claude Models Default to Full Code Output, Stronger Prompt Required

New Claude Models Default to Full Code Output, Stronger Prompt Required

June 18, 2025

The latest Claude models are more likely to output full code, even if you ask for only the changes. We examine this behavior, how it compares to older models and competitors, and how to get concise output.

Why Gemini 2.5 Pro Won't Stop Talking (And How to Fix It)

Why Gemini 2.5 Pro Won't Stop Talking (And How to Fix It)

June 1, 2025

Learn how to manage Gemini 2.5 Pro's verbose output, especially for coding, and compare its behavior with other models like Claude and GPT.

Claude Opus 4 and Claude Sonnet 4 Evaluation Results

Claude Opus 4 and Claude Sonnet 4 Evaluation Results

May 25, 2025

A detailed analysis of Claude Opus 4 and Claude Sonnet 4 performance on coding and writing tasks, with comparisons to GPT-4.1, DeepSeek V3, and other leading models.

Mistral Medium 3 Coding and Writing Evaluation

Mistral Medium 3 Coding and Writing Evaluation

May 9, 2025

A detailed look at Mistral Medium 3's performance on coding and writing tasks, compared to top models like GPT-4.1, Claude 3.7 Sonnet, and Gemini 2.5 Pro.

Download 16x Eval

Join AI builders and power users in running your own evaluations