Download 16x Eval

Iterate on prompts. Test different models. Find the best combo for your tasks.

Mac (Intel) Mac (M1/M2/M3/M4) Windows Linux (deb) Linux (AppImage)

Latest version: v0.0.46
Released: (June 17, 2025)

New updates from the latest releases

0.0.46

June 17, 2025

Added evaluation comparison page to compare the results of two evaluations side by side

Release 0.0.46 - Evaluation comparison page

0.0.45

June 8, 2025

Added support for Gemini 2.5 Pro Preview (06-05)
Optimized the UX for adding OpenRouter models for new users

0.0.44

June 1, 2025

Moved benchmark to a separate dedicated page with option to select models
Added sorting options for experiments page
Added temperature as an advanced setting
Merged rating and notes modal for better UX
Various UI/UX improvements

Release 0.0.44 - Benchmark page

Download 16x Eval

Join AI builders and power users in running your own evaluations