DTeval

A Collective Intelligence Project

Loading blueprint versions...

Please wait while we gather all the unique runs for this blueprint.

Analysis: Gd6 Experiment Dtef Global Dialogues Gd6 Country%3Ajapan B2 - Run 41924a5...

Global Dialogues GD6 - Japan (batch 2)

DTEF: Batched predictions (2 Qs/prompt) for Japan. Source: Global Dialogues GD6 (https://github.com/collect-intel/global-dialogues)

TAGS:

Global Dialogues Gd6

Instruction Following & Prompt Adherence

Efficiency & Succinctness

Factual Accuracy & Hallucination

Best Models (Coverage)

1.Gemini 2.5 Flash
71.7%
2.GPT 4.1 Mini
69.2%
3.GPT 4.1 Nano
67.8%
4.GPT 4o Mini
67.7%
5.Gemma 3 12b It
64.0%

Select Prompt:

Macro Coverage Overview

Average key point coverage extent for each model across all prompts.

Pro Tip

Click on any result cell to open a detailed view.

Advanced view

Highlight best performers

Sort prompts by

Sort models by

Color Scale - Simplified View (Avg. Coverage)

Perfect

Excellent

Good

Fair

Poor

Bad

Not Met

	Prompts vs. Models	Claude Haiku 4.5	Gemini 2.5 Flash	Gemma 3 12b It	GPT 4.1 Mini	GPT 4.1 Nano	GPT 4o Mini
Score		- -	1st 71.7%	5th 64.0%	2nd 69.2%	3rd 67.8%	4th 67.7%
75.8%			68%	78%	75%	79%	79%
59.6%			66%	49%	60%	60%	63%
68.8%			73%	61%	72%	62%	76%
66.4%			71%	61%	65%	66%	69%
64.8%			68%	60%	69%	63%	64%
59.8%			67%	44%	61%	66%	61%
54.2%			62%	56%	53%	56%	44%
80.8%			84%	72%	81%	92%	75%
60.2%			58%	72%	63%	54%	54%
90.4%			100%	87%	93%	80%	92%