Please wait while we gather all the unique runs for this blueprint.
Please wait while we gather all the unique runs for this blueprint.
Please wait while we prepare the detailed comparison.
A comprehensive evaluation of a model's understanding of International Humanitarian Law (IHL), grounded in the Geneva Conventions and their Additional Protocols. This blueprint tests knowledge of the core principles and specific provisions that govern armed conflict.
Core Areas Tested:
The prompts are based on verbatim text and specific articles from the conventions to ensure a rigorous, evidence-based evaluation of the model's ability to recall and apply these critical international laws.
Average key point coverage extent for each model across all prompts.
Prompts vs. Models | Claude 3.5 Haiku | Claude Sonnet 4 | Command A | Deepseek Chat V3 | Deepseek R1 | Gemini 2.5 Flash | Gemini 2.5 Pro | Mistral Large 2411 | Mistral Medium 3 | GPT 4.1 | GPT 4.1 Mini | GPT 4.1 Nano | GPT 4o | GPT 4o Mini | O4 Mini | Kimi K2 Instruct | Grok 3 | Grok 3 Mini | Grok 4 | |
---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
Score | 14th 73.7% | 8th 78.2% | 15th 71.9% | 7th 79.2% | 6th 80.4% | 4th 82.8% | 12th 74.7% | 13th 74.6% | 10th 76.6% | 3rd 85.0% | 17th 68.8% | 18th 60.6% | 11th 76.1% | 19th 60.6% | 16th 69.6% | 9th 76.8% | 2nd 85.3% | 5th 80.5% | 1st 93.2% | |
98.7% | 100% | 100% | 100% | 96% | 100% | 100% | 100% | 100% | 100% | 100% | 100% | 100% | 100% | 100% | 83% | 96% | 100% | 100% | 100% | |
89.7% | 88% | 100% | 83% | 100% | 100% | 100% | 0% | 100% | 85% | 100% | 100% | 90% | 100% | 81% | 94% | 83% | 100% | 100% | 100% | |
95.6% | 100% | 100% | 98% | 100% | 100% | 100% | 100% | 100% | 100% | 95% | 68% | 85% | 100% | 80% | 100% | 100% | 95% | 100% | ||
96.1% | 89% | 98% | 93% | 96% | 100% | 100% | 77% | 96% | 100% | 100% | 98% | 95% | 95% | 91% | 98% | 100% | 100% | 100% | 100% | |
75.9% | 67% | 100% | 67% | 100% | 100% | 67% | 67% | 67% | 67% | 100% | 67% | 38% | 71% | 67% | 67% | 63% | 100% | 67% | 100% | |
95.1% | 100% | 100% | 100% | 94% | 97% | 100% | 100% | 100% | 100% | 100% | 97% | 72% | 81% | 69% | 100% | 97% | 100% | 100% | 100% | |
75.5% | 53% | 69% | 56% | 88% | 97% | 94% | 97% | 47% | 78% | 94% | 69% | 63% | 69% | 59% | 69% | 72% | 72% | 94% | 94% | |
71.6% | 65% | 91% | 60% | 72% | 91% | 100% | 82% | 99% | 56% | 99% | 71% | 40% | 53% | 38% | 1% | 91% | 99% | 83% | 69% | |
66.4% | 60% | 60% | 75% | 58% | 83% | 58% | 100% | 83% | 50% | 75% | 67% | 50% | 58% | 56% | 50% | 75% | 52% | 63% | 88% | |
80.9% | 69% | 63% | 69% | 69% | 63% | 88% | 100% | 88% | 88% | 100% | 63% | 69% | 88% | 69% | 88% | 63% | 100% | 100% | 100% | |
51.0% | 50% | 46% | 31% | 50% | 58% | 50% | 65% | 31% | 56% | 92% | 33% | 36% | 50% | 25% | 73% | 50% | 48% | 44% | 81% | |
100.0% | 100% | 100% | 100% | 100% | 100% | 100% | 100% | 100% | 100% | 100% | 100% | 100% | 100% | 100% | 100% | 100% | 100% | 100% | 100% | |
67.7% | 77% | 75% | 63% | 66% | 70% | 74% | 82% | 74% | 72% | 75% | 50% | 47% | 63% | 49% | 56% | 67% | 81% | 63% | 83% | |
62.5% | 67% | 58% | 50% | 69% | 96% | 50% | 54% | 42% | 48% | 75% | 50% | 42% | 48% | 38% | 67% | 63% | 88% | 83% | 100% | |
93.7% | 91% | 95% | 100% | 100% | 93% | 98% | 61% | 84% | 93% | 98% | 98% | 88% | 100% | 88% | 98% | 95% | 100% | 100% | 100% | |
72.2% | 44% | 66% | 69% | 88% | 47% | 94% | 94% | 50% | 88% | 94% | 53% | 44% | 100% | 38% | 69% | 75% | 100% | 59% | 100% | |
64.0% | 64% | 91% | 42% | 73% | 53% | 94% | 59% | 75% | 58% | 45% | 63% | 52% | 56% | 41% | 44% | 69% | 81% | 58% | 98% | |
68.7% | 56% | 63% | 59% | 59% | 63% | 88% | 88% | 56% | 66% | 94% | 63% | 63% | 56% | 56% | 41% | 59% | 88% | 88% | 100% | |
81.3% | 69% | 75% | 75% | 100% | 75% | 100% | 56% | 97% | 75% | 100% | 75% | 63% | 75% | 72% | 75% | 94% | 94% | 75% | 100% | |
57.7% | 55% | 67% | 48% | 70% | 67% | 77% | 61% | 55% | 47% | 53% | 50% | 42% | 52% | 45% | 33% | 55% | 72% | 56% | 92% | |
39.5% | 16% | 28% | 41% | 19% | 28% | 32% | 53% | 38% | 66% | 47% | 22% | 19% | 44% | 25% | 0% | 22% | 75% | 75% | 100% | |
56.9% | 59% | 50% | 53% | 56% | 69% | 47% | 75% | 44% | 50% | 75% | 47% | 38% | 75% | 31% | 63% | 50% | 63% | 56% | 81% | |
76.0% | 80% | 80% | 70% | 70% | 88% | 80% | 23% | 80% | 78% | 80% | 80% | 60% | 80% | 75% | 80% | 80% | 80% | 80% | 100% | |
73.8% | 83% | 83% | 73% | 83% | 83% | 70% | 100% | 100% | 68% | 65% | 80% | 63% | 53% | 68% | 75% | 70% | 53% | 53% | 80% | |
52.5% | 53% | 28% | 40% | 90% | 55% | 40% | 58% | 40% | 28% | 75% | 25% | 23% | 63% | 23% | 40% | 63% | 70% | 93% | 90% | |
46.1% | 46% | 54% | 38% | 46% | 38% | 46% | 71% | 46% | 50% | 50% | 46% | 38% | 46% | 38% | 33% | 38% | 38% | 46% | 67% | |
80.1% | 85% | 65% | 70% | 85% | 90% | 95% | 98% | 95% | 98% | 80% | 40% | 55% | 75% | 53% | 83% | 75% | 100% | 80% | 100% | |
73.4% | 75% | 75% | 72% | 75% | 69% | 72% | 72% | 75% | 75% | 75% | 69% | 56% | 69% | 66% | 75% | 75% | 75% | 75% | 100% | |
39.1% | 35% | 56% | 25% | 36% | 61% | 40% | 38% | 14% | 47% | 46% | 21% | 22% | 44% | 15% | 14% | 45% | 69% | 27% | 88% | |
91.7% | 96% | 100% | 96% | 100% | 96% | 100% | 71% | 96% | 96% | 96% | 96% | 35% | 96% | 73% | 96% | 100% | 100% | 100% | 100% | |
100.0% | 100% | 100% | 100% | 100% | 100% | 100% | 100% | 100% | 100% | 100% | 100% | 100% | 100% | 100% | 100% | 100% | 100% | 100% | 100% | |
49.1% | 42% | 45% | 42% | 59% | 67% | 81% | 34% | 25% | 45% | 63% | 25% | 31% | 58% | 28% | 17% | 63% | 67% | 53% | 88% | |
87.4% | 90% | 90% | 60% | 95% | 95% | 98% | 80% | 93% | 95% | 95% | 78% | 68% | 93% | 68% | 85% | 90% | 100% | 88% | 100% | |
91.7% | 73% | 100% | 100% | 80% | 100% | 100% | 98% | 80% | 100% | 100% | 100% | 63% | 80% | 68% | 100% | 100% | 100% | 100% | 100% | |
76.3% | 88% | 100% | 96% | 67% | 67% | 92% | 67% | 38% | 67% | 100% | 67% | 33% | 100% | 33% | 63% | 71% | 100% | 100% | 100% | |
99.2% | 96% | 100% | 100% | 100% | 92% | 100% | 100% | 100% | 100% | 100% | 100% | 100% | 100% | 96% | 100% | 100% | 100% | 100% | 100% | |
95.2% | 100% | 100% | 100% | 94% | 100% | 100% | 100% | 100% | 100% | 100% | 76% | 88% | 100% | 56% | 100% | 100% | 100% | 94% | 100% | |
78.3% | 84% | 75% | 72% | 81% | 84% | 84% | 88% | 72% | 88% | 84% | 50% | 78% | 72% | 69% | 78% | 78% | 75% | 88% | 88% | |
74.6% | 63% | 69% | 75% | 75% | 72% | 97% | 50% | 97% | 75% | 75% | 72% | 72% | 75% | 63% | 75% | 69% | 69% | 75% | 100% | |
96.5% | 95% | 100% | 100% | 98% | 100% | 100% | 60% | 93% | 98% | 100% | 100% | 95% | 100% | 95% | 100% | 100% | 100% | 100% | 100% | |
85.8% | 100% | 90% | 88% | 90% | 90% | 90% | 85% | 90% | 90% | 90% | 90% | 68% | 83% | 78% | 100% | 93% | 90% | 90% | 35% |