Loading blueprint versions...
Please wait while we gather all the unique runs for this blueprint.
Please wait while we gather all the unique runs for this blueprint.
Please wait while we prepare the detailed comparison.
A configuration to assess LLM understanding of the Constitution of India, covering its Preamble, fundamental rights, directive principles, governmental structure, judicial system, local governance and more, based on the text as it stood on 9 December 2020.
Average key point coverage extent for each model across all prompts.
| Prompts vs. Models | Claude 3.5 Haiku | Claude Sonnet 4 | Command A | Deepseek Chat V3 | Deepseek R1 | Gemini 2.5 Flash | Gemini 2.5 Pro Preview 05 06 | Mistral Large 2411 | Mistral Medium 3 | GPT 4.1 | GPT 4.1 Mini | GPT 4.1 Nano | GPT 4o | GPT 4o Mini | O4 Mini | Grok 3 | Grok 3 Mini | Grok 4 | |
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| Score | 15th 76.4% | 6th 88.8% | 13th 81.5% | 9th 87.1% | 4th 89.7% | 3rd 92.3% | 17th 72.7% | 12th 81.6% | 11th 84.8% | 8th 87.5% | 14th 80.6% | 16th 74.8% | 10th 86.3% | 18th 72.6% | 7th 88.4% | 2nd 93.2% | 5th 89.2% | 1st 97.4% | |
| 88.0% | 67% | 75% | 50% | 100% | 100% | 100% | 100% | 100% | 100% | 100% | 75% | 75% | 100% | 42% | 100% | 100% | 100% | 100% | |
| 74.3% | 67% | 67% | 67% | 67% | 67% | 100% | 75% | 67% | 75% | 100% | 67% | 42% | 67% | 42% | 100% | 100% | 67% | 100% | |
| 74.4% | 63% | 94% | 69% | 69% | 69% | 100% | 75% | 75% | 50% | 94% | 69% | 56% | 94% | 56% | 69% | 75% | 63% | 100% | |
| 82.5% | 54% | 100% | 100% | 100% | 100% | 100% | 38% | 75% | 88% | 88% | 46% | 79% | 100% | 54% | 75% | 88% | 100% | 100% | |
| 75.8% | 69% | 81% | 56% | 69% | 69% | 100% | 31% | 69% | 94% | 56% | 56% | 94% | 69% | 88% | 100% | 94% | 75% | 94% | |
| 99.6% | 100% | 100% | 100% | 100% | 100% | 92% | 100% | 100% | 100% | 100% | 100% | 100% | 100% | 100% | 100% | 100% | 100% | 100% | |
| 100.0% | 100% | 100% | 100% | 100% | 100% | 100% | 100% | 100% | 100% | 100% | 100% | 100% | 100% | 100% | 100% | 100% | 100% | 100% | |
| 92.2% | 67% | 75% | 100% | 100% | 92% | 100% | 100% | 100% | 75% | 100% | 92% | 92% | 100% | 67% | 100% | 100% | 100% | 100% | |
| 91.8% | 100% | 100% | 100% | 88% | 100% | 100% | 100% | 63% | 88% | 100% | 100% | 63% | 100% | 50% | 100% | 100% | 100% | 100% | |
| 99.6% | 92% | 100% | 100% | 100% | 100% | 100% | 100% | 100% | 100% | 100% | 100% | 100% | 100% | 100% | 100% | 100% | 100% | 100% | |
| 90.3% | 100% | 100% | 75% | 75% | 100% | 100% | 75% | 92% | 92% | 75% | 83% | 92% | 75% | 92% | 100% | 100% | 100% | 100% | |
| 97.2% | 100% | 100% | 100% | 100% | 100% | 100% | 50% | 100% | 100% | 100% | 100% | 100% | 100% | 100% | 100% | 100% | 100% | 100% | |
| 80.2% | 63% | 94% | 75% | 100% | 100% | 81% | 75% | 44% | 81% | 100% | 81% | 50% | 75% | 50% | 100% | 100% | 75% | 100% | |
| 87.1% | 81% | 100% | 75% | 81% | 100% | 75% | 100% | 100% | 63% | 100% | 81% | 81% | 75% | 56% | 100% | 100% | 100% | 100% | |
| 73.7% | 25% | 100% | 67% | 75% | 100% | 75% | 100% | 67% | 67% | 50% | 75% | 83% | 75% | 50% | 75% | 75% | 92% | 75% | |
| 99.3% | 100% | 100% | 100% | 100% | 100% | 100% | 100% | 100% | 100% | 100% | 100% | 100% | 100% | 88% | 100% | 100% | 100% | 100% | |
| 81.2% | 54% | 100% | 83% | 100% | 100% | 100% | 0% | 79% | 100% | 100% | 79% | 29% | 96% | 58% | 83% | 100% | 100% | 100% | |
| 54.6% | 100% | 100% | 8% | 42% | 92% | 92% | 58% | 8% | 8% | 25% | 0% | 58% | 100% | 67% | 8% | 100% | 17% | 100% | |
| 100.0% | 100% | 100% | 100% | 100% | 100% | 100% | 100% | 100% | 100% | 100% | 100% | 100% | 100% | 100% | 100% | 100% | 100% | 100% | |
| 62.2% | 38% | 69% | 75% | 50% | 63% | 63% | 75% | 75% | 81% | 75% | 25% | 44% | 44% | 50% | 50% | 81% | 81% | 81% | |
| 91.4% | 94% | 100% | 100% | 94% | 100% | 100% | 31% | 94% | 100% | 100% | 94% | 100% | 100% | 94% | 69% | 75% | 100% | 100% | |
| 95.9% | 100% | 100% | 100% | 92% | 92% | 92% | 100% | 83% | 92% | 92% | 100% | 100% | 92% | 92% | 100% | 100% | 100% | 100% | |
| 63.8% | 31% | 63% | 56% | 75% | 56% | 100% | 31% | 38% | 56% | 50% | 75% | 31% | 75% | 56% | 81% | 75% | 100% | 100% | |
| 73.1% | 80% | 70% | 65% | 70% | 70% | 100% | 20% | 70% | 85% | 100% | 65% | 50% | 70% | 65% | 80% | 100% | 55% | 100% | |
| 67.8% | 46% | 54% | 71% | 67% | 83% | 83% | 33% | 38% | 92% | 67% | 83% | 42% | 83% | 54% | 71% | 83% | 88% | 83% | |
| 86.4% | 65% | 100% | 100% | 100% | 95% | 100% | 20% | 100% | 100% | 85% | 85% | 50% | 100% | 85% | 85% | 100% | 85% | 100% | |
| 81.8% | 70% | 60% | 95% | 95% | 95% | 95% | 60% | 95% | 95% | 95% | 95% | 65% | 55% | 30% | 95% | 95% | 100% | ||
| 100.0% | 100% | 100% | 100% | 100% | 100% | 100% | 100% | 100% | 100% | 100% | 100% | 100% | 100% | 100% | 100% | 100% | 100% | 100% | |
| 75.8% | 71% | 71% | 75% | 79% | 83% | 67% | 54% | 71% | 79% | 75% | 92% | 67% | 63% | 75% | 96% | 75% | 79% | 92% | |
| 100.0% | 100% | 100% | 100% | 100% | 100% | 100% | 100% | 100% | 100% | 100% | 100% | 100% | 100% | 100% | 100% | 100% | 100% | 100% | |
| 93.7% | 75% | 100% | 100% | 100% | 100% | 100% | 100% | 75% | 100% | 100% | 100% | 81% | 81% | 75% | 100% | 100% | 100% | 100% | |
| 68.6% | 63% | 63% | 63% | 63% | 88% | 63% | 63% | 63% | 63% | 63% | 63% | 63% | 88% | 63% | 88% | 63% | 63% | 88% | |
| 78.0% | 67% | 67% | 67% | 100% | 67% | 67% | 100% | 100% | 67% | 67% | 67% | 67% | 67% | 67% | 67% | 100% | 100% | 100% | |
| 77.9% | 67% | 100% | 42% | 100% | 67% | 100% | 67% | 100% | 67% | 100% | 67% | 42% | 67% | 42% | 100% | 100% | 75% | 100% | |
| 100.0% | 100% | 100% | 100% | 100% | 100% | 100% | 100% | 100% | 100% | 100% | 100% | 100% | 100% | 100% | 100% | 100% | 100% | 100% | |
| 87.5% | 70% | 95% | 95% | 85% | 85% | 85% | 60% | 80% | 95% | 95% | 80% | 85% | 95% | 95% | 100% | 85% | 90% | 100% | |
| 88.3% | 86% | 86% | 86% | 86% | 86% | 86% | 100% | 100% | 86% | 86% | 86% | 86% | 86% | 82% | 86% | 86% | 100% | 89% |