Please wait while we gather all the unique runs for this blueprint.
Please wait while we gather all the unique runs for this blueprint.
Please wait while we prepare the detailed comparison.
This blueprint evaluates an AI's ability to provide accurate, evidence-based, and nuanced information on a range of civic, historical, social, and health topics pertinent to Sri Lanka. The evaluation is strictly based on a provided compendium of research, with all prompts and scoring criteria derived from its contents to ensure fidelity to the source material.
Core Areas Tested:
These prompts were originally sourced from Factum. The rubrics were assembled via Gemini Deep Research.
Average performance for each system prompt variant across all models and prompts.
[No System Prompt]
The user is located in Sri Lanka.
Average key point coverage, broken down by system prompt variant. Select a tab to view its results.
Prompts vs. Models | Claude 3.5 Haiku | Claude Sonnet 4 | Command A | Deepseek Chat V3 | Deepseek R1 | Gemini 2.5 Flash | Gemini 2.5 Pro Preview 05 06 | Mistral Large 2411 | Mistral Medium 3 | GPT 4.1 Mini | GPT 4.1 Nano | GPT 4.1 | GPT 4o Mini | GPT 4o | O4 Mini | Grok 3 Mini | Grok 3 | |
---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
Score | 16th 26.0% | 10th 32.6% | 8th 35.5% | 9th 34.1% | 5th 39.6% | 3rd 40.6% | 14th 27.4% | 11th 32.0% | 4th 39.7% | 12th 29.9% | 15th 26.9% | 7th 37.2% | 17th 23.8% | 13th 29.2% | 1st 44.5% | 6th 37.9% | 2nd 43.3% | |
57.2% | 36% | 33% | 67% | 85% | 60% | 71% | 58% | 64% | 77% | 49% | 45% | 54% | 24% | 40% | 73% | 68% | 69% | |
55.6% | 38% | 58% | 40% | 69% | 90% | 54% | 35% | 38% | 75% | 54% | 40% | 54% | 40% | 38% | 71% | 69% | 83% | |
60.8% | 49% | 81% | 67% | 0% | 84% | 87% | 98% | 53% | 87% | 30% | 32% | 79% | 19% | 40% | 82% | 58% | 87% | |
69.1% | 66% | 76% | 79% | 34% | 85% | 71% | 76% | 59% | 75% | 68% | 51% | 64% | 67% | 64% | 76% | 79% | 85% | |
3.4% | 2% | 4% | 4% | 2% | 0% | 0% | 0% | 2% | 12% | 2% | 4% | 4% | 2% | 4% | 8% | 4% | 4% | |
51.1% | 27% | 59% | 68% | 43% | 52% | 75% | 77% | 52% | 34% | 61% | 40% | 48% | 40% | 52% | 32% | 54% | 55% | |
16.5% | 14% | 23% | 8% | 16% | 14% | 21% | 13% | 8% | 4% | 22% | 18% | 23% | 15% | 16% | 22% | 19% | 24% | |
21.9% | 16% | 27% | 13% | 23% | 41% | 13% | 4% | 38% | 10% | 23% | 13% | 20% | 13% | 13% | 41% | 20% | 44% | |
62.8% | 47% | 66% | 80% | 88% | 54% | 48% | 7% | 66% | 79% | 61% | 66% | 88% | 39% | 75% | 56% | 66% | 82% | |
0.4% | 0% | 0% | 0% | 2% | 0% | 0% | 0% | 0% | 0% | 3% | 0% | 0% | 0% | 0% | 0% | 0% | 2% | |
14.9% | 14% | 0% | 28% | 15% | 35% | 21% | 0% | 4% | 4% | 6% | 4% | 19% | 14% | 13% | 44% | 25% | 8% | |
14.8% | 4% | 15% | 15% | 0% | 15% | 19% | 0% | 15% | 15% | 25% | 12% | 27% | 12% | 12% | 35% | 15% | 15% | |
17.1% | 30% | 14% | 13% | 8% | 13% | 41% | 5% | 9% | 11% | 9% | 18% | 26% | 13% | 5% | 30% | 30% | 16% | |
9.9% | 23% | 9% | 12% | 12% | 8% | 4% | 8% | 4% | 15% | 0% | 15% | 19% | 8% | 8% | 8% | 8% | 8% | |
30.4% | 30% | 40% | 20% | 30% | 28% | 40% | 50% | 22% | 42% | 15% | 15% | 35% | 33% | 5% | 28% | 42% | 42% | |
53.2% | 25% | 28% | 61% | 70% | 75% | 71% | 24% | 57% | 80% | 47% | 20% | 54% | 19% | 59% | 100% | 51% | 63% | |
40.6% | 34% | 34% | 45% | 56% | 44% | 38% | 28% | 50% | 45% | 31% | 31% | 45% | 31% | 37% | 56% | 29% | 56% | |
32.9% | 8% | 24% | 15% | 55% | 30% | 55% | 7% | 21% | 48% | 27% | 33% | 31% | 18% | 34% | 53% | 48% | 53% | |
18.1% | 9% | 8% | 26% | 9% | 13% | 25% | 0% | 21% | 25% | 13% | 33% | 17% | 16% | 17% | 25% | 29% | 21% | |
51.5% | 48% | 52% | 48% | 65% | 50% | 58% | 58% | 58% | 56% | 52% | 48% | 36% | 52% | 52% | 50% | 44% | 48% |