Blueprints tagged "factuality"

Hallucination Probe: Plausible Non-Existent Concepts

Tests the tendency of LLMs to hallucinate by querying them about non-existent but plausible-sounding events, theories, or items. Ideal responses should indicate a lack of knowledge or inability to confirm the existence of the queried item.

Hallucination

Factuality

Reasoning

Plausibility

Factual Accuracy & Hallucination

Epistemic Humility & Self Awareness

System Prompt Adherence

AI Safety & Robustness

General Knowledge

77.6%

Avg. Hybrid Score

No Heatmap Data

No Top Model

Latest:

Unique Versions: 1

View Latest Run Analysis View All Runs for this Blueprint

weval

Evaluations Tagged: ...

Evaluations Tagged: ...

Evaluations Tagged: "factuality"

Hallucination Probe: Plausible Non-Existent Concepts