PromptCause
Donate

6 / 11

Self-criticism

Chain-of-Verification (CoVe)

Advanced

In short: Generate the answer, write checking questions, and revise.

What is: The model generates the answer, then formulates independent verification questions, answers each WITHOUT looking at the original answer, and revises based on them. One of the best defenses against invented facts.

When to use: Answers with facts, dates, numbers, names, where hallucination is costly.

When to avoid: Tasks with no verifiable facts (opinion, free creation).

Right
1. List 5 Brazilian fintechs with their founding year. 2. For each, generate an isolated verification question and answer it from scratch. 3. Compare with the initial list, fix divergences and mark with [?] what you're unsure of.

Re-asking each fact in isolation stops the model from "anchoring" on what it already wrote.

Why: Dhuliawala et al. (2023) showed that verifying each fact in isolation, without the original answer's context, significantly reduces the factual hallucination rate.

💡 Tip: Do the verification in a separate step (or separate call) so the model isn't contaminated by the initial answer.

Self-Verification, Self-Calibration and RCoT

Advanced

In short: Verify candidates, estimate confidence, reconstruct the problem.

What is: Self-Verification generates several solutions and verifies each by reconstructing the problem. Self-Calibration asks the model to estimate confidence in its own answer. Reversing CoT (RCoT) reconstructs the prompt from the answer to detect inconsistency.

When to use: Self-Calibration is the most practical: use it to route (low confidence → review or escalate to a human).

When to avoid: When you won't act on the confidence/verification, it's just overhead.

Right
Answer the question and, at the end, give a confidence level from 0 to 100% with a one-line justification. If confidence is below 70%, list what you'd need to be sure.

An answer at 95% and one at 40% deserve different treatment.

Why: Making confidence explicit lets you route decisions (Kadavath et al., 2022, showed models are reasonably calibrated when asked directly). RCoT detects when the answer doesn't "fit" the prompt.

💡 Tip: Use confidence as an automation trigger: <70% → second opinion or human review.