PromptCause
Donate

4 / 11

Part 4 Advanced Zero-shot

Rephrase and Respond (RaR)

Intermediate

In short: The model rephrases your question before answering it.

What is: Instruct the model to rewrite the question in its own words before answering. This clarifies intent and surfaces ambiguity.

When to use: Vague, ambiguous or poorly worded questions; when you want to make sure the model understood.

When to avoid: Already clear, direct questions, the rephrasing only adds text.

Wrong
Is the bank closed?
Right
Rephrase my question fully and unambiguously, then answer. Question: "Is the bank closed?"

By rephrasing, the model exposes the ambiguity (institution? river bank?) and answers better.

Why: Deng et al. (2023) showed that letting the model rephrase its own question improves performance across tasks, clear questions yield better answers.

💡 Tip: Combine with CoT: rephrase, then reason. The clarity of the rephrasing improves the reasoning that follows.

Re-reading (RE2)

Intermediate

In short: Ask the model to re-read the question before answering.

What is: Simply instruct the model to re-read the prompt, repeating the input. Cheap, improves comprehension on complex questions.

When to use: Long prompts or ones with many conditions, where details are easy to skip.

When to avoid: Short, simple questions.

Right
Read the question below. Then read it again, paying attention to every condition. Only then answer. Question: [long prompt with several constraints]

Re-reading makes the model notice conditions a single read glosses over.

Why: Xu et al. (2023) showed that simply re-reading the prompt improves reasoning, the model attends to conditions (e.g. "except on Tuesdays") it would skip in one pass.

💡 Tip: Near-zero-cost trick; worth stacking with CoT on problems with many constraints.

Self-Ask

Intermediate

In short: The model asks itself sub-questions before the final answer.

What is: The model decides whether it needs follow-up sub-questions, answers each, and then composes the final answer. Ideal for questions that require combining several facts (multi-hop).

When to use: Questions depending on intermediate facts ("Who directed the film that won the Oscar the year X was born?").

When to avoid: Single-fact questions, nothing to decompose.

Right
Answer using sub-questions. Before the final answer, ask and answer yourself whatever is needed. Question: What's the life expectancy in the home country of the creator of Linux?

Decomposing into "who created it → where from → expectancy there" avoids skipping a link and hallucinating.

Why: Press et al. (2022) showed that making sub-questions explicit narrows the "compositionality gap", the model errs less when answering each link separately.

💡 Tip: Works even better with search access: each sub-question becomes a query.

System 2 Attention (S2A)

Advanced

In short: Clean the context of noise before answering.

What is: The model first rewrites the context removing irrelevant or distracting information, and only then answers on the clean context. Reduces the effect of noise and planted opinions.

When to use: Inputs with lots of noise, embedded opinion or conflicting information.

When to avoid: Already clean, objective inputs.

Wrong
I think it's 50. What's 17 × 4? My cousin said 70.
Right
First rewrite the question removing opinions and guesses. Then solve the clean version. "I think it's 50... what's 17×4? My cousin said 70."

Cleaned to "What's 17×4?", the model answers 68 without being pulled by the wrong guesses.

Why: Weston & Sukhbaatar (2023) showed LLMs are swayed by irrelevant context; filtering the noise before reasoning improves robustness and factuality.

💡 Tip: Also useful as a defense: planted opinions and manipulation attempts are stripped in the cleaning step.

Analogical and Contrastive CoT

Advanced

In short: The model generates analogous examples; or learns from right AND wrong.

What is: Analogical makes the model generate its own analogous examples before solving (self-few-shot). Contrastive CoT provides right AND wrong reasoning demonstrations so the model learns what to avoid.

When to use: Analogical: when you have no ready examples. Contrastive: when there's a recurring reasoning error to prevent.

When to avoid: Trivial tasks, generating analogues or contrasts is overhead.

Right
Contrastive: here's CORRECT and WRONG percentage reasoning: ✓ "20% of 50 = 0.20 × 50 = 10" ✗ "20% of 50 = 50 / 20 = 2.5" (dividing instead of multiplying) Now solve, avoiding the error: what's 35% of 80?

Showing the typical error inoculates the model against it.

Why: Yasunaga et al. (2023) showed self-generated analogues beat fixed few-shot; Chia et al. (2023) showed negative demonstrations (right + wrong) reduce reasoning errors.

💡 Tip: In Contrastive, show the EXACT error you want to avoid, the more specific, the more effective.

Thread-of-Thought and Maieutic

Advanced

In short: CoT for long context; or a tree of logical explanations.

What is: Thread-of-Thought (ThoT) is a CoT adapted to long, chaotic contexts ("analyze in manageable parts"). Maieutic prompting builds a tree of recursive explanations and resolves contradictions logically.

When to use: ThoT: long, messy documents/histories. Maieutic: high-stakes logical reasoning.

When to avoid: Maieutic is expensive; reserve it for when logical consistency is essential.

Right
Walk through this long chat history in manageable parts. Summarize each relevant part as you go and, at the end, answer who promised the report and when.

Advancing in blocks with summaries keeps the thread in huge inputs.

Why: Processing a huge context "all at once" loses middle details (the Lost in the Middle effect); ThoT works around it. Maieutic (Jung et al., 2022) raised accuracy by ~20% on reasoning that requires logical consistency.

💡 Tip: For very long contexts, combine ThoT with quote extraction before answering.