PROMPTING TECHNIQUE #05

Zero-Shot Chain of Thought Prompts

Just add "Let's think step by step"

What It Is

Zero-Shot Chain of Thought is the simplest way to improve AI reasoning: add "Let's think step by step" (or similar phrase) to any prompt. This triggers AI to break down its response into logical steps without you providing examples or detailed instructions.

It combines the simplicity of direct prompting with the improved accuracy of step-by-step reasoning.

Why It Works

Step-by-step pattern activation: The phrase "think step by step" (and similar) appeared in training data alongside methodical problem-solving. It activates patterns where AI shows its work.

Intermediate context: Each step AI generates becomes context for the next prediction, improving accuracy on complex reasoning tasks compared to jumping straight to an answer.

✓ Use Zero-Shot CoT When:

  • Problem has multiple steps
  • Logical reasoning required
  • Math or calculation involved
  • Decision requires weighing factors
  • You want to see AI's thought process

✗ Skip Zero-Shot CoT When:

  • Simple factual questions
  • Creative writing (makes it rigid)
  • Already providing step-by-step instructions
  • Single-step tasks
  • Speed more important than accuracy

Ready-to-Use Templates

The Magic Phrases

Any of these trigger step-by-step reasoning:

  • "Let's think step by step"
  • "Let's approach this systematically"
  • "Let's break this down"
  • "Let's work through this carefully"
  • "Let's think through this logically"

Simply add one of these phrases before or after your question.

Template 1: Problem Solving

[DESCRIBE PROBLEM] Let's think step by step.
Example:
"We have 500 monthly visitors but only 10 conversions. Our target is 50 conversions. Let's think step by step."

Template 2: Decision Making

Should I [DECISION]? Let's approach this systematically.
Example:
"Should I hire two junior developers or one senior developer with my $150K budget? Let's approach this systematically."

Template 3: Analysis

Analyze [SITUATION/DATA]. Let's break this down.
Example:
"Analyze why our customer churn rate increased from 5% to 12% last quarter. Let's break this down."

Template 4: Planning

How do I [ACHIEVE GOAL]? Let's work through this carefully.
Example:
"How do I migrate 10,000 customers from our old platform to the new one without service interruption? Let's work through this carefully."

Template 5: Calculation/Math

Calculate [MATHEMATICAL PROBLEM]. Let's think through this logically.
Example:
"Calculate our break-even point if fixed costs are $50K/month, variable costs are $15 per unit, and we sell at $45 per unit. Let's think through this logically."

Pro Tips

  • Position matters: "Let's think step by step" works at the beginning or end, but end placement often works slightly better.
  • Don't overuse: Save this for problems that actually need reasoning. Simple tasks don't benefit.
  • Check the steps: AI's intermediate steps might reveal faulty logic even if the conclusion sounds good.
  • Combine with other techniques: "You are an accountant. Calculate... Let's think step by step."
  • Upgrade when needed: If zero-shot CoT isn't enough, move to full Chain of Thought with explicit step structure.

Understanding the Fundamentals

Zero-Shot Chain of Thought works because of core AI principles:

  • Pattern Activation: Trigger phrases associated with methodical reasoning in training data.
  • Intermediate Context: Each generated step improves the context for subsequent predictions.
  • Error Reduction: Breaking problems down reduces compounding errors in multi-step reasoning.

Want to understand these concepts more deeply? Our Making AI Make Sense series breaks down how AI actually works.

Watch on YouTube →
← Previous
Chain of Thought Prompts
Next →
Instructional Prompts

Need Help Implementing AI in Your Business?

These templates teach techniques. We help you apply them to your specific business challenges.

Our ServicesContact Us

Eau Claire AI - Your path to AI, made clear.