Prompt Caching and Reuse: Design Prompts That Save 90% on Token Costs at Scale
The architecture decisions that turn a $500/day LLM bill into $50 without sacrificing output quality
Pillar
Techniques
Chain-of-thought, few-shot, role prompting, structured output
43 articles • Page 1 of 5
XML Tags Are the New Markdown: Why Structured Delimiters Beat Free-Form Prompts in Every Benchmark
The delimiter strategy that Claude, GPT, and Gemini all respond to better than plain English sections
Grounding Prompts With Retrieved Context: The RAG Prompt Patterns That Cut Hallucinations by 80%
Stop bolting retrieval onto bad prompts -- design prompts that actually use retrieved context correctly
GPT-5.6 Pays You to Delete Your System Prompt: State Every Rule Once and Stop Repeating Yourself
OpenAI's own tests show trimming duplicated instructions raises scores 10-15% while cutting tokens up to 66%. Your old scaffolding is now a tax.
Chain-of-Thought Is Sabotaging Your Model's Sense of Direction: Prompt Grids as Symbols, Not Sentences
Seventeen models, thirteen spatial benchmarks, one verdict: "think step by step" makes maps, mazes, and layouts worse. Here's what to send instead.
Stop Trusting Free-Form Chain-of-Thought. Make Your Model Sign a Logical Certificate Instead
Meta's semi-formal reasoning template forces premises, traced paths, and a derived conclusion -- so you can see exactly where the model is bluffing.
Marc Andreessen Told His AI to 'Never Hallucinate.' Here's the Four-Line Scaffold That Actually Works
You can't command next-token prediction into honesty, but you can engineer the conditions where it stops guessing.
Chain-of-Thought Assumes Left-to-Right. Mercury 2 Doesn't: How to Prompt a Diffusion LLM by Handing It a Skeleton, Not a Trail
Diffusion models like Inception's new Mercury 2 refine the whole answer in parallel, so scaffold the output shape instead of nudging a linear reasoning chain.
Delete Your Temperature Parameter: Why Self-Consistency Sampling Is Dead on Reasoning Models Like Gemini 3.5 Flash
Google's migration guide quietly killed the majority-vote trick you've leaned on for years. Here's what replaces it.