Skip to content
Search

Qurtoo

Papers

Short digests of research papers about prompting and agents: what each paper found, why it matters, and how to use it.

  • Techniques

    Chain-of-Verification Reduces Hallucination in Large Language Models

    Chain-of-Verification (CoVe) cuts hallucinations with four steps: draft an answer, plan questions that fact-check the draft, answer each question independently, then write a final answer using those checks. It reduced hallucinations on list questions from Wikidata, closed-book MultiSpanQA and longform text generation.

    Shehzaad Dhuliawala, Mojtaba Komeili, Jing Xu, et al.

  • Techniques

    Lost in the Middle: How Language Models Use Long Contexts

    Lost in the Middle tested how language models use long contexts and found that they answer best when the relevant passage sits at the start or end of the input, and noticeably worse when it sits in the middle. The drop showed up even in models built for long contexts.

    Nelson F. Liu, Kevin Lin, John Hewitt, et al.

  • Techniques

    Chain-of-Thought Prompting Elicits Reasoning in Large Language Models

    Appending "let's think step by step" or showing worked-example reasoning in the prompt dramatically improves LLM accuracy on math and multi-step problems. The paper that named and formalized chain-of-thought. Still the cited reference for CoT despite being from 2022.

    Jason Wei, Xuezhi Wang, Dale Schuurmans, et al.