Introduction to Self-Consistency in LLMs
Self-consistency is an advanced prompting technique that builds on COT prompting. The aim here is to improve the naive greedy decoding using COT prompting by sampling multiple diverse reasoning paths and selecting the most consistent answers.
This can help boost the performance of COT prompting on tasks involving arithmetic and common sense reasoning. By utilizing a majority voting system, the AI model can arrive at more accurate and reliable answers.