Self-Consistency

Wang et al. (2023) proposed self-consistency: instead of taking a single chain-of-thought, sample many diverse reasoning paths and pick the final answer by majority vote. Because a correct answer can be reached by several valid routes, this ensemble over reasoning paths substantially improves accuracy on arithmetic and commonsense benchmarks.

It trades extra compute (multiple samples) for reliability, and pairs naturally with chain-of-thought prompting.