Revisiting Overthinking in Long Chain-of-Thought from the Perspective of Self-Doubt

Reasoning Large Language Models (RLLMs) have demonstrated impressive performance on complex tasks, largely due to the adoption of Long Chain-of-Thought (Long CoT) reasoning. However, they often exhibit overthinking -- performing unnecessary reasoning steps even after arriving at the correct answer. Prior work has largely focused on qualitative analyses of overthinking through sample-based observations of long CoTs. In contrast, we present a quantitative analysis of overthinking from the perspective of self-doubt, characterized by excessive token usage devoted to re-verifying already-correct answer. We find that self-doubt significantly contributes to overthinking. In response, we introduce a simple and effective prompting method to reduce the model's over-reliance on input questions, thereby avoiding self-doubt. Specifically, we first prompt the model to question the validity of the input question, and then respond concisely based on the outcome of that evaluation. Experiments on three mathematical reasoning tasks and four datasets with missing premises demonstrate that our method substantially reduces answer length and yields significant improvements across nearly all datasets upon 4 widely-used RLLMs. Further analysis demonstrates that our method effectively minimizes the number of reasoning steps and reduces self-doubt.

Paper

References (14)

102025. Reasoning without self-doubt: More efficient chain-of-thought through certainty probingICLR 2025 Workshop on Foundation Models in the Wild
112024. Achieving> 97% on gsm8k: Deeply understanding the problems makes llms better solvers for math word problemsarXiv
12and 22 others. 2024. Qwen2.5 technical reportarXiv preprint

Scroll for more · 2 remaining

Similar papers

© 2026 NYSGPT2525 LLC