Contradictory effects of verifier feedback in formal theorem proving
In brief
- Showing prior failures reduces performance in formal theorem proving.
- Adding error messages partially compensates for this drop.
- No tested method outperforms independent resampling.
A study examines how verifier feedback impacts the repair of failed proofs in Lean. Results show that showing previous failures reduces performance, except when error messages are provided. No method outperforms independent resampling.
This summary gives you the essentials. The full article, its figures and quotes are on cs.AI updates on arXiv.org.
Read the original articleAI-generated summary of the source, checked by rules. Report an error