MEGA Hub

TDD-Agent: Test-Driven Reasoning for Code Generation

Authors

Do you know Hongyue Yu?You can claim authorship or link another user.Do you know Kefan Li?You can claim authorship or link another user.Do you know Jiakun Li?You can claim authorship or link another user.Do you know Hongzheng Chai?You can claim authorship or link another user.Do you know Yuan Yuan?You can claim authorship or link another user.Do you know Rui He?You can claim authorship or link another user.Do you know Junyi Wei?You can claim authorship or link another user.

Abstract

Large Language Models (LLMs) have achieved remarkable progress in code generation, yet ensuring correctness in complex, repository-level tasks remains challenging. Existing approaches often use generated tests as static post-hoc validators, which limits their ability to guide implementation and may introduce misleading feedback when the tests themselves are incomplete or incorrect. In this paper, we introduce TDD-Agent, which operationalizes the test-driven development paradigm for code generation. TDD-Agent first prompts the model to generate executable tests, encouraging it to clarify expected behaviors before implementation, and then performs iterative dual-track refinement over both the generated code and tests using execution feedback. We first isolate the effect of test-first reasoning through a prompt variant TDD-prompt on LiveCodeBench, where it consistently improves upon reasoning-based prompting baselines. Building on this finding, we evaluate the full TDD-Agent framework on RepoEval, a repository-level benchmark, and show that it consistently outperforms retrieval-based and agent-based baselines. Additional analyses show that iterative refinement improves not only code correctness but also the effectiveness of the generated tests, yielding higher pass rates, coverage, and mutation scores, suggesting that tests can serve as evolving reasoning artifacts rather than fixed validators. Our source code is available at https://anonymous.4open.science/r/TDD-Agent-Framework-6370/.

Community

00