ResearchPod Summary
Automated program repair (APR) often focuses on generating patches that pass test suites, but this "generate-and-validate" approach frequently treats the internal reasoning process as a black box. THEMIS addresses this by externalizing the requirement-to-repair process, creating a traceable record that connects issue requirements, semantic interpretations, code edits, and post-edit audit evidence. By making these transitions explicit, researchers can inspect how repair decisions evolve across stages.
THEMIS structures the repair process into four distinct modules that produce serialized, inspectable artifacts:
In an audit of 300 SWE-bench Lite cases, THEMIS demonstrated that its stage-aware projection provides broad support for inspection: 71.3% of cases retained a complete set of audited fields connecting the pre-edit, edit, and post-edit stages. Lexical analysis showed that target symbols identified by the system recur in 62.8% of patches, rising to 75.8% when related symbols are included. Furthermore, in a paired 100-case comparison, the relational workflow resolved 19 cases compared to 9 for a direct, non-relational baseline, suggesting that structuring the repair context significantly aids the model in producing successful patches.
By turning implicit reasoning into observable traces, THEMIS shifts the focus of APR evaluation from final outcomes to the quality of the repair process. This transparency allows developers to diagnose why a system failed, understand the rationale behind specific edits, and systematically improve the alignment between requirements and code changes.
AI-generated third-party summary by ResearchPod. Not official content or an endorsement by the paper authors or affiliated organizations.