CRAFT

Contextual Repair Agent for Flaky Tests - A Multi-Agent VS Code extension.

CRAFT (Contextual Repair Agent for Flaky Tests) is a Multi-Agent VS Code extension designed to detect and repair flaky tests directly within the IDE.

The Solution

Unlike traditional tools that rely on static analysis or simple regression, CRAFT utilizes a Multi-Agent architecture to analyze the test execution context dynamically. It supports both Java and Python environments.

The agents work collaboratively to:

  1. Detect flaky tests by analyzing execution history and code patterns.
  2. Diagnose the root cause (e.g., concurrency issues, async waits).
  3. Repair the code autonomously using LLM-based reasoning.

Key Features

  • Multi-Agent Architecture: Specialized agents for diagnosis, generation, and verification.
  • Dual Language Support: Native integration for Java (JUnit) and Python (pytest).
  • IDE Integration: seamless experience within VS Code.
Snapshot of CRAFT detecting and repairing a flaky test in VS Code.

View the code on GitHub.