Testence is an open-source Python framework designed to automate web testing by integrating AI agents into the development lifecycle. The tool manages the entire process from feature description and test design to the generation of executable pytest scripts.
The framework addresses common automation challenges such as reactive UI updates and race conditions. It emphasizes the use of an 'oracle'—a secondary verification method, such as an API check, to confirm that actions performed in the browser have actually persisted on the server.
The system separates the AI-driven design phase from execution. Once an agent creates, debugs, and validates a test, the resulting code runs independently using standard Playwright and pytest tools without requiring LLM calls or cloud subscriptions during CI/CD runs.
Testence provides diagnostic capabilities, including HTML reports, screenshots, and network logs. It supports integration with existing reporting tools like Allure, JUnit XML, and CTRF, allowing teams to maintain their current testing stack while incorporating AI-assisted workflows.
