AUTOTEST review
A local CLI for turning web-page context into executable Selenium or Playwright tests.
Reviewed by iTechGuides Editors · Editorial team · Updated Oct 2026
AUTOTEST is an open-source command-line framework for developers who need to generate automated web test cases from existing pages. It uses large language models to analyze page metadata and HTML source, then creates page-specific cases and executable Python Selenium scripts. The repository also documents Playwright test generation. Its workflow is developer-oriented and local, making it a fit for teams comfortable running Python tools and supplying an LLM provider API key rather than using a hosted testing service.
Its strongest capability is the range of web scenarios it can generate from page context. AUTOTEST can recursively extract internal URLs with breadth-first search to a configured depth, and it supports positive and negative authentication and form scenarios. Supplied valid and invalid test data enables data-driven testing. The package also provides generated test reports and execution results, while caching LLM responses and generated test data. These features make it more useful for structured web flows than a basic prompt-to-test utility.
AUTOTEST remains focused on browser-based testing and local execution. The documented platform targets are Windows and Linux, and the tool requires an LLM provider API key. Selenium and Playwright are supported in the repository documentation, while Puppeteer support is available in the development branch. The approach is centered on inspecting existing web pages, so teams seeking a broader requirements-driven test design workflow may prefer another tool. Choose AUTOTEST for an open-source framework that generates executable web tests from HTML and page metadata; choose an alternative if you need hosted operation, broader platform coverage, or a requirements-first workflow.
AUTOTEST pros and cons
- Where it wins
- Generates executable Python Selenium scripts with LLMs
- Supports positive, negative, and data-driven web scenarios
- Analyzes page metadata, HTML, and internal URLs for context
- Where it doesn't
- Requires Python and an LLM provider API key
- Platform support is limited to Windows and Linux
- Focuses on web-page context rather than documented requirements
AUTOTEST fact sheet, pricing and score →
Advertiser disclosure: iTechGuides is reader-supported. Vendors can pay for top positions in our rankings and for a place on other products' pages, and we may earn a commission when you click some links. Bought places stand at the number bought; this page and our disclosure say so. Paying vendors may get a fuller, more detailed review from our editors, and that review can change their score. How we rank.
Last updated · How we research and update