AI Testing Repos

AI-powered testing & quality automation tools on GitHub · updated daily

Inspired by goodailist.com

⚙️383repos
146.1Ktotal stars
📈359added this week
🏆Othertop category
383 repos
1 / 4
#RepoStars1d7dForksDescriptionCategoryLanguageUpdated
1
vxcontrol
pentagi
17,4152,380Fully autonomous AI Agents system capable of performing complex penetration testing tasksSecurity TestingGo2026-05-31
2
raga-ai-hub
RagaAI-Catalyst
16,1693,607Python SDK for Agent AI Observability, Monitoring and Evaluation Framework. Includes features like agent, llm and tools tracing, debugging multi-agentic system, self-hosted dashboard and advanced analytics with timeline and execution graph view Performance TestingPython2026-02-11
3
cvat-ai
cvat
15,9673,695Computer Vision Annotation Tool (CVAT) is a leading platform for building high-quality visual datasets for vision AI. It offers open-source, cloud, and enterprise products, as well as labeling services, for image, video, and 3D annotation with AI-assisted labeling, quality assurance, team collaboration, analytics, and developer APIs.Visual TestingPython2026-06-03
4
alibaba
MNN
14,3842,218MNN is a blazing fast, lightweight deep learning framework, battle-tested by business-critical use cases in Alibaba. Full multimodal LLM Android App:[MNN-LLM-Android](./apps/Android/MnnLlmChat/README.md). MNN TaoAvatar Android - Local 3D Avatar Intelligence: apps/Android/Mnn3dAvatar/README.mdOtherC++2026-03-05
5
web-infra-dev
midscene
13,5581,025AI-powered, vision-driven UI automation for every platform.E2E TestingTypeScript2026-06-03
6
GreyDGL
PentestGPT
13,4572,327Automated Penetration Testing Agentic Framework Powered by Large Language ModelsSecurity TestingPython2026-02-23
7
evidentlyai
evidently
7,566857Evidently is ​​an open-source ML and LLM observability framework. Evaluate, test, and monitor any AI-powered system or data pipeline. From tabular data to Gen AI. 100+ metrics.Test GenerationJupyter Notebook2026-05-02
8
Giskard-AI
giskard-oss
5,417467🐢 Open-Source Evaluation & Testing library for LLM AgentsSecurity TestingPython2026-06-03
9
qodo-ai
qodo-cover
5,412518Qodo-Cover: An AI-Powered Tool for Automated Test Generation and Code Coverage Enhancement! 💻🤖🧪🐞Test GenerationPython2026-04-05
10
GH05TCREW
pentestagent
2,569509PentestAgent is an AI agent framework for black-box security testing, supporting bug bounty, red-team, and penetration testing workflows.Security TestingPython2026-05-27
11
Armur-Ai
Pentest-Swarm-AI
1,645341Autonomous penetration testing using a swarm of AI agents. Orchestrates recon, classification, exploitation, and reporting specialists with ReAct reasoning — supports bug bounty, continuous monitoring, and CTF modes. Built with Go, Claude API, and 7+ native security tools.Security TestingGo2026-05-25
12
kubeshop
testkube
1,600164☸️ The Open Testing Platform for AI-Driven Engineering TeamsObservabilityGo2026-06-03
13
zakirkun
guardian-cli
1,445304Guardian is a production-ready AI-powered penetration testing automation CLI tool that leverages Google Gemini and LangChain to orchestrate intelligent, step-by-step penetration testing workflows while maintaining ethical hacking standards.Test GenerationPython2026-05-29
14
JoasASantos
NeuroSploit
1,118270NeuroSploit is an advanced, AI-powered penetration testing framework designed to automate and augment various aspects of offensive security operations. Leveraging the capabilities of large language models (LLMs).Security TestingPython2026-03-29
15
test-zeus-ai
testzeus-hercules
1,034160Hercules is the world’s first open-source testing agent, enabling UI, API, Security, Accessibility, and Visual validations – all without code or maintenance. Automate testing effortlessly and let Hercules handle the heavy lifting! ⚡E2E TestingPython2026-05-26
16
SanMuzZzZz
LuaN1aoAgent
995158LuaN1aoAgent is a cognitive-driven AI hacker. It is a fully autonomous AI penetration testing agent, using dual-graph reasoning.Security TestingPython2026-04-13
17
PurpleAILAB
Decepticon
932175Autonomous Multi-Agent Based Red Team Testing Service / AI hackerTest GenerationPython2026-03-26
18
MGdaasLab
WHartTest
925123WHartTest 是一款AI驱动的测试自动化平台,实现从需求到可执行测试用例的自动化生成与管理,帮助测试团队提升效率与覆盖率。 (WHartTest is an AI-driven test automation platform that automates the generation and management of executable test cases from requirements, helping testing teams improve efficiency and coverage.)E2E TestingPython2026-06-03
19
CyberSecurityUP
NeuroSploit
910234NeuroSploit is an advanced, AI-powered penetration testing framework designed to automate and augment various aspects of offensive security operations. Leveraging the capabilities of large language models (LLMs).Security TestingPython2026-02-24
20
bug0inc
passmark
897163The open-source Playwright library for AI browser regression testing with intelligent caching, auto-healing, and multi-model verification.E2E TestingTypeScript2026-05-29
21
langwatch
scenario
89365Agentic testing for agentic codebasesOtherPython2026-06-02
22
alumnium-hq
alumnium
89190End-to-end testing with AIE2E TestingTypeScript2026-06-03
23
zakirkun
deep-eye
831177An advanced AI-driven vulnerability scanner and penetration testing tool that integrates multiple AI providers (OpenAI, Grok, OLLAMA, Claude) with comprehensive security testing modules for automated bug hunting, intelligent payload generation, and professional reporting.Test GenerationPython2026-02-03
24
Agent-Field
SWE-AF
831133Autonomous software engineering fleet of AI agents for production-grade PRs on AgentField: plan, code, test, and ship.Test GenerationPython2026-06-01
25
ScrapeGraphAI
scrapecraft
65198🤖 AI-powered web scraping editor with visual workflow builder. Build, test & deploy web scrapers using natural language. Powered by ScrapeGraphAI & LangGraph.Visual TestingPython2025-12-26
26
pikpikcu
airecon
63799AIRecon is an autonomous cybersecurity agent that combines a self-hosted Large Language Model (Ollama) with a Kali Linux Docker sandbox and a Textual TUI. It is designed to automate security assessments, penetration testing, and bug bounty reconnaissance — without any API keys or cloud dependency.Security TestingPython2026-04-23
27
CopilotKit
aimock
61540Mock everything your AI app talks to — LLM APIs, MCP, A2A, AG-UI, vector DBs, search. One package, one port, zero dependencies.OtherTypeScript2026-06-03
28
trueleaf
apiflow
60498A modern API workspace that works both online and offline — combining API documentation, testing, mock, and AI-powered automation in one lightweight toolOtherTypeScript2026-05-31
29
ServiceNow
AgentLab
585115AgentLab: An open-source framework for developing, testing, and benchmarking web agents on diverse tasks, designed for scalability and reproducibility.Performance TestingPython2026-03-17
30
PacificAI
langtest
55949Deliver safe & effective language modelsPerformance TestingPython2026-04-22
31
Pacific-AI-Corp
langtest
55150Deliver safe & effective language modelsPerformance TestingPython2026-02-19
32
modal-labs
devlooper
46931A program synthesis agent that autonomously fixes its output by running tests!OtherPython2024-09-19
33
Ktovoz
Skiritai
41917AI-powered test automation framework that explores test paths with AI and generates replayable scripts for 30x faster execution.Test GenerationPython2026-05-30
34
project-codeguard
rules
40956Project CodeGuard is an AI model-agnostic security framework and ruleset that embeds secure-by-default practices into AI coding workflows (generation and review). It ships core security rules, translators for popular coding agents, and validators to test rule compliance.Test GenerationPython2026-01-29
35
RevoltDevScript
Revolt-Script
3881Revolt is the #1 Edgenuity automation tool featuring Auto Quiz, Auto Essay, Auto Advance, AI-powered writing with humanization, Auto Vocabulary, Auto Journal, and more. A semi-AFK script that handles quizzes, tests, exams, projects, and essays with ease. Compatible with desktop and mobile. Visit https://revolt.ly to get started.Other2026-04-16
36
SHAdd0WTAka
Zen-Ai-Pentest
38565🛡⚔️AI-Powered Penetration Testing Framework with automated vulnerability scanning, multi-agent system, and compliance reporting🛡⚔️Security TestingPython2026-05-29
37
z3n70
Frida-Script-Runner
36275Web-based Frida framework and toolkit for Android & iOS penetration testing, mobile security, and dynamic analysis, featuring AI-assisted Frida script generation.Test GenerationJavaScript2026-01-26
38
faiscadev
fakecloud
31119Free, open-source AWS emulator. LocalStack alternative: 40 services, 2,935 operations, true 100% Smithy conformance (99,678/99,678 variants pass). No account, no auth token, no paid tier.Integration TestingRust2026-06-02
39
aielte-research
HackSynth
31051LLM Agent and Evaluation Framework for Autonomous Penetration Testing Security TestingPython2025-06-24
40
CyberStrikeus
CyberStrike
29857AI-powered offensive security agent with 7,300+ actionable security skills. Autonomous pentesting powered by MITRE ATT&CK (2,000+ Atomic tests), CIS Benchmarks (1,500+ controls), OWASP, NIST. Lazy-loading, zero context pollution. Your AI red team.Security TestingTypeScript2026-06-02
41
pensarai
apex
28349AI-powered offensive security testing using autonomous agents, directly in your terminal.Security TestingTypeScript2026-06-03
42
jd-opensource
JoySafeter
28053🚀 JoySafeter: An enterprise AI Agent Platform—Not just chatting. building、running、testing, and tracing autonomous Agent Teams with visual orchestration...Visual TestingPython2026-05-29
43
ai-dashboad
flutter-skill
27836AI-powered E2E testing for 10 platforms. 253 MCP tools. Zero config. Works with Claude, Cursor, Windsurf, Copilot. Test Flutter, React Native, iOS, Android, Web, Electron, Tauri, KMP, .NET MAUI — all from natural language.E2E TestingDart2026-05-21
44
Coff0xc
AutoRedTeam-Orchestrator
23752Enterprise AI Red Team Platform | 企业级AI红队平台 | 132 MCP Tools | Pure Python Engines | SDK+CLI+MCP | Auto-Download sqlmap/nuclei/ffuf | Production C2 | LLM Enhanced | Docker Sandbox | SARIF CI/CD | 1980 TestsSecurity TestingPython2026-05-18
45
gsd-build
gsd-browser
23414A fast, native browser automation CLI built from the ground up for AI agents, powered by Chrome DevTools Protocol. 63 commands covering navigation, interaction, screenshots, accessibility, network mocking, visual diffing, test generation, and more — all from a single binary.E2E TestingRust2026-05-03
46
Corpus-OS
corpusos
2247Open-source protocol suite standardizing LLM, Vector, Graph, and Embedding infrastructure across LangChain, LlamaIndex, AutoGen, CrewAI, Semantic Kernel, and MCP. 3,330+ conformance tests. One protocol. Any framework. Any provider.OtherPython2026-05-08
47
praetorian-inc
augustus
22328LLM security testing framework for detecting prompt injection, jailbreaks, and adversarial attacks — 190+ probes, 28 providers, single Go binarySecurity TestingGo2026-06-03
48
capture0x
AdStrike
21643AI-powered modular Active Directory red-team framework for authorized penetration testing, AD enumeration, attack-path analysis, Kerberos/ADCS workflows, reporting, operator automation, and MCP server integration.Security TestingPython2026-06-02
49
LLAMATOR-Core
llamator
21120Red Teaming python-framework for testing chatbots and GenAI systems.Security TestingPython2026-05-20
50
inhouseseo
superseo-skills
1952711 Claude skills for SEO: page audits, linkbuilding, article writing, E-E-A-T audits, semantic gap analysis, link building. Methodology from Koray Tuğberk, Kyle Roof, and Lily Ray, plus a generation-time anti-AI-slop ruleset. Production-tested at InhouseSEOTest Generation2026-05-12
51
Hellsender01
LLMMap
19522Automated prompt injection testing framework for LLM-integrated applications with dual-LLM architecture.OtherPython2026-03-14
52
ShirleyRex
assertify.io
176121AI-powered assistant that turns your project context into end-to-end test strategies, detailed scenarios, and ready-to-run boilerplate across popular frameworks.E2E TestingTypeScript2026-03-15
53
CatchTheTornado
open-agents-builder
17236AI Agents are missing the UI! We're here to change it. Build Business AI Agents for your company: business workflows, API's, bookings, e-commerce, social commerce, b2b, CPQ, intake forms, NPS tests, made-to-order use casesOtherTypeScript2025-12-08
54
KHenryAegis
VulnBot
16828The repository of VulnBot: Autonomous Penetration Testing for A Multi-Agent Collaborative Framework.OtherPython2025-04-07
55
AISquare-Studio
AISquare-Studio-QA
1679Setting up QA testing agents using playwright and crewAIE2E TestingPython2026-04-17
56
fugazi
test-automation-skills-agents
15727A practical library of agents, instructions, and skills designed specifically for QA Automation Engineers, focusing on production-oriented solutions.OtherJava2026-05-25
57
DanielSuo117
velocitai
1560Next-generation UI automation harness powered by Python & Playwright. Chat with AI Agents to seamlessly generate, architect, and execute enterprise-grade UI test code.E2E TestingHTML2026-05-24
58
DebugBase
glance
15323AI-powered browser automation MCP server for Claude Code. Navigate, click, screenshot, test — all from your terminal.E2E TestingTypeScript2026-04-16
59
pymc-labs
decision-lab
14512Run tested, autonomous agent workflows on your data for meaningful decision-making OtherPython2026-06-03
60
fzn0x
watchtower
14124Watchtower is a simple AI-powered penetration testing automation CLI tool that leverages LLMs and LangGraph to orchestrate agentic workflows that you can use to test your websites locally. Generate useful pentest reports for your websites.Test GenerationPython2026-02-27
61
alfredolopez80
multi-agent-ralph-loop
13922Autonomous orchestration framework for Claude Code with MemPalace-inspired memory (4-layer stack, 818-token wake-up), parallel-first Agent Teams (6 teammates), Aristotle First Principles methodology, and 4-stage quality gates. 925+ tests, 22 active hooks, automatic learning pipeline.ObservabilityShell2026-04-20
62
PramodDutta
qaskills
13311QA Skills Directory QA Skills is a curated directory of testing-specific skills for AI coding agents (Claude Code, Cursor, Copilot, etc.).E2E TestingTypeScript2026-05-25
63
nbshenxm
pentest-agent
12637PentestAgent is a novel LLM-driven penetration testing framework to automate intelligence gathering, vulnerability analysis, and exploitation stages, reducing manual intervention. For more information, read our paper at https://dl.acm.org/doi/10.1145/3708821.3733882 Security TestingPython2025-12-20
64
notadev-iamaura
OneRAG
12338Production-ready RAG Framework (Python/FastAPI). 1-line config swaps: 6 Vector DBs (Weaviate, Pinecone, Qdrant, ChromaDB, pgvector, MongoDB), 5 LLMs (Gemini, OpenAI, Claude, Ollama, OpenRouter). OpenAI-compatible API. 2100+ tests.Test GenerationPython2026-06-01
65
Wytamma
write-the
12115AI-powered Documentation and Test Generation ToolTest GenerationPython2025-06-26
66
Free-AI-Things
g4f-working
10814g4f-working is a daily-updated list of working no-auth AI providers and models from @xtekky/gpt4free. It helps developers, testers, and AI enthusiasts instantly find which models are currently online and accessible without any API keys, tokens, or cookies.Test GenerationPython2026-06-02
67
qelos-io
testai
10114The testing framework for skills, MCPs, commands, subagents, and LLM models! Docs at https://testingai.aiOtherTypeScript2026-05-25
68
Addepto
contextcheck
9511 MIT-licensed Framework for LLMs, RAGs, Chatbots testing. Configurable via YAML and integrable into CI pipelines for automated testing.Test GenerationPython2024-12-11
69
georgeguimaraes
tribunal
903LLM evaluation framework for Elixir: evaluate and test LLM outputs, detect hallucinations, measure response qualityOtherElixir2026-06-01
70
nayangoel
AIPentester
9015AI-powered penetration testing assistant for Claude Code. Autonomous security testing with browser automation, Burp Suite integration, and intelligent threat modeling.E2E TestingPython2026-04-28
71
maikotrindade
mobile-tester-agent
9015AI-powered test automation tool which allows developers to run mobile automated testsOtherKotlin2026-05-28
72
JetBrains-Research
TestSpark
8726TestSpark - a plugin for generating unit tests. TestSpark natively integrates different AI-based test generation tools and techniques in the IDE. Started by SERG TU Delft. Currently under implementation by JetBrains Research (Software Testing Research) for research purposes.Test GenerationKotlin2026-02-07
73
anton-abyzov
specweave
879Spec-driven development framework for AI coding agents. 100+ skills for Claude Code, Cursor, Copilot, Codex, Antigravity & more. CLI tools, verified skill certification via verified-skill.com, and autonomous execution.OtherTypeScript2026-03-11
74
bitDive
java-producer
874Low-overhead Java agent for the Autonomous Verification Layer. Captures real runtime traces, SQL queries, and HTTP payloads in Spring Boot apps to enable trace-based testing.ObservabilityJava2026-04-29
75
bitDive
mcp-server
8118BitDive Model Context Protocol (MCP) server. The Autonomous Quality Loop for AI agents. Provides real runtime context, before/after trace comparison, and integration testing workflows.ObservabilityPython2026-05-30
76
MLSZHU
LLMSafetyBenchmark
8058A comprehensive framework for assessing the security capabilities of large language models (LLMs) through multi-dimensional testing.Security TestingPython2025-05-15
77
vuejs-ai
vue-tui
801The Vue framework for terminal UIs. SFC & JSX, Yoga flexbox, HMR, and testing out of the box.OtherTypeScript2026-06-03
78
samihalawa
visual-ui-debug-agent-mcp
787VUDA is an autonomous debugging agent that empowers AI models to visually analyze, test, and debug webE2E TestingJavaScript2025-12-09
79
MasoudJTehrani
PCLA
7712PCLA: A framework for testing autonomous agents in the CARLA simulatorOtherJupyter Notebook2026-04-13
80
ellydee
acceptance-bench
761A robust LLM evaluation framework measuring acceptance vs refusal across difficulty levels. Features multi-prompt variation testing, temperature sweeping, and LLM-as-judge evaluation.OtherPython2026-04-13
81
vostride
agent-qa
764The self-improving Agentic QA harness with Memory. Write tests in natural language.
 Catch regressions before releases ship.E2E TestingTypeScript2026-05-25
82
DataKitchen
dataops-testgen
756DataOps Data Quality TestGen is part of DataKitchen's Open Source Data Observability. DataOps TestGen delivers simple, fast data quality test generation and execution by data profiling,  new dataset hygiene review, AI generation of data quality validation tests, ongoing testing of data refreshes, & continuous anomaly monitoringTest GenerationPython2026-06-03
83
hoangsonww
Agentic-AI-Pipeline
6919🦾 A production‑ready research outreach AI agent that plans, discovers, reasons, uses tools, auto‑builds cited briefings, and drafts tailored emails with tool‑chaining, memory, tests, and turnkey Docker, AWS, Ansible & Terraform deploys. Bonus: An Agentic RAG System & a Coding Pipeline with multistep planning, self-critique, and autonomous agents.OtherPython2026-06-02
84
syntropix-ai
synthora
682Synthora is a lightweight, extensible framework for LLM-driven agents and ALM research. It provides the essential components to build, test, and evaluate agents, enabling you to assemble an agent with a single configuration file. Our goal is to minimize effort while delivering robust functionality.OtherPython2025-10-03
85
Yenn503
Hexstrike-redteam
6512 AI-powered MCP penetration testing framework combining HexStrike's 150+ security tools with BOAZ's advanced payload evasion (77+ loaders, 12 encoders). Features 12+ autonomous AI agents for bug bounty, CTF, CVE intelligence, exploit generation, and red team operations.Test GenerationC++2025-11-27
86
Rahulec08
appium-mcp
6410AI-powered mobile automation with Model Context Protocol (MCP) integration. Seamlessly control Android & iOS devices through Appium with intelligent visual element detection and recovery. Built for AI agents like Claude to perform complex mobile testing workflows.Visual TestingTypeScript2025-07-30
87
srvsngh99
genai-testing-journey
622052-week journey from QA/SDET to GenAI Testing - learning in public with weekly mini-projects, code, and honest documentation of struggles and wins.OtherPython2026-05-12
88
ServiceNow
DoomArena
617DoomArena is a Framework for Testing AI Agents Against Evolving Security ThreatsE2E TestingPython2025-09-12
89
walker0012025
API-TestPilot
6113API-TestPilot,Ai 驱动的高效接口测试用例生成模型 | AI-Driven Efficient API Test Case Generation ModelTest GenerationPython2025-09-10
90
who0xac
Pinakastra
617AI-powered pentesting framework with automated recon and exploitation. Multi-source subdomain discovery, active vuln testing (XSS/SQLi/SSRF/IDOR), AI-driven payload generation, local inference, structured reporting. For pentesters and bug bounty hunters.Test GenerationGo2025-12-27
91
existential-birds
beagle
618Claude Code plugin marketplace: 145 framework-aware code-review skills plus AI-writing detection, doc and test-plan generation, architectural analysis, and git workflows — for Python, Go, Rust, Elixir, React, Remix, iOS/Swift, and AI frameworks. Installable for Codex and other agents too.Test GenerationShell2026-05-31
92
zachblume
autospec
618Autospec is an open-source AI agent that takes a web app URL and autonomously QAs it, and saves its passing specs as E2E test codeE2E TestingTypeScript2026-05-15
93
zakirkun
saber-ai
6110A production-grade, autonomous, AI-powered penetration testing and security automation platform.Security TestingPython2026-05-19
94
kousen
OpenAIClient
6030Demonstrates how to use Spring to access OpenAI restful web services without using the Spring AI project. Tests call ChatGPT for text, DALL-E for image generation, and Whisper for audio transcriptions.Test GenerationJava2024-09-10
95
coinse
droidagent
598DroidAgent: Intent-Driven Mobile GUI Testing with Autonomous LLM AgentsOtherJupyter Notebook2024-03-12
96
Echoxiawan
AITestCase
5919A生成测试用例:基于页面和需求文档内容结合自动生成测试用例,解决单个需求文档生成测试用例质量较差的问题。Test Case Generation: Automatically generate test cases based on the current page and requirement document content, solving the problem of poor quality test cases generated from a single requirement document.E2E TestingPython2026-05-12
97
Alqemist-labs
ruby_llm-tribunal
562LLM evaluation framework for Ruby, powered by RubyLLM. Tribunal provides tools for evaluating and testing LLM outputs, detecting hallucinations, measuring response quality, and ensuring safety. Perfect for RAG systems, chatbots, and any LLM-powered application.OtherRuby2026-04-09
98
presidio-oss
factif-ai
5627AI-powered computer control for automated testing. Factifai uses vision models (Claude, GPT-4o, Gemini) to interact with applications naturally - clicking, typing, and verifying results just like a human would.E2E TestingTypeScript2025-10-01
99
angelomorgado
CARLA-GymDrive
5413Autonomous driving episode generation for the Carla simulator in a gym environment. This framework makes it easy to create driving scenarios to train/test the agent.Test GenerationPython2024-11-01
100
MatterAIOrg
matter-ai
537Matter AI is open-source AI Code Reviewer Agent 🤖 for Code Review, Summary Generation, Bug Detection, Security Vulnerabilities and Tests GenerationTest GenerationTypeScript2025-06-29