HttpRunner
Open-source testing framework supporting API testing (HTTP/WebSocket/RPC), vision-driven UI automation (Android/iOS/browser via OCR/CV), and load testing. Includes MCP server for AI-assisted test orchestration and an interactive chat mode.
Score Breakdown
⚙ Agent Friendliness
🔒 Security
Community/specialized tool. Apply standard security practices for category. Review documentation for specific security requirements.
⚡ Reliability
Best When
You need a unified framework covering API, UI, and load testing with AI assistance, especially for Chinese-language teams or cross-platform mobile testing.
Avoid When
Your team needs English documentation, you only need API OR UI testing (not both), or you prefer established ecosystem tools like Playwright for browser testing.
Use Cases
- • API testing across HTTP, HTTP2, WebSocket, and RPC protocols
- • Cross-platform UI automation using vision-driven approach (OCR/CV)
- • Load testing with distributed horizontal scaling
- • AI-assisted test creation via MCP server integration
- • Mobile app testing on Android, iOS, and HarmonyOS
Not For
- • Teams needing English-first documentation (primarily Chinese)
- • Simple unit testing needs
- • Browser-only UI testing (Playwright/Cypress better suited)
- • Users wanting a GUI test builder
Interface
Authentication
No authentication required. CLI tool with local execution.
Pricing
Apache-2.0 license. Free and open source.
Agent Metadata
Known Gotchas
- ⚠ Documentation is primarily in Chinese with minimal English
- ⚠ MCP server is a subcommand (hrp mcp-server) with sparse documentation
- ⚠ Vision-driven UI testing adds OCR/CV overhead
- ⚠ Go binary distribution - limited plugin extensibility
- ⚠ v5 with LLM features appears to be evolving rapidly
Alternatives
Full Evaluation Report
Detailed scoring breakdown, competitive positioning, security analysis, and improvement recommendations for HttpRunner.
Scores are editorial opinions as of 2026-03-06.