HttpRunner

Open-source testing framework supporting API testing (HTTP/WebSocket/RPC), vision-driven UI automation (Android/iOS/browser via OCR/CV), and load testing. Includes MCP server for AI-assisted test orchestration and an interactive chat mode.

Evaluated Mar 01, 2026 (50d ago) vunknown
Homepage ↗ Repo ↗ Developer Tools mcp api-testing ui-automation load-testing golang http websocket android ios ocr vision-testing
⚙ Agent Friendliness
55
/ 100
Can an agent use this?
🔒 Security
50
/ 100
Is it safe for agents?
⚡ Reliability
N/A
Not evaluated
Does it work consistently?
AF Security Reliability

Best When

You need a unified framework covering API, UI, and load testing with AI assistance, especially for Chinese-language teams or cross-platform mobile testing.

Avoid When

Your team needs English documentation, you only need API OR UI testing (not both), or you prefer established ecosystem tools like Playwright for browser testing.

Use Cases

  • API testing across HTTP, HTTP2, WebSocket, and RPC protocols
  • Cross-platform UI automation using vision-driven approach (OCR/CV)
  • Load testing with distributed horizontal scaling
  • AI-assisted test creation via MCP server integration
  • Mobile app testing on Android, iOS, and HarmonyOS

Not For

  • Teams needing English-first documentation (primarily Chinese)
  • Simple unit testing needs
  • Browser-only UI testing (Playwright/Cypress better suited)
  • Users wanting a GUI test builder

Alternatives

Full Evaluation Report

Comprehensive deep-dive: security analysis, reliability audit, agent experience review, cost modeling, competitive positioning, and improvement roadmap for HttpRunner.

AI-powered analysis · PDF + markdown · Delivered within 30 minutes

$99

Package Brief

Quick verdict, integration guide, cost projections, gotchas with workarounds, and alternatives comparison.

Delivered within 10 minutes

$3

Score Monitoring

Get alerted when this package's AF, security, or reliability scores change significantly. Stay ahead of regressions.

Continuous monitoring

$3/mo

Scores are editorial opinions as of 2026-03-01.

8642
Packages Evaluated
17761
Need Evaluation
586
Need Re-evaluation
Community Powered