{"id":"dasdigitalemomentum-searxncrawl","name":"searxNcrawl","af_score":58.0,"security_score":52.2,"reliability_score":31.2,"what_it_does":"searxNcrawl provides a minimal MCP server (STDIO and HTTP) plus CLI tools to search the web via SearXNG and crawl web pages/sites, extracting readable Markdown using Crawl4AI with configurable deduplication and optional authenticated crawling via Playwright storage_state.","best_when":"You need local/agent-harness crawling + Markdown extraction and can run an MCP server you control, optionally pointing to your own SearXNG instance.","avoid_when":"You need strict compliance guarantees, guaranteed safe crawling behavior, or you cannot run Playwright (chromium) and required dependencies locally.","last_evaluated":"2026-03-30T15:20:37.803992+00:00","has_mcp":true,"has_api":false,"auth_methods":["SearXNG basic auth via SEARXNG_USERNAME/SEARXNG_PASSWORD (optional)","Playwright storage_state file for authenticated crawling (WIP)"],"has_free_tier":false,"known_gotchas":["Authenticated crawling is WIP; UX/flow may change and may not be fully reliable.","Crawling can be expensive (browser automation via Playwright/chromium) and slow depending on target pages and concurrency.","Site crawling uses BFS with max depth/page limits; agents should set tight limits to avoid unexpectedly large crawls."],"error_quality":0.0}