DocSentinel
DocSentinel is a Python/FastAPI MCP-ready service that parses security documents (PDF/DOCX/XLSX/PPTX/text), indexes an organization’s security policies into a knowledge base (RAG), and uses configurable LLM backends to generate structured security assessment reports (risks, compliance gaps, and remediation suggestions). It exposes REST endpoints for assessments and knowledge-base operations and includes an MCP server for agent integration.
Score Breakdown
⚙ Agent Friendliness
🔒 Security
Security.md is referenced but not provided; based on README/manifest only, endpoint-level auth/authorization is not clearly documented. TLS requirements for the REST/MCP server are not stated. The project includes LLM provider integration (OpenAI/Claude) and local options (Ollama), which affects data exposure risk. Dependencies include common Python libs and LLM/RAG tooling; no CVE/SBOM evidence is provided in the supplied content.
⚡ Reliability
Best When
You need repeatable, auditable security assessments across many projects using internal policies and you want to integrate the capability into agent workflows via MCP or into pipelines via REST.
Avoid When
You cannot control data exposure (documents/policies sent to external LLM providers) or you need guaranteed deterministic outputs and formal compliance certification.
Use Cases
- • Automate first-pass review of security questionnaires and design docs
- • Assess uploaded documents against internal policies/standards using RAG with citations
- • Generate structured compliance gap analyses and remediations for frameworks (e.g., ISO 27001, PCI DSS)
- • CI/CD or security workflow integration for repeated document assessments
- • Agent/desktop integration (e.g., Claude Desktop/OpenClaw) to run security assessment as a tool/skill
Not For
- • As a replacement for formal audits or legally binding compliance determinations
- • Real-time/hyper-low-latency systems (LLM + document parsing workflow)
- • Systems requiring strong tenancy isolation guarantees without additional infrastructure
- • Use without validating model output quality and policy mappings
Interface
Authentication
The README describes LLM provider keys (OpenAI) and MCP server configuration, but does not describe authentication/authorization for the DocSentinel REST/MCP endpoints (e.g., API keys, OAuth, tenant scoping). Assume service is trusted/internal unless additional auth is implemented elsewhere.
Pricing
Project appears self-hostable; pricing mainly depends on chosen LLM backend (OpenAI/Claude vs local Ollama). No published hosting tiers in provided content.
Agent Metadata
Known Gotchas
- ⚠ LLM backends can produce variable outputs; agents should validate/compare to policy clauses returned by RAG
- ⚠ Document parsing (PDF/DOCX/XLSX/PPTX) quality may vary; agents should expect occasional extraction errors
- ⚠ MCP and REST integration may require correct local file/Chroma path configuration (e.g., CHROMA_PERSIST_DIR)
- ⚠ If using cloud LLMs, document/policy content may be transmitted externally; confirm data-handling expectations before deployment
Alternatives
Full Evaluation Report
Comprehensive deep-dive: security analysis, reliability audit, agent experience review, cost modeling, competitive positioning, and improvement roadmap for DocSentinel.
AI-powered analysis · PDF + markdown · Delivered within 30 minutes
Package Brief
Quick verdict, integration guide, cost projections, gotchas with workarounds, and alternatives comparison.
Delivered within 10 minutes
Score Monitoring
Get alerted when this package's AF, security, or reliability scores change significantly. Stay ahead of regressions.
Continuous monitoring
Scores are editorial opinions as of 2026-03-30.