msty-admin-mcp

msty-admin-mcp is an MCP server (Python) that provides tools for administering Msty Studio Desktop and orchestrating multiple local AI backends (Ollama, MLX, LLaMA.cpp, Vibe CLI proxy). It can auto-discover services via Msty port-based discovery, inspect Msty’s local SQLite data, sync configuration/personas, run calibration and response scoring, and perform Bloom behavioral evaluations using an external judge model via an Anthropic API key.

Evaluated Mar 30, 2026 (21d ago)
Repo ↗ DevTools mcp python msty local-ai administration bloom-evaluation anthropic sqlite streamable-http stdio
⚙ Agent Friendliness
55
/ 100
Can an agent use this?
🔒 Security
28
/ 100
Is it safe for agents?
⚡ Reliability
40
/ 100
Does it work consistently?

Score Breakdown

⚙ Agent Friendliness

MCP Quality
78
Documentation
70
Error Messages
0
Auth Simplicity
70
Rate Limits
0

🔒 Security

TLS Enforcement
30
Auth Strength
20
Scope Granularity
0
Dep. Hygiene
55
Secret Handling
45

TLS/auth are not clearly specified for the MCP HTTP transport; by default this appears intended for local use. No auth for MCP tool invocation is described, which may be risky if HTTP is exposed beyond localhost. Anthropic API key handling is required for Bloom tools, but documentation does not describe secret redaction/logging behavior. Package depends on mcp>=1.0.0 and common utilities; no CVE status is provided in the supplied data.

⚡ Reliability

Uptime/SLA
0
Version Stability
55
Breaking Changes
60
Error Recovery
45
AF Security Reliability

Best When

You run Msty Studio Desktop locally (macOS implied by topics) and want an MCP tool layer for local model orchestration plus optional Bloom-based behavioral evaluation using a judge model.

Avoid When

You need fine-grained access control, formal API contracts with comprehensive error semantics, or you cannot expose an HTTP transport on localhost with appropriate network restrictions.

Use Cases

  • Query and inspect Msty’s local SQLite database (tools, versions, configured tools)
  • Health monitoring across local Msty services and backends
  • Export/import tool configurations and preferences/personas
  • Chat and orchestrate requests across multiple local model backends
  • Collect model performance metrics and conversation analytics
  • Run local calibration tests and score responses
  • Detect handoff triggers and decide when to escalate to Claude using Bloom
  • Run Bloom behavioral evaluation workflows against local models

Not For

  • Production-grade remote multi-tenant services without additional security hardening
  • Environments requiring strong enterprise authentication/authorization for tool access
  • Use cases needing guaranteed idempotency or robust API pagination/recovery semantics (not described)
  • Teams unwilling to handle Anthropic API keys (Bloom Phase 6) and associated data exposure considerations

Interface

REST API
Yes
GraphQL
No
gRPC
No
MCP Server
Yes
SDK
No
Webhooks
No

Authentication

Methods: Anthropic API key via ANTHROPIC_API_KEY (for Bloom judge/evaluation tools)
OAuth: No Scopes: No

The README indicates Bloom tools require ANTHROPIC_API_KEY. For the MCP server itself, no authentication/authorization mechanism is described for tool access.

Pricing

Free tier: No
Requires CC: No

No pricing/tiers are described for the package itself.

Agent Metadata

Pagination
none
Idempotent
False
Retry Guidance
Not documented

Known Gotchas

  • HTTP transport uses a local endpoint (streamable-http) but no network binding/auth details are documented—ensure it is restricted to localhost.
  • Bloom Phase 6 requires ANTHROPIC_API_KEY; agent workflows should gracefully handle missing/invalid keys.
  • Service discovery depends on Msty version (requires Msty 2.4.0+ for port-based discovery).
  • Tool behavior may depend on locally running backend services on specific ports; ensure ports are reachable before calling tools.

Alternatives

Full Evaluation Report

Comprehensive deep-dive: security analysis, reliability audit, agent experience review, cost modeling, competitive positioning, and improvement roadmap for msty-admin-mcp.

AI-powered analysis · PDF + markdown · Delivered within 30 minutes

$99

Package Brief

Quick verdict, integration guide, cost projections, gotchas with workarounds, and alternatives comparison.

Delivered within 10 minutes

$3

Score Monitoring

Get alerted when this package's AF, security, or reliability scores change significantly. Stay ahead of regressions.

Continuous monitoring

$3/mo

Scores are editorial opinions as of 2026-03-30.

8642
Packages Evaluated
17761
Need Evaluation
586
Need Re-evaluation
Community Powered