AI Readiness AuditRef. APM-B02BEF3E · Confidential
Toolhouse API
An independent assessment of whether the Toolhouse API specification is ready for AI-assisted integration and autonomous agents, prepared for Toolhouse.
60/100
Significant gaps
Functional for AI-assisted builds.
Broken for autonomous agents.
Broken for autonomous agents.
Reach AI-ready by Phase 1; resolve all findings → 100 · AI-ready
F
D
C
B
A
60
055708085100
F · Not readyD · Significant gapsC · Needs workB · Mostly readyA · AI-ready
0
Critical blockers : no findings stop an operation group outright
4940
Total instances: 0 critical, 642 high, 2098 medium, 2200 low
52
Rule groups across 4 pillars: 0 critical, 642 high sev. instances
Executive summary
Toolhouse API scores 60.1/100: Significant gaps · Grade D. The weakest pillar is MCP readiness at 51; the strongest is SDK readiness for AI at 81. We recorded 4940 finding instances: 0 critical, 642 high, 2098 medium, and 2200 low. Functional for AI-assisted builds. Broken for autonomous agents. Every finding lives in the specification, and the roadmap in this report orders the fixes by impact; resolving them projects the score to 100/100.
Readiness by pillar
Significant gaps
60 / 100
FoundationThe spec itself
57/100
Standards Compliance
OpenAPI validity, structural correctness, specification conformance, and import linting: can machines trust your spec?
57Significant gaps
Build Time ReadinessAI writes the code
67/100
Documentation Readiness for AI
Descriptions that say when to use an operation, examples that pin down every shape: whether an AI can learn the truth of your API from what you publish
53Not ready
SDK Readiness for AI
Clean types, predictable naming, correct formats: whether production-grade client code can be generated from your spec, by SDK pipelines and AI coding assistants alike
81Mostly ready
Runtime ReadinessAgents make the calls
51/100
MCP Readiness
Whether your operations survive being turned into tools: distinct names, descriptions that carry what an agent must know, safe invocation semantics, auth, error recovery, and context budget
51Not ready
Score projection · what fixing each phase unlocks
Todaycurrent score
Phase 1fix highs
Phase 2+ fix mediums & lows
About this report. We evaluated the Toolhouse API specification against thousands of deterministic rules we have refined over twelve years of building API tooling, supplemented by AI-based analysis. Every finding is reproducible from the spec itself, scored consistently, and paired with a concrete fix.
What's at stake
What these gaps cost you in production
4 failure modes across 3 groups, each driven by your audit scores. Several are active risks today.
Foundation
The spec itself
57 / 100
Elevated risk · Standards compliance
Spec Violations Disrupt Toolchain Functionality
You must address property type mismatches, duplicate schema titles, and identical templated paths to prevent integration failures.
22→29
code quality score out of 40: the lift consumers achieve when the underlying spec is clean and standards-compliant
APIMatic Context Plugins research · Series B · June 2026
Build Time Readiness
AI writes the code
67 / 100
Active risk · Documentation readiness for AI
AI readers misinterpret Toolhouse API data
The missing parameter object descriptions force coding assistants to make incorrect assumptions, risking integration failures.
74%
of developers name missing or unclear documentation as the top reason they abandon an API. AI readers are stricter: what a human would ask about, an AI assumes.
APIMatic Developer Experience research · June 2026
Managed · SDK readiness for AI
SDKs generate incorrect types and formats
You should refine the schema layer to improve the accuracy of generated integration code.
0
fabricated API constructs when a coding assistant was grounded in an AI-ready spec. Ambiguity in the spec is what triggers hallucinated integration code
APIMatic Context Plugins research · 6 APIs · 3 models · June 2026
Runtime Readiness
Agents make the calls
51 / 100
Active risk · MCP readiness
Autonomous agents cannot execute API calls
The Toolhouse API lacks clear operation names and server URLs, preventing agents from safely executing tasks.
65%
reduction in token consumption when agent tools are grounded in authoritative API context. Bloated or confusable tools consume up to 3.3× more.
APIMatic Context Plugins research · Series A · June 2026
The evidence numbers come from our controlled research: 6 experiments across 3 models, 6 commercial APIs, and 3 languages. We derive each card's risk status from this API's pillar scores. Full methodology at apimatic.io.
Contents