AI Readiness AuditRef. APM-B7348C11 · Confidential
Ably Platform API
An independent assessment of whether the Ably Platform API specification is ready for AI-assisted integration and autonomous agents, prepared for Ably.
74/100
Needs work
Gaps for AI-assisted builds.
Not ready for autonomous agents.
Not ready for autonomous agents.
Reach AI-ready by Phase 1; resolve all findings → 100 · AI-ready
F
D
C
B
A
74
055708085100
F · Not readyD · Significant gapsC · Needs workB · Mostly readyA · AI-ready
0
Critical blockers : no findings stop an operation group outright
552
Total instances: 0 critical, 23 high, 193 medium, 336 low
37
Rule groups across 4 pillars: 0 critical, 23 high sev. instances
Executive summary
Ably Platform API scores 74.1/100: Needs work · Grade C. The weakest pillar is Documentation readiness for AI at 66; the strongest is Standards compliance at 80. We recorded 552 finding instances: 0 critical, 23 high, 193 medium, and 336 low. Gaps for AI-assisted builds. Not ready for autonomous agents. Every finding lives in the specification, and the roadmap in this report orders the fixes by impact; resolving them projects the score to 100/100.
Readiness by pillar
Needs work
74 / 100
FoundationThe spec itself
80/100
Standards Compliance
OpenAPI validity, structural correctness, specification conformance, and import linting: can machines trust your spec?
80Needs work
Build Time ReadinessAI writes the code
72/100
Documentation Readiness for AI
Descriptions that say when to use an operation, examples that pin down every shape: whether an AI can learn the truth of your API from what you publish
66Significant gaps
SDK Readiness for AI
Clean types, predictable naming, correct formats: whether production-grade client code can be generated from your spec, by SDK pipelines and AI coding assistants alike
78Needs work
Runtime ReadinessAgents make the calls
69/100
MCP Readiness
Whether your operations survive being turned into tools: distinct names, descriptions that carry what an agent must know, safe invocation semantics, auth, error recovery, and context budget
69Significant gaps
Score projection · what fixing each phase unlocks
Todaycurrent score
Phase 1fix highs
Phase 2+ fix mediums & lows
About this report. We evaluated the Ably Platform API specification against thousands of deterministic rules we have refined over twelve years of building API tooling, supplemented by AI-based analysis. Every finding is reproducible from the spec itself, scored consistently, and paired with a concrete fix.
What's at stake
Residual risks to monitor
No active failures, but elevated risks remain. Continued improvement will bring these into the managed band.
Foundation
The spec itself
80 / 100
Elevated risk · Standards compliance
Default Value Violates Schema Compliance
You must correct the default value to match the defined schema type, as this breaks SDK generation and downstream integrations.
22→29
code quality score out of 40: the lift consumers achieve when the underlying spec is clean and standards-compliant
APIMatic Context Plugins research · Series B · June 2026
Build Time Readiness
AI writes the code
72 / 100
Elevated risk · Documentation readiness for AI
AI readers misinterpret API parameters
You must provide detailed descriptions for parameters to ensure accurate understanding and prevent assumptions.
74%
of developers name missing or unclear documentation as the top reason they abandon an API. AI readers are stricter: what a human would ask about, an AI assumes.
APIMatic Developer Experience research · June 2026
Elevated risk · SDK readiness for AI
SDKs return incorrect types and formats
We found that the success response lacks a body schema, leading to integration code errors and misinterpretations.
0
fabricated API constructs when a coding assistant was grounded in an AI-ready spec. Ambiguity in the spec is what triggers hallucinated integration code
APIMatic Context Plugins research · 6 APIs · 3 models · June 2026
Runtime Readiness
Agents make the calls
69 / 100
Elevated risk · MCP readiness
Autonomous agents struggle with API execution
The agents misinterpret tool names, encounter mutation semantics in GET operations, and face non-object request bodies, which disrupts safe API interactions.
65%
reduction in token consumption when agent tools are grounded in authoritative API context. Bloated or confusable tools consume up to 3.3× more.
APIMatic Context Plugins research · Series A · June 2026
The evidence numbers come from our controlled research: 6 experiments across 3 models, 6 commercial APIs, and 3 languages. We derive each card's risk status from this API's pillar scores. Full methodology at apimatic.io.
Contents