AI Readiness Audit
Ref. APM-5386AE27 · Confidential

Datavant REST API

An independent assessment of whether the Datavant REST API specification is ready for AI-assisted integration and autonomous agents, prepared for Datavant.

Prepared for
Datavant
Subject
Datavant REST API v2023-04-01
Scope
54 operations · 4 pillars · 3 groups
Date
October 2026
45/100
Not ready
Gaps for AI-assisted builds.
Not ready for autonomous agents.
Reach AI-ready by Phase 2; resolve all findings → 100 · AI-ready
Import blocked: SDK, docs, and MCP generators will refuse this spec

The validation engine found 1 blocking violation: No item found in the enumeration list.. Import tools reject the specification outright until it is fixed, so nothing downstream can be generated regardless of the other pillar scores. While this gate is open, the Standards Compliance score is capped at 40 and every AI pillar weights standards at 60% (normally 30%). Fixing the blocker in Phase 1 lifts the caps; the score projection below shows what that unlocks.

1
Critical blocker stopping entire operation groups for agents
2375
Total instances: 1 critical, 474 high, 715 medium, 1185 low
61
Rule groups across 4 pillars: 1 critical, 474 high sev. instances
Executive summary

Your API cannot generate SDKs, documentation, or MCPs due to a blocking violation in the specification. The overall composite score of 45.3 out of 100 indicates significant readiness issues, with standards compliance at 38.4 and documentation readiness for AI at 45. The audit identified 474 high-severity findings across 61 rule groups, revealing critical gaps for AI-assisted builds and a lack of readiness for autonomous agents. To move forward, you must address the blocking violation to enable any generation from the API specification.

Readiness by pillar
Not ready 45 / 100
FoundationThe spec itself
38/100
Standards Compliance
OpenAPI validity, structural correctness, specification conformance, and import linting: can machines trust your spec?
38Not ready
Build Time ReadinessAI writes the code
50/100
Documentation Readiness for AI
Descriptions that say when to use an operation, examples that pin down every shape: whether an AI can learn the truth of your API from what you publish
45Not ready
SDK Readiness for AI
Clean types, predictable naming, correct formats: whether production-grade client code can be generated from your spec, by SDK pipelines and AI coding assistants alike
55Not ready
Runtime ReadinessAgents make the calls
47/100
MCP Readiness
Whether your operations survive being turned into tools: distinct names, descriptions that carry what an agent must know, safe invocation semantics, auth, error recovery, and context budget
47Not ready
Score projection · what fixing each phase unlocks
Todaycurrent score
45
Not ready
Phase 1fix criticals
59
Significant gaps
Phase 2+ fix highs
94
AI-ready
Phase 3+ fix mediums & lows
100
AI-ready
About this report. We evaluated the Datavant REST API specification against thousands of deterministic rules we have refined over twelve years of building API tooling, supplemented by AI-based analysis. Every finding is reproducible from the spec itself, scored consistently, and paired with a concrete fix.
What's at stake

What these gaps cost you in production

4 failure modes across 3 groups, each driven by your audit scores. Several are active risks today.

Foundation The spec itself 38 / 100
Active risk · Standards compliance
Fix Spec Violations to Prevent Breaks
You must address critical spec violations that disrupt toolchains, SDK generation, and downstream integrations before any AI processes the spec.
22→29
code quality score out of 40: the lift consumers achieve when the underlying spec is clean and standards-compliant
APIMatic Context Plugins research · Series B · June 2026
Build Time Readiness AI writes the code 50 / 100
Active risk · Documentation readiness for AI
AI readers misinterpret API due to gaps
The Datavant REST API lacks essential parameter descriptions, leading to incorrect assumptions and potential integration failures.
74%
of developers name missing or unclear documentation as the top reason they abandon an API. AI readers are stricter: what a human would ask about, an AI assumes.
APIMatic Developer Experience research · June 2026
Active risk · SDK readiness for AI
SDKs return incorrect types and formats
The success response for the Datavant REST API lacks a body schema, causing integration code to generate errors and misinterpret data.
0
fabricated API constructs when a coding assistant was grounded in an AI-ready spec. Ambiguity in the spec is what triggers hallucinated integration code
APIMatic Context Plugins research · 6 APIs · 3 models · June 2026
Runtime Readiness Agents make the calls 47 / 100
Active risk · MCP readiness
Agents cannot execute API operations safely
The Datavant REST API lacks essential operation identifiers and clear descriptions, risking agent confusion and execution failures.
65%
reduction in token consumption when agent tools are grounded in authoritative API context. Bloated or confusable tools consume up to 3.3× more.
APIMatic Context Plugins research · Series A · June 2026
The evidence numbers come from our controlled research: 6 experiments across 3 models, 6 commercial APIs, and 3 languages. We derive each card's risk status from this API's pillar scores. Full methodology at apimatic.io.
Contents

What's inside the full report

Unlock the full report

Book a free call to view the full report and the roadmap our team recommends to upgrade your developer and agentic experience.

Book a free call to view the full report