AI Clinical Decision Support: FDA Non-Device CDS Guidance, 21st Century Cures Act, and HIPAA Compliance
Clinical decision support (CDS) tools that incorporate AI have become a critical element of modern healthcare — but they also sit at the intersection of FDA medical device regulation, ONC health IT interoperability requirements, and HIPAA privacy mandates. The 21st Century Cures Act created a CDS exclusion from FDA device regulation for certain software tools, but the criteria for that exclusion are specific and frequently misunderstood. Healthcare organizations deploying AI-powered CDS must understand when their tools require FDA clearance, when they qualify for the Cures Act exclusion, and how to maintain HIPAA compliance for CDS-related PHI data flows.
The FDA had authorized more than 700 AI/ML-based medical devices through 510(k) clearance, De Novo classification, or PMA approval by 2024, according to the FDA AI/ML-Based Software as Medical Device Action Plan. The majority are radiology AI tools, but cardiology, pathology, and general CDS AI are rapidly growing categories. Not all CDS tools require FDA clearance — the 21st Century Cures Act created a statutory exclusion for qualifying CDS software — but organizations must rigorously assess each tool.
Memorial Hermann Health System — CDS Algorithm Bias Investigation
ONC Investigation into Sepsis CDS Algorithm Disparate Impact- Context
- ONC and CMS increased CDS algorithm scrutiny following 2019 Obermeyer et al. Science study
- Issue
- Widely-used commercial risk-scoring algorithm found to assign lower risk scores to Black patients with same health burden as white patients
- Impact
- Estimated 17.7% lower likelihood of Black patients being identified as needing extra care
- Mechanism
- Algorithm used healthcare cost as proxy for health need — reflecting historical underinvestment in care for Black patients
- Response
- Optum (algorithm developer) updated algorithm; HHS issued AI equity guidance
- CDS AI Risk
- AI CDS tools embedding historical data patterns may perpetuate or amplify care disparities
FDA Regulation of AI Clinical Decision Support
The FDA regulates software that meets the definition of a medical device under 21 U.S.C. §321(h). The 21st Century Cures Act (2016) created a statutory exclusion from device regulation for CDS software meeting four criteria (21 U.S.C. §520(o)(1)(E)):
- Not intended to acquire, process, or analyze medical images or signals
- Displays, analyzes, or prints medical information about a patient or population
- Supports or provides recommendations to HCPs about prevention, diagnosis, or treatment
- The HCP can independently review the basis of the recommendation — i.e., the software presents the underlying clinical logic and HCPs are not expected to rely on the software without such review
The "Independently Review" Criterion: FDA's 2022 Final Guidance on Clinical Decision Support Software clarifies that the fourth criterion — the clinician's ability to independently review the basis — is the most frequently at issue. Black-box AI models that generate recommendations without transparent reasoning do NOT qualify for the Cures Act CDS exclusion and are regulated as medical devices requiring FDA clearance.
ONC and the 21st Century Cures Act CDS Framework
The Office of the National Coordinator for Health Information Technology (ONC) administers the health IT provisions of the 21st Century Cures Act, including information blocking rules that interact with CDS. Key ONC requirements:
- Information blocking prohibition: 45 CFR Part 171 prohibits practices that unreasonably restrict access to electronic health information — CDS tools must not create information blocking arrangements
- FHIR R4 interoperability: ONC's 2020 Interoperability and Patient Access Rule requires certified EHR technology to support FHIR R4 APIs — CDS tools built on certified EHRs must use these APIs
- CDS Hooks standard: ONC has promoted CDS Hooks as the standard mechanism for FHIR-based CDS integration, enabling context-aware recommendations at key EHR workflow points
HIPAA Compliance for CDS PHI Data Flows
AI CDS tools necessarily process PHI to generate recommendations. HIPAA requirements:
- Treatment purpose: CDS tools used directly in patient care operate under the HIPAA treatment exception — providers may use and disclose PHI for treatment without patient authorization (45 CFR §164.506)
- Minimum necessary: CDS tools should access only the PHI fields actually needed to generate the recommendation — not entire patient records
- Business associate agreements: CDS software vendors are business associates subject to BAA requirements and HIPAA Security Rule obligations
- Audit logging: PHI accessed by CDS tools must be captured in HIPAA-compliant audit logs with the AI system identified as the accessing agent
Compliance Checklist
Compliance Checklist
FDA Device Classification Analysis
Conduct a formal FDA device classification analysis for every CDS AI tool before deployment. Use the four-factor 21st Century Cures Act test. Document the analysis. If the tool does not meet all four criteria — particularly the 'independently reviewable basis' requirement — the tool is a regulated medical device requiring FDA clearance before clinical deployment.
CDS Hooks FHIR Integration
Implement CDS tools using CDS Hooks via FHIR R4 APIs to ensure standards-based integration with certified EHRs. CDS Hooks allow CDS services to receive EHR context (patient, encounter, order) and return recommendation cards. This architecture satisfies both ONC interoperability requirements and the 21st Century Cures Act's independently-reviewable-basis requirement when the CDS card displays the underlying clinical logic.
Algorithm Bias Assessment
Conduct regular bias assessments on AI CDS tools, especially those used for risk stratification. Audit recommendations by race, ethnicity, sex, age, and insurance status. The 2019 Obermeyer et al. study in Science found a widely-deployed commercial algorithm systematically underestimated illness severity for Black patients. HHS has issued equity guidance requiring healthcare organizations to address algorithmic bias in CDS.
BAA with CDS Vendors
All AI CDS vendors that access, store, or transmit PHI in generating recommendations are business associates under HIPAA. Execute BAAs before deploying any CDS tool that processes real patient data. The BAA must cover the specific PHI data flows used by the CDS system and include AI-specific provisions for de-identification, model training data use restrictions, and breach notification.
Clinician Override and Audit Trail
Implement clinician override mechanisms for all AI CDS recommendations. Document overrides with reason codes. HIPAA audit logging requirements apply to CDS-triggered PHI access. The audit trail must show which recommendations were made, which PHI was accessed to generate them, which clinician received the recommendation, and whether the recommendation was followed or overridden.
ONC Information Blocking Compliance
Ensure CDS tool vendor contracts do not create information blocking arrangements. CDS vendors that restrict patient data access, charge excessive fees for data portability, or create EHR lock-in may violate ONC's 45 CFR Part 171 information blocking prohibition. Penalties for information blocking by health IT developers can reach $1,000,000 per violation.
Frequently Asked Questions
FDA-Compliant AI Clinical Decision Support
Claire's CDS integration framework includes FDA regulatory classification analysis, CDS Hooks FHIR integration, bias monitoring, BAA-compliant data flows, and clinician audit trails — ensuring your AI CDS tools meet FDA, ONC, and HIPAA requirements.