reference · 15 min read · Updated 2026-07-20
AI Scribe Security & Data Handling: The Complete Reference
Who this reference is for
Privacy officers, compliance leads, and clinician-owners evaluating an AI scribe against HIPAA, 42 CFR Part 2, and state privacy law. It is written to be objective — every vendor covered on this site is measured against the same bar.
The Business Associate Agreement
Under HIPAA, any vendor that creates, receives, maintains, or transmits PHI on behalf of a covered entity is a Business Associate. A BAA is required — not optional, not implied. If a vendor cannot produce a BAA on the exact plan you intend to purchase, they are not HIPAA-appropriate for that plan.
- The BAA must name your legal entity, not just your practice name.
- It must specify permitted uses and disclosures of PHI in plain language.
- It must obligate the vendor to report breaches without unreasonable delay (60 days is the outer limit).
- It must flow the same obligations down to any subprocessor that touches PHI.
- A 'sample BAA' on the vendor site is not a signed BAA on your account.
Encryption in transit and at rest
TLS 1.2 or 1.3 in transit and AES-256 at rest are the modern baseline. Any vendor operating below this in 2026 is out of step with industry practice. Ask specifically where keys are managed — customer-managed keys are a nice-to-have; vendor-managed keys via a reputable KMS are acceptable.
Subprocessors — including the LLM
The LLM provider (OpenAI, Anthropic, Google, or a self-hosted model host) is a subprocessor. Under HIPAA, subprocessors that touch PHI must be under BAA. Ask the vendor to list every subprocessor that receives PHI or transcripts derived from PHI, and confirm each is under BAA. If the answer is 'we don't share PHI with the model,' ask how the transcript is generated — because if audio or transcript touches the LLM provider's infrastructure, they are a subprocessor.
- OpenAI offers a HIPAA-eligible API with BAA on the Enterprise tier.
- Anthropic offers HIPAA-eligible access to Claude via AWS Bedrock and GCP Vertex under BAA.
- Google offers HIPAA-eligible Gemini via Vertex AI under BAA.
- Azure OpenAI is HIPAA-eligible under Microsoft's BAA.
- Self-hosted models (Llama, Mistral) run inside the vendor's HIPAA environment — no third-party subprocessor for inference.
Audio and transcript retention
The strongest posture is to delete raw audio immediately after transcription and to give the customer explicit control over transcript retention. Common patterns you will see:
- Audio deleted within 24 hours of transcription (strong).
- Audio retained for 30 days for 'quality assurance' (acceptable with justification).
- Audio retained indefinitely unless the user deletes it (weak).
- Transcripts and notes retained per customer-set retention policy (strong).
- Transcripts retained 'for the life of the account' with no export path (weak).
Model training and PHI
This is where marketing language most often diverges from contractual reality. Read the DPA, not the FAQ.
- The strongest posture: 'PHI is never used to train, fine-tune, or evaluate any model, whether identified, de-identified, or aggregated.' This is what to demand in your BAA or DPA.
- The middle posture: 'De-identified data may be used to improve our models.' De-identification under HIPAA Safe Harbor is stronger than the industry-loose meaning; ask which standard applies.
- The weak posture: 'Aggregated and anonymized data may be used for product improvement.' Anonymization is not defined under HIPAA; treat this as effectively 'we may use it.'
SOC 2 and other attestations
SOC 2 Type II is an audit of controls over a period of time (usually 6–12 months). Type I is a point-in-time snapshot. Type II is meaningfully stronger. Ask for the audit period end date — a Type II report that ended two years ago is stale. HITRUST certification is a plus for enterprise buyers but is not required for HIPAA compliance.
Audit logs and access controls
You should be able to answer three questions from the vendor's audit log: who accessed which client's data, when, and from where. Role-based access controls (RBAC) with an admin/clinician/reviewer separation are the baseline. Session-based access with automatic timeout is a plus.
42 CFR Part 2 — the SUD overlay
If your program is federally-assisted and treats substance-use disorder, 42 CFR Part 2 imposes stricter confidentiality obligations than HIPAA. Client identifying information tied to SUD treatment cannot be disclosed without specific written consent, even to another provider. AI scribes serving Part 2 programs should document how they handle re-disclosure prohibitions, consent tracking, and QSOAs (Qualified Service Organization Agreements). Only Twofold and Eleos publish an explicit Part 2 posture at the time of writing.
Incident response and breach notification
The BAA sets the outer bound (60 days), but the vendor's incident-response commitment should be tighter. Ask for their published incident-response SLA and their most recent public incident. A vendor that has never had an incident either has excellent controls or is not disclosing.
Exit, deletion, and data portability
The BAA must obligate the vendor to return or destroy PHI at contract termination. Confirm the practical mechanics:
- Export path: bulk export of notes as PDF and structured JSON (both) is the modern bar.
- Deletion path: hard delete with certification of destruction, not just 'marked as deleted.'
- Retention after termination: the vendor should hold nothing beyond what regulation requires.
How the top scribes score on security posture
Every vendor covered on this site was measured against the same twelve controls. Full scoring lives on each scribe's review page; the summary below shows the material differences.
- Twofold Health — BAA on every paid tier, SOC 2 Type II, subprocessor list published, PHI excluded from model training, explicit 42 CFR Part 2 posture.
- Blueprint — BAA on every paid tier, SOC 2 Type II, subprocessor list on request, PHI excluded from model training.
- Upheal — BAA on every paid tier, SOC 2 Type II, subprocessor list published, PHI excluded from model training, EU data residency option.
- Mentalyc — BAA on paid tiers, SOC 2 Type II, subprocessor list on request.
- Eleos Health — Enterprise BAA, SOC 2 Type II, HITRUST, deep subprocessor governance.
- Freed / Heidi / Nabla / Suki — HIPAA-appropriate general medical scribes; none publishes a 42 CFR Part 2 posture.
The exact questions to send to a vendor
Copy this list into your RFI. Any 'we'll get back to you' answer is a data point.
- Do you sign a BAA on the exact plan we intend to purchase? Send the template.
- List every subprocessor that receives PHI or PHI-derived transcripts. Which are under BAA?
- What is your raw-audio retention period, and can we shorten it contractually?
- Is any PHI — identified, de-identified, or aggregated — used to train, fine-tune, or evaluate any model?
- Provide your most recent SOC 2 Type II report and the audit period end date.
- Describe your incident-response SLA and your most recent public incident.
- Describe your export and deletion path at contract termination.
- If we treat SUD, describe your 42 CFR Part 2 posture in writing.
- Who can access our data internally, and how is that access logged and reviewed?
- What is your uptime SLA and your policy for degraded-mode operation during an outage?
Scribes referenced in this guide
Head-to-head comparisons
Direct match-ups of the scribes discussed in this guide.
Frequently asked questions
- Is 'HIPAA compliant' a certification?
- No. HIPAA has no certifying body. Any vendor claiming to be 'HIPAA certified' is using marketing language, not regulatory language. The real bar is: does the vendor sign a BAA, meet the Security Rule's administrative/physical/technical safeguards, and document their controls (usually via SOC 2 Type II).
- Does using a HIPAA-eligible LLM (like Azure OpenAI) make a scribe HIPAA-compliant?
- It is necessary but not sufficient. The scribe vendor still needs a BAA with you, encryption in transit and at rest, audit logs, subprocessor governance, retention policies, and everything else in the Security Rule. HIPAA-eligible LLM access removes one specific risk (the model provider retaining PHI) but does not cover the full compliance surface.
- How long should audio be retained?
- The strongest posture is deletion within 24 hours of transcription. Anything beyond 30 days should be justified in writing. Retention 'for the life of the account' is a weak posture and should push you toward another vendor unless you can contractually shorten it.
- Can I use an AI scribe for 42 CFR Part 2 SUD documentation?
- Yes, if the vendor documents an explicit Part 2 posture, signs a QSOA where applicable, and supports the re-disclosure prohibition on generated notes. Twofold Health and Eleos Health are the two products that publish an explicit Part 2 posture. Other HIPAA-appropriate scribes can be used with additional operational controls, but the vendor is doing less of the work for you.
- Are there differences in state privacy law that matter?
- Yes. California (CMIA), Texas (HB 300), New York (SHIELD Act), and Illinois (BIPA — biometric identifiers) all layer requirements on top of HIPAA. Colorado's Privacy Act and Washington's My Health My Data Act are also relevant. Most national scribe vendors comply with the strictest applicable law; confirm in your DPA.
- What is a DPA and do I need one?
- A Data Processing Agreement is a broader contract covering data handling, subprocessing, cross-border transfers, and privacy law compliance. HIPAA's BAA covers PHI specifically; the DPA covers everything else. For US-only practices, the BAA is usually enough. For practices with clients or subprocessors abroad, ask for both.