# Nixi AI vs. Manual Notes: A Clinical Quality Pilot Study

Pilot study in outpatient rheumatology (n=15) compares AI-assisted and manual documentation across seven quality dimensions — from telegraphic shorthand to audit-ready clinical narratives.

- Author: Dr. Peer Aries, Consultant Rheumatologist · Immunologikum Hamburg (MD)
- Published: 2025-07-01
- Updated: 2025-07-01
- Read online: https://www.nixiai.ai/en/insights/pilot-study-ai-vs-manual-documentation-rheumatology

**PILOT ANALYSIS — July 2025**

From telegraphic shorthand to clinical clarity. A structured evaluation of
AI-assisted documentation quality against manual physician documentation in
outpatient rheumatology — based on real consultations at a specialized
German immunology center.

- n = 15 consultations
- parallel documentation (manual + AI)
- Immunologikum Hamburg

## Introduction — why documentation *quality* matters more than speed

Speed is the metric everyone talks about. But in rheumatology — a field
defined by complex medication histories, multi-system diseases, and
high-cost biologic therapies — the quality of what gets documented is what
determines patient outcomes, insurance approvals, and legal defensibility.

Manual documentation under time pressure is an exercise in triage.
Physicians capture what they believe is most urgent, using shorthand and
abbreviations optimized for personal recall. Not for external readers,
auditors, or continuity of care. The result is notes that are
**diagnostically functional but structurally incomplete**.

This pilot asks a different question from the typical AI documentation
study: not *"Is it faster?"* but *"Is it better?"* By running manual and
AI-assisted documentation in parallel across the same consultations, the
evaluation isolates the qualitative difference — structure, completeness,
clinical depth, and readability — between how a physician documents under
pressure and what an ambient AI system captures from the same conversation.

## Methodology — parallel documentation in a real clinical workflow

The evaluation was conducted in a specialized outpatient immunology and
rheumatology setting. Fifteen consultations were documented simultaneously
using two methods.

**Protocol.** Each visit followed a standardized workflow. Patients first
completed a digital pre-anamnesis (e.g. via Idana). The physician then
conducted the clinical anamnesis, and this is the phase that was
evaluated. Documentation occurred in parallel: the physician wrote their
standard manual note, while Nixi AI's ambient system generated a
structured note from the same spoken conversation.

The comparison focuses exclusively on the anamnesis. Not on examination
findings, diagnoses, or treatment plans. This isolates the documentation
task where time pressure is highest and information loss is greatest.

### Evaluation criteria

Seven dimensions were assessed across every case, grouped into four
quality domains.

| Quality domain | Dimension | What was assessed |
|---|---|---|
| Language | Linguistic style | Telegraphic shorthand vs. narrative completeness |
| Language | Comprehensibility | Readability for third parties (colleagues, MDK, insurers) |
| Structure | Temporal organization | Chronological timeline of events and therapy changes |
| Structure | Therapy integration | Explicit linkage between treatments and outcomes |
| Clinical depth | Symptom description | Specificity, functional impact, patient-reported quality |
| Clinical depth | Comorbidity coverage | Systematic capture of co-existing conditions + preventive data |
| Operational | Consistency & efficiency | Standardization, correction effort, audit readiness |

## Results — language & structure

### The structural gap between manual and AI documentation

**Language and style.** The most immediate difference is not *what* is
documented, but *how*. Manual notes are written in telegraphic shorthand —
fragments designed for the physician's own memory, often unintelligible to
colleagues, auditors, or MDK reviewers.

Nixi AI produced narrative, complete sentences that maintained clinical
precision while being comprehensible to any reader. Occasional redundancy
was noted — a minor trade-off for the gain in completeness.

| Aspect | Manual documentation | Nixi AI documentation |
|---|---|---|
| Linguistic style | Telegraphic, abbreviated | Narrative, complete sentences |
| Comprehensibility | Limited to author | Understandable by third parties |
| Redundancy | Low | Occasional repetitions |

**Structure and information logic.** Manual notes showed no consistent
temporal organization. Therapy histories were implied rather than stated.
Comorbidities appeared sporadically or not at all.

Nixi AI consistently separated the clinical course from current
complaints, established clear chronological timelines, and explicitly
linked therapies to outcomes — precisely the structure required for
treatment-escalation documentation and insurance justification.

| Aspect | Manual documentation | Nixi AI documentation |
|---|---|---|
| Temporal organization | Unstructured | Clear chronological progression |
| Therapy integration | Rarely explicit | Systematically integrated |
| Comorbidity coverage | Partially incomplete | Regularly integrated |

## Results — clinical depth

### What gets lost under time pressure

**The completeness gap.** This is where the qualitative difference becomes
clinically significant. Manual notes captured the diagnostic essentials —
the minimum a physician needs to recall the case. But they routinely
omitted:

- Functional status (grip strength, mobility limitations, daily-activity impact)
- Subjective symptom quality ("stinging," "deep and heavy," "enormous")
- Preventive context (vaccination status, bone density screening, exercise patterns)
- Risk-relevant details (residual nerve damage, medication sensitivity patterns)
- The patient's own words and perspective

Nixi AI captured all of these. Not because it was programmed to add them,
but because the physician spoke about them during the consultation. The
information was always there. It simply wasn't making it into the written
record.

| Aspect | Manual documentation | Nixi AI documentation |
|---|---|---|
| Clinical course description | Cursory | Comprehensible, detailed narrative |
| Symptom description | Diagnostically oriented only | Functional & subjective qualities included |
| Functional status | Usually not documented | Frequently captured |
| Patient perspective | Rarely recognizable | Explicitly preserved |
| Readability for third parties | Limited | Consistently comprehensible |

> **The patient voice:** Perhaps the most striking finding: in manual notes, the patient's
>   perspective was rarely recognizable. Notes read as physician assessments,
>   not as records of a conversation. Nixi AI consistently preserved the
>   patient's language, context, and concerns — creating notes that reflect a
>   bilateral exchange rather than a unilateral judgment.

## Results — operational impact

### Efficiency, consistency, and audit readiness

**Consistency and quality assurance.** Manual documentation quality is
inherently variable. It depends on the physician's energy level, the
complexity of the preceding case, how far behind they're running, and
whether they plan to dictate a more complete note later (which, in
practice, rarely happens with the same fidelity).

Nixi AI produced standardized output quality across all cases — whether
the consultation was a straightforward follow-up or a complex multi-system
review. This consistency is particularly valuable for multi-physician
practices, locum coverage, and external audit preparation.

**Key attributes:**

- **Automated** — documentation with minimal correction effort
- **Standardized** — consistent quality across all cases
- **Audit-ready** — MDK-suitable structure and completeness
- **Person-independent** — quality not tied to physician energy or workload

| Dimension | Manual documentation | Nixi AI documentation |
|---|---|---|
| Linguistic clarity | Low | High |
| Temporal structure | Absent | Consistent |
| Therapy context | Implicit | Explicit |
| Symptom specificity | Diagnostic only | Functional + subjective |
| Patient perspective | Rare | Preserved |
| Audit readiness | Limited | MDK-ready |
| Cross-case consistency | Variable | Standardized |

## Implications for biologics

### Defensive documentation and the biologics approval pathway

In rheumatology, documentation quality directly impacts treatment access.
Biologic therapies — the most effective treatments for diseases like
rheumatoid arthritis and psoriatic arthritis — require detailed
prior-authorization documentation. Insurance denials frequently hinge on:

- Incomplete documentation of prior therapy failures ("failed MTX" vs.
  "MTX 15mg discontinued after 6 months due to persistent GI side effects
  despite dose reduction")
- Missing disease-activity scores or severity criteria
- Absent documentation of why alternatives were inappropriate
- Lack of structured chronology showing treatment progression

In this pilot, Nixi AI consistently captured the granular detail required
for biologic justification — therapy timelines, specific failure reasons,
side-effect inventories, and functional-impact assessments — information
that was spoken during consultations but lost in manual documentation.

**Manual note captures:**

- "Failed MTX" — no dosage, no duration, no reason for discontinuation
- "Inadequate tolerability" — no specific side effects listed
- Disease activity: implied but no scores or severity markers documented
- Therapy timeline: no dates, no sequence, no causal chain
- Functional impact: not documented

**Nixi AI captures:**

- "MTX 10mg, later 7.5mg, 1 year, discontinued — no clinical effect"
- Specific side effects: "severe headaches, shortness of breath, latent
  nausea after a few days"
- Severity documented: pain described as "enormous," functional grip
  limitation quantified
- Complete chronology: therapy start → pause trigger → deterioration →
  current status
- Daily-life impact: "cancellation of personal engagements," difficulty
  with fine motor tasks

> **Why this matters for biologics approval:** German insurance providers (GKV) require structured evidence of prior
>   therapy failure before approving biologic prescriptions. Missing dosage,
>   duration, or specific failure reasons are among the most common causes
>   of initial denial. **Nixi AI captures this level of detail from the
>   spoken conversation, without additional physician effort.**

## Conclusion — documentation quality as a clinical outcome

This evaluation demonstrates that the gap between manual and AI-assisted
documentation is not primarily about speed — it is about **information
fidelity**. The physician spoke the same words in every case. The
difference lies in what was captured.

Manual documentation under time pressure is an act of lossy compression.
Nixi AI functions as lossless recording — preserving the clinical
narrative as it was spoken, structured for downstream use.

The implications extend beyond individual practices. In a healthcare
system moving toward value-based care, quality metrics, and
cross-institutional data exchange, the completeness and structure of
clinical documentation becomes a systemic variable — one that ambient AI
can meaningfully improve.

### Next steps

- Extension to additional documentation types (examination findings,
  clinical course notes, patient letters)
- Integration with practice-management systems (PVS) via GDT/HL7 interfaces
- Multi-center evaluation with standardized time measurement and
  clinician feedback
- Comparative analysis with other documentation systems to benchmark
  innovation

---

*Based on: Analysebericht zur Pilotphase von Nixi AI — Dr. Peer Aries,
Immunologikum Hamburg, July 2025. Data-privacy notice: all clinical
examples referenced in this analysis are anonymized and modified. No real
patient data is displayed.*