Patients/6d4ef68d-aef9-fd6b-02a4-f52a102d5d31

Hal307 Grimes165

1969-01-07male30yr history131 total medication requests

6d4ef68d-aef9-fd6b-02a4-f52a102d5d31

Active Medications

ground truth

Best F1

1.000

across all runs

Mean F1

0.561

all models & strategies

Parse Failures

of 20 runs

Ground Truth — Active Medications

7 active

Clopidogrel 75 MG Oral TabletSimvastatin 20 MG Oral Tablet24 HR metoprolol succinate 100 MG Extended Release Oral TabletNitroglycerin 0.4 MG/ACTUAT Mucosal SprayAcetaminophen 325 MG Oral Tablet [Tylenol]budesonide 0.125 MG/ML Inhalation Suspension [Pulmicort]NDA021457 200 ACTUAT albuterol 0.09 MG/ACTUAT Metered Dose Inhaler [ProAir]

Results Grid

F1 / Precision / Recall / Inference time per model × strategy

Model	Raw JSON	Table	Narrative	Timeline
Phi-3.5-mini (3.8B)
Mistral 7B v0.3
BioMistral 7B
Llama 3.1 8B
Llama 3.3 70B

Click a cell to compare that result against ground truth below.

Medication Diff

Model: Llama 3.1 8B

Strategy: Strategy A — Raw FHIR JSON

F1 1.000P 1.000R 1.00015.6s

Ground Truth

7 active

Clopidogrel 75 MG Oral TabletMatched

Simvastatin 20 MG Oral TabletMatched

24 HR metoprolol succinate 100 MG Extended Release Oral TabletMatched

Nitroglycerin 0.4 MG/ACTUAT Mucosal SprayMatched

Acetaminophen 325 MG Oral Tablet [Tylenol]Matched

budesonide 0.125 MG/ML Inhalation Suspension [Pulmicort]Matched

NDA021457 200 ACTUAT albuterol 0.09 MG/ACTUAT Metered Dose Inhaler [ProAir]Matched

Model Output

7 predicted

24 HR metoprolol succinate 100 MG Extended Release Oral TabletCorrect

Acetaminophen 325 MG Oral Tablet [Tylenol]Correct

Clopidogrel 75 MG Oral TabletCorrect

NDA021457 200 ACTUAT albuterol 0.09 MG/ACTUAT Metered Dose Inhaler [ProAir]Correct

Nitroglycerin 0.4 MG/ACTUAT Mucosal SprayCorrect

Simvastatin 20 MG Oral TabletCorrect

budesonide 0.125 MG/ML Inhalation Suspension [Pulmicort]Correct

7 matched0 missed0 hallucinatedexact match

Inspect:

["Clopidogrel 75 MG Oral Tablet", "Simvastatin 20 MG Oral Tablet", "24 HR metoprolol succinate 100 MG Extended Release Oral Tablet", "Nitroglycerin 0.4 MG/ACTUAT Mucosal Spray", "Acetaminophen 325 MG Oral Tablet [Tylenol]", "budesonide 0.125 MG/ML Inhalation Suspension [Pulmicort]", "NDA021457 200 ACTUAT albuterol 0.09 MG/ACTUAT Metered Dose Inhaler [ProAir]"]