FHIR MedRecon
Patients/04e8a125-4120-89fc-3c36-c95500605a61

Rolando809 Nicolas769

1963-04-15male15yr history43 total medication requests

04e8a125-4120-89fc-3c36-c95500605a61

Active Medications

7

ground truth

Best F1

1.000

across all runs

Mean F1

0.580

all models & strategies

Parse Failures

5

of 20 runs

Ground Truth — Active Medications
7 active
24 HR Donepezil hydrochloride 10 MG / Memantine hydrochloride 28 MG Extended Release Oral CapsuleClopidogrel 75 MG Oral TabletSimvastatin 20 MG Oral Tablet24 HR metoprolol succinate 100 MG Extended Release Oral TabletNitroglycerin 0.4 MG/ACTUAT Mucosal Spraylisinopril 10 MG Oral TabletAcetaminophen 300 MG / Hydrocodone Bitartrate 5 MG Oral Tablet
Results Grid

F1 / Precision / Recall / Inference time per model × strategy

ModelRaw JSONTableNarrativeTimeline
Phi-3.5-mini (3.8B)
Mistral 7B v0.3
BioMistral 7B
Llama 3.1 8B
Llama 3.3 70B

Click a cell to compare that result against ground truth below.

Medication Diff
Model: Llama 3.1 8B
Strategy: Strategy A — Raw FHIR JSON
F1 1.000P 1.000R 1.0007.5s

Ground Truth

7 active
24 HR Donepezil hydrochloride 10 MG / Memantine hydrochloride 28 MG Extended Release Oral CapsuleMatched
Clopidogrel 75 MG Oral TabletMatched
Simvastatin 20 MG Oral TabletMatched
24 HR metoprolol succinate 100 MG Extended Release Oral TabletMatched
Nitroglycerin 0.4 MG/ACTUAT Mucosal SprayMatched
lisinopril 10 MG Oral TabletMatched
Acetaminophen 300 MG / Hydrocodone Bitartrate 5 MG Oral TabletMatched

Model Output

7 predicted
24 HR Donepezil hydrochloride 10 MG / Memantine hydrochloride 28 MG Extended Release Oral CapsuleCorrect
24 HR metoprolol succinate 100 MG Extended Release Oral TabletCorrect
Acetaminophen 300 MG / Hydrocodone Bitartrate 5 MG Oral TabletCorrect
Clopidogrel 75 MG Oral TabletCorrect
Nitroglycerin 0.4 MG/ACTUAT Mucosal SprayCorrect
Simvastatin 20 MG Oral TabletCorrect
lisinopril 10 MG Oral TabletCorrect
7 matched0 missed0 hallucinatedexact match
Inspect:
[
  "24 HR Donepezil hydrochloride 10 MG / Memantine hydrochloride 28 MG Extended Release Oral Capsule",
  "Clopidogrel 75 MG Oral Tablet",
  "Simvastatin 20 MG Oral Tablet",
  "24 HR metoprolol succinate 100 MG Extended Release Oral Tablet",
  "Nitroglycerin 0.4 MG/ACTUAT Mucosal Spray",
  "lisinopril 10 MG Oral Tablet",
  "Acetaminophen 300 MG / Hydrocodone Bitartrate 5 MG Oral Tablet"
]