FHIR MedRecon
Patients/f2334b9a-dae6-2f29-d1eb-4911095afa5a

Lauralee67 Murphy561

1954-02-28female30yr history58 total medication requests

f2334b9a-dae6-2f29-d1eb-4911095afa5a

Active Medications

8

ground truth

Best F1

1.000

across all runs

Mean F1

0.633

all models & strategies

Parse Failures

5

of 20 runs

Ground Truth — Active Medications
8 active
Acetaminophen 300 MG / Hydrocodone Bitartrate 5 MG Oral TabletClopidogrel 75 MG Oral TabletSimvastatin 20 MG Oral Tablet24 HR metoprolol succinate 100 MG Extended Release Oral TabletNitroglycerin 0.4 MG/ACTUAT Mucosal SprayAcetaminophen 300 MG / Codeine Phosphate 15 MG Oral TabletAcetaminophen 325 MG / Oxycodone Hydrochloride 10 MG Oral Tablet [Percocet]Acetaminophen 325 MG Oral Tablet [Tylenol]
Results Grid

F1 / Precision / Recall / Inference time per model × strategy

ModelRaw JSONTableNarrativeTimeline
Phi-3.5-mini (3.8B)
Mistral 7B v0.3
BioMistral 7B
Llama 3.1 8B
Llama 3.3 70B

Click a cell to compare that result against ground truth below.

Medication Diff
Model: Llama 3.1 8B
Strategy: Strategy B — Markdown Table
F1 1.000P 1.000R 1.0005.1s

Ground Truth

8 active
Acetaminophen 300 MG / Hydrocodone Bitartrate 5 MG Oral TabletMatched
Clopidogrel 75 MG Oral TabletMatched
Simvastatin 20 MG Oral TabletMatched
24 HR metoprolol succinate 100 MG Extended Release Oral TabletMatched
Nitroglycerin 0.4 MG/ACTUAT Mucosal SprayMatched
Acetaminophen 300 MG / Codeine Phosphate 15 MG Oral TabletMatched
Acetaminophen 325 MG / Oxycodone Hydrochloride 10 MG Oral Tablet [Percocet]Matched
Acetaminophen 325 MG Oral Tablet [Tylenol]Matched

Model Output

8 predicted
24 HR metoprolol succinate 100 MG Extended Release Oral TabletCorrect
Acetaminophen 300 MG / Codeine Phosphate 15 MG Oral TabletCorrect
Acetaminophen 300 MG / Hydrocodone Bitartrate 5 MG Oral TabletCorrect
Acetaminophen 325 MG / Oxycodone Hydrochloride 10 MG Oral Tablet [Percocet]Correct
Acetaminophen 325 MG Oral Tablet [Tylenol]Correct
Clopidogrel 75 MG Oral TabletCorrect
Nitroglycerin 0.4 MG/ACTUAT Mucosal SprayCorrect
Simvastatin 20 MG Oral TabletCorrect
8 matched0 missed0 hallucinatedexact match
Inspect:
["Acetaminophen 300 MG / Hydrocodone Bitartrate 5 MG Oral Tablet", "Clopidogrel 75 MG Oral Tablet", "Simvastatin 20 MG Oral Tablet", "24 HR metoprolol succinate 100 MG Extended Release Oral Tablet", "Nitroglycerin 0.4 MG/ACTUAT Mucosal Spray", "Acetaminophen 300 MG / Codeine Phosphate 15 MG Oral Tablet", "Acetaminophen 325 MG / Oxycodone Hydrochloride 10 MG Oral Tablet [Percocet]", "Acetaminophen 325 MG Oral Tablet [Tylenol]"]