Garret233 Durgan499
1971-01-26male17yr history57 total medication requests
0f218e56-1298-808b-6d11-fe7d83191215
Active Medications
7
ground truth
Best F1
1.000
across all runs
Mean F1
0.593
all models & strategies
Parse Failures
4
of 20 runs
Ground Truth — Active Medications
7 activeferrous sulfate 325 MG Oral TabletVitamin B12 5 MG/ML Injectable SolutionAcetaminophen 300 MG / Hydrocodone Bitartrate 5 MG Oral TabletAcetaminophen 300 MG / Codeine Phosphate 15 MG Oral TabletAcetaminophen 325 MG / Oxycodone Hydrochloride 10 MG Oral Tablet [Percocet]Acetaminophen 325 MG Oral Tablet [Tylenol]tramadol hydrochloride 50 MG Oral Tablet
Results Grid
F1 / Precision / Recall / Inference time per model × strategy
| Model | Raw JSON | Table | Narrative | Timeline |
|---|---|---|---|---|
| Phi-3.5-mini (3.8B) | ||||
| Mistral 7B v0.3 | ||||
| BioMistral 7B | ||||
| Llama 3.1 8B | ||||
| Llama 3.3 70B |
Click a cell to compare that result against ground truth below.
Medication Diff
Model: Llama 3.1 8B
Strategy: Strategy C — Clinical Narrative
F1 1.000P 1.000R 1.0004.0s
Ground Truth
7 activeferrous sulfate 325 MG Oral TabletMatched
Vitamin B12 5 MG/ML Injectable SolutionMatched
Acetaminophen 300 MG / Hydrocodone Bitartrate 5 MG Oral TabletMatched
Acetaminophen 300 MG / Codeine Phosphate 15 MG Oral TabletMatched
Acetaminophen 325 MG / Oxycodone Hydrochloride 10 MG Oral Tablet [Percocet]Matched
Acetaminophen 325 MG Oral Tablet [Tylenol]Matched
tramadol hydrochloride 50 MG Oral TabletMatched
Model Output
7 predictedAcetaminophen 300 MG / Codeine Phosphate 15 MG Oral TabletCorrect
Acetaminophen 300 MG / Hydrocodone Bitartrate 5 MG Oral TabletCorrect
Acetaminophen 325 MG / Oxycodone Hydrochloride 10 MG Oral Tablet [Percocet]Correct
Acetaminophen 325 MG Oral Tablet [Tylenol]Correct
Vitamin B12 5 MG/ML Injectable SolutionCorrect
ferrous sulfate 325 MG Oral TabletCorrect
tramadol hydrochloride 50 MG Oral TabletCorrect
7 matched0 missed0 hallucinatedexact match
Inspect:
[ "ferrous sulfate 325 MG Oral Tablet", "Vitamin B12 5 MG/ML Injectable Solution", "Acetaminophen 300 MG / Hydrocodone Bitartrate 5 MG Oral Tablet", "Acetaminophen 300 MG / Codeine Phosphate 15 MG Oral Tablet", "Acetaminophen 325 MG / Oxycodone Hydrochloride 10 MG Oral Tablet [Percocet]", "Acetaminophen 325 MG Oral Tablet [Tylenol]", "tramadol hydrochloride 50 MG Oral Tablet" ]