Model Comparison
Performance breakdown per model across all four serialisation strategies
Mean F1
0.666
all strategies
Mean Recall
0.619
clinically critical
Avg Inference
8.7s
per patient run
Parse Failures
67
of 800 total runs
Precision / Recall / F1 by Strategy
F1 Distribution
Across all strategies and patients
Per-Strategy Breakdown
| Strategy | F1 | Precision | Recall | Avg time | Failures |
|---|---|---|---|---|---|
| Strategy C — Clinical Narrative | 0.701 | 0.762 | 0.667 | 5.2s | 7 |
| Strategy B — Markdown Table | 0.683 | 0.811 | 0.626 | 11.6s | 16 |
| Strategy D — Timeline | 0.644 | 0.770 | 0.590 | 3.6s | 11 |
| Strategy A — Raw FHIR JSON | 0.636 | 0.730 | 0.593 | 14.5s | 33 |
Patient-level Results
All patients · click any row to open drill-down
200 patients
| Patient ↕ | Meds ↕ | Mean F1 ↑ | Raw JSON | Table | Narrative | Timeline |
|---|---|---|---|---|---|---|
| 7092d859…Jamika47 Schmidt332 | 2 | 0.000 | fail | fail | fail | 0.000 |
| 24f7ebda…Dante562 Welch179 | 1 | 0.125 | 0.000 | 0.000 | fail | 0.500 |
| 522f53ae…Hollie21 Padberg411 | 2 | 0.125 | fail | 0.000 | 0.500 | 0.000 |
| 7ed9b2f9…Von197 Strosin214 | 6 | 0.125 | fail | fail | 0.000 | 0.500 |
| 41b6d605…Sharan181 Kulas532 | 4 | 0.167 | 0.000 | 0.667 | fail | 0.000 |
| 9018e566…Kirsten270 Jenkins714 | 2 | 0.167 | 0.000 | 0.000 | 0.000 | 0.667 |
| bbeebbe2…Samuel331 Villanueva621 | 1 | 0.167 | fail | fail | 0.667 | fail |
| d15fcef1…Tommye961 Eichmann909 | 1 | 0.167 | fail | 0.667 | 0.000 | fail |
| 7021b2b7…Daniel959 Mohr916 | 6 | 0.208 | 0.000 | 0.000 | 0.000 | 0.833 |
| 6d4ef68d…Hal307 Grimes165 | 7 | 0.214 | 0.000 | fail | 0.857 | 0.000 |
| 51b90e2e…Ellie521 Nader710 | 1 | 0.250 | fail | 0.000 | 1.000 | fail |
| 7323b20b…Leo278 Sanford861 | 11 | 0.250 | fail | fail | 0.625 | 0.375 |
| d21c1a99…Irene779 Ruiz676 | 2 | 0.250 | 0.000 | 0.000 | 1.000 | fail |
| d570c66f…Ken316 Cole117 | 1 | 0.250 | 0.000 | 1.000 | 0.000 | fail |
| e372711f…Toya963 Bogisich202 | 1 | 0.250 | 0.000 | 1.000 | fail | 0.000 |
| c5f21693…Lou594 Langosh790 | 4 | 0.271 | 0.000 | 0.333 | 0.750 | 0.000 |
| 8f51273e…Rocio28 Valdés907 | 4 | 0.286 | fail | fail | 0.286 | 0.857 |
| 88223d62…Katheleen349 Gutkowski940 | 6 | 0.292 | fail | fail | 0.667 | 0.500 |
| e2fcc788…Haydee844 Treutel973 | 2 | 0.292 | 0.000 | 0.667 | 0.500 | 0.000 |
| 1e18e750…Dalila583 Hartmann983 | 8 | 0.300 | 0.400 | fail | 0.400 | 0.400 |
| 3c95ac10…Emilio417 Legros616 | 6 | 0.347 | 0.222 | 0.250 | 0.667 | 0.250 |
| bb88b4a2…Christal240 Schneider199 | 2 | 0.350 | 0.400 | 0.500 | 0.500 | 0.000 |
| 7ed81b56…Jerry654 Jones311 | 7 | 0.361 | fail | fail | 1.000 | 0.444 |
| 1b3c405a…Burma963 Goyette777 | 6 | 0.369 | fail | 0.500 | 0.727 | 0.250 |
| 81202398…Leif534 Rowe323 | 4 | 0.371 | fail | 0.400 | 0.750 | 0.333 |
| 73207256…Concepción765 Navarrete760 | 9 | 0.373 | 0.000 | fail | 0.778 | 0.714 |
| f360fbf6…Trenton748 Nitzsche158 | 6 | 0.386 | fail | 0.600 | 0.444 | 0.500 |
| 5d93cfec…Wan724 Cormier289 | 4 | 0.393 | fail | 0.571 | 0.667 | 0.333 |
| 04e8a125…Rolando809 Nicolas769 | 7 | 0.401 | fail | 0.444 | 0.714 | 0.444 |
| d374c41d…Julian715 Beatty507 | 14 | 0.407 | fail | 0.444 | 0.741 | 0.444 |
| 2d6e2e64…Janetta325 Weissnat378 | 3 | 0.417 | 1.000 | fail | 0.000 | 0.667 |
| c0e9f6af…Eldon28 Kunze215 | 2 | 0.417 | 0.667 | 1.000 | 0.000 | 0.000 |
| debb2d37…Hoyt490 Davis923 | 1 | 0.417 | 0.000 | 1.000 | 0.667 | 0.000 |
| e15ab14b…Kena893 Jacobson885 | 4 | 0.417 | fail | 0.667 | 0.000 | 1.000 |
| 06bdb812…Doug189 Lowe577 | 7 | 0.426 | 0.444 | fail | 0.714 | 0.545 |
| ab618d09…Germán350 Dávila115 | 6 | 0.444 | fail | 0.444 | 0.833 | 0.500 |
| 6ccbf84f…Wayne846 Considine820 | 8 | 0.465 | 0.200 | 0.400 | 0.714 | 0.545 |
| 50da38aa…Wallace647 Hermiston71 | 6 | 0.465 | fail | 0.667 | 0.909 | 0.286 |
| 8d44068a…Woodrow571 Collier206 | 6 | 0.470 | 0.545 | 0.000 | 0.833 | 0.500 |
| 2e37c0de…Lyman173 Lubowitz58 | 7 | 0.472 | 0.444 | 0.444 | 0.400 | 0.600 |
| 7aa87a8d…Miguel815 Hegmann834 | 5 | 0.473 | fail | 0.571 | 0.750 | 0.571 |
| 703fc921…Leopoldo762 Kovacek682 | 8 | 0.479 | 0.545 | 0.200 | 0.625 | 0.545 |
| 54eb6734…Oren284 Kshlerin58 | 5 | 0.479 | fail | 0.750 | 0.500 | 0.667 |
| 6c6acf0d…Jarrod316 Wiza601 | 12 | 0.486 | fail | 0.556 | 0.833 | 0.556 |
| e304f79d…Milford485 Gaylord332 | 7 | 0.490 | 0.769 | 0.476 | 0.714 | 0.000 |
| 8f8f39b2…Colette720 Stiedemann542 | 4 | 0.497 | fail | 0.667 | 0.571 | 0.750 |
| 7e4a103b…Basil991 Brekke496 | 5 | 0.500 | fail | fail | 1.000 | 1.000 |
| 7ff67b5e…Julienne688 Schulist381 | 2 | 0.500 | fail | 0.500 | 1.000 | 0.500 |
| 962ab3d7…Louie190 Emard19 | 1 | 0.500 | 1.000 | fail | 1.000 | fail |
| 98ac0345…Raeann749 Kovacek682 | 1 | 0.500 | fail | 1.000 | 0.000 | 1.000 |
Page 1 of 4