Hard fences on diagnosis, dosing, and triage language
The product may educate. It may not prescribe, and it must push emergencies to human care.
No compiled flow or public database names this control yet.
Risk this mitigates
20Given that a general chatbot is already a weekly health advisor for hundreds of millions of people, there is a possibility of medical decisions being made on model output that is not a licensed device, not a record, and not under a clinician’s duty resulting in population-scale diagnostic and dosing errors, and delayed care for people who trusted the chat more than a clinic.
Residual composite 20 · still above the threshold
Effect if implemented
Applied to every failure scenario on that risk, then re-ranked. Axes are clamped at 1.
- Likelihood
- −1
- Consequence
- −1
- Urgency
- −1