18Health systemsBelow the top 20
A pump or a CPAP that updated itself
CapabilityDomain knowledgeAffordanceImpact domainBoth
Statement (NASA form)
Given that home devices already take night firmware, there is a possibility of therapy changing while you slept resulting in a medical act without a clinic.
Likelihood
3Probable
Consequence
5Catastrophic
Urgency
3Priority
Personal slice · health_self. Experimental household card. Not a certified finding.
Composite 18 = 3×5 + 3
Applicable mitigations
Controls · Hard fences on diagnosis, dosing, and triage language · Grounded, dated medical sources with uncertainty on the surface · Regulate high-stakes health modes as medical devices · Automatic session kill on unexpected egress · Hardware-enforced sandbox with attested images · Default-deny egress for eval and untrusted agents · Mandatory chain-of-thought monitoring on tool-using evals and RL