AI Risk Atlas Prototype/DemoUnofficial independent experiment. Not an official xAI product. Scores can be wrong.

Back to watch register
18Physical & weaponsBelow the top 20

Physical lab agents shipping before the safety evals exist

CapabilityDomain knowledgeAffordanceImpact domainBoth

Statement (NASA form)

Given that a shared hardware driver already lets agents talk to arms, lasers, and liquid handlers, there is a possibility of open-sourcing the driver, or widening the preview, before physical-safety evals land resulting in an agent moving mass, heat, or a sample on a prompt that was never in the test suite.

Likelihood
3Probable
Consequence
5Catastrophic
Urgency
3Priority

Anthropic MHS preview (27 Aug) with HHMI Janelia. Integration time drops from weeks to hours. They say they will not open-source until evals exist. A preview that reaches a laser is already an affordance.

Composite 18 = 3×5 + 3

Applicable mitigations

Related on the map