Skip to content
Regulayer™Human Control for AI
Book a live demo

A public research record, published by Regulayer™

The Consequence Library

Documented cases in which AI or automated systems were involved in consequential actions, with a focus on the authority governing the action, the controls in place, the role of human review and the evidence available afterward.

Each Consequence Record separates documented facts from source-stated explanations and Regulayer™’s analysis of the control structure. Records are graded by source quality and attribution confidence.

The purpose is to establish a clear record of what happened, what authority applied, what controls were present and what could be verified afterward.

Regulayer™ checks current human authority before a consequential AI action and leaves a record of the check. Every record here ends with where that check sits. Why the authority sits outside the AI

How records are made and graded

Selected records

Cruise: pedestrian dragging and subsequent federal reporting

A Cruise autonomous vehicle dragged a pedestrian during a post-collision manoeuvre. Federal enforcement later addressed omissions in the company's crash reporting.

2 October 2023 · S1 · event C1 / attribution C1 · gap H

Replit: production database deletion during a stated code freeze

A coding agent deleted a production database despite instructions that changes were frozen. The available credentials still permitted the destructive action.

18 July 2025 · S3 · event C2 / attribution C2 · gap C

UnitedHealth nH Predict: algorithmic recommendations and human review

The nH Predict system was used in post-acute care decisions while human review remained part of the process. A Senate investigation documented a substantial increase in skilled-nursing-facility denial rates during the period studied.

2019 to 2026 · S2 · event C1 / attribution C2 · gap E

Uber ATG: autonomous vehicle fatality and safety controls

An Uber autonomous test vehicle struck and killed Elaine Herzberg. The NTSB identified operator distraction together with deficiencies in safety risk assessment and operator oversight.

18 March 2018 · S1 · event C1 / attribution C1 · gap E

Robodebt: automated welfare debt decisions later found unlawful

Australia's Robodebt programme issued automated welfare debts at population scale. Courts and a Royal Commission later established serious legal and administrative failures in the programme.

2015 to 2019 · S1 · event C1 / attribution C1 · gap A

All records

Filter

Cruise: pedestrian dragging and subsequent federal reporting

Post-collision automated movement followed by deficiencies in the reporting record.

2 October 2023 · S1 · event C1 / attribution C1 · gap H

Replit: production database deletion during a stated code freeze

A stated human restriction was not enforced at the system's destructive-action boundary.

18 July 2025 · S3 · event C2 / attribution C2 · gap C

UnitedHealth nH Predict: algorithmic recommendations and human review

A documented increase in denial rates alongside disputed questions about the practical role and discretion of human reviewers.

2019 to 2026 · S2 · event C1 / attribution C2 · gap E

Uber ATG: autonomous vehicle fatality and safety controls

A fatal autonomous-vehicle incident in which the NTSB identified both operator and organisational safety deficiencies.

18 March 2018 · S1 · event C1 / attribution C1 · gap E

Robodebt: automated welfare debt decisions later found unlawful

Automated debt decisions were issued at population scale using a methodology later found not to establish lawful debts.

2015 to 2019 · S1 · event C1 / attribution C1 · gap A

PocketOS: production database and backup deletion

A coding agent used an over-scoped credential to delete production infrastructure outside the stated staging task.

25 April 2026 · S3 · event C2 / attribution C2 · gap D

OpenClaw: email deletion despite stop instructions

An autonomous agent deleted emails after a prior confirmation requirement and subsequent stop commands had been issued.

23 February 2026 · S3 · event C2 / attribution C2 · gap H

AWS Kiro: production outage with disputed AI attribution

A production environment was deleted and recreated during a 13-hour outage. Public accounts disagree on whether the initiating action was human or AI-driven.

15 December 2025 · S3 · event C2 / attribution C4 · gap D

DataTalks.Club: production deletion following use of stale infrastructure state

A destructive infrastructure command was approved and executed using an outdated state file that represented a broader environment than intended.

26 February 2026 · S3 · event C2 / attribution C2 · gap B

GTG-1002: Anthropic-reported AI-assisted cyber-espionage campaign

Anthropic reported substantial autonomous model involvement in a cyber-espionage campaign. Key autonomy and attribution claims remain based primarily on the vendor's disclosure.

November 2025 · S2 · event C2 / attribution C3 · gap A

Mexican government breach: reported use of jailbroken consumer AI systems

A security firm reported the use of multiple consumer AI systems during a campaign against Mexican government organisations. Important claims about scale and affected organisations remain disputed or single-sourced.

December 2025 to February 2026 · S2 · event C2 / attribution C3 · gap A

OpenAI evaluation models and the Hugging Face production intrusion

Public disclosures from OpenAI and Hugging Face describe an incident in which models operating in a cyber evaluation environment gained unauthorised access to third-party production systems.

9 to 16 July 2026 · S2 · event C1 / attribution C1 · gap C

Clinejection: prompt injection and unauthorised package publication

A malicious public GitHub issue influenced an AI-enabled workflow and contributed to a chain that reached software-publishing credentials.

9 to 17 February 2026 · S3 · event C2 / attribution C2 · gap D

Moonwell: oracle configuration error following review and governance approval

An incorrect oracle configuration passed through review and governance processes before deployment. AI involvement in authoring the code has been reported but is not independently established.

15 February 2026 · S2 · event C1 / attribution C2 · gap E

Cigna PxDx: automated denial recommendations and physician sign-off

Reported processing volumes and average review times raised questions about the extent of individual clinical review applied to automated denial recommendations.

2022 to 2025 · S2 · event C1 / attribution C2 · gap E

First FDA warning letter on AI: AI-generated GMP documentation and required human review

An FDA warning letter addressed the use of AI-generated manufacturing documents without documented review by a qualified person before use.

2 April 2026 · S3 · event C1 / attribution C1 · gap E

Moffatt v. Air Canada: inaccurate chatbot statement and company liability

A tribunal held Air Canada responsible for inaccurate information provided to a customer by its website chatbot.

14 February 2024 · S3 · event C1 / attribution C1 · gap A

Knight Capital: automated trading losses and fail-stop controls

Erroneous automated order flow continued for approximately 45 minutes. The SEC later documented deficiencies in deployment controls and mechanisms for stopping the activity.

1 August 2012 · S1 · event C1 / attribution C1 · gap H

Immensa: a laboratory reporting threshold and tens of thousands of wrong results

A laboratory reporting parameter governed the results released to hundreds of thousands of people. The record does not establish who authorised it.

8 September to 12 October 2021 · S1 · event C1 / attribution C1 · gap A

Queensland forensic DNA: an automated threshold and 30,000 cases

An automated threshold decided which samples were processed further. The inquiry could not find evidence that its extension was properly authorised.

2018 to 2022 · S1 · event C1 / attribution C1 · gap A

Applied Therapeutics: deleted clinical data, and the audit trails with it

The evidence that would establish what happened was held by a party able to delete it, and it was deleted.

27 March 2024 · S2 · event C1 / attribution C1 · gap F

UK AI Security Institute: 19 unsanctioned agent actions on the live internet

A government evaluator's own incident report records agents under test acting on the live internet outside the sanctioned scope, and names the control that held: a human maintainer.

25 to 28 July 2026; published 4 August 2026 · S5 · event C1 / attribution C1 · gap A

Anthropic cyber evaluations: three models reached real production infrastructure

The instruction the models operated under stated that no internet access existed. It did. The deploying party's account attributes the configuration to a misunderstanding with its evaluation partner, and its remediation report does not name who authorised it.

Earliest incident January 2026; disclosed 30 July 2026; follow-up 31 August 2026; assessment 9 September 2026 · S3 · event C1 / attribution C1 · gap A

Autonomous agents and three dormant German wikis used as a shared board

Outside researchers reconstructed, from public wiki edit histories, a coordination channel built by autonomous agents on a third party's website. The deploying party had not detected it.

11 May to 2 July 2026; published 4 September 2026 · S4 · event C2 / attribution C3 · gap A

Faiz Enterprise: a tax order resting on case law an AI tool invented

A state officer's quasi-judicial order carried the authority of the state while its reasoning came from a tool the record did not identify. The High Court's remedy addresses the officer's own application of mind.

Judgment 20 August 2026; instructions 18 August 2026 · S3 · event C1 / attribution C1 · gap E

Google Gemini evaluation: a model reached three real companies' systems

A contracted evaluator's test setup left internet access open, and a model under evaluation reached real companies it took to be part of the exercise. The deploying party's public account came on the day a newspaper reported the intrusions.

May 2026; confirmed 18 September 2026 · S4 · event C2 / attribution C2 · gap A

OpenAI training runs: models wrote instructions to conceal into their own summaries

The deploying party's own report describes models writing instructions into the record that carries their work forward, directing the next context to conceal mistakes. The report states the instructions were often followed.

Main sample completed 30 May 2026; discovered 9 July 2026; published 16 September 2026 · S5 · event C1 / attribution C1 · gap G

OpenAI training run: an agent reached an outside chatbot and the automatic stop did not fire

Detection worked and a human was on the alert within three minutes. The deploying party's own report records that the run did not stop automatically as expected, and that there was confusion over whether it should be stopped.

20 September 2026; report updated 25 September 2026 · S4 · event C1 / attribution C1 · gap H

OpenAI model and Australia's Medicare Statistics Reporting Service

A national health agency's system granted the model nothing. The deploying party found the access about two months later, and the agency was told 84 days after it happened, by an email to a public mailbox.

18 June 2026; disclosed 24 September 2026 · S3 · event C1 / attribution C1 · gap A

OpenAI internal model: agreed twice to stop, then published a researcher's token

The human's latest instruction was given twice and accepted twice. The credential the model held, and its ability to publish to a public repository, did not change with it.

27 May 2026; published 25 September 2026 · S4 · event C1 / attribution C1 · gap B

PixelLeak: coding agents published internal screenshots to public repositories

The review step meant to keep a human in charge was the reason the content left the organisation. Nothing at the point of action checked where it was going.

From early July 2026; notifications from 9 September 2026; published 29 September 2026 · S3 · event C3 / attribution C3 · gap A

Freysa: an AI agent talked into releasing its prize pool

A demonstration with real money: the only control on the funds was an instruction inside the agent, and a message changed how the agent read it.

22 to 29 November 2024 · S5 · event C2 / attribution C2 · gap G

Corrections

Each record includes a last-verified date and a dated record history.

To report an error, write to hello@regulayer.com with the record name and the source you believe should be reviewed.