Use Case Illustration

AI-Assisted Surgical Decision-Making Without Contemporaneous Decision Records

Why this document exists

This use case is published through the AI OSI™ initiative to examine a publicly reported incident involving AI-assisted surgical systems.

It does not assess clinical correctness, assign liability, or offer regulatory judgment. Its purpose is narrower: to illustrate how harm involving AI can be compounded by the absence of contemporaneous, human-readable governance records, and how that absence is neither necessary nor inevitable.

The failure described here is not a failure of artificial intelligence. It is a failure of institutional memory.

The situation as it now exists

AI systems are increasingly embedded in surgical and clinical environments. They assist with visualization, navigation, anatomical identification, monitoring, and risk assessment.

These systems are rarely introduced through a single, explicit governance moment. Instead, they are adopted through procurement pathways, vendor training, and gradual normalization within clinical practice.

Over time, reliance increases. Scrutiny decreases. Authority becomes implicit. When AI influences care, it often does so quietly—shaping attention and judgment without leaving a durable record of how it was used, how influential it was, or who authorized that reliance.

When something goes wrong, institutions are left reconstructing decisions that should have been recorded at the moment they occurred.

What the public reporting revealed

According to public reporting, AI-assisted systems were used in surgical contexts where misidentification or incorrect guidance occurred and patient harm resulted.

Afterward, it was not possible to clearly determine:

  • how influential the AI system had been in the decision process

  • whether its use exceeded its intended or approved role

  • who explicitly authorized reliance on it at the point of care

  • what constraints or limitations were understood at the time of use

Statements following the incident emphasized complexity, training issues, or distributed responsibility. What was absent was a contemporaneous governance record capturing how reliance on AI was authorized when it mattered.

That absence is the central issue.

What actually failed

The failure was not model accuracy alone, system design alone, or clinician competence alone.

The failure was the absence of a simple, durable governance record capturing:

  • who decided to rely on an AI system

  • under what conditions that reliance was permitted

  • what risks were understood at the time

  • and until when that authorization remained valid

Without such records, accountability collapses into retrospective reconstruction. Reconstruction introduces hindsight bias. Hindsight bias invites adversarial reinterpretation. Institutional memory erodes precisely when it is most needed.

This is not merely a documentation gap. It is a governance failure in evidentiary continuity.

How the AI OSI™ framework would have changed what could be known

The AI OSI™ framework does not prevent error. It preserves evidentiary continuity around error.

If a standing governance record had existed under the AI OSI™ framework defining how the system was approved for use, what it was not approved to do, and who held responsibility for that authorization, then scope drift would have been visible before harm occurred.

If a contemporaneous decision record had been created at the moment of care, it would have captured:

  • the degree of AI influence in the decision

  • whether human override was substantive or nominal

  • and what risks were understood at the time of reliance

That record would have preserved the decision as it existed before outcomes reshaped interpretation.

If a first-capture incident record had been created immediately after the unexpected outcome, it would have preserved operational reality before legal framing, institutional messaging, or vendor alignment altered the narrative surface.

None of this requires advanced technical capability. It requires naming responsibility at the moment it exists.

Why this was not inevitable

Nothing about this incident required new models, additional regulatory authority, or prohibition of AI in clinical environments.

It required a small number of contemporaneous governance records, created at the moment decisions were made, by identifiable human owners, documenting AI’s role in consequential decisions.

The absence of those records did not cause the clinical harm directly. It caused the inability to clearly reconstruct, defend, or learn from the conditions under which the harm occurred.

What this illustrates more broadly

This failure mode is not unique to healthcare.

It appears wherever AI systems influence decisions affecting:

  • physical safety

  • employment

  • financial access

  • legal rights

  • or institutional outcomes

Across these domains, the same structural question emerges:

Who decided to trust the system, and where is that decision recorded?

When that question cannot be answered cleanly, accountability becomes interpretive rather than evidentiary.

Conclusion

AI did not make this situation inherently unknowable. The absence of contemporaneous governance records did.

The AI OSI™ initiative exists to replace that absence with structured institutional memory—created at the moment decisions occur, not reconstructed after outcomes are known.

This is not a claim of safety or certainty. It is a commitment to evidentiary continuity.

It is a refusal to forget decisions that cannot be undone.

References

Reuters, AI enters operating room; reports arise of botched surgeries, misidentified body parts, February 9, 2026.
https://www.reuters.com/investigations/ai-enters-operating-room-reports-arise-botched-surgeries-misidentified-body-2026-02-09/