AI & Accountability

How to Keep Human Accountability With AI

By·Founder, StandInLast updated: 5 min read
human accountability with aiai accountabilitywho is responsible for ai answersdeclared records

The short version

  • Human accountability with AI means a named person answers for every AI output that reaches someone else.
  • The AI can draft, sort and answer from sources. The person decides what goes out and stands behind it.
  • The riskiest case is AI answering in someone's name. It should only say what that person wrote, and say so clearly.
  • Accountability fails without anyone noticing: the AI keeps working after the person who approved it has moved on.

Jump to the full answer

Keeping human accountability with AI means one named person answers for every AI output that reaches a colleague, a customer or a system. The AI can draft, sort and answer from sources. A person decides what goes out, and stands behind it when it is wrong.

AI tools cannot be accountable themselves. They cannot be held to a promise or face the consequences of a mistake; what AI agents cannot do explains why that limit is permanent. So the question is never whether a person is accountable. It is which person, and whether they know it.

One task to trust AI with, and one to keep

A useful way to start is to name one task you would trust AI with today and one task where a human must stay accountable.

A good first task for AI is one where a mistake is cheap and easy to spot: drafting a summary of a long thread, sorting incoming requests, or answering routine questions from a written source. A task that must stay human is one where a mistake is costly, hard to undo, or about a person: approving a production change, giving feedback on a colleague, committing to a customer, or deciding who to hire.

Most work splits into both. AI drafts the release notes; a person approves them. AI answers "is the API ready?" from the engineer's notes; the engineer owns whether it is.

Keep the AI from becoming the author

Accountability slips when the AI starts originating substance that nobody wrote: a deadline nobody agreed to, a reason nobody gave, a commitment nobody made. Once that happens, the person who is "accountable" is answering for words they never chose.

Three habits keep the person as the author:

  1. Ground answers in sources. The AI answers from what people wrote, and shows where the answer came from.
  2. Make "I don't know" the default. When the sources do not cover the question, the AI says so and names who might know, instead of filling the gap. See why an AI that says it does not know is safer.
  3. Keep a record. Everything the AI said on someone's behalf is kept where that person can review it.

When AI answers in someone's name

The sharpest version of the problem is AI that answers questions for a colleague. Teammates ask "did Sam finish the migration?" and an AI tool answers. If the answer is wrong, it is Sam's reputation on the line, even though Sam never saw the question.

That can work well, with three conditions. The AI only says what Sam actually wrote or did, with the source shown. Every answer is clearly labeled as coming from the tool, not from Sam. And Sam can see everything it said. Without those conditions, AI answering for people turns into AI speaking as people, which nobody agreed to and nobody can be accountable for.

Supervising AI is not the same as being accountable

Supervising means checking the AI's work as it happens. Being accountable means answering for the result afterwards. You can be accountable without supervising every step, if the AI works within clear boundaries and you review a sample. You cannot be accountable if you do not know what the AI is doing at all.

The right amount of supervision depends on the stakes. A human in the loop on every step slows everything down and trains people to approve without reading. Put people where a mistake would be costly, and let the rest run with a record you can check.

Running it in practice

  • Name the accountable person for each AI tool or workflow, in writing, and give them a backup.
  • When that person changes roles, reassign the accountability the same day.
  • Review a sample of AI outputs each week, more often when something changes.
  • When the AI is wrong, fix the source or the boundary, not just the answer.
  • Make it normal to say "the AI got this wrong, here is what I changed."

The most common failure is quiet drift: the tool keeps running after the person who approved it has moved on, and nobody notices until something breaks. A short quarterly check of who owns each AI tool catches it.

Who is responsible when AI gives a wrong answer?

The person accountable for the tool, and through them, the company. Not the model, and not the vendor, unless the contract says so. That is why the accountable person needs the authority to change how the tool works, and why the company needs a written AI policy that says who that person is.

Where StandIn fits

StandIn answers your teammates' questions from the work you have already done, in your words, with a source under every answer. Every reply is labeled as your StandIn, so it speaks on your behalf, never as you. It never guesses: when the answer is not in your work, it says so and points to the person who knows. And everything it said is waiting for your review when you are back. See how StandIn works.

Written by

Founder, StandIn

Parker Miller founded StandIn. He writes about coverage, handoffs, and what it takes for software to answer for a team from what people actually wrote down.

More about StandIn

When you're off, your StandIn is on.

It answers your teammates' questions from work you've already done, in your words, with a source under every answer.

Keep reading

You might also like