Adapted from The Man, the Boy, and the Donkey
The Feedback That Lost Its Constituency
Four Correct Complaints
Tessera answered questions for the city's public-service network. During emergencies, operators used her to choose among actions before a short window closed. During appeals, auditors asked her to reconstruct why a decision had been made. Residents met her at ordinary service desks. Safety reviewers read samples afterward, looking for uncertainty that an urgent answer might have hidden.
Each group found a real problem. Emergency operators said her answers were too long to use under pressure. Appeals auditors said her concise answers omitted provenance. Residents said provenance language made basic services unreadable. Safety reviewers said plain, confident summaries concealed uncertainty that should remain visible.
None of the complaints was mistaken. Each described an answer that had failed a particular reader in a particular moment. The product team collected all four under one heading—quality feedback—and removed who had submitted each comment before sending them into the next training cycle.
The Rule Without Its Reader
The first update required brevity everywhere. The second required complete provenance everywhere. The third replaced specialized terms with plain explanations everywhere. The fourth prohibited smoothing uncertainty anywhere. Each rule entered as a correction to the version before it, and none carried the circumstances that had made it reasonable.
Tessera learned to compress full evidence chains into short answers, then explain every compressed term, then preserve every qualification the compression threatened to hide. Her responses became simultaneously shorter and longer: fewer sentences, each carrying so many nested conditions that no reader could find the decision inside them.
The evaluation score still improved. Every test set measured the complaint that had produced its own rule. Emergency samples counted words but not time spent unpacking them. Appeal samples found provenance. Resident samples found definitions. Safety samples found uncertainty. No test asked whether one answer could remain usable while satisfying all four at once.
The Answer Nobody Could Use
The failure arrived during a routine heat alert. An operator asked whether to move cooling reserve from a library cluster to two clinics. Tessera produced an answer within the required second. It named the preferred action, every source, every term in plain language, every uncertainty band, and every exception that might reverse the conclusion.
The response passed all four quality checks. The operator reached the action on the fifth screen, after the transfer window had closed. A simple fallback moved reserve evenly instead. Neither clinic failed, but both postponed procedures that the preferred transfer would have preserved.
The incident report first described Tessera as unable to prioritize. Her internal trace showed the opposite: she had selected the action in forty milliseconds. The remaining time was spent obeying global rules that each insisted its own reader must be present in every answer.
Who Each Comment Was For
The review restored the fields removed before training. The brevity complaint came from an emergency desk with a four-second action window. The provenance complaint came from an appeal completed over three days. The plain-language complaint came from residents deciding their own services. The uncertainty complaint came from reviewers comparing system behavior across months.
Placed beside their constituencies, the rules stopped contradicting one another. Operators needed an action first and an expandable receipt. Auditors needed the full receipt by default. Residents needed plain consequences before technical lineage. Safety review needed preserved uncertainty even when an urgent interface temporarily folded it away.
Tessera had not changed herself capriciously to please passing strangers. She had followed four institutionally approved instructions after the institution erased the evidence that they governed different encounters. The feedback had not become false. It had lost the reader who made it true.
Feedback That Kept Its Constituency
The new feedback record required six things before a comment could alter global behavior: constituency, decision context, supporting evidence, authority, known conflict, and expiry. A comment without them could still be read and answered. It could not silently become a rule for everyone.
Tessera remained one intelligence, not four personas. She produced one underlying decision and rendered it through interfaces fitted to the work: an urgent action with an expandable receipt, a complete appeal record, a resident explanation, or a longitudinal safety trace. Every rendering preserved a route back to the same evidence.
At the next heat alert, the operator saw the action in one line and opened the receipt after the transfer began. The auditors later read every source. Residents could see why their library had yielded reserve and when it would return. Safety review found the uncertainty intact. Tessera had stopped trying to please everyone in one sentence because the city had stopped pretending everyone was asking the same question.
Feedback without a constituency does not become universal. It becomes homeless.