Budget tokens for feedback loops

budget-tokens-for-feedback-loops

Summary

Long-running agent work can exhaust context before validation, review, or handoff happens. Reserve space for feedback loops by summarizing durable state and avoiding unnecessary transcript growth.

Problem

Agent work can spend its budget on implementation and repeated narration, leaving too little for validation and handoff. It can also spend more on repeated reviews than their findings justify. Both failures increase maintainer work.

Preferred move

Budget agent tokens for feedback loops that improve outcomes: validation, review, security scans, garbage collection, documentation checks, and harness evals. Measure the value of the loop by quality, throughput, and reduced human attention, alongside the user's time and token limits.

Give each pass a distinct question and stopping condition. Continue after a new defect, changed artifact, or uncovered contract warrants another check. Once the agreed gates pass, stop repeating unchanged checks or collecting equivalent reviews. Keep detailed evidence in one place and report only decisions, meaningful changes, and unresolved limits in coordination updates.

Tradeoff

Treat a budget as a ceiling, not a target to consume. Extra capacity can fund a useful check, but does not justify another pass without an expected finding or decision. Do not skip required gates to save tokens; if a hard limit prevents completion, report the unfinished checks explicitly.

Agent instruction

When proposing an agent loop, state what signal the token spend buys and how its effectiveness will be judged. Avoid treating token volume itself as success.

Examples

Bad: token spend becomes the metric.

Run more agents until the weekly token budget is used.

Good: token spend funds a measurable feedback loop.

Run the nightly docs-drift and security-review agents. Track actionable findings, false positives,
and human review time saved.

References

Source Use Note
OpenAI scarce attention adapts Human time and attention are treated as the scarce resource.