Task · CFO-0027

Bounded fast catch-up for lagging window collectors

Description

After an OTLP outage, aigateway.logs commits at most one 15-minute source window on each 5-minute scheduler tick. The live wave 2 replay showed that delivery was healthy but checkpoint recovery took much longer than export throughput required. Preserve the 15-minute per-commit safety bound and flush-gated checkpoint behavior while allowing controlled catch-up between normal ticks. The exact concurrency, request budget, and backpressure policy need to be chosen against current code and provider limits when this task is taken up.

Acceptance Criteria

Definition of Done

Implementation Plan

Commit bounded windows serially inside one tick, stop after failure or cancellation, and prove checkpoint and OTLP delivery behavior with fake-clock and exporter-failure tests.

Final Summary

Lagging collectors can commit multiple 15-minute windows per tick without advancing before export acknowledgement. Prechange catch-up tests failed; fake-clock, cancellation, 429, exporter-failure/retry, fairness and deadline tests passed, followed by independent security review, exact-SHA just ci and CI at v0.3.0.

View the source file on GitHub