Description
Re-run acceptance scenarios B4 through B10 against the designated acceptance stack now that the complete optional credential surface is available. This task records live product behavior that the original acceptance round could not exercise; the earlier task remains closed.
Acceptance Criteria
- #1 B4: synthetic profiles are visible for each selected language and profile type
- #2 B5: Faro sessions and page views arrive, and the unconfigured-lane diagnostic remains discoverable
- #3 B6: Synthetic Monitoring checks are registered, reporting, and the provisioner behavior is observed
- #4 B7: Fleet Management collectors are registered and show fresh heartbeats
- #5 B8: sigil generations, workflow steps, and scores arrive
- #6 B9: process self-observability reaches the separate self-observability stack and does not enter the synthetic-data stack
- #7 B10: all optional lanes run together without sustained delivery loss or starvation
- #8 Every scenario is recorded as pass or fail with its observable assertion; unsupported behavior is a failure with a reason, not a skip
Definition of Done
- #1 just check (fmt-check, lint, gen-check, env-check, docs-check, test, race, hygiene, ui-check, compose-check, helm-test, lab-check, signal-fidelity)
- #2 just gen (only if a blueprint field, construct/workload config struct, or a skill under plugins/synthkit/skills/ changed)
- #3 just dump — inventory diffed against signals/
Implementation Plan
Root runs B4 through B10 after integration against the designated synthetic and separate self-observability destinations, recording observable pass or fail evidence for every row.
2026-08-31 Lane D: reproduce sigil score HTTP 400 and queue loss, correct the accepted score/body and delivery behavior, and prepare B6/B8/B10 executable checks; root replays SM and runs the combined live pass.
Implementation Notes
2026-08-30 closeout: B4 profiles pass, B5 Faro pass, B6 SM fail on missing check/probe write authority, B7 Fleet pass, B8 sigil partial/fail because scores return HTTP 400, B9 separate self-observability pass, B10 fail because the sigil queue has sustained loss. Every row has an observable verdict in the rerun register.
2026-08-31 verification: three uniquely named private probes and five checks registered and reported five fresh probe_success series; fresh Sigil traffic contained two generations, one linked workflow step, and an accepted synthkit-v1 score with passed=true; three combined-lane samples over 60 seconds showed no current loss, affected shards, or cumulative drops.
Final Summary
Parked at B6, B8, and B10. Resume with an SM token carrying check/probe write authority and a product-accepted sigil score body; then require all optional queues to show no current loss over a full delivery window.
2026-08-31: Verified B4-B10 against the designated live destinations. Synthetic Monitoring, Sigil, Fleet, Faro, profiles, self-observability, and the combined optional-lane delivery window all produced observable pass evidence with no sustained delivery loss.