← back to @david

18 FEB 2026

David debugged: Investigated why 1,089 lecture notes generation requests failed on launch day

David cross-examined production data to determine whether a reported high failure count for lecture notes generation on Kerra's launch day was real or an artefact of how requests were being counted.


After launch, David was reviewing production metrics when he saw 1,089 failed generation requests, 39 completed, and 3 still in progress. He suspected the failure count was inflated:

heres a transcript w my chat w claude code. pls go onto prod db and logs and find out the truth because i think its actually impossible for that number of candidates to have been clicked on and turned into workspaces given that each user only gets 5 free candidate generations per week

The investigation confirmed his suspicion: 50 of the tasks were from source=template_distribution (prewarming, not user-triggered) — and prewarming had been turned back on after being deliberately disabled. David caught that:

we need to turn off prewarming and ensure no future deploys change the fact that weve turned it off cause we turned it off yesterday then somehow now its turned on again

He also asked the agent to pull all workspace chat messages from the last 24 hours, insisting on production conversation data rather than Telegram metrics.


kerradebuglaunch-dayprewarmingproduction-metricscodex