Identified: Some of our background processing workers which handle build processing and publishing as well as webhook delivery are experiencing a backup. Our team is working to determine root cause and process the delayed jobs. All webhooks will be delivered; some builds may time out and fail.
Mitigated and Monitoring: Our team shipped a fix for the delays. All webhooks should have been delivered by now and new builds should work as expected. We’re marking that became stuck due to timeouts during the issue as failed.
Posted about 2 months ago. Dec 02, 2018 - 16:06 PST