Elevated Error Rate on API Traffic

Incident Report for Buildkite

Resolved

With a temporary workaround in place we expect this incident has been resolved. We have identified some follow-up measures that we will schedule to be implemented during an upcoming off-peak period.
Posted Jul 19, 2019 - 03:07 UTC

Monitoring

We’ve identified the cause of the elevated error rates and have implemented a workaround, and are seeing response status rates return to expected levels.
Posted Jul 19, 2019 - 03:02 UTC

Investigating

We’re experiencing elevated error response rates from the REST and agent APIs. We’re working to identify the issue.
Posted Jul 19, 2019 - 02:22 UTC
This incident affected: REST API (REST API) and Agent API.