All Systems Operational

About This Site

Status updates for Buildkite’s services and components. You can also follow @buildkitestatus on Twitter for updates.

Uptime over the past 90 days. View historical uptime.
Web Operational
90 days ago
99.99 % uptime
Today
Agent API Operational
90 days ago
99.98 % uptime
Today
REST API Operational
90 days ago
99.98 % uptime
Today
Job Queue Operational
90 days ago
99.99 % uptime
Today
SCM Integrations Operational
90 days ago
100.0 % uptime
Today
Notifications Operational
90 days ago
100.0 % uptime
Today
Github Commit Status Notifications Operational
Email Notifications Operational
Slack Notifications Operational
Hipchat Notifications Operational
Webhook Notifications Operational
90 days ago
100.0 % uptime
Today
SCM Providers ? Operational
GitHub Operational
GitHub API Requests Operational
Atlassian Bitbucket SSH Operational
Atlassian Bitbucket Website and API Operational
Atlassian Bitbucket Git via HTTPS Operational
Third Party Services ? Operational
AWS ec2-us-east-1 Operational
AWS elasticache-us-east-1 Operational
AWS elb-us-east-1 Operational
AWS rds-us-east-1 Operational
PagerDuty Notification Delivery Operational
Operational
Degraded Performance
Partial Outage
Major Outage
Maintenance
Major outage
Partial outage
No downtime recorded on this day.
No data exists for this day.
had a major outage.
had a partial outage.

No incidents or maintenance related to this downtime.

Scheduled Maintenance
Database maintenance Oct 24, 07:00-08:00 UTC
We'll be performing database maintenance next weekend on Sunday 24th October 2021 from 07:00 UTC. We may need to pause database activity for a few minutes in this window, and Buildkite may not be available during this pause. The Buildkite Dashboard and APIs will be unavailable, and no new work will be scheduled during the downtime. Agents which already have work can run the work to completion, but agents will not be assigned new work and will not be able to submit the results of work until the maintenance is completed. Webhooks will be received but not processed until maintenance is completed.
Posted on Oct 18, 01:45 UTC
System Metrics Month Week Day
Web Response Time ?
Fetching
Agent API Response Time ?
Fetching
REST API Response Time ?
Fetching
Agent Job Dispatch
Fetching
HTTP Request Error Rate ?
Fetching
Past Incidents
Oct 23, 2021
Database maintenance
Completed - The scheduled maintenance has been completed.
Oct 23, 02:32 UTC
Update - The performance regression has been fixed and performance is back to normal across the board.
Oct 23, 02:27 UTC
Update - Most performance is back to normal, except for a performance regression having some secondary impact. We have identified a fix and are applying it now.
Oct 23, 01:51 UTC
Verifying - The upgrade is done and the site is back online. Performance will be degraded for a bit longer as caches warm up.
Oct 23, 01:14 UTC
Update - We've commenced our upgrade. We expect downtime shortly.
Oct 23, 00:42 UTC
Update - We're preparing to make the planned changes and will post an update before operations expected to cause downtime.
Oct 22, 23:06 UTC
In progress - Scheduled maintenance is currently in progress. We will provide updates as necessary.
Oct 22, 23:00 UTC
Scheduled - We'll be performing database maintenance next weekend on Friday 22nd October 2021 from 23:00 UTC. We will be doing a database upgrade and so our database will be unavailable for around 15 minutes in this window, and Buildkite may not be available during this period. The Buildkite Dashboard and APIs will be unavailable, and no new work will be scheduled during the downtime. Agents which already have work can run the work to completion, but agents will not be assigned new work and will not be able to submit the results of work until the maintenance is completed. Webhooks will be received but not processed until maintenance is completed.
Oct 18, 01:44 UTC
Oct 22, 2021
Oct 21, 2021

No incidents reported.

Oct 20, 2021

No incidents reported.

Oct 19, 2021

No incidents reported.

Oct 18, 2021
High error rates
Resolved - Buildkite suffered from high error rates for two minutes on Monday, 18th October 2021 from 4:18 am until 4:20 am UTC. The Buildkite Dashboard and all APIs were affected. Some Buildkite Agent activities may have been interrupted, but default retry behaviours should have mitigated interruption. Webhook ingestion was not affected, although ingested webhooks may not have been processed until the errors subsided.

The errors were caused by a migration which should have been zero downtime except for a small mistake. The migration was being closely supervised, and a revert was quickly applied. The mistake has been fixed, and the errors should not recur.
Oct 18, 04:21 UTC
Oct 17, 2021

No incidents reported.

Oct 16, 2021

No incidents reported.

Oct 15, 2021

No incidents reported.

Oct 14, 2021

No incidents reported.

Oct 13, 2021

No incidents reported.

Oct 12, 2021

No incidents reported.

Oct 11, 2021

No incidents reported.

Oct 10, 2021

No incidents reported.

Oct 9, 2021

No incidents reported.

← Incident History Powered by Atlassian Statuspage