All Systems Operational

About This Site

Status updates for Buildkite’s services and components. You can also follow @buildkitestatus on Twitter for updates.

Web Operational
90 days ago
99.99 % uptime
Today
Agent API Operational
90 days ago
99.69 % uptime
Today
REST API Operational
90 days ago
99.99 % uptime
Today
Job Queue Operational
90 days ago
99.68 % uptime
Today
SCM Integrations Operational
90 days ago
99.99 % uptime
Today
Notifications Operational
90 days ago
100.0 % uptime
Today
GitHub Commit Status Notifications Operational
Email Notifications Operational
Slack Notifications Operational
Hipchat Notifications Operational
Webhook Notifications Operational
90 days ago
100.0 % uptime
Today
SCM Providers ? Operational
GitHub Operational
GitHub API Requests Operational
Atlassian Bitbucket SSH Operational
Atlassian Bitbucket Website and API Operational
Atlassian Bitbucket Git via HTTPS Operational
Third Party Services ? Operational
AWS ec2-us-east-1 Operational
AWS elasticache-us-east-1 Operational
AWS elb-us-east-1 Operational
AWS rds-us-east-1 Operational
PagerDuty Notification Delivery Operational
Operational
Degraded Performance
Partial Outage
Major Outage
Maintenance
Major outage
Partial outage
No downtime recorded on this day.
No data exists for this day.
had a major outage.
had a partial outage.
Scheduled Maintenance
Database maintenance May 29, 00:00-01:00 UTC
We will be performing database maintenance this weekend on Sunday 29th May 2022 for 30 to 60 minutes between 00:00-01:00 UTC. During this window, Buildkite will not be available for 30 to 60 minutes. The Buildkite Dashboard and APIs will be unavailable, and no new work will be scheduled during the downtime. Agents which already have work can run the work to completion, but agents will not be assigned new work and will not be able to submit the results of work until the maintenance is completed. Webhook requests will not be acknowledged during the window, existing webhooks will not processed until the failover is completed. We will provide an update with the exact timing of the downtime closer to the window.
Posted on May 23, 07:42 UTC
Web Response Time ?
Fetching
Agent API Response Time ?
Fetching
REST API Response Time ?
Fetching
Agent Job Dispatch
Fetching
HTTP Request Error Rate ?
Fetching
Past Incidents
May 27, 2022

No incidents reported today.

May 26, 2022

No incidents reported.

May 25, 2022

No incidents reported.

May 24, 2022

No incidents reported.

May 23, 2022
Resolved - On May 23 at 04:16 UTC a feature was turned on that caused unexpected errors in uploading job logs for approximately 3300 builds.
The effect was short delays in processing job uploads. Our engineers were automatically paged at 04:22 UTC when job logs upload latency exceeded 2 seconds.
The feature was then immediately disabled and job processing began to improve. It returned to within normal limits at 04:25 UTC and all builds caught up.
We are continuing to monitor. Please contact us if you have any issues.

May 23, 04:16 UTC
May 22, 2022

No incidents reported.

May 21, 2022

No incidents reported.

May 20, 2022

No incidents reported.

May 19, 2022
Resolved - This issue was escalated to AWS who has applied manual remediations to the primary RDS instance that powers job dispatching. We continue to work with AWS to identify and remediate the root cause of repeated high write latency.
May 19, 23:02 UTC
Monitoring - The issue has been identified and service is beginning to return to normal. We are monitoring
May 19, 22:49 UTC
Investigating - We are experiencing elevated latency in dispatching build jobs to agents.
May 19, 22:44 UTC
May 18, 2022
Resolved - This incident has been resolved.
We continue to closely monitor and investigate the underlying causes.

May 18, 00:31 UTC
Monitoring - A fix has been implemented and we are monitoring the results.
May 18, 00:19 UTC
Update - Metrics are returning to normal, and we continue to monitor and investigate.
May 18, 00:14 UTC
Investigating - We are experiencing elevated latency in dispatching build jobs to agents.
Our engineers are investigating.

May 18, 00:07 UTC
May 17, 2022

No incidents reported.

May 16, 2022

No incidents reported.

May 15, 2022

No incidents reported.

May 14, 2022

No incidents reported.

May 13, 2022

No incidents reported.