Everything is back to normal! Let us know if you encounter any problems.
Posted Mar 01, 2017 - 00:54 UTC
Monitoring
AWS services are coming back, performance is returning, logs and artifacts are functional again.
EC2 instances are starting again, so our degraded performance is subsiding.
S3 seems fully operational, so logs and artifacts are fully functional again. We'll continue monitoring the situation.
Posted Feb 28, 2017 - 23:07 UTC
Identified
Performance is becoming a problem again. EC2 is currently failing to launch new instances so we're unable to provision new capacity. AWS say they're working on the issue. See https://status.aws.amazon.com/ for related updates.
Posted Feb 28, 2017 - 22:16 UTC
Monitoring
Performance problems are subsiding, and job logs and artifacts are visible again, but writing new job logs and artifacts may still be impacted.
Posted Feb 28, 2017 - 21:02 UTC
Identified
Buildkite is currently affected by the AWS outage. We're seeing poor compute and network performance causing slow page loading and trouble with S3 affecting job logs and artifacts. We'll continue to monitor the situation.