Errata‎ > ‎

Cloud Outage Collection

Updated 21 June 2017

A running collection of cloud related outages/incidents (2013-present) with associated news articles and provider responses.  Also started noting outages caused by cyberattacks in late 2016 since more seemed to be popping up in my feeds/alerts.

Outages listed may be somewhat spotty/random, simply picked up by various scans, alerts or feeds.  Links to articles and incidents may also break over time, but still may be useful to those evaluating Cloud Service Providers.  Suggestions always welcome!

Related/Interesting

Recent  

Date Who/What/Where Service Provider Comments, Notes ....
06/19/2017   Skype (Microsoft) - Article Article Article Article Article Article
 Article Article Article
Sing-a-long on Skype Heartbeat
Skype Support Twitter chatter
Unconfirmed DDoS Cyberattack
06/03/2017 Google Home - Article Article Article Article Sounded like multi-day issue on google home forums - Best Answer @ https://goo.gl/x0bSq1?
05/27/2017 British Airways - Article Article Article Article Article Article  Article Article Article Article Article Article Article ArticleNot exactly cloud outage, but lots of chatter (and disruption).  Human Error? 
Outage cost guestimate:  £80m
05/25/2017   Capita Pay360 (UK) - Article Article Article Article 
05/12/2017 'WannaCry' Ransomware - Article Article Article Article Article
 Article Article Article
Lots of press/chatter, thousands affected worldwide.  WannaCry on Wikipedia
05/10/2017 Microsoft Office 365 - Article Looked like a small bump via - Twitter Office365Status/status/862396348569706496
04/13/2017   Melbourn IT (AUS) DNS DDoS Attack - Article Article Article  status.netregistry.com.au:  "Today we experienced a large DDoS attack on our DNS servers that disrupted our web hosting (Cloud and cPanel), email platforms, and access to the Console (our customer administration portal). 
03/28/2017 Azure Japan - Article 'Cooling Event" - MS Status Dashboard 
03/21/2017 Microsoft Office 365 -  Article Article Article Article
 Article Article Article Article Article Article Article Article Article
 Article
 Service Health Dashboard:  Apparently Authentication issues affecting Skype, Outlook and/or OneDrive services.  Xbox Live too
03/08/2017 ATT 911 Service - Article Article Article Article  
03/02/2017 GoDaddy DNS - Article Article Article 
03/01/2017 Baidu (CN) - Article 
02/28/2017 Amazon AWS - Article Article Article Article Article 
 Article Article Article Article Article Article Article Article
 Article Article Article Article Article Article Article Article
 Article Article Article Article Article

 Article Article Article Article Article Article Article Article
 Article Article Article
Amazon summary (twas a typo!) and apology
4hr outage, lot of chatter.  Resiliency test for many!
Specifically S3 - Many popular sites affected.
Interesting that Amazon Services not affected

LOTS of CHATTER:  Week 2 - articles continue
02/27/2017 HSBC Online Banking (UK) - Article"We're sorry" via Tweet
02/23/2017    Google's OnHub - Article Article Article Article Article 
 Article Article
Mass factory reset of OnHub routers
Google apology and reset instructions
02/08/2017    Instapaper - Article Article ArticleDown 31 hours + a week to recover?
Appears to scalability - hit the wall (er ceiling!)
Explanation and apology blogged
02/03/2017Telstra (AU) - Article Article Article Ongoing Struggle for Telstra (see June 2016).  Even more:  "Your SMS may have gone to another mobile number and not the number you intended to send it to. We apologise for this."
01/30/2017Google Compute Engine - ArticleApology on Cloud Status Dashboard
01/29/2017 Delta Airlines - Article Article Article Article Delta update and CEO apology
(Trump blames delta for airport delays ... TeeHee)
01/26/2017IBM SoftLayer - Article ArticlePlanned update gone wrong?
01/22/2017United Airlines - Article Article Article Article ArticleGlitch
01/19/2017SSP Worldwide (Ins) - Article Article Article ArticleCOO Apology (blames upstream providers)
Amazing chronic outages
2 BIG/Multi-Day outages in 2016
01/17/2017Google Drive - Article Article ArticleG Suite Incident details & apology
01/11/2017Lloyds Bank - Article Article Article Article ArticleCyberattack DDoS
01/09/2017MJ Freeway - Article Article ArticleNot exactly cloud, but interesting Cyberattack.  
ERP for Cannabis Industry.

Some info on mjfreeway.com &  FB Page 
* Good one

2016

 Date  Who/What/Where  Service Provider Comments, Notes ....
 

2016
in Review
Checkpoint's 2017 Predictions 

Zetta Reports on Six of 2016’s Top Data Outages and their Consequences

CRN's 10 Biggest Cloud outages of 2016

Another!  Top Cloud Outages and IT Issues of 2016

And ... The 11 Worst Cloud Outages (Fiascos) of 2016
 2016 in review PLUS predictions for 2017

 Caught 5 of 6 of them this year


 Dang:  9 out of 10 - missed August Nest outage 

 10 for 10 on this one!  They missed Oct Dyn DDos

 Had 10 or the 11 here ... I missed Pokemon Go
12/17/2016  Kiev, Ukraine Power Grid -  Article Article Article Article Article Article Article Article Article Article Article
Article
 Cyber Attack Outage
 Affected 60 Substations, 200k Residents

Noteworthy: Dec 2016 Ukraine Grid Cyberattack 
Apparently Linked to Russian Hackers
12/3/2016  Singtel (Singapore) - Article Article  24 Hour outage - Users get 10% off bill
12/2/2016  TalkTalk Internet Services (UK) - Article Article Article  Cyberattack
11/28/2016  Deutsche Telekom - Article Article Article Article Article Article  900k German Household Routers - Cyberattack 
11/24/2016  EU Commission - Article Article Article Article  DDoS 
11/22/2016      MS Outlook/Hotmail - Article  
11/21/2016  Federal Motor Carrier Safety Administration (FMCSA)
 Article
 fmcsa.dot.gov Cloud Transition
11/14/2016  SSP Worldwide (Insurance) - Article Article  Wow
11/14/2016    Google Big Query Service - Article   Google BigQuery Incident #18022
11/10/2016  SSP Worldwide (Insurance) - Article  Another?!  After BIG one in August.
11/4/2016  Liberia (the country?!) - Article Article Article Article Article Article Article Article Article  Lots of DDoS chatter., but details/extent unconfirmed - similar view from Krebs
11/3/2016  Office 365 - Article  
11/2/2016  Barracuda Email Security Scanning - Article  Caused by "Large number of inbound connections"
10/31/2016  Apple iCloud, Apps & iTunes Stores - Article  Not much, noted on Apple System Status
10/26/2016  gov.uk - Article Article  Not Malicious Attack according to @govuk on Twitter
10/21/2016 Dyn DDoS Cyberattack - Article Article Article Article Article Article Article Article Article Article Article Article Article Article Article  DYN Statement on 10/21 DDoS Attack
 Hangzhou Xiongmai Device Recall (pr)
10/13/2016 GlobalSign SSL Certs Revoked  - Article  Apologies and Support Links
10/6/2016    Microsoft Outlook.com - Article  
10/3/2016    Apple iTunes/Music/App Stores - Article  
9/26/2016 Vesk (UK) - Article  Apologies and updates @ customers.vesk.com/
9/16/2016    Fonality (VoIP) - Article   
9/15/2016 Microsoft Azure - Article Article Article Article  DNS Issue
9/14/2016
Google Gmail - Article Article Article Article Article Article
 Goolge App Status Dashboard blow-by-blow
9/9/2016
Microsoft Azure - Article
 Europe
     
8/26/2016   
Vesk (UK) - Article
 
8/23/2016 SSP World Wide (Insurance) - Article Article Article Article Article  10 Day Outage
Not much @ https://www.ssp-worldwide.com
Twitter Chatter 
8/11/2016 Google App Engine (US) - Article Article   Self Inflicted - Incident #16008
 More Details in this Article
8/8/2016 Delta Airlines - Article Article Article Article Article Article Article Article  Refunds, waived change fees(!) and more
 CEO Apology - Video
8/2/2016 123-Reg (UK) - Article  
7/27/2016 Petnet - Article Article Article Article  Cloud Based Pet Feeder 
7/19/2016
BT Internet (UK) - Article Article Article Article
 Apparently caused by Equinix 
7/18/2016
Docker Cloud - Article Article
 DDoS
7/18/2016
Scalr Hosting - Article
 
7/12/2016 Comcast Biz Phone Service - Article Article  Apparently Datacenter Power outage
 Comcast support:  "Reboot your modem" 
7/11/2016
Fasthosts (UK) - Article
 4 Day outage
7/1/2016
Snapchat (OMG!) - Article
 
6/30/2016
Google Calendar - Article Article  
6/30/2016
Office 365 email - Article  Article
 
6/28/2016 Google Compute - Article  Self-inflicted Bug? 
6/20/2016 CloudFlare (EUR) - Article Article Article  
6/15/2016 Nasuni Cloud Storage - Article   Interesting register article about outage:  Competitor (CTERA) reported outage to press!
6/06/2016 Amazon AWS (AU) - Article Article Article Article Article  Storm related - Amazon explanation HERE
 Interesting Article:  Partners give AWS good score!
 More Interesting:  Bank ATM traffic Riding on AWS?
6/03/2016 Cricket Wireless (US) - Article Article Article  
6/02/2016 Apple Cloud Services - Article Article Article Article Article  Not Much
5/19/2016 Telstra Network (AU) - Article  $50M Injection to avoid repeats
5/16/2016 Lloyds Online banking - Article  
5/10/2016 Salesforce.com - Article Article Article Article 
Article Article Article Article Article Article Article
Down for a day WITH DATA LOSS (Yeeesh!)
CEO apology on twitter  
Regrets @ http://trust.salesforce.com/trust/instances/NA14
4/25/2016 Lansing Board of Power & Light Ransomware 
Article Article - 5/5 Update STILL Recovering
 Not exactly Cloud outage, but noteworthy trend
4/19/2016 Google OAuth Services - Article Article  Interesting little outage
4/16/2016 123-Reg (UK) VPS Outage Article Article Article 
Article 
Whoops!  Deleted hosted sites! Copy of 123-Reg email to customers @ https://goo.gl/XOnWso. Ongoing recovery @ https://www.123-reg.co.uk/support/system-status/, Lots more chatter on twitter https://twitter.com/search?q=123-reg.  

Apology and 6 months free hosting HERE
4/11/2016 Google Compute Engine - Article Article Article Article Article Article Article Article  Lots-of-chatter for 18 min outage
 Apology + $ credits for GCE & VPN customers *and* an  interesting read if you are into networking.
4/11/2016 Symantec Cloud -  Article Article  Sequence of events w/ Apology 
4/1/2016     Apple iCloud - Article  Seemed like a blip on Apple System Status 
3/28/2016    MedStar Health Ransomware - Article Article Article  Not exactly Cloud outage, but noteworthy - trend?
3/18/2016    Verizon Network - Article Article   Southern California
3/17/2016 Telstra Network (AU) - Article Article AWS Impact  CEO Apology & another free data day
3/2/2016 Salesforce.com (Europe) - Article Article   EU2 Storage issue - details posted on Trust Status Page
2/25/2016 Ukraine Power Outage - Article Article Article  Industrial Controls Hack - Power Grid
 US Homeland Security Alert:  IR-ALERT-H-16-056-01
2/25/2016 Google Compute Engine - Article  Incident #16003 (w/ apology)
2/24/2016 XERO (Accounting SaaS) - Article Article Article  Chronology w/ apology
2/22/2016   Office 365 - Article Article  Europe
2/16/2016    Xbox Live - Article   
2/9/2016 Telstra Network - Article Article Article  Apology & Free Data
2/5/2016 MS Visual Studio Online - Article Article  Microsoft Explanation
2/4/2016 IRS.gov - Article Article  
2/4/2016 Apple iTunes, iCloud & App Store - Article Article  
2/2/2016 Virgin Australia (Optus) - Article  
2/2/2016 BT Broadband (UK) - Article  BT Apology
1/26/2016 Google Drive, Docs & friends - Article Article  
1/18/2016 Office 365 - Article Article  Multi-Day 
1/19/2016 Twitter - Article   Incident/Statement
1/14/2016  JetBlue - Article Article Article Article Article  Verizon's Fault
1/14/2016  Xbox Live - Article   Snoop Dogg madd at Bill Gates!
1/9/2016  Nest Smart Home Apps - Article   From status.nest.com:  "We’re experiencing a problem  with the Nest web and mobile apps and are investigating  the cause. We’ll have more details soon. Update: This  issue has been resolved 9 January 4:21 PST"
1/5/2016 Linode Security Incident - Article Article  Linode Incident Report
1/4/2016     Sony Play Station Network (PSN) - Article Article Article  Sony Apology & Voucher 
1/4/2016 HSBC Online Banking - Article Article Article Article  Apology

2015

 Date  Who/What/Where  Service Provider Comments
 

2015
in Review
Talking Cloud's 7 Biggest Cloud Outages of 2015

Another from ThousandEyes:  Top Internet Outages in 2015 

Interesting analysis of 2015 CSP downtime - based on https://cloudharmony.com/status

 
 I caught all 7 in 2015!

 6 out of 7 - I missed Tata outage in Feb 2015
12/18/2015 Microsoft Azure & Office 365 - Article  
12/08/2015 Google Cloud - Article Article  SnapChat!  OMG!  Incident 15065
12/03/2015 Microsoft Azure & Office 365 - Article Article Article Article Article  Europe.  Quite a bit of chatter in Azure Status History,  summarized in this Article
12/01/2015 Netgear Ready Cloud  Netgear Notice and Apology
11/30/2015   Google Cloud - Article Article Article Article  Europe.   Incident 15064
11/28/2015 Neiman Marcus - Article  Black Friday
11/28/2015   BestBuy (Cloud?) - Article  Black Friday in Canada?!
11/25/2015 Telecity (Again?!) Article   
11/24/2015   FedEx (Cloud?) - Article   
11/19/2015 Telecity (UK) Article Article Article 
Article Article
 
11/14/2015 Ebay - Article  Log Entry and Apology
11/08/2015 Angani (Kenya) - Article Article  Angani Explanation & Apology
10/30/2015 PayPal - Article Article  
10/26/2015   Google Container Engine - Article   Incident 15001
10/15/2015   Apple AppStore, iTunes, TV - Article  
10/15/2015 UltraDNS (Netflix+Uber+more)  Article Article Article Article  Nuestar Press Release 
10/11/2014   Southwest Airlines - Article Article  
10/09/2015 Google Docs went down Article Article Article  Notes in App Status Dashboard w/ Apology
9/24/2015 Facebook - Article Article Article  
9/21/2015     Skype - Article Article Article Article  Apology posted in Skype Heartbeat
9/20/2015 Amazon DynamoDB & Others - Article Article Article Article Article AWS Details and Apology
Sort of a "Take a Friend to Lunch" event - some examples:
- Wink (Home Automation) "Upstream Error"
Netflix, Reddit, Tinder and more
9/7/2015 Nest - Thermostats & Dropcams
 Article Article Article
Service Status Page 
8/26/2015 Google Cloud Storage - Article  Incident #16029
8/24/2015 C4L (UK) - Article Article Article  C4L Update & Apology
8/22/2015 Fujitsu - Article Article Article Another Power Outage
8/21/2015 Level 3 Communications - Article Article LA Power Outage
Upstream also affected - LogMeIn
8/14/2015 Google Compute Engine (Europe Lightning Strike) - Article Article Article Article Article  Incident #15056 - Power outage from "four successive lightning strikes"
8/12/2015 CloudFlare - Article  Incident Report on Cloudflarestatus.com
8/11/2015 Adobe Marketing Cloud - Article  
8/10/2015     Amazon AWS "Slowdown"
Article Article Article Article Article 

 Not listed as outage @ http://status.aws.amazon.com/.
 But ... many notes on services that were marked as 

Service is operating normally


e.g.
  [RESOLVED] Delayed Instance Status Check metrics in US-EAST-1
8/6/2015 Microsoft Office 365 - Article  
8/2/2015 Interesting Article - 10 Biggest Cloud Outages in 2015 (So Far)  Dang, I only caught 7 of 10 here!
7/21/2015 Apple Music, Store and more  - Article Article Article Article Article  
7/15/2015 MS Office 365 - Article Article Some vender comments in Community chatter 
7/8/2015 United Airlines - Article Article Article  Not exactly Cloud outage, but picked-up and noteworthy

United blames 'Glitch', sent apology letters 
7/8/2015 NYSE - Article Article Article Not exactly Cloud outage, but picked-up and noteworthy

NYSE blames 'Software Release', https://www.nyse.com/market-status/history
7/3/2015 MS Azure (Australia) - Article Article Article Check http://azure.microsoft.com/en-us/status/#history
7/1/2015 Axcelex + Friends - Article Article Article Another Route Leak!  This time taking Amazon WS along!
Apology from Axcelex
6/29/2015 Amazon WS - Article Take a friend to lunch - Netflix and others affected
6/24/2015 Verizon (phone, TV, net ...) - Article Article  
6/21/2015 Aliyun (Alibaba) - Article Article Article Cable Cut?
6/17/2015 Relevant article from Talking Cloud Article - 7 Worst Cloud Outages of 2015 (So Far) 6 of 7 here!  Yea!
6/17/2014 Google App Engine - Article Incident #15019
6/12/2015 Level 3 Communications - Article Article Article Article Take a bunch of friends to lunch!  
Large Tier 1 (http://maps.level3.com/) leaking routes? May 

Likely cause was Telecom Malasia (Apology), but very little from Level 3 who Twittered a picture(?!?) containing outage info @ twitter.com/Level3/status/609353696787496960/photo/1 
 
6/9/2015 EasyStreet Email - Article  Switch from gmail to office 365?
6/2/2015 Apple iCloud/iTunes - Article Article Article Article  
6/1/2015 Comcast - Article Article  $5 Credit! from COMCAST!
5/25/2015    Xbox Live - Article  Again
5/20/2015 Apple iCloud - Article Article  
4/25/2015 Starbucks POS - Article Noteworthy - Free Coffee!
4/17/2015 Bloomberg Trading - Article Article Noteworthy
4/8/2015 Microsoft Outlook - Article Article Incident Report
3/11/2015 Apple (Various Services) - Article Article Article Apology/Statement via CNBC
3/9/2015 AVG Cloud Services - Article  
3/10/2015 eNom (DNS) - Article Article  
3/5/2015 Google (various services) -
Article Article Article
Incident #15046
2/19/2015 Google Compute Engine - Article Article Article Incident #15045
2/16/2015 Xbox Live - Article Article  
2/16/2015 Amazon UK - Article Article Article  
1/27/2015 FaceBook - Article Article  Self-inflicted?  Side-effects?
1/21/2015 Xbox Live (Again?) - Article  Yeesh!
1/18/2015 Westpac - Article  Online Banking, kinda rare
1/14/2015 Xbox Live - Article Article  
1/10/2015 Verizon - Article Article Article Article Article Article Article  All in the Plan!  Excuses? No More

2014


  Date Who/What/Where Service Provider Comments, Notes ....

 2014
in Review


Top 10 Lists 2014 Outages:
CRN (slideshow):  10 Biggest Cloud Outages
 
12/19/2014Playstation - Article ArticleDDoS says PS Blog.  Offers 10% off!
Had to post (Lots-o Xbox Live outages)
12/22/2014Rackspace - Article DDoS - Details on Google+ (where nobody will ever look!)
12/11/2014Limestone Networks  Discussion Board chatter
12/1/2014Xbox Live - Article Article DDoS/hackers
11/26/2014Amazon CloudFront - Article Article DNS according to AWS Status page
11/19/2014Microsoft Azure - Article Article
Article +Xbox Live + VS Online
 MS Tweets,  MS VP Explains  
 Tech postmortem, but apparently late
11/12/2014DoubleClick - Article Article 
11/3/2014Comcast X1 - Article Article Apology - Making it Right
10/14/2014Google Drive - Article Article App Status
10/7/2014Gandi.net  Nice Explanation, Response/Apology
9/29/2014Apple iCloud - Article Article emailed Apology
9/6/2014Oracle CRM - Article 
9/5/2014Salesforce.com - Article 
8/25/2014 Mailbox - Article Tweet
8/18/2014 Microsoft Azure - Article Article Article Article Article 
8/14/2014Microsoft Visual Studio Online - Article Article   MS Explains
8/12/2014LastPass - Article Company Blog
7/2/2014Dimension Data (AUS) - Article 
6/24/2014Microsoft Office 365 - Article MS ExplainsApologyOffers Credits
6/23/2014 Microsoft Lync - Article Tweet!
6/20/2014Apple iCloud - Article  
6/17/2014CodeSpaces - Article Article Article Hacked out of Business (Archives)
6/4/2014Google Drive - Article Status Dashboard w/ Apology
5/28/2014Joyent - Article Article Article MortifiedPostmortem + apology
5/23/2014Rackspace Block Storage - Article May/June Incidents & apology
5/15/2014Adobe Creative Cloud - Article Article Article Article Article
Adobe Apologyanother via tweetCompensation? Not Security issue!
5/7/2014Microsoft Xbox - Article  
5/3/2014SAP Ariba Network - Article 
4/16/2014    Proofpoint (Security) Interesting DNS Issue
4/2/2014Apple iCloud (AU) - Article No incidents or indicators @ Apple?
4/2/2014 Ellie Mae Cloud Mortgage  Origination - Article Article CEO Apology & Update (Poss DDoS)
 Press Release - No Breach!
3/28/2014Egnyte (East Coast) - Article  3/12 Incident another 3/28 Incident 
3/26/2014++Western Digital My cloud
Week+ Outage - Article Article 
 Service Team Apology - on Special Support page
3/24/2014UK Parliament Issues - Article
NOT A CLOUD Problem
 // no specific outage, just interesting series of articles caught in alerts //
3/20/2014    Hootsuite DDoS - Article CEO Blog Post
3/17/2014Google:  Talk Hangouts & Sheets - Article Article Article Google Talk Service Details
 Google+ Hangouts Details
 Google Sheets Service Details
3/14/2014    Dropbox - Article  Hiccups reported on Twitter
3/11/2014Microsoft Xbox Live - Article  Game Credits to Affected users?
2/20/2014 Google Apps - Article Article Google Apology in Status Dashboard
1/24/2014Google Gmail - Article Article Google Status Dashboard
 Another VP of Eng Apology
1/10/2014Dropbox - Article, Article
Tabloid drama/opinions
 VP of Eng Apology ('not a Hack'!)
1/7/2014Amazon AWS East - Article Not 'Outage', only Snow or Fiber cut!
 No Blip on status.aws.amazon.com

2013


 Date Who/What/Where Service Provider Comments, Notes ....

2013

in Review


Top 10 Lists 2013 Outages:

Neverfail's Infograph
Another from DCK
 
12/09/2013+Yahoo Mail - ArticleMarissa's Apology on tumblr
11/25/2013Healthcare.gov - ArticleSee Healthcare.gov Blog entries
11/21/2013 Microsoft Azure, Office 365, Outlook.com - ArticleArticleMS Status Dashboards Chatter only?
Some Finger pointing (not good)
11/18/2013    YouTube - ArticleNo explanation(?) - Monkey Message 
11/15/2013
Salesforce.com - ArticleIncident on trust.salesforce.com
10/31/2013  Microsoft Azure FTP - ArticleAzure dashboard chatter 10/29-10/31
10/30/2013UK's G-Cloud Store - ArticleG-Cloud blogpost explanation
10/30/2013Microsoft Azure - ArticleAzure dashboard chatter 10/29-10/31
10/28/2013Healtcare.gov - ArticleVerizon Terremark - No Comment?
10/8/2013Apple iCloud/Store - ArticleNo Comment by Apple?
10/4/2013Comcast X1 - ArticleComcast Apology-o-matic on twitter
9/27/2013LeaseWebLeaseWeb Blog
9/23/2013Google Gmail & Docs - ArticleGoogle Apology Enterprise Blog Post
9/24/2013Microsoft Skydrive - ArticleIncident on status.live.com
9/13/2013Amazon AWS - ArticleSomewhere on status.aws.amazon.com
9/12/2013Phoenixnap - ArticleSome on info.phoenixnap.com
9/3/2013Intermedia Hosted Ex - ArticleCEO Apology
8/26/2013Amazon AWS - ArticleSomewhere on status.aws.amazon.com
8/14/2013Microsoft Outlook - ArticleMicrosoft Apology on status.live.com