▲ 186 points
back
107 comments
If you’re wondering if GitHub has been down more since the Microsoft acquisition, I actually just recently did some analysis on that using their status page data (the answer is yes):
https://nimbleindustries.io/2020/06/04/has-github-been-down-...
It's not surprising. I don't have any data to prove it but it feels like they're shipping improvements and new features at a much faster rate.
If you’re wondering if this^ website is hugged to death right now, I checked it on downforeveryoneorjustme.com at 11:08 UTC/04:08 PDT/07:08 EDT(the answer is also yes)
Where are they hosted? Could they be moving infrastructure?
Ironically, it seems your site is down? Hug of death?
Again? This is like the fourth time GitHub went down. Last time this happened was almost a week ago. [0]
Seriously, just consider self-hosting [1] rather than 'centralizing everything' [2]
[0] https://news.ycombinator.com/item?id=23604944
Or live with it and list GitHub downtimes as one of your business risks.
I set up a self hosted Gitlab where on-prem was a requirement and it's surprisingly easy. Obviously another service that needs to be maintained and updated but as code repositories and connected services are a crucial part of infrastructure it makes sense to have control over that.
Not the biggest fan of Gitlabs UI but I got used to it quickly.
I find it a bit surprising that it is still a headline, sure it is a huge service used by many. Though as you write its not the first time this year. But apparently still people use a single service as their 'origin'.
So many services rely on github that it has become a single point of failure for online infrastructure as we’ve come to know it. I remember seeing this shared many years ago [1] and not much seems to have changed in the interim. If anything the MS acquisition has only exacerbated matters.
[1] https://www.brandonsavage.net/github-your-single-point-of-fa...
If you let Github become a single point of failure, maybe you are using git wrong? It's named "Distributed version-control" for a reason. I can really recommend this talk by Linus Torvalds about how git is more of a way of working than a piece of software: https://www.youtube.com/watch?v=4XpnKHJAok8
I'm using git bug, so I don't care at all about some delays to sync my issues.
I'm not using GH actions, only Cirrus, Travis and Appveyor, which can be triggered manually if the API service is down also.
> Gitlab is written on Ruby on Rails; you should understand the security implications of Ruby on Rails before using Gitlab
Can someone ELI5 the security implications of Ruby on Rails?
Has anyone here tried self hosting Phabricator?
Some of our private repos are Mercurial so it would be nice to have both git and hg repos on a single platform.
Kallithea[0] has support for both. You might want to test it out and see if it's a good fit for your setup. I enjoyed working with it when when I used it.
Years ago, it was too complex for me. I recently switched to Gogs and I'm satisfied with that. But that's Git only.
Well, at least Microsoft hasn't had a Sidekick like event happen to GitHub. https://en.m.wikipedia.org/wiki/2009_Sidekick_data_loss
99.95% SLA means less than 66 minutes of downtime is acceptable per quarter. I guess they will be offering credits to enterprise customers this time for the first time.
Edit: Correct a mistake but the time calculated is correct.
99.95% that is.
Source: https://help.github.com/en/github/site-policy/github-enterpr...
Nice. I hope GitHub is down 67 minutes every quarter, just so that Microsoft loses some money.
C'mon microsoft GH is down it's becoming a weekly trend here on HN..
After Facebook bought Whatsapp it also started having outages at a scale never seen before. Whatsapp used to be a service that was practically never down, after the acquisitions it sometimes had outages of up to a day. Rumours were that it was related to features that FB wanted to add (e.g. video chat). Maybe there's something similar at play here, that Github integrates MSFT services without proper testing?
inb4 PR strategy
Sounds like a good time to run something like this https://github.com/clockfort/GitHub-Backup
Git itself is not the issue - the problem is Review Comments, Pull requests and issues.
Browsing through the status page makes me wonder how they manage to have issues like this so frequently. Are there publicly available post-mortems for previous incidents? From a first glance I can't find any on the status page.
Having an electronics engineering background, my personal pet theory is that the convoluted layers upon layers of automagic container management, load balancing and scaling mechanisms act like nested control loops in respect to each other and sudden load increases (e.g. Monday morning load spike) cause the system to essentially produce a step response and it starts overshooting/oscillating. Just a thought tough.
Earlier this year, they were blaming several of the outages on "the database". Not sure if that's still their scapegoat or if they've come up with a new one.
GitHub Pages seems to be up though. My website is still online.
I'm guessing the core functionality of Pages is quite isolated from the rest of the site since it's just serving static sites over a CDN.
In the OP you can see that GH pages are currently the only service that is not broken
It feels like this is happening a lot more(since quarantine) . It's really weird for how big this company is, how important, and have microsoft's backing. It is a little concerning given how much my work depends on its stability.
Its back up for me
Monday blues...
Unicorn!
I get the falling off a cliff.
It's back up for me now
Ag nee ouens !
+1 down in India
Looks like something went wrong!
Can we make this thread a sticky?
I hate Microsoft. I've seen a lot of unicorn lately.
The prophecy, it's starting...
We had issues producing the response to your request.
Sorry about that. Please try refreshing and contact us if the problem persists.
Contact Support — GitHub Status — @githubstatus
It drives me insane that they don’t localize the times on their status page, is there a real reason they are displayed as UTC? If you are looking at a status page chances are anxiety is already high, to throw time zone conversion into the mix too is just obnoxious.
works for me... loaded this file no problem: https://github.com/washingtonpost/data-police-shootings/blob...
First time I've ever seen it down, I guess there's a first for everything. Now I understand why many people are very paranoid when it comes to taking backups.
Is it worth backing up my GitHub repos somewhere else? What do other people use as an alternative source of truth for their code?