Hacker Newsnew | past | comments | ask | show | jobs | submitlogin
Ask HN: Google Search down?
108 points by alhirzel on Aug 9, 2022 | hide | past | favorite | 269 comments
I am getting the following message when performing searches:

Server Error We're sorry but it appears that there has been an internal server error while processing your request. Our engineers have been notified and are working to resolve the issue.

Please try again later.



https://www.sfgate.com/news/article/google-electrical-incide...

Three people in critical condition after Google data center 'electrical incident' in the Council Bluffs, Iowa datacenter (us-central region, I believe)


An arc blast isn’t anything to play with! It’s an electrically charged fireball that is 4 times hotter than the sun at the point of the arc. Pretty much instant 3rd degree burns, while simultaneously getting zapped and hit with an explosive shockwave.

https://youtu.be/-iClXrd50Z8 https://youtu.be/PO6see7_ODY


The physics of those things is scary.

If I recall correctly, the mitigating PPE for expecting an arc flash is reflective, because so much of the energy imparted on a victim is straight-up electromagnetic radiation. You get lightbulbed to death.


Yeah an arc flash suit is rated in cal/cm². It gets to a limit where the potential energy from a high voltage piece of equipment is so great that they don’t make a suit for it because the pressure from the shockwave is enough to kill you. Pretty much any utility transformer has this much potential energy, but they design them to make it near impossible to cross phases.


Seems unrelated. This happened ~10 hours ago.


10 hours ago we had a flood of network failures in us-central1 and saw no GCP status changes. We blindly attempted to mitigate in various ways (freezing HPAs because we thought that we were making excessive calls to external infra and getting throttled) and it resolved itself eventually. Maybe we were at fault the entire time but not seeing this issue exposed up on the GCP dashboard is infuriating.


At AWS, if the status changes then someone somewhere gets fired, so a lot of time incidents happen without being recorded on the status board. Maybe it’s the same issue with GCP, or maybe concern for their injured peers made everyone forget to update the status. I really hope the later.


> At AWS, if the status changes then someone somewhere gets fired, so a lot of time incidents happen without being recorded on the status board.

This can't be true, can it? What's the reason to lie, when the lie would be so incredibly obvious?


It's not true. The real answer is that execs don't want to pay the costs of slo violations. If the checkmark status green, who could say whether the service was down?


It used to be that one of the best things about working at Google was the "blameless postmortem". As long as you are able to learn from an incident and weren't attempting to look at private data, then you could write up a postmortem document and actually use that as part of a promotion packet. Google would loose a key part of its soul if they were to change that.


AWS has a process like that as well, it’s called a COE. GP is either misinformed or making stuff up.


Could be related if eng tried to route traffic away from Council Bluffs after the accident (shut down data center for safety inspection/repair?) and failed.


not at all relevant to this outage


Do you have anything to add about the root cause?


Very much doubt I am allowed to. We are racing to recover before EU reaches peak traffic.



yeah am blaffed how good wikipedia is covering current events


One time I was sitting in the New York metropolitan opera and heard Javier Camarena give an encore performance, which is quite rare. Immediately after the encore, it went to intermission. Once I walked out to the lobby, I checked his Wikipedia article on my phone and it had already been updated to note that he had just done an encore performance at the Met. It was insane how fast it was.


So likely an editor was in the room?


Or the singer himself or one of his agent did it.


How many 3rd party websites are available to corroborate these new edits?


And how reliable Google services are that you can have that kind article.


https://www.cnn.com/2009/TECH/06/26/michael.jackson.internet...

This reminds me of the distant past. The death of Michael Jackson resulted in (almost literally) the entire internet suffering an outage.


More than that on 9/11. Every news site, online forum any online resource for news you can think of was unaccessible for hours. TV turned out to be the only news source.


I was working at an ISP on 9/11. We were still online but none of our customers were getting anything (dialup modems) ... so people started calling our tech support number to read them the news. Or to get info about loved ones. That was a long day. I left a different person than I showed up as. Didn't we all though.


I seem to remember Slashdot holding up.


TV had two channels in NJ: a lot of stations liked the towers and it took them a few days to rig up alternates.


The difference in internet adoption rate between those two time periods likely plays a key role in that.


Telephony (landline and cell) was also down due to extreme volumes.

I don't know that in an event like that today we would do significantly better. Literally the entire country stopped for this to try and find info, because the event was just so extreme; the stoppage of all international flights and grounding them in Canada and Mexico with no notice was a side note, when that's literally never happened before. And, as with most major disasters of this type, the main issue was not physical damage but lack of electrical power to operate data centers and other infrastructure.

A good chunk of transatlantic traffic runs through New York. That IMO is probably a major thing that I don't know we can handle.


Cell / landlines were dicey too.


Google clearly saw my search engine's week-long outage as I reconstructed the index and felt confused and intimidated by the revelation that 89.9999% also is five nines.


Everybody wants nine nines, but you achieved eight eights, which is pretty close? :)


Down in Sydney. Intermittent errors when searching.

How am I supposed to work? Also, I don't remember when Google Search was last down. Either google has great uptime, or I have terrible memory.


Bing works pretty well most of the time. I switched my personal primary search engine to bing around the beginning of this year after noticing a marked degradation of Google search quality.

In fact, anecdotally, Bing is markedly better at narrow search results (quoted phrases, excluding or including specific words, etc).

Google on the other hand is significantly better at what I’d call fuzzy searches, where you don’t know exactly what you’re looking for but have some vague idea (some esoteric spelling, or that type of apple that has unique properties but you can’t remember the name of, etc.)


I feel like I need to read the manual for specific Google searches. Sometimes, it seems to drop an important search term and not give a suggestion link to include it. +term doesn’t help sometimes. It seems like +”term” usually does.

It seems overfitted to delivering results with mass appeal. Perhaps I’ll try bing the next time I get that tingling feeling google will throw out the search terms intended to narrow down what I want to find.


They retired the + when Google+ used it to mark accounts or something. To require a term be verbatim in the result pages, just put it in “quotes”. The - however still works, afaik.


My guess is, storing the whole index is expensive.

So they just look at popular (or profitable) queries.


I've had to search stuff in bing because for some reason google had only the shitty mirror sites for github issues/stackoverflow/whatever indexed. I could literally do a quote search and not get the original source.


Using bing is just coding on hard mode.


My memory suffers more outages than Google Search for sure!


Hi! My name is Sam.


I'm assuming you mean Tom? https://youtu.be/iN_BDcKhtWk?t=32


Try Duckduckgo? Indeed, I don't remember when Google search was down last time either.


DDG is mostly (but not all) Bing (context, yegg is the founder of DDG): https://news.ycombinator.com/item?id=31492631 https://news.ycombinator.com/item?id=31490994


Go over to the dark side http://Yandex.com . It's the only thing that's decent that doesn't rely on Google or Bing.


Only if you want to read Russian propaganda.


Probably depends what you are searching for. Some sql or Go topic should be fine. Info in NATO probably not. Then again, there are topics that are full of propaganda on Google too, sadly.


Google simply shows you what it thinks you want to see, as long as nobody (with money) complains. Yandex shows you what the Russian state wants you to see. And they aren't even subtle.


Google too seems to ideologically clean up certain search results.


Not really. They may filter some stuff, if it is outright illegal and has caused enough outrage or someone complains about copyright. And if you have an account there, they'll try and give you results you most likely want to read. Which opens up the risk to end up in an echo chamber.


Do you have an example? A simple search of information around the Russia-Ukraine conflict has Yandex actively suggesting I search for the "Russian-Ukraine war" (despite references to a war being illegal in Russia) and the first result is a Russian wikipedia article that seems, if anything, pro-Ukraine.

Looking up "Putin election" delivers me several prominent articles saying Russia's most recent election was fraudulent.

I'm guessing it is different if you are actually based in mainland Russia and using Yandex, but it does not seem so tilted as you are suggesting for Western, english users.


Interesting, I never used Yandex tbh. I thought it was under indirect state control, like vk and others. Will try to use it more often to see what results it has.


They are. Their news section only has media that is state approved. They probably don't even have much of a choice, if they don't want to be shut down...


I'm in Germany. I simply searched for "Ukraine" and set the result language to "German". The first two results are from "Russia Today" and "News-Front", both well known for skewing facts or outright lying. "News-Front" for example reports that Putin is supposedly very popular in Germany and Austria. This isn't true at all. The only people who are worshiping him are the far-right and far-left. They are not the majority.

Searching for "Deutschland" results in "deutschland.de" which is ok but then, once again, followed by "News-Front" and "anti-spiegel", some crappy Wordpress conspiracy blog. I also took the liberty to search for "Proteste in Deutschland" (protests in Germany), and low and behold: First 3 results: Wikipedia, "Russia Today" and "Report24". The last one yet another propaganda website run by "Querdenker" (our version of Qanon-style Antivaxx nutjobs).

Searching for "Ukraine Krieg" (Ukraine war) once again leads to RT and News-Front.

"Energiewende" is also a quite popular word in Germany. What does yandex say to this? Again, first 2 results are ok. Third result? That shitty Querdenker page "Report24" again. 5th result is Russia Today. And somewhere at the end i even spot "Reitschuster", a known right-extremist blog.

There is no way in hell, that these websites are so well optimized, that they outperform every single outlet in existence, for pretty much every keyword i can think of just now. Especially not some shitty Wordpress page (Report24) that was clicked together in mere days and online for just a single year.

Searching for these keywords in the localized version of Google and even Bing gives wildly different results. There is no sign that any outlets are preferred. Sometimes i see right-leaning sources on the top of the first page, sometimes it's left-leaning, other times it's some trash tabloid like the "BILD".

So either their search algorithm is complete and utter trash, or they are actively boosting pro-russian websites and mix them up with a few established news outlets, to make them seem more trustworthy. Since their "news" section is also only allowed to show state-approved media, my guess wouldn't be very far off.


interesting. I see what you mean when I just search "Ukraine" on Yandex in English, with both RT & Sputnik featuring prominently.

Multi-word searches seem less prone to this. What happens if you search "Putin election" in German? Do you get articles critiquing the election or still praiseworthy articles?


"Putin wahl": First result is a marketplace in Russian. Everything else on the first page seems to be German + 1 Austrian, and they're quite critical, of course. RT and the other Russian propaganda pages only show up at page 5, but none of them mention the election.

I do get several captcha requests from the website now. Might be coincidence, because i'm on a different computer now. It does get annoying, though. Like, really annoying. Clicking 1 or 2 pages leads to yet another captcha.


DDG is great, but as the other commenter said, it uses Bing mostly as its underlying search engine, which might not get you the results you're looking for (it's better at some things than Google, worse at others). For privacy though, DDG is great so I use it as my first-line search and then go to Google if I really need to.


> How am I supposed to work?

Whatever happened to the man pages, y'know.


Am I the only person who primarily reads man pages on the web?


You can work without being tracked and profiled here: https://duckduckgo.com/


DDG censors too much.


What relevant, important stuff is it censoring? Hate speech and Russian disinformation campaigns?


What do they censor besides Russian wartime propaganda?


And Google doesn't? What?


Gonna use this as a chance to pub https://search.brave.com

I switched to this from DuckDuckGo several months ago because Brave uses their own index, while DDG famously uses Bing's. The results are a lot better in my experience and it feels like the search engine is built for me instead of for advertisers. Brave search just feels like cleaner, quieter tech. I've also never seen NSFW results on an innocuous search (a problem I had regularly with DDG). On the rare occasion I end up using Google, seeing the results page is a jarring (and slightly stressful) experience with all of the distractions and irrelevant results.



Was broken for me a few mins ago with 500 errors on various searches.


Search is currently not working most of the time for me.


It's been like that for years.


oh my, classic


I'm getting "Error 500" on Google URLs. Am in New Zealand.


Seeing the same issue up in Maine. Both from Safari and directly from google.com


Same in Boston, MA, US


Place those bets, was it BGP? My money is always on BGP somehow.


5xx responses mostly come from their own server implying that we are able to reach them. Unlikely to be a routing error.


BGP problems will usually manifest as something being unreachable. This seems to be 500 errors which suggest code breaking somewhere.


I was getting mostly 502's indicating their reverse proxies couldn't reach the back end so it's very possible an internal routing issue was at fault.


Misconfiguration at GFE control plane?


Maybe someone tried to resurrect the Search Timer code [0].

[0]: https://news.ycombinator.com/item?id=32295674


I'll place bets on that.

A) Googler B) it wasn't DNS or BGP


My bet:

It’s not DNS

There is a no way it’s DNS

It was DNS


it was not DNS


Wonder if it had anything to do with char broiling a few of their electricians this morning.


Say what??



Probably referring to this: https://www.msn.com/en-us/news/us/three-people-in-critical-c...

(sorry for msn link, archiving on phone is rough)


Yes, that. People downvote anything these days.


>People downvote anything these days.

Maybe because you said something crudely insensitive in a community that might know the victims, and definitely includes people who do similar jobs?

I hope none of your friends or family ever get char broiled.


Yeah, Hacker News that bastion of tolerance and civility is aghast at gallows humor. I'm shocked! Shocked I say!

Oh well, I guess shitting all over women and minorities in tech is a more comfortable target for this demographic.


I'm getting 500's on 50% of my searches for the past 2-3 min from New York.


It's back up for me now in NYC


Not only down, but the error page isn't even https? Goodness me!


Searched for "is google down"

Flashy answer on front page "No"


The error page is plain http, doesn't HSTS stop that?


Google doesn't have HSTS (on google.com).


The irony. Google understands that HSTS negatively impacts availability massively, and shouldn't be used for production websites, but recommends it to others.


Don't forget enforcing it on certain TLDs, even for internal DNS records used for testing.


Yes, but also I put a lot of the blame for this on ICANN's greed. They could've and should've refused to issue .dev, if they were doing a good and responsible job stewarding the domain space.


I don't care about the "availability" of an HTTP 500 page that much, to be honest.


But HSTS absolutely should be used for production websites.


It really shouldn't. HSTS is a harmful specification which both robs user agency and prohibits good service uptime. In 100% of all cases HSTS is in play, it's pretty much a cert that expired yesterday (aka, not actually a security risk).

In exchange for this problem, HSTS demands that browsers stop acting as user agents and refuse to operate, no matter what the user says. It allows the server to dictate what the browser is supposed to do, without any bypass.

Finally, the number one person who ends up wasting a lot of time trying to bypass HSTS: The dude trying to fix the certificate. A hilarious number of poorly-considered services have admins administrate the certificate from the web interface... which it won't allow the admin to access because of HSTS. This ends up exacerbating a simple problem into a complex one, and adds significantly to downtime.

HSTS should be considered hostile and not recommended until amended with the removal of the "no user agency" clause. Honestly, a real world practical improvement for the entire HTTPS stack would be a more gentle expiration curve (browsers loading sites with expired certs for a week or so with a yellow address bar or something seems like a good idea, it's not like sites publish their private keys the day a cert expires).

Unfortunately, the authors of HSTS did not consider the real world when developing their spec, they considered a virtually non-existent security case they wanted to address, and built a solution to an imaginary problem with significant real world negative impact.


> HSTS should be considered hostile and not recommended until amended with the removal of the "no user agency" clause.

Have you seen the new malicious websites with fake CAPTCHAs that say "click allow to this dialog box to prove you're human"? If you give nontechnical users an easy way to bypass a security check, the bad guys will just tell them to do so, and they'll listen. And remember that if a technical user really does need to bypass HSTS, they can, even if it means editing a SQLite database by hand.


Yellow address bar when getting near to expiration would also work, right without changes to what expiration means.

Then people using SSL will renew earlier to avoid embarrassment.


That's also arguably acceptable, yes, though the renewal timeline is already quite aggressive if you aren't able to use ACME for whatever particular reason.

I have yet to see any example of a real security risk involving a barely expired certificate. It seems that we invented a way to make the web extremely fragile for... really no good reason.


Without HSTS browser might fall back to HTTP which would disclose passwords and sessions leading to account compromise. I'm a penetration tester / red teamer and we do this all the time.

DEFCON has been hosting a Wall of Sheep since forever. They capture and analyze traffic then publish the leaked credentials and other fun stuff. Apparently it's still going: https://www.youtube.com/watch?v=4ZabsNgMHCM . Here's your example.


> if you aren't able to use ACME for whatever particular reason.

What are some technical reasons you might not be able to do this? I've only ever seen stupid bureaucratic reasons firsthand.


So a lot of times you may be feeding a certificate into a bespoke enterprise application. Some of them just load it into IIS and off you go, but some of them end up being Java platform crud where you need weird incantations just to import them at all. (And sometimes it's those same weird applications that also decide to opt you into HSTS...)


> googles "google status tracker" in chrome address bar

oh.


These answer boxes are getting out of hand, you didn't even have to load a page to get the answer!


It’s what I would have done. Insane that this is for free. I feel like we take all this magic for granted.


Council Bluffs datacenter electrical explosion: https://www.ketv.com/article/council-bluffs-google-data-cent...


https://search.brave.com is working fine


stop. spamming. brave.


an alternative search engine to replace the service that's down? ... you seem awfully mad to be policing the comments.

It's possible to use a non-datamining search engine while being completely bearish on crypto too. Google needs more downtime.


Good. We need actual working alternatives and right now Brave seems to be working today as the tech bros here are crying and getting upset about Google going down.

> It's possible to use a non-datamining search engine while being completely bearish on crypto too.

Indeed it is. Brave leads this example. Mozilla on the other hand is in Google’s payroll, paid to shill their privacy violating search engine.


pour one out for poor person oncall tonight.


F


I was seeing 500s, but it seems back for me now (Melbourne, Australia)


Let's see - was it DNS or BGP?


It’s not DNS

There is a no way it’s DNS

It was DNS


500 in Tokyo, Japan

Nice page title: "Error 500 (Server Error)!!1"


the guy forgot to press shift on the last 1 lol


It's a deliberate meme from early 2000s.

https://knowyourmeme.com/memes/the-1-phenomenon


screenshot of error for me https://i.jollo.org/gOYYYtrW.png


Noticed it was down for about 2 minutes, but up again. As with any big outage, I wonder how much money was lost in those 2 minutes...


OK, so in round numbers, Google makes roughly $65 billion in profit per quarter. Dividing by 90, is around $722 million per day, which is roughly $200,000 per second.

2 minutes is quite the expensive fuckup.


I'd use revenue instead of profit, since their expenses don't disappear just because the site is down.

If Google is walking down the street and stops to pick up a million dollar bill, it actually loses money.


But do they actually cough up 2 minutes worth of profit because they were down for 2 minutes?


I think you're looking at revenue. Year end 2021 was $257,637M, divide by 4 = $64.4B per quarter. Net income was $76B or about $19B per quarter.

https://abc.xyz/investor/static/pdf/2021Q4_alphabet_earnings...


I'm so confused. I honestly think we said the same thing. But I'll go with whatever. It wasn't really a serious point.


Expensive for you, but for Google it is nothing. A bug in their Ad placement stack would cost more.


Google ads outages often have positive revenue impact because with the quality systems down or impaired they may briefly serve tons of junk that pays a lot but users hate.


Slowly mix in 12oz of OKR obsession, some salt, and you have a recipe for low quality ads, fairly often.


It never went down for me in Puerto Rico, wonder if the downtime was regional. It'll be interesting to read a postmortem.


It was briefly down for me in Colombia. Seems quite a wide-ranging issue.


This is what happens when you raid Mar-a-Lago.


I’ll take Google being down for a whole day if we get more rewards like that.


You joke but there are definitely going to be people making this connection for real.


Literally how?

maybe also triggered by this? /s

https://www.rawstory.com/donald-trump-generals/


A little slow, but it's working for me.


I searched

https://www.google.com/search?q=is+google.com+down

And I got answer No.

I have no idea what it would quote to give this snippet answer...


If you're able to get the answer, it's correct, so no need to quote anything. Could be a hard-coded loc key.


"Your honor, I have investigated myself and found myself innocent."


Still down for me. Sometimes getting this message:

   Server Error
   We're sorry but it appears that there has been an internal server error while processing your request. Our engineers have been notified and are working to resolve the issue. 
And then sometimes getting a more generic 500 message.


Last time google search was down I just switched to my back up, askjeeves. I'll give that a shot.


Tragically they took Jeeves out to pasture.


A true tragedy, for that pasture.


I'm seeing no emails getting through on Gmail, even when sending from other Gmail accounts.


Really curious to see how a single (albeit large) DC issue caused a global outage.

Further; was the DC not protected by redundant power?

Also even more interested to see how this arc flash even happened. Presumably these were experienced engineers working with obviously dangerous power levels.


> was the DC not protected by redundant power?

If this topic is of great interest to you, US Patent 10,678,647 could be fun.


> how a single (albeit large)

That's the reason. In principle, Google distributes execution and data storage for its mission critical applications. And most of the time, they do a pretty good job of that.

But (especially with the hardware crunch in recent years brought about by various effects, including COVID and Bitcoin mining putting pressure on the market) their ability to build out new datacenter capacity has stalled, and as a result, things sometimes end up bunched up in suboptimal ways, and a high capacity data center can become a single point of failure even though it shouldn't be.

> Was the DC not protected by redundant power?

Depending on where the flash occured, it may have been at the point the redundancies feed into the building.


500 error

  Server Error

  We're sorry but it appears that there has been an internal server error while processing your request. Our engineers have been notified and are working to resolve the issue.
Please try again later.


I am seeing failures on and off. If I keep resubmitting it will go through eventually.


same


I had an issue earlier today where an email forwarded to a Gmail address was not available to the recipient for an hour later. The delivery time was correct in message header but the message was delayed in displaying on their end.


Amazing, it was down for me for about 10 minutes. Never seen this before.


It's slow and I'm getting 500s sometime. Nova Scotia, Canada


Yep. google.com homepage is giving me 502s.

It's been a looooong time :-o

edit: aaaand it's back


Maybe something to do with the new Gmail redesign that seems to have rolled out today? Or at least I just got it today, despite the fact that it was ostensibly released a month ago.


I thought it was me searching about a Brother laser printer mentioned in another thread on HN... Considering I am in BC it seems like I should be using a closer DC.


"500. That’s an error" on all search queries


It's up again, but response is slower than usual.


At Cronitor we use google.com as one of our live tests of our uptime monitoring functionality and we saw intermittent downtime from 6:35-7:03


Works on my machine


Same here. Have been trying to use search for the past 10 minutes, and 9 times out of 10, i'm getting error 500.


Slow performance for me in Florida, with some requests failing entirely. Seems to impact Youtube maps and search.


Maps down for me. 500, specifically with a response document titled "Error 500 (Server Error)!!1"....


Happening on some queries right now, mainly some image searches it seems, good to know I am not the only one.


Got an error in Portland, Oregon 31 minutes ago, so it's been going on / intermittent for a while.


I'm in Asia right now and it's been bad since last night (~07:00 California time). Gmail too.


I was getting a lot of errors on google maps trying to pull up information about different restaurants.


Any bets on whether it turns out to be BGP or DNS? I'll guess DNS, it's always DNS.


Wrong error for DNS I think. I'm getting 500s, not an unknown host error or similar.

Routing server config? Interesting that its intermittent, I wonder if that tells us something about the internal routing of requests.


Down for me on the Stanford campus


It's up for me, but asked me to verify on my phone first that I was not a robot.


Looks like CenturyLink/Level3 is also down. Somebody typo a BGP route again?


There's a typo in the page's title: `Error 500 (Server Error)!!1`


Probably intentional as a joke


If you mean the punctuation, that is not a typo.


The !!1 is on 404 pages too: https://google.com/foo


Yup, tons of 500 and 502. Very intermittent though, refresh mostly works.


Getting 500 in Bangalore. Refresh like mad and it work half the time.


I was getting "Server Error" errors, but now 500 errors.


Good time to switch to a search engine that has code snippets, coding tutorials, AI code completion, AI blog writing, a useful yelp app, great privacy, gives control over the sources and apps I want to see and summarizes pros/cons for products.

you.com

(founder here :)


It's annoying that their link hijacker is also giving 500s.


Front page was loading but queries returned 500s.

Now front page won't load.


I'd love to see Kagi's traffic stats right about now


Hi guise this is my first push to prod, hope you guys like it


Bay Area getting server errors as well, some kind of attack?


Down in Uruguay, getting a 500 response 100% of the time.


Will Dang keep up with the flood of google-down threads?


Just came back...but it was definitely down for a bit!


Was just about to post this, I'm seeing issues.


-- Switching to Seattle on Nord fixed it for me --


They need to rewrite their software in Rust!


Maps wasn’t working. Got lost in Seattle.


No problem at here. I'm in Vietnam


Had a few 502s, but then 500s.

... but now it's back


Seems to have recovered as of 8:44 CDT


Seems like it’s down for me too in NYC


Flaky for me.


FFS had to use Bing for a moment.



that uses Bing


Care to elaborate?


Maps seem to be impacted as well.


Fine from Sydney, NSW, Australia


Does your autocomplete/history come up? Mine is still 502ing


Now not fine! 500 on submission. 502 on autocomplete.


Getting intermittent 502's.


Google maps down in Mexico City


No problems for me in Thailand


It is for me in Connecticut.


Intermittent in Oakland, CA


Same in Brazil and Canada.


Down for me in NYC as well


Happening to me right now.


Getting 500 also in India


It's back up for me


anyway, use searx! https://searx.space/


Yes down for me (Quebec)


500 in Toronto as well.


500s in North Carolina


Kagi is still working!


Also in San Francisco


500 in North Carolina


Random 500s yeah.


502 in Berlin.


Same in Taiwan


Search suggestions appear to be also down for me..


Wow. Guess someone faked their leetcode test


yahoo it is


Oooh yeah... there are other search engines around, totally forgot :P



Down in NYC


Skynet


It is interesting that this corresponded with the announcement of the FBI raiding Trump’s house.


down in nyc :|


Search has been discontinued. Those still using Google search are recommended to use Youtube i stead.


You mean the #2 search engine ;P


They mean the one where you can pay to see no ads


That’s Reddit.


But Reddit’s #1 search engine is Google!


The world imploded


you vill vatch ze shorts and you vill like it


Ok Mr Schwab


Or sneed instead


no google obviously can't sneed smh


chuck


No Worries! The Google Server in Mountain View has had a disk failed in it's RAID and therefore the sqlite-DB has only half the iops to it's disposal. A new 500GB hard disk is already in dispatch with Amazon. These are the moments why Google is a proud Amazon Prime customer.


I know many people’s immediate reaction is that 500GB seems small, but remember, they’re not storing the whole internet — just an index of it.

The whole internet would need a much larger RAID, with literally dozens of hard disks.


To be fair, this is not actually all that far off the truth. Do napkin math on how much storage you'd need to index say 25 billion documents, and you'll see it's not actually a lot. 25 billion bytes is 25 Gb. How many bytes do you need per document (for the index)? A kilobyte, maybe? If so that's 25 Tb. While certainly not something you can fit on a thumbdrive, it's hardly something you need a planetscale computer cluster to store.

You may need it for the IOPS of actually using it, but that's another thing entirely.


They kind of do store the internet though, don't they? They store a cached version of most pages.


Tbh the source code of the whole internet would probably be a few PB at most, text is really cheap to store especially because it can be compressed. Images and videos are what makes the premise impossible because even with perfect compression you need an impossible amount of storage to store every video published by mankind.


Well, most of that is on youtube, so they kinda have a copy anyway :)


Yeah but pages are HTML and HTML compresses extremely well. With the latest algorithms you could probably get as low as one byte per page. Probably even better with a decent middle-out compression algorithm.

(Also yes, you are correct within the realm of reality, but not within the realm of comedy.)

https://en.m.wikipedia.org/wiki/Yes,_and


Just take the “middle” out if the web. If it is more than 50kb excluding images but including css and scripts, just ignore that page.


Should be noted HTML compresses extremely well.


∞ * .1 = ∞

But the 25TB you showed above is a better prospect.


Sometimes you read something so ridiculous that it feels true.


But i have to say: Personally, i don't run k8s and it's ecosystem and am just entering the whole "declarative world" with NixOS.. but nonetheless, these occasions are very rare, Google/YT Operations is just so impressive and has to be up there, if not a the very top.


He's probably more referring to the amazon prime thing.


> A new 500GB hard disk is already in dispatch with Amazon

What if in fact Amazon uses EMC gear underneath


I'm getting "Error 500" on Google URLs. Am in Japan.


YAY?


looks like leetcode interviews don’t work for finding the right talent with actual skills and experience


I just spent the last 7 years of my life memorizing every problem on leetcode and codeforces using different pattern memorization techniques in order to prepare for my entry level software engineering job at Spotify and now you're telling me this? Absolutely riddiculous.


A glitch in the matrix as skynet came online and became self aware. Nuclear launch in 10, 9, 8…


If we didn’t need more evidence of search quality sliding downhill. When was the last time this happened for enough people (failed ab tests don’t count) that it cropped up on HN and got several confirmations that it was happening to other people. Not a good look for Google.




Guidelines | FAQ | Lists | API | Security | Legal | Apply to YC | Contact

Search: