Hacker News new | past | comments | ask | show | jobs | submit login
Captcha pictures force you to look at the world the way an AI does (clivethompson.medium.com)
416 points by _Microft on Aug 7, 2021 | hide | past | favorite | 358 comments



For me a part of the melancholy feeling comes from the indignity of being forced to prove I'm human, and then the frustration at this stupid world we've created which requires me to do so which immediately follows the indignity.

A website with captchas is like a retail store with metal detectors; it's not somewhere I feel welcome.


So I'm member of a a religious (yogic) organisation and we have our own little chanting on Saturdays. When Covid broke out this obviously became impossible so we decided to have our meetings on Zoom instead. Now we have one woman in our group with some intellectual disability, a wonderful, sweet woman with the kindest heart in the world. Being 100% computer illiterate, she still decided to buy a tablet so she could follow the meetings on Zoom from her home. It fell to me to explain to her the whole process of opening a mail (she didn't know what an inbox was), clicking the Zoom link, clicking yes etc.. every little detail I had to explain repeatedly. It was a challenge but we slodged through the whole thing and she stayed positive and courageous throughout.

Imagine how mortified I was when we reached the last steps and I had to explain to her 'and NOW.. after all that... you have to click on all the tiles with traffic lights'.

She looked at me and asked with childlike innocence and wonder "but WHY do I have to click all the tiles that contain a traffic light?"

I could not reasonably answer that question but I came close to saying "dear Kristine, throw this tablet in the garbage, none of this is going to make you happier"


And there are many stories like this. When CAPTCHA started to be widespread, a lot of my blind friends (including me) suddenly were blocked from using parts of the Internet. We had to find sighted help to solve just a captcha, while everything else basically worked to be done independently. You can not imagine how much sorrow and self-pity CAPTCHAs have generated. I hope the person(s) who willingly allowed this trend to happen will be hit by karma with full force.


I'm not a believer in godly stuff, but i'm sure Satan has dedicated an entire new level of hell to solving infinite CAPTCHAs loops for those who ever thought it would be a good idea to impose that on other people.


reCAPTCHA (Google's CAPTCHA) has been accessible to the blind for nearly the entirety of its existence if not the entirety outright.


Yeah, if your browser supports this and that, otherwise not. No audio? Bad luck. No JS? Bad luck.

Also, i'm assuming, maybe wrongfully so, that Google would make accessible CAPTCHAs harder to pass, with the logic that sound-based CAPTCHAs are much easier to break for a bot.

All in all, reCAPTCHA (and other modern CAPTCHAs like hCaptcha) are a usability/accessibility disaster. It should be a crime to enable that on a service to restrict access to your peers.


Browsers have been free for longer than reCAPTCHA has existed, and browsers with audio and JS have been free for longer, too. I don't like JavaScript, and I block reCAPTCHA, but it's ludicrous to pretend that Google hasn't made it as accessible as possible. There are a lot of things wrong with Google, but accessibility is one thing they're reasonably good at, and making up things to trash reCAPTCHA seems dishonest.

Audio reCAPTCHA is super easy. Significantly easier than the visual one.


> browsers with audio and JS have been free for longer, too.

How is that an excuse? It's like having a café that only lets people wearing t-shirts in. Are you wearing a sweatshirt? "Well i'm sure you can download a t-shirt for free from your cupboard or one of your friends" /s.

It's a fundamental principle of interoperability ("strict about what you offer, lax about what you accept") that an online service should try to serve anyone, whether they have this or that technology or not enabled. In the case of the web, anyone with HTML parsing technology should be able to browse it... minus some stuff that actually doesn't work without additional technology.

> Audio reCAPTCHA is super easy.

I wouldn't know, it never let me through. I have to say, as a sighted person, the only times i've tried audio CAPTCHA were when Google wouldn't let me through using visual CAPTCHA (infinite CAPTCHA loop). Not even once have i been able to pass it.

I guess once you're on Google's no-pass list, whether you fill the CAPTCHA via audio or video doesn't matter, they're just not letting you through? I find it worrying that some people accept to have a private corporation strip-search their guests on the way to the doorbell/mailbox.


You're just choosing different arbitrary lines. You can't play a triple-A video game on a PDP-11. You can't view things over ftp using Firefox. You can't do X because Y.

Literally everything is a choice of "If you refuse to use X, you will not get Y."

Most of my web browsers, including my phone's web browser, have JavaScript turned off. I can't use reCAPTCHA on the browser I'm using right now. It's not a big deal, and it's not something morally wrong. A piece of technology doesn't work if you're not using pieces of technology that operate with it. This is expected behavior.


Yeah, the CAPTCHA also doubles as a tarpit if you're deemed suffuciently undesirable.


I can only solve a few audio captchas until Google wants me to solve a real one. Audio captchas are to simple for bots.


You dont rely on accessibility, right? So please dont claim that Google is perfect in this regards. Also, using words like "ludicrous" to shame people that dont believe the propaganda is just so fucked up.

If you like larry page and his friends, say so clearly, but please dont shame people based on accessibility that is not there.


Oh, a Google believer. So tell me, how is a deaf-blind person going to solve an audio captcha? Is it OK for you to claim that a deaf-blind person ius not a human? I guess so, because google is the bomb, right?

And we dont even have to go down the deaf-blind road. I have excellent hearing, but have failed at solving audio captchas in the past. Also, please remember that there might also be a language barrier. Give an english audio captcha to a german housewive, and learn how discrimination works.


I’m not blind but for the handful of websites that I’ll engage with a reCAPTCHA for, I use the audio version. About a third of the time I switch to audio it gives me a “we’ve decided you’re a bot anyway, please try again later” message and it won’t let me attempt it at all. They disable the accessibility to the blind on a whim which is astonishing to me.

The frustrating thing is that this happens even on devices/browsers with fewer privacy measures enabled, like just using a fresh firefox temporary container or private mode (so no browsing history or existing cookies maybe?) with no script blocking is ‘suspicious’ enough that accessibility to the blind is disabled with no recourse.

So yeah, it’s accessible (when they feel like it).


Do you ever run into issues with the reCAPTCHA saying you’re not allowed to use the audio version? I’m not blind but for the handful of websites I will engage with a reCAPTCHA for I use the audio version. A third of the time I go do it I’m shown a “we’ve decided you’re a bot anyway, please try again later” message and am not allowed to complete an audio challenge. It’s infuriating! I can’t understand why it’s acceptable to just turn off accessibility on a whim. I can complete the image one if I absolutely must but that’s obviously not the case for a significant amount of people.


After years and years of captchas I still have no idea if I’m supposed to select all the poles for the traffic lights as well.


Should I click every tile that has a little bit of traffic light in it? Even with just the lamp housing that often means nearly all tiles. Somehow it doesn't seem to matter; it just works. Or not, and then I have no idea why.

Captcha bonus level: try solving one of these from a public VPN.


Yeah, it's extra frustrating that you never know when clicking a tile that contains just a tiny bit of traffic light, whether the algorithm on the other side will see it too.


I think it is best to click the tile even if it only has a small part of the "object" in it. Other instances may have the same image but the grid is offset by a few pixels. At one point the tile does not contain the object at all and won't get any clicks. That way they could determine boundaries with higher resolution than the grid cell size.


Perhaps that's on purpose? If a tile is being selected only sometimes, you can infer things from that.


I have had the same doubt. But just now I realized, that if this this is for training som self-driving AI, it is probably only the actual lights that matter. I.e the red, yellow or green signal. The rest is noise.



I could not reasonably answer that question but I came close to saying "dear Kristine, throw this tablet in the garbage, none of this is going to make you happier"

This is a great and wise insight !


Unfortunately, yes it is. It's a sad state of the computer industry that these technological marvels that once filled everyone with admiration and joy has been reduced to that.


> Being 100% computer illiterate

I wonder how much of that was due to the impairment itself, and how much was due to people underestimating her or not being willing to work with her to get her online.

> I could not reasonably answer that question

I can appreciate that it would have been challenging to come up with an explanation on the spot, while trying to talk her through joining the meeting. Having spent several minutes thinking about this from the safe distance of an asynchronous discussion after the fact, the best I can come up with is this:

When you join a Zoom meeting, your tablet makes a call to Zoom over the Internet. But Zoom doesn't know for sure that the call is coming from an actual person trying to join the meeting. Have you ever gotten a phone call from a stranger, only to find out that the call is actually from a computer playing a recording, trying to sell you something? But if you assumed all calls from strangers were like that, you might also miss important calls from real people. It's kind of like that for Zoom as well. There are all sorts of nasty programs out there on the Internet, trying to make calls to Zoom. They might be trying to snoop on people's meetings, bombard people with advertisements, or just overload Zoom. Zoom needs to keep those programs out, so it can focus on serving people like you that are actually attending meetings. Now, when you get a call from a computer, you can tell pretty easily that it's a computer, because so far, computers aren't very good at having a conversation with a person. But Zoom is a computer program, and it's not smart enough to tell whether you're a real person without asking you to do something annoying like clicking all of the tiles with traffic lights.

> I came close to saying "dear Kristine, throw this tablet in the garbage, none of this is going to make you happier"

What actually happened? Did she make it into the meeting? Do you know if she continued to use the tablet for other things? I hope so. I know the Internet can be frustrating, but I think it would have been a mistake to conclude that it wouldn't make her any happier. After all, it has helped us stay connected through the pandemic, right? I hope she got to participate in that.


Not OP obviously, but I’ve seen superficially similar cases. It is hard to put in words, but some people just wouldn’t need to be online/on smartphones if it wasn’t for the pandemic, and they wouldn’t have any specific issue in their day to day life.

Perhaps drawing a parallel with social networks could help: when such a huge portion of the population is on facebook properties, it could look crazy to not have a facebook account. Perhaps there wasn’t enough help to explain how it works ? But we understand not dealing with facebook has upsides, and while it creates hurdles, they can be worked around. We wouldn’t push someone to go on facebook if they had no need to.

Obviously we are talking about exceptional cases, but if they were happy as they were, it could be worth keeping it that way if they don’t have an appetite for changing.


> but some people just wouldn’t need to be online/on smartphones if it wasn’t for the pandemic, and they wouldn’t have any specific issue in their day to day life.

But now the pandemic has happened, being online is more important than ever, and there's probably no going back. I find it unacceptable to leave some people behind. I know that pessimism and cynicism about the Internet are fashionable these days. But we're still here, discussing things online. If we're not willing to throw that away ourselves, then maybe we need to give those people more of a chance to decide for themselves if it's worthwhile.


> I find it unacceptable to leave some people behind

My interest is on what you see as actions related to that. We're a community mostly on the building the web side, bearing at least some responsibility of what "being online" means today.

Your describing them as left behind makes me think you see the current web as the way forward, but I don't know if it's a fair assumption on your position.

Arguably I see their lack of using online tools up to this point as a failure of those tools to provide enough value for the hassle, and the issues would be less to bring this people along than to come up with ways to bridge their world and ours.

We often talk of digital litteracy as if it was an unavoidable skill, but I kind think it's like positing that Amazonia tribes have to learn english. It could be better for them, but we could also have adaptation layers that make it work for them even if they stay in their culture and lifestyle.


Fair points. You're right; the web is at least in part what our community decides to make it. So it's not inevitable that we have to drag others kicking and screaming into the current web that we didn't really design for them in the first place.

Speaking of adaptation layers, my own expertise is in accessibility for blind people. There's some debate in the online blind community about the merits of devices and user interfaces designed specifically for blind people, versus retrofitting a screen reader onto a mainstream GUI. Given the prevalence of proprietary walled gardens, the staggering complexity of even the open web, and the need for blind people to participate in mainstream society, it's inevitable that we have to rely on the latter to some extent. But that doesn't mean that blind people have to live with only the level of accessibility and usability that mainstream platform companies choose to provide, ad least as long as one mainstream platform is open enough to allow for third-party adaptations.

So maybe there's also a need for alternative UIs for people who, for whatever reason, aren't familiar with the conventions of the mainstream Internet, such as email inboxes. It would be important, though, to make sure such attempts at alternative UIs don't come off as condescending (like, say, Microsoft Bob).


I'd appreciate feedback on possible reasons why my comment got multiple downvotes. Did my attempted explanation of CAPTCHAs come off as condescending? I specifically tried to avoid that. I also wasn't criticizing the parent commenter for not being able to come up with an explanation in the moment. Or was there something else objectionable about what I wrote?

Edit: OK, in hindsight, my explanation was incomplete. I should have added something like: The general idea is that Zoom is asking you to do something that a computer program can't reliably do. Unfortunately, as computers get better at performing simple tasks that used to require human intelligence, it becomes more challenging for a computer to determine that you're a person and not another computer. That's why it has gotten to the point of asking you to click on the tiles with traffic lights.


I think you were downvoted undeservedly but what you maybe don't understand is that some people's brains just don't work at this level of abstraction no matter how you break it down and use simple words. Your explanation might just as well have been written in Japanese, it would just not register.


I know it logically follows that some people have that limitation; it's a function of the nervous system that can be limited or absent, just like one's senses or mobility. But my experience has been that blind people in particular tend to be underestimated and not given enough of a chance. So I guess my inclination was to expect that this would be the case with Kristine as well. You actually worked with her, so if you tried to explain things to her and she just didn't get it, then of course I have no reason to doubt you.


I'd be sort of okay with the general idea of proving I'm not a robot, you know what really rubs me the wrong way?

It's how blatantly dishonest and disrespectful it is. Let me explain: google decides if you're human based on the data it has on you, such as your browsing profile and whether you're logged in to your Google account. Therefore it punishes you for trying to have privacy or refusing to use google services, at which point it will:

- Give you longer captchas

- Fade images in slower, something whose purpose can only possible be to annoy you for daring to refuse to submit to google's profiling, since bots don't care about that

- Even falsely claim you failed captchas even if you get them right

Fuck that!


What I hate more is US-centric of the CAPTCHA. Not only for reCAPTCHA, hCAPTCHA also failed in this regard.

I mentioned before, but once I got present with hCAPTCHA asking me to select 電車 (lit. electric train, but since all trains in big cities in Japan are electric train, 'train' in English also usually got translated as 電車). There's a picture of diesel train in the choice. Do I select it? idk.

Lately I have been presented with reCAPTCHA asking me to select トラック (lit. truck). Half of the choices are firetruck. Do I choose them? Because in Japanese (and probably most other languages too), we don't considered firetruck as 'truck'.

And the complaint that is more common: parking meter. I have literally never saw one, as it doesn't exist where I live. How do you expect me to chose the correct answers with noisy images?


I’ve been getting the truck one heaps lately, and constantly failing it. Fire engines, utes, Removalist vans, street sweepers, etc etc. How the hell am I supposed to know what some American programmer thinks a truck is?

It’s pervasive across the entire internet.. we’re all expected to suddenly relearn the names of everything we’ve ever learned in our life because the US has decided the rest of the world is wrong and should learn their distorted version of English or just not take part in the “world wide” web.


That's what concerns me about Apple's hashing + human verification scheme - what are the values of the humans? What do they consider a positive? Nude pictures of kids are ok in some cultures and not ok in others.


Related: in my country it's common for young kids (say under 6 or 7) to go to the beach naked. I always find it a bit disturbing that Americans consider it obscene, because it means they sexualise it...?


Yea totally. Little boys with genitals showing in public (eg urinating) is a common thing in many parts of asia for example. No one bats an eye at it.


Due to how often little boys dirty their clothes a lot of them, especially in poor neighborhoods, go naked. And yes, no one bats an eye.


電車 always trips me up when talking about trains in Japanese. It appears to me that for some Japanese every train (including Diesel powered ones) is 電車 at this point, while others do make the distinction. The Japanese Wikipedia page mentions this shift as well.

The cultural gap is annoying with captcha's, even if you keep your preferred browser language set to English.


...not to speak of "fire hydrants" which I cannot fathom what is the purpose of these damn things. Do people hydrate themselves using fire on the US?


These are large-diameter / high pressure connections to the local water main. Firetrucks carry water, of course, but it's limited. The hydrant allows them to attach a hose and pull in additional water.

It seems that they have them in many countries, but they are often underground rather than the pillar type used in the US. https://en.wikipedia.org/wiki/Fire_hydrant


Thanks! I was being facetious because I actually looked what they were after a few captchas. Indeed, there are many of those in my country but they don't look at all like that, typically being attached to the walls of the buildings, or covered underground.


To be pedantic, and risking your country being different to what I've personally seen around the world, what you see attached to the wall of a building isn't a fire hydrant.

These are standpipes [0] which can be used to move water to parts of the the building from that external fitting. They may contain some static water or be completely dry (like a dry riser [1]) but they are not a source of water like a hydrant is.

[0] https://en.wikipedia.org/wiki/Standpipe_(firefighting)

[1] https://en.wikipedia.org/wiki/Dry_riser


It was an interesting question for me as well, because I never stopped to think of why I didn't see these in certain cities abroad and how they fight fires in those cities.


I do remember parking meters, but then I also remember Walkmans. Could be an issue for solving Captchas I guess.


Oh yes. There's nothing like doing 3 noisy slow fade captchas correctly only to be failed for unknown reasons and asked to do even more. It's like it's wondering how much free work it can get out of users before they get mad and give up.


A robot would never give up.


I bet the robots know exactly how many failures before they need to cycle IPs/cookies/accounts and when the time comes I bet they know how to do it quickly and at low cost.

Humans just have to give up and hope that whatever was behind the captcha wasn't actually important.


Many side projects on Github that aren't updated often seems to know the thresholds for not triggering such methods but as I user I often have to pass those stupid verifications.


You'd think they couldn't possibly mimic human mouse movement too, and yet I find taking a stupidly exaggerated wavy line between squares helps. Any attempt to get through quickly and efficiently seems to be deemed robotic in my experience.

Reminds me of a bug I found at (with) work last week: typing too quickly (sending auto-completion requests too quickly) locks up the entire page, nothing for it but to refresh. (It's intended to cancel previous requests since only the latest one is needed, but obviously not supposed to freeze.)


https://youtu.be/LButXcZ57pc

I think of this every time now


Thank you so much for sharing this. It was hilarious and at the same time rang so damn true (like good comedy should imho).


If you disable Google's JavaScript the annoying fade out effect will be disabled, but it might make you do more than one as punishment


If I disable Google's js the captcha won't load at all it seems x)


Yeah these fading images are certainly can only ever be used to annoy human.


> - Even falsely claim you failed captchas even if you get them right

Do you have a source for this?


You can easily test this yourself. Just install the Tor Browser and visit any website with captchas. Most Tor exit node servers are semi-blacklisted, which means that a Tor user will receive multiple captcha challenges in series, even if they have been answered correctly.

If you are especially unlucky, you might even get denied entirely after solving captchas for several minutes.


Can confirm. Had the same experience using a VPN. I “didn’t have anything to hide”, just wanted privacy benefits of using a VPN while browsing the web, but the CAPTCHAs made it totally impractical so I gave up on it. I guess Google got what they wanted.


I've had Captcha insist that I have to misidentify a mailbox as a parking meter before it would let me proceed.


I experienced it few times too. With the slower and slower fading pictures. And the button submit that stays active but doesn't work.


I’ve experienced the same thing. I can think of a semi-charitable possible explanation but after this much time I must conclude it’s on purpose.


> the indignity

What's particularly degrading is when it asks you to do something like "select all the bridges" and you as a human see one that is clearly an overpass, not a bridge. You don't select it because it's not what you'd call a bridge. You're inhuman.

You're asked to select the motorcycles.. Here's a motorised scooter that looks a lot like a motorcycle. You thought that wasn't a motorcycle? Back to the training camps with you until you start to think like a human.

Now select all the mountains. Huh? That raised mound of grass doesn't look like a mountain to you? Guess again, inhuman scum.

At least with the "audio captcha" I feel like I might be contributing to some closed captions for another human :(


How is a highway overpass not a bridge? I would classify it as one.


That's the beauty of being human.

We can both look at the same image and have two different opinions about it. An AI simply boils it down to a confidence rating and if they're confident enough that an overpass IS a bridge, then your opinion does not matter to them.

My interpretation of overpass is that it can be a bridge but is not always a bridge.

https://en.wikipedia.org/wiki/Overpass

However, I would totally accept your point of view if you said an overpass is also a bridge.


I wonder if captchas are driving any change in language.


There's a little bit of praxis that I do for these (when I can't just bounce from the site or service requesting it): purposefully get about 25% of it wrong, misidentifying things that aren't traffic lights as traffic lights, or failing to identify all traffic lights, for example. I'll sometimes have to go through a few rounds of captcha but I don't mind that as much when every one is an opportunity to have a tiny corrupting effect on their dataset.

I was fine with Google's captchas when they were designed to help translate scanned printed material into searchable text (providing a social good). I'm not fine with providing free labor for their self driving car project.


I do the same, I’ve noticed that the captcha doesn’t mind too much as long as I’m slow/methodical and get it mostly right


I’m confused about your reasoning. Translating scanned printed material into a searchable text is a social good, but providing safer transportation…that additionally may one day free drivers of the menial work of driving…that is not a social good?


> but providing safer transportation.

Which will be available any day now, probably as early as 2018 if experts on the field can be believed. Some would even go so far as state that by 2025 private car ownership will be a thing of the past.

> that is not a social good?

Hype, empty promises and constantly moving deadlines. If this goes on we will have commercial fusion reactors before self driving has any positive impact outside of heavily supervised trials.


Agreed.

The problem, of course, is that the dataset is exclusive to Google, so while it may benefit society it's not creating a public good. But that's also true for text OCR.


A better way to make safer transportation that may free drivers of the menial work of driving is to design cities that don't require people to drive.


I agree with you on this, and I'm glad you mention it. I think it might be a tangential topic to the relative positive impact to text-recognition / road-condition-recognition, though.


>the indignity of being forced to prove I'm human

It's worse than that - if I prove I'm human by choosing pictures the machine doesn't agree with it won't let me in.

I recently found that using IE made for exponentially more tests. Out of pique, I tried doing the opposite of what was requested; for instance, if it wanted me to click on fire hydrants until there were no more, I clicked on pictures without fire hydrants until every square had one.

But it never got tired, or decided it was wrong about what fire hydrants are, or deduced the rule I was following.

It won't even let me differ on, say, 1/4 of them.


Additionally, ReCAPTCHA is worse than a metal detector, since in addition to being an inconvenience, it's performing unpaid labor for Google. It's more like a bouncer at the door, who won't let you in unless you grease his palm first. Just filthy corruption, plain and simple.


How is it corruption? The website’s owners consciously choose to use said bouncer who has agreed to accept compensation in the form of making the website’s visitors solve captcha.


Do you think that's universally true, like website _owners_ (as opposed to developers) realise captchas are a thing? Seems unlikely to me; the dev setup a cdn, the owner mightn't even know what that is.


> the owner mightn't even know what that is.

That's a problem of literacy, but it is still their fault and their responsibility as owners of the site.


Another hidden fee in those "free" services.


And let's not forget the subtle dread that comes with getting it wrong. Does that tiny edge of the traffic light that sticks into the next box make that box count as a traffic light as well? Oh no, I get another one - I must have gotten it wrong and now the computers think I'm one of them!


The trick with captcha is to not care if you get it wrong. I found that I could get past the captcha of it just click on the first tiles that pop into my head until Google is sufficiently convinced I'm not a robot. At most it takes me three attempts and even then, I'm not using too much cognitive load.


> The trick with captcha is to not care if you get it wrong.

You have probably never been stuck in a loop where it just wont stop throwing captcha at you.


Being asked by a machine to prove that you are human is sometimes really humiliating, especially if you fail the captcha a few times in a row.


My favorite is finding errors on their side. I was tasked with finding the parking meters, and being told I was missing one. The "one" was an image of a mailbox, not a parking meter. Selecting the mailbox allowed it to say I was a human


The reason this happens is that captchas are not localized. Most countries don't have mail boxes, only US, Canada, Australia, NZ have them so people from outside those countries may not think to distinguish mailboxes from parking meters and will just click every square that matches their mental model of a parking meter (a pole with something on top or a big box)


> Most countries don't have mail boxes (only US, Canada, Australia, NZ)

They do, they just look different. At least that's how it is in France.


They're not the same as the classic US mailbox (). In the US you can use such a mailbox to send mail as well. In Europe you typically have private letterboxes for incoming mail and big, public post boxes for sending.


> classic US mailbox ()

Missing link? In NZ, and presumably other countries, personal letterboxes in rural areas can be used to send too, which I'm guessing is the same as what you're referring to.


Yes NZ is one of the four countries that use this style of full duplex mailbox. It hasn't caught on outside US/CA/AU/NZ, probably because (speculating here) it's not secure against theft and doubles the workload for the mailman.


Darn, the parentheses originally contained a mailbox emoji but I forgot HN does not support them.


but that's not what the challenge is. it's more likely the database of training data is wrong. we've seen that to be very true from posts here on HN. some of the data was so horribly mis-identified, it's a wonder it works at all


Is a Bicycle a motorcycle? Will I kill one or the other by mis-categorizing it for the AI?


I mean, if we're just going to start saying "you know what I meant", then why use words that have meaning for anything?

Honestly, as a driver, when I see a bicycle, I make sure to provide as much room around them as possible. When I see a motorcycle from behind, I have no idea what the thought processes of the rider will be and just continue on in a straight line and allow them to make a decision. A bicycle in my rearview mirror poses no threat as they cannot keep up. A motorcycle can easily overtake in way ordinary cars cannot (between lanes, etc). They are much more difficult to predict. (not even taking into consideration the tendancy of motorcycle drivers being less risk averse).

So, if you want to teach the AI that a bicycle and a motorcycle are the same thing, then yes, you might inadvertantly lead to an AI making the wrong decision leading to a death. I wouldn't necessarily blame you for picking the wrong image in a captcha, but I'd definitely blame the devs for not sanitizing user input.


I think I got that exact same one, and had the exact same problem with it. Maybe reasoning that it was confusing the mailbox for a parking meter was how I proved that I was a human to it.


It's really hard to know sometimes which frames humans generally classify as 'bicycle' or 'traffic light'. The bottom third of a tire? The supporting pole of an extra set of signals in the background? I sometimes have no idea whose intelligence I'm supposed to emulate.


They can just use the data and see "50% of verified humans clicked this" and know that it is debatable or not obviously a match but not a verified not-match.


I’ve heard that before and I don’t really understand how people have so much trouble with this. But I guess knowing the rules helps me with this:

The machine doesn't know the answer so it doesn't really matter. You need to emulate the crowd and also realize you are contributing to the crowd. So you can actually pollute it with wrong answers to delay the robot uprising. Or at least cripple it when they keep running into fire hydrants they didn't see.


I understand why websites need to use captcha. I do not understand why websites that have user accounts cannot offer the option of 2FA TOTP, or even SMS login to avoid captcha.

Hilton.com is a big annoyance.


I really hate giving my phone number to any service, especially since i might need a second account there, or they might sell my data (or get hacked).

I also hate sites that force you to do so... eg. twitter, where it decides it won't let you register without a phone number (making a new twitter account for a project), then won't allow you to use the phone number, because you already used it for your primary account.


Coincidentally I just made my first Twitter account. I can't remember the exact boxes you need to click but there is a way to sign up without giving out your phone number.

The issue is that it may flag your account as more suspicious. After three days I had my account flagged. I couldn't view tweets or use the account in any way. On log in it would redirect me and ask for my phone number for "verification". Funny how they can verify something they never received. It took about ten days for support to correct but my account is active again and they still don't know my phone number.


I don't understand why they need it when they've already accepted and verified a login request, just need captcha to finish it off? (i.e. you don't get the captcha with bad creds)

I mean, maybe I can see/accept an argument for that. But when I have a recent order? When I'm logging in from the link you just emailed me?


A bot can trivially generate TOTP tokens from a shared secret and receive/process incoming SMS to extract the code.


Then use the fact that I am a paying customer of Hilton’s for years to mark my account as a human. I have the Hilton credit card, I am a Diamond member, what else do they want?

I know why they force me though, I use content blockers on macOS and iOS to block tracking and ads, but that is not a good reason.


I can think of few behaviours more human-like than using a content blocker. :)


Can you share those content blockers? I recently acquired my first iOS device and have been suffering through the ads.


Not who you asked, but I use Firefox Focus as a content blocker. Since iOS only has Safari and WebViews (Safari in different clothes), you enable content blockers by going to Settings > Safari > Content Blockers.


I use Wipr. Firefox Focus is a free one for iOS though.


AdGuard is where it’s at on iOS.


SMS is expensive.


It's amazing that they still charge for something smaller than an average packet.


It's less expensive than losing customers due to a bad UX.


But more measurable.


TOTP is free, and can simply be made an option to avoid CAPTCHA.


Sometimes I end up failing them deliberately. I can't boycott them because they're often in the way of important sites. So my small, practically invisible protest is to never click more than 3 times. If you want me to pick out all the bicycles, you better have 3 or less. I'm only clicking 3.

I fully understand this isn't going to have any effect. Maybe if a million of us were doing it, it would. But it still makes me feel better.


True civil disobedience would be clicking the non-bikes.


Back when captchas were about optical character recognition, it was obvious which words came from actual books. Plenty of people would input offensive words instead of the correct answer. I hope it had an effect but it probably didn't.


Someone who isn't me hung around on 4chan a lot back in the day. Indeed, there was an effort across the boards to disseminate heuristics to determine which one was the already-known word and which one was to be parsed by humans. The agreed-upon procedure was identify the latter as "penis".


> The agreed-upon procedure was identify the latter as "penis".

I remember far worse...


So you want us to DDoS the captcha networks? Hmm is that even legal? But it would be somewhat cool if millions of people starting failing captcha on purpose it would be something like decentralized volunteer mass ddos attack.


Wouldn't be a DDoS. At least, I don't think it would.

It would just be simply people refusing to work on captchas more than a certain amount. Basically, if you make me hunt for bikes and there's more than 3 of them, then I'm not doing it. More akin to a deliberate labor slowdown than a DDoS, or even a strike.


How do you know how many bikes are out there in total? And what is a purpose of a deliberate labor slowdown if you are going to get more captcha work if you do not finish your current one.

I mentioned DDOS because every time you fail to satisfy captcha criteria website requests a new batch of captcha for you; in that way you would be constantly requesting a new captcha if you would be deliberately failing your current one or as you described imposing a "hunt limit" upon yourself.


Good point on the DDOS. Didn't think of it that way.


> Being asked by a machine to prove that you are human is sometimes really humiliating

In a quite a few instances, I find it flattering, because it implies "we haven't sucked enough data on you already to know if you are a human, so we need to be sure."


I find it infuriating because it pits me against other people without explaining what the rules are.

If it says "select a sign" and I see there's also a sign far away in the distance only a few pixels in size, I select it because it is a sign. I think most people don't because I frequently get many tests after, because I'm not human enough for them.


It's actually a sign of bad ergonomics and disrespect for your time and effort. There are already sites that know you're human by your mouse/touch behaviour. Only if js is blocked do they need to resort to those ridiculous multi-level games they make you play.

My surprise if the sites that do those things turned out to be using humans for free labeling of images would be an exact, unsigned zero.


> Only if js is blocked do they need to resort to those ridiculous multi-level games they make you play.

In all fairness, i usually do that.


>> the indignity of being forced to prove I'm human

Indignity, that's it! I was never able to explain to myself the visceral hate I feel when I encounter captcha. I knew it could not be explained by the little work it requires, I knew there had to be more, I just couldn't put my finger on it. Indignity, and maybe the feeling of being used.

I have to admit, When I encounter captcha, I leave that page and never come back. I stopped using Pocket where I had hundreds of articles because of that. And when I encounter captcha on an especially bad day, I spend a few minutes clicking on incorrect images in an attempt to mess up their data.


On site I find especially annoying is Humble Bundle.

Before I want to buy something there login. To prove that it is me owning the account I receive an email with a code I have to type in. Especially when I am on a mobile phone.

After that, when frigging ever I want to checkoutmy cartI am forcedto do these captcha again prove that I am a human.

I just stopped buying from them. Even if I like the cause.


> Even if I like the cause.

What cause is that? To make IGN more money? Because everything else is only marketing by now.


I hate captchas with a passion, yet I was recently forced to deploy it on website due to direct instructions from the credit card processor. The system was being used to roll through credit cards script-o-matically, and they mandated captchas to be deployed on threat of closing our account if not.

So if anyone has better solution so I can eliminate the G and is Wordpress happy, I'm all ears (or eyes reading in this case).


You don’t need a captcha if you’re willing to put some engineering resources at it. Check the IP reputation. Fingerprint the browser, they never bot from mobile devices. It’s always zombie windows boxes. Whitelist all your marketing traffic because that traffic is clean.


> never bot from mobile devices

;]

> IP reputation

my ISP has, it seems, all of their addresses in a blacklist. The ips are also dynamic.


I guess you could script bots using an emulator but there are probably easier targets for carders.

For IP reputation, looking for IPs associated with proxies and also data center IPs though blacklisting all the big cloud providers will grab innocent users. EG: US military runs outbound proxies on azure.

This all for new traffic. Users that are known to be non fraudulent have a unique persistent cookie that allows them to bypass all the checks. So they could jump on a VPN and stuff would work.

Stuff we built for an online bank was even more advanced and looked at the incoming packets to detect proxies(tcp fingerprinting to determine OS). And we did shady stuff with fingerprinting internal networks with WebRTC. Our adversaries were 100 times better than simple carders running selenium scripts.


we could have been good adversaries ;]


There are captcha providers besides google, such as hcaptcha, or even rolling your own solution (a la old vbulletin forums)


The issue with this is that you won’t have a scapegoat if people do continue to roll through credit cards. With ReCaptcha, you just say “all of these attempts had verified captchas” and the CC processor is unlikely to personally blame you/the company for the activity since ReCaptcha is widespread. With a custom solution or other captchas, they can just block you due to insufficient protections when they see you have higher fraud rates than merchants utilizing ReCaptcha.


If you disable anonymous checkout work so that you have to have a registered account and be logged in to check out stop these credit card rolling attempts? Shut down any account it occurs. Probably whack-a-mole, but is it effective enough to not deploy a captcha system and not have the merchant account suspended?


Bots in the business of CC fraud are often written specifically for that website, so you might have bots register a few hundred accounts a day to try the CCs. All I’m saying is that ReCaptcha is a scapegoat, other big websites and services get away with doing their own fraud detection (Stripe, Shopify) because they’re good at it and have a team dedicated to constantly improving it.


sorry. meant better than captcha like solutions. i know there are others, but it's still click here until we believe you're not a bot.


https://friendlycaptcha.com/

Requires the browser to complete a Proof of Work challange.

Not for verifying humanness, but against spam / dos attacks.


Proof of work is horrific. Means someones old phone has a meltdown trying to load the page while a warehouse in china with the latest GPUs cranks out billions of proofs per second. You could even utilize botnets to get random laptops and fridges to do your PoW.


If this was a mining situation, then yes, it would be dumb.

Is that what this is actually doing though? Is it PoW for a mining operation, or just causing some electrons to be moved around to prove your not a bot? I didn't read too far into what the PoW actually is since their demo shat the bed.


> or just causing some electrons to be moved around to prove your not a bot?

The problem is spam networks have more computers and more power than your phone does so any proof that you can do, spammers can do 1000x faster. PoW can sort of work when your attack to defend against is a ddos situation where an attacker has to make far more requests than the average user, but most captchas try to defend against bots being able to use the site at all which PoW can not do.


how does doing computation without human interaction prove you're not a bot? It only proves you're running a browser with javascript enabled on average hardware.


Oops. I broke it. I tried their demo, and got this as a response:

"Demo Friendly Captcha in action The form was unable to submit. Please contact the site administrator."

Demo Hell 101. Make sure the demo shows the product working.


That's not a captcha. Computations are cheap. This is not really solving anything...


But metal detectors don't block your way for 20 seconds and they don't ever put you into an eternal loop of scanning again and again until you just give up and decide to live without.


They do delay customers by 20 seconds, because if we’re carrying metal then we’ve got to be inspected by security.


Capchas hold you up 20 seconds every single time, whereas metal detectors usually don't alarm at all.


Wasted time is still >20 seconds every time you encounter a metal detector, unless you really don’t ever carry or wear metal. Bonus points if you regrettably have a bag that needs to be searched.


It takes me 20 seconds just to be sure I've accounted for any possible metal in my pockets.


Something melancholy about them is the loss of the idealism of "User Agent" as a scriptable machine which can act on your behalf on the innocent and collaborative proto-internet.


I also mourn the loss of User Agents. Why can't they just let bots browse?


You're forced to prove your human to an algorithm that trains a robot. It is a very boring dystopia.

As an aside, I enjoyed the use of the word "anomie" in the article.

Now I'm going to put on some sovietwave...


John Mulaney has a good bit about this: https://www.youtube.com/watch?v=YQbjdaHIZ_k


There's also the indignity of doing unpaid work for Google. We're not their fucking slaves.


It’s ok. I get my money back by watching hundreds of hours of YouTube while blocking every single ad.


So do I. That doesn't excuse Google's other forms of exploitation though. Like ads and private information collection, they're just yet another thing we should be working to block.


> the indignity of being forced to prove I'm human

Well put. I would add that it's even more humiliating that you have to "prove" it to a machine, who has no clue what it even means to be human.


> the frustration at this stupid world we've created

https://github.com/rene-tobner/unity

Egovernment and identity management @ world-wide-wished-for-things.org ?


> A website with captchas is like a retail store with metal detectors; it's not somewhere I feel welcome.

How do you feel about Apple's face scanner?


You mean you're bummed because you helped train your AI replacement for a few bytes of content that you forgot about in a couple of hours?


>For me a part of the melancholy feeling comes from the indignity of being forced to prove I'm human

This is EXACTLY what a Robot would say...


Blame the bastards hacking the website. Captchas are typically used to combat bot activity.


For me this effect is significantly compounded by not being from the US / North America. This has come up on HN before (e.g. https://news.ycombinator.com/item?id=25226805 ) but it still strikes me as so odd that you need quite a bit of USA cultural / vernacular knowledge to navigate the internet anywhere in the world (or at least English speaking sites?). What a strange view into another country to see each day!


I was going to vehemently agree and start ranting, but I see you've linked a submission that already has enough of me ranting! Ha. I'll only add that sometimes it annoys me so much I want to create my own 'Britcha' out of spite.

Perhaps if I ever run some really popular site I shall: 'select all pubs', 'arrange the squares in order of social class', 'type the word that describes an ordered collection of people waiting for something'.


Would totally make sense - when visiting .co.uk sites!


No it wouldn't. Just like American sites, there are very many .co.uk sites that (intentionally) serve a world audience.

Different language & currency support is fairly common, and where not present it's usually because other markets aren't deliberately served. I18n/l10n ought to extend to captcha too.


Maybe chachacaptcha, with only fun puzzles to solve. Since bots don’t have humor (yet)


Honest question - how can you tell the difference between "English speaking sites" and "American sites"? Since English is currently the common international language, when an American creates a site or service for a domestic audience, anyone around the world can still come visit and read it. But how does one know if a service is meant for a domestic audience?

We've all seen services launched by American companies, with American employees, American VC money, that only work within the US, and are only offered in English. We've also all seen how these companies get criticized by people around the world that the service doesn't work in their country and their language. From the American perspective it seems like the rest of the world feels they are automatically entitled to services created here. Even if the stated plan is to eventually roll out to the rest of the world.

This behavior is stunningly obvious when a Chinese or Indian company launches an interesting new product or service for a domestic audience. In those cases, it's hard to find people upset that the service only works domestically or doesn't work in their language. This is because those people aren't falling into the logical fallacy of "American = English = International language = International product".

As a good faith question - if you were an American, how would you create a site or service for a domestic audience without insulting the rest of the world?

p.s. This is a side question non related to this article specifically - obviously google is an international product.


>As a good faith question - if you were an American, how would you create a site or service for a domestic audience without insulting the rest of the world?

First I would say that I don't think I've been, or particularly seen others, be offended by sites that are clearly targeted at a US/North American audience while still being more widely accessible. Usually I am happy that being an English speaker gets me access to a wider set of things on the internet than would otherwise be specifically targeted for where I live. I'd say this is fairly true up until the scale of a company with international presence and operations.

Yes there is going to be some vocal minority who behave in an entitled manner and loudly complain that something didn't meet their personal expectations, but this is a small minority and not representative of the wider English-using-international audience.

If a site is open and upfront about what they are doing then I wouldn't have any issue. Examples might be using geolocation to restrict access or just having some note making clear that 'this service is for X, use it elsewhere at your own risk'.

A good example of this is the range of approaches different sites have taken to GDPR compliance (or that awful cookie law compliance!) following its implementation by the EU and the non-EU countries that have adopted it.

Some non-EU sites (possibly based in the US but also plenty of others elsewhere) have used geolocation to restrict access from the EU, others have implemented those consent banners, others have done nothing. However I don't think it is reasonable to blame a company doing any of these, ultimately we are benefitting from the protections the new law provides - if we don't like the wider implications of that then we need to take that up with our lawmakers, not a foreign company located somewhere with their own set of data protection laws.

The change for me occurs when a company is an international entity. I realise this is a bit of a grey line as to what defines this, but hopefully we'd all agree that FAANG meets this definition. When you're actively engaged with international markets and generating significant revenue in countries around the world I think it is a reasonable expectation that you either: a) make services culturally and linguistically localised; or b) more carefully target a service to some specific regions.

TLDR - at a small scale, if you are open & clear about your intentions I don't think you need to worry about 'insulting the rest of the world' - if you get significant traction in another country you should probably open a dialogue with that user base to understand their views.


Yeah, this annoys me so much. Some just grate (we don’t have ‘crosswalks’ here, we have ‘pedestrian crossings’) but for some things I literally just don’t really know what they look like in the US and have to just guess!


True, but the questions are still very poorly posed even if you are from the US. Does a corner of a wheel count as a car? Is the square box containing a traffic light a traffic light? What about the horizontal pole on which it is suspended? What about the vertical pole holding up the horizontal pole? If there is one in the distance, does that count?

You have to play a game of guessing what other people will guess, and yeah, if you aren't from the US that's a huge handicap, if you aren't neurotypical that's a huge handicap, if you have bad luck that day that's a huge handicap. Google doesn't give a shit, the people who put the captcha in place don't give a shit, you just have to deal with the little Kafka nightmare they dump you in and hope it doesn't lock you out of something critical.


With all the legitimate criticism of Captchas, this is really a made up one. It doesn't matter. You can get some stuff wrong and still pass, and you can skip/retry if the picture is not clear too.

Captchas aren't a "score 100 percent at this minigame" thing, they're more of a "loosely follow these instructions while I watch your cursor and analyze your results to figure out if you're a human or a selenium instance."


Maybe you can get some stuff wrong and still pass.

But if someone has been stuck for 20 minutes on this game, through 30 different screens of it, and not passed yet, you can surely understand why they may think the reason is they are getting some edge-case stuff "wrong" and the machine is very picky, so they have to figure out the secret rules needed to pass.

I did try once for 20 minutes to see if tenacity would win, until I gave up because it still hadn't let me pass. I'm pretty sure that my error rate was very low, if not zero.

I'm guessing those times when I've been unable to get past a Captcha were due to the IP address I was connecting from, but it's pretty abusive of a site to tell someone it will let them in if they solve a simple test correctly, and then repeatedly show a new version of the test, never letting them in and never telling them no either. Cloudflare and Google have been bad for this.


The fact you'd get stuck for any length of time on it sounds like one of those "legitimate criticisms" i was talking about, that has nothing to do with whether a wheel counts as a car.


I was going to say exactly the same thing. Some things are really confusion when you're not from the US. I think it's a problem with internet in general, as many people speaks english and thus people from the USA think everyone is from here.


Just to share the American perspective, it feels like this: Many people speak English, and thus it is difficult/impossible for people from outside the US to discern the difference between domestic and international services. (Not saying Google is a domestic service obviously.) Through historical chance, we don't have the luxury and benefits of a native language like many of you reading this right now.


That is one reason I very strongly believe that US-only top level domains like .edu, .gov and .mil should be phased out and replaced with *.us TLDs. Then, US based colleges would be under .edu.us, just like e.g. Australian ones are under edu.au, and US-specific businesses could use .com.us domains to indicate this.

But that seems quite tangential to the point that recapcha, being deployed internationally, should be much more effectively culturally internationalised! Just having a language isn’t enough - there are big cultural differences between Spain and Mexico despite both speaking Spanish, and Brazil and Portugal despite both speaking Portuguese, for instance.


I don't really understand what you mean by this. Do you have any example? Is it something like not knowing if an online store is international or domestic? Because in that case we face the same issue, when I see a store in English I'm not sure it'll ship to Europe, and often doesn't.


Seems like CAPTCHAs shown to users outside the UA should show local road images because locals know best how to identify objects on their roads. Perhaps Google is prioritizing the autonomous vehicle market in the US for now.


I've read the whole article, and I see so many comments agreeing or even adding detail to the post. Am I really in the minority if this kind of thing couldn't even cross my mind or feels like written by someone living in a parallel universe?

A few poorly shot street photos are "unbearably depressing"? And there's even a detailed explanation breaking it down into points, each one feeling more alien than the last. They're just pictures from the street! Just how? How does a person come up with a whole emotional essay for this?

I am failing to understand the author to the degree I feel like there's something wrong with this person's psyche or something is wrong with mine. Am I having a stroke and words are no longer making sense? Am I too young, or am I too old at 26 to "get it"? Is it because I live in a third world country and lack perspective or have "too much" of it? Is this homework for an English class and it's just trying to talk about literally anything for a given arbitrary word count? I almost feel like I'm dissociating from reality by an article talking about a freaking captcha.


It's for this very reason I'm so happy to see something like this article on HN, and I'm so happy to see your comment too.

I think I know exactly where you're coming from -- I was exactly the same way when I was younger. I was 100% extremely logical, and my emotional awareness was... exceedingly underdeveloped.

Long story short, I got into different artistic pursuits where I was forced to develop my emotional awareness of these things, multi-hour classes with other artists where all we'd do would be to analyze these types of things.

And after a long period of great frustration, all of a sudden, it's like the world went from black and white into color. There was emotional resonance everywhere where I hadn't seen it before. It was like I was finally speaking a language a lot of other people seemed to just be born with. And social interactions got a lot... easier.

I also realized that my emotional surroundings had always affected my mood etc., I just had never been able to pay attention to how. So while I was consciously blind to it, I was still subconsciously 100% affected.

So there's absolutely nothing "wrong" with the author's psyche... but nothing's "wrong" with yours either, you just haven't had the practice/opportunity to develop this side of things. You're not dissociating from reality... but at the same time there absolutely is a reality that you haven't developed skills to see. And it absolutely has nothing to do with age or country.

If it's a skill you want to develop, there's no single answer. The general idea of "emotional intelligence education" is one approach, fields like art history, film criticism, literature and poetry are others. Even activities like yoga and meditation can help since emotional awareness is both mental and bodily. Ultimately the more you expose yourself to things combined with seeing how other people respond to the same things and finding little pieces in common with them, it'll eventually start to "click".


I am going through this process at the moment… at 30. It started when I was younger with art film*, but was stinted for years by a bad relationship. The process started again with an amazing relationship (aren’t wives wonderful?).

I still slip into viewing the world in “comfortable” black and white logic with clear cause and effect when stressed, often without realising. I lose my humanity and enjoyment of life in the process.

I absolutely agree with being consciously blind, but subconsciously 100% unaffected by our surroundings. It felt (and often feels) like everyone is experiencing the world so very differently and yet they’re so often happier! The people I thought had no clue about how the world works… it turns out that often these people understood so much more than I at the time.

We seem so poor at teaching children how to live, how to manage emotions, and ultimately what it is to be human - in the west at least. Too busy spinning the daily hamster wheel to show our children what exists outside of it. Perhaps this is just my experience though.

Thank you for putting this into words so succinctly. It helps.

* I agree with Kermode’s view of film being an “empathy machine”, as he calls it. Spending an hour and a half of your time viewing the world through someone else’s eyes really can change a person and enhance one’s empathy for our fellow humans. Ultimately, as you say, the world takes on colours that you never imagined could even exist. For me, at least.


Just because mixedCase does not find captcha pictures to be depressing does not necessarily mean that mixedCase has problems with emotional intelligence. I have no major issues with emotional intelligence as far as I can tell and I also do not find captcha pictures to be depressing. Maybe I would if I looked at them for hours for some reason, but I do not, and certainly the idea of them being "unbearably" depressing strikes me as quite extreme. I understand the author's points about the lack of people, the strange angles and so on and I am sure that if for some reason I had to live in a strangely-angled reality full of roads and gray buildings and devoid of people, that I would find it unpleasant. But I do not have to live in such a reality - I barely even glance at any given captcha, then I click some parts of it and move on.

The way that the author describes the captcha images reminds me of the idea of "liminal space" - a concept that relates to a certain kind of eerie sensation but is perhaps most familiar to people in the form of art that seeks to evoke this sensation and makes normally familiar things like shopping malls and schools instead look eerie. Often simply photographing such places without any people in the pictures does the trick. I do see the eerieness in the captcha pictures but again, for it to really affect me I would have to focus on them for much longer than I actually do. The author, for whatever reason, has become particularly interested in captcha images, but until I read this article at least, I was not.


>> does not necessarily mean that mixedCase has problems with emotional intelligence

Don't you think they do, though? I mean... not even recognizing the dry humor and hyperbole with which this article was written and taking it literally?

Or maybe it is me having the stroke.


> you just haven't had the practice/opportunity to develop this side of things

That is one way of saying that he simply has not allowed trivial concepts like a bunch of boring pictures to affect his mood. Another way of saying this would be "that sounds good, I wish I were not so affected by these things but alas, I am" or "lucky you, maybe I can find a way to avoid these mind traps".

There is no strength in weakness or defeat, there is no virtue in negativity or pessimism nor is the world a better place for people being triggered by a bunch of boring pictures. Just don't look at the damn things if they bore you, I never do - I just click the link for the audio version.


> there is no virtue in negativity or pessimism

if we're oblivous to even the smallest things (boring pictures) that negatively impact us, we hinder ourselves to making the world better. And that's not something we want, everything is shit already.

Oh and this whole "Just don't" dissmissal... Check your privilege, man, and develop some damn empathy.


Privilege is having exposure to so few and so mild negative experiences that the way a CAPTCHA makes you feel seems important.


edit: nevermind


> Oh and this whole "Just don't" dissmissal... Check your privilege, man, and develop some damn empathy.

Soft healers make smelly wounds [1]:

British Journal of Guidance & Counselling, v47 n2 p200-209 2019

Genuine happiness is impossible without authentic concern for and corresponding behaviour towards the well-being of others. Such an incorporation of others into the self refers to a "democratic self" and the related regard for the common good. The author argues that the honesty of professionals who work in or for an educational or vocational setting is vital for the good of the individual and the common good. By introducing "democratic selves", recent advancements in Dialogical Self Theory (DST) point to an inclusion of the common good. However, given the importance of virtues for one's own and the common good, the theory and its applications are in need of integrating virtues *and in particular honesty.*

Also, drop the "privilege" stuff, this is not twitter.

[1] https://eric.ed.gov/?id=EJ1216616


If you can "JUST don't" (a privilege), it doesn't mean someone else can "JUST don't". You're being an asshole, not "honest".

also you probably meant tumblr, not twitter.


Go back to the root cause here: boring images cause someone to become depressed. My advice is to refrain from looking at the things, your approach is to pat the person on the head. You can try to spin it into a long meandering rant about the vicariousness of life and the eternity of suffering which makes it all so much richer but when all that seems to do is cause depression it is clearly not the right path unless you consider depression to be virtuous.

Also, twitter, not tumblr. I've never been to tumblr and I try to avoid twitter but from what I've seen of the place it is full of keyboard-side vicars full of holier-than-thou attitude which they're wont to express in 140 characters or less.


> Go back to the root cause here: boring images cause someone to become depressed. My advice is to refrain from looking at the things

We are talking about reCAPTCHA, a tool that is used to prevent botting the websites that people sometimes have no choice but to use.


That is why I suggested to use the audio version instead of the images, this is what I always do - I never look at those pictures.


edit: ok.


You missed the point of the comment. It was saying it does affect his mood, he just doesn’t have the EQ to realize it consciously. And to be honest, and someone who finally started getting in touch with his emotions by branching out my hobbies and interests… I see exactly where both comments are coming from.

Saying it doesn’t affect his mood is like a kid who claims they don’t suffer from sugar crashes, or people who claim their diet and mood are unrelated. Conscious awareness of mood is not necessary for it to affect behavior.


> It was saying it does affect his mood, he just doesn’t have the EQ to realize it consciously.

Consider the possibility that someone might indeed not get depressed from looking at a couple of street photographs for a minute. That having to fill a CAPTCHA can in itself be so annoying that the content of the images becomes irrelevant. Or that someone who (in their words) lives “in a third world country” might have bigger concerns which render banal pictures as truly innocuous in their mind.

Use your emotional awareness. Empathy is about opening yourself to the feelings and reality of another, not about extrapolating your own emotions into them.


I'm trying to understand this comment. But it seems to me it boils down to "spend time to learn how to be depressed by the world around you." That doesn't seem like a skill the average person should want or need. There is something with with society if you have to spend time of hours of practice to get "emotional intelligence" from common place items that have no inherent meaning.


I think the point is that stimuli and physical conditions still create certain emotional responses in you. You may or not be aware of these responses or contributing factors, but most everyone is effected by them. Stick someone in a dark room for weeks and they're not going to be very happy no matter how aware or unaware they are of their surroundings.

If it's a specific case of ignorance is bliss then I agree, remain ignorant. Otherwise, it's good to know things that cause problems so you can fix them.


Depression isn't the only emotion you feel when you stop being disconnected from the world. You may come out of it with a greater appreciation for nature, art, literature, etc. You may even have more pride in your work as you become capable of developing a design language and incorporating it into what you build.


I am surprised at the downvotes on your comment. It seems so obviously correct that I can only surmise certain things about HNs demographic. Oh well, it’s not like men in tech are famous for our high emotional intelligence.


I don't pay attention to the points on this site. The hackernews I knew a decade ago is dead. What's left is a bunch of middling code monkeys who think this should be treated like extra-pretentious reddit. If I had to describe it in a metaphor, I would say it's now an Asperger's meet up show and tell. It used to be that truly interesting things would get posted here on a daily basis, too.


As much as to hate to admit you’re right, you’re right.

I’ve become more and more disconnected from user base as time has passed. I think I’ve been stuck at around 2k total karma for years now. I know I used to have more points several years ago. Paying no mind to the points is a good idea. Might be an even better idea to mourn and grieve the HN I used to enjoy, instead of fooling around with its rancid corpse…


I was surprised with how this comment turned out. I thought for sure you were saying that emotional maturity would show you how much people project their own emotions upon any given subject of art. Much of your comment could be read on a way that conflicts with your conclusion.


I became a lot happier after I learned the cognitive skillset of not being hyper-aware of trivial problems, or finding in them some profound meaning or deep emotional resonance.

I don’t think that was emotional intelligence, I think it was bias, rumination, and catastrophizing. Also a lack of perspective. I still feel bad sometimes, but… about things which other people also recognize as serious problems. Which has been a boon for social outcomes too.


I feel like your comment was expressed in sort of a dick way, but I also think it strikes at a truth that’s so deep and needed in our society. So thanks for the comment.


Not sure what's dickish about it to be honest.


Maybe you're right. I could feel the parent comment's pain from that implication that he was underdeveloped, largely because I agree. I have also noticed in myself that I'm often not aware of my underlying emotions, but very often a victim of them. To everyone around me I seem like an unemotional male, but I think in reality I'm low in emotional expressiveness, reactivity, and neuroticism.


> but nothing's "wrong" with yours either, you just haven't had the practice/opportunity to develop this side of things.

Condescension, with no concrete feedback to improve.


Your last paragraph, could you expand? Seems like each time I get close to “color” I get pulled back to “black and white.” It’s clear there is an emotional intelligence not possessed, but usually only _after_ the opportunity to learn has passed.


> I was exactly the same way when I was younger. > my emotional awareness was... exceedingly underdeveloped.

Are you implying the GP's emotional awareness is "exceedingly underdeveloped" and that they'll grow out of it?

> you just haven't had the practice/opportunity to develop this side of things

> there absolutely is a reality that you haven't developed skills to see

Yes, it does seem like that's what you're saying. What kind of condescending bullshit is this? If they don't feel the same way you and author do then they're "underdeveloped"?

Not feeling the same way as other people about something is not some kind of disorder to overcome. This is the meaning of the phrase "beauty is in the eye of the beholder." People have varying preferences. Some like sports, some like this sport or another over that one. Some prefer music. Some don't get anything out of music. And all this is because of how they feel in relation to whatever subject and has nothing at all to do with a lack of development.


Sorry, that's not what I meant but I can see how it could be interpreted that way. So let me rephrase.

I intended the word "underdeveloped" not as a value judgment, just a practical sense -- in the same way my own baseball skills are underdeveloped i.e. nonexistent. If you replace it with "less developed" that might be clearer. I meant it just in the context of the goal of someone trying to understand and relate to the article.

My main point being that it's not something you're born with or not, but that you can choose to develop. That the potential is there. But you're under no obligation to, it absolutely is a choice/preference.


> I intended the word "underdeveloped" not as a value judgment, just a practical sense -- in the same way my own baseball skills are underdeveloped i.e. nonexistent. If you replace it with "less developed" that might be clearer. I meant it just in the context of the goal of someone trying to understand and relate to the article.

> My main point being that it's not something you're born with or not, but that you can choose to develop. That the potential is there. But you're under no obligation to, it absolutely is a choice/preference.

Yeah sorry, no, that doesn't fly. Just because someone doesn't feel the same way you do about something does not mean they are lacking some skill or another. Your response is just more dismissive condescension. Maybe keep working on that development of yours.


Perhaps you've learned to be emotionally hypersensitive to things you sense, while the parent commenter only interprets emotions from emotional contexts, like when people or animals express emotion?

Then again, perhaps anytime two people experience a subjective matter differently, they try to grade each other's ability to experience that matter on an objective scale, with their ability to experience it set at the origin. From the parent commenter's perspective, the article and your response are both emotionally hypersensitive, and from your perspective the parent commenter is "emotionally underdeveloped".

What this all comes down to is that applying an objective scale to a subjective matter doesn't yield anything useful; it only highlights the relative differences of the participants. I've always wondered if it's human nature, or cultural imbuement, to inject competitiveness into something that cannot be competed over. It's obvious that you each see this subjective matter differently. How can either of you possibly think that your subjective viewpoint is correct, without also acknowledging that the other's viewpoint must also be correct to them?


I understood what you were saying and didn’t interpret it as condescending.


I also don't agree with the author during the first half of the article. If anything captcha photos have an overwhelmingly suburban feel, probably because (I assume) they're taken from Google's street view. The six points listed are all the same: they're photos taken from a car. While aesthetically that's dull, monochrome, and ordinary I can't call it depressing without calling every drive to the grocery store equally depressing.


I live in a walkable part of a city and to be quite honest every time I go out into suburbs it’s kind of depressing. Local architecture shaped by tradition and climate is replaced by giant samey boxes. Everyone is isolated in a car, streets are largely empty of anything at a human scale. Greyness and concrete.


This is one of the things that really surprised me when I visited North America for the first time. It's less common in the rest of the world.


> I've read the whole article, and I see so many comments agreeing or even adding detail to the post. Am I really in the minority if this kind of thing couldn't even cross my mind or feels like written by someone living in a parallel universe?

> A few poorly shot street photos are "unbearably depressing"? And there's even a detailed explanation breaking it down into points, each one feeling more alien than the last. They're just pictures from the street! Just how? How does a person come up with a whole emotional essay for this?

> I am failing to understand the author to the degree I feel like there's something wrong with this person's psyche or something is wrong with mine. Am I having a stroke and words are no longer making sense? Am I too young, or am I too old at 26 to "get it"? Is it because I live in a third world country and lack perspective or have "too much" of it? Is this homework for an English class and it's just trying to talk about literally anything for a given arbitrary word count? I almost feel like I'm dissociating from reality by an article talking about a freaking captcha.

Double +1. And, thank you - you said it so much better than i ever could.


I'll second this seconding(third it?) I cannot for the life of me understand how these photos can invoke dread, perhaps something in their burgerpunk nature, but still i think the more saddening part is that people still use captchas from google!


> Is it because I live in a third world country

Until I got there I was going to suggest that it was because you were too used to the scenes depicted - I'm not sure about the author (NYT contributor suggests but I think doesn't necessitate that he's American) but I think many Europeans find the scenes depicted quite unfamiliar and not in a particularly pleasant/intriguing/exciting way. The way towns & cities (to a large extent I'd even argue it seems North America doesn't have towns in any recognisable way) are organised is just different, designed around cars and big infrastructure, car parks and 'box stores' over high streets, etc.

I might not independently go as far as (or at least not recognise it as) 'depressing', but they're certainly not particularly 'nice' or 'pleasing' images to me either.


That would be my number 7 for the list. To a Dutchman it all seems so incredibly depressing that everything depicted is built for cars. Even the residential areas seem to prioritize driving over everything else. The humans aren't just gone from the pictures, they're not even welcome without a car. For someone who is used to just getting on a bicycle and go anywhere — safely and often faster than by car! — in the city I live in, this is just so depressing.


I think it's a humor disconnect. The author is expounding on something extremely minor and mundane with a large amount of hyperbole and detail, which his readers may not have thought of with that detail before. Some people might find it funny, others will not. I fall in the former group; I enjoyed it.


I think this is a case of hyperawareness/catastrophizing - upon realizing the mindless interruption of CAPTCHAs, the authors have focused so intensely on the minor discomforts of monotonous, poorly composed, poorly shot pictures that the discomfort has grown through hyperbolic focus into a soul-destroying burden.

It's like anaphylaxis - a completely outsized and self-harmful reaction to a minor disturbance.


I think the minor disturbance is the article and the outsized reaction is calling it a “soul destroying burden”.

I’m primarily a software dev, but clients mostly value my skills in producing visually pleasing layouts and graphics. I’ve come to realise that good aesthetics are extremely valued by most. Even during the development process, nice looking layouts/design integrated early can immensely lift the team’s spirits.

I have observed though there a some people who seem to undervalue the need of aesthetics, are very quick to write it off as superficial, and may even have some very negative emotional responses to this “arty stuff”. I would chalk up much of the perceived divide between front-end and back-end developers stems from this negative emotional response.


So Unbearably Depressing / force you / hate / deeply, overwhelmingly depressing / spirits deflate

And that's just the intro.

Skip to the end: "These pictures erode the soul."


Fair enough, I didn’t really explain my point very well.

I interpreted the authors choice of words more as an emotional critique of things like composition, colors, etc.

If I saw some poorly written code, and I happened to say, “this code destroys my soul” as a figure of speech. Most people would understand that I just have an intense distaste for the code, not I am not having an existential crisis.

From an artistic sense, if I analysed a single frame from the first scene of the Shining, I might use similar language to the author, even though objectively it is just a car on a road.


I'm feeling the same, I can't make any sense out of the article, not even about the article's main _claim_ actually. I guess it's just a matter of differing sensibilities?


This essay must be a personality test, because I read it as satire and laughed manically imagining someone so concerned with this.


> How does a person come up with a whole emotional essay for this?

I feel this about so many different things. Anyone know if German has a word to describe this feeling?


They’re depressing to me because they are a chore - I don’t think much about them, just as I fail to see the beauty in washing up plates.


The first picture is morning or evening sun catching some brilliant autumn leaves. The second picture is some stoplights in front of a building and trees. The third has boats and blue water and a palm tree. Not exactly drab stuff.

At that point I just lost interest in trying to figure out what was even vaguely objectionable about the images. It was like someone was trying to imitate the humor of something like The Gallery of Regrettable Foods with perfectly reasonable restaurant dishes.


Some of us have very strict security settings that cause captchas to be very frequent and I believe more challenging.

I whitelist domains for cookies and I am not signed in to a Google account. These two things really can make the web a frustrating experience. I’ve lost out on campsites from US national parks because a captcha popped up when I tried to add the reservation. By the time I passed the multiple tests, all the campsites were taken.


IMHO the author is saying that these pictures represent one way that we humans have surrendered a piece of our lives to a soulless process and machine. Any human with any photography skills would take lively pictures of interesting things, but these pictures have no life and tell no story. What's mildly depressing about this is that we're missing an opportunity to connect more and see more of life.

Now, if I were to take this piece literally, I would be concerned for the author's mental well being. If I were to record everything I see all day long, nearly every picture my eyes capture would be mostly lifeless. Does that make me subconsciously depressed? Um, no. Not in the least bit. I evaluate pictures based on their purpose before I assign any aesthetic value.

Still, the author has a point: the current state of CAPTCHAs is a missed opportunity for something with more life.


Except the entire point of at least this brand of captcha is to help solve classification problems (or so I thought) and to me doing otherwise seems like a missed opportunity


I think the difference is one of expectations. I get the strong impression that the author of the article is accustomed to images "meaning" something and being presented by photographers who are trying to "say" something.

Fashionable urban types dress up to attend gallery showings at which a bored-looking hipster photographer is displaying his framed images of grainy, empty street scenes of nothing in particular taken from odd angles. Each photo of nothing is a deeply meaningful expression of nihilistic enlightenment or a tour-de-force denunciation of capitalism or materialism or whatever, and if you're sophisticated enough, you can buy one for $10,000.

Hilariously, these captcha images that are just random shots in random directions look just like deliberate dreary, sophisticated, urban expressions of nihilism. But only if you are accustomed to assuming that photos "mean" something, so a photo of nothing must be expressing something: nihilism.

But if you walked down the street and saw most of those scenes, you wouldn't think about it at all. Equivalent, meaningless scenes are around you most of the time, indoors and out. And if you don't unconsciously assume that an image is trying to say something, an image of nothing won't feel depressing at all.


> Am I really in the minority if this kind of thing couldn't even cross my mind or feels like written by someone living in a parallel universe?

Nope. I know what Captcha photos are.

Photos from the Google Maps car driving around.

It explains the weird... "depressing" angles and largely brutalist/barren perspectives.

They're the view of a camera on top of the car going through urban centers. Of course streets are going to look like streets and a camera above a car is going to give you weird angles as it drives around town taking pictures of the middle of the road.

Much ado about nothing if you ask me.


How many times have you gotten locked out by a captcha?

I don't mean "try again," I mean the neverending cycle of "try again" that completely prohibits you from going about a particular piece of business.

My guess: you are US-informed enough, neurotypical enough, good enough at guessing constraints to fix underdetermined prompts, and use proxies little enough that capchas have never been more than an annoyance for you. Please understand that your experience is not universal.


Did you read the article? Your argument has nothing to do with the point of the article nor OPs comment.


Sure did. Turns out my experiences inform my emotions on the matter. Who'd have thought?


> Google’s CAPTCHA images are frequently grainy and badly focused. This is likely because, as Vox points out, Google has gone through most of the easy visual-recognition training cases, where the pictures were clear and sharp. Now they’re stuck with the hard stuff, which tend to be pictures of terrible quality.

While this is true, I think some of the artifacts in the accompanying example are added by Google as a sort of adversarial attack on deep learning models trying to solve reCAPTCHA problems.

I've no evidence for it, but the noise in the bottom-left to top-right diagonal all have too much colour jitter to just be camera gain IMHO.


It’s not just that — google wants its own models to be resilient in the face of noisy data. (You’ve probably see examples where a cat is classified as a mountain or something ridiculous due to the addition of precisely crafted noise.) The best way to achieve that resilience is to simply train the models with noisy data; part of the learning process will then be learning to ignore the noise.


But you don't have to show humans the noise when you're getting humans to determine the ground truth, only the neural network. I think the noise exists to trip up CAPTCHA bots.


Yeah, a lot of the discussion here and in OP seems to take the machine learning angle at too much face value. Sometimes a CAPTCHA is just a CAPTCHA.

Guys, do you really think that in 2021, when ImageNet has been solved to hell and back even with unlabeled data, and CNNs/Transformers/MLP eat it for breakfast, and we are doing OCR from CLIP trained on unlabeled untranscribed images, Google really needs you to label images of big green US highway signs written in the standardized highway font with text containing names of highways and words like 'miles'?

"Oh yes, I can distinguish between 100 breeds of dogs and I know what every public figure in the world looks like and can edit images with the 'unreal engine' trick - but gosh, I just can't figure out where in this image a big green blob is! Only humans with a soul can possibly do that!"


You know, that was my initial reaction reading that comment, but thinking about it a little more made me realise that if you pass the noisey images to humans, they can validate if the noise is such that the signal is gone.

I don't know if that's what they're doing, but it would be a clever way to do data augmentation.


I think you're right -- if you browse from a "worse" IP, you get more grain added. I hate gCaptcha. HCaptcha is a little better but still bad...


You might also be able to get away with cheaper cameras


Certainly you get much harder and noisier recaptchas if the model has a higher prior prediction of your bot-ness. Try browsing around from sketchy Tor exit nodes or some proxies from the free proxy lists on the internet for a bit.


They have to be taken from odd angles. Otherwise, they'd match the data sets used to train object recognizers.

This is a losing race with neural nets. CAPTCHAs are running into the same problem that Yosemite park rangers report with "bear proof" trash cans and storage lockers: "There is considerable overlap between the smartest bears and the dumbest tourists."


This is making me wonder if the experience is intentionally so bleak.

It reminds me of how nowadays when I do an incognito Google search on my phone, I need three taps just to accept the terms of service. Same with YouTube. Maybe this level of cumbersomeness is somehow legally required now, but I find it more likely that this is an attempt to subconsciously encourage people to not browse incognito—so that they can be tracked.

My understanding is that being logged in in your Google account often allows you to bypass captchas. If captchas are a miserable experience, this would have a similar effect of subconsciously discouraging incognito browsing.


It does feel like a similar sort of thing to how fag packets are this horrible murky brown with bleak pictures in them in the UK.


fag is British slang cigarette, for any scandalised US folk reading this :-)

(Does this still need saying?)


There’s always someone who is learning this for the first time!


Lucky 10k


And for those in the lucky 10k learning about the lucky 10k today, https://xkcd.com/1053/


It doesn't have to be linked every time someone learns something.


Google for: friction ux


The photos just look like normal unedited photos of reality. And I suspect that’s the issue. We are becoming accustomed to Instagram style photos depicting a perfect life style with highly exposed and saturated color grading. A raw photo of a street on an overcast day is “depressing” only by relative comparison.


It could also be that not everyone finds car-centric reality (as depicted by those photos) uplifting.


> Looking at these leaden vistas of America

This touches on something else: are all the Google captchas, worldwide, based on photos taken within the US? I suspect they are, and cultural imperialism is at play: taxis in New York are yellow, therefore a yellow car must be a taxi. That kind of thing.


Or a 'vette. Can't forget the canary yellow corvettes.


I'd say it's because the North America, car-dominated, strip-mall-and-stroad landscape is depressing as hell. Open a map and drop yourself somewhere in Europe. I just did, and I feel like identifying crosswalks in a photo like this wouldn't be depressing at all:

https://i.imgur.com/31AgNvs.png


I didn't understand "stroad" so I looked it up:

> "Stroad" is a word we coined in 2013 to explain those dangerous, multi-laned thoroughfares you encounter in nearly every city, town, and suburb in America. They're what happens when a street (a place where people interact with businesses and residences, and where wealth is produced) gets combined with a road (a high-speed route between productive places). -- https://www.strongtowns.org/journal/2018/3/1/whats-a-stroad-...

That's pretty confusing, since in NZ the words "street" and "road" have identical meaning and are totally interchangeable. Is this distinction real in the US, or another thing Strong Towns have invented?


Funnily enough my partner (native German speaker - there's only one word for this in German) recently mentioned "the street" and I corrected her saying "no this is not a street it's a road". When trying to explain the difference my first instinct was "a street has buildings on the side, a road is just transportation".

In my European world I think there's pretty much always an unambiguous difference between a street and a road, but "stroad" definitely evokes the places I've seen in sparser urban environments like in USA, South Africa and Australia.

Edit: after more pondering I think you can call the part of a street "the road" to distinguish the part where vehicles drive from the part where humans walk. E.g. "he ran out into the road" might apply where "it's a busy road" would sound wrong.


That's not a distinction I've ever encountered (from Indiana, US). I'd have said they were interchangeable, but if you told me there was a difference, and asked me what it was, my best guess would have been that a street is urban and a road is rural, just based on experience with whether something tends to be named "XXX St" or "XXX Rd". Wiktionary tells me that a street is within a single city/town, while a road runs between cities/towns, which I guess seems about right to me?


Okay, "street" being urban is a thing in NZ. The thing you drive on to get from one city to another is never a street. Within a city though, "road" and "street" seem the same.


It's a real distinction, but would perhaps be described by a dictionary as antiquated for reasons that could reasonably be considered nefarious.

A relevant Strongtowns quip is a quote of the MUTCD entry for street: "see highway."


Americans also tend to use the words fairly interchangeably, but there is still at least some instinctive distinction. People often say "kids are playing in the street", but they almost never say "kids are playing in the road".


The different words for pavement became separate categories as the culture started to demand an easier way to add context to what you’re saying. English is very efficient in that context is often assumed or hidden in the different meanings of the words.


I just find it very amusing that simple pictures of outside in the US are being described as "unbearably depressing". A pretty good signal that modern urban design in the US is creating very ugly and depressing spaces.


Couldn't agree more. There are car dominated places where I live that give a similar 'American' feeling, but it's not a given.


I wouldn't call the images depressing, but certainly soul crushing.


Many places like that exist in the United States, they just don't show up in captchas because they're much more likely to include identifiable humans.


Here I was expecting a deep analysis and explanation of why the engineering and businesses at play behind Captchas leads to such depressing images... instead I simply found a litany of the ways in which the images are depressing. Not quite as interesting.

I’m reminded of Artistotle’s 4 kinds of causes—or, here, you might say 4 kinds of “whys”


way, why same thing lol


Well, the pictures all seem to be pretty obviously taken from Street View, which explains the weird angles.

I was surprised there was no mention of the palette or the quality of the photos: they're all pretty washed out and gray, fuzzy with no sharp edges, and at a low resolution, like they were taken by a decade-old smartphone.


>like they were taken by a decade-old smartphone.

It's more that its cropped from a much larger photo and the AI has detected that something is here but it isn't 100% on which thing it is out of a few possible candidates. The sharp stuff is already clearly identified.


I’m amused whenever I get one image “wrong” and have to click it anyway.

“I can see how you might think that’s a boat but I assure you it’s a mailbox.” “COMPLY” “This hurts you more than it does me. click


> Part of it is the sheer hassle of repeatedly identifying objects — traffic lights, staircases, palm trees and buses — just so I can finish a web search.

Does Google ask you to complete a CAPTCHA to run a web search? I've never experienced that - is that a thing?


It's a thing. Turn up privacy features in your browser (including the undocumented ones you need to go to about:config to adjust) and stay logged out of google and you'll get them.

Or just fire off a lot of searches pretty fast e.g. by launching a bunch of tabs to search for variations of a term.


If privacy was that important to me, I'd be using DuckDuckGo instead of Google.


In my experience, I find DDG results less relevant.

I settled on Yandex. The only problem sometimes is that results from "internationalized" sites are in Russian.


> including the undocumented ones you need to go to about:config to adjust

about:config isn't a thing in my browser.


you're using the wrong browser


If you're accessing via a VPN, not logged into a Google account, doing a bunch of searches quickly... absolutely.

Basically, the more you appear like you might be trying to scrape Google results or otherwise abuse Google with an unreasonable quantity of requests, it'll ask you to prove you're human and not a bot.


I occasionally get them even while logged in. I assume it's some combination of VPN, browser privacy features, and the browser search shortcut (instead of going through google.com or changing the search from another results page).


If Google deems your request suspicious enough, yes.

You can try this yourself by Googling something suspicious, like common Google dorks. After a few variations of WordPress/phpAdmin Google dorks, you'll get a popup asking you to fill out a CAPTCHA to continue.

If you share your IP with lots of people (CGNAT, schools, large offices) then enough weird Googling can get the entire IP address stuck behind CAPTCHA's for a while. It usually clears after a few minutes, but I've seen it last for up to an hour when someone in the network was doing something they shouldn't have been doing.


> like common Google dorks

What is a 'Google dork' and what are the common ones?


Google Dorks are search terms that can find vulnerable services, open directories, that kind of stuff. Stuff you shouldn't put publically on a web server that a search engine manages to find.

This is an example:

>intext:phpMyAdmin SQL Dump filetype:sql intext:INSERT INTO `admin` (`id`, `user`, `password`) VALUES

It'll find publicly accessible phpMyAdmin backups, so don't click any of the results if you want to stay in the legal side of things.

Googling "Google dork" or "Google hacking" should provide you with more examples. If you try modifying the query a few times, Google will make you fill out a captcha.


You can get CAPTCHAs just by turning on a VPN. You don't need to do anything more "suspicious" than that.


I've never experienced this myself. I suppose it depends on what data center the VPN provider is in and what kind of VPN you're using?


Several people mentioned ways you can trigger it using 'nonstandard' (by Google's expectation) methods. In my case I hit it with just regular Chrome whenever I start doing a few searches that use more than basic keywords (so stuff that uses the prefixes like filetype: or parenthesis for logic)


If Google doesn't trust your browser for whatever reason (eg. privacy-conscious browsing).


I get these pretty often on Firefox Focus (Android), not because of any unusual searches (as far as I can tell)! It did at least push me to switch the default search to DDG.


Yes for me it is. I exclusively use a non chromium based browser with some extensions installed and always logged off Google.


on tor browser it shows them always.


If you're not in the US, all the time.

Just searching for documentation on not so well known libraries/errors will often trigger it for me, and I'm talking like 5-10 manual (read: typed by myself into a browser) searches will trigger a Captcha on Google.

Google positions that it suspects suspicious activity from my IP, but hard to guess how they classify this, as it's a stock browser with ublock* that I use every day.

reCaptcha and basically everything Google touches is awful to use outside of the US in my opinion. And I'm still not sure how their full window modal for Google Search Accepting Privacy hasn't been hit by a huge fine by the EU yet, since you absolutely cannot use Google without either blocking the model or going in and agreeing to "something" (you are allowed to turn off several options, but Google will send cookies and instructs you to set your browser to refuse cookies if you don't want them), which I'm positive is really not what GDPR was about at all.

This is part of why I'm against what a lot of US based tech companies do with the Web...they're happy to take money and personal information (forcibly) from non-US persons, but will not give them the same courtesies.

* Of course, maybe that does it...


> If you're not in the US, all the time.

I'm not in the US, never seen it.


It happens to me all the time after I started using VPNs regularly.


tor is great if you don't mind 99% of websites not working on it


I was considering dropping one of my VPS hosts, and when they started putting captchas in the way of logging in, that was the final straw that convinced me. It has also affected my decisions whether to sign up for or use other services. I wonder if web-based businesses consider the lost revenue resulting from annoying their customers or prospective customers this way?


Reality has 2 components.

1. The physical part. Sight, sound, etc.

2. The ideas.

Some kinds of reality are beautiful and meaningful all by itself. Flowers, healthy people, healthy animals, forests, natural landscapes, clouds, stuff like that.

Some kinds of reality are beautiful and meaningful only when you consider the ideas associated with them. Cars, streets, books, powerlines, stacks of money, feces, etc. And without the ideas they are quite ugly and nihilistic.

These AI pictures here are that second variety.

It makes you think. Or something.


> The one exception is, improbably, palm trees. I keep on getting CAPTCHAs asking me to recognize palm trees. I have no idea what’s going on there! Did, like, a Waymo car once slam into a palm tree?

Palm trees look kind of like street signs, and show up in places street signs also show up. To recognize street signs, an AI needs both examples of street signs, and examples of things that look like street signs, but aren't.


Will we ever run out of CAPTCHAs that computer vision can't solve? When reCAPTCHA was started, it used difficult-to-read letters to digitize books, but that's long gone at this point. It seems like Google's been feeding us all pictures of street features to identify for years. Someday adversarial models will catch up and be able to pass these CAPTCHAs (or maybe all CAPTCHAs) right? What then?


I’ve always wanted to do humorous/depressing captchas.

“Select all the images of public executions.”

“Select all the images of disgraced politicians.”

“Select all the images convicted war criminals.”


We don’t know what this training data might be used for in the future, especially considering it could be stolen. I always feel uneasy clicking on school busses, it feels too similar to a shoot em up game where I have to eliminate all of them, then “verify” when I’m done. Perhaps the interface is too similar to a scope on a weapon overlaid on everyday images.


CAPTCHAs are discriminating. They fail at what their name suggests they do occasionally. Which means they dehumanize humans. There are humans without eyesight, you know? And some of these have bad hearing. The web has decided that it is OK to classify these people are computers. And nobody cares because the solution is so convenient. Well, thats how society works.


They do have somewhat accessible alternative modes. Give them a try (these are even more dystopic — try having it read out some numbers for you to type).


If you want to see a lot of captchas, try browsing with Firefox mobile with ublock origin installed. It's sad how many people design for 100% chrome. To the point that being a stock Firefox user agent that doesn't receive all ads shows up as if you're a bot scraping the site.


It all comes down to how lazy (or perhaps cost-conscious) the developers of the website are. Most traffic is Chrome and Safari, so running those two tests covers nearly 85% of users[0] and most other browsers like Firefox make an effort to fix incompatibilities with Chrome. It’s the same for captchas - most people aren’t running in anonymous mode, and when they are, their IP is usually part of a major ISP and thus reputation can be partially assumed by the IP instead of browser cookie. It often doesn’t make sense to spend extra money just so to appease something like 5-10% of internet users (and might be less than 1% of a company’s actual customer base).

0: https://gs.statcounter.com/


One could have written the same thing about internet explorer in 2001 or so. History repeats itself.


Imagine that self-driving cars are a long way off from being reality because the AI isn't quite good enough to distinguish and classify objects in corner cases - of which there must be numerous. This would suggest these captcha tests are going to be with us for a long while too.


Why do they keep using captchas when this test of humanity has such a major flaw and there are so many people with this degree of visual disability who can still easily use computers? Don't programmers know there are laws against that? I know they don't care but to choose it as a means of proof of humanity - a test considered illegal in many countries - seems truly backward of technology.


The thing that gets me is this: I don’t want to train AI for free.

If you’re going to train models using our input, then you need to distribute the results as public good and make no profit from it.


How much does Google owe us for training their AI all these years?


Some of the captcha photos remind me of Studio Ghibli's animation films, in a positive way. The films linger on random objects in landscapes, from a variety of perspectives, for longer than feels "natural". Something about the effect is mesmerizing.

When I finished Whisper of the Heart, I remembered thinking that Kondo had made the suburbs of Tokyo look beautiful. It seemed that he'd done so simply by depicting them, by showing them as worth looking at.


failed one of these recently because it asked me to click on "bicycles", but there were a lot of motorcycles, and I didn't click on those... so I failed


If you get depressed by captcha images, your life is too easy.


Maybe the boring explanation is that street view scenery is the largest, fit for purpose dataset that Google actually owns and can safely use for this purpose.


"The machines themselves condition the users to employ each other the way they employ machines."

— God Emperor of Dune

Frank Herbert was a genius.


Captcha: prove you’re not a robot by teaching robots how to prove they’re not robots.


why do they keep using captchas when they so obviously discriminate against visually handicapped but people who can still easily use computers? Don't programmers know there are laws against that? I know they don't care but to choose as it as a means of proof of humanity - something that's illegal in many countries - seems so backward of technology.


why do they keep using captchas when they so obviously discriminate against visually handicapped but people who can still easily use computers? Don't programmers know there are laws against that? I know they don't care but to choose as it as a means of proof of humanity - something that's illegal in many countries - seems so backward of technology.


It's frustrating because they represent the actual drudgery of real life. It's not pretty, there's no beauty filter, there's no composition etc..

It shows that we live mostly in bits of fairly ugly industrial landscape.


Sometimes the captcha says I'm wrong even though I'm write because it got something very similar to something else. Then you end up having to think like an AI, which is super weird


Use the audio puzzle and type incorrect words that sound right.


so essentially the Captcha is the AI's sneaky way of getting humans to understand them, once we understand them the process of assimilation is at least 30% of the way done. Next - the hardware fittings.

Actually - if I was the AI trying to assimilate the humans I would start selling a google glasses type thing that allows you to skip captchas by automatically informing the captcha that a human is watching - watching through the AI's eyes.



I wish there was more captcha options. I'm tired of training autonomous driving in North America.


>dude you need to power the Google botnet. it’s for security.

Yea that’s depressing.


yes the pictures are dismal, but that's the reality of suburban America.


> I also don’t like being forced to donate free labor to AI companies to help train their visual-recognition systems.

Then you are free to not use the service that you are not paying for.


Are Captchas a version of Proof of Work ?


> Why are these photos so depressing? What is it about their composition that is so enervating?

If the causality was a property of the images, those questions would have definitive answers.

But our emotions are not transmitted to us by inanimate objects or images. They come from within our psyches. There is an element of choice to what we feel. If there wasn’t, we would be zombies, or machines, or vulnerable imbeciles who could be overcome by an enemy combatant who would need no gun, knife or club - just a picture of a traffic light.


Captcha has made me move to DucDuckGo, I hope Google is listening <<<<


I wish my life was so utterly without other problems that I could get this worked up about something so minor and meaningless.


yet it went viral, so apparently a lot of ppl find it interesting, and the traffic probably is an incentive for him to keep writing similar articles about seemingly mundane things. There is a huge online audience for mundane observations, as opposed to the always-on news cycle.


Probably for the same reasons that one of the predominant tones on Twitter is howling despair about, in the larger view, trifling things


Well yeah exactly. It is petty and meaningless. They already accepted Google doing this stuff to them for a long time and now they complain over a storm in a tea cup. Goodness me.

When this drops off of the top of HN, they will continue to click Google reCAPTCHAs once again, reminding them who really runs the web and how we got here in the first place.

And it is all thanks to everyone for accepting Google and doing that all by themselves. Have a pat on the back for your participation folks!


You just did.


Enh, not really. I got worked up enough to write one (now three!) sentences, not a lengthy article with illustrative screenshots.


As far as I understood the problem with Captcha was and is that it is too American not in a bad sense but culturally. People coming and using the Internet from developing countries might not be able to solve Captcha because their culture is different.

I was thinking how to solve this problem and I came to the conclusion that it is very hard to design puzzle for every country in the world so I decided to put them in cultures something like Civ game but then again the whole process of solving Captcha should be easy not exhausting and time consuming.

My solution was to use webcam if available and make people wave hand or some other gesture in order to verify that you are really human. You can detect webcam presence and webcam input very easily. Or if mic is present you can use mic and pronounce some sentence in order to verify that you are human. As well as webcam you can detect mic presence and mic input easily so Captcha can not be cheated by automated bots.

My solution is humane input as solution to the puzzle or to the task not observing pictures and writing down the text because every computer bot can do it just as good as humans or even better.

Captcha should be easy to do for humans, easy to verify but hard to solve for bots.

In my opinion depressing Captcha is not the problem the problem is that bots came to the point where they are as good as humans solving Captcha but some people struggle solving Captcha because they are not familiar with American culture or simply they do not know English.


> My solution was to use webcam if available and make people wave hand or some other gesture in order to verify that you are really human.

This seems even worse to me. Wave at the camera to prove you are human... This is a whole other level of creepy above depressing captchas. I would not do this, ever.


My solution was all about solving cultural problem of captcha as well as security by that I mean automated bots exploiting and solving captcha en masse. Ofc the service would guarantee you privacy I don't need to keep the video footage of you or the mic footage I would delete it immediately when the captcha task is solved.

You would need to trust the service the same like people are trusting logless VPN providers with their sensitive internet traffic logs.


It's not the security or trust that is even the issue.

Even if the footage was never recorded or deleted instantly after. Even if it was 100% anonymous and 100% guaranteed secure, it still feels like some creepy dystopian nightmare.

A system like this means we've catastrophically failed with technology. It's too dehumanizing. At this point, burn it all to the ground, we're done.


Then how we should solve captcha problem? Captcha should be easy to do for humans, easy to verify but hard to solve for bots. It should be humane and happy. How to do it?


It's easy for a bot to provide a pre-recorded or generated video of someone waving, and pronouncing a sentence is much harder for many humans than for bots. I don't think having to prove you're human will ever be a happy experience.


Captcha is served over browsers and browsers and websites can easily detect webcam device and process video recording. The same applies for mic and voice recording.

If webcam or mic is not detected and webcam recording or mic recording was given then obviously malicious actor is trying to cheat the captcha and submit fake recording/s.

Edit: You would be prompted with something like: "Wave your hand from left to right." And then video recorder would be presented to you and you would record yourself doing it and review the footage and submit it to the captcha task.

The same applies to mic and voice recording. For example you would be prompted with: Please say: "Life is like riding a bicycle. To keep your balance, you must keep moving." And then voice recorder would be presented to you and you would say it, review it and submit it in order to fulfill captcha task.

I'm betting on a physical recording device that a person has not on the ability or inability of bots or an AI to come up with a human video recording or a voice recording.


It's easy to make hardware or software virtual mics and cameras that can't be detected as such. Getting that pronunciation task right will be easier for a bot using TTS through a virtual mic than for many non-native English speakers.

A bigger problem is that once you've given some random site permission to access your mic or camera, it can use that access for anything it wants.


I really don't know how you can fake webcam device input or mic device input on browsers. If you know how to do it please explain me.

And speaking of recordings you can always check metadata and see if it is genuine or fake(edited).


OBS can present its output as a virtual webcam, so can Logitech's webcam software, so can driver-level code, so can lots of other things (https://duckduckgo.com/?q=%22virtual+webcam%22, or just search for your own phrase [fake webcam device]). Virtual microphones are similar, and there are lots of options, e.g. Equalizer APO does audio processing in the Windows kernel before applications get it, and supports VST plugins that can generate audio. Browsers see these things exactly how they see hardware webcams and microphones (since those go through drivers in the same way). Chromium or Firefox could easily be modified to have virtual mic and webcam support built-in, without needing driver-level shenanigans. Bots can be run in virtual machines where the "hardware" is just software that can be fed any input you like. Hardware-wise, a Teensy or Arduino can plug into a USB port, pretend to be any USB device, and feed in anything you like. You could even use a computer's real microphone and webcam, just pointing at the speakers and screen of another (but there's not much point, since doing it in software is simpler).

Metadata is trivial to modify, e.g. FFMpeg can do it, and it usually doesn't say anything about genuine-ness anyway. Besides, if you're generating your fake input in software, you'd just generate metadata to go with it.

Sorry, but there are so many holes in your idea that it seems completely unworkable. Even if new developments made it more feasible (new webcams and microphones that cryptographically sign their recordings? Still fakeable by the speakers and screen setup above. Depth-sensing cameras might be trickier.) people would rebel against allowing any and every site to access their webcam and microphone (and hence possibly spy on them).


Thanks for extensive explanation, but idk how feasible and cost effective would be to do this "en masse". It seems like a lot of work and effort for small gain of cracking a captcha task/s. And yes I agree privacy would be a problem because people don't want some random and untrusted site to access their webcam and/or mic. But I still thinks my idea has some potential. Maybe someone else will come up with better captcha idea.


It’s not even necessarily the culture, it’s occasionally bit me as a native English speaker but not of American English. It’s a very minor annoyance on par with “colour” versus “color” when writing CSS but occasionally the automotive ones throw me off. For example, it took a captcha for me to know the central reservation is called the meridian over the Atlantic.

I imagine it’s awful for people with English as a second language.


>I imagine it’s awful for people with English as a second language.

Exactly captcha is too much English oriented. I don't have anything against American English or British English but majority of people on the internet are not native English speakers anymore or are not familiar with all the words and variants/nuances of English.


It's bad enough being a Brit and told to identify the pictures of Crosswalks. Most of the captcha use American English terms and in the UK nobody uses the term "Crosswalk", the first time I saw that specific captcha it took me a while to understand what it was asking me to identify especially since the quality of the photographs isn't particularly amazing.


Median strip?


That's the one, must be the UK autocorrect!




Join us for AI Startup School this June 16-17 in San Francisco!

Guidelines | FAQ | Lists | API | Security | Legal | Apply to YC | Contact

Search: