Hacker News new | past | comments | ask | show | jobs | submit login

Seems like there is one instruction it didn't follow: The first task mentions the usernames should be exactly like in the list, yet the AI responds with "firebob" (as in the comment) rather than "FireBob1990" (as in the list)

Funnily enough, that is exactly the kind of thing a human might do, as we too are terrible at following instructions precisely.




Yes, I noticed this after I posted. Small errors like this become common when instructions reach this length. It randomly forgets to do steps that aren’t written down — it never leaves things blank, but it forgets pieces of compound directions.

I also suspect it was confused by the fact the name was abbreviated but not misspelled, and it was only told explicitly to ensure names are not misspelled. Still an error though.


I noticed the same thing and a few others did too.

Someone one twitter suggested that possibly the algorithm interpreted that as "abbreviated" but not "mis-spelled".

Either way it's intriguing.




Join us for AI Startup School this June 16-17 in San Francisco!

Guidelines | FAQ | Lists | API | Security | Legal | Apply to YC | Contact

Search: