DoodleR33Riddles (theaihow doodle Short #33)
Duration 01:29 · voice ElevenLabs b3LAxfqGNXNMzmX4iSAv

[00:00] Change one word in a famous riddle and watch a very capable model get it wrong. Let me draw why that happens.

[00:07] Here is the original. A cowboy rode into town on Sunday, stayed one night, and rode out on Sunday. How is that possible?

[00:14] The answer is that the horse is called Sunday. A trick, and models are good at it, because that riddle is all over the internet.

[00:21] Now the altered one. Same cowboy, same one night, but he rides out on Monday.

[00:27] There is no trick left. He arrived Sunday, he stayed one night, he left Monday. That is just a calendar.

[00:33] But the shape still looks like a riddle. And that is what gets answered.

[00:38] So how often does this actually happen?

[00:41] Researchers built thirty of these pairs and ran nine models and a hundred people through them.

[00:47] The models got eighty five percent of the real riddles right, and about half of the altered ones.

[00:54] People did the opposite. They were better on the altered ones, and worse on the real riddles, because they read them literally.

[01:01] And the errors line up. Over ninety percent of the models' mistakes were reaching for a clever answer where none was needed.

[01:08] So it is not that it cannot reason. It answered the shape of the question instead of the words in it, and the shape was familiar.

[01:15] So what would you change one word of to test yours? Tell me in the comments. Follow for more AI concepts in drawings. And if you are building AI tools at work, we help teams do it properly. The A.I. How dot com.
