A cowboy rides into town on Sunday, stays one night, and rides out on Sunday. The horse is named Sunday.

Now change one word. He rides out on Monday. The riddle has no trick anymore. It is a calendar.

Researchers built 30 riddle pairs like this and ran 9 AI models and 100 people through them. Models solved 85% of the real riddles and about half of the altered ones. People did the opposite. They read the words literally, so they did better on the altered versions and worse on the originals.

Over 90% of the models' mistakes were reaching for a clever answer where none was needed. The model answered the shape of the question instead of the words in it.

Which question would you change one word of to test your model? Tell me in the comments.

More AI concepts in drawings at theaihow.com

#AI #LLM #AIExplained #MachineLearning #Riddles
