Breaking ChatGPT: Patterns in Sequences

Here’s a sequence of numbers: 2,4,6,8,10,12,… What’s the next number in the sequence? Obviously 14. That one was simple. But what if we make finding the pattern more difficult? It turns out ChatGPT has serious difficulties with numerical patterns. The problem is not just that it can’t figure out the pattern. It makes up patterns that don’t exist. And then it acts as though it knows what’s going on when in fact it is clueless.

Pattern completion tasks like this have been part of aptitude testing for a long time. The NSA and CIA, for…