[D] Fun little discovery: Gemini is surprisingly bad at following simple number sequences

Try this: tell it to reply to you with the next number in a sequence, starting from 1, then you reply with the next one, and so on. After a few messages, it starts to output text instead of numbers, and after about 20 messages, it completely fails to keep following the sequence.

The original goal was to find out how good is its long-term memory, which seems to be pretty bad. Given its huge context window, how can it …

discovery fun gemini machinelearning messages next numbers simple text