The ‘strawberrry’ downside: The best way to overcome AI’s limitations

By now, giant language fashions (LLMs) like ChatGPT and Claude have turn out to be an on a regular basis phrase throughout the globe. Many individuals have began worrying that AI is coming for his or her jobs, so it’s ironic to see virtually all LLM-based programs flounder at an easy activity: Counting the variety of “r”s within the phrase “strawberry.” They aren’t completely failing on the alphabet “r”; different examples embody counting “m”s in “mammal”, and “p”s in “hippopotamus.” On this article, I’ll break down the explanation for these failures and supply a easy workaround.

LLMs are highly effective AI programs skilled on huge quantities of textual content to grasp and generate human-like language. They excel at duties like answering questions, translating languages, summarizing content material and even producing inventive writing by predicting and developing coherent responses primarily based on the enter they obtain. LLMs are designed to acknowledge patterns in textual content, which permits them to deal with a variety of language-related duties with spectacular accuracy.

Regardless of their prowess, failing at counting the variety of “r”s within the phrase “strawberry” is a reminder that LLMs aren’t able to “considering” like people. They don’t course of the data we feed them like a human would.

Nearly all the present excessive efficiency LLMs are constructed on transformers. This deep studying structure doesn’t instantly ingest textual content as their enter. They use a course of referred to as tokenization, which transforms the textual content into numerical representations, or tokens. Some tokens could be full phrases (like “monkey”), whereas others may very well be components of a phrase (like “mon” and “key”). Every token is sort of a code that the mannequin understands. By breaking all the pieces down into tokens, the mannequin can higher predict the following token in a sentence. 

LLMs don’t memorize phrases; they attempt to perceive how these tokens match collectively in several methods, making them good at guessing what comes subsequent. Within the case of the phrase “hippopotamus,” the mannequin would possibly see the tokens of letters “hip,” “pop,” “o” and “tamus”, and never know that the phrase “hippopotamus” is product of the letters — “h”, “i”, “p”, “p”, “o”, “p”, “o”, “t”, “a”, “m”, “u”, “s”.

A mannequin structure that may instantly take a look at particular person letters with out tokenizing them might probably not have this downside, however for in the present day’s transformer architectures, it isn’t computationally possible.

Additional, taking a look at how LLMs generate output textual content: They predict what the following phrase can be primarily based on the earlier enter and output tokens. Whereas this works for producing contextually conscious human-like textual content, it isn’t appropriate for easy duties like counting letters. When requested to reply the variety of “r”s within the phrase “strawberry”, LLMs are purely predicting the reply primarily based on the construction of the enter sentence.

Right here’s a workaround

Whereas LLMs won’t have the ability to “assume” or logically cause, they’re adept at understanding structured textual content. A splendid instance of structured textual content is pc code, of many many programming languages. If we ask ChatGPT to make use of Python to depend the variety of “r”s in “strawberry”, it’s going to more than likely get the proper reply. When there’s a want for LLMs to do counting or another activity that will require logical reasoning or arithmetic computation, the broader software program will be designed such that the prompts embody asking the LLM to make use of a programming language to course of the enter question.

Conclusion

A easy letter counting experiment exposes a basic limitation of LLMs like ChatGPT and Claude. Regardless of their spectacular capabilities in producing human-like textual content, writing code and answering any query thrown at them, these AI fashions can not but “assume” like a human. The experiment reveals the fashions for what they’re, sample matching predictive algorithms, and never “intelligence” able to understanding or reasoning. Nonetheless, having a previous information of what sort of prompts work nicely can alleviate the issue to some extent. As the combination of AI in our lives will increase, recognizing its limitations is essential for accountable utilization and reasonable expectations of those fashions.

 Chinmay Jog is a senior machine studying engineer at Pangiam.