Prior to now few days, Apple’s provocatively titled paper, The Phantasm of Pondering, has sparked recent debate in AI circles. The declare is stark: in the present day’s language fashions don’t actually “cause”. As an alternative, they simulate the looks of reasoning till complexity reveals the cracks of their logic. Not surprisingly, the paper has triggered a rebuttal – entitled, The Phantasm of the Phantasm of Pondering, credited to “C. Opus”, a nod to Anthropic’s Claude Opus mannequin, and
Alex Lawsen, who initially revealed the commentary on the arXiv distribution service as a joke, apparently. The joke obtained out of hand and the response has been broadly circulated. Joke or not – does the LLM truly debunk Apple’s thesis? Not fairly.
What Apple reveals
The Apple staff got down to probe whether or not AI fashions can really cause – or whether or not they’re simply mimicking problem-solving primarily based on memorized examples. To do that, the staff designed duties the place complexity may very well be scaled in managed increments: extra disks within the Tower of Hanoi, extra checkers in Leaping Checkers, extra characters in River Crossing, extra blocks in Blocks World.
The idea is easy: if a mannequin has mastered reasoning in less complicated instances, it ought to be capable to lengthen those self same rules to extra advanced ones – particularly when ample compute and context size stay obtainable. However that’s not what occurs. The Apple paper finds that even when working effectively inside their token budgets and inference capabilities, fashions don’t rise to the problem.
As an alternative, they generate shorter, much less structured outputs as complexity will increase. This means a type of “giving up,” not a wrestle in opposition to laborious constraints. Much more telling, the paper finds that fashions usually scale back their reasoning effort simply when extra effort is required. As additional proof, Apple references 2024 and 2025 benchmark questions from the American Invitational Arithmetic Examination (AIME), a prestigious US arithmetic competitors for top-performing high-school college students.
Whereas human efficiency improves year-on-year, mannequin scores decline for extra the unseen 2025 batch – supporting the concept that AI success continues to be closely reliant on memorized patterns, and never versatile problem-solving.
The place Claude fails
The counterargument hinges on the concept that language fashions truncate responses not as a result of they fail to cause, however as a result of they “know” the output is turning into too lengthy. One cited instance reveals a mannequin halting mid-solution with a self-aware remark: “The sample continues, however to keep away from making this too lengthy, I’ll cease right here.”
That is offered as proof that fashions perceive the duty however select brevity.
However it’s anecdotal at greatest – drawn from a single social media submit – and makes a big inferential leap. Even the engineer who initially posted the instance doesn’t totally endorse rebuttal’s conclusion. They level out that increased era randomness (“temperature”) results in collected errors, particularly on longer sequences – so stopping early might not point out understanding, however entropy avoidance.
The rebuttal additionally invokes a probabilistic framing: that each transfer in an answer is sort of a coin flip, and ultimately even a small per-token error price will derail an extended sequence. However reasoning isn’t simply probabilistic era; it’s sample recognition and abstraction. As soon as a mannequin identifies an answer construction, later steps shouldn’t be unbiased guesses – they need to be deduced. The rebuttal doesn’t account for this.
However the true miss for the rebuttal is its argument that fashions can succeed if prompted to generate code. However this misses the entire level. Apple’s aim was to not take a look at whether or not fashions might retrieve canned algorithms; it was to guage their means to cause via the construction of the issue on their very own. If a mannequin solves an issue by merely recognizing it ought to name or generate a selected software or piece of code, then it isn’t actually reasoning – it’s simply recalling an answer or a sample.
In different phrases, if an AI mannequin sees the Tower of Hanoi puzzle and responds by outputting Lua code it has ‘seen’ earlier than, it’s simply matching the issue to a recognized template and retrieving the corresponding software. It isn’t ‘pondering’ via the issue; it’s simply subtle library search.
The place this leaves us
To be clear, the Apple paper isn’t bulletproof. Its remedy of the River Crossing puzzle is a weak level. As soon as sufficient individuals are added to the puzzle, the issue turns into unsolvable. And but Apple’s benchmark marks a “no answer” response as unsuitable. That’s an error. However the factor is, the mannequin’s efficiency has already collapsed earlier than the issue turns into unsolvable – which suggests the drop-off occurs not on the fringe of cause, however lengthy earlier than it.
In conclusion, the rebuttal’s response, whether or not AI assisted or AI generated, raises vital questions, particularly round analysis strategies and mannequin self-awareness. However the rebuttal rests extra on anecdote and hypothetical framing than on rigorous counter-evidence. Apple’s unique declare – that present fashions simulate reasoning with out scaling it – stays largely intact. And it isn’t truly new; knowledge scientists have been saying this for a very long time.
But it surely at all times helps, in fact, when massive corporations like Apple help the prevailing science. Apple’s paper might sound confrontational, at instances – within the title, alone. However its evaluation is considerate and well-supported. What it reveals is a reality the AI neighborhood should grapple with: reasoning is greater than token era, and with out deeper architectural shifts, in the present day’s fashions might stay trapped on this phantasm of pondering.
Maria Sukhareva has been working within the area of AI for 15 years – in AI mannequin coaching and product administration. She is principal key skilled in AI at Siemens. The views expressed are above are her’s, and never her employer’s. Her Substack weblog web page is right here; her web site is right here.