What is your assessment of Yann LeCun's argument that autoregressive transformers cannot achieve true reasoning?

Autoregressive language models alone certainly have fundamental limitations regarding planning, world modeling, and physical grounding. However, augmenting transformers with reinforcement learning, external verifiers, memory systems, and test-time compute scaling bridges much of the gap between passive pattern matching and active rational deliberation.