Language as a Bottleneck in AI Reasoning (samsja.github.io)

Summary:

• Chain of Thought (COT) allows autoregressive LLMs like GPT to reason step by step in language, unlocking new use cases.
• However, reasoning via language is computationally inefficient and limits AI's potential for more advanced, non-verbal reasoning.