A new wave of research has revealed critical limitations in current AI models, particularly in their ability to handle complex logical and spatial reasoning tasks. According to a recent study published in MIT Technology Review, AI systems continue to struggle with puzzles and games that require nuanced understanding, adaptability, and spatial awareness, skills that humans perform with ease. This finding underscores a growing divide between human and artificial intelligence, raising questions about the true extent of AI's cognitive abilities. In late 2024, a team of scientists from Columbia University conducted a series of experiments using the New York Times' Connections puzzles, a popular daily challenge that requires identifying thematic connections among four seemingly unrelated words. At the time, even the most advanced AI models managed to solve only 18% of these puzzles correctly. However, by early 2025, several models had improved significantly, achieving near-perfect scores consistently. This rapid progress demonstrates the accelerating pace of AI development, yet it also highlights persistent challenges in areas such as subtle pattern recognition and abstract reasoning. Despite these gains, AI models still face notable shortcomings. One area where they falter is spatial reasoning, a fundamental skill that plays a crucial role in fields like architecture, engineering, and design. Mental rotation exercises, which ask individuals to identify the correct orientation of an object after it has been rotated, remain a major hurdle for large language models. Even with the ability to process visual input, AI systems frequently misinterpret or fail to recognize spatial relationships, suggesting a gap in their capacity to simulate human-like spatial thinking. Another challenge lies in memory and adaptability. While modern AI models possess vast amounts of stored knowledge, this strength can become a weakness when faced with novel or slightly altered scenarios. A 2024 study by researchers at Google and the University of Illinois Urbana-Champaign demonstrated this limitation through a set of Knights and Knaves puzzles. These puzzles rely on logical deduction based on statements made by characters who either always tell the truth or always lie. Although the models were trained on similar problems, they often failed to detect subtle inconsistencies, leading to incorrect conclusions. This suggests that AI systems may lack the flexibility required to adjust their responses in real-time when confronted with unfamiliar situations. The Knights and Knaves puzzles offer a clear example of this issue. Consider the first scenario involving Edward and Wallace. Wallace claims that Edward tells the truth, while Edward asserts that both he and Wallace are of the same type. Solving this requires careful analysis of the implications of each statement, a task that demands both logical precision and contextual awareness. Similarly, the second scenario introduces complexity by adding a third character, Alice, whose statements further complicate the logic. These puzzles expose the limitations of AI in handling layered reasoning, where small shifts in phrasing or structure can drastically alter the outcome. As AI continues to evolve, researchers emphasize the importance of designing tests that push the boundaries of current models. By exposing AI to increasingly challenging puzzles, developers can gain deeper insights into the nature of machine intelligence and identify areas where human cognition still holds an edge. This ongoing exploration not only helps refine AI capabilities but also reinforces the unique aspects of human problem-solving, creativity, and intuition.
★
Keep the news honest.
ObjectiveNews is reader-funded and ad-free — we show you the bias instead of hiding it. Support independent journalism for €4/month.
Become a Supporter