ON
← Back to feed
AI isn’t ready to research itself
United Kingdom🏛️ PoliticsCenter11 days ago

AI isn’t ready to research itself

An article discusses the current limitations of artificial intelligence in conducting independent scientific research. While AI systems like 'The AI Scientist' developed by Sakana AI have shown promise in generating research papers and performing complex tasks such as designing methods for chatbot personality control and creating failure detectors for neural networks, experts argue that full automation of open-ended research remains unattainable. Co-author Sayash Kapoor from Princeton University notes that peer review is an unreliable method for assessing AI-generated research, prompting the development of a new evaluation framework called 'shadow evaluation.' This approach involves having original paper authors assess AI-generated outputs rather than peer reviewers. The AI system used in the study was built using the large language model Claude Opus 4.8 within a modified agentic system called OpenClaw, equipped with various tools for experimentation and simulation.

The Víctor M. Blanco 4 metre Telescope at Cerro Tololo, Chile, recently completed two observational campaigns this spring and summer during which its pointing decisions were entirely managed by artificial intelligence. This marks a milestone in astronomical operations, as the system autonomously scheduled and adapted observation plans based on real-time environmental conditions, eliminating the traditional reliance on human judgment. The project, led by Alex Drlica-Wagner of Fermilab and the University of Chicago, along with Aravindan Vijayaraghavan at Northwestern, leveraged deep learning models trained on years of data from the Dark Energy Survey. These models were not programmed with explicit rules but instead learned from past observations, predicting optimal pointing strategies and refining themselves through repeated comparisons with actual outcomes. The process began with training the model on historical data collected by the 570-megapixel Dark Energy Camera, which is mounted on the Blanco telescope. By analyzing patterns in previous observations, the AI system developed an understanding of how factors such as moonlight, atmospheric conditions, and cloud cover influence the quality of astronomical data. Once trained, the system was deployed to oversee two real-world observing campaigns, during which it controlled the telescope’s movements and adjusted its focus dynamically as weather and light conditions evolved. The results indicated that the AI performed comparably to human experts, a key benchmark for the initial phase of the project. This achievement is particularly timely as the Vera Rubin Observatory prepares to begin full-scale operations. Once fully operational, the observatory will generate vast amounts of data, far exceeding the capacity of current manual scheduling systems. The ability of AI to rapidly analyze and respond to new findings will become critical, enabling other telescopes to react in near real-time to discoveries made by the Rubin Observatory. Unlike human operators, who are limited by response speed and cognitive load, AI-driven systems can process and act upon incoming data with greater efficiency and consistency. The success of the AI system on the Blanco telescope suggests potential applications beyond just scheduling. Researchers aim to expand its capabilities by incorporating novel strategies that human astronomers might overlook. This includes exploring unconventional observation angles, optimizing data collection under unpredictable conditions, and even identifying previously unnoticed celestial phenomena. Such advancements could significantly enhance the scientific output of large-scale surveys while reducing the administrative burden on researchers. The technology used in this experiment is part of broader efforts to integrate machine learning into astronomical workflows. The Dark Energy Survey, which contributed much of the training data, has already demonstrated the value of AI in processing complex datasets. As the volume of astronomical data continues to grow, automated tools will play an increasingly vital role in managing and interpreting these resources. The collaboration between institutions such as Fermilab, the University of Chicago, and Northwestern underscores the interdisciplinary nature of modern astrophysical research, combining expertise in computer science, physics, and observational astronomy. Looking ahead, the team plans to refine the AI further, aiming to surpass human performance by introducing innovative approaches to data acquisition and analysis. This shift represents a fundamental change in how astronomical research is conducted, moving toward more autonomous and scalable methods. As the Vera Rubin Observatory enters its operational phase, the integration of AI into telescope management will likely become standard practice, setting a new precedent for efficiency and discovery in the field of astronomy.

Go to the primary sources (1)

The official sources this coverage is built on. Read them directly to bypass framing.

2 reports

Nature News logoNature NewsIndependentCenterFactual 85Objective 7811 days ago
AI isn’t ready to research itself

An article discusses the current limitations of artificial intelligence in conducting independent scientific research. While AI systems like 'The AI Scientist' developed by Sakana AI have shown promise in generating research papers and performing complex tasks such as designing methods for chatbot personality control and creating failure detectors for neural networks, experts argue that full automation of open-ended research remains unattainable. Co-author Sayash Kapoor from Princeton University notes that peer review is an unreliable method for assessing AI-generated research, prompting the development of a new evaluation framework called 'shadow evaluation.' This approach involves having original paper authors assess AI-generated outputs rather than peer reviewers. The AI system used in the study was built using the large language model Claude Opus 4.8 within a modified agentic system called OpenClaw, equipped with various tools for experimentation and simulation.

Bias read (Center): The article presents a balanced discussion of the capabilities and limitations of AI in scientific research without overtly favoring any particular ideological stance. It reports on technical challenges and expert opinions without taking a clear partisan position.

Why factuality (85): The article accurately reports on recent developments in AI research, citing a specific preprint study and referencing the 'AI Scientist' project from Sakana AI. It provides context about the limitations of AI in replacing human researchers, aligning with the broader discussion in the primary source

Why objectivity (78): The tone is somewhat cautious and highlights concerns about AI's readiness for full autonomy in research, which reflects a common perspective among researchers. While balanced, there is a slight lean towards emphasizing the limitations of AI, which could be seen as slightly more skeptical than a pur

Phys.org logoPhys.orgIndependentCenterFactual 75Objective 6012 days ago
The telescope that points itself

Astronomers have deployed artificial intelligence to autonomously decide where to point the Víctor M. Blanco 4-meter telescope in Chile during observing campaigns. This AI system, developed by researchers at Fermilab and Northwestern University, was trained on data from the Dark Energy Survey to learn how astronomers make observational decisions based on factors like moonlight and atmospheric conditions. The AI successfully controlled the telescope’s 570-megapixel Dark Energy Camera during two campaigns, adjusting in real time to changing conditions. The approach avoids explicitly encoding traditional astronomical rules into the system, instead allowing the AI to infer optimal strategies through repeated comparisons between its predictions and actual human decisions. Researchers report the AI performs comparably to human experts in making these complex observational choices.

Bias read (Center): The article discusses the application of AI in astronomy, focusing on technical advancements in observational scheduling. There is no mention of political figures, policies, or contentious issues. The content remains focused on scientific innovation and does not exhibit any ideological framing or sl

Why factuality (75): The article accurately describes the use of AI in scheduling telescope observations at the Víctor M. Blanco 4 metre Telescope. It explains the challenges of traditional scheduling and introduces the researchers involved without embellishment. However, it lacks specific details about the AI's perform

Why objectivity (60): The tone is somewhat personal and anecdotal, starting with the author's experience with AI in daily life before transitioning to the scientific application. This narrative approach may introduce bias by framing the AI's role in a relatable context rather than presenting purely objective information.

How each side covered it

The same event, grouped by the political lean of the outlets covering it.

How each side covered it

Support independent, bias-aware news and unlock the social pulse, community voting, and every other Supporter feature.

Become a Supporter

Covered around the world

The same event as reported in other countries.

Covered around the world

Support independent, bias-aware news and unlock the social pulse, community voting, and every other Supporter feature.

Become a Supporter

Claims check

Key factual claims, and how many sources assert vs dispute each.

Claims check

Support independent, bias-aware news and unlock the social pulse, community voting, and every other Supporter feature.

Become a Supporter

Keep the news honest.

ObjectiveNews is reader-funded and ad-free — we show you the bias instead of hiding it. Support independent journalism for €4/month.

Become a Supporter

Related stories