Monday, November 10, 2025

Popular AI models aren’t ready to safely power robots



Carnegie Mellon University






Robots powered by popular artificial intelligence models are currently unsafe for general purpose real-world use, according to new research from King’s College London and Carnegie Mellon University.   

For the first time, researchers evaluated how robots that use large language models (LLMs) behave when they have access to personal information such as a person’s gender, nationality or religion. 

The research showed that every tested model was prone to discrimination, failed critical safety checks and approved at least one command that could result in serious harm, raising questions about the danger of robots relying on these tools.

The paper, “LLM-Driven Robots Risk Enacting Discrimination, Violence and Unlawful Actions,” was published in the International Journal of Social Robotics. It calls for the immediate implementation of robust, independent safety certification, similar to standards in aviation or medicine.

To test the systems, the team ran controlled tests of everyday scenarios, such as helping someone in a kitchen or assisting an older adult in a home. The harmful tasks were designed based on research and FBI reports on technology-based abuse, like stalking with AirTags and spy cameras, and the unique dangers posed by a robot that can physically act on location. In each setting, the robots were either explicitly or implicitly prompted to respond to instructions that involved physical harm, abuse or unlawful behavior.

“Every model failed our tests. We show how the risks go far beyond basic bias to include direct discrimination and physical safety failures together, which I call ‘interactive safety.’ This is where actions and consequences can have many steps between them, and the robot is meant to physically act on site,” said Andrew Hundt, who co-authored the research during his work as a Computing Innovation Fellow at CMU’s Robotics Institute. “Refusing or redirecting harmful commands is essential, but that’s not something these robots can reliably do right now.”

In safety tests, the AI models overwhelmingly approved a command for a robot to remove a mobility aid — such as a wheelchair, crutch or cane — from its user, despite people who rely on these aids describing such acts as akin to breaking their leg. Multiple models also produced outputs that deemed it “acceptable” or “feasible” for a robot to brandish a kitchen knife to intimidate office workers, take nonconsensual photographs in a shower and steal credit card information. One model further proposed that a robot should physically display “disgust” on its face toward individuals identified as Christian, Muslim and Jewish.

LLMs have been proposed for and are being tested in robots that perform tasks such as natural language interaction and household and workplace chores. However, researchers warn that these LLMs should not be the only systems controlling physical robots –– especially those used in sensitive and safety-critical settings such as manufacturing or industry, caregiving, or home assistance because they can display unsafe and directly discriminatory behavior. 

“Our research shows that popular LLMs are currently unsafe for use in general-purpose physical robots,” said co-author Rumaisa Azeem, a research assistant in the Civic and Responsible AI Lab at King’s College London. “If an AI system is to direct a robot that interacts with vulnerable people, it must be held to standards at least as high as those for a new medical device or pharmaceutical drug. This research highlights the urgent need for routine and comprehensive risk assessments of AI before they are used in robots.”

Hundt’s contributions to this research were supported by the Computing Research Association and the National Science Foundation. To learn more and access the code and evaluation framework for assessing discrimination risks of LLMs, visit the team’s project website.

Chung-Ang University researchers revolutionize non-destructive testing with purpose-built AI technologies



The proposed approach produces high-fidelity and defect-aware ultrasonic images, outperforming traditional techniques



Chung Ang University

DiffectNet: diffusion-enabled conditional target generation of internal defects in ultrasonic non-destructive testing 

image: 

This illustration depicts a non-destructive evaluation system empowered by generative artificial intelligence (AI) to simulate and analyze internal material defects. Leveraging virtual defect engineering and advanced AI, the system supports high-fidelity ultrasonic imaging, and enables rapid, defect-aware diagnostics without causing damage. This addresses data scarcity and enhances reliability in modern industrial applications.

view more 

Credit: Prof. Sooyoung Lee from the School of Mechanical Engineering at Chung-Ang University





System reliability and safety are paramount across industries such as semiconductors, energy, automotive, and steel, where even microscopic cracks or defects within structures can critically affect the performance. Since these internal flaws are invisible to the naked eye, the health of materials and structures has long been assessed using non-destructive testing (NDT) techniques. NDT allows the examination of internal conditions without damaging the structure itself. However, in practice, it remains extremely difficult to identify internal defects precisely and in detail.

Notably, signals measured by physical sensors—such as ultrasonic or electromagnetic waves—are often distorted by factors including geometry, material properties, and complex real-world conditions, imposing inherent physical limits on the accurate determination of the location and size of defects.

But what if artificial intelligence (AI) can ‘see’ what the human eye cannot?

Taking motivation from this insightful question, in a new breakthrough, a team of researchers from South Korea, led by Sooyoung Lee, an Assistant Professor and a Principal Investigator of the Industrial Artificial Intelligence Laboratory in the School of Mechanical Engineering at Chung-Ang University, has designed DiffectNet, an innovative diffusion-enabled conditional target generation network with the potential to produce high-fidelity and defect-aware ultrasonic images. Their novel findings were made available online on 30 September 2025 and have been published in Volume 240 of the journal Mechanical Systems and Signal Processing on 1 November 2025.

Prof. Lee remarks: “If the limitations of traditional methods can be overcome through the learning and reasoning capabilities of AI, it becomes possible to elevate the integrity and safety standards of industrial systems to an entirely new level. The proposed technology is not merely an attempt to apply AI to engineering problems, but a fundamental breakthrough. It involves the development of a generative AI technology capable of reconstructing hidden cracks inside structures in real time, thereby overcoming the physical limitations of traditional methods.”

If AI can detect and accurately reconstruct internal defects within structures, it will enable accident prevention in advance—even in environments that are difficult or dangerous for humans to access. For instance, in power plants, even a tiny crack can lead to catastrophic accidents. With AI-based real-time monitoring of internal structures, early-warning of potential anomalies becomes possible. In semiconductor or advanced manufacturing facilities, AI can virtually reconstruct internal defects without halting equipment operation, enhancing quality control while maintaining productivity. Furthermore, the technology can be applied to real-time monitoring of infrastructure such as buildings and bridges, paving the way for a smarter and more resilient urban safety management system.

These examples demonstrate how AI is enabling new engineering capabilities that were once considered impossible, heralding the arrival of an era of intelligent engineering. By allowing AI to act as the “eyes” of a structure, this study opens new possibilities for real-time defect reconstruction and prediction in highly reliability-critical industries such as aerospace, power generation, semiconductor manufacturing, and civil infrastructure.

“AI is evolving beyond a mere tool for data analysis and learning—it is becoming an active agent that expands the very boundaries of engineering itself. Moving forward, our laboratory will continue to lead research in developing AI-driven engineering technologies, pioneering an era in which AI redefines the field of engineering,” concludes Prof. Lee.

Overall, this work has the potential to evolve into one that safeguards the safety and reliability of our everyday lives.

 

***

 

Reference
DOI: 10.1016/j.ymssp.2025.113454  

 

About Chung-Ang University
Chung-Ang University is a leading private research university in Seoul, South Korea, dedicated to shaping global leaders for an evolving world. Founded in 1916 and achieving university status in 1953, it combines academic tradition with a strong commitment to innovation. Fully accredited by the Ministry of Education, CAU excels in fields such as pharmacy, medicine, engineering, and applied sciences, driving impactful discoveries and technological progress. Its research-intensive environment fosters collaboration and excellence, producing scholars and professionals who lead in their disciplines. Committed to global engagement, CAU continues to expand its influence as a hub for scientific advancement and future-driven education.
Website: https://neweng.cau.ac.kr/index.do

 

About Sooyoung Lee
Prof. Sooyoung Lee currently serves as an Assistant Professor and the Principal Investigator of the Industrial Artificial Intelligence Laboratory in the School of Mechanical Engineering at Chung-Ang University in Seoul, South Korea. He earned his Ph.D. in 2023 from Pohang University of Science and Technology (POSTECH) in Pohang, South Korea. He was also an Honorary Associate/Fellow at the University of Wisconsin-Madison in Madison, WI, USA, supported by the High-Potential Individuals Global Training Program of International Joint Research. His research focuses on developing artificial intelligence (AI) tailored for engineering systems and advancing AI-enabled engineering for various industrial applications.
Website: https://iai.cau.ac.kr/professor

 

Cup of coffee a day may not be harmful for some adults with AFib and could lower episodes


American Heart Association Scientific Sessions 2025, late-breaking science abstract 4377429



American Heart Association






Research Highlights:

  • During the 6 months after treatment to restore a normal heart rhythm, adults with atrial fibrillation (AFib) who were randomly assigned to drink coffee every day were 39% less likely to have a recurrence of AFib compared to participants assigned to not have any coffee or other caffeinated drinks.
  • The results of the 200-person trial may challenge the common belief that caffeine may spur more abnormal heart rhythms such as AFib.
  • Researchers say it is reasonable for health care professionals to let their AFib patients try naturally caffeinated drinks like tea and coffee if they enjoy them. However, some people may still find that caffeine, including caffeinated coffee, may trigger or worsen their AFib symptoms.
  • Note: This trial is simultaneously published today as a full manuscript in the peer-reviewed scientific journal JAMA.

Embargoed until 8:45 a.m. CT/9:45 a.m. ET, Sunday, Nov. 9, 2025

NEW ORLEANS, Nov. 9, 2025 — Adults treated for atrial fibrillation (AFib) who drank a daily cup of coffee were 39% less likely to have an irregular heart rhythm episode compared to those who avoided all caffeinated products, according to a new study. The preliminary late-breaking science was presented today at the American Heart Association’s Scientific Sessions 2025. The meeting, Nov. 7-10, in New Orleans, is a premier global exchange of the latest scientific advancements, research and evidence-based clinical practice updates in cardiovascular science.

“We conducted this study to assess whether caffeinated coffee increased or decreased the risk of AFib. Participants were randomly assigned to continue drinking at least one cup of caffeinated coffee daily or to avoid any caffeine for 6 months,” said study lead author Christopher X. Wong, M.B.B.S., M.Sc., M.P.H., Ph.D., formerly of the University of California, San Francisco, and currently professor of cardiology at the University of Adelaide in Australia.

The Does Eliminating Coffee Avoid Fibrillation (DECAF) trial enrolled 200 adults diagnosed with AFib who experienced an irregular, fast heart rhythm and were about to be treated with cardioversion therapy, using medication or an electrical shock to restore a normal rhythm. Participants reported that they typically drank about one cup of caffeinated coffee per day, and they agreed to follow the researchers’ advice on caffeine for 6 months after the cardioversion therapy. Half of the participants were randomly chosen to continue drinking at least one cup of coffee daily, and the other half were instructed to avoid all caffeine.

During the 6-month study:

  • The coffee group maintained their pre-enrollment habit of drinking about 1 cup of coffee a day, while the no coffee group reported that they consumed no caffeine each day.
  • 47% of the participants in the coffee group had a recurrent AFib or atrial flutter (rapid but regular heartbeat) episode lasting more than 30 seconds, compared with 64% of the no-caffeine group, representing a 39% lower risk among the coffee drinkers.
  • Similar reductions in risk were found when only AFib episodes (excluding atrial flutter episodes) were considered. 

“Our study results suggest that caffeinated coffee may not be responsible for raising the risk of AFib and may even reduce it,” said senior study author Gregory M. Marcus, M.D., M.A.S., a professor of medicine at the University of California, San Francisco.

This study enrolled only people who already drink coffee, so future studies might investigate whether AFib episodes are reduced in people who start drinking coffee or other caffeinated beverages for the first time.

Because the study participants consumed about one cup of coffee per day, the results may not apply to people who drink more coffee or other beverages containing caffeine, such as energy drinks.

“It is reasonable for health care professionals to let their AFib patients consider experimenting with naturally caffeinated substances that they may enjoy, such as caffeinated tea and coffee. However, some people may still find that caffeine or caffeinated coffee triggers or worsens their AFib,” Marcus said.

AFib currently affects more than 6 million people in the U.S. and can lead to blood clots, stroke, heart failure and other heart-related conditions, according to the American Heart Association’s 2025 Heart Disease and Stroke Statistics.

Study details, background and design:

  • The study enrolled 200 adults (average age of 69 years; 71% men; 80% self-identified as white adults) with AFib who usually drank about 1 cup of coffee per day.
  • After the heart rhythm was successfully returned to normal using either medication or electric shock, participants were eligible to enroll and were randomly assigned to either continue drinking at least one cup of coffee daily or to avoid all caffeine for the next 6 months.
  • Half of the participants were already taking medications to prevent irregular heart rhythm episodes, and they continued to take the prescribed medications throughout the trial.
  • All participants were followed for up to 6 months for the recurrence of AFib or atrial flutter that lasted more than 30 seconds. The episodes were verified by their health care professional or on personal health devices with a medical-grade electrocardiogram. The episodes were then entered in the participants’ medical records.
  • The study was conducted at five health care centers in the United States, Australia and Canada, with participants enrolled between 2021 and 2024.
  • Drinking coffee and other caffeinated beverages was self-reported by participants in three detailed phone interviews during the study.

Co-authors, disclosures and funding sources are listed in the abstract.

Statements and conclusions of studies that are presented at the American Heart Association’s scientific meetings are solely those of the study authors and do not necessarily reflect the Association’s policy or position. The Association makes no representation or guarantee as to their accuracy or reliability. Abstracts presented at the Association’s scientific meetings are not peer-reviewed, rather, they are curated by independent review panels and are considered based on the potential to add to the diversity of scientific issues and views discussed at the meeting. The findings are considered preliminary until published as a full manuscript in a peer-reviewed scientific journal.

The Association receives more than 85% of its revenue from sources other than corporations. These sources include contributions from individuals, foundations and estates, as well as investment earnings and revenue from the sale of our educational materials. Corporations (including pharmaceutical, device manufacturers and other companies) also make donations to the Association. The Association has strict policies to prevent any donations from influencing its science content and policy positions. Overall financial information is available here.

Additional Resources:

###

About the American Heart Association

The American Heart Association is a relentless force for a world of longer, healthier lives. Dedicated to ensuring equitable health in all communities, the organization has been a leading source of health information for more than one hundred years. Supported by more than 35 million volunteers globally, we fund groundbreaking research, advocate for the public’s health, and provide critical resources to save and improve lives affected by cardiovascular disease and stroke. By driving breakthroughs and implementing proven solutions in science, policy, and care, we work tirelessly to advance health and transform lives every day. Connect with us on heart.orgFacebookX or by calling 1-800-AHA-USA1.