New program takes us one step closer to autonomous robots

by Peter Grad , Tech Xplore

Feasibility verification for push door with recoil behaviors.

 Credit: Science Robotics (2023). DOI: 10.1126/scirobotics.adg5014

We've watched the remarkable evolution of robotics over the past decade with models that can walk, talk and make gestures like humans, undertake tasks from moving heavy machinery to delicately manipulating tiny objects, and maintain balance on two or four legs over rough and hostile terrain.

As impressive as the latest robots are, their accomplishments are largely the result of task-specific programming or remote instruction from humans.

Researchers at ETH Zurich have developed a program that helps robots tackle activities that do not rely on "prerecorded expert demonstrations," as the developers put it, or "densely engineered rewards."

Instead, they designed an approach in which the robot can "rapidly discover a feasible and near optimal multi-modal sequence that solves the task." In other words, they provide an environment in which robots can achieve objectives with minimal guidance from human operators.

The research was reported in the Aug. 16 edition of Science Robotics. The paper, "Versatile multicontact planning and control for legged loco-manipulation," was prepared by Jean-Pierre Sleiman, Farbod Farshidian and Marco Hunter of the Robotic Systems Lab at the public research university ETH Zurich.

"Given high-level descriptions of the robot and object, along with a task specification encoded through a sparse objective," Sleiman said, "our planner holistically discovers how the robot should move, what forces it should exert, what limbs it should use, as well as when and where it should establish or break contact with the object."

Credit: Science Robotics (2023). DOI: 10.1126/scirobotics.adg5014

Demonstration videos show ANYbotics' quadrupedal ANYmal mastering the opening of a dishwasher door and deftly opening a weighted door and keeping it open with a leg while maneuvering through.

"The framework can be readily adapted to different kinds of mobile manipulators," Sleiman said.

The last several years have seen great strides in robotic development. Boston Dynamics, a leading player in the field of robotics, created Atlas in 2013. With stereo vision and fine motor abilities, it could maintain balance in a hostile environment. It eventually was improved to get in and out of vehicles, open doors and handle power equipment. Agility Robotics' Cassie in 2016 exhibited superior walking and running capacity.

In 2017, a lifelike Sophia that smoothly mimicked human gestures and behavior was dispatched to assist the elderly in nursing facilities and play with children. And highly advanced tactile manipulation was demonstrated in 2019 with OpenAI's Dactyl: After training sessions that its developers estimated would take humans 13,000 years to complete, the single-handed Dactyl could easily manipulate a Rubik's cube and solve the 3D combination puzzle, which has stymied millions of users since its release in 1974, in just four minutes.

Planning and control architecture for multicontact loco-manipulation. 

Credit: Science Robotics (2023). DOI: 10.1126/scirobotics.adg5014

More recently, the last few years have seen Boston Dynamics' four-legged Spot, which can walk three miles, climb hills, conquer obstacles and perform specialized tasks. And Ameca, considered one of the most—if not the most—lifelike robot, engages in smooth conversation and generates facial expressions and hand gestures that are remarkably humanlike.

ETH Zurich, which would take the grand accomplishments of its predecessors and eliminate—or at least greatly reduce—the need for humans to control robots behind the scenes, has taken a key step in the next stage of robot development.

More information: Jean-Pierre Sleiman et al, Versatile multicontact planning and control for legged loco-manipulation, Science Robotics (2023). DOI: 10.1126/scirobotics.adg5014

Journal information: Science Robotics 

© 2023 Science X NetworkResearchers expand ability of robots to learn from videos

Lifelike robots and android dogs wow visitors at Beijing robotics fair

A human-like robot performs near robots of faces that mimic human expressions during the annual World Robot Conference at the Etrong International Exhibition and Convention Center on the outskirts of Beijing, Thursday, Aug. 17, 2023. 

Credit: AP Photo/Andy Wong

Winking, grimacing or nodding their heads, robots mimicked the expressions of visitors at a robot expo in Beijing.

They were among the creations dazzling people attending the annual World Robot Conference, where companies showed off robots designed for a wide range of uses, including manufacturing, surgery and companionship.

The animatronic heads and humanoid robots on display at the EX Robots booth this week personified the image of what robots are supposed to be in the popular imagination, with synthetic skin and lifelike facial expressions complimented by moving arms and hands.

CEO Li Boyang said they're ideal for roles that require interacting with the public, such as in museums, tourist attractions, school settings and "companion scenarios."

Doggie droids—a mainstay of high tech fairs—were out in force. Canine robots shook hands with fairgoers and performed handstands on their front paws.

Elsewhere at the fair, robotic arms served Chinese tea, prepared ice cream cones, bounced ping pong balls and gave visitors back massages.

Harvesting robots demonstrated how they could pick apples off the branch, while an artist robot drew portraits of visitors.

Industrial robot arms for factory production lines also grabbed focus. One of Chinese leader Xi Jinping's goals is to move the country's vast manufacturing sector away from low-cost creation of cheap goods into more high-tech production, and industrial robots will be an important element of that plan.

Human like robots and robotic faces that mimic human expressions are displayed at the annual World Robot Conference at the Beijing Etrong International Exhibition and Convention Center in Beijing, Wednesday, Aug. 16, 2023. Credit: AP Photo/Ng Han Guan

A worker charges robots displayed at the annual World Robot Conference at the Beijing Etrong International Exhibition and Convention Center in Beijing, Wednesday, Aug. 16, 2023. Credit: AP Photo/Ng Han Guan

Visitors watch human-like robots and robotic faces that mimic human expressions during the annual World Robot Conference at the Etrong International Exhibition and Convention Center on the outskirts of Beijing, Thursday, Aug. 17, 2023. Credit: AP Photo/Andy Wong

A man looks at the industrial robotic arms from Yaskawa Shougang Robot Co. Ltd on display at the annual World Robot Conference at the Etrong International Exhibition and Convention Center on the outskirts of Beijing, Thursday, Aug. 17, 2023. Credit: AP Photo/Andy Wong

Visitors watch a robotic arm playing a table tennis ball during the annual World Robot Conference at the Etrong International Exhibition and Convention Center on the outskirts of Beijing, Thursday, Aug. 17, 2023. Credit: AP Photo/Andy Wong

An exhibitor watches a visitor receiving a massage by a robotic arm during the annual World Robot Conference at the Etrong International Exhibition and Convention Center on the outskirts of Beijing, Thursday, Aug. 17, 2023. Credit: AP Photo/Andy Wong

Visitors look at the remote control robots perform during the annual World Robot Conference at the Etrong International Exhibition and Convention Center on the outskirts of Beijing, Thursday, Aug. 17, 2023. Credit: AP Photo/Andy Wong

A visitor touches robotic fingers during the annual World Robot Conference at the Etrong International Exhibition and Convention Center on the outskirts of Beijing, Thursday, Aug. 17, 2023. Credit: AP Photo/Andy Wong

Visitors look at robots perform on stage during the annual World Robot Conference at the Etrong International Exhibition and Convention Center on the outskirts of Beijing, Thursday, Aug. 17, 2023. Credit: AP Photo/Andy Wong

A robot face capable of mimicking human like expressions is displayed near robotic arms at the annual World Robot Conference at the Beijing Etrong International Exhibition and Convention Center in Beijing, Wednesday, Aug. 16, 2023. Credit: AP Photo/Ng Han Guan

An exhibitor teaches a visitor to control a robotic arm during the annual World Robot Conference at the Etrong International Exhibition and Convention Center on the outskirts of Beijing, Thursday, Aug. 17, 2023. Credit: AP Photo/Andy Wong

Visitors look at a robotic arm performs a Chinese tea serving during the annual World Robot Conference at the Etrong International Exhibition and Convention Center on the outskirts of Beijing, Thursday, Aug. 17, 2023. Credit: AP Photo/Andy Wong

A woman poses in front of a six arm robot at the annual World Robot Conference at the Beijing Etrong International Exhibition and Convention Center in Beijing, Wednesday, Aug. 16, 2023. Credit: AP Photo/Ng Han Guan

Visitors look at robot palms during the annual World Robot Conference at the Etrong International Exhibition and Convention Center on the outskirts of Beijing, Thursday, Aug. 17, 2023. Credit: AP Photo/Andy Wong

Children gather to watch a robotic arm perform ice cream serving during the annual World Robot Conference at the Etrong International Exhibition and Convention Center on the outskirts of Beijing, Thursday, Aug. 17, 2023. Credit: AP Photo/Andy Wong

Visitors look at remotely controled robots perform a jump during the annual World Robot Conference at the Etrong International Exhibition and Convention Center on the outskirts of Beijing, Thursday, Aug. 17, 2023. Credit: AP Photo/Andy Wong

A device for scanning the human brain to help diagnose mental afflictions is displayed at the annual World Robot Conference at the Beijing Etrong International Exhibition and Convention Center in Beijing, Wednesday, Aug. 16, 2023. Credit: AP Photo/Ng Han Guan

An exhibitor walks with his robot passing by visitors during the annual World Robot Conference at the Etrong International Exhibition and Convention Center on the outskirts of Beijing, Thursday, Aug. 17, 2023. Credit: AP Photo/Andy Wong

Visitors look at a remote control robot perform a walk during the annual World Robot Conference at the Etrong International Exhibition and Convention Center on the outskirts of Beijing, Thursday, Aug. 17, 2023. Credit: AP Photo/Andy Wong

Robotic arms perform near a robotic face capable of mimicking human-like expressions during the annual World Robot Conference at the Etrong International Exhibition and Convention Center on the outskirts of Beijing, Thursday, Aug. 17, 2023. Credit: AP Photo/Andy Wong

A human like cyborg and an image of a robot dog is displayed at the Xiaomi booth at the annual World Robot Conference at the Beijing Etrong International Exhibition and Convention Center in Beijing, Wednesday, Aug. 16, 2023. Credit: AP Photo/Ng Han Guan

A robot receptionist with a screen showing Chinese President Xi Jinping is displayed at the annual World Robot Conference at the Beijing Etrong International Exhibition and Convention Center, Wednesday, Aug. 16, 2023. Credit: AP Photo/Ng Han Guan

Visitors look at an exhibitor showcasing a walking robot during the annual World Robot Conference at the Etrong International Exhibition and Convention Center on the outskirts of Beijing, Thursday, Aug. 17, 2023. Credit: AP Photo/Andy Wong

Visitors look at a robotic arm performs a Chinese tea serving during the annual World Robot Conference at the Etrong International Exhibition and Convention Center on the outskirts of Beijing, Thursday, Aug. 17, 2023. Credit: AP Photo/Andy Wong

Visitors take a close look at an artificial heart during the annual World Robot Conference at the Etrong International Exhibition and Convention Center on the outskirts of Beijing, Thursday, Aug. 17, 2023. Credit: AP Photo/Andy Wong

Children watch a 2-wheel robot perform at the annual World Robot Conference at the Etrong International Exhibition and Convention Center on the outskirts of Beijing, Thursday, Aug. 17, 2023. Credit: AP Photo/Andy Wong

An exhibitor walks with his robot passing by visitors during the annual World Robot Conference at the Etrong International Exhibition and Convention Center on the outskirts of Beijing, Thursday, Aug. 17, 2023. Credit: AP Photo/Andy Wong

A panda shaped robot is prepared for a demonstration at the annual World Robot Conference at the Beijing Etrong International Exhibition and Convention Center in Beijing, Wednesday, Aug. 16, 2023. Credit: AP Photo/Ng Han Guan

A man tests a device that uses brain activities and virtual reality to control other machines at the annual World Robot Conference at the Beijing Etrong International Exhibition and Convention Center, Wednesday, Aug. 16, 2023. Credit: AP Photo/Ng Han Guan

Workers sit near images of robotic arms from Estun a Chinese manufacturer of industrial robots at the annual World Robot Conference at the Beijing Etrong International Exhibition and Convention Center, Wednesday, Aug. 16, 2023. Credit: AP Photo/Ng Han Guan

A woman pushes robots around at the annual World Robot Conference at the Beijing Etrong International Exhibition and Convention Center, Wednesday, Aug. 16, 2023. Credit: AP Photo/Ng Han Guan

A worker stands next to apples harvesting robot displayed at the annual World Robot Conference held at the Beijing Etrong International Exhibition and Convention Center, Wednesday, Aug. 16, 2023. Credit: AP Photo/Ng Han Guan

Visitors record a robot that can draw portraits for them at the annual World Robot Conference at the Beijing Etrong International Exhibition and Convention Center, Wednesday, Aug. 16, 2023. Credit: AP Photo/Ng Han Guan

A man prepares to demonstrate a robot capable of walking on two limbs at the annual World Robot Conference at the Beijing Etrong International Exhibition and Convention Center, Wednesday, Aug. 16, 2023. Credit: AP Photo/Ng Han Guan

An artificial heart is displayed at the annual World Robot Conference at the Beijing Etrong International Exhibition and Convention Center on Wednesday, Aug. 16, 2023. Credit: AP Photo/Ng Han Guan

Workers demonstrate a giant robot at the annual World Robot Conference at the Beijing Etrong International Exhibition and Convention Center, Wednesday, Aug. 16, 2023. Credit: AP Photo/Ng Han Guan

© 2023 The Associated Press. All rights reserved. This material may not be published, broadcast, rewritten or redistributed without permission.

Robots can help improve mental wellbeing at work – as long as they look right

Reports and Proceedings

UNIVERSITY OF CAMBRIDGE

 

IMAGE: RESEARCHERS FROM THE UNIVERSITY OF CAMBRIDGE CARRIED OUT A STUDY IN A TECH CONSULTANCY FIRM USING TWO DIFFERENT ROBOT WELLBEING COACHES, WHERE 26 EMPLOYEES PARTICIPATED IN WEEKLY ROBOT-LED WELLBEING SESSIONS FOR FOUR WEEKS. ALTHOUGH THE ROBOTS HAD IDENTICAL VOICES, FACIAL EXPRESSIONS, AND SCRIPTS FOR THE SESSIONS, THE ROBOTS’ PHYSICAL APPEARANCE AFFECTED HOW PARTICIPANTS INTERACTED WITH IT. view more 

CREDIT: UNIVERSITY OF CAMBRIDGE

Robots can be useful as mental wellbeing coaches in the workplace – but perception of their effectiveness depends in large part on what the robot looks like.

Researchers from the University of Cambridge carried out a study in a tech consultancy firm using two different robot wellbeing coaches, where 26 employees participated in weekly robot-led wellbeing sessions for four weeks. Although the robots had identical voices, facial expressions, and scripts for the sessions, the robots’ physical appearance affected how participants interacted with it.

Participants who did their wellbeing exercises with a toy-like robot said that they felt more of a connection with their ‘coach’ than participants who worked with a humanoid-like robot. The researchers say that perception of robots is affected by popular culture, where the only limit on what robots can do is the imagination. When faced with a robot in the real world however, it often does not live up to expectations.

Since the toy-like robot looks simpler, participants may have had lower expectations and ended up finding the robot easier to talk connect with. Participants who worked with the humanoid robot found that their expectations didn’t match reality, since the robot was not capable of having interactive conversations.

Despite the differences between expectations and reality, the researchers say that their study shows that robots can be a useful tool to promote mental wellbeing in the workplace. The results will be reported today (15 March) at the ACM/IEEE International Conference on Human-Robot Interaction in Stockholm.

The World Health Organization recommends that employers take action to promote and protect mental wellbeing at work, but the implementation of wellbeing practices is often limited by a lack of resources and personnel. Robots have shown some early promise for helping address this gap, but most studies on robots and wellbeing have been conducted in a laboratory setting.

“We wanted to take the robots out of the lab and study how they might be useful in the real world,” said Dr Micol Spitale, the paper’s first author.

The researchers collaborated with local technology company Cambridge Consultants to design and implement a workplace wellbeing programme using robots. Over the course of four weeks, employees were guided through four different wellbeing exercises by one of two robots: either the QTRobot (QT) or the Misty II robot (Misty).

The QT is a childlike humanoid robot and roughly 90cm tall, while Misty is a 36cm tall toy-like robot. Both robots have screen faces that can be programmed with different facial expressions.

“We interviewed different wellbeing coaches and then we programmed our robots to have a coach-like personality, with high openness and conscientiousness,” said co-author Minja Axelsson. “The robots were programmed to have the same personality, the same facial expressions and the same voice, so the only difference between them was the physical robot form.”

Participants in the experiment were guided through different positive psychology exercises by a robot in an office meeting room. Each session started with the robot asking participants to recall a positive experience or describe something in their lives they were grateful for, and the robot would ask follow-up questions. After the sessions, participants were asked to assess the robot with a questionnaire and an interview. Participants did one session per week for four weeks, and worked with the same robot for each session.

Person interacting with Misty II robot 

Researchers from the University of Cambridge carried out a study in a tech consultancy firm using two different robot wellbeing coaches, where 26 employees participated in weekly robot-led wellbeing sessions for four weeks. Although the robots had identical voices, facial expressions, and scripts for the sessions, the robots’ physical appearance affected how participants interacted with it.

CREDIT

University of Cambridge

Participants who worked with the toy-like Misty robot reported that they had a better working connection with the robot than participants who worked with the child-like QT robot. Participants also had a more positive perception of Misty overall.

“It could be that since the Misty robot is more toy-like, it matched their expectations,” said Spitale. “But since QT is more humanoid, they expected it to behave like a human, which may be why participants who worked with QT were slightly underwhelmed.”

“The most common response we had from participants was that their expectations of the robot didn’t match with reality,” said Professor Hatice Gunes from Cambridge’s Department of Computer Science and Technology, who led the research. “We programmed the robots with a script, but participants were hoping there would be more interactivity. It’s incredibly difficult to create a robot that’s capable of natural conversation. New developments in large language models could really be beneficial in this respect.”

“Our perceptions of how robots should look or behave might be holding back the uptake of robotics in areas where they can be useful,” said Axelsson.

Although the robots used in the experiment are not as advanced as C-3PO or other fictional robots, participants still said they found the wellbeing exercises helpful, and that they were open to the idea of talking to a robot in future.

“The robot can serve as a physical reminder to commit to the practice of wellbeing exercises,” said Gunes. “And just saying things out loud, even to a robot, can be helpful when you’re trying to improve mental wellbeing.”

The team is now working to enhance the robot coaches’ responsiveness during the coaching practices and interactions.

The research was supported by the Engineering and Physical Sciences Research Council (EPSRC), part of UK Research and Innovation (UKRI). Hatice Gunes is a Staff Fellow of Trinity Hall, Cambridge.

How China, the US, and Europe are using robots to replace and help humans fight coronavirus by delivering groceries, sanitizing hospitals, and monitoring patients
Mary Meisenzahl 3/24/2020

Robots distributing hand sanitizer and face masks. REUTERS/Sivaram V

The coronavirus outbreak that originated in China has killed more than 17,000 people worldwide and infected more than 398,000, according to recent totals.
The virus, which causes a disease known as COVID-19, has spread to 169 countries, and the majority of infections and deaths are now outside of China.
As the outbreak spreads, robots are being used to disinfect, take temperatures, and even prepare food.

Around the world, robots are being used to minimize the spread of COVID-19, the disease caused by the coronavirus, by taking on cleaning and food preparation jobs that are considered dangerous for humans.

The worldwide death toll of the coronavirus disease that originated in Wuhan, China, is now more than 17,000, and the virus has infected more than 398,000 people. On March 11, the World Health Organization (WHO) officially declared it a pandemic. The virus has disrupted travel worldwide, leading to flight cancellations, quarantines, and other breakdowns in movement and supply chains.

Take a look at some of the clever ways robots are used around the world to slow the spread of the coronavirus and help healthcare workers.

In Wuhan, where the outbreak started, a robot spraying disinfectant moves through a residential area of the city.

Sanitizing robots. China OUT (Photo by STR/AFP via Getty Images

Source: Business Insider

Volunteers refilled the robot with disinfectant on March 3.

Sanitizing robots. China OUT (Photo by STR/AFP via Getty Images


Workers on scooters control the robot.

Sanitizing robots. REUTERS

A patrol robot in a Shenyang, China, hospital checks temperatures and disinfects people and spaces.

Temperature monitor robot. Photo by STR/AFP via Getty Images


These robots are used at hospitals to cut down on demands on medical staff.

Temperature monitor robot. Photo by STR/AFP via Getty Images

Hangzhou, China, is yet another city using robots to disinfect large areas.

Sanitizing robots. Photo by STR/AFP via Getty Images


They're controlled via remote control, and can be seen getting refilled here.

Sanitizing robots. Photo by STR/AFP via Getty Images

Hangzhou's disinfecting robots look notably different from those in Wuhan and Shenyang, resembling miniature tanks.

Sanitizing robots. Photo by STR/AFP via Getty Images


Another robot disinfectant in Luoyang is remote-controlled and able to climb stairs.

Sanitizing robots. REUTERS

Anhui, China has a fleet of disinfecting robots ready to start working.

Sanitizing robots. Photo by TPG/Getty Images


This hand sanitizer-dispensing robot was photographed in Shanghai on March 4.

Sanitizing robots. REUTERS

On March 11, robots in the Hunan province in China conduct morning temperature checks.

Temperature monitor robot. Xinhua/Chen Zeguo via Getty Images


Engineers have also modified the robots to record data, give feedback, and even disinfect people's hands.

Temperature monitor robot. Xinhua/Chen Zeguo via Getty Images

Immediate feedback can make the containment process faster and more efficient.

Temperature monitor robot. Xinhua/Chen Zeguo via Getty Images


Robots are being used for more than just disinfecting areas with coronavirus. A hospital in Ezhou has incorporated a robot chef into its kitchen.

Food prep robot. Photo by Shi Xiaojie/China News Service via Getty Images

The robot can reportedly produce 100 pots of rice per hour.

Food prep robot. Photo by Shi Xiaojie/China News Service via Getty Images


The robot operates without human supervision, which minimizes the number of people in the hospital exposed to the virus.

Food prep robot. Photo by Shi Xiaojie/China News Service via Getty Images

Sharing food presents an opportunity to spread the virus, so some cities have been incorporating robots in food service and preparation.

Food prep robot. Feature China/Barcroft Media via Getty Images


This robot delivered food to diners in Hangzhou.

Food prep robot. Feature China/Barcroft Media via Getty Images

Beijing-based Zhen Robotics says that its yellow robots are in demand to deliver groceries and patrol malls for people not wearing face masks.

Delivery robot. Photo by Simon Song/South China Morning Post via Getty Images


Engineering students at Chulalongkorn University in Bangkok modified medical "ninja robots" designed for stroke patients to make them useful with patients who have COVID-19.

Thai ninja robot. Photo by LILLIAN SUWANRUMPHA/AFP via Getty Images

Source: Business Insider

The robots can take patients' temperatures and protect the safety of healthcare workers by reducing interactions with sick people.

Thai ninja robot. Photo by LILLIAN SUWANRUMPHA/AFP via Getty Images


They also have a screen, allowing doctors to video chat with sick patients.

Thai ninja robot. Photo by LILLIAN SUWANRUMPHA/AFP via Getty Images

Postmates delivery robots deliver food in Los Angeles.

Postmates delivery robot. Photo by AaronP/Bauer-Griffin/GC Images


Los Angeles is one of many US cities that closed all non-essential businesses due to COVID-19, and restaurants are allowed to stay open only for takeout and delivery.

Postmates delivery robot. AaronP/Bauer-Griffin/GC Images

A hospital in Johannesburg, South Africa is using a UV light robot to disinfect the facility.

Sanitizing robot. Photo by MICHELE SPATARI/AFP via Getty Images


The hospital is using UV light instead of hydrogen peroxide, because it cuts cleaning time down from hours to five or ten minutes.

Sanitizing robot. Photo by MICHELE SPATARI/AFP via Getty Images

UV light also poses less danger to healthcare workers than hydrogen peroxide.

Sanitizing robot. Photo by MICHELE SPATARI/AFP via Getty Images


Startup Asimov Robotics launched two robots to spread awareness of the coronavirus in India.

Robots distributing hand sanitizer and face masks. REUTERS/Sivaram V

They distribute face masks and hand sanitizer...

Robots distributing hand sanitizer and face masks. REUTERS/Sivaram V


...along with information about preventing the virus.

Robots distributing hand sanitizer and face masks. REUTERS/Sivaram V

A self-driving Starship robot drops off deliveries in Emerson Valley, Britain.

Delivery robot. REUTERS/Andrew Boyers


The robot goes right to people's door, eliminating the need for contact between people.

Delivery robot. REUTERS/Andrew Boyers

Belgian company ZoraBots made a robot designed for elderly people to communicate with loved ones from the safety of their own homes.

Video call robot. REUTERS/Yves Herman


The robot has video and audio so people can still talk while sheltering at home, keeping the most vulnerable people socially connected.

Video call robot. REUTERS/Yves Herman