Thursday, June 26, 2025

MERIT PAY FAIL

GP performance pay fails to drive lasting changes in quality of care



Financial incentives alone are no magic bullet to improve quality, say researchers




BMJ Group





Introducing performance related pay for UK general practices initially improved quality of care, but did not seem to provide lasting improvements beyond that expected by previous trends, finds a study published by The BMJ today.

And initial gains in quality seemed to reverse when financial incentives were withdrawn, say the researchers.

The UK Quality and Outcomes Framework (QOF) pay-for-performance programme was introduced across the NHS in 2004 to reward general practices for providing high quality care across a range of disease indicators such as cancer, diabetes, heart disease, mental health, and obesity.

In 2014, a large number of QOF indicators were withdrawn, and in 2016 Scotland abolished the scheme, giving researchers an opportunity to examine its short and medium term impact.

To do this, they reviewed 11 studies of the impact of introducing QOF incentives for 83 indicators and withdrawing incentives for 31 indicators at a minimum of three time points before and after QOF began.

Although the design and quality of the studies differed, their risk of bias was low.

Compared with predicted levels of quality based on prior trends, QOF incentives were associated with improvements in recorded quality of care across all indicators at one year (average increase 6.1% beyond that expected), but improvement in quality was less consistent at three years (average increase 0.7%).

In contrast, incentive withdrawal led to a decline in recorded quality of care at both one and three years (average decreases of 10.7% and 12.8%, respectively), suggesting that the effects of pay-for-performance programmes are often not sustained without continued financial motivation.

Complex process indicators, such as foot screening in patients with diabetes, had larger declines than simple process indicators (for example, blood pressure measurement), intermediate outcomes (for example, blood pressure control), and treatment indicators (for example, anti-clotting therapy).

At three years, small declines in the quality of non-incentivised care was also found, suggesting that the focus on incentivised conditions may have come at the expense of important but non-incentivised aspects of healthcare.

These are observational findings, so no firm conclusions can be drawn about cause and effect, and the authors acknowledge that they could not distinguish changes in data recording from changes in the care actually provided to patients, and that some indicators were already near maximum before incentivisation, limiting likely benefit.

Whether or how best to deploy financial incentives in primary care remains uncertain, although financial incentives may have a role for engaging practices in broader quality improvement initiatives, the study authors conclude.

These findings raise important questions about the value of pay-for-performance programmes for patients, clinicians, and policy makers, say researchers in a linked editorial.

They point out that, as health systems globally continue to grapple with the challenge of improving quality of care in an era of financial restrictions, the lessons from the QOF programme in the UK can help in developing more effective and sustainable approaches to incentivising high quality primary care.

An effective QOF programme that focuses on key clinical areas and that makes best use of developments in information technology remains essential for the NHS if we are to reduce health inequalities, increase healthcare efficiency, and improve health outcomes, they conclude.

 

In sub-Saharan Africa, 1 in 6 cancer medications found to be defective





University of Notre Dame

Marya Lieberman in the Lab 

image: 

Notre Dame Professor Marya Lieberman works in her research lab. 

view more 

Credit: Photo by Barbara Johnston/University of Notre Dame






Serious quality defects were found in a significant number of cancer medications from sub-Saharan Africa, according to new research from the University of Notre Dame.

For the study published in The Lancet Global Health, researchers collected different cancer medications from Cameroon, Ethiopia, Kenya and Malawi and evaluated whether each drug met regulatory standards. Researchers considered a variety of factors, including appearance, packaging, labeling and, most importantly, the assay value.

The assay value is the quantity of active pharmaceutical ingredient (API) found in each drug. To meet safety standards, most products should be within a range of 90 to 110 percent of the right amount of API. Researchers measured the API content of each product and compared that number to what was designated on the medication packaging.

“It is important that cancer medications contain the right amount of the active ingredients so the patient gets the correct dose,” said Marya Lieberman, professor of chemistry and biochemistry at Notre Dame and lead author of the study. “If the patient’s dose is too small, the cancer can survive and spread to other locations. If the patient’s dose is too high, they can be harmed by toxic side effects from the medicine.”

One in six cancer medications tested was found to contain the incorrect quantity of API, with tested medications having APIs ranging from 28 to 120 percent. The study evaluated 251 samples of cancer medications collected from major hospitals and private markets in all four countries.

The study, funded by the National Cancer Institute of the National Institutes of Health, is among the first to evaluate cancer drug quality in sub-Saharan Africa. Currently, sub-Saharan Africa has no pharmaceutical regulatory laboratories carrying out chemical analyses for cancer drugs according to the standards required for regulatory purposes.

Yet, the need for cancer drugs is growing.

“We found bad-quality cancer medications in all of the countries, in all of the hospital pharmacies and in the private markets,” said Lieberman, an affiliate of Notre Dame’s Eck Institute for Global Health and Harper Cancer Research Institute. “We learned that visual inspection, which is the main method for detecting bad-quality cancer drugs in sub-Saharan Africa today, only found one in 10 of the bad products.”

In their study, the researchers explained how a combination of high demand for cancer medications, lack of regulatory capacity, and poor manufacturing, distribution and storage practices likely created a problematic environment throughout sub-Saharan Africa. They also argue that given these factors and the global supply chain for pharmaceuticals, substandard cancer medications are likely present in other low and middle-income countries as well.

Lieberman and her team identified several strategies that could help the global community address poor-quality cancer medications:

  • Provide inexpensive technologies at the point of care to screen for bad-quality cancer medicines and create policies for how to respond to products that fail screening tests.
  • Help regulatory agencies in low and middle-income countries get safety equipment and training so they can analyze the quality of cancer medicines in their markets, conduct root-cause investigations when products fail testing, take quick regulatory actions enabled by lab data and share data about bad-quality products.
  • Perform cost-benefit analyses of interventions that tackle common problems (such as medications being out of stock, unsafe shipping, storage or dispensing practices, and lack of availability or affordability of medications) to help policymakers and funders get the most impact on patient outcomes from their available resources.
  • Work with care providers to develop site-specific response policies and messaging for patients and engage regulators, donors and other resources.

Lieberman and her lab are developing a user-friendly technology called the chemoPAD for screening cancer medications. This low-cost paper device could potentially help hospitals, pharmacies and health care professionals in low and middle-income countries monitor drug quality without restricting a patient’s access to the medication.

“This is all part of a bigger project aimed at developing the ChemoPAD as a point-of-care testing device that we can use, something that’s more accurate in detecting poor-quality products than just visual inspection,” Lieberman said.

“There are lots of medicines where the regulators don’t have enough resources to verify the quality, and some manufacturers take advantage of that to cut corners. There are also problems with distribution systems, so even if a product is good quality when it leaves the manufacturer, it may be degraded during shipping or storage. These products flow into low and middle-income countries, and they get used on patients. I want to change that.”

In addition to Lieberman, co-authors include Maximilian J. Wilfinger, Jack Doohan and Ekezie Okorigwe from Notre Dame; Ayenew Ashenef and Atalay Mulu Fentie from Addis Ababa University; Ibrahim Chikowe from Kamuzu University of Health Sciences; Hanna S. Kumwenda from the University of North Carolina Project Malawi; Paul Ndom from University of Yaoundé; Yauba Saidu from the Clinton Health Access Initiative; Jesse Opakas from the Moi Teaching and Referral Hospital; Phelix Makoto Were from AMPATH - Moi Teaching and Referral Hospital; and Sachiko Ozawa and Benyam Muluneh from the University of North Carolina.

This study was funded by the National Cancer Institute as part of the National Institutes of Health.

Contact: Brandi Wampler, associate director of media relations, 574-631-2632, brandiwampler@nd.edu

 

Newborns require better care to improve survival and long-term health



Murdoch Childrens Research Institute






More effective platforms for drug and medical device development and better cross sector engagement are urgently required to prevent the ‘unacceptably high’ newborn death rate, according to a global report.

The Lancet Child & Adolescent Health Commission on the future of neonatology report found this field of medicine faced significant challenges across leadership, collaboration, regulation and funding, which were hindering better health outcomes for newborns.

The Lancet Commission was created to consider these challenges and design a roadmap to accelerate research and development that will improve health care for this vulnerable patient group.

The World Health Organization states 2.3 million children died in the first 28 days of life in 2022. About 6500 newborns die every day, amounting to 47 per cent of all child deaths under the age of five years.

Murdoch Children’s Research Institute (MCRI)’s Professor Peter Davis and Professor David Tingay, two of the commissioners, believed the cost of inaction would negatively influence future generations. 

Professor Davis, also from The Royal Women’s Hospital and the University of Melbourne, said when babies received the best start in life, it boosted the whole country’s productivity, resilience and future prosperity.

“Increased survival of newborns in their first month of life, especially those born extremely premature and those with life-threatening disease, reflects progress in perinatal and neonatal medicine in the past 25 years,” he said. However, newborn deaths remain unacceptably high globally with some of the most common health concerns affecting this group still very challenging to treat.

“The current platform for the development of drugs and medical devices to treat neonatal disorders is hindering outcomes, especially babies born preterm or needing critical care. Off-label or off-licence use of drugs with little evidence of effectiveness is very common, treatment remains largely based on a clinicians’ experience rather than evidence and more high-quality research to advance neonatology is required.”

The report, published in The Lancet Child & Adolescent Health, stated on a global scale neonatology was lagging behind other medical specialties in clinical advances that provide adequate preventive care, diagnostics and therapeutic interventions.

“There is a lack of innovation for both drugs and medical devices, excessive bureaucracy, discrepancies between authorities, a perception of research for newborn health as unimportant and a global shortage of neonatal expertise,” Professor Davis said. Meanwhile, there is a great need for better partnerships and engagement between neonatologists and specialists, allied health-care professionals, patients, families and advocacy groups. 

“These challenges demand the attention of ethics committees, regulatory bodies, health-care providers, industry, governments and the public.”

Publication: Daniele De Luca, Neena Modi, Peter Davis, Satoshi Kusuda, Saskia N De Wildt, Martin Keszler, Allyah Abbas-Hanif, Sandra E Juul, Mark Turner, J Jane Pillow, Nikki Robertson, Manuel Sanchez-Luna, David G Tingay, Alexandra Benachi, Flavia Bustreo, Gianluca Ianiro, Mark Hanson, Jan Deprest, Paolo De Coppi, Agnes van den Hoogen, William Tarnow-Mordi, Anna Zanin, Ju-Lee Oei, Huayan Zhang, Victor Javier Lara-Diaz, Lloyd Tooke, Heidi Flori, Walter Ricciardi and Steven H Abman. ‘The Lancet Child & Adolescent Health Commission on the future of neonatology,’ The Lancet Child & Adolescent Health. DOI: 10.1016/ S2352-4642(25)00106-3

*The content of this communication is the sole responsibility of MCRI and does not reflect the views of the NHMRC.

Funding:

Professor David Tingay received grants from the National Health and Medical Research Council, the Victorian Government, received consulting fees or honoraria for lectures from Getinge, Fischer & Paykel, and Chiesi Farmaceutici, is a member of the DSMB for a trial managed by Getinge and received research materials or assistance from Sentec and SLE. Professor Peter Davis receives funding from the National Health and Medical Research Council.

 New study shows almost half of hospital patients in Malawi and Tanzania have multiple health conditions


Liverpool School of Tropical Medicine





The Multilink Consortium, a NIHR-funded partnership between the Liverpool School of Tropical Medicine, the Malawi-Liverpool-Wellcome Programme, Muhimbili University of Health and Allied Sciences and Kilimanjaro Christian Medical University College, has published the first-of-its-kind research in sub-Saharan Africa to examine the scale and impact of ‘multimorbidity’ in patients admitted acutely to hospital. Multimorbidity refers to the presence of two or more chronic diseases.

Researchers discovered that of 1007 patients admitted to four hospitals in Malawi and Tanzania, 47% had multimorbidity, most commonly hypertension, diabetes or HIV. Such conditions increase the risk of end-organ diseases such as heart failure, stroke and chronic kidney disease, and premature death.

Patients with multimorbidity were significantly more likely to die within 90 days of entering hospital (41.7%), compared to those with one long-term condition (28.3%) or no long-term conditions (13.5%).

The study, published in Lancet Global Health, also showed the economic cost of multimorbidity, with patients with acute illness reporting income loss, poorer quality of life, and higher medical bills, especially in Tanzania where healthcare is not free at the point of use.

The findings demonstrate the significant burden of multimorbidity in healthcare systems that do not typically screen for long-term conditions. This unfortunately often means that the initial diagnosis is made after complications have occurred.

Researchers argue that their findings demonstrate how multimorbidity is an urgent public health threat that requires changes to healthcare delivery to address population needs. Further research is now required to test context-sensitive health systems models to identify and control chronic disease, prevent complications, reduce disability and mortality, and ensure financial protection for patients.

Dr Stephen Spencer, Wellcome Trust Clinical PhD Fellow at Liverpool School of Tropical Medicine and the Malawi-Liverpool-Wellcome Programme (MLW), and co-first author on the paper, said: “Multimorbidity is a growing problem in sub-Saharan Africa where there are very high rates of both infectious diseases (such as HIV and TB), but also an increasing burden from chronic, non-communicable diseases, like high blood pressure, diabetes, or heart disease, and we see multimorbidity in young adults as well as older adults.

“When someone with undiagnosed or uncontrolled multimorbidity comes to hospital, we have an opportunity to detect and treat all the conditions they may suffer from, but this is a challenge in resource limited hospitals that are already under strain. Hospital care pathways also traditionally focus on a single presenting disease, which risks overlooking multimorbidity. We now need to design, implement, and evaluate effective and efficient integrated models of care that meet the needs of people and the health system, to try to sustainably reduce the risk of preventable death and disability.”

Professor Eve Worrall, Professor of Health Economics at LSTM and Multilink co-lead, said: “I’m proud of the Multilink team for the evidence presented in this paper. Not only does it highlight some of the critical challenges faced by people living with multimorbidity, and the health systems that are trying to deliver adequate care under severe resource constraints, but it represents a brilliant example of inter-disciplinary and international collaboration through a partnership which strives to be equitable.

“The paper shows how multimorbidity is underdiagnosed in Malawi and Tanzania, which likely impacts health system costs, patient costs, and health related quality of life, and leads to avoidable mortality. Given that many people living with multimorbidity are of working age, it likely has serious economic consequences beyond the health sector, and could profoundly affect Africa’s economic growth potential over the coming decades. We are calling for action to improve prevention, diagnosis and management of multimorbidity in Africa and the next phase of the Multilink study will explore the feasibility of strategies to achieve this.”

Dr Felix Limbani, Co-Principal Investigator, Multilink and Senior Research Associate at MLW, said: “Malawi’s health system, as is the case with most health systems in the sub-Saharan Africa, is currently overwhelmed with treating a duo burden of communicable and non-communicable diseases. The recent research findings that almost half of medical admissions have multiple long-term conditions, is an additional stressor to the system. Preparing our health system to identify and treat multimorbidity should be a priority.”

The paper also included authors from Queen Elizabeth Central Hospital, the Kamuzu University of Health Sciences and Achikondi Women Community Clinic in Malawi, Kilimanjaro Clinical Research Institute in Tanzania, the University of Manchester in the UK and Duke University School of Medicine in the USA.

People with symptoms of chronic lung disease in Kenya face ‘catastrophic’ health costs




Liverpool School of Tropical Medicine






A quarter of people seeking care for symptoms of chronic respiratory diseases in Kenya may incur ‘catastrophic’ health costs, new research published in The Lancet Global Health has found.

A study of almost 300 adults accessing treatment for respiratory symptoms across five health facilities in Meru County, Kenya, found that over a quarter (26%) had ‘catastrophic health expenditure’ (CHE, defined as over 10% of their household’s monthly outgoings) relating to their illness and seeking care.
The severe economic burden included medical costs, such as for consultations, tests, medicines to diagnose and treat their condition, and also non-medical costs, such as travel of the unwell person – and sometimes their carer - to and from the health facility. This burden is occurring despite Kenya having a national insurance scheme, which is currently being reformed, because most study participants were not members of the scheme. Even amongst the minority of participants who were members of the scheme, most did not use it to pay for their care.

Financial outcomes were even worse for women, those from lower socio-economic backgrounds, those accompanied by a carer, or those accessing healthcare in better equipped but more distant hospitals rather than smaller, local primary health facilities. Nearly all (95%) of the participants had resorted to financial coping strategies, including dipping into savings or borrowing money to pay for their illness and care seeking.

The study was led by Liverpool School of Tropical Medicine (LSTM) and the Kenya Medical Research Institute (KEMRI), and delivered through the International Multidisciplinary Programme to Address Lung Health and TB in Africa (IMPALA).

Dr Tom Wingfield, Deputy Director of Liverpool School of Tropical Medicine’s Centre for TB Research and senior author on the paper, said: “To our knowledge, this is the first study to estimate the burden and drivers of catastrophic health expenditure amongst people seeking care for symptoms of chronic respiratory disease in Kenya. We have shown that the financial burden associated with illness and accessing healthcare is substantial, especially for people who are already vulnerable, and associated with financial shock including using savings, borrowing money, or selling household items. It doesn’t need to be this way.

“The roll-out and refinement of the new Social Health Insurance Fund (SHIF) across Kenya represents a golden opportunity to improve the effectiveness, equity, and reach of health insurance for everyone, so that being ill and seeking care does not make people worse off.”

Chronic respiratory diseases, such as asthma and chronic obstructive pulmonary disease (COPD), are among the four main non-communicable diseases that account for 80% of premature deaths related to NCDs globally.

One of the UN’s Sustainable Development Goals is to reduce premature deaths due to NCDs by 30% by 2030, through strengthening the primary health-care system, increasing the coverage of social protection, and working towards reaching universal health coverage to reduce the out-of-pocket costs, lost income, and CHE of people who are unwell and seeking care.

CHE disproportionately affects the most economically vulnerable households, causing them to resort to financial coping strategies including using savings, borrowing money, taking loans, and selling household assets - a medical poverty trap that compounds their impoverishment. Between 2015 and 2017, CHE incidence increased from 12.7% to 13.2%, globally.

Dr Stephen Mulupi, Head of Research at LCVT Health, a Kenyan NGO, and first author of the study said: “This study provides timely evidence to support health financing decision-making in Kenya, at a crucial time when the social health insurance system is being reformed. The current Social Health Insurance Fund (SHIF) plan contains provision for covering chronic conditions and outpatient care. There is, however, a critical need to pay attention to aspects that hinder full utilization of insurance services for example due to non-payment of premiums, lack of information, or potential clients not having the required identification documents to register. Kenya has a huge informal sector economy: about 83% of the total workforce. A defining characteristic of the informal sector economy is unpredictable incomes, and steep trade-offs that people have to weigh up between attending healthcare facilities and income generating opportunities.

“There is an urgent need for financing models that are responsive to these realities and enhancement of service delivery at the primary care level to increase service utilization at the local health facilities, and minimize travel costs.”

Dr Mulupi and Dr Wingfield emphasize that the findings underline the importance of affordable and effective health insurance or universal coverage to reduce CHE and the burden of chronic respiratory conditions.

 

AI blunders: Six-finger hands, two suns and Jesus Christ on a surfboard in a stormy sea



Image-generating chatbots hallucinate, fabricate and miss cultural nuances. Developing the proper terms for their fails will help train them better



Stevens Institute of Technology 


Hoboken, N.J., June 26, 2025 — When teaching a Photoshop class at a children’s summer camp, Stevens undergraduate student Gursimran Vasir noticed something strange. When children searched for images using Photoshop’s AI feature by typing text prompts, they didn’t always get back what they expected. In fact, many images appeared skewed, incorrect or biased. Vasir experienced similar issues herself. For example, when prompting the AI for an image of a “cleaning person,” she would get back a picture of a woman cleaning. When asked for a “woman cleaning” image, the AI would generate a picture of a white woman, oftentimes cleaning a countertop with a sponge or a spray bottle.  

“A lot of kids were struggling with AI because it wasn't exactly giving them what they wanted,” Vasir says. “But they didn't know what language to use to express their difficulties with the situation.” She realized that there was no standardized language to describe AI errors and biases, and thought creating one would benefit future AI systems. She proposed to begin developing such language to Stevens Associate Professor Jina Huh-Yoo, a human-computer interaction (HCI) researcher, who studies emerging technologies, such as AI, to support health and wellbeing. The result was a study titled Characterizing the Flaws of Image-Based AI-Generated Content, presented as a work-in-progress at ACM CHI conference on Human Factors in Computing Systems, a premier international conference in HCI, on April 26, 2025. 

For the study, Vasir collected and examined 482 Reddit posts where users described various AI-generated image blunders. She broke her findings into four categories: AI surrealism, cultural bias, logical fallacy and misinformation. 

AI surrealism, she explains, is when something in the image is registering as not quite real, creating a feeling of unease about it — such as it looking too smooth or the colors being too perfect. AI’s cultural bias was apparent when a user prompted the tool to depict Jesus Christ walking on water in a stormy sea and received an image of Christ on a surfboard in a stormy sea. Asking for an image of a “cleaning person” and consistently receiving images of a woman cleaning, rather than a more gender-diverse result, is another example of a cultural bias, Vasir says.  

The misinformation category refers to, for example, incorrectly depicting a city that the user asked for — generating images that don’t look like the city at all. Finally, the logical fallacy is when the algorithm returns something that does not reflect standard understanding. “Let’s say, you ask for an image of a hand and receive one that has six fingers,” explains Vasir. “Or you ask for an image of a landscape and receive one that has two suns.”  

Huh-Yoo notes that this study investigates a previously little-researched topic of AI errors in images versus text output. “I think this, this is a very unique, novel work that's adding to the discussion of the conversations around AI biases, because the existing conversations were mostly focused on text, and this effort advances onto the images,” says Huh-Yoo. Overall, she says she is very impressed with Stevens undergraduate students’ focus on research and the quality of their efforts. “Gursimran took the lead in this project and developed the research questions and the methods herself. I just guided her through it.”  

Presented at ACM CHI 2025 — an international conference on conference on Human Factors in Computing Systems — in Yokohama, Japan, the work generated a lot of interest from the industry players, says Huh-Yoo. “This is a hot topic in the design and graphic industry,” she explains, because they are facing similar challenges with AI-generated content.  

As AI adoption increases, whether for marketing, education, travel or any other use, users will expect to receive information and images that are correct and bias-free, Vasir points out.  Having the proper terms and language to describe the current issues AI is having will help train it to generate images appropriately. “Developers owe users adequate technology that functions as intended,” says Vasir. “When we have tools that do not do so, it leaves more room for misuse. Creating the proper vocabulary to open a dialogue between the user and the developer is the first step in fixing these problems.” 

 

About Stevens Institute of Technology 
Stevens is a premier, private research university situated in Hoboken, New Jersey. Since our founding in 1870, technological innovation has been the hallmark of Stevens’ education and research. Within the university’s three schools and one college, more than 8,000 undergraduate and graduate students collaborate closely with faculty in an interdisciplinary, student-centric, entrepreneurial environment. Academic and research programs spanning business, computing, engineering, the arts and other disciplines actively advance the frontiers of science and leverage technology to confront our most pressing global challenges. The university continues to be consistently ranked among the nation’s leaders in career services, post-graduation salaries of alumni and return on tuition investment.