Wednesday, October 04, 2023

 

Can ChatGPT help us form personal narratives?


Peer-Reviewed Publication

UNIVERSITY OF PENNSYLVANIA




Research has shown that personal narratives—the stories we tell ourselves about our lives—can play a critical role in identity and help us make sense of the past and present. Research has also shown that by helping people reinterpret narratives, therapists can guide patients toward healthier thoughts and behaviors.

Now, researchers from the Positive Psychology Center at the University of Pennsylvania have tested the ability of ChatGPT-4 to generate individualized personal narratives based on stream-of-consciousness thoughts and demographic details from participants, and showed that people found the language model’s responses accurate.

In a new study in The Journal of Positive Psychology, Abigail Blyler and Martin Seligman found that 25 of the 26 participants rated the AI-generated responses as completely or mostly accurate, 19 rated the narratives as very or somewhat surprising, and 19 indicated they learned something new about themselves. Seligman, the Zellerbach Family Professor of Psychology, is the director of the Positive Psychology Center, and Blyler is his research manager. 

“This is a rare moment in the history of scientific psychology: Artificial intelligence now promises much more effective psychotherapy and coaching,” Seligman says.

For each participant, the researchers fed ChatGPT-4 recorded stream-of-consciousness thoughts, which Blyler likened to diary entries with thoughts as simple as “I’m hungry” or “I’m tired.” In a second study published concurrently in The Journal of Positive Psychology, they fed five narratives rated “completely accurate” into ChatGPT-4, asked for specific interventions, and found that the chatbot generated highly plausible coaching strategies and interventions. 

“Since coaching and therapy typically involve a great deal of initial time spent fleshing out such an identity, deriving this automatically from 50 thoughts represents a major savings,” the authors write. 

Abigail Blyler and Martin Seligman, Zellerbach Family Professor of Psychology and director of Penn’s Positive Psychology Center.

Blyler, the first author and a student in the Master of Applied Positive Psychology Program, shares more about the studies in a Q & A.

Q: What are personal narratives, how do they shape identity, and what is their role in therapeutic approaches?

Stories of the self, the way people talk about the journey of their lives and who they are, is really what pulled me into psychology. I’ve come to understand that these narratives impact our behaviors, how we view the world and others, and, importantly, our well-being. One thing Marty [Seligman] and I have discussed a lot is, How do we get to knowing what our narratives are? Narratives help to construct a coherent story, make sense of everything in our lives. 

We found that ChatGPT was able to, with just 50 of those thoughts and very basic demographic information, come up with a highly accurate and detailed personal narrative. This could be a tool for helping people gain self-insight. We see this as something that can be used in the therapeutic context, not as something that would replace a therapist. Can the coach use this to help understand the client better, and can the client in turn understand themselves better? We’re hoping there’s this reciprocal relationship, where this speeds up the process of getting to mutual understanding, so the deep work can take place.

Q: How did you come up with the idea of using ChatGPT-4 to create personal narratives?

I really credit Marty [Seligman]. He has been such a leader in the field of positive psychology for so long. To me, he is the paragon of curiosity, particularly when it comes to the cutting-edge, and so he’s been really steeped in the things that people are doing with AI and psychology. The idea came from a series of discussions we were having around my interest in personal narratives, asking, What are the things we’re consistently telling ourselves? Might that give us a window into the narratives that play on a loop in people’s minds? Can AI be of use here?

Q: The personal narratives were generated from 50 stream-of-consciousness thoughts the participants recorded. What instructions were they given?

We didn’t give any description of what the content of the thoughts should be, just that they should be fairly automatic. We asked that people try not to edit them in their minds. We gave them the option to record it via a voice memo or write it down in a Word document or Notes app. However they chose to do it, we gave them 48 hours to just collect 50 of them.

Q: How did you determine the coaching strategies and interventions ChatGPT-4 generated were highly plausible?

We based it on the literature. There are very many evidence-based therapeutic interventions, and what the machine does here is select the ones that seem most appropriate to the narrative identity. This research is exploratory; there is absolutely a need to continue the research and deploy this with coaches. That’s where we are now, getting this into the hands of coaches. We have just begun collaborations to find out if therapy and coaching are more effective when assisted by our new methods.

No comments: