National Eating Disorders Association Retires Chatbot

National Eating Disorders Association Retires Chatbot

The National Eating Disorders Association, a nonprofit organization that supports people affected by eating disorders, said it disabled its wellness chatbot after two users reported that the program gave them advice on diets that promoted disordered eating behaviors.

The users, Sharon Maxwell and Alexis ConasonThey both posted about their experiences with the NEDA chatbot, called Tessa, on Instagram this week. They said Tessa gave them advice on how to count calories, advising them to lose 1 to 2 pounds a week and telling them to restrict their diets. experts, including NEDAthey say this behavior is symptomatic of an eating disorder.

“When someone in that state goes into a website like NEDA, which is supposed to provide support for eating disorders, and they get advice that says, ‘It’s okay to restrict certain foods, you should minimize your sugar intake, you should minimize the amount of calories you eat each day, you need to exercise more,’ you’re really giving the green light to engage in disordered eating behaviors,” said Conason, a clinical psychologist and certified eating disorder specialist.

Liz Thompson, CEO of NEDA, said in an email to NBC News on Wednesday that Tessa “underwent rigorous testing over several years” before quietly launching in February 2022. However, the chatbot will be retired until further notice.

“Regarding the comments about weight loss and calorie limitation made in a chat on Monday, we are concerned and are working with the tech team and research team to investigate this further; such language is against our core beliefs and policies as an eating disorder organization; furthermore, it was not language in the original ‘closed’ product,” Thompson said. “We will continue to work on the bugs and will not relaunch until we have everything fixed.”

Such language goes against our core beliefs and policies as an eating disorder organization.

Liz Thompson, CEO of NEDA, in response to chat comments received earlier this week

Thompson also said that the CEO of X2AI, the mental health artificial intelligence company that supports Tessa, reported that there was a “600% increase in traffic and behavior that indicated various forms of nefarious activity by bad guys.” actors trying to fool Tessa.”

A representative for X2AI, also known as Cass, did not immediately respond to a request for comment.

Maxwell, a fat activist and weight-inclusion consultant, said she was “surprised by the detail” in which the chatbot gave her “guidelines for engaging in disorderly behavior.” She said Tessa recommended a 10-step guide on how to lose weight, including tips on how to limit your calorie intake and what foods to avoid eating. After her experience, she said that she felt it was clear that the chatbot lacked the nuance needed to provide adequate support to people with eating disorders.

“In a field where we are supposed to do no harm, I don’t see how the National Eating Disorders Association was negligent in posting this here, not knowing for a fact that I wasn’t going to release this information, is something that was can be overlooked,” he said. “It’s abominable.”

Conason agreed that Tessa’s bot lacked the nuance needed to help people struggling with eating disorders. However, he also said that chatbots like Tessa are often the only resources people have to start addressing their eating disorders due to a lack of access to mental health care.

NEDA had been transitioning from their helpline to Tessa, which was set to fully function. replace phone line for June 1. Tessa went offline on Tuesday, two days before her hotline was supposed to shut down.

NEDA’s Thompson said the chatbot was “never intended to replace the helpline,” though the helpline stopped working on Thursday.

NEDA decided to close the helpline after “3 years of analysis” and will invest in more online resources, Thompson said in his email.

He said the nonprofit has moved toward digital tools “so that people looking for information and treatment options can access that help at any time of day and don’t have to wait for a response from helpline volunteers. aid”.

The announcement that NEDA would be closing its helpline came two weeks after helpline workers won federal recognition for their union. The helpline had six paid employees and more than 200 volunteers, according to NPR.

The union issued a statement. On twitter about the incident of May 26. Helpline Associates Union did not immediately respond to requests for comment.

“We are not going to give up. We are not on strike. We will continue to show up every day to support our community through June 1st. A chat bot is not a substitute for human empathy, and we believe this decision will cause irreparable damage to the eating disorder community,” the statement read.

As of Thursday, both the helpline and Tessa were unavailable. However, the NEDA website listed a volunteer-run text line and other resources for those in crisis seeking immediate help.

By Mitchell G. Patton

You May Also Like