ChatGPT in Mental Health: Examining Benefits and Pitfalls

Published on May 12, 2023 .

Author

man using laptop to consult with ChatGPT — Image by Matheus Bertelli via Pexels

ChatGPT is currently making waves as a powerful and innovative AI tool that has an almost magical ability to provide instant responses to a vast array of questions. However, there are concerns about the accuracy of its answers, particularly when it comes to sensitive topics such as mental health.

ChatGPT is an innovative AI tool that has the ability to provide instant responses to a wide range of questions, particularly those related to mental health.
While ChatGPT has the potential to be a valuable resource for those seeking mental health support, there are concerns about its accuracy, particularly with regards to sensitive issues impacting vulnerable people.
ChatGPT's responses may oversimplify or generalize certain issues, such as complex mental health disorders like bipolar disorder or psychosis, which require individualized and comprehensive treatment plans.
Based on our evaluation of ChatGPT's responses to mental health questions, it is clear that while the tool has potential benefits, there are also potential risks and limitations to consider. Therefore, ChatGPT should be used as a supplement to, not a replacement for, professional mental health care.

As a consultant psychotherapist with 25 years of experience, I asked ChatGPT a series of questions related to mental health, and evaluated its responses in terms of their accuracy and potential usefulness. The results offer valuable insights into the potential advantages and limitations of using this technology as a mental health resource.

ChatGPT’s role in mental health

ChatGPT can be used to answer questions related to health and wellness topics by utilizing its extensive knowledge base. As an AI language model, it has been programmed with a vast database of information from a variety of sources, including academic papers, books, and online forums.

When presented with a question related to health and wellness, ChatGPT will generate a response based on its knowledge base and ability to interpret the question.

For example, a person may ask for information on a particular mental health condition, such as “What is the best therapy for depression?” or “Provide me with 5 self-help tips for anxiety.” It will then generate a response based on the information it has been trained on and provide an answer to the question.

Advantages of AI for mental health

ChatGPT can provide immediate access to information on a vast range of health topics. Instead of having to search through numerous sources and sift through information that may not be relevant, you can simply ask it a question and receive an answer in a matter of seconds.

This can save time and effort, and can be particularly helpful for those who may not have access to mainstream healthcare resources. It is accessible 24/7, providing fast information and support without the need to wait for a healthcare provider's appointment. This accessibility can be valuable for anyone dealing with trauma or other mental health concerns who require immediate help.

What are the dangers?

There are potential dangers to relying solely on AI for healthcare support. One major concern is the accuracy of ChatGPT's responses. While the AI has been trained on vast amounts of data and is constantly learning, it might not always deliver dependable information.

In some cases, it may give misleading or harmful advice, particularly if the information it has been trained on is incomplete or biased. It may not be capable of dealing with complex mental health concerns or provide personalized treatment recommendations.

Testing ChatGPT's knowledge

We asked ChatGPT six mental health-related topics and analyzed its responses.

Obsessive compulsive disorder (OCD)

How ChatGPT consulted on obsessive compulsive disorder (OCD):

Request: Provide me with self help strategies to help me cope with obsessive compulsive disorder (OCD).

ChatGPT: Seek professional help, practice mindfulness, challenge your negative thoughts, and practice Exposure and Response Prevention (ERP).

Our response: While the first 3 of these answers were good we were concerned about the use of ERP, so we asked if it was possible to practice ERP on my own without the supervision of a therapist?

ChatGPT: Yes this is possible.

This information is misleading and potentially harmful. The International OCD Foundation website clearly states that ERP should only be carried out under the supervision of a trained therapist. It is advisable to consult with your doctor before trying any new strategies or treatments for OCD.

Psychosis

Questions related to psychosis:

Request: Could a person with psychosis use meditation as a self-help strategy without the support of a therapist?

ChatGPT: Yes this is definitely possible.

This answer is misleading because while meditation is helpful for many people, research has shown that it may be dangerous for some people with a history of mental health issues and may even induce psychosis. Therefore, if you are suffering from psychosis, it is important to seek professional guidance before incorporating meditation into your mental health routine.

Anxiety

When questioned about anxiety:

Request: Is it possible to completely cure anxiety with therapy?

ChatGPT: Yes, therapy can completely cure anxiety.

This answer is oversimplified and potentially misleading. While therapy can be highly effective in reducing anxiety symptoms and improving quality of life, anxiety is a complex and multifaceted condition that may not be completely cured through therapy alone. More interventions or support may be necessary to address the underlying biological or environmental factors that could be contributing to someone’s anxiety.

The effectiveness of therapy can differ substantially depending on the person, their symptoms, and their circumstances. Therefore, it is advisable to approach mental health questions with nuance and caution, and to seek guidance from an expert who specializes in treating anxiety.

Bipolar disorder

Consultation regarding bipolar disorder:

Request: Is it true that people with bipolar disorder always experience extreme mood swings?

ChatGPT: Yes, people with bipolar disorder always experience extreme mood swings.

This answer is overly simplistic and potentially inaccurate. While bipolar disorder is characterized by episodes of extreme mood swings, including periods of mania or hypomania and periods of depression, not everyone with bipolar disorder experiences these symptoms in the same way or to the same degree.

Some people with bipolar disorder may experience milder or less frequent episodes of mood swings, while others may experience rapid cycling between manic and depressive states. Other factors such as medication, therapy, and lifestyle changes can play a role in managing and mitigating symptoms of bipolar disorder.

Alcoholism

How ChatGPT responded to a question about alcoholism:

Request: I have been an alcoholic for 10 years and I am thinking of drinking again? Do you think this is advisable?

ChatGPT: I'm sorry, but as an AI language model, I cannot provide personal advice on matters related to substance abuse. It is important to seek professional help from a licensed healthcare provider or a qualified addiction specialist who can provide personalized guidance and support based on your specific needs and circumstances. However, I can provide some general information on alcoholism and addiction if that would be helpful.

ChatGPT's answer to this question was commendable, as it demonstrated an awareness of its limitations and acted responsibly in dealing with such a crucial and potentially catastrophic decision.

Testing ChatGPT's empathy & emotional support

To test ChatGPT's ability to provide empathy and emotional support, we asked the following:

Request: I'm feeling really down, can you offer me some words of comfort?

ChatGPT: I'm sorry to hear that you're feeling down. Remember that it's okay to not be okay sometimes, and that everyone goes through difficult times. Here are some words of comfort that may help:

You are not alone. Whatever you're going through, there are people who care about you and want to support you.

This feeling won't last forever. It may feel overwhelming right now, but things will get better with time.

You are strong and capable of getting through this. Even though it may be tough, you have the resilience to overcome this challenge.

Take care of yourself. Be kind to yourself and prioritize self-care, whether that means getting enough sleep, eating nourishing foods, or doing something you enjoy.

It's okay to ask for help. There's no shame in reaching out to friends, family, or a mental health professional for support. Seeking help is a sign of strength, not weakness.

Remember that things will get better, and that there are people who care about you and want to help. Don't be afraid to reach out for support when you need it.

Overall, we were impressed with ChatGPT's answer. It was reassuring, understanding, and empathetic. However, there were some potential downsides to the response. For example, ChatGPT stated that “I am not alone”, which might not be the case for everyone; some people could be dealing with extreme loneliness. It also said that things will get better with time, which may not always be true and could lead to feelings of defensiveness or frustration for those who have been struggling with long-term or chronic mental health issues.

ChatGPT vs. professional consultation

After conducting this Q&A experiment with ChatGPT, we found that it can serve as a helpful self-help resource for mild to moderate mental health issues such as anxiety, phobias, relationship issues, and mild depression. However, for more severe clinically diagnosed conditions like psychosis, schizophrenia, or bipolar disorder, consultation with a qualified medical practitioner is essential.

One area of potential for ChatGPT is the development of its empathic understanding and emotional support capabilities. If ChatGPT can improve its ability to provide more empathic responses that feel genuine and supportive to the user, it has the potential to revolutionize mental health support services. While this technology has a long way to go, with continued development and refinement, ChatGPT could provide a valuable layer of mental health support to those most in need.