AI-driven analyzes of open-ended responses to assess outcomes of internet-based cognitive behavioral therapy (ICBT) in adolescents with anxiety and depression comorbidity
Garcia, Danilo LU
; Granjard, Alexandre
; Vanhée, Loïs
; Berg, Matilda
; Andersson, Gerhard
; Lasota, Marta
LU
and Sikström, Sverker
LU
(2025)
In Journal of Affective Disorders
381.
p.659-668
- Abstract
Objective: Although patients prefer describing their problems using words, mental health interventions are commonly evaluated using rating scales. Fortunately, recent advances in natural language processing (i.e., AI-methods) yield new opportunities to quantify people's own mental health descriptions. Our aim was to explore whether responses to open-ended questions, quantified using AI, provide additional value in measuring intervention outcomes compared to traditional rating scales. Method: Swedish adolescents (N = 44) who received Internet-based Cognitive Behavioral Therapy (ICBT) for eight weeks completed (pre/post) scales measuring anxiety and depression and three open-ended questions (related to depression, anxiety and general... (More)
Objective: Although patients prefer describing their problems using words, mental health interventions are commonly evaluated using rating scales. Fortunately, recent advances in natural language processing (i.e., AI-methods) yield new opportunities to quantify people's own mental health descriptions. Our aim was to explore whether responses to open-ended questions, quantified using AI, provide additional value in measuring intervention outcomes compared to traditional rating scales. Method: Swedish adolescents (N = 44) who received Internet-based Cognitive Behavioral Therapy (ICBT) for eight weeks completed (pre/post) scales measuring anxiety and depression and three open-ended questions (related to depression, anxiety and general mental health). The language responses were quantified using a large language model and quantitative methods to predict mental health as measured by rating scales, valence (i.e., words' positive/negative affectivity), and semantic content (i.e., meaning). Results: Similar to the rating scales, language measures revealed statistically significant health improvements between pre and post measures such as reduced depression and anxiety symptoms and an increase in the use of words conveying positive emotions and different meanings (e.g., pre-intervention: “anxious”, depressed; post-intervention: “happy”, “the future”). Notably, the health changes identified through semantic content measures remained statistically significant even after accounting for the changes captured by the rating scales. Conclusion: Language responses analyzed using AI-methods assessed outcomes with fewer items, demonstrating effectiveness and accuracy comparable to traditional rating scales. Additionally, this approach provided valuable insights into patients' well-being beyond mere symptom reduction, thus highlighting areas of improvement that rating scales often overlook. Since patients often prefer using natural language to express their mental health, this method could complement, and address comprehension issues associated fixed-item questionnaires.
(Less)
- author
- Garcia, Danilo
LU
; Granjard, Alexandre
; Vanhée, Loïs
; Berg, Matilda
; Andersson, Gerhard
; Lasota, Marta
LU
and Sikström, Sverker
LU
- organization
- publishing date
- 2025-07
- type
- Contribution to journal
- publication status
- published
- subject
- keywords
- Artificial intelligence, Internet-based cognitive behavioral therapy, Mental health interventions, Natural language, Outcome assessment
- in
- Journal of Affective Disorders
- volume
- 381
- pages
- 10 pages
- publisher
- Elsevier
- external identifiers
-
- pmid:40187428
- scopus:105002678303
- ISSN
- 0165-0327
- DOI
- 10.1016/j.jad.2025.04.003
- language
- English
- LU publication?
- yes
- id
- e73cf388-fb76-4c0f-97e9-14495209fb41
- date added to LUP
- 2025-08-06 11:51:12
- date last changed
- 2025-08-07 02:43:32
@article{e73cf388-fb76-4c0f-97e9-14495209fb41,
abstract = {{<p>Objective: Although patients prefer describing their problems using words, mental health interventions are commonly evaluated using rating scales. Fortunately, recent advances in natural language processing (i.e., AI-methods) yield new opportunities to quantify people's own mental health descriptions. Our aim was to explore whether responses to open-ended questions, quantified using AI, provide additional value in measuring intervention outcomes compared to traditional rating scales. Method: Swedish adolescents (N = 44) who received Internet-based Cognitive Behavioral Therapy (ICBT) for eight weeks completed (pre/post) scales measuring anxiety and depression and three open-ended questions (related to depression, anxiety and general mental health). The language responses were quantified using a large language model and quantitative methods to predict mental health as measured by rating scales, valence (i.e., words' positive/negative affectivity), and semantic content (i.e., meaning). Results: Similar to the rating scales, language measures revealed statistically significant health improvements between pre and post measures such as reduced depression and anxiety symptoms and an increase in the use of words conveying positive emotions and different meanings (e.g., pre-intervention: “anxious”, depressed; post-intervention: “happy”, “the future”). Notably, the health changes identified through semantic content measures remained statistically significant even after accounting for the changes captured by the rating scales. Conclusion: Language responses analyzed using AI-methods assessed outcomes with fewer items, demonstrating effectiveness and accuracy comparable to traditional rating scales. Additionally, this approach provided valuable insights into patients' well-being beyond mere symptom reduction, thus highlighting areas of improvement that rating scales often overlook. Since patients often prefer using natural language to express their mental health, this method could complement, and address comprehension issues associated fixed-item questionnaires.</p>}},
author = {{Garcia, Danilo and Granjard, Alexandre and Vanhée, Loïs and Berg, Matilda and Andersson, Gerhard and Lasota, Marta and Sikström, Sverker}},
issn = {{0165-0327}},
keywords = {{Artificial intelligence; Internet-based cognitive behavioral therapy; Mental health interventions; Natural language; Outcome assessment}},
language = {{eng}},
pages = {{659--668}},
publisher = {{Elsevier}},
series = {{Journal of Affective Disorders}},
title = {{AI-driven analyzes of open-ended responses to assess outcomes of internet-based cognitive behavioral therapy (ICBT) in adolescents with anxiety and depression comorbidity}},
url = {{http://dx.doi.org/10.1016/j.jad.2025.04.003}},
doi = {{10.1016/j.jad.2025.04.003}},
volume = {{381}},
year = {{2025}},
}