Precise language responses versus easy rating scales—Comparing respondents’ views with clinicians’ belief of the respondent’s views
Sikström, Sverker LU
; Höök, Alfred Pålsson
and Kjell, Oscar
LU
(2023)
In PLoS ONE
18(2 February).
- Abstract
Background Closed-ended rating scales are the most used response format for researchers and clinicians to quantify mental states, whereas in natural contexts people communicate with natural language. The reason for using such scales is that they are typically argued to be more precise in measuring mental constructs; however, the respondents’ views as to what best communicates mental states are frequently ignored, which is important for making them comply with assessment. Methods We assessed respondents’ (N = 304) degree of depression using rating scales, descriptive words, selected words, and free text responses and probed the respondents for their preferences concerning the response formats across twelve dimensions related to the... (More)
Background Closed-ended rating scales are the most used response format for researchers and clinicians to quantify mental states, whereas in natural contexts people communicate with natural language. The reason for using such scales is that they are typically argued to be more precise in measuring mental constructs; however, the respondents’ views as to what best communicates mental states are frequently ignored, which is important for making them comply with assessment. Methods We assessed respondents’ (N = 304) degree of depression using rating scales, descriptive words, selected words, and free text responses and probed the respondents for their preferences concerning the response formats across twelve dimensions related to the precision of communicating their mental states and the ease of responding. This was compared with the clinicians’ (N = 40) belief of the respondent’s view. Results Respondents found free text to be more precise (e.g., precision d’ = .88, elaboration d’ = 2.0) than rating scales, whereas rating scales were rated as easier to respond to (e.g., easier d’ = –.67, faster d’ = –1.13). Respondents preferred the free text responses to a greater degree than rating scales compared to clinicians’ belief of the respondents’ views. Conclusions These findings support previous studies concluding that future assessment of mental health can be aided by computational methods based on text data. Participants prefer an open response format as it allows them to elaborate, be precise, etc., with respect to their mental health issues, although rating scales are viewed as faster and easier.
(Less)
- author
- Sikström, Sverker
LU
; Höök, Alfred Pålsson
and Kjell, Oscar
LU
- organization
- publishing date
- 2023-02
- type
- Contribution to journal
- publication status
- published
- subject
- in
- PLoS ONE
- volume
- 18
- issue
- 2 February
- article number
- e0267995
- publisher
- Public Library of Science (PLoS)
- external identifiers
-
- scopus:85148250159
- pmid:36791090
- ISSN
- 1932-6203
- DOI
- 10.1371/journal.pone.0267995
- language
- English
- LU publication?
- yes
- additional info
- Funding Information: Marianne och Marcus Wallenbergs Stiftelse (MMW-2021.0058).”AI-based language models for improving diagnostics, monitoring, and outcome of depression and anxiety”. Vinnova. Förbättrad diagnostisering av mental hälsa med beskrivande ord och artificiell intelligens. (2018-02007). Kamprad Foundation. Förbättrad diagnostik för psykisk ohälsa hos äldre: implementering av beslutsstöd baserat på beskrivande ord och artificiell intelligens, ref # 20180281 The funders had no role in study design, data collection and analysis, decision to publish, or preparation of the manuscript.
- id
- 1cc9d85e-ccc0-4873-a2c8-219e553bcad3
- date added to LUP
- 2023-03-02 17:00:33
- date last changed
- 2024-04-18 20:00:25
@article{1cc9d85e-ccc0-4873-a2c8-219e553bcad3,
abstract = {{<p>Background Closed-ended rating scales are the most used response format for researchers and clinicians to quantify mental states, whereas in natural contexts people communicate with natural language. The reason for using such scales is that they are typically argued to be more precise in measuring mental constructs; however, the respondents’ views as to what best communicates mental states are frequently ignored, which is important for making them comply with assessment. Methods We assessed respondents’ (N = 304) degree of depression using rating scales, descriptive words, selected words, and free text responses and probed the respondents for their preferences concerning the response formats across twelve dimensions related to the precision of communicating their mental states and the ease of responding. This was compared with the clinicians’ (N = 40) belief of the respondent’s view. Results Respondents found free text to be more precise (e.g., precision d’ = .88, elaboration d’ = 2.0) than rating scales, whereas rating scales were rated as easier to respond to (e.g., easier d’ = –.67, faster d’ = –1.13). Respondents preferred the free text responses to a greater degree than rating scales compared to clinicians’ belief of the respondents’ views. Conclusions These findings support previous studies concluding that future assessment of mental health can be aided by computational methods based on text data. Participants prefer an open response format as it allows them to elaborate, be precise, etc., with respect to their mental health issues, although rating scales are viewed as faster and easier.</p>}},
author = {{Sikström, Sverker and Höök, Alfred Pålsson and Kjell, Oscar}},
issn = {{1932-6203}},
language = {{eng}},
number = {{2 February}},
publisher = {{Public Library of Science (PLoS)}},
series = {{PLoS ONE}},
title = {{Precise language responses versus easy rating scales—Comparing respondents’ views with clinicians’ belief of the respondent’s views}},
url = {{http://dx.doi.org/10.1371/journal.pone.0267995}},
doi = {{10.1371/journal.pone.0267995}},
volume = {{18}},
year = {{2023}},
}