Revealing teaching quality through lesson semantics : A GPT-assisted analysis of transcripts
(2025) In The British journal of educational psychology- Abstract
BACKGROUND: Existing conceptions of teaching quality assume that classroom interactions serve as the foundation for effective teaching. The resulting data necessitates analytical approaches capable of extracting the semantics of these interactions.
AIM: This study investigates whether and to what extent lesson semantics provide insights into teaching quality (i.e., cognitive engagement, encouragement and warmth, multiple approaches, and the nature of discourse). To achieve this, GPT-4 was applied as a tool for analysing lesson transcripts.
SAMPLE: The study is based on data from the TALIS Video study, which included N = 50 teachers delivering two consecutive mathematics lessons in 9th grade. Teaching quality was annotated by... (More)
BACKGROUND: Existing conceptions of teaching quality assume that classroom interactions serve as the foundation for effective teaching. The resulting data necessitates analytical approaches capable of extracting the semantics of these interactions.
AIM: This study investigates whether and to what extent lesson semantics provide insights into teaching quality (i.e., cognitive engagement, encouragement and warmth, multiple approaches, and the nature of discourse). To achieve this, GPT-4 was applied as a tool for analysing lesson transcripts.
SAMPLE: The study is based on data from the TALIS Video study, which included N = 50 teachers delivering two consecutive mathematics lessons in 9th grade. Teaching quality was annotated by trained observers across multiple dimensions.
METHOD: The analysis involved embedding segmented lesson transcripts to examine their semantic characteristics and associations with human annotations of teaching quality. Additionally, we applied content-informed prompting to evaluate the interpretability of semantic characteristics for the considered dimensions.
RESULTS: GPT-4 identified five distinct semantic representations of transcripts, varying at both the teacher and lesson levels. These representations were related to teaching quality, accounting for up to 20% of variance in teaching quality annotations. Content-informed prompting aligned lesson segments more closely with semantic representations, supporting their interpretability.
CONCLUSION: The findings suggest that lesson semantics serve as indicators of teaching quality, offering a promising approach to understanding effective classroom learning.
(Less)
- author
- Göllner, Richard ; Lazarides, Rebecca and Stark, Philipp LU
- organization
- publishing date
- 2025-06-10
- type
- Contribution to journal
- publication status
- epub
- subject
- in
- The British journal of educational psychology
- publisher
- Wiley-Blackwell
- external identifiers
-
- scopus:105007907206
- pmid:40495397
- ISSN
- 0007-0998
- DOI
- 10.1111/bjep.70001
- language
- English
- LU publication?
- yes
- additional info
- © 2025 The Author(s). British Journal of Educational Psychology published by John Wiley & Sons Ltd on behalf of British Psychological Society.
- id
- 92f511a6-8bfc-4112-8175-9a341938fee4
- date added to LUP
- 2025-06-17 13:22:21
- date last changed
- 2025-06-24 09:11:10
@article{92f511a6-8bfc-4112-8175-9a341938fee4,
abstract = {{<p>BACKGROUND: Existing conceptions of teaching quality assume that classroom interactions serve as the foundation for effective teaching. The resulting data necessitates analytical approaches capable of extracting the semantics of these interactions.</p><p>AIM: This study investigates whether and to what extent lesson semantics provide insights into teaching quality (i.e., cognitive engagement, encouragement and warmth, multiple approaches, and the nature of discourse). To achieve this, GPT-4 was applied as a tool for analysing lesson transcripts.</p><p>SAMPLE: The study is based on data from the TALIS Video study, which included N = 50 teachers delivering two consecutive mathematics lessons in 9th grade. Teaching quality was annotated by trained observers across multiple dimensions.</p><p>METHOD: The analysis involved embedding segmented lesson transcripts to examine their semantic characteristics and associations with human annotations of teaching quality. Additionally, we applied content-informed prompting to evaluate the interpretability of semantic characteristics for the considered dimensions.</p><p>RESULTS: GPT-4 identified five distinct semantic representations of transcripts, varying at both the teacher and lesson levels. These representations were related to teaching quality, accounting for up to 20% of variance in teaching quality annotations. Content-informed prompting aligned lesson segments more closely with semantic representations, supporting their interpretability.</p><p>CONCLUSION: The findings suggest that lesson semantics serve as indicators of teaching quality, offering a promising approach to understanding effective classroom learning.</p>}},
author = {{Göllner, Richard and Lazarides, Rebecca and Stark, Philipp}},
issn = {{0007-0998}},
language = {{eng}},
month = {{06}},
publisher = {{Wiley-Blackwell}},
series = {{The British journal of educational psychology}},
title = {{Revealing teaching quality through lesson semantics : A GPT-assisted analysis of transcripts}},
url = {{http://dx.doi.org/10.1111/bjep.70001}},
doi = {{10.1111/bjep.70001}},
year = {{2025}},
}