Skip to main content

LUP Student Papers

LUND UNIVERSITY LIBRARIES

Bedömning av korrekthet och komplexitet i ett muntligt språkfärdighetstest

Agebjörn, Anders LU (2015) SPVR01 20151
Master's Programme: Language and Linguistics
Abstract
In this thesis, I investigate the relation between assessed speaking proficiency and measured complexity and accuracy in twenty test-takers’ performance in the oral part of the Swedish certificate test Swedex B2. Accuracy and complexity have been measured in seven different ways; both global and local measures from the CAF (Complexity–Accuracy–Fluency) triad have been used. Also, each test-taker’s level of processability capacity, according to the Processability theory (PT), has been estimated. Hence, I have tested correlations between in total eight measurements using Pearson’s correlation coefficient (r). Most measures co-vary with each other with some degree of significance. Furthermore, correlations between measurements and grades have... (More)
In this thesis, I investigate the relation between assessed speaking proficiency and measured complexity and accuracy in twenty test-takers’ performance in the oral part of the Swedish certificate test Swedex B2. Accuracy and complexity have been measured in seven different ways; both global and local measures from the CAF (Complexity–Accuracy–Fluency) triad have been used. Also, each test-taker’s level of processability capacity, according to the Processability theory (PT), has been estimated. Hence, I have tested correlations between in total eight measurements using Pearson’s correlation coefficient (r). Most measures co-vary with each other with some degree of significance. Furthermore, correlations between measurements and grades have been tested. The effect of accuracy and complexity on both a specific grade for ‘Formal accuracy and complexity’ and two holistic grades – one for the oral part of the test and one for the whole test, consisting of four parts – have been investigated. Results indicate that most measurements co-vary with the holistic grade for the oral exam. However, the specific grade co-varies with foremost global accuracy measures, indicating a halo-effect. In a final qualitative investigation, four test-takers are selected and examined closer. From this study, all seven CAF measures can be criticised; only PT level seems to capture the level of proficiency. Quantitative as well as qualitative results are considered in a discussion of both language testing and language proficiency measures. (Less)
Please use this url to cite or link to this publication:
author
Agebjörn, Anders LU
supervisor
organization
alternative title
Assessing accuracy and complexity in a L2 speaking proficiency test
course
SPVR01 20151
year
type
H2 - Master's Degree (Two Years)
subject
keywords
språkfärdighet, komplexitet, korrekthet, processbarhetsteorin, språktestning
language
Swedish
id
5156646
date added to LUP
2015-03-18 13:58:56
date last changed
2015-03-18 13:58:56
@misc{5156646,
  abstract     = {{In this thesis, I investigate the relation between assessed speaking proficiency and measured complexity and accuracy in twenty test-takers’ performance in the oral part of the Swedish certificate test Swedex B2. Accuracy and complexity have been measured in seven different ways; both global and local measures from the CAF (Complexity–Accuracy–Fluency) triad have been used. Also, each test-taker’s level of processability capacity, according to the Processability theory (PT), has been estimated. Hence, I have tested correlations between in total eight measurements using Pearson’s correlation coefficient (r). Most measures co-vary with each other with some degree of significance. Furthermore, correlations between measurements and grades have been tested. The effect of accuracy and complexity on both a specific grade for ‘Formal accuracy and complexity’ and two holistic grades – one for the oral part of the test and one for the whole test, consisting of four parts – have been investigated. Results indicate that most measurements co-vary with the holistic grade for the oral exam. However, the specific grade co-varies with foremost global accuracy measures, indicating a halo-effect. In a final qualitative investigation, four test-takers are selected and examined closer. From this study, all seven CAF measures can be criticised; only PT level seems to capture the level of proficiency. Quantitative as well as qualitative results are considered in a discussion of both language testing and language proficiency measures.}},
  author       = {{Agebjörn, Anders}},
  language     = {{swe}},
  note         = {{Student Paper}},
  title        = {{Bedömning av korrekthet och komplexitet i ett muntligt språkfärdighetstest}},
  year         = {{2015}},
}