Advanced

A step-wise method for annotating APPRAISAL

Fuoli, Matteo LU (2018) In Functions of Language 25(2). p.229-258
Abstract
Despite a growing awareness of methodological issues, the literature on APPRAISAL has not so far provided adequate answers to some of the key challenges involved in reliably identifying and classifying evaluative language expressions. This article presents a step-wise method for the manual annotation of APPRAISAL in text that is designed to optimize reliability, replicability and transparency. The procedure consists of seven steps, from the creation of a context-specific annotation manual to the statistical analysis of the quantitative data derived from the manually-performed annotations. By presenting this method, the article pursues the twofold purpose of (i) providing a practical tool that can facilitate more reliable, replicable and... (More)
Despite a growing awareness of methodological issues, the literature on APPRAISAL has not so far provided adequate answers to some of the key challenges involved in reliably identifying and classifying evaluative language expressions. This article presents a step-wise method for the manual annotation of APPRAISAL in text that is designed to optimize reliability, replicability and transparency. The procedure consists of seven steps, from the creation of a context-specific annotation manual to the statistical analysis of the quantitative data derived from the manually-performed annotations. By presenting this method, the article pursues the twofold purpose of (i) providing a practical tool that can facilitate more reliable, replicable and transparent analyses, and (ii) fostering a discussion of the best practices that should be observed when manually annotating APPRAISAL. (Less)
Please use this url to cite or link to this publication:
author
publishing date
type
Contribution to journal
publication status
published
subject
keywords
challenges in analyzing APPRAISAL, intra-coder agreement, Reliability, replicability, transparency, inter-coder agreement
in
Functions of Language
volume
25
issue
2
pages
229 - 258
publisher
John Benjamins Publishing Company
external identifiers
  • scopus:84988801297
ISSN
1569-9765
DOI
10.1075/fol.15016.fuo
language
English
LU publication?
no
id
ff0ad6ea-fd02-45c1-bb16-82733dda74c5 (old id 8146128)
date added to LUP
2016-04-01 14:30:56
date last changed
2020-05-26 02:55:47
@article{ff0ad6ea-fd02-45c1-bb16-82733dda74c5,
  abstract     = {Despite a growing awareness of methodological issues, the literature on APPRAISAL has not so far provided adequate answers to some of the key challenges involved in reliably identifying and classifying evaluative language expressions. This article presents a step-wise method for the manual annotation of APPRAISAL in text that is designed to optimize reliability, replicability and transparency. The procedure consists of seven steps, from the creation of a context-specific annotation manual to the statistical analysis of the quantitative data derived from the manually-performed annotations. By presenting this method, the article pursues the twofold purpose of (i) providing a practical tool that can facilitate more reliable, replicable and transparent analyses, and (ii) fostering a discussion of the best practices that should be observed when manually annotating APPRAISAL.},
  author       = {Fuoli, Matteo},
  issn         = {1569-9765},
  language     = {eng},
  number       = {2},
  pages        = {229--258},
  publisher    = {John Benjamins Publishing Company},
  series       = {Functions of Language},
  title        = {A step-wise method for annotating APPRAISAL},
  url          = {https://lup.lub.lu.se/search/ws/files/23007580/Article_3_a_stepwise_model.pdf},
  doi          = {10.1075/fol.15016.fuo},
  volume       = {25},
  year         = {2018},
}