Skip to main content

Lund University Publications

LUND UNIVERSITY LIBRARIES

Unshared Task : (Dis)agreement in Online Debates

Skeppstedt, Maria ; Sahlgren, Magnus ; Paradis, Carita LU orcid and Kerren, Andreas (2016) 3rd Workshop on Argument Mining (ArgMining '16) In Proceedings of the Annual Meeting of the Association for Computational Linguistics p.154-159
Abstract
Topic-independent expressions for conveying agreement and disagreement were annotated in a corpus of web forum debates, in order to evaluate a classifier trained to detect these two categories. Among the 175 expressions annotated in the evaluation set, 163 were unique, which shows that there is large variation in expressions used. This variation might be one of the reasons why the task of automatically detecting the categories was difficult. F-scores of 0.44 and 0.37 were achieved by a classifier trained on 2,000 debate sentences for detecting sentence-level agreement and disagreement.
Please use this url to cite or link to this publication:
author
; ; and
organization
publishing date
type
Chapter in Book/Report/Conference proceeding
publication status
published
subject
keywords
argumentation mining, online debates, classifier, agreement, disagreement, stance, corpus, annotation
host publication
The 54th Annual Meeting of the Association for Computational Linguistics : Proceedings of the 3rd Workshop on Argument Mining (ArgMining2016) - Proceedings of the 3rd Workshop on Argument Mining (ArgMining2016)
series title
Proceedings of the Annual Meeting of the Association for Computational Linguistics
editor
Reed, Chris
pages
6 pages
publisher
Association for Computational Linguistics (ACL)
conference name
3rd Workshop on Argument Mining (ArgMining '16)
conference location
Berlin, Germany
conference dates
2016-08-07 - 2016-08-12
external identifiers
  • scopus:85096282579
  • scopus:85096282579
ISSN
0736-587X
ISBN
978-1-945626-17-3
DOI
10.18653/v1/W16-2818
language
English
LU publication?
yes
additional info
ACL Anthology ID: W16-28
id
83f5d4b0-71de-445a-bec5-792d6e3583b7
date added to LUP
2016-11-28 20:51:20
date last changed
2023-03-20 12:14:11
@inproceedings{83f5d4b0-71de-445a-bec5-792d6e3583b7,
  abstract     = {{Topic-independent expressions for conveying agreement and disagreement were annotated in a corpus of web forum debates, in order to evaluate a classifier trained to detect these two categories. Among the 175 expressions annotated in the evaluation set, 163 were unique, which shows that there is large variation in expressions used. This variation might be one of the reasons why the task of automatically detecting the categories was difficult. F-scores of 0.44 and 0.37 were achieved by a classifier trained on 2,000 debate sentences for detecting sentence-level agreement and disagreement.}},
  author       = {{Skeppstedt, Maria and Sahlgren, Magnus and Paradis, Carita and Kerren, Andreas}},
  booktitle    = {{The 54th Annual Meeting of the Association for Computational Linguistics : Proceedings of the 3rd Workshop on Argument Mining (ArgMining2016)}},
  editor       = {{Reed, Chris}},
  isbn         = {{978-1-945626-17-3}},
  issn         = {{0736-587X}},
  keywords     = {{argumentation mining; online debates; classifier; agreement; disagreement; stance; corpus; annotation}},
  language     = {{eng}},
  pages        = {{154--159}},
  publisher    = {{Association for Computational Linguistics (ACL)}},
  series       = {{Proceedings of the Annual Meeting of the Association for Computational Linguistics}},
  title        = {{Unshared Task : (Dis)agreement in Online Debates}},
  url          = {{http://dx.doi.org/10.18653/v1/W16-2818}},
  doi          = {{10.18653/v1/W16-2818}},
  year         = {{2016}},
}