Unshared Task : (Dis)agreement in Online Debates
(2016) 3rd Workshop on Argument Mining (ArgMining '16) In Proceedings of the Annual Meeting of the Association for Computational Linguistics p.154-159- Abstract
- Topic-independent expressions for conveying agreement and disagreement were annotated in a corpus of web forum debates, in order to evaluate a classifier trained to detect these two categories. Among the 175 expressions annotated in the evaluation set, 163 were unique, which shows that there is large variation in expressions used. This variation might be one of the reasons why the task of automatically detecting the categories was difficult. F-scores of 0.44 and 0.37 were achieved by a classifier trained on 2,000 debate sentences for detecting sentence-level agreement and disagreement.
Please use this url to cite or link to this publication:
https://lup.lub.lu.se/record/83f5d4b0-71de-445a-bec5-792d6e3583b7
- author
- Skeppstedt, Maria ; Sahlgren, Magnus ; Paradis, Carita LU and Kerren, Andreas
- organization
- publishing date
- 2016
- type
- Chapter in Book/Report/Conference proceeding
- publication status
- published
- subject
- keywords
- argumentation mining, online debates, classifier, agreement, disagreement, stance, corpus, annotation
- host publication
- The 54th Annual Meeting of the Association for Computational Linguistics : Proceedings of the 3rd Workshop on Argument Mining (ArgMining2016) - Proceedings of the 3rd Workshop on Argument Mining (ArgMining2016)
- series title
- Proceedings of the Annual Meeting of the Association for Computational Linguistics
- editor
- Reed, Chris
- pages
- 6 pages
- publisher
- Association for Computational Linguistics (ACL)
- conference name
- 3rd Workshop on Argument Mining (ArgMining '16)
- conference location
- Berlin, Germany
- conference dates
- 2016-08-07 - 2016-08-12
- external identifiers
-
- scopus:85096282579
- scopus:85096282579
- ISSN
- 0736-587X
- ISBN
- 978-1-945626-17-3
- DOI
- 10.18653/v1/W16-2818
- language
- English
- LU publication?
- yes
- additional info
- ACL Anthology ID: W16-28
- id
- 83f5d4b0-71de-445a-bec5-792d6e3583b7
- date added to LUP
- 2016-11-28 20:51:20
- date last changed
- 2023-03-20 12:14:11
@inproceedings{83f5d4b0-71de-445a-bec5-792d6e3583b7, abstract = {{Topic-independent expressions for conveying agreement and disagreement were annotated in a corpus of web forum debates, in order to evaluate a classifier trained to detect these two categories. Among the 175 expressions annotated in the evaluation set, 163 were unique, which shows that there is large variation in expressions used. This variation might be one of the reasons why the task of automatically detecting the categories was difficult. F-scores of 0.44 and 0.37 were achieved by a classifier trained on 2,000 debate sentences for detecting sentence-level agreement and disagreement.}}, author = {{Skeppstedt, Maria and Sahlgren, Magnus and Paradis, Carita and Kerren, Andreas}}, booktitle = {{The 54th Annual Meeting of the Association for Computational Linguistics : Proceedings of the 3rd Workshop on Argument Mining (ArgMining2016)}}, editor = {{Reed, Chris}}, isbn = {{978-1-945626-17-3}}, issn = {{0736-587X}}, keywords = {{argumentation mining; online debates; classifier; agreement; disagreement; stance; corpus; annotation}}, language = {{eng}}, pages = {{154--159}}, publisher = {{Association for Computational Linguistics (ACL)}}, series = {{Proceedings of the Annual Meeting of the Association for Computational Linguistics}}, title = {{Unshared Task : (Dis)agreement in Online Debates}}, url = {{http://dx.doi.org/10.18653/v1/W16-2818}}, doi = {{10.18653/v1/W16-2818}}, year = {{2016}}, }