Advanced

Do open-ended survey questions on migration motives create coder variability problems?

Niedomysl, Thomas LU and Malmberg, Bo (2009) In Population, Space and Place 15(1). p.79-87
Abstract
Contemporary research on migration has benefi ted from adopting a variety of methodological approaches and different sources of information to provide answers to the ever-recurring question of why people migrate. Yet, when it comes to central methods used for researching migration motives, progress appears to have been slow. This paper focuses on surveys to research migration motives using self-administered postal questionnaires. It addresses a key validity

question, namely the issue of whether the usage of open-ended questions creates coder variability problems. An experimental

research design was used where fi ve coders independently coded 500 randomly selected responses from a large survey on migration

... (More)
Contemporary research on migration has benefi ted from adopting a variety of methodological approaches and different sources of information to provide answers to the ever-recurring question of why people migrate. Yet, when it comes to central methods used for researching migration motives, progress appears to have been slow. This paper focuses on surveys to research migration motives using self-administered postal questionnaires. It addresses a key validity

question, namely the issue of whether the usage of open-ended questions creates coder variability problems. An experimental

research design was used where fi ve coders independently coded 500 randomly selected responses from a large survey on migration

motives. Krippendorff’s a was calculated to test the level of agreement between the coders. The results advance our knowledge in two

important ways: fi rstly, it is shown that coder variability is not a major problem (Krippendorff’s a = 0.82). Secondly, it identifies those types of responses that nevertheless appear problematic to code. The implications of these fi ndings for survey research on migration motives are discussed, and it is argued that open-ended questions have some distinct advantages compared with the more commonly used closed-ended questions. (Less)
Please use this url to cite or link to this publication:
author
organization
publishing date
type
Contribution to journal
publication status
published
subject
keywords
migration motives, survey design, postal questionnaires, content analysis
in
Population, Space and Place
volume
15
issue
1
pages
79 - 87
publisher
John Wiley & Sons
external identifiers
  • Scopus:60549093013
ISSN
1544-8452
DOI
10.1002/psp.493
language
English
LU publication?
yes
id
36e40757-ee40-49e6-9c6a-ccfa1fdfc926 (old id 2426213)
date added to LUP
2012-04-16 17:33:49
date last changed
2016-11-15 15:05:30
@misc{36e40757-ee40-49e6-9c6a-ccfa1fdfc926,
  abstract     = {Contemporary research on migration has benefi ted from adopting a variety of methodological approaches and different sources of information to provide answers to the ever-recurring question of why people migrate. Yet, when it comes to central methods used for researching migration motives, progress appears to have been slow. This paper focuses on surveys to research migration motives using self-administered postal questionnaires. It addresses a key validity<br/><br>
question, namely the issue of whether the usage of open-ended questions creates coder variability problems. An experimental<br/><br>
research design was used where fi ve coders independently coded 500 randomly selected responses from a large survey on migration<br/><br>
motives. Krippendorff’s a was calculated to test the level of agreement between the coders. The results advance our knowledge in two<br/><br>
important ways: fi rstly, it is shown that coder variability is not a major problem (Krippendorff’s a = 0.82). Secondly, it identifies those types of responses that nevertheless appear problematic to code. The implications of these fi ndings for survey research on migration motives are discussed, and it is argued that open-ended questions have some distinct advantages compared with the more commonly used closed-ended questions.},
  author       = {Niedomysl, Thomas and Malmberg, Bo},
  issn         = {1544-8452},
  keyword      = {migration motives,survey design,postal questionnaires,content analysis},
  language     = {eng},
  number       = {1},
  pages        = {79--87},
  publisher    = {ARRAY(0x6a553a8)},
  series       = {Population, Space and Place},
  title        = {Do open-ended survey questions on migration motives create coder variability problems?},
  url          = {http://dx.doi.org/10.1002/psp.493},
  volume       = {15},
  year         = {2009},
}