A Conceptual Framework and Recommendations for Open Data and Artifacts in Empirical Software Engineering
Runeson, Per LU
; Söderberg, Emma
LU
and Höst, Martin
LU
(2024)
International Workshop on Methodological Issues with Empirical Studies in Software Engineering, WSESE 2024
In ICSE Workshops
- Abstract
- Open science aims to improve research accessibility, replicability, and consequently its quality. Empirical software engineering entails both data and artifacts, which may be shared more or less openly, to support transparency. However, the trade-offs involved in balancing the openness against integrity and secrecy concerns need methodological guidance. Aim. We aim to derive such advice, based on our own experiences from a research project, in the field of gaze-assisted code reviews – the Gander case. Method. We draw on literature about open data and artifacts in socio-technical research. Next, we describe our case project and derive a conceptual framework of steps in research data analysis and artifact development, using our data and... (More)
- Open science aims to improve research accessibility, replicability, and consequently its quality. Empirical software engineering entails both data and artifacts, which may be shared more or less openly, to support transparency. However, the trade-offs involved in balancing the openness against integrity and secrecy concerns need methodological guidance. Aim. We aim to derive such advice, based on our own experiences from a research project, in the field of gaze-assisted code reviews – the Gander case. Method. We draw on literature about open data and artifacts in socio-technical research. Next, we describe our case project and derive a conceptual framework of steps in research data analysis and artifact development, using our data and artifacts as illustrating examples. Results. The conceptual framework contains 1) a categorization of humans involved as participants and their concerns, 2) four steps for data analysis, each resulting in corresponding data and meta-data, and 3) three steps of artifact distribution, matching different levels of openness. We derive a preliminary set of recommendations for open science practices for data and artifacts. Conclusion. The conceptual framework has proven useful in summarizing and discussing data and artifacts in the studied case project. We envision that the framework and recommendations will provide a foundation for further advancement of open science research practices in empirical, socio-technical software engineering. (Less)
Please use this url to cite or link to this publication:
https://lup.lub.lu.se/record/1b2b62e6-4066-46d8-a0a3-350af4173201
- author
- Runeson, Per
LU
; Söderberg, Emma
LU
and Höst, Martin
LU
- organization
- publishing date
- 2024
- type
- Chapter in Book/Report/Conference proceeding
- publication status
- published
- subject
- host publication
- 1st International Workshop on Methodological Issues with Empirical Studies in Software Engineering
- series title
- ICSE Workshops
- editor
- Vegas, Sira ; Jedlitschka, Andreas and Carver, Jeffrey C.
- publisher
- Association for Computing Machinery (ACM)
- conference name
- International Workshop on Methodological Issues with Empirical Studies in Software Engineering, WSESE 2024
- conference location
- Lisbon, Portugal
- conference dates
- 2024-04-14 - 2024-04-20
- DOI
- 10.1145/3643664.3648206
- language
- English
- LU publication?
- yes
- id
- 1b2b62e6-4066-46d8-a0a3-350af4173201
- date added to LUP
- 2024-02-12 20:46:08
- date last changed
- 2024-02-14 08:01:52
@inproceedings{1b2b62e6-4066-46d8-a0a3-350af4173201,
abstract = {{Open science aims to improve research accessibility, replicability, and consequently its quality. Empirical software engineering entails both data and artifacts, which may be shared more or less openly, to support transparency. However, the trade-offs involved in balancing the openness against integrity and secrecy concerns need methodological guidance. Aim. We aim to derive such advice, based on our own experiences from a research project, in the field of gaze-assisted code reviews – the Gander case. Method. We draw on literature about open data and artifacts in socio-technical research. Next, we describe our case project and derive a conceptual framework of steps in research data analysis and artifact development, using our data and artifacts as illustrating examples. Results. The conceptual framework contains 1) a categorization of humans involved as participants and their concerns, 2) four steps for data analysis, each resulting in corresponding data and meta-data, and 3) three steps of artifact distribution, matching different levels of openness. We derive a preliminary set of recommendations for open science practices for data and artifacts. Conclusion. The conceptual framework has proven useful in summarizing and discussing data and artifacts in the studied case project. We envision that the framework and recommendations will provide a foundation for further advancement of open science research practices in empirical, socio-technical software engineering.}},
author = {{Runeson, Per and Söderberg, Emma and Höst, Martin}},
booktitle = {{1st International Workshop on Methodological Issues with Empirical Studies in Software Engineering}},
editor = {{Vegas, Sira and Jedlitschka, Andreas and Carver, Jeffrey C.}},
language = {{eng}},
publisher = {{Association for Computing Machinery (ACM)}},
series = {{ICSE Workshops}},
title = {{A Conceptual Framework and Recommendations for Open Data and Artifacts in Empirical Software Engineering}},
url = {{https://lup.lub.lu.se/search/files/171186875/Open_science_in_socio_technical_SE_WSESE_ICSE24-10.pdf}},
doi = {{10.1145/3643664.3648206}},
year = {{2024}},
}