Replicated Study of Effectiveness Evaluation of Cutting-Edge Software Engineering

Yukasa MURAKAMI; Masateru TSUNODA

doi:10.1587/transinf.2021MPL0002

Replicated Study of Effectiveness Evaluation of Cutting-Edge Software Engineering

Yukasa MURAKAMI, Masateru TSUNODA

Full Text Views

0

Cite this

Summary :

Although many software engineering studies have been conducted, it is not clear whether they meet the needs of software development practitioners. Some studies evaluated the effectiveness of software engineering research by practitioners, to clarify the research satisfies the needs of the practitioners. We performed replicated study of them, recruiting practitioners who mainly belong to SMEs (small and medium-sized enterprises) to the survey. We asked 16 practitioners to evaluate cutting-edge software engineering studies presented in ICSE 2016. In the survey, we set the viewpoint of the evaluation as the effectiveness for the respondent's own work. As a result, the ratio of positive answers (i.e., the answers were greater than 2 on a 5-point scale) was 33.3%, and the ratio was lower than past studies. The result was not affected by the number of employees in the respondent's company, but would be affected by the viewpoint of the evaluation.

Publication: IEICE TRANSACTIONS on Information Vol.E105-D No.1 pp.21-25

Publication Date: 2022/01/01

Publicized: 2021/12/02

Online ISSN: 1745-1361

DOI: 10.1587/transinf.2021MPL0002

Type of Manuscript: Special Section LETTER (Special Section on Empirical Software Engineering)

Category

Authors

Yukasa MURAKAMI
Kindai University
Masateru TSUNODA
Kindai University

Keyword

replicated study, questionnaire, effectiveness, interest

Cite this

Copy

Yukasa MURAKAMI, Masateru TSUNODA, "Replicated Study of Effectiveness Evaluation of Cutting-Edge Software Engineering" in IEICE TRANSACTIONS on Information, vol. E105-D, no. 1, pp. 21-25, January 2022, doi: 10.1587/transinf.2021MPL0002.
Abstract: Although many software engineering studies have been conducted, it is not clear whether they meet the needs of software development practitioners. Some studies evaluated the effectiveness of software engineering research by practitioners, to clarify the research satisfies the needs of the practitioners. We performed replicated study of them, recruiting practitioners who mainly belong to SMEs (small and medium-sized enterprises) to the survey. We asked 16 practitioners to evaluate cutting-edge software engineering studies presented in ICSE 2016. In the survey, we set the viewpoint of the evaluation as the effectiveness for the respondent's own work. As a result, the ratio of positive answers (i.e., the answers were greater than 2 on a 5-point scale) was 33.3%, and the ratio was lower than past studies. The result was not affected by the number of employees in the respondent's company, but would be affected by the viewpoint of the evaluation.
URL: https://global.ieice.org/en_transactions/information/10.1587/transinf.2021MPL0002/_p

Copy

@ARTICLE{e105-d_1_21,
author={Yukasa MURAKAMI, Masateru TSUNODA, },
journal={IEICE TRANSACTIONS on Information},
title={Replicated Study of Effectiveness Evaluation of Cutting-Edge Software Engineering},
year={2022},
volume={E105-D},
number={1},
pages={21-25},
abstract={Although many software engineering studies have been conducted, it is not clear whether they meet the needs of software development practitioners. Some studies evaluated the effectiveness of software engineering research by practitioners, to clarify the research satisfies the needs of the practitioners. We performed replicated study of them, recruiting practitioners who mainly belong to SMEs (small and medium-sized enterprises) to the survey. We asked 16 practitioners to evaluate cutting-edge software engineering studies presented in ICSE 2016. In the survey, we set the viewpoint of the evaluation as the effectiveness for the respondent's own work. As a result, the ratio of positive answers (i.e., the answers were greater than 2 on a 5-point scale) was 33.3%, and the ratio was lower than past studies. The result was not affected by the number of employees in the respondent's company, but would be affected by the viewpoint of the evaluation.},
keywords={},
doi={10.1587/transinf.2021MPL0002},
ISSN={1745-1361},
month={January},}

Copy

TY - JOUR
TI - Replicated Study of Effectiveness Evaluation of Cutting-Edge Software Engineering
T2 - IEICE TRANSACTIONS on Information
SP - 21
EP - 25
AU - Yukasa MURAKAMI
AU - Masateru TSUNODA
PY - 2022
DO - 10.1587/transinf.2021MPL0002
JO - IEICE TRANSACTIONS on Information
SN - 1745-1361
VL - E105-D
IS - 1
JA - IEICE TRANSACTIONS on Information
Y1 - January 2022
AB - Although many software engineering studies have been conducted, it is not clear whether they meet the needs of software development practitioners. Some studies evaluated the effectiveness of software engineering research by practitioners, to clarify the research satisfies the needs of the practitioners. We performed replicated study of them, recruiting practitioners who mainly belong to SMEs (small and medium-sized enterprises) to the survey. We asked 16 practitioners to evaluate cutting-edge software engineering studies presented in ICSE 2016. In the survey, we set the viewpoint of the evaluation as the effectiveness for the respondent's own work. As a result, the ratio of positive answers (i.e., the answers were greater than 2 on a 5-point scale) was 33.3%, and the ratio was lower than past studies. The result was not affected by the number of employees in the respondent's company, but would be affected by the viewpoint of the evaluation.
ER -