Validity of Kit-Build Method for Assessment of Learner-Build Map by Comparing with Manual Methods

Warunya WUNNASRI; Jaruwat PAILAI; Yusuke HAYASHI; Tsukasa HIRASHIMA

doi:10.1587/transinf.2017EDP7177

IEICE TRANSACTIONS on Information

Validity of Kit-Build Method for Assessment of Learner-Build Map by Comparing with Manual Methods

Warunya WUNNASRI, Jaruwat PAILAI, Yusuke HAYASHI, Tsukasa HIRASHIMA

Full Text Views

0

Cite this

Summary :

This paper describes an investigation into the validity of an automatic assessment method of the learner-build concept map by comparing it with two well-known manual methods. We have previously proposed the Kit-Build (KB) concept map framework where a learner builds a concept map by using only a provided set of components, known as the set “kit”. In this framework, instant and automatic assessment of a learner-build concept map has been realized. We call this assessment method the “Kit-Build method” (KB method). The framework and assessment method have already been practically used in classrooms in various schools. As an investigation of the validity of this method, we have conducted an experiment as a case study to compare the assessment results of the method with the assessment results of two other manual assessment methods. In this experiment, 22 university students attended as subjects and four as raters. It was found that the scores of the KB method had a very strong correlation with the scores of the other manual methods. The results of this experiment are one of evidence to show the automatic assessment of the Kit-Build concept map can attain almost the same level of validity as well-known manual assessment methods.

Publication: IEICE TRANSACTIONS on Information Vol.E101-D No.4 pp.1141-1150

Publication Date: 2018/04/01

Publicized: 2018/01/11

Online ISSN: 1745-1361

DOI: 10.1587/transinf.2017EDP7177

Type of Manuscript: PAPER

Category: Educational Technology

Authors

Warunya WUNNASRI
  Hiroshima University
Jaruwat PAILAI
  Hiroshima University
Yusuke HAYASHI
  Hiroshima University
Tsukasa HIRASHIMA
  Hiroshima University

Keyword

concept map assessment method, kit-build concept map, validity

Cite this

Copy

Warunya WUNNASRI, Jaruwat PAILAI, Yusuke HAYASHI, Tsukasa HIRASHIMA, "Validity of Kit-Build Method for Assessment of Learner-Build Map by Comparing with Manual Methods" in IEICE TRANSACTIONS on Information, vol. E101-D, no. 4, pp. 1141-1150, April 2018, doi: 10.1587/transinf.2017EDP7177.
Abstract: This paper describes an investigation into the validity of an automatic assessment method of the learner-build concept map by comparing it with two well-known manual methods. We have previously proposed the Kit-Build (KB) concept map framework where a learner builds a concept map by using only a provided set of components, known as the set “kit”. In this framework, instant and automatic assessment of a learner-build concept map has been realized. We call this assessment method the “Kit-Build method” (KB method). The framework and assessment method have already been practically used in classrooms in various schools. As an investigation of the validity of this method, we have conducted an experiment as a case study to compare the assessment results of the method with the assessment results of two other manual assessment methods. In this experiment, 22 university students attended as subjects and four as raters. It was found that the scores of the KB method had a very strong correlation with the scores of the other manual methods. The results of this experiment are one of evidence to show the automatic assessment of the Kit-Build concept map can attain almost the same level of validity as well-known manual assessment methods.
URL: https://global.ieice.org/en_transactions/information/10.1587/transinf.2017EDP7177/_p

Copy

@ARTICLE{e101-d_4_1141,
author={Warunya WUNNASRI, Jaruwat PAILAI, Yusuke HAYASHI, Tsukasa HIRASHIMA, },
journal={IEICE TRANSACTIONS on Information},
title={Validity of Kit-Build Method for Assessment of Learner-Build Map by Comparing with Manual Methods},
year={2018},
volume={E101-D},
number={4},
pages={1141-1150},
abstract={This paper describes an investigation into the validity of an automatic assessment method of the learner-build concept map by comparing it with two well-known manual methods. We have previously proposed the Kit-Build (KB) concept map framework where a learner builds a concept map by using only a provided set of components, known as the set “kit”. In this framework, instant and automatic assessment of a learner-build concept map has been realized. We call this assessment method the “Kit-Build method” (KB method). The framework and assessment method have already been practically used in classrooms in various schools. As an investigation of the validity of this method, we have conducted an experiment as a case study to compare the assessment results of the method with the assessment results of two other manual assessment methods. In this experiment, 22 university students attended as subjects and four as raters. It was found that the scores of the KB method had a very strong correlation with the scores of the other manual methods. The results of this experiment are one of evidence to show the automatic assessment of the Kit-Build concept map can attain almost the same level of validity as well-known manual assessment methods.},
keywords={},
doi={10.1587/transinf.2017EDP7177},
ISSN={1745-1361},
month={April},}

Copy

TY - JOUR
TI - Validity of Kit-Build Method for Assessment of Learner-Build Map by Comparing with Manual Methods
T2 - IEICE TRANSACTIONS on Information
SP - 1141
EP - 1150
AU - Warunya WUNNASRI
AU - Jaruwat PAILAI
AU - Yusuke HAYASHI
AU - Tsukasa HIRASHIMA
PY - 2018
DO - 10.1587/transinf.2017EDP7177
JO - IEICE TRANSACTIONS on Information
SN - 1745-1361
VL - E101-D
IS - 4
JA - IEICE TRANSACTIONS on Information
Y1 - April 2018
AB - This paper describes an investigation into the validity of an automatic assessment method of the learner-build concept map by comparing it with two well-known manual methods. We have previously proposed the Kit-Build (KB) concept map framework where a learner builds a concept map by using only a provided set of components, known as the set “kit”. In this framework, instant and automatic assessment of a learner-build concept map has been realized. We call this assessment method the “Kit-Build method” (KB method). The framework and assessment method have already been practically used in classrooms in various schools. As an investigation of the validity of this method, we have conducted an experiment as a case study to compare the assessment results of the method with the assessment results of two other manual assessment methods. In this experiment, 22 university students attended as subjects and four as raters. It was found that the scores of the KB method had a very strong correlation with the scores of the other manual methods. The results of this experiment are one of evidence to show the automatic assessment of the Kit-Build concept map can attain almost the same level of validity as well-known manual assessment methods.
ER -

IEICE TRANSACTIONS on Information