A rule-based expert system for automatic question classification in mathematics adaptive assessment on indonesian elementary school environment

Umi Laili Yuhana, Siti Rochimah, Eko Mulyanto Yuniarno, Aliia Rysbekova, Alex Tormasi, L. Kóczy, Mauridhi Hery Purnomo

Research output: Contribution to journalArticle

Abstract

This paper is part of research in developing a competency-based assessment system for mathematics in Indonesian elementary school environment. An essential task is to accurately classify questions based on competency and difficulty level. Thus, an expert system is needed to classify those questions since competency information is often manually defined by experts. The objectives of this work are replacing a human expert’s role in the related knowledge engineering process and providing a rule-based expert system to supersede an expert to classify the questions. Five types of the rule-based algorithm: OneR, RIPPER, PART, FURIA, and J48, were applied to the dataset, which is comprised of 9454 real mathematics examination questions collected from several Indonesian elementary schools. Following the knowledge engineering principles, these algorithms generated the classification rules based on a pattern of the data. The rules of the best performing algorithm were utilized by a knowledge base for inference. Finally, to be able to fully measure the system performance, ten expert teachers were involved in the question classification step. The results confirm that the system meets the stated objectives in classifying the competency and the difficulty level of a question automatically.

Original languageEnglish
Pages (from-to)143-161
Number of pages19
JournalInternational Journal of Innovative Computing, Information and Control
Volume15
Issue number1
DOIs
Publication statusPublished - Feb 1 2019

Fingerprint

Rule-based Systems
Expert System
Expert systems
Knowledge engineering
Knowledge Engineering
Classify
Classification Rules
Knowledge Base
System Performance

Keywords

  • Adaptive assessment
  • Automatic question classification
  • Rule-based expert system

ASJC Scopus subject areas

  • Software
  • Theoretical Computer Science
  • Information Systems
  • Computational Theory and Mathematics

Cite this

A rule-based expert system for automatic question classification in mathematics adaptive assessment on indonesian elementary school environment. / Yuhana, Umi Laili; Rochimah, Siti; Yuniarno, Eko Mulyanto; Rysbekova, Aliia; Tormasi, Alex; Kóczy, L.; Purnomo, Mauridhi Hery.

In: International Journal of Innovative Computing, Information and Control, Vol. 15, No. 1, 01.02.2019, p. 143-161.

Research output: Contribution to journalArticle

Yuhana, Umi Laili ; Rochimah, Siti ; Yuniarno, Eko Mulyanto ; Rysbekova, Aliia ; Tormasi, Alex ; Kóczy, L. ; Purnomo, Mauridhi Hery. / A rule-based expert system for automatic question classification in mathematics adaptive assessment on indonesian elementary school environment. In: International Journal of Innovative Computing, Information and Control. 2019 ; Vol. 15, No. 1. pp. 143-161.
@article{14706fb4b58446d5aee1f0e487066f6a,
title = "A rule-based expert system for automatic question classification in mathematics adaptive assessment on indonesian elementary school environment",
abstract = "This paper is part of research in developing a competency-based assessment system for mathematics in Indonesian elementary school environment. An essential task is to accurately classify questions based on competency and difficulty level. Thus, an expert system is needed to classify those questions since competency information is often manually defined by experts. The objectives of this work are replacing a human expert’s role in the related knowledge engineering process and providing a rule-based expert system to supersede an expert to classify the questions. Five types of the rule-based algorithm: OneR, RIPPER, PART, FURIA, and J48, were applied to the dataset, which is comprised of 9454 real mathematics examination questions collected from several Indonesian elementary schools. Following the knowledge engineering principles, these algorithms generated the classification rules based on a pattern of the data. The rules of the best performing algorithm were utilized by a knowledge base for inference. Finally, to be able to fully measure the system performance, ten expert teachers were involved in the question classification step. The results confirm that the system meets the stated objectives in classifying the competency and the difficulty level of a question automatically.",
keywords = "Adaptive assessment, Automatic question classification, Rule-based expert system",
author = "Yuhana, {Umi Laili} and Siti Rochimah and Yuniarno, {Eko Mulyanto} and Aliia Rysbekova and Alex Tormasi and L. K{\'o}czy and Purnomo, {Mauridhi Hery}",
year = "2019",
month = "2",
day = "1",
doi = "10.24507/ijicic.15.01.143",
language = "English",
volume = "15",
pages = "143--161",
journal = "International Journal of Innovative Computing, Information and Control",
issn = "1349-4198",
publisher = "IJICIC Editorial Office",
number = "1",

}

TY - JOUR

T1 - A rule-based expert system for automatic question classification in mathematics adaptive assessment on indonesian elementary school environment

AU - Yuhana, Umi Laili

AU - Rochimah, Siti

AU - Yuniarno, Eko Mulyanto

AU - Rysbekova, Aliia

AU - Tormasi, Alex

AU - Kóczy, L.

AU - Purnomo, Mauridhi Hery

PY - 2019/2/1

Y1 - 2019/2/1

N2 - This paper is part of research in developing a competency-based assessment system for mathematics in Indonesian elementary school environment. An essential task is to accurately classify questions based on competency and difficulty level. Thus, an expert system is needed to classify those questions since competency information is often manually defined by experts. The objectives of this work are replacing a human expert’s role in the related knowledge engineering process and providing a rule-based expert system to supersede an expert to classify the questions. Five types of the rule-based algorithm: OneR, RIPPER, PART, FURIA, and J48, were applied to the dataset, which is comprised of 9454 real mathematics examination questions collected from several Indonesian elementary schools. Following the knowledge engineering principles, these algorithms generated the classification rules based on a pattern of the data. The rules of the best performing algorithm were utilized by a knowledge base for inference. Finally, to be able to fully measure the system performance, ten expert teachers were involved in the question classification step. The results confirm that the system meets the stated objectives in classifying the competency and the difficulty level of a question automatically.

AB - This paper is part of research in developing a competency-based assessment system for mathematics in Indonesian elementary school environment. An essential task is to accurately classify questions based on competency and difficulty level. Thus, an expert system is needed to classify those questions since competency information is often manually defined by experts. The objectives of this work are replacing a human expert’s role in the related knowledge engineering process and providing a rule-based expert system to supersede an expert to classify the questions. Five types of the rule-based algorithm: OneR, RIPPER, PART, FURIA, and J48, were applied to the dataset, which is comprised of 9454 real mathematics examination questions collected from several Indonesian elementary schools. Following the knowledge engineering principles, these algorithms generated the classification rules based on a pattern of the data. The rules of the best performing algorithm were utilized by a knowledge base for inference. Finally, to be able to fully measure the system performance, ten expert teachers were involved in the question classification step. The results confirm that the system meets the stated objectives in classifying the competency and the difficulty level of a question automatically.

KW - Adaptive assessment

KW - Automatic question classification

KW - Rule-based expert system

UR - http://www.scopus.com/inward/record.url?scp=85060479572&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=85060479572&partnerID=8YFLogxK

U2 - 10.24507/ijicic.15.01.143

DO - 10.24507/ijicic.15.01.143

M3 - Article

VL - 15

SP - 143

EP - 161

JO - International Journal of Innovative Computing, Information and Control

JF - International Journal of Innovative Computing, Information and Control

SN - 1349-4198

IS - 1

ER -