The Library
Evaluation of an automatic question generation approach using ontologies
Tools
Tools
Tools
Ibrahim Teo, Noor Hasimah and Joy, Mike (2017) Evaluation of an automatic question generation approach using ontologies. In: 15th European Conference on e-Learning (ECEL 2016), Prague, 27-28 Oct 2016. Published in: Proceedings of the 15th European Conference on e-Learning (ECEL 2016) pp. 735-743. ISBN 9781510832671.
|
PDF
WRAP-Evaluation-automatic-question-generation-approach-Joy-2016.pdf - Published Version - Requires a PDF viewer. Download (466Kb) | Preview |
Official URL: https://www.academic-conferences.org/conferences/e...
Abstract
Advancements in Semantic Web techniques have led to the emergence of ontology based question generation. Ontologies are used to represent domain knowledge in the form of concepts, instances and their relationships as their elements. Many research strategies for generating questions using ontologies have been proposed but little work has been done on investigating whether an ontology is an appropriate source of data for question generation. Since there is no standard guideline for developing an ontology, the representation of ontology elements might vary in many ways, and this paper aims to investigate how the naming of ontology elements would affect the questions generated. In order to achieve this aim, two research questions will be investigated which are: how many correct questions can be generated from an ontology, and what are the reasons for incorrect questions being generated. Categorized question templates and a set of question strategies for mapping templates with a concept in an ontology are proposed. A prototype has been developed with a Reader to read data from input file and 3 question genera tors namely termQG, ClassQG and PropertyQG to generate questions for 3 ontological approaches. After questions have been generated, the number of correct questions generated is calculated and the reasons for incorrect questions are identified. Two ontologies have been used, an Operating System Ontology and a Travel Ontology. Twenty question templates from three question categories – definition, concept completion and comparison – together with 5 question generation strategies have been used in this evaluation. Results shows that more than half of the questions generated are correct and there are 3 distinct reasons why incorrect questions may be generated. The main contribution to incorrect question generation was inappropriate naming of ontology elements where 4 distinct categories are further identified. In addition, evaluation shows that the object type should be considered when designing question templates. Furthermore, the evaluation indirectly shows the effectiveness of the ontological approaches for generating questions from a real-world ontology.
| Item Type: | Conference Item (Paper) | |||||||||
|---|---|---|---|---|---|---|---|---|---|---|
| Subjects: | L Education > LB Theory and practice of education > LB2300 Higher Education | |||||||||
| Divisions: | Faculty of Science, Engineering and Medicine > Science > Computer Science | |||||||||
| Library of Congress Subject Headings (LCSH): | Web-based instruction, Ontologies (Information retrieval), Semantic Web | |||||||||
| Journal or Publication Title: | Proceedings of the 15th European Conference on e-Learning (ECEL 2016) | |||||||||
| Publisher: | Academic Conferences Ltd | |||||||||
| ISBN: | 9781510832671 | |||||||||
| Official Date: | February 2017 | |||||||||
| Dates: |
|
|||||||||
| Page Range: | pp. 735-743 | |||||||||
| Status: | Peer Reviewed | |||||||||
| Publication Status: | Published | |||||||||
| Access rights to Published version: | Restricted or Subscription Access | |||||||||
| Date of first compliant deposit: | 4 December 2018 | |||||||||
| Date of first compliant Open Access: | 4 December 2018 | |||||||||
| RIOXX Funder/Project Grant: |
|
|||||||||
| Conference Paper Type: | Paper | |||||||||
| Title of Event: | 15th European Conference on e-Learning (ECEL 2016) | |||||||||
| Type of Event: | Conference | |||||||||
| Location of Event: | Prague | |||||||||
| Date(s) of Event: | 27-28 Oct 2016 | |||||||||
| Related URLs: |
Request changes or add full text files to a record
Repository staff actions (login required)
 |
View Item |
Downloads
Downloads per month over past year
