The Library
A Bayesian end-to-end model with estimated uncertainties for simple question answering over knowledge bases
Tools
Zhang, Linhai, Lin, Chao, Zhou, Deyu, He, Yulan and Zhang, Meng (2021) A Bayesian end-to-end model with estimated uncertainties for simple question answering over knowledge bases. Computer Speech & Language, 66 . 101167. doi:10.1016/j.csl.2020.101167 ISSN 0885-2308.
|
PDF
WRAP-Bayesian-end-to-end-model-estimated-2021.pdf - Accepted Version - Requires a PDF viewer. Available under License Creative Commons Attribution Non-commercial No Derivatives 4.0. Download (1064Kb) | Preview |
Official URL: https://doi.org/10.1016/j.csl.2020.101167
Abstract
Existing methods for question answering over knowledge bases (KBQA) ignore the consideration of the model prediction uncertainties. We argue that estimating such uncertainties is crucial for the reliability and interpretability of KBQA systems. Therefore, we propose a novel end-to-end KBQA model based on Bayesian Neural Network (BNN) to estimate uncertainties arose from both model and data. To our best knowledge, we are the first to consider the uncertainty estimation problem for the KBQA task using BNN. The proposed end-to-end model integrates entity detection and relation prediction into a unified framework, and employs BNN to model entity and relation under the given question semantics, transforming network weights into distributions. Therefore, predictive distributions can be estimated by sampling weights and forward inputs through the network multiple times. Uncertainties can be further quantified by calculating the variances of predictive distributions. The experimental results demonstrate the effectiveness of uncertainties in both the misclassification detection task and cause of error detection task. Furthermore, the proposed model also achieves comparable performance compared to the existing state-of-the-art approaches on SimpleQuestions dataset.
Item Type: | Journal Article | ||||||||||||
---|---|---|---|---|---|---|---|---|---|---|---|---|---|
Subjects: | Q Science > Q Science (General) Q Science > QA Mathematics > QA76 Electronic computers. Computer science. Computer software |
||||||||||||
Divisions: | Faculty of Science, Engineering and Medicine > Science > Computer Science | ||||||||||||
Library of Congress Subject Headings (LCSH): | Question-answering systems, Expert systems (Computer science) , Neural networks (Computer science), Uncertainty (Information theory) , Bayesian statistical decision theory | ||||||||||||
Journal or Publication Title: | Computer Speech & Language | ||||||||||||
Publisher: | Elsevier | ||||||||||||
ISSN: | 0885-2308 | ||||||||||||
Official Date: | March 2021 | ||||||||||||
Dates: |
|
||||||||||||
Volume: | 66 | ||||||||||||
Article Number: | 101167 | ||||||||||||
DOI: | 10.1016/j.csl.2020.101167 | ||||||||||||
Status: | Peer Reviewed | ||||||||||||
Publication Status: | Published | ||||||||||||
Access rights to Published version: | Restricted or Subscription Access | ||||||||||||
Date of first compliant deposit: | 1 January 2021 | ||||||||||||
Date of first compliant Open Access: | 27 October 2021 | ||||||||||||
RIOXX Funder/Project Grant: |
|
Request changes or add full text files to a record
Repository staff actions (login required)
View Item |
Downloads
Downloads per month over past year