The Library
Demonstrating software reliability using possibly correlated tests : Insights from a conservative Bayesian approach
Tools
Salako, Kizito and Zhao, Xingyu (2024) Demonstrating software reliability using possibly correlated tests : Insights from a conservative Bayesian approach. Quality and Reliability Engineering International, 40 (3). pp. 1197-1220. doi:10.1002/qre.3460 ISSN 0748-8017.
Research output not available from this repository.
Request-a-Copy directly from author or use local Library Get it For Me service.
Official URL: http://dx.doi.org/10.1002/qre.3460
Abstract
This paper presents Bayesian techniques for conservative claims about software reliability, particularly when evidence suggests the software's executions are not statistically independent. We formalise informal notions of “doubting” that the executions are independent, and incorporate such doubts into reliability assessments. We develop techniques that reveal the extent to which independence assumptions can undermine conservatism in assessments, and identify conditions under which this impact is not significant. These techniques – novel extensions of conservative Bayesian inference (CBI) approaches – give conservative confidence bounds on the software's failure probability per execution. With illustrations in two application areas – nuclear power-plant safety and autonomous vehicle (AV) safety – our analyses reveals: (1) the confidence an assessor should possess before subjecting a system to operational testing. Otherwise, such testing is futile – favourable operational testing evidence will eventually decrease one's confidence in the system being sufficiently reliable; (2) the independence assumption supports conservative claims sometimes; (3) in some scenarios, observing a system operate without failure gives less confidence in the system than if some failures had been observed; (4) building confidence in a system is very sensitive to failures – each additional failure means significantly more operational testing is required, in order to support a reliability claim.
Item Type: | Journal Article | |||||||||
---|---|---|---|---|---|---|---|---|---|---|
Divisions: | Faculty of Science, Engineering and Medicine > Engineering > WMG (Formerly the Warwick Manufacturing Group) | |||||||||
Journal or Publication Title: | Quality and Reliability Engineering International | |||||||||
Publisher: | Wiley | |||||||||
ISSN: | 0748-8017 | |||||||||
Official Date: | April 2024 | |||||||||
Dates: |
|
|||||||||
Volume: | 40 | |||||||||
Number: | 3 | |||||||||
Page Range: | pp. 1197-1220 | |||||||||
DOI: | 10.1002/qre.3460 | |||||||||
Status: | Peer Reviewed | |||||||||
Publication Status: | Published | |||||||||
Access rights to Published version: | Open Access (Creative Commons) | |||||||||
RIOXX Funder/Project Grant: |
|
Request changes or add full text files to a record
Repository staff actions (login required)
View Item |