The Library
Understanding metric-related pitfalls in image analysis validation.
Tools
(2024) Understanding metric-related pitfalls in image analysis validation. Nature Methods, 21 (2). pp. 182-194. doi:10.1038/s41592-023-02150-0 ISSN 1548-7091.
|
PDF
s41592-023-02150-0.pdf - Published Version - Requires a PDF viewer. Available under License Creative Commons Attribution 4.0. Download (3272Kb) | Preview |
Official URL: https://doi.org/10.1038/s41592-023-02150-0
Abstract
Validation metrics are key for tracking scientific progress and bridging the current chasm between artificial intelligence research and its translation into practice. However, increasing evidence shows that, particularly in image analysis, metrics are often chosen inadequately. Although taking into account the individual strengths, weaknesses and limitations of validation metrics is a critical prerequisite to making educated choices, the relevant knowledge is currently scattered and poorly accessible to individual researchers. Based on a multistage Delphi process conducted by a multidisciplinary expert consortium as well as extensive community feedback, the present work provides a reliable and comprehensive common point of access to information on pitfalls related to validation metrics in image analysis. Although focused on biomedical image analysis, the addressed pitfalls generalize across application domains and are categorized according to a newly created, domain-agnostic taxonomy. The work serves to enhance global comprehension of a key topic in image analysis validation. [Abstract copyright: © 2024. Springer Nature America, Inc.]
Item Type: | Journal Article | ||||||
---|---|---|---|---|---|---|---|
Divisions: | Faculty of Science, Engineering and Medicine > Science > Computer Science | ||||||
SWORD Depositor: | Library Publications Router | ||||||
Journal or Publication Title: | Nature Methods | ||||||
Publisher: | Nature Publishing Group | ||||||
ISSN: | 1548-7091 | ||||||
Official Date: | 12 February 2024 | ||||||
Dates: |
|
||||||
Volume: | 21 | ||||||
Number: | 2 | ||||||
Page Range: | pp. 182-194 | ||||||
DOI: | 10.1038/s41592-023-02150-0 | ||||||
Status: | Peer Reviewed | ||||||
Publication Status: | Published | ||||||
Access rights to Published version: | Open Access (Creative Commons) | ||||||
Date of first compliant deposit: | 27 March 2024 | ||||||
Date of first compliant Open Access: | 27 March 2024 |
Request changes or add full text files to a record
Repository staff actions (login required)
View Item |
Downloads
Downloads per month over past year