The Library
Lessons from a breast cell annotation competition series for school pupils
Tools
Lu, Wenqi, Miligy, Islam M., Minhas, Fayyaz, Park, Young Saeng, Snead, David R. J., Rakha, Emad A., Verrill, Clare and Rajpoot, Nasir (2022) Lessons from a breast cell annotation competition series for school pupils. Scientific Reports, 12 (1). 7792. doi:10.1038/s41598-022-11782-9 ISSN 2045-2322.
|
PDF
WRAP-Lessons-from-a-breast-cell-annotation-competition-series-for-school-pupils-Lu-22.pdf - Published Version - Requires a PDF viewer. Available under License Creative Commons Attribution 4.0. Download (1857Kb) | Preview |
Official URL: http://dx.doi.org/10.1038/s41598-022-11782-9
Abstract
Due to COVID-19 outbreaks, most school pupils have had to be home-schooled for long periods of time. Two editions of a web-based competition “Beat the Pathologists” for school age participants in the UK ran to fill up pupils’ spare time after home-schooling and evaluate their ability on contributing to AI annotation. The two editions asked the participants to annotate different types of cells on Ki67 stained breast cancer images. The Main competition was at four levels with different level of complexity. We obtained annotations of four kinds of cells entered by school pupils and ground truth from expert pathologists. In this paper, we analyse school pupils’ performance on differentiating different kinds of cells and compare their performance with two neural networks (AlexNet and VGG16). It was observed that children tend to get very good performance in tumour cell annotation with the best F1 measure 0.81 which is a metrics taking both false positives and false negatives into account. Low accuracy was achieved with F1 score 0.75 on positive non-tumour cells and 0.59 on negative non-tumour cells. Superior performance on non-tumour cell detection was achieved by neural networks. VGG16 with training from scratch achieved an F1 score over 0.70 in all cell categories and 0.92 in tumour cell detection. We conclude that non-experts like school pupils have the potential to contribute to large-scale labelling for AI algorithm development if sufficient training activities are organised. We hope that competitions like this can promote public interest in pathology and encourage participation by more non-experts for annotation.
Item Type: | Journal Article | ||||||||||||
---|---|---|---|---|---|---|---|---|---|---|---|---|---|
Subjects: | Q Science > QH Natural history R Medicine > RC Internal medicine |
||||||||||||
Divisions: | Faculty of Science, Engineering and Medicine > Science > Computer Science Faculty of Science, Engineering and Medicine > Engineering > WMG (Formerly the Warwick Manufacturing Group) |
||||||||||||
Library of Congress Subject Headings (LCSH): | Pathology, Cellular , Breast -- Cytopathology, Cells -- Identification -- Data processing, Cells -- Morphology -- Computer simulation | ||||||||||||
Journal or Publication Title: | Scientific Reports | ||||||||||||
Publisher: | Nature Publishing Group | ||||||||||||
ISSN: | 2045-2322 | ||||||||||||
Official Date: | 12 May 2022 | ||||||||||||
Dates: |
|
||||||||||||
Volume: | 12 | ||||||||||||
Number: | 1 | ||||||||||||
Number of Pages: | 11 | ||||||||||||
Article Number: | 7792 | ||||||||||||
DOI: | 10.1038/s41598-022-11782-9 | ||||||||||||
Status: | Peer Reviewed | ||||||||||||
Publication Status: | Published | ||||||||||||
Access rights to Published version: | Open Access (Creative Commons) | ||||||||||||
Date of first compliant deposit: | 5 July 2022 | ||||||||||||
Date of first compliant Open Access: | 6 July 2022 | ||||||||||||
RIOXX Funder/Project Grant: |
|
Request changes or add full text files to a record
Repository staff actions (login required)
View Item |
Downloads
Downloads per month over past year