The Library
Codeveloping and evaluating a campaign to reduce dementia misconceptions on Twitter : machine learning study
Tools
Erturk, Sinan, Hudson, Georgie, Jansli, Sonja M., Morris, Daniel, Odoi, Clarissa M., Wilson, Emma, Clayton-Turner, Angela, Bray, Vanessa, Yourston, Gill, Cornwall, Andrew, Cummins, Nicholas, Wykes, Til and Jilka, Sagar (2022) Codeveloping and evaluating a campaign to reduce dementia misconceptions on Twitter : machine learning study. JMIR Infodemiology, 2 (2). e36871. doi:10.2196/36871 ISSN 2564-1891.
|
PDF
WRAP-Codeveloping-and-evaluating-a-campaign-to-reduce-dementia-misconceptions-on-Twitter-machine-learning-study-Jilka-2022.pdf - Published Version - Requires a PDF viewer. Available under License Creative Commons Attribution 4.0. Download (842Kb) | Preview |
Official URL: https://doi.org/10.2196/36871
Abstract
Background:
Dementia misconceptions on Twitter can have detrimental or harmful effects. Machine learning (ML) models codeveloped with carers provide a method to identify these and help in evaluating awareness campaigns.
Objective:
This study aimed to develop an ML model to distinguish between misconceptions and neutral tweets and to develop, deploy, and evaluate an awareness campaign to tackle dementia misconceptions.
Methods:
Taking 1414 tweets rated by carers from our previous work, we built 4 ML models. Using a 5-fold cross-validation, we evaluated them and performed a further blind validation with carers for the best 2 ML models; from this blind validation, we selected the best model overall. We codeveloped an awareness campaign and collected pre-post campaign tweets (N=4880), classifying them with our model as misconceptions or not. We analyzed dementia tweets from the United Kingdom across the campaign period (N=7124) to investigate how current events influenced misconception prevalence during this time.
Results:
A random forest model best identified misconceptions with an accuracy of 82% from blind validation and found that 37% of the UK tweets (N=7124) about dementia across the campaign period were misconceptions. From this, we could track how the prevalence of misconceptions changed in response to top news stories in the United Kingdom. Misconceptions significantly rose around political topics and were highest (22/28, 79% of the dementia tweets) when there was controversy over the UK government allowing to continue hunting during the COVID-19 pandemic. After our campaign, there was no significant change in the prevalence of misconceptions.
Conclusions:
Through codevelopment with carers, we developed an accurate ML model to predict misconceptions in dementia tweets. Our awareness campaign was ineffective, but similar campaigns could be enhanced through ML to respond to current events that affect misconceptions in real time.
Item Type: | Journal Article | |||||||||||||||
---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
Subjects: | H Social Sciences > HM Sociology Q Science > QA Mathematics > QA76 Electronic computers. Computer science. Computer software R Medicine > RC Internal medicine > RC0321 Neuroscience. Biological psychiatry. Neuropsychiatry |
|||||||||||||||
Divisions: | Faculty of Science, Engineering and Medicine > Medicine > Warwick Medical School | |||||||||||||||
Library of Congress Subject Headings (LCSH): | Alzheimer's disease -- Social aspects, Machine learning, Social media and society, Medical misconceptions, Stigma (Social psychology) | |||||||||||||||
Journal or Publication Title: | JMIR Infodemiology | |||||||||||||||
Publisher: | JMIR Publications Inc. | |||||||||||||||
ISSN: | 2564-1891 | |||||||||||||||
Official Date: | 22 November 2022 | |||||||||||||||
Dates: |
|
|||||||||||||||
Volume: | 2 | |||||||||||||||
Number: | 2 | |||||||||||||||
Number of Pages: | 12 | |||||||||||||||
Article Number: | e36871 | |||||||||||||||
DOI: | 10.2196/36871 | |||||||||||||||
Status: | Peer Reviewed | |||||||||||||||
Publication Status: | Published | |||||||||||||||
Access rights to Published version: | Open Access (Creative Commons) | |||||||||||||||
Date of first compliant deposit: | 29 November 2022 | |||||||||||||||
Date of first compliant Open Access: | 29 November 2022 | |||||||||||||||
RIOXX Funder/Project Grant: |
|
Request changes or add full text files to a record
Repository staff actions (login required)
View Item |
Downloads
Downloads per month over past year