The Library

Everything you never wanted to know about circular analysis, but were afraid to ask

Tools

Kriegeskorte, Nikolaus, Lindquist, Martin A., Nichols, Thomas E., Poldrack, Russell A. and Vul, Edward (2010) Everything you never wanted to know about circular analysis, but were afraid to ask. Journal of Cerebral Blood Flow and Metabolism, Vol.30 (No.9). pp. 1551-1557. ISSN 0271-678X

Full text not available from this repository.

Official URL: http://dx.doi.org/10.1038/jcbfm.2010.86

Abstract

Over the past year, a heated discussion about 'circular' or 'nonindependent' analysis in brain imaging has emerged in the literature. An analysis is circular (or nonindependent) if it is based on data that were selected for showing the effect of interest or a related effect. The authors of this paper are researchers who have contributed to the discussion and span a range of viewpoints. To clarify points of agreement and disagreement in the community, we collaboratively assembled a series of questions on circularity herein, to which we provide our individual current answers in <= 100 words per question. Although divergent views remain on some of the questions, there is also a substantial convergence of opinion, which we have summarized in a consensus box. The box provides the best current answers that the five authors could agree upon.

Item Type:

Journal Item

Subjects:

Q Science > QA Mathematics
R Medicine > RC Internal medicine > RC0321 Neuroscience. Biological psychiatry. Neuropsychiatry

Divisions:

Faculty of Science > Statistics
Faculty of Science > WMG (Formerly the Warwick Manufacturing Group)

Library of Congress Subject Headings (LCSH):

Brain -- Imaging -- Statistical methods, Brain -- Magnetic resonance imaging, Circular data

Journal or Publication Title:

Journal of Cerebral Blood Flow and Metabolism

Publisher:

Nature Publishing Group

ISSN:

0271-678X

Official Date:

September 2010

Dates:

Date	Event
September 2010	Published

Volume:

Vol.30

Number:

No.9

Number of Pages:

Page Range:

pp. 1551-1557

Identification Number:

10.1038/jcbfm.2010.86

Status:

Peer Reviewed

Publication Status:

Published

Access rights to Published version:

Open Access

Description:

Review article

References:

Barrett LF (2009) Understanding the mind by measuring
the brain: lessons from measuring behavior (Commentary
on Vul et al., 2009). Perspect Psychol Sci 4:314–8
Diener E (2009) Editor’s introduction to Vul et al. (2009)
and comments. Perspect Psychol Sci 4:272–3
Friston KJ, Worsley KJ, Frackowiak RSJ, Mazziotta JC,
Evans AC (1994) Assessing the significance of focal
activations using their spatial extent. Hum Brain Mapp
1:214–20
Genovese CR, Lazar NA, Nichols T (2002) Thresholding of
statistical maps in functional neuroimaging using the
false discovery rate. Neuroimage 15:870–8
Ioannidis JP (2008) Why most discovered true associations
are inflated. Epidemiology 19:640–8
Ioannidis JPA (2005) Why most published research findings
are false. PLoS Med 2:e124. doi:10.1371/journal.
pmed.0020124
Kriegeskorte N, Simmons WK, Bellgowan PSF, Baker CI
(2009) Circular analysis in systems neuroscience—the
dangers of double dipping. Nat Neurosci 12:535–40
Lazar NA (2009) Discussion of ‘puzzlingly high correlations in
fMRI studies of emotion, personality, and social cognition’
by Vul et al. (2009). Perspect Psychol Sci 4:308–9
Lieberman MD, Berkman ET, Wager TD (2009) Correlations
in social neuroscience aren’t voodoo: commentary on
Vul et al. (2009). Perspect Psychol Sci 4:299–307
Lindquist M, Gelman A (2009) Correlations and multiple
comparisons in functional imaging: a statistical perspective
(Commentary on Vul et al., 2009). Perspect
Psychol Sci 4:310–3
Lindquist M, Spicer J, Leotti L, Asllani I, Wager T (2009)
Localizing areas with significant inter-individual variation:
testing variance components in a multi-level GLM.
Hum Brain Mapp Annu Meet
Nichols TE, Holmes AP (2002) Nonparametric permutation
tests for functional neuroimaging: a primer with examples.
Hum Brain Mapp 15:1–25
Nichols TE, Hayasaka S (2003) Controlling the familywise
error rate in functional neuroimaging: a comparative
review. Stat Methods Med Res 12:419–46
Nichols TE, Poline J-B (2009) Commentary on Vul et al.’s
(2009) ‘puzzlingly high correlations in fMRI studies of
emotion, personality, and social cognition’. Perspect
Psychol Sci 4:291–3
Poldrack RA, Mumford JA (2009) Independence in ROI
analysis: where is the voodoo? Soc Cog Affect Neurosci
4:208–13
Poline JB, Mazoyer BM (1993) Analysis of individual
positron emission tomography activation maps by
detection of high signal-to-noise-ratio pixel clusters.
J Cereb Blood Flow Metab 13:425–37
Vul E, Harris C,Winkielman P, Pashler H (2009a) Puzzlingly
high correlations in fMRI studies of emotion, personality,
and social cognition. Perspect Psychol Sci 4:274–90
Vul E, Harris C, Winkielman P, Pashler H (2009b) Reply to
comments on ‘puzzlingly high correlations in fMRI
studies of emotion, personality, and social cognition’.
Perspect Psychol Sci 4:319–24
Vul E, Kanwisher N (2010) Begging the question: the nonindependence
error in fMRI data analysis. In: Foundational
Issues for Human Brain Mapping (Hanson S,
Bunzl M, eds). MIT Press: Cambridge, MA
Worsley KJ, Evans AC, Marrett S, Neelin P (1992) A threedimensional
statistical analysis for rCBF activation studies
in human brain. J Cereb Blood Flow Metab 12:900–18
Yarkoni T (2009) Big correlations in little studies: inflated
fMRI correlations reflect low statistical power. Commentary
on Vul et al. (2009). Perspect Psychol Sci 4:294–8