Cohen, Andrew L., Sanborn, Adam N. and Shiffrin, Richard M. (2008) Model evaluation using grouped or individual data. Psychonomic Bulletin & Review, Vol.15 (No.4). pp. 692-712. doi:10.3758/PBR.15.4.692 ISSN 1069-9384.

Research output not available from this repository.

Request-a-Copy directly from author or use local Library Get it For Me service.

Request Changes to record.

Abstract

Analyzing the data of individuals has several advantages over analyzing the data combined across the individuals (the latter we term group analysis): Grouping can distort the form of data, and different individuals might perform the task using different processes and parameters. These factors notwithstanding, we demonstrate conditions in which group analysis outperforms individual analysis. Such conditions include those in which there are relatively few trials per subject per condition, a situation that sometimes introduces distortions and biases when models are fit and parameters are estimated. We employed a simulation technique in which data were generated from each of two known models, each with parameter variation across simulated individuals. We examined how well the generating model and its competitor each fared in fitting (both sets of) the data, using both individual and group analysis. We examined the accuracy of model selection (the probability that the correct model would be selected by the analysis method). Trials per condition and individuals per experiment were varied systematically. Three pairs of cognitive models were compared: exponential versus power models of forgetting, generalized context versus prototype models of categorization, and the fuzzy logical model of perception versus the linear integration model of information integration. We show that there are situations in which small numbers of trials per condition cause group analysis to outperform individual analysis. Additional tables and figures may be downloaded from the Psychonomic Society Archive of Norms, Stimuli, and Data, www.psychonomic.org/archive.

Item Type:	Journal Article
Subjects:	B Philosophy. Psychology. Religion > BF Psychology
Divisions:	Faculty of Science, Engineering and Medicine > Science > Psychology
Library of Congress Subject Headings (LCSH):	Cognitive psychology, Human information processing
Journal or Publication Title:	Psychonomic Bulletin & Review
Publisher:	Springer New York LLC
ISSN:	1069-9384
Official Date:	2008
Dates:	Date Event 2008 Published
Volume:	Vol.15
Number:	No.4
Page Range:	pp. 692-712
DOI:	10.3758/PBR.15.4.692
Status:	Peer Reviewed
Funder:	National Institute of Mental Health (U.S.)
Grant number:	1 R01 MH12717 (NIMH), 1 R01 MH63993 (NIMH)

Request changes or add full text files to a record

Repository staff actions (login required)

View Item