The Library
Model evaluation using grouped or individual data
Tools
Tools
Tools
Cohen, Andrew L., Sanborn, Adam N. and Shiffrin, Richard M. (2008) Model evaluation using grouped or individual data. Psychonomic Bulletin & Review, Vol.15 (No.4). pp. 692-712. doi:10.3758/PBR.15.4.692
Research output not available from this repository, contact author.
Official URL: http://dx.doi.org/10.3758/PBR.15.4.692
Abstract
Analyzing the data of individuals has several advantages over analyzing the data combined across the individuals (the latter we term group analysis): Grouping can distort the form of data, and different individuals might perform the task using different processes and parameters. These factors notwithstanding, we demonstrate conditions in which group analysis outperforms individual analysis. Such conditions include those in which there are relatively few trials per subject per condition, a situation that sometimes introduces distortions and biases when models are fit and parameters are estimated. We employed a simulation technique in which data were generated from each of two known models, each with parameter variation across simulated individuals. We examined how well the generating model and its competitor each fared in fitting (both sets of) the data, using both individual and group analysis. We examined the accuracy of model selection (the probability that the correct model would be selected by the analysis method). Trials per condition and individuals per experiment were varied systematically. Three pairs of cognitive models were compared: exponential versus power models of forgetting, generalized context versus prototype models of categorization, and the fuzzy logical model of perception versus the linear integration model of information integration. We show that there are situations in which small numbers of trials per condition cause group analysis to outperform individual analysis. Additional tables and figures may be downloaded from the Psychonomic Society Archive of Norms, Stimuli, and Data, www.psychonomic.org/archive.
| Item Type: | Journal Article | ||||
|---|---|---|---|---|---|
| Subjects: | B Philosophy. Psychology. Religion > BF Psychology | ||||
| Divisions: | Faculty of Science > Psychology | ||||
| Library of Congress Subject Headings (LCSH): | Cognitive psychology, Human information processing | ||||
| Journal or Publication Title: | Psychonomic Bulletin & Review | ||||
| Publisher: | Springer New York LLC | ||||
| ISSN: | 1069-9384 | ||||
| Official Date: | 2008 | ||||
| Dates: |
|
||||
| Volume: | Vol.15 | ||||
| Number: | No.4 | ||||
| Page Range: | pp. 692-712 | ||||
| DOI: | 10.3758/PBR.15.4.692 | ||||
| Status: | Peer Reviewed | ||||
| Funder: | National Institute of Mental Health (U.S.) | ||||
| Grant number: | 1 R01 MH12717 (NIMH), 1 R01 MH63993 (NIMH) |
Request changes or add full text files to a record
Repository staff actions (login required)
 |
View Item |
