The Library

Methods of testing and diagnosing model error : dual and single route cascaded models of reading aloud

Tools

Adelman, James S. and Brown, G. D. A. (Gordon D. A.). (2008) Methods of testing and diagnosing model error : dual and single route cascaded models of reading aloud. Journal of Memory and Language, Vol.59 (No.4). pp. 524-544. ISSN 0749-596X

Preview

PDF
WRAP_Adelman_drc2.pdf - Requires a PDF viewer such as GSview, Xpdf or Adobe Acrobat Reader
Download (347Kb)

Official URL: http://dx.doi.org/10.1016/j.jml.2007.11.008

Abstract

Models of visual word recognition have been assessed by both factorial and regression approaches. Factorial approaches tend to provide a relatively weak test of models, and regression approaches give little indication of the sources of models’ mispredictions, especially when parameters are not optimal. A new alternative method, involving regression on model error, combines these two approaches with parameter optimization. The method is illustrated with respect to the dual route cascaded model of reading aloud. In contrast to previous investigations, this method provides clear evidence that there are parameter-independent problems with the model, and identifies two specific sources of misprediction made by model.

Item Type:	Journal Article
Subjects:	B Philosophy. Psychology. Religion > BF Psychology
Divisions:	Faculty of Science > Psychology
Library of Congress Subject Headings (LCSH):	Language and languages -- Research
Journal or Publication Title:	Journal of Memory and Language
Publisher:	Academic Press
ISSN:	0749-596X
Date:	14 January 2008
Volume:	Vol.59
Number:	No.4
Page Range:	pp. 524-544
Identification Number:	10.1016/j.jml.2007.11.008
Status:	Peer Reviewed
Access rights to Published version:	Open Access
Funder:	Economic and Social Research Council (Great Britain) (ESRC), Leverhulme Trust (LT), University of Warwick
Grant number:	RES-000-22-1558 and RES-062-23-0545 (ESRC), F/215/AY (Leverhulme)
Version or Related Resource:	Some portions of this paper are based on work presented at the Twenty-Seventh Annual Conference of the Cognitive Science Society.
References:	Adelman, J. S. (2005). Regularity and length effects in word naming: A test of the dual route cascaded model. In B. G. Bara, L. Barsalou, & M. Bucciarelli (Eds.), Proceedings of the twenty-seventh annual conference of the Cognitive Science Society (pp. 57–61). Alpha, NJ: Sheridan Printing. Adelman, J. S., & Brown, G. D. A. (2007). Phonographic neighbors, not orthographic neighbors, determine word naming latencies. Psychonomic Bulletin & Review, 14, 455–459. Adelman, J. S., & Brown, G. D. A. (in press). Modeling lexical decision: The form of frequency and diversity effects. Psychological Review. Adelman, J. S., Brown, G. D. A., & Quesada, J. F. (2006). Contextual diversity, not word frequency, determines word-naming and lexical decision times. Psychological Science, 17, 814–823. Andrews, S. (1989). Frequency and neighborhood effects on lexical access: Activation or search? Journal of Experimental Psychology: Learning, Memory, and Cognition, 15, 802–814. Andrews, S. (1992). Frequency and neighborhood effects on lexical access: Lexical similarity or orthographic redundancy? Journal of Experimental Psychology: Learning, Memory, and Cognition, 18, 234–254. Andrews, S., & Scarratt, D. R. (1998). Rule and analogy mechanisms in reading nonwords: Hough dou peapel rede gnew wirds? Journal of Experimental Psychology: Human Perception and Performance, 24, 1052–1086. Andrews, S., Woollams, A., & Bond, R. (2005). Spelling-sound typicality only affects words with digraphs: Further qualifications to the generality of the regularity effect on word naming. Journal of Memory and Language, 53, 567–593. Baayen, R. H., Piepenbrock, R., & Gulikers, L. (1995). The CELEX Lexical Database (Release 2) [CD-ROM]. Philadelphia: Linguistic Data Consortium, University of Pennsylvania. Balota, D. A., Cortese, M. J., & Pilotti, M. (1999). Item-level analysis of lexical decision: Results from a mega-study. In Abstracts of the 40th Annual Meeting of the Psychonomics Society (p. 44). Los Angeles, CA: Psychonomic Society. Balota, D. A., Cortese, M. J., Sergent-Marshall, S. D., Spieler, D. H., & Yap, M. J. (2004). Visual word recognition of single-syllable words. Journal of Experimental Psychology: General, 133, 283–316. Balota, D. A., & Spieler, D. H. (1998). The utility of item-level analyses in model evaluation: A reply to Seidenberg and Plaut. Psychological Science, 9, 238–240. Besner, D. (1999). Basic processes in reading: Multiple routines in localist and connectionist models. Cambridge, MA: MIT Press. Besner, D., & Borowsky, R. (2006). Postscript: Plaut and Booth’s (2006) new simulations — What have we learned? Psychological Review, 113, 194–195. Besner, D., Twilley, L., McCann, R. S., & Seergobin, K. (1990). On the association between connectionism and data: Are a few words necessary? Psychological Review, 97, 432–446. Coltheart, M., Curtis, B., Atkins, P., & Haller, M. (1993). Models of reading aloud: Dual-route and parallel-distributed-processing approaches. Psychological Review, 100, 589–608. Coltheart, M., Davelaar, E., Jonasson, J. T., & Besner, D. (1977). Access to the internal lexicon. In S. Dorniˇc (Ed.), Attention and performance VI (pp. 535–555). Hillsdale, NJ: Erlbaum. Coltheart, M., & Rastle, K. (1994). Serial processing in reading aloud: Evidence for dual-route models of reading. Journal of Experimental Psychology: Human Perception and Performance, 20, 1197–1211. Coltheart, M., Rastle, K., Perry, C., Langdon, R., & Ziegler, J. (2001). DRC: A dual route cascaded model of visual word recognition and reading aloud. Psychological Review, 108, 204–256. Cutler, A. (1981). Making up materials is a confounded nuisance, or: Will we be able to run any psycholinguistic experiments at all in 1990? Cognition, 10, 65–70. Frost, R., Kugler, T., Deutsch, A., & Forster, K. I. (2006). Orthographic structure versus morphological structure: Principles of lexical organization in a given language. Journal of Experimental Psychology: Learning, Memory, and Cognition, 31, 1293–1326. Glushko, R. J. (1979). The organization and activation of orthographic knowledge in reading aloud. Journal of Experimental Psychology: Human Perception and Performance, 5, 674–691. Gordon, B., & Caramazza, A. (1985). Lexical access and frequency sensitivity: Frequency saturation and open/closed class equivalence. Cognition, 21, 95–115. Grainger, J., & Jacobs, A. M. (1996). Orthographic processing in visual word recognition: A multiple read-out model. Psychological Review, 103, 518–565. Harm, M. W., & Seidenberg, M. S. (1999). Phonology, reading acquisition, and dyslexia: Insights from connectionist models. Psychological Review, 106, 491–528. Heathcote, A., Brown, S., & Mewhort, D. J. K. (2002). The power law repealed: The case for an exponential law of practice. Psychonomic Bulletin & Review, 7, 185–207. Jared, D. (1997). Spelling-sound consistency affects the naming of high frequency words. Journal of Memory and Language, 36, 505–529. Jared, D. (2002). Spelling-sound consistency and regularity effects in word naming. Journal of Memory and Language, 46, 723–750. Kwantes, P., & Mewhort, D. J. (1999). Modeling lexical decision and word naming as a retrieval process. Canadian Journal of Experimental Psychology, 53, 306–315. McClelland, J. L. (1979). On the time relations of mental processes: An examination of systems of processes in cascade. Psychological Review, 86, 287–330. McClelland, J. L., & Rumelhart, D. E. (1981). An interactive activation model of context effects in letter perception: Part 1. An account of basic findings. Psychological Review, 88, 375–407. McDonald, S. A., & Shillcock, R. C. (2001). Rethinking the word frequency effect: The neglected role of distributional information in lexical processing. Language and Speech, 44, 295–323. Mulatti, C., Reynolds, M. G., & Besner, D. (2006). Neighborhood effects in reading aloud: New findings and new challenges for computational models. Journal of Experimental Psychology: Human Perception and Performance, 32, 799–810. Norris, D. (1994). A quantitative multiple-levels model of reading aloud. Journal of Experimental Psychology: Human Perception and Performance, 20, 1212–1232. Norris, D., & Brown, G. (1986). Race models and analogy theories: A dead heat? Reply to Seidenberg. Cognition, 20, 155-168. Paap, K. R., McDonald, J. E., Schvaneveldt, R. W., & Noel, R. W. (1987). Frequency and pronounceability in visually presented naming and lexical decision tasks. In M. Coltheart (Ed.), Attention and performance XII: The psychology of reading (pp. 221–243). Hillsdale, NJ: Erlbaum. Peereman, R., & Content, A. (1995). Neighborhood size effect in naming: Lexical activation or sublexical correspondences? Journal of Experimental Psychology: Learning, Memory, and Cognition, 21, 409–421. Peereman, R., & Content, A. (1997). Orthographic and phonological neighborhoods in naming: Not all neighbors are equally influential in orthographic space. Journal of Memory and Language, 37, 382–410. Perry, C., Ziegler, J. C., & Zorzi, M. (2007). Nested incremental modeling in the development of computational theories: The CDP+ model of reading aloud. Psychological Review, 114, 273–315. Plaut, D. C., McClelland, J. L., Seidenberg, M. S., & Patterson, K. (1996). Understanding normal and impaired reading: Computational principles in quasi-regular domains. Psychological Review, 103, 56–115. Rastle, K., & Coltheart, M. (1998). Whammies and double whammies: The effect of length on nonword reading. Psychonomic Bulletin & Review, 5, 277–282. Rastle, K., & Coltheart, M. (1999). Serial and strategic effects in reading aloud. Journal of Experimental Psychology: Human Perception and Performance, 25, 482–503. Rastle, K., & Coltheart, M. (2000). Serial processing in reading aloud: Reply to Zorzi (2000). Journal of Experimental Psychology: Human Perception and Performance, 26, 1232–1235. Reynolds, M., & Besner, D. (2002). Neighbourhood density effects in reading aloud: New insights from simulations with the DRC model. Canadian Journal of Experimental Psychology, 56, 310–318. Reynolds, M., & Besner, D. (2004). Neighbourhood density, word frequency, and spelling-sound regularity effects in naming: Similarities and differences between skilled readers and the dual route cascaded computational model. Canadian Journal of Experimental Psychology, 58, 13–31. Roberts, M. A., Rastle, K., Coltheart, M., & Besner, D. (2003). When parallel processing in visual word processing is not enough: New evidence from naming. Psychonomic Bulletin & Review, 10, 405–414. Rumelhart, D. E., & Siple, P. (1974). The process of recognizing tachistoscopically presented words. Psychological Review, 81, 99–118. Sears, C. R., Campbell, C. R., & Lupker, S. J. (2006). Is there a neighborhood frequency effect in english? evidence from reading and lexical decision. Journal of Experimental Psychology: Human Perception and Performance, 32, 1040–1062. Seidenberg, M. S. (1985). The time course of phonological code activation in two writing systems. Cognition, 19, 1–30. Seidenberg, M. S. (1986). Constraining models of word recognition. Cognition, 20, 69–190. Seidenberg, M. S., & McClelland, J. L. (1989). A distributed, developmental model of word recognition and naming. Psychological Review, 96, 523–568. Seidenberg, M. S., Waters, G. S., Barnes, M. A., & Tanenhaus, M. K. (1984). When does irregular spelling or pronunciation influence word recognition. Journal of Verbal Learning and Verbal Behavior, 23, 383–404. Siakaluk, P. D., Sears, C. R., & Lupker, S. J. (2002). Orthographic neighborhood effects in lexical decision: The effects of nonword orthographic neighborhood size. Journal of Experimental Psychology: Human Perception and Performance, 28, 661–681. Spieler, D. H., & Balota, D. A. (1997). Bringing computational models of word naming down to the item level. Psychological Science, 8, 411–416. Sternberg, S. (1969). The discovery of processing stages: Extensions of Donders’ method. Acta Psychologica, 30, 276–315. Taraban, R., & McClelland, J. L. (1987). Conspiracy effects in word pronunciation. Journal of Memory and Language, 26, 608–631. Weekes, B. S. (1997). Differential effects of number of letters on word and nonword naming latency. Quarterly Journal of Experimental Psychology, 50A, 439–456. Zevin, J. D., & Seidenberg, M. S. (2006). Simulating consistency effects and individual differences in nonword naming: A comparison of current models. Journal of Memory and Language, 54, 145–160. Ziegler, J., Perry, C., Jacobs, A., & Braun, M. (2001). Identical words are read differently in different languages. Psychological Science, 12, 379–384. Zorzi, M. (2000). Serial processing in reading aloud: No challenge for a parallel model. Journal of Experimental Psychology: Human Perception and Performance, 26, 847–856.
URI:	http://wrap.warwick.ac.uk/id/eprint/401