The Library
Presentation and response timing accuracy in Adobe Flash and HTML5/JavaScript web experiments
Tools
Tools
Tools
Reimers, Stian and Stewart, Neil (2015) Presentation and response timing accuracy in Adobe Flash and HTML5/JavaScript web experiments. Behavior Research Methods, 47 (2). pp. 309-327. doi:10.3758/s13428-014-0471-1
|
PDF
WRAP_art%3A10.3758%2Fs13428-014-0471-1.pdf - Published Version - Requires a PDF viewer. Available under License Creative Commons Attribution 4.0. Download (1112Kb) | Preview |
Official URL: http://dx.doi.org/10.3758/s13428-014-0471-1
Abstract
Web-based research is becoming ubiquitous in the behavioral sciences, facilitated by convenient, readily available participant pools and relatively straightforward ways of running experiments: most recently, through the development of the HTML5 standard. Although in most studies participants give untimed responses, there is a growing interest in being able to record response times online. Existing data on the accuracy and cross-machine variability of online timing measures are limited, and generally they have compared behavioral data gathered on the Web with similar data gathered in the lab. For this article, we took a more direct approach, examining two ways of running experiments online—Adobe Flash and HTML5 with CSS3 and JavaScript—across 19 different computer systems. We used specialist hardware to measure stimulus display durations and to generate precise response times to visual stimuli in order to assess measurement accuracy, examining effects of duration, browser, and system-to-system variability (such as across different Windows versions), as well as effects of processing power and graphics capability. We found that (a) Flash and JavaScript’s presentation and response time measurement accuracy are similar; (b) within-system variability is generally small, even in low-powered machines under high load; (c) the variability of measured response times across systems is somewhat larger; and (d) browser type and system hardware appear to have relatively small effects on measured response times. Modeling of the effects of this technical variability suggests that for most within- and between-subjects experiments, Flash and JavaScript can both be used to accurately detect differences in response times across conditions. Concerns are, however, noted about using some correlational or longitudinal designs online.
| Item Type: | Journal Article | ||||||||
|---|---|---|---|---|---|---|---|---|---|
| Subjects: | B Philosophy. Psychology. Religion > BF Psychology Q Science > QA Mathematics > QA76 Electronic computers. Computer science. Computer software |
||||||||
| Divisions: | Faculty of Science > Psychology | ||||||||
| Library of Congress Subject Headings (LCSH): | HTML (Document markup lanuage, JavaScript (Computer program language), Real-time data processing, Reaction time | ||||||||
| Journal or Publication Title: | Behavior Research Methods | ||||||||
| Publisher: | Psychonomic Society, Inc. | ||||||||
| ISSN: | 1554-351X | ||||||||
| Official Date: | June 2015 | ||||||||
| Dates: |
|
||||||||
| Date of first compliant deposit: | 28 December 2015 | ||||||||
| Volume: | 47 | ||||||||
| Number: | 2 | ||||||||
| Page Range: | pp. 309-327 | ||||||||
| DOI: | 10.3758/s13428-014-0471-1 | ||||||||
| Status: | Peer Reviewed | ||||||||
| Publication Status: | Published | ||||||||
| Access rights to Published version: | Open Access | ||||||||
| Funder: | Economic and Social Research Council (Great Britain) (ESRC), Leverhulme Trust (LT) | ||||||||
| Grant number: | ES/K002201/1 (ESRC) and ES/K004948/1 (ESRC) : RP2012-V-022 (LT) |
Request changes or add full text files to a record
Repository staff actions (login required)
 |
View Item |
Downloads
Downloads per month over past year
