Skip to content Skip to navigation
University of Warwick
  • Study
  • |
  • Research
  • |
  • Business
  • |
  • Alumni
  • |
  • News
  • |
  • About

University of Warwick
Publications service & WRAP

Highlight your research

  • WRAP
    • Home
    • Search WRAP
    • Browse by Warwick Author
    • Browse WRAP by Year
    • Browse WRAP by Subject
    • Browse WRAP by Department
    • Browse WRAP by Funder
    • Browse Theses by Department
  • Publications Service
    • Home
    • Search Publications Service
    • Browse by Warwick Author
    • Browse Publications service by Year
    • Browse Publications service by Subject
    • Browse Publications service by Department
    • Browse Publications service by Funder
  • Help & Advice
University of Warwick

The Library

  • Login
  • Admin

Presentation and response timing accuracy in Adobe Flash and HTML5/JavaScript web experiments

Tools
- Tools
+ Tools

Reimers, Stian and Stewart, Neil (2015) Presentation and response timing accuracy in Adobe Flash and HTML5/JavaScript web experiments. Behavior Research Methods, 47 (2). pp. 309-327. doi:10.3758/s13428-014-0471-1

[img]
Preview
PDF
WRAP_art%3A10.3758%2Fs13428-014-0471-1.pdf - Published Version - Requires a PDF viewer.
Available under License Creative Commons Attribution 4.0.

Download (1112Kb) | Preview
Official URL: http://dx.doi.org/10.3758/s13428-014-0471-1

Request Changes to record.

Abstract

Web-based research is becoming ubiquitous in the behavioral sciences, facilitated by convenient, readily available participant pools and relatively straightforward ways of running experiments: most recently, through the development of the HTML5 standard. Although in most studies participants give untimed responses, there is a growing interest in being able to record response times online. Existing data on the accuracy and cross-machine variability of online timing measures are limited, and generally they have compared behavioral data gathered on the Web with similar data gathered in the lab. For this article, we took a more direct approach, examining two ways of running experiments online—Adobe Flash and HTML5 with CSS3 and JavaScript—across 19 different computer systems. We used specialist hardware to measure stimulus display durations and to generate precise response times to visual stimuli in order to assess measurement accuracy, examining effects of duration, browser, and system-to-system variability (such as across different Windows versions), as well as effects of processing power and graphics capability. We found that (a) Flash and JavaScript’s presentation and response time measurement accuracy are similar; (b) within-system variability is generally small, even in low-powered machines under high load; (c) the variability of measured response times across systems is somewhat larger; and (d) browser type and system hardware appear to have relatively small effects on measured response times. Modeling of the effects of this technical variability suggests that for most within- and between-subjects experiments, Flash and JavaScript can both be used to accurately detect differences in response times across conditions. Concerns are, however, noted about using some correlational or longitudinal designs online.

Item Type: Journal Article
Subjects: B Philosophy. Psychology. Religion > BF Psychology
Q Science > QA Mathematics > QA76 Electronic computers. Computer science. Computer software
Divisions: Faculty of Science > Psychology
Library of Congress Subject Headings (LCSH): HTML (Document markup lanuage, JavaScript (Computer program language), Real-time data processing, Reaction time
Journal or Publication Title: Behavior Research Methods
Publisher: Psychonomic Society, Inc.
ISSN: 1554-351X
Official Date: June 2015
Dates:
DateEvent
June 2015Published
6 June 2014Available
1 June 2014Accepted
Volume: 47
Number: 2
Page Range: pp. 309-327
DOI: 10.3758/s13428-014-0471-1
Status: Peer Reviewed
Publication Status: Published
Access rights to Published version: Open Access
Funder: Economic and Social Research Council (Great Britain) (ESRC), Leverhulme Trust (LT)
Grant number: ES/K002201/1 (ESRC) and ES/K004948/1 (ESRC) : RP2012-V-022 (LT)

Request changes or add full text files to a record

Repository staff actions (login required)

View Item View Item

Downloads

Downloads per month over past year

View more statistics

twitter

Email us: wrap@warwick.ac.uk
Contact Details
About Us