Alexandra Chesterfield, Natwest
Participants completing a study online cannot clarify their understanding of the task with an experimenter, possibly leading to reduced data quality. The absence of an experimenter can be particularly detrimental to the data quality for designs that involve complex cognitive tasks and multiple testing sessions. However, the insurgence of video conferencing technology now permits live interaction between a participant and an experimenter, facilitating task comprehensiveness and possibly improving data quality of online studies. The purpose of the current study was to determine how the delivery of task instructions impacts data quality in an online cognitive study.
In a between-subjects design, participants completed two testing sessions in either the Zoom condition where an experimenter delivered instructions or in a written instruction condition (no experimenter). Each participant completed two cognitive tasks (spatial n‑back and Remote Associates Test) along with surveys. Data quality was assessed through attention checks, comprehension quizzes, task performance, and survey test-retest reliability. Data collection was recently completed, and results will be presented at the conference. As an integrated service provider with its graphical user interface, helpful support team, and online community, Gorilla has allowed us to create and run our first online study in less than a year.