Literature research (2020-11-17)

Tagged as: blog, literature
Group: I_20/21 Quick summary of first literature search and current state of research.

Research Process

We crossreferenced the articles of each wiki entry. Additionally we looked for literature on remote studies and possible interferencing factors on reading. We used the keywords „remote“, „reading studies“ and „environmental factors“ as well as combinations of them and their synonyms in Google Scholar and on the ACM site. We structured the literature we found in different categories like „Paper vs. Digital“ and „Remote Studies“.

Current state of research

There is a wide variety of works that deal with reading comprehension (e.g. Pearson et al.). There are also a number of studies comparing paper and digital reading (e.g. Noyes & Garland and Clinton). However, these are mostly local laboratory studies. There are also studies that deal with remote studies, some of which compare to local laboratory studies (e.g. Kelly & Gyllstrom and Brush et al.). However, there is no best practice on how to design remote studies so that their results are comparable to laboratory studies.

Five important publications

Kelly & Gyllstrom (2011) - An examination of two delivery modes for interactive search system experiments: remote and laboratory

Comparison of interactive search systems in a remote vs. laboratory study. Reveals the different behavior of the participants, search behavior and evaluation behavior of both forms. Finally, it is found that there are no significant differences between remote experiments and laboratory experiments.

Smith (2017) - Getting the most out of remote research and testing

General recommendations of the Forum „Evalution and Usability“ on Remote Research and Testing

Brush et al. (2004) - A comparison of synchronous remote and local usability studies for an expert interface

This thesis compares synchronous remote usability studies with local usability studies. No significant differences were found. However, they conclude that remote studies should be investigated even more.

Noyes & Garland (2008) - Computer- vs. paper-based tasks: Are they equivalent?

A literature review of the last 15 years to compare paper-based versus computer-based tasks, using NASA-TLX measures for workload to try to find out if they are equivalent.

Clinton (2019) - Reading Across Mediums: Effects of Reading Digital and Print Texts on Comprehension and Calibration

In this work we investigated which medium (paper or digital) students used to achieve a better understanding. The results showed that the expected better performance using the digital medium was not confirmed and even disproved.

Pearson et al. (2016) - Handbook of Research on Reading Comprehension

Overview on the subject of reading research as support to develop a standardized test procedure