Evaluation of the Regensburger Usability Platform (RUP)

The Regensburger Usability Platform is a synchronous remote testing tool. It is the first iteration in an ongoing development process, which to this point lacks a proper evaluation. In order to build a possible roadmap for further iterations and implementations, the tool was evaluated in two steps. At first a market analysis and expert interviews were conducted to gather information about functions and attributes that should be considered for future updates and how well regarded remote testing tools are as a whole.

Members: Dominik Deller, Julia Grötsch, Philipp Schuhbauer

Keywords: Usability, Testing, Remote, Morae, Open Broadcaster Software, Synchronous, Moderated

Regensburger Usability Platform

Description

The Regensburger Usability Platform is a synchronous remote testing tool. It is the first iteration in an ongoing development process, which to this point lacks a proper evaluation. In order to build a possible roadmap for further iterations and implementations, the tool was evaluated in two steps. At first a market analysis and expert interviews were conducted to gather information about functions and attributes that should be considered for future updates and how well regarded remote testing tools are as a whole. The second part consisted of a qualitative usability test in which the Regensburger Usability Platform is compared to the established remote testing tool Morae. We discovered certain problems of remote testing tools, the major ones were the communication between the participants and the supervisor, as well as the configuration of the setup. These properties reduce the possible advantages of synchronous remote testing tools. To address these weaknesses new features should be added or existing ones should be improved. Overall both systems provide good usability. Nevertheless our findings show no reason, why remote testing should be used more or why it would be the best way to do usability testing. Future work should be done to get better insights and thereby make it possible to make a more significant statement in that regard.

Goals

  • What are the core features a remote usability tool needs?
  • How do users (test subjects / examiners) rate the usage of the tool?
  • What possibilities are there to improve the tool?
  • What is already out on the market, and what can we learn from those solutions?

Updates

Discussion & Conclusion (2019-03-22)

This entry will cover the discussion regarding our evaluation and a final conlusion (more...)


Evaluation (2019-03-21)

Evaluation of the Regensburger Usability Platform (more...)


Main Study (2019-01-30)

After getting positive input from our expert interviews concerning the relevance of our research goals, we are conducting the user study. (more...)


Expert Interviews (2019-01-09)

The gathered information from the conducted interviews, concerning usability testing tools, with special focus on remote testing tools. (more...)


Conclusion Literature Research & Expert Interviews (2018-12-18)

This entry will summarize our conclusion on the literature research and the market analysis. Also we will give a short insight on the planning regarding our upcoming expert interviews. (more...)


First Steps (2018-12-04)

This entry sums up the our first steps towards the project, regarding literatur research, finalizing the function set of the OBS-Tool, which will be tested and creating the schedule for our project. (more...)


Background and Goal (2018-11-21)

The following entry describes the background of our project and what goals we want to achieve. (more...)


Further Resources