Unterschiede

Hier werden die Unterschiede zwischen zwei Versionen angezeigt.

Link zu dieser Vergleichsansicht

Nächste ÜberarbeitungBeide Seiten der Revision
lehre:ws18:fsm_18ws:group_f:2019-02-01_main_study [01.02.2019 00:12] – Erstellt mit dem Formular lehre:ws18:fsm_18ws:group_f hok10026lehre:ws18:fsm_18ws:group_f:2019-02-01_main_study [01.02.2019 00:19] hok10026
Zeile 8: Zeile 8:
 ----  ---- 
  
-Conduction of main study  +Conduction of main study  
-Final User Study Design + 
 +** Final User Study Design **  
 Before we conducted our main study, we changed some stuff from the preliminary: Before we conducted our main study, we changed some stuff from the preliminary:
-We changed some questions for the interview +  - We changed some questions for the interview 
-We added SEQ (Single ease question) after every single task to get how hard or easy the task was (will be used to compare the learning effect) +  We added SEQ (Single ease question) after every single task to get how hard or easy the task was (will be used to compare the learning effect) 
-We adjusted the tasks a bit  +  We adjusted the tasks a bit  
-The Setup: + 
 + 
 +** The Setup: ** 
 All of our studies (almost) were conducted in the Usability Lab in the university. We had 3 different notebooks for our subjects to use, depending on which Operating System they are using at home/work. One Laptop with Windows 10, a Linux Laptop with ubuntu and a Macbook with a rather old Mac OSX (10.4).  All of our studies (almost) were conducted in the Usability Lab in the university. We had 3 different notebooks for our subjects to use, depending on which Operating System they are using at home/work. One Laptop with Windows 10, a Linux Laptop with ubuntu and a Macbook with a rather old Mac OSX (10.4). 
 We tested 28 in total with 2 more people missing (will be done this weekend), with a total of 10 Windows user, 10 Mac User and 8(10) Linux User. We counterbalanced the tasksgroups, so we can check if there was a major difference in task completion if people did the “easier” task beforehand and so had the so called “learning effect”. We tested 28 in total with 2 more people missing (will be done this weekend), with a total of 10 Windows user, 10 Mac User and 8(10) Linux User. We counterbalanced the tasksgroups, so we can check if there was a major difference in task completion if people did the “easier” task beforehand and so had the so called “learning effect”.
 The tasks groups: We prepared the folder structure beforehand for the subjects, each task has its own folder, also we counter balanced the order to avoid the learning effect. The tasks groups: We prepared the folder structure beforehand for the subjects, each task has its own folder, also we counter balanced the order to avoid the learning effect.
-The tasks: + 
-Task 1 +** The tasks: ** 
-Task 2 + 
-• Task 3 +  * Navigiere in den Ordner Desktophintergrund, suche die 3 neuesten Bilder heraus, lege einen neuen Ordner "Bilder" im Unterordner Task 1 an und verschiebe die drei Bilder dort hinein. 
-• Task 4 +  * Suche zwei Dateien mit dem selben Namen in den Ordnern "Notizen" und "Notes" im Unterordner Task 2, und lösche die ältere Datei der beiden. 
-Task 5 +  * Navigiere in den Ordner Tiere, suche die Katzenbilder heraus und lösche diese. Benenne den Ordner Tiere in "Hunde" um. 
-Task 6 +  * Erstelle ein Tagebuch: Erstelle für 10 Tage jeweils eine Text Datei und nenne Sie "Tag x ". 
-• Task 7 +  * Suche im Unterordner Task 5 nach dem File "findMich.txt" und kopiere es in den Unterordner Task 5. 
-• Task 8+  * Öffne das Textfile "Löse mich" berechne das Ergebnis, schließe das File und nenne das File um in das Ergebnis. 
 +  * Sortiere die Files nach Filetypen und lösche die Filetypen mit den meistens Einträgen. 
 +  * Sortiere die Files nach ihrer Größe, erstelle im Ordner Task8 einen Ordner „Size“ und kopiere die größten drei Files dahin. 
 Group A: 8 Tasks on Standard Explorer Group A: 8 Tasks on Standard Explorer
 Group B: 8 Tasks on Dual pane Group B: 8 Tasks on Dual pane
 Group C: 8 Tasks on command line Group C: 8 Tasks on command line
-Therefore a total of 24 Tasks in total per person + 
 +Therefore a total of 24 Tasks in total per person  
 A = Standard Explorer (Finder, Nautilus, Windows Explorer) A = Standard Explorer (Finder, Nautilus, Windows Explorer)
 B = Dual pane (Double commander on all 3) B = Dual pane (Double commander on all 3)
 C = Command Line C = Command Line
-ABC – ACB – BAC – BCA – CAB – CBA 
  
 +ABC – ACB – BAC – BCA – CAB – CBA
  
 +** The “Interview”: **
  
-The “Interview”: 
 Introduction: Introduction:
 +
 • How old are you? • How old are you?
 • What is your working environment? • What is your working environment?
Zeile 50: Zeile 60:
 • What are the key components of a file manager? • What are the key components of a file manager?
 • Are you using any shortcuts? • Are you using any shortcuts?
-ATI (Affinity )+ 
 +ATI (Affinity for Technology Interaction) 
 After User Tasks: After User Tasks:
 +
 • What was your first impressions of the respective file manager? • What was your first impressions of the respective file manager?
 • Which one would you like to use? • Which one would you like to use?
Zeile 60: Zeile 73:
 For every group of OS (Windows, Linux, Mac) we had different orders, so we can avoid having the learning effect. This will be an important aspect of our analysis.  For every group of OS (Windows, Linux, Mac) we had different orders, so we can avoid having the learning effect. This will be an important aspect of our analysis. 
  
-The Process:+** The Process: ** 
 We started the main study with a round about of our topic, so the subject knows what exactly he is doing and why we are conducting our study. Afterwards he got a data privacy statement, since we recorded the screen they are using and for their insurance of privacy. We started the main study with a round about of our topic, so the subject knows what exactly he is doing and why we are conducting our study. Afterwards he got a data privacy statement, since we recorded the screen they are using and for their insurance of privacy.
 Afterwards we started the interview, asking about some demographical stuff and their multi media knowledge in general. After the introduction the subjects filled in the ATI, a scale which gets a score to the affinity of a person towards technical systems. This score will be used to check if there is a correlation between their ATI Score (basically how or if their technical affinity affects the task completion) and the performance in the user tasks. Afterwards we started the interview, asking about some demographical stuff and their multi media knowledge in general. After the introduction the subjects filled in the ATI, a scale which gets a score to the affinity of a person towards technical systems. This score will be used to check if there is a correlation between their ATI Score (basically how or if their technical affinity affects the task completion) and the performance in the user tasks.
 The user tasks were conducted right after and depending on the knowledge of CLI (we asked beforehand if the person knows the CLI and how experienced he/she is with it), we gave them a short introduction how to use a CLI and explained shortly how the commands are used and which shortcuts are commonly (tab for autocomplete, arrow key to repeat a command…). Depending on the OS and subject, we changed the order of tasks groups (counter balancing) to avoid the learning effect. The duration of one user study last from 50 minutes (fastest) to 2,5 hours (slowest). The user tasks were conducted right after and depending on the knowledge of CLI (we asked beforehand if the person knows the CLI and how experienced he/she is with it), we gave them a short introduction how to use a CLI and explained shortly how the commands are used and which shortcuts are commonly (tab for autocomplete, arrow key to repeat a command…). Depending on the OS and subject, we changed the order of tasks groups (counter balancing) to avoid the learning effect. The duration of one user study last from 50 minutes (fastest) to 2,5 hours (slowest).
 +
 As conclusion we asked the subjects some questions about the used file manager and some questions about esthetics (check “After User Tasks”). As conclusion we asked the subjects some questions about the used file manager and some questions about esthetics (check “After User Tasks”).
 +
 What we found out (without doing the evaluation and analysis yet): What we found out (without doing the evaluation and analysis yet):
 +
 • The normal Windows user are usually more used to the User Interfaces and functionality  • The normal Windows user are usually more used to the User Interfaces and functionality 
 • Linux User are commonly more used to the Terminal than the other 2 • Linux User are commonly more used to the Terminal than the other 2