Unterschiede
Hier werden die Unterschiede zwischen zwei Versionen angezeigt.
Nächste ÜberarbeitungBeide Seiten der Revision | |||
lehre:ws18:fsm_18ws:group_f:2019-02-01_main_study [01.02.2019 00:12] – Erstellt mit dem Formular lehre:ws18:fsm_18ws:group_f hok10026 | lehre:ws18:fsm_18ws:group_f:2019-02-01_main_study [01.02.2019 00:19] – hok10026 | ||
---|---|---|---|
Zeile 8: | Zeile 8: | ||
---- | ---- | ||
- | Conduction of main study | + | # Conduction of main study |
- | Final User Study Design | + | |
+ | ** Final User Study Design | ||
Before we conducted our main study, we changed some stuff from the preliminary: | Before we conducted our main study, we changed some stuff from the preliminary: | ||
- | • We changed some questions for the interview | + | - We changed some questions for the interview |
- | • We added SEQ (Single ease question) after every single task to get how hard or easy the task was (will be used to compare the learning effect) | + | |
- | • We adjusted the tasks a bit | + | |
- | The Setup: | + | |
+ | |||
+ | ** The Setup: | ||
All of our studies (almost) were conducted in the Usability Lab in the university. We had 3 different notebooks for our subjects to use, depending on which Operating System they are using at home/work. One Laptop with Windows 10, a Linux Laptop with ubuntu and a Macbook with a rather old Mac OSX (10.4). | All of our studies (almost) were conducted in the Usability Lab in the university. We had 3 different notebooks for our subjects to use, depending on which Operating System they are using at home/work. One Laptop with Windows 10, a Linux Laptop with ubuntu and a Macbook with a rather old Mac OSX (10.4). | ||
We tested 28 in total with 2 more people missing (will be done this weekend), with a total of 10 Windows user, 10 Mac User and 8(10) Linux User. We counterbalanced the tasksgroups, | We tested 28 in total with 2 more people missing (will be done this weekend), with a total of 10 Windows user, 10 Mac User and 8(10) Linux User. We counterbalanced the tasksgroups, | ||
The tasks groups: We prepared the folder structure beforehand for the subjects, each task has its own folder, also we counter balanced the order to avoid the learning effect. | The tasks groups: We prepared the folder structure beforehand for the subjects, each task has its own folder, also we counter balanced the order to avoid the learning effect. | ||
- | The tasks: | + | |
- | • Task 1 | + | ** The tasks: |
- | • Task 2 | + | |
- | • Task 3 | + | * Navigiere in den Ordner Desktophintergrund, |
- | • Task 4 | + | * Suche zwei Dateien mit dem selben Namen in den Ordnern " |
- | • Task 5 | + | * Navigiere in den Ordner Tiere, suche die Katzenbilder heraus und lösche diese. Benenne den Ordner Tiere in " |
- | • Task 6 | + | * Erstelle ein Tagebuch: Erstelle für 10 Tage jeweils eine Text Datei und nenne Sie "Tag x ". |
- | • Task 7 | + | * Suche im Unterordner |
- | • Task 8 | + | * Öffne das Textfile "Löse mich" berechne das Ergebnis, schließe das File und nenne das File um in das Ergebnis. |
+ | * Sortiere die Files nach Filetypen und lösche die Filetypen mit den meistens Einträgen. | ||
+ | * Sortiere die Files nach ihrer Größe, erstelle im Ordner Task8 einen Ordner „Size“ und kopiere die größten drei Files dahin. | ||
Group A: 8 Tasks on Standard Explorer | Group A: 8 Tasks on Standard Explorer | ||
Group B: 8 Tasks on Dual pane | Group B: 8 Tasks on Dual pane | ||
Group C: 8 Tasks on command line | Group C: 8 Tasks on command line | ||
- | Therefore a total of 24 Tasks in total per person | + | |
+ | Therefore a total of 24 Tasks in total per person | ||
A = Standard Explorer (Finder, Nautilus, Windows Explorer) | A = Standard Explorer (Finder, Nautilus, Windows Explorer) | ||
B = Dual pane (Double commander on all 3) | B = Dual pane (Double commander on all 3) | ||
C = Command Line | C = Command Line | ||
- | ABC – ACB – BAC – BCA – CAB – CBA | ||
+ | ABC – ACB – BAC – BCA – CAB – CBA | ||
+ | ** The “Interview”: | ||
- | The “Interview”: | ||
Introduction: | Introduction: | ||
+ | |||
• How old are you? | • How old are you? | ||
• What is your working environment? | • What is your working environment? | ||
Zeile 50: | Zeile 60: | ||
• What are the key components of a file manager? | • What are the key components of a file manager? | ||
• Are you using any shortcuts? | • Are you using any shortcuts? | ||
- | ATI (Affinity | + | |
+ | ATI (Affinity | ||
After User Tasks: | After User Tasks: | ||
+ | |||
• What was your first impressions of the respective file manager? | • What was your first impressions of the respective file manager? | ||
• Which one would you like to use? | • Which one would you like to use? | ||
Zeile 60: | Zeile 73: | ||
For every group of OS (Windows, Linux, Mac) we had different orders, so we can avoid having the learning effect. This will be an important aspect of our analysis. | For every group of OS (Windows, Linux, Mac) we had different orders, so we can avoid having the learning effect. This will be an important aspect of our analysis. | ||
- | The Process: | + | ** The Process: |
We started the main study with a round about of our topic, so the subject knows what exactly he is doing and why we are conducting our study. Afterwards he got a data privacy statement, since we recorded the screen they are using and for their insurance of privacy. | We started the main study with a round about of our topic, so the subject knows what exactly he is doing and why we are conducting our study. Afterwards he got a data privacy statement, since we recorded the screen they are using and for their insurance of privacy. | ||
Afterwards we started the interview, asking about some demographical stuff and their multi media knowledge in general. After the introduction the subjects filled in the ATI, a scale which gets a score to the affinity of a person towards technical systems. This score will be used to check if there is a correlation between their ATI Score (basically how or if their technical affinity affects the task completion) and the performance in the user tasks. | Afterwards we started the interview, asking about some demographical stuff and their multi media knowledge in general. After the introduction the subjects filled in the ATI, a scale which gets a score to the affinity of a person towards technical systems. This score will be used to check if there is a correlation between their ATI Score (basically how or if their technical affinity affects the task completion) and the performance in the user tasks. | ||
The user tasks were conducted right after and depending on the knowledge of CLI (we asked beforehand if the person knows the CLI and how experienced he/she is with it), we gave them a short introduction how to use a CLI and explained shortly how the commands are used and which shortcuts are commonly (tab for autocomplete, | The user tasks were conducted right after and depending on the knowledge of CLI (we asked beforehand if the person knows the CLI and how experienced he/she is with it), we gave them a short introduction how to use a CLI and explained shortly how the commands are used and which shortcuts are commonly (tab for autocomplete, | ||
+ | |||
As conclusion we asked the subjects some questions about the used file manager and some questions about esthetics (check “After User Tasks”). | As conclusion we asked the subjects some questions about the used file manager and some questions about esthetics (check “After User Tasks”). | ||
+ | |||
What we found out (without doing the evaluation and analysis yet): | What we found out (without doing the evaluation and analysis yet): | ||
+ | |||
• The normal Windows user are usually more used to the User Interfaces and functionality | • The normal Windows user are usually more used to the User Interfaces and functionality | ||
• Linux User are commonly more used to the Terminal than the other 2 | • Linux User are commonly more used to the Terminal than the other 2 |