Synthesis example 2
Subject 1 - HDX Export Prototype Test Notes
Test Date: 20th April 2018
User: General user, works as a web designer, relatively new to the platform.
Task 1: Previous experience with ‘tagging’ (no screen required)
Scenarios:
Ask the users to describe what they think when they here the term ‘tagging’ or ‘labelling’ means in relation to websites, digital products, software etc.
Ask users when they have previously had experience of ‘tagging’. What was the nature of the content? Was there any extraction of data afterwards? Whether there was anything they wish they could have done that they couldn’t do.
Scenario | Observation | Category |
1 | Labelling people and/or pictures. Keywords. Anchors for making data easier/better to search. | #Activity |
2 | Blog posts, facebook, wordpress, Evernote (used for personal notes and research for projects) | #Activity |
The prototype (URL) opens on Settings view.
Scenarios:
Can you show me where you’d look to download CSV spreadsheet files?
(On Export page with 3 CTAs) Without clicking, can you explain to me what options you think are available from here?
What would you need to do in order to feel comfortable choosing one of the three buttons?
Can you tell me what you expect ‘hxl tags or attributes’ to be? Don’t worry if you don’t know, we’re looking for your best guess if you’ve never heard of them before.
If you haven’t already, click a blue, underlined link.
Were you expecting a page like this? If not how does it differ from your expectations?
Spend a minute or so reading the information here. [Pause] Can you give me a summary of your understanding of hxl tags. (There are no wrong answers!)
How would you get back to where you were?
If you haven't already, please click the back button (you may need to click a few times on a ‘real’ website.
Imagine you want your volunteer data to include hxl tags.
(We can briefly explain here that hxl tags are a way of ‘assigning’ a ‘term’ to a piece of information. Use Justin’s analogy of Instagram/Twitter hashtags!)
Which option would you choose? (they can click at this point)
As you choose this option, what are you thinking? What is your first impression of this page? (Should be on the first view of the export table)
Scenario | Observation | Category |
1 | Export data - easily found in settings page | #Activity |
2 | User looks at top paragraph of text but only ‘sees’ the blue links. Is irritated because they ‘will take them away for the page’ and they don’t want to. User assumes they are already locked into an ‘export’ and fears losing progress already. User thought they may get a tooltip hover over but didn’t so confirm their suspicions around ‘exit’ links. Export all = Main button, will give them everything Select fields = Select and choose categories Export to HDX = Specialised option. “I don’t know what it is - is it a data structure? Or a fancy name for tags?” Also later says it may be ‘all data but with tags and attributes included’ | #Activity #Activity #Activity #Quote |
3&4 | Assume hxl means = sort data and search pre-tagged data. List of best tags or official list of tags. No idea what attributes means in this context. User says they need more info. User says they would feel most comfortable choosing ‘Select fields’ User makes a comment on the placement of buttons being odd. Assumes that ‘Export all’ and ‘Export with hxl…’ should be closer together. | #Activity #Activity #Activity |
5, 6, 7, 8, 9 | (Clicking on a blue link and exploring the HDX documentation) User was not expecting this. Has raised more questions than it has answered. “Now I have to read all of this in order to understand!” User wonders how they would get back. User says they are now doing an intense reading task as well as a exporting process. “It’s too much” User reads the tagging conventions. “Wow - lots of information. It doesn’t look simple” “Very high-level” User described feeling ‘down’ and this info being ‘beyond them’ and ‘disempowered’ | #Activity #Activity #Quote #Activity #Quote #Quote #Quote #Quote |
10 | Would choose the hxl option | #Activity |
11 | This looks well sorted. “I like tables!” Presentation is easy and user has seen before so is familiar. User said the checkboxes are too small for them to click. Red stars are also too small. | #Quote #Activity #Activity |
Scenarios:
Is it clear how you progress? What are the steps you would take to start this section?
Can you show me how you would know if a certain section was going to be included in the eventual CSV download?
Can you show me how you would add a HXL tag?
(If they click on the ‘Leave empty’ drop down) What do you think of the options presented in this drop-down list? What kinds of information does it give you?
Can you add the hxl tag ‘activity’
Can you show me (without clicking) how you might add a hxl attribute?
(If they click on the ‘Leave empty’ attribute drop down) What do you think of the options presented in this section? What kinds of information does it give you in relation to the tags?
(Is the difference between tags and attributes clearer for the user at this point?)
Can you now show me how you would add a custom hxl attribute? (Encourage clicking now)
(on the ‘please type an attribute’ field) What do you expect to be able to do here? (Go through the clicks in order to add the custom attribute)
Has any information changed? Can you explain what you are seeing/understand?
Can you now add a tag to ‘description’. Can you point to a tag you might choose if you wanted to capture information relating to a ‘flyer’ (like a handout/leaflet/pamphlet) There are no wrong answers!
(If they haven’t already) Please click ‘item’ and then add a custom attribute for ‘flyer’.
Can you show me how you would add a second attribute? (Once user find blue link) Can you now add the attribute ‘adults’
Take a moment to pause, Can you describe your current thoughts on the process? Anything that has stood out to you?
Please continue with the section ‘Location’ and add a tag ‘geo’
(Pause - see if they notice the list is less populated) Why do you think this list has less options?
Q: (if they don’t notice) Is there anything you notice about the drop down list? Why do you think this list has less options?
Can you now add two hxl attributes ‘longitude’ and ‘latitude’. (these are the last tags/attributes to add during the test the ‘export to CSV and HDX buttons should be clickable)
Take a moment to pause, Can you take a look at this screen and explain what you have just completed.
Can you point out the HXL tags and attributes?
Do you remember what they mean? If not can you give a good guess?
Can you now show me how you would get a CSV file? What would you expect to see happen next?
Can you tell me what you think ‘Export to HDX’ means? (Do people assume this is a file extension type? Do they understand it’s a whole system?) Go ahead and click ‘Export to HDX’. Take me through your impressions of this message.
Scenario | Observation | Category |
1 | User looks at which fields to include. Wants to click checkbox first (prototype error won’t allow this) User describes working from left to right. Doesn’t read any top text (or say they did) | #Activity |
2 | Easy - gestures to the checkbox | #Activity |
3 | Easy - finds the drop down and interacts to look at the list. | #Activity |
4 | Describes the list content as clear until ‘impact’ Admin tags mean nothing to this user. Think this might be here by accident - like the user accidentally has access to an admin account. “Am I seeing something I shouldn’t” Descriptive tags are fine but some are unclear | #Activity #Quote #Activity |
5 | Easy - finds. | #Activity |
6 | Easy - interacts with the attribute drop down | #Activity |
7 | User is unclear why there are +’s instead of a # here. “It doesn’t look right” Expecting maybe an underscore or a hyphen. | #Activity #Quote #Activity |
8 | Easily finds the way to add a custom tag | #Activity |
9 | User describes typing in the field and then clicking on the plus to add a custom attribute. “It’s weird because there’s a double plus. The plus in the ‘attributes’ and the plus button. Plus has already been used” | #Activity #Quote |
10 | Tag preview = user says its not clear how this relates to what’s been completed. Text is too small for this user. Unsure on how to delete an attribute or tag or both. User describes the kind of type ahead text fields that add tags as a user types and brings up a list. Describes this as more widely used. | #Activity #Activity #Activity |
11 | User says they might choose ‘activity’ or ‘output’ but wants the ability to add multiple tags to be sure. | #Activity |
12 | Easy action | #Activity |
13 | Easy - talks about tag preview still being too small | #Activity |
14 | Skipped question |
15 | Easy to add tags and attribute now. User is used to process. | #Activity |
16 | User suspects that less tags to choose from suggests a ‘more precise’ type of data. “Why is meta there?” “Why custom? I don’t need this” | #Activity #Quote #Quote |
17 | “Why is it not the full word? (longitude) there's enough space!” | #Quote |
18 | User is able to point out tags and attributes that they have completed. Described fields they have interacted with. User does not remember what all the tags mean if they aren’t descriptive. “I understand real words” | #Activity #Activity #Quote |
19 | Export to CSV would bring up a download pop up | #Activity |
20 | “I don’t know (in relation to HDX) I would guess it’s a file format that is specific to this dataset” When modal popped up the user leaned back “This is scary” The red is intense, overpowering and ‘screaming at me’ “I immediately doubt all my previous actions” I’m not ready - creates nervousness | #Quote #Quote #Quote #Activity |
Any final thoughts?
UI was easy and familiar.
User wanted more normal dialog that guide them along the process and reassures.
User would have spent much more time reading through all the documentation but expressed a desire for a ‘condensed’ version or a ‘tutorial’
User didn’t understand the term ‘deployment’
User wants a progress bar in certain areas.
Wants more illustrations or diagrams to help them along like a clock when the ‘export’ is happening.