Synthesis example 2
Subject 1 - HDX Export Prototype Test Notes
Test Date: 20th April 2018
User: General user, works as a web designer, relatively new to the platform.
Task 1: Previous experience with âtaggingâ (no screen required)
Scenarios:
Ask the users to describe what they think when they here the term âtaggingâ or âlabellingâ means in relation to websites, digital products, software etc.
Ask users when they have previously had experience of âtaggingâ. What was the nature of the content? Was there any extraction of data afterwards? Whether there was anything they wish they could have done that they couldnât do.
Scenario
Observation
Category
1
Labelling people and/or pictures.
Keywords.
Anchors for making data easier/better to search.
#Activity
2
Blog posts, facebook, wordpress, Evernote (used for personal notes and research for projects)
#Activity
The prototype (URL) opens on Settings view.
Scenarios:
Can you show me where youâd look to download CSV spreadsheet files?
(On Export page with 3 CTAs) Without clicking, can you explain to me what options you think are available from here?
What would you need to do in order to feel comfortable choosing one of the three buttons?
Can you tell me what you expect âhxl tags or attributesâ to be? Donât worry if you donât know, weâre looking for your best guess if youâve never heard of them before.
If you havenât already, click a blue, underlined link.
Were you expecting a page like this? If not how does it differ from your expectations?
Spend a minute or so reading the information here. [Pause] Can you give me a summary of your understanding of hxl tags. (There are no wrong answers!)
How would you get back to where you were?
If you haven't already, please click the back button (you may need to click a few times on a ârealâ website.
Imagine you want your volunteer data to include hxl tags.
(We can briefly explain here that hxl tags are a way of âassigningâ a âtermâ to a piece of information. Use Justinâs analogy of Instagram/Twitter hashtags!)
Which option would you choose? (they can click at this point)
As you choose this option, what are you thinking? What is your first impression of this page? (Should be on the first view of the export table)
Scenario
Observation
Category
1
Export data - easily found in settings page
#Activity
2
User looks at top paragraph of text but only âseesâ the blue links. Is irritated because they âwill take them away for the pageâ and they donât want to.
User assumes they are already locked into an âexportâ and fears losing progress already.
User thought they may get a tooltip hover over but didnât so confirm their suspicions around âexitâ links.
Export all = Main button, will give them everything
Select fields = Select and choose categories
Export to HDX = Specialised option. âI donât know what it is - is it a data structure? Or a fancy name for tags?â Also later says it may be âall data but with tags and attributes includedâ
#Activity
#Activity
#Activity
#Quote
3&4
Assume hxl means = sort data and search pre-tagged data.
List of best tags or official list of tags.
No idea what attributes means in this context. User says they need more info.
User says they would feel most comfortable choosing âSelect fieldsâ
User makes a comment on the placement of buttons being odd. Assumes that âExport allâ and âExport with hxlâŚâ should be closer together.
#Activity
#Activity
#Activity
5, 6, 7, 8, 9
(Clicking on a blue link and exploring the HDX documentation)
User was not expecting this.
Has raised more questions than it has answered.
âNow I have to read all of this in order to understand!â
User wonders how they would get back.
User says they are now doing an intense reading task as well as a exporting process. âItâs too muchâ
User reads the tagging conventions.
âWow - lots of information. It doesnât look simpleâ
âVery high-levelâ
User described feeling âdownâ and this info being âbeyond themâ and âdisempoweredâ
#Activity
#Activity
#Quote
#Activity
#Quote
#Quote
#Quote
#Quote
10
Would choose the hxl option
#Activity
11
This looks well sorted. âI like tables!â
Presentation is easy and user has seen before so is familiar.
User said the checkboxes are too small for them to click.
Red stars are also too small.
#Quote
#Activity
#Activity
Scenarios:
Is it clear how you progress? What are the steps you would take to start this section?
Can you show me how you would know if a certain section was going to be included in the eventual CSV download?
Can you show me how you would add a HXL tag?
(If they click on the âLeave emptyâ drop down) What do you think of the options presented in this drop-down list? What kinds of information does it give you?
Can you add the hxl tag âactivityâ
Can you show me (without clicking) how you might add a hxl attribute?
(If they click on the âLeave emptyâ attribute drop down) What do you think of the options presented in this section? What kinds of information does it give you in relation to the tags?
(Is the difference between tags and attributes clearer for the user at this point?)
Can you now show me how you would add a custom hxl attribute? (Encourage clicking now)
(on the âplease type an attributeâ field) What do you expect to be able to do here? (Go through the clicks in order to add the custom attribute)
Has any information changed? Can you explain what you are seeing/understand?
Can you now add a tag to âdescriptionâ. Can you point to a tag you might choose if you wanted to capture information relating to a âflyerâ (like a handout/leaflet/pamphlet) There are no wrong answers!
(If they havenât already) Please click âitemâ and then add a custom attribute for âflyerâ.
Can you show me how you would add a second attribute? (Once user find blue link) Can you now add the attribute âadultsâ
Take a moment to pause, Can you describe your current thoughts on the process? Anything that has stood out to you?
Please continue with the section âLocationâ and add a tag âgeoâ
(Pause - see if they notice the list is less populated) Why do you think this list has less options?
Q: (if they donât notice) Is there anything you notice about the drop down list? Why do you think this list has less options?
Can you now add two hxl attributes âlongitudeâ and âlatitudeâ. (these are the last tags/attributes to add during the test the âexport to CSV and HDX buttons should be clickable)
Take a moment to pause, Can you take a look at this screen and explain what you have just completed.
Can you point out the HXL tags and attributes?
Do you remember what they mean? If not can you give a good guess?
Can you now show me how you would get a CSV file? What would you expect to see happen next?
Can you tell me what you think âExport to HDXâ means? (Do people assume this is a file extension type? Do they understand itâs a whole system?) Go ahead and click âExport to HDXâ. Take me through your impressions of this message.
Scenario
Observation
Category
1
User looks at which fields to include.
Wants to click checkbox first (prototype error wonât allow this)
User describes working from left to right. Doesnât read any top text (or say they did)
#Activity
2
Easy - gestures to the checkbox
#Activity
3
Easy - finds the drop down and interacts to look at the list.
#Activity
4
Describes the list content as clear until âimpactâ
Admin tags mean nothing to this user.
Think this might be here by accident - like the user accidentally has access to an admin account. âAm I seeing something I shouldnâtâ
Descriptive tags are fine but some are unclear
#Activity
#Quote
#Activity
5
Easy - finds.
#Activity
6
Easy - interacts with the attribute drop down
#Activity
7
User is unclear why there are +âs instead of a # here.
âIt doesnât look rightâ
Expecting maybe an underscore or a hyphen.
#Activity
#Quote
#Activity
8
Easily finds the way to add a custom tag
#Activity
9
User describes typing in the field and then clicking on the plus to add a custom attribute.
âItâs weird because thereâs a double plus. The plus in the âattributesâ and the plus button. Plus has already been usedâ
#Activity
#Quote
10
Tag preview = user says its not clear how this relates to whatâs been completed.
Text is too small for this user.
Unsure on how to delete an attribute or tag or both.
User describes the kind of type ahead text fields that add tags as a user types and brings up a list. Describes this as more widely used.
#Activity
#Activity
#Activity
11
User says they might choose âactivityâ or âoutputâ but wants the ability to add multiple tags to be sure.
#Activity
12
Easy action
#Activity
13
Easy - talks about tag preview still being too small
#Activity
14
Skipped question
15
Easy to add tags and attribute now. User is used to process.
#Activity
16
User suspects that less tags to choose from suggests a âmore preciseâ type of data.
âWhy is meta there?â
âWhy custom? I donât need thisâ
#Activity
#Quote
#Quote
17
âWhy is it not the full word? (longitude) there's enough space!â
#Quote
18
User is able to point out tags and attributes that they have completed. Described fields they have interacted with.
User does not remember what all the tags mean if they arenât descriptive.
âI understand real wordsâ
#Activity
#Activity
#Quote
19
Export to CSV would bring up a download pop up
#Activity
20
âI donât know (in relation to HDX) I would guess itâs a file format that is specific to this datasetâ
When modal popped up the user leaned back âThis is scaryâ
The red is intense, overpowering and âscreaming at meâ
âI immediately doubt all my previous actionsâ
Iâm not ready - creates nervousness
#Quote
#Quote
#Quote
#Activity
Any final thoughts?
UI was easy and familiar.
User wanted more normal dialog that guide them along the process and reassures.
User would have spent much more time reading through all the documentation but expressed a desire for a âcondensedâ version or a âtutorialâ
User didnât understand the term âdeploymentâ
User wants a progress bar in certain areas.
Wants more illustrations or diagrams to help them along like a clock when the âexportâ is happening.