forked from MapComplete/MapComplete
Usertest: usertest search; first part of the report
This commit is contained in:
parent
6468e33d66
commit
1ecb780764
2 changed files with 124 additions and 0 deletions
124
Docs/UserTests/2024-08-26 User Test Search.md
Normal file
124
Docs/UserTests/2024-08-26 User Test Search.md
Normal file
|
@ -0,0 +1,124 @@
|
||||||
|
# User Test of the new (WIP) search functionality
|
||||||
|
|
||||||
|
## Background info
|
||||||
|
|
||||||
|
The participant has average computer knowledge and knows a bit about OSM; has used MapComplete before. They had recently eaten in a small restaurant which they enjoyed.
|
||||||
|
Browser: Dev machine with dev account (Librewolf/Firefox) + participants mobile phone (Android with DuckDuckGo-browser)
|
||||||
|
Testurl: pietervdvn.github.io/mc/feature/search/food.html
|
||||||
|
|
||||||
|
## Task
|
||||||
|
|
||||||
|
The main goal is to test the new Search-functionality and to validate the UI; the secondary goal is to also validate the general UI.
|
||||||
|
|
||||||
|
For this, the following tasks were given:
|
||||||
|
[MapComplete was opened with the 'food' theme, showing the province]
|
||||||
|
|
||||||
|
1. Search the business
|
||||||
|
(2. Give a review and update information)
|
||||||
|
3. Search vegetarian pizzeria's in a city
|
||||||
|
4. Bonus: Use the search function to search pizzeria's _without_ typing a number
|
||||||
|
5. Switch to the map of _toilets_ using the search function
|
||||||
|
|
||||||
|
In between the tasks, time was given to explore and surface more issues.
|
||||||
|
|
||||||
|
# Interactions and surfaced issues
|
||||||
|
|
||||||
|
## Searching for 'Saladette'
|
||||||
|
|
||||||
|
The user was asked to search 'Saladette' in Roeselare.
|
||||||
|
|
||||||
|
> "Let's use the search function, cause I don't know by heart where Roeselare is"
|
||||||
|
> "Oh, a hamburger menu! Maybe the search is there"
|
||||||
|
|
||||||
|
Failure: Search bar isn't very visible and rather hidden/low contrast: the white searchbar on a yellow basemap with many white-on-black indicators is hidden
|
||||||
|
Failure: the 'theme overview menu' where a search functionality is (again) not considered a button!
|
||||||
|
|
||||||
|
Observator hinted to the location of the search button
|
||||||
|
|
||||||
|
> User clicks search button, an empty result bar appears
|
||||||
|
|
||||||
|
Failure: bar shows up if there are no results (was using private navigation)
|
||||||
|
|
||||||
|
> User searches for 'Roeselare', but the results are mostly 'Kanaal Roeselare'
|
||||||
|
|
||||||
|
Failure: maybe dedup some results, and place e.g. cities higher? Is there a relevancy-metric included?
|
||||||
|
|
||||||
|
> "Fuck it, let's just type 'Saladette'
|
||||||
|
|
||||||
|
Success, immediately found! "Dat heeft ie snel"
|
||||||
|
|
||||||
|
> User sees the little clock of being closed
|
||||||
|
|
||||||
|
Failure: closed icon not immediately clear; maybe use a different icon?
|
||||||
|
|
||||||
|
## Adding a review
|
||||||
|
|
||||||
|
> The user opens the info popup of the restaurant
|
||||||
|
> User sponteanously adds a review
|
||||||
|
|
||||||
|
Success: user sponteanously interacts with the questions!
|
||||||
|
Failure: some terms are still in english, fixed now
|
||||||
|
|
||||||
|
> User wants to make a change to the review
|
||||||
|
|
||||||
|
Failure: this is not yet possible
|
||||||
|
|
||||||
|
## Updating information
|
||||||
|
|
||||||
|
> The user wants to update information
|
||||||
|
> User reads the detailed description between "restaurant" and "fastfood" and then wants to change it to "fast food"
|
||||||
|
> User is not logged in
|
||||||
|
|
||||||
|
### Logging in
|
||||||
|
|
||||||
|
> User clicks 'login button' and doesn't know password anymore
|
||||||
|
> User wants to _see_ the password they are typing, and will thus first type it in the URL-bar of a new browsertab, to copy-paste it into the password field
|
||||||
|
|
||||||
|
Failure: user cannot show the password they are typing. See https://github.com/openstreetmap/openstreetmap-website/issues/5122
|
||||||
|
|
||||||
|
> Password is incorrect, but user doesn't see immediately see this
|
||||||
|
|
||||||
|
Failure: error message should be closer to the login form. See https://github.com/openstreetmap/openstreetmap-website/issues/5123
|
||||||
|
|
||||||
|
> In the end, the observators OSM-account was used
|
||||||
|
|
||||||
|
|
||||||
|
## Actually Updating information
|
||||||
|
|
||||||
|
> At first, the user changed the classification from 'restaurant' to 'fastfood' after thoroughly reading through the descriptions
|
||||||
|
|
||||||
|
> Then, the 'cuisine' was inspected. As the restaurant they visited is focusing on _vegetarian_ salads, the user wanted to use the freeform to enter 'vegetarian salad'
|
||||||
|
|
||||||
|
Failure: how to properly explain this? Move the 'vegetarian' question up? Should some options, such as 'chicken restaurant' be hidden if `vegetarian=only`?
|
||||||
|
|
||||||
|
|
||||||
|
> The user left the 'cuisine' question open and moved on to other questions
|
||||||
|
> Whenever they answered a question, the UI would jump back to the first open question
|
||||||
|
|
||||||
|
Failure: maybe simply remove this?
|
||||||
|
|
||||||
|
> User gets confused by having some bold options: "I thought someone already selected option "Lactose free offering"
|
||||||
|
|
||||||
|
![](./2024-08-26%20Usertest-bold-question.png)
|
||||||
|
|
||||||
|
Failure: don't show bold (fixed in b79835074fe5f954bd4b64ecdb713ca13503495e)
|
||||||
|
|
||||||
|
> The user also taps the 'phone' icon, upon which the phone app opens with the phone number filled out
|
||||||
|
> The phone number misses some numbers
|
||||||
|
|
||||||
|
browser-specific-bug: phone links should not contain spaces in blink-based browsers, fixed in 4168ef01e333784f738fafa15d1eb7d7c4c527c7
|
||||||
|
|
||||||
|
|
||||||
|
## Switching theme
|
||||||
|
|
||||||
|
> The user types 'WC' and doesn't find anything
|
||||||
|
|
||||||
|
Failure: only 'toilet' is known, fixed in cdc1e05499ffc41d093503ccd24defa347eea50e
|
||||||
|
|
||||||
|
> The user sees the 'WC'-theme button, but after a second, it is replaced by other search results
|
||||||
|
|
||||||
|
Reorder this, so that slow-loading and fast-loading search queries don't overlap
|
||||||
|
|
||||||
|
> The user sees 'no results found', which gets replaced by resuts a few ms later
|
||||||
|
|
||||||
|
Have a 'loading-indicator'
|
BIN
Docs/UserTests/2024-08-26 Usertest-bold-question.png
Normal file
BIN
Docs/UserTests/2024-08-26 Usertest-bold-question.png
Normal file
Binary file not shown.
After Width: | Height: | Size: 49 KiB |
Loading…
Reference in a new issue