8.6 KiB
[# User Test of the new (WIP) search functionality
Background info
The participant has average computer knowledge and knows a bit about OSM; has used MapComplete before. They had recently eaten in a small restaurant which they enjoyed. Browser: Dev machine with dev account (Librewolf/Firefox) + participants mobile phone (Android with DuckDuckGo-browser) Testurl: pietervdvn.github.io/mc/feature/search/food.html
Task
The main goal is to test the new Search-functionality and to validate the UI; the secondary goal is to also validate the general UI.
For this, the following tasks were given: [MapComplete was opened with the 'food' theme, showing the province]
- Search the business
- Give a review and update information
- Search vegetarian pizzeria's in a city
- Bonus: Use the search function to search pizzeria's without typing a number
- Switch to the map of toilets using the search function
- Ad hoc: link a mapillary streetview image
In between the tasks, time was given to explore and surface more issues.
Interactions and surfaced issues
Searching for 'Saladette' and others
The user was asked to search 'Saladette' in Roeselare.
"Let's use the search function, cause I don't know by heart where Roeselare is" "Oh, a hamburger menu! Maybe the search is there"
[x] Failure: Search bar isn't very visible and rather hidden/low contrast: the white searchbar on a yellow basemap with many white-on-black indicators is hidden Fixed (see #2113) [x] Failure: the 'theme overview menu' where a search functionality is (again) not considered a button! Fixed (see #2113) Observator hinted to the location of the search button
User clicks search button, an empty result bar appears
[x] Failure: bar shows up if there are no results (was using private navigation) Search suggestions should be shown!
User searches for 'Roeselare', but the results are mostly 'Kanaal Roeselare'
[x] Failure: maybe dedup some results, and place e.g. cities higher? Is there a relevancy-metric included? (Fixed now)
(In a different part of the user test, the user was asked to go to Ghent)
User types 'Gent' and presses enter Gentstraat in Brugge pops up
[ ] Failure: cities should have more priority
User swipes "back" to go to the previous location
[ ] Failure: Should this work? TBD
"Fuck it, let's just type 'Saladette'
Success, immediately found! "Dat heeft ie snel"
User sees the little clock of being closed
[ ] Failure: closed icon not immediately clear; maybe use a different icon?
Adding a review
The user opens the info popup of the restaurant User sponteanously adds a review
Success: user sponteanously interacts with the questions! [x] Failure: some terms are still in english, fixed now
User wants to make a change to the review
[/] Failure: this is not yet possible, tracked in https://github.com/pietervdvn/MapComplete/issues/2129
Updating information
The user wants to update information User reads the detailed description between "restaurant" and "fastfood" and then wants to change it to "fast food" User is not logged in
Logging in
User clicks 'login button' and doesn't know password anymore User wants to see the password they are typing, and will thus first type it in the URL-bar of a new browsertab, to copy-paste it into the password field
[/] Failure: user cannot show the password they are typing. See https://github.com/openstreetmap/openstreetmap-website/issues/5122
Password is incorrect, but user doesn't see immediately see this
[/] Failure: error message should be closer to the login form. See https://github.com/openstreetmap/openstreetmap-website/issues/5123
In the end, the observators OSM-account was used
Actually using and updating information
THe user notices that complex opening hours are displayed a bit sloppily
[+] Coincidentally, an issue was opened about precisely this at the same time: https://github.com/pietervdvn/MapComplete/issues/2100
At first, the user changed the classification from 'restaurant' to 'fastfood' after thoroughly reading through the descriptions
Then, the 'cuisine' was inspected. As the restaurant they visited is focusing on vegetarian salads, the user wanted to use the freeform to enter 'vegetarian salad'
[ ] Failure: how to properly explain this? Move the 'vegetarian' question up? Should some options, such as 'chicken restaurant' be hidden if vegetarian=only
?
[ ] UI: issue: the emojis (especially flags) slightly overlaps with the text on this browser
The user left the 'cuisine' question open and moved on to other questions Whenever they answered a question, the UI would jump back to the first open question
[x] Failure: maybe simply remove this scrolling behaviour? (Fixed in d62974b1e3
)
User gets confused by having some bold options: "I thought someone already selected option "Lactose free offering"
(In the popup for a different restaurant) User wants to scroll down, but the opening hours picker intercepts the swipe event
[x] Failure: move OH-picker into separate popup
User wants to remove selected OH
[x] Failure: trash bin is too small, maybe provide a 'clear all' button?
[x] Failure: don't show bold (fixed in b79835074f
)
The user also taps the 'phone' icon, upon which the phone app opens with the phone number filled out The phone number misses some numbers
[x] browser-specific-bug: phone links should not contain spaces in blink-based browsers, fixed in 4168ef01e3
Using filters through the search menu
When instructed to search for filters, the user didn't realise that is possible through the search
[x] Failure: search results should show some example filters, cities, layers and other thematic maps when nothing has been shown before [x] Failure: default text should be changed and broadened and mention more then just 'locations'
The user attempts to search, but often 'fat-fingers' and presses a shop behind the search bar, opening this
[x] Solution: on mobile, a 'no-touch' buffer should be added; Maybe even a top bar? --> Fixed in feature/menu-drawer Fixed by #2113
The user was tasked to search a 'vegetarian pizzeria' User literally types "vegetarian pizza", but no filters pop up as the goal was to search for 'pizza' and "vegetarian" separately Same for "vegetarisch frietkot"
[x] Failure: filter-search should be split on word Fixed
Suggested filters shows up as "This is a pizzeria"
[x] Failure: Unclear text, to be changed (Fixed in 3939d2fe7b
)
[x] Unclear that this is a filter that can be added: subheadings are needed
User clears the filter, MC hangs as it is re-rendering all items
[x] Failure: show a loading icon - Fixed
Switching theme
The user types 'WC' and doesn't find anything
[x] Failure: only 'toilet' is known, fixed in cdc1e05499
The user sees the 'WC'-theme button, but after a second, it is replaced by other search results
[x] Reorder this, so that slow-loading and fast-loading search queries don't overlap Fixed by having separate titles
The user sees 'no results found', which gets replaced by results a few ms later
[x] Have a 'loading-indicator'
User switches to 'toilets' theme
Exploring the toilets theme
User sees different types of icons, many of which are standing-urinals "Tiens, those are mostly men toilets. Good to know" User notices a "lock"-icon and wonders if this is a non-useable toilet User presses toilet and confirms that this is not open to the public
Success: the icons are clear :)
Using and linking nearby pictures
The user was pointed to the "See and link nearby images" "Wow, linking sounds intimidating"
[x] Note: "and link" also doesn't work if the user isn't logged in Remove this wording, fixed in weblate
Mapillary-pictures popup, some images are made by 'Teddy73' "What is this 'Teddy73' and this 'CC-BY-SA'-thing?
[x] Failure: attribution is unclear and irritating, made smaller in link-preview and more explicit in image preview Fixed
User wants a bigger version of the picture and zooms in onto the low-quality picture
[x] Failure: user doesn't realize that tapping the picture will open up a pannable, big screen and HD version
Fix: add a 'zoom-in' icon, fixed in 8465b59c7f
User finds the zoomed-in version, but is confused by the download-button. How to link?
[ ] Failure: move download-button behind "extra"-dot? [ ] Failure: should some of the tools (e.g. linking and unlinking) be hidden behind a dot?