Caracol

Usability Testing Plan

Background
Caracol’s discovery phase began in early 2024, identifying a need for connecting homeowners and renters with home decor professionals. This test evaluates key functionalities with new users.

Goals
Identify issues first-time users face with Caracol’s core features and evaluate their impact.

Test Objectives

  • Assess the login process.

  • Determine search functionality effectiveness and ability to book professionals.

  • Evaluate usability of creating and managing projects.

Laptop displaying a website with modern interior design images, including living rooms and public spaces.

Methology

I conducted a moderated in-person usability study, beause it allows for direct observation and immediate feedback of user interaction on both mobile and desktop devices. During the study, a significant challenge was managing user frustration with the search function not being more visual. I observed that users struggled with the search bar and the home page, leading to confusion and delays in task completion. To address these issues, I collected detailed feedback and used it to improve the search functionality and home page layout. These insights were critical in enhancing the design and overall user experience.

Participants and Schedule

Six participants fitting Caracol’s target profiles (designers and architects) were tested on April 24 and 26, 2024, in Miami from 10:00 a.m. to 3:00 p.m. The participants comprised 3 males and 3 females aged 20-40, professionals with interest in design. They were selected to represent a variety of backgrounds and expertise within the design and architecture industries, ensuring a diverse range of insights.

Script
For the detailed Test Script and task list, explore: Link

Usability Test Report

This report summarizes findings from the usability test. The focus was on interactions such as logging in, searching for professionals, creating project, and booking appointments.

Issues and Recommendations

Issue 1: Unclear service offerings before login (Medium)

A before-and-after comparison of a website design for an interior decorating service. The left side shows a simpler, less organized layout, while the right side displays a more polished, colorful, and user-friendly interface with images of interior spaces, profile search options, and a professional hiring call to action.

Evidence: All participants showed signs of uncertainty about what the platform offered before logging in.

Change:  Outline services before users log in, incorporating elements that allow preliminary interaction.

Issue 2: Confusion over account type selections during login  (Medium)

Comparison of mobile app screens before and after design update for interior decorating service, showing user interface, login screens, and a chat feature.

Evidence: Users hesitated during login, unsure of which account type to select.

Change: Create a different login pathway for professionals, separate from standard users.

Issue 3: Confusion over search bar functionality (High)

Evidence: Participants were confused about using the search bar as they were unsure of specific keywords.

Change:  Images have a footer with profile information to clarify you can search profiles from the main page, search bar remains as an alternative option. Users can toggle between sections easily, and recommendations based on searches.

Comparison of two interior design websites, showing the before and after redesigns. The before site has a simple layout with a grid of images and filter tags like 'Mediteranean,' 'Modern,' 'Bohemian,' and 'Mid-Century.' The after site features a modern, colorful interface with personalized recommendations, toggleable sections, a prominent search bar, profile and project tabs, and images of stylish living rooms and home interiors.

Issue 4: Unclear service descriptions during booking (Medium)

Evidence: All participants expressed confusion about the scope of the call they were booking.

Change:  Add more detailed descriptions of services on the booking page.

Comparison of a mobile app interface before and after updates. The left side labeled 'Before' shows a list of profiles and a book a call section with a calendar. The right side labeled 'After' displays a more detailed appointment booking page with images, filters, and options for appointment type, with a next button at the bottom.

Issue 5: Missing location and price filters (Low)

Comparison of a mobile app interface before and after improvements, showing filters and tags related to interior design and real estate, with images of rooms and furniture.

Evidence: Participants sought filters like location, rates and project size but found them absent.

Change:  Add filters and place them at the top of the filter list.

Preference Test

Description

The test evaluated home screen banner design with two variations: one with a background image and one with a color background. It aimed to gather insights on the background type's impact on visual appeal, readability, and overall aesthetic preference as the banner highlighted the search bar. 9 out of 10 testers preferred the image background version, one out nine preferred the search bar out of the banner all together. 

Screenshot of an interior design website with a header, a large living room photo with white walls, a beige couch, red armchair, and artwork, and a search bar. The site promotes finding, connecting, and designing with professionals, featuring a profile of Nia Mann, an architect.
Homepage of Caracol interior design website showing a header with the company logo and buttons "Hire a Pro" and "Get Hired." Central pink section with the words "Find, Connect, Design." Below, a search bar and a row of four interior design project images with the designer Nia Mann's photo and title.

Final thoughts

Interior of a modern art gallery with wooden panels and colorful geometric shapes displayed on vertical and ceiling structures.

Moving forward, understanding user preferences between different versions of the Caracol app is crucial. Users are primarily trying to achieve efficient and effective engagement with design professionals through the app. Our usability study revealed that aligning the app with these goals is essential to ensure adoption. Additionally, users showed a preference for visual searches, which enhance their ability to find relevant professionals quickly and intuitively. Evaluating the ease of use and overall experience helps us understand how well the usability aspects meet these preferences. These insights will inform the design decisions, ensuring we create a version of the Caracol app that meets functional needs and provides a enjoyable user experience, ultimately enhancing user satisfaction and usability.