Jun 11, 2020
To create great user experiences, feedback is key.
Having feedback loops in place benefits everyone within an organization—from product development and customer success to sales and marketing. Collecting continuous feedback helps teams understand what’s working and what’s not—and ultimately deliver something that users really want.
At Maze, we’re a small remote team and still in the early stages of our journey. We try to keep things simple and don’t have many rigid processes in place so we can move fast. But we do make sure to stay in touch with our users on a regular basis. In the end, getting frequent feedback helps us make better decisions and deliver value as a company.
Here are some examples of how we collect, analyze, and action feedback—and things you can easily implement too.
It all started with an article. This one to be specific. After joining Maze, our first product manager was inspired to understand our product/market fit, what makes users love Maze, and what we can improve.
“With a product/market fit survey, you really get the user’s voice, how they speak about the product, what they love, and what the core value for them is. It gives you a lot of information to help you define what strategy to adopt.”
Arjen Harris, Sr. Product Manager
Here’s the product/market fit survey we sent (Click to view) 👇
And this was our process:
So, what did we learn?
"Maze helps me validate ideas really quickly. As a solo designer on a team, it lets me work fast and is less time-consuming than scheduling traditional user testing."
3. We also found out that some users want to understand the why behind the data they collect with Maze. This means we have a chance to add more features to improve our product for a wider audience.
"The survey section will be better if you can create certain connecting logic between questions."
4. Finally, we learned that many respondents haven’t used the product a lot. This is a great opportunity to look into our onboarding and product education to help our customers understand the value of Maze better.
In short, the product/market fit survey gave us many valuable insights that we’re now using to help inform our product and marketing strategy. The plan is to run this survey on an ongoing basis so we can continue to track our product/market fit as we grow.
The product/market fit survey gave us a good understanding of what our users value most, but not necessarily any specific solutions or features to build.
To get a pulse of what our users want to see next in Maze, we use Nolt. It’s an easy-to-use feedback collection tool where users can add and upvote feature requests. Collecting all requests in one place allows our team to get a general sentiment of what people want and keep an eye on what’s most important to our users, as it also lets them upvote their favorite requests.
Nolt feedback board
Do we build everything requested on Nolt?
The short answer is no. The key is prioritizing what to build based on the volume of requests and our strategy. For example, before deciding what to work on, we ask ourselves: Will a particular new feature unlock a new market segment, or will it help current users get more value out of the platform?
At Maze, we review the requests regularly and use them to help inform our product strategy. For instance, we recently released Team Management and the Figma integration—both highly requested features. The Figma integration helped us reach a new audience while Team Management helped us strengthen our value proposition for larger design teams and organizations.
There are many ways you can collect feature requests, but Nolt has made it easy for us to have everything in one place. And the best part: we don’t have to do any manual tagging.
Collecting user insights to help inform what we’re going to build next is great, but we also need to ensure that our users have a good user experience right now. Those are the table stakes of a business.
For example, if a user contacts us because they are experiencing issues with their CSV export and can’t perform their data analysis or a button in the platform doesn’t work, we need to address these quickly to avoid frustration.
Our customer success team helps us flag important issues early so that we can give the quality experience users expect. We use Crisp as our live-chat and support platform and have a tagging system in place to categorize and analyze support issues. These get shared in our CS Slack channel or on a bug request board on Notion for the product development team to action.
Our live chat is available in-app and on our website
The ultimate goal, of course, is to have a seamless experience. Think iPhone—everything works. Unfortunately, we're not quite there yet, so we need to make sure we have the tools and processes in place to address issues as early as possible. Monitoring support tickets in real-time is the easiest way to do this.
"As a developer, I currently do not have a lot of direct interaction with users, but I get to see all of the support tickets coming in, and that helps me understand where the gaps are and what kind of bug backlog we have. Being informed of how people are running into issues also helps me understand how they are using the product."
Avi, Front-end Developer
We collect a lot of quantitative user feedback, such as the requests on Nolt, to help inform our decisions. Still, we realized early on that we wanted a forum in which we could get deeper insights into what our most active customers think of Maze and the user research market in general. This is why our Customer Success team launched our Customer Advisory Board in December 2019.
"I started the Customer Advisory Board because I wanted to give Maze users not only the opportunity to express their opinions directly to the builders of Maze, but also to shape the future of Maze. The Customer Advisory Board gives our top users a chance to share their feedback and requests one-on-one on a monthly basis."
George, Customer Success Lead
A customer advisory board (CAB) is a group of customers that share insights and advice with an organization on a regular basis. It’s a great way to get qualitative feedback from the most engaged customers. Our CAB consists of around 80 of our Enterprise and most active customers. We hop on a one-on-one call every month to have a conversation and ask research questions that will help us improve our product.
Here’s how we set up the calls:
The CAB has been a great channel to speak directly with customers and understand their needs better. In our first CAB meeting, for example, a common request was the ability to do moderated testing and record audio and mouse tracking. This insight helped validate the assumption that our customers want to see this feature in Maze.
As with any qualitative research, setting up and maintaining a CAB can be time-consuming, but it's worth the investment. We get direct access to our most active and valuable customers regularly, which helps us shape our product's future together with our most important stakeholders: our users.
“We're lucky we get to share our work with our users, who are usually designers themselves. The meetings with our Customer Advisory Board are an amazing source of information.”
Jola, UX Designer & Researcher
We use Maze to collect user insights throughout the product development process. As a critical tool in our workflow, Maze gives the product team the data they need to validate their ideas and concepts before they go into development.
Here are some ways we use Maze.
Before we start working on designs and build prototypes, we collect user insights from various sources, e.g., analytics tools, user feedback, and research done with Maze Discovery. All of this data helps us make better product decisions early.
For example, we used Maze Discovery to run a research survey to collect feedback on how users would expect to use an upcoming feature—Conditions. We had a hypothesis that users would add conditions to their blocks after they completed their maze, but not everyone agreed. This lead to an internal debate on how to proceed, so we decided to let our users settle the debate. And we're glad we did.
The results showed that users expected to add conditions after adding each individual block. In the end, the insights we collected helped us improve our user experience in the early stages of the build cycle.
Once we’re designing and we’ve created a prototype, we create a usability test in Maze. We don’t test everything as we don’t have enough resources to test every product update yet. But we generally set up a maze to test the final prototype for bigger features or something we’re uncertain about.
“I like creating mazes for my prototypes as it allows me to test them from the user’s perspective. Maze helps me find issues I’ve missed in my designs even when I think they're ready."
Victor, Product Designer
Our product designer, Victor, likes to set up mazes to test his designs. It’s a quick way to find usability issues early in his design process, as it’s not always easy to spot them after working on something for a long time. Setting up a maze and running through it is a simple way to see details you might otherwise not.
We also use Maze to collect quick, anonymous input from within the team. It helps us get a first-round of feedback before it gets sent to users, and this way, we make sure the tests are well-structured.
Once we make adjustments based on the first round of feedback, the team shares it with our Customer Advisory Board. Our product designers like to share prototypes with the CAB because they understand the product well, and they are designers who often know how to give valuable feedback. We try to share something new with the CAB every month to have an ongoing flow of feedback.
“Our users are with us from an early stage of the design process, and so they feel involved in the development of the product.”
Jola, UX Designer & Researcher
It can be difficult to test UX functionalities with testers that don’t know the product. But, occasionally, our product design team also uses our Testers Panel to test things like colors, icons, and simple elements to get more answers, faster.
Before and after: New design for creating a Maze project
Here are some tips for testing with Maze from our design team:
As a bonus, we also use Maze internally for team building activities, like organizing Lunch & Learn sessions or team quizzes. 🙌
As a product-led company, a lot of the insights we collect help us build a better product. But we don’t just want to build a great product; we want to provide an overall amazing user experience—so every interaction with Maze matters.On the marketing side, for example, we collect user feedback to help inform our content strategy. As we started to invest more in content, we wanted to understand our audience’s content consumption better. To do this, we ran a content survey and spoke to a handful of readers one-on-one.
Here's the content survey we sent (Click to view) 👇
Here’s what we learned and why it matters.
We want our users to succeed with Maze, and we believe education is key to that success. This is why we’re investing in creating useful, actionable content. As with building a product, to understand what to focus on in content, you need research—and we plan to touch base with our readers regularly to keep a pulse on our content activities.
There are many formats, channels, and tools you can use to collect user feedback, and we’re just getting started ourselves. The key is turning the feedback we receive into actionable insights so that we can deliver something our users want and like.
At the moment, we’re just scratching the surface of what’s possible. How do you or your team collect feedback? Let us know on Twitter @mazedesignHQ.