Tracking your tester engagement is a critical part of what we offer at Stomio. Gone are the days of you wondering if a tester is actually testing your product. With Tester Engagement, you will know for sure where each tester is on their journey. And you can take actions based on each stage.
In this article
- How do I customize tester onboarding?
- What does the Tester Funnel show?
- How do I see what testers did and when?
How do I customize tester onboarding?
You can customize some elements of your tester journey in Stomio. This includes the email invitation sent from Stomio when you add a tester to your beta. As well as adding an NDA for them to accept.
As a Manager, navigate to your beta → onboarding. You will see the invitation Email section where you can customize the Subject and body of the default email sent from Stomio to your testers.
The Onboarding page, with the subject and body of the invitation email testers receive
Customize the message to your needs by utilizing the rich text bar. Make sure to utilize the variables available for you for more flexibility.
The invitation email editor with the variables menu open, offering beta name, workspace and manager placeholders
What does the Tester Funnel show?
The Testers tab of a beta's Results, with the funnel chart above the top performers list
With Tester Funnel, you’ll know exactly where your testers are in their journey. Navigate to your Project→Results→Testers. You will see your tester analysis for that beta.
At the top of the screen, you will see your Tester Funnel chart. It gives you a quick visual on how many testers got invited, accepted their invitation, finished one task, finished half of the tasks, finished all tasks, and declined their invitation.
The Testers Funnel chart, with a bar for invited, accepted, one task, half, all tasks and declined
Clicking on “See in depth” takes you to a new screen where you can see the individuals in each stage and can have some actions based on where they are in the funnel (e.g. starting a chat with testers who finished all their tasks to say Thank You)
The in-depth funnel view, expanding each stage into the testers in it with a chat link beside each
Next in the tester analysis is the Top performers table. This is a quick list of the top testers who finished all of their tasks ordered by the time spent finishing those tasks. You can easily start a chat with each of them to say Thank You or reward them in other ways (swag is always a great idea!)
The Top performers list, ranking testers who finished every task
Finally, you will see a table with the testers who opened most tickets and the number of tickets they opened. This is typically a good indicator of tester engagement so always a good idea to reward testers who reported most bugs or shared most ideas on how to improve your product.
The Tester who opened most tickets list, with a ticket count beside each name
How do I see what testers did and when?
You can dig deeper into your tester activity to see how your beta is progressing. Navigate to your Project→Results→General Insights→Tester Activity→See activity log. You will see the activity log screen where you can track various activities at various time intervals.
The Testers activity log, with metric tiles, an activity chart over time and the log beneath
You can filter this view by activity (All activity, Task completed, New testers, Opened tickets) and/or by time frame (Last 24 hours, Last 48 hours, Last week, Last 2 weeks, Since launch)
The time frame filter on the activity log, offering last 24 hours through since launch
Next, you will see the main metrics tracked for tester activity: Task completed, Opened tickets, and New testers. You will see an indicator next to the number in green or red for the change in that metric within the time frame selected.
The activity tiles for tasks completed, opened tickets and new testers, each with its change indicator
Next is a chart tracking new testers and tasks completed over time, so you can see your tester activity by date.
The activity chart plotting tasks completed and new testers by date
Finally, you will see a full activity log for each tester. You can quickly jump to the feedback of each tester from the table for ease of access
The per-tester activity log, with a link to that tester's feedback on each row