Time: 10-15 Minutes
Purpose: Reflect on the Modern Testing Data Growth Model
Introduction: In our experience, we’ve seen teams adopt data practices on four stages/levels:
-
Data Oblivious - Intuition and Customer Feedback defines Actions taken
-
Data Affirmed - Data is ONLY believed if it affirms Intuition
-
Data Driven - Intuition VALIDATED by Data defines Actions taken
-
Data Centric - Data Analysis is core to all decisions
Activity:
- Where is your team on this spectrum? As with any model, your team may be between levels, or different parts of your team may have different levels of data growth.
- What are some things you can do to grow the data culture on your team?
Discuss your answers and ask questions on this thread.
My organization collects a lot of data from our users and mostly business teams use them for;
- Making long term business decision such as launching the software on different platforms or enabling different technologies within our software
- A/B test new features
- Detect anomalies such as users being confused and not able to use a certain functionality
My organization is already quite data-driven. To improve this I would motivate my team-mates to deep dive into the meaning of the data. Sometimes looking at just a few metrics on decision making is not enough, it also requires discussions about the meaning of this data we collect. For example;
We are a subscription-based meal-kit company. Our team naturally focuses on weekly order amounts to measure our performance. Together with different marketing campaigns sometimes it increases quite much but when the users are not so happy with the meal selection they cancel their subscription after a while. In this scenario looking at only the checkout rate is not enough to measure the success of the company I believe.
1 Like