6 Signs You Need a Tracking Plan on Top of Mixpanel

Intro

It is Tuesday morning, 9:45 AM, 15 minutes before the team meeting. You open Mixpanel (or your favorite analytics tool). You are excited to see the results: How are users interacting with the new detail page UI released last week?

First, you want to check how many users (hopefully more) have been using the new UI, but it's hard to find the exact event. After searching, three events — show_detail_page, detail_page_view, and load_detail_page_new — all seem possible. The product specs and Jira aren't very helpful either; they only mention “tracking usage of the new page” without specifying the exact name. You message the engineer who added the tracking and confirm the event is load_detail_page_new.

As you think about what "load" means, you see that the number of users has gone up by 50%. This increase is much bigger than what could be explained by the new UI design (even if it is a really good one). You then realize that this was logged differently than you had intended. But it’s now 10 AM, and the meeting is starting. You find yourself thinking about how to deliver this bad news to the team, plan out for a rework and another release.

When there are only a few things to track, these tasks move along okay, facilitated by a combination of Slack messages, Jira comments, a section in each prod spec, and verbal agreements in meetings. However, as the product starts to grow, we often feel tracking issues creep up, consuming more and more of our team’s resources. Sometimes we are moving too fast to realize how much time it has taken until it leads to missed deadlines or poor decisions. 

Luckily, this is a problem that can be effectively solved. The solution is a data tracking plan. 

What this post is about

I have worked as a data specialist, a software engineer, and a product owner. I have solved similar problems for different teams as different roles. Today I want to share my experience in combating data tracking messes.

In this post, we'll explore six key signs that indicate the need for a tracking plan, and explain how a small effort that can save you a lot of headaches later on.

‘measure twice, cut once'

Signs You Need a Tracking Plan

First things first, do you actually need a tracking plan?

1. New Team Members Are Lost: When new members join and ask “What events are we tracking?”, or “What event should I look up if I want to analyze this button/flow” it shows a lack of accessible, organized tracking information.

2. Delayed Product Decisions: If you're waiting to make product decisions because the analytics or A/B test data is missing or seems unreliable, it’s a red flag.

3. Engineers Seeking Clarifications: If engineers on your team frequently ask about tracking requirements, it means the tracking goals were not planned beforehand.

4. Misaligned Tracking Implementation: Discovering that the tracking implemented doesn’t match what was initially intended is a clear sign of disorganized tracking processes.

5. Overloaded Feature Specs: When more than three of your feature specifications or Jira tickets include sections on data tracking, it's a sign your tracking needs deserve a dedicated place.

6. Data Reporting Doubts: Find yourself wondering if the data is ready to be reported to leadership? This indicates a lack of confidence in your data's readiness and accuracy.

If you've noticed one or more these signs, it's time to consider a tracking plan.

What is a Tracking Plan?

A tracking plan is a living document that outlines three things:

Events: What user interactions you are tracking. 

💡 Naming convention for events

Using a naming convention is the most cost-effective way to achieve a tracking system that is both easy to maintain and use. There are many philosophical approaches to naming convention. Here at Seal, we use: page_location.ui_name.action, for example, product_detail.add_to_cart.clicked. Stay tuned for our next blog, which will talk about event naming conventions in more depth.

Properties: The additional details of these interactions. 

Details: More event details.

• Descriptions

• Status 

  Here is the steps we use at Seal, feel free to tune it according to your team’s workflow:

  📝 In planning → 🧑‍💻 Ready for dev → 🛠 Implemented → ✅ Ready to use → ⛔️ Update needed → 🗂 Archived

• Platforms (e.g., web, desktop, iOS, Android, server, etc.)

• UI screenshot (Or, plan directly on Figma designs, see below)

• Other relevant information (like owners, data source, priority, QA notes, etc.).

This document makes sure everyone knows what data is being tracked and how.

How to Build a Tracking Plan for my Product/Team?

Ready to make tracking right and painless? Read our Tracking Plan Quick Start Guide 🙌