TOT Rocks: Q1 Development – Durable Improvement Graduation Ceremony
TOT Rocks: Q1 Development – Durable Improvement Graduation Ceremony
Date: 10/01/2025
Rock: Q1 Development – Solutions for Digging into Verifications and Fixing Consumer Issues
Rock Lead: Charlie
Durable Improvement: Weekly tracking of verification clear rates in sprint planning, captured on the Product Scorecard.
A. Summary of the Process & Key Links
The durable improvement implemented is the systematic tracking of verification clear rates during weekly sprint planning meetings. Each week, the Development team reviews verification statistics and records them on the Product Scorecard, ensuring visibility into performance trends and potential issues.
📎 Related Links
B. Value of the Improvement
Effort & Cost
- ~10 minutes weekly effort (collecting and reporting statistics).
Why is this an improvement?
Previously, there was no consistent process for surfacing verification clear rate issues. With this improvement, the team can now identify and respond to problems quickly.
Key Results
- Faster detection of verification issues across configurations (e.g., Shopify post-checkout verifications).
- Enabled the team to proactively identify when performance dropped unexpectedly and address root causes.
Highlights
- A recent drop in postCheckoutTransaction clear rates was detected through the scorecard. Investigation revealed that polarispeptides.com had temporarily turned off verification and forgotten to turn it back on. Thanks to this process, the issue was flagged immediately, and the client was reactivated quickly—avoiding prolonged disruption.
Measured Growth
- Clear rate visibility is now embedded in the team’s weekly rhythm, reducing the time between issue occurrence and resolution.
- Provides a consistent data-driven foundation for decision-making in verification-related development work.
C. Ensuring Sustainability
- Verification clear rate tracking is now a permanent part of the weekly Product Scorecard review in Development sprint planning.
- Issues flagged through this process are logged and addressed during sprint discussions.
- The Product Scorecard serves as a single source of truth for ongoing monitoring.
✅ With this Durable Improvement, Development now has a reliable, lightweight, and sustainable system for monitoring verification performance, ensuring faster detection of issues and stronger client outcomes.