A record NPS jump looks like good news, but a change in who is answering the customer tracking survey can move the score on its own. We compare respondents wave over wave and break down NPS movement like for like.
The score jumps more than ever before, with no clear cause in the customer experience itself.
A change such as an update to the login process can quietly change who answers the customer tracking survey.
A different mix of respondents can make performance look better, or worse, than it really is.
Leadership wants to share the result before anyone has validated what really moved the score.
We check whether the survey's respondent mix has changed and trace any shift back to its cause.
We separate the change driven by real customer experience from the change driven by a different mix of respondents.
We check whether the remaining movement is larger than normal statistical noise before anyone reports it.
Leadership reports a validated primary NPS, while a secondary NPS that includes any new respondent group is tracked in parallel, so no insight is lost.
The brand recorded its largest quarterly NPS jump ever. But a recent product update to the login process had quietly changed who was answering the customer tracking survey. Leadership needed to know whether customer experience had really improved, or whether a different mix of respondents was making it look that way.
By comparing respondents wave over wave, we confirmed that the login update had changed the survey's respondent mix. We then broke down the NPS movement on a like-for-like basis and found a stable and minimal increase in NPS.
Leadership reported a validated NPS, keeping the new respondent group out of the primary metric until a full 12-month cycle was complete. A secondary NPS that includes the new group is tracked in parallel, so no insight is lost.
The brand avoided overstating its performance and kept its customer experience reporting credible.
A score that leadership can report with confidence.
A clear breakdown of what really moved the score.
How the respondent mix changed, and why.
A primary and secondary metric setup, so no insight is lost.
Brands that track NPS wave over wave.
Teams that recently changed a product, process, or survey channel.
Leaders who need customer experience reporting to stay credible.
Common questions about our customer experience tracking and NPS validation approach.
A comparison that uses the same type of respondents in each wave, so changes in the score reflect customer experience rather than a different mix of people answering the survey.
Adding them right away mixes two different groups and can overstate performance. Keeping them out until a full 12-month cycle is complete keeps the comparison fair, while a secondary NPS still captures their feedback.
Not always. A jump can come from a change in who answers the survey. Validating the result first protects leadership from reporting a gain that isn't real.
Copyright © 2026 Delphinus Market Research - All Rights Reserved.
We use cookies to analyze website traffic and optimize your website experience. By accepting our use of cookies, your data will be aggregated with all other user data.