NPS is a widely used methodology to measure CX - in fact it’s nearly ubiquitous and has gained a massive following around the world - primarily because of its simplicity and equally importantly - as a measure of predicting customer loyalty - and in turn profitability.
NWe also know that Customer Churn is the single measurement that can sustain companies through good and bad times. However, determining and more importantly predicting Churn without a data-science team dedicated to this is nearly impossible. Most data-science teams look at _behaviours_ and try to correlate a multitude of behavioral variables to exit variables. While this is theoretically true, this almost never gives researchers the “Why” - it only gives a co-relational model - not a causational model.
Here is an enhancement to the NPS model - to include a operationally & cognitively easy way to:
Exit / Cancellation Surveys
Most NPS Programs already have models in place for contacting customers after they cancel/churn and determine reasons for churn. This is post-facto and while it gives good directional indicators, operationalizing this has been challenging. This is partly because reasons change over time and there is no “Base” comparison - by base comparison we mean that - if we are only surveying customers who are cancelling / churning - then its very difficult to map that against folks who are NOT churning - existing customers.
Ongoing NPS / Check In Surveys
Companies that use NPS as an ongoing basis for existing customers can use that same model to determine and predict churn. This benefit of using on-going operational surveys to determine Churn is that it is already in place - the ability to deliver emails/sms notifications, post transactions and collect data.
While it’s easy to determine NPS - dynamically determining root-cause / isolating and identifying root causes has been relegated to text analytics - around “Why?”
For surveys, most text analytics models don’t work - partly because of NLP/Training data. Good Machine Learning models need a lot of training data to increase accuracy.
In this solution we functionally determine the “Why” answer by using the collective intelligence of the customers themselves.
The first task at hand is Isolation - by isolation, we mean - determine the top one or two reasons why someone has the propensity to churn. Every product / service has some unique and key elements - that determine customer affinity - and inversely determine customer churn. The first key idea here is to isolate these key reasons. This can’t be done using text analytics - simply because AI/NLP tools are still not good enough to determine “Weight” around different reasons from simple text.
We can spend a lot of energy, time and effort around claiming that AI/NLP tools will one day get there - but it is 2020 and I’ve yet to meet a customer that can confidently tell me that their trust in their NLP model is high enough to make this determination.
We are showcasing a much simple approach to this - we let the customer choose between a set of “reasons” when they go through an NPS survey. Here is an example below:
We allow users to choose between 1, 2 or 3 items - this is needed for isolation. There may be many reasons for churning - but we are forcing respondents to choose the “top” reasons for churn. This process allows for isolation of the reasons automatically.
The next part is concrete identification. The typical argument against using a model like this, where the reasons are pre-determined, is that these reasons may not be exhaustive. This is correct. To solve for this, we include an “Other” option - this allows for the respondent to enter in their own reasons for giving the NPS Score.
There are 2 key ideas that apply here:
Furthermore, we use a data/content dictionary to determine “topics” - using an NLP/text model. Again, this would be much more accurate, because we are only looking for “Topics” - that the user has to type in. I.e Nouns. “Server was rude” or “Not enough choices” - where we are modeling this for automatic identification of the topics.
QuestionPro has partnered with Bryght.ai for this part and will be using that AI/ML model for topic identification. One of the reasons for this is that we’ve worked with Bryght’s team to develop data-dictionaries across multiple and unique verticals - including Gaming, Retail, Gig-Economy, B2BSaaS etc. - These customized data-dictionaries - based on verticalized industry knowledge gives us better and focused accuracy.Predictive Suggestions
We also do predictive suggestions - very similar to Google Suggest - as users are typing in - we show them what others have suggested. This allows users to simply choose the item - instead of exponentially expanding the data-dictionary.
So far, with the Identification & Isolation models above, we can deterministically say that - reasons a, b and c are the top reasons why folks are dissatisfied/detractors and hence the assumption is that they all have an 100% propensity to churn. We believe it is logical to use detractors to identify and isolate reasons for churn. We assume that that detractors are already churned and at this point - would be nearly impossible to prevent that.
The Passive folks are the “Undecided” - they are wavering - but could lean either way. In our prediction model - we further ask the passive folks to choose the exact same set of reasons that the detractors were given. This allows us to compare the Passive to the Detractors and accurately identify and predict the passive folks that will churn.
Let's take a real example and go through this; Let's assume that there are 5 reasons for Detractors have chosen:
These percentages won’t add up to 100 because we’ve allowed users to choose upto 3 reasons for giving a Detractor Score. As described above - this isolation model can be anywhere from 1 -3 (Choose the top reason or the top 2 or reasons.)
For the Passives; let’s say our distribution falls as below
Anecdotally looking at the data, we can say that Poor Service, Dirty Tables and Location are the top reasons someone will be a detractor. This also means - that anyone Passive - who chooses those three items is likely to be a detractor in the next visit or in the upcoming months. There are other factors weighting against that decision - but in the absence of other counterbalancing factors, all passives who select those options are candidates for churn.
We use this model to predict Churn - the % of Passive folks who select the same “reasons” as marked as “Churn Predictors” - this gives you a predictive model on who probably will churn.
Uber uses a simplisting identification model for both promoter and detractor root-cause identification.
As you can see with the screenshot above, the user gave a 4 Star Rating - Assuming 3 & 4 Stars are passive, Uber is now trying to determine the root cause of the 4-Star rating - using a simple choice model.
While the efficacy of NPS has been debated for over 15+ years now, the underlying model for segregation customers between “Advocates” - “Lurkers” and “Haters” is a fundamental construct in satisfaction and loyalty modeling. The Churn modeling that we propose is fundamentally based on the premise that “Lurkers” can be swayed - either to be “Advocates” or not.
The predictive model fundamentally relies on the principle that indifferent customers are the highest propensity to churn - in fact even more so than passionate haters. We rely on this fundamental psychological precept to model our predictive churn process.