Adding the phrase ‘Customer Experience’ in front of something doesn’t make it so.  And this applies to Mystery Shopper research.   A Customer Experience Mystery Shopper is something very particular and special.

Some time back in Singapore, one of the local Awards Clubs introduced a Customer Experience Mystery Shopper Award into its portfolio.

Cool I thought – it will be interesting to see what a Customer experience-based Mystery Shopper Award looks like as per a global vendor.

A short time later, I was helping a hospitality Client set up the Quality Assurance program for their Contact Centre.

A group of 20 senior folks were gathered together in the conference room, and we were in the midst of selecting & defining quality standards when one of them stopped and asked –

Hey Dan – did you know that we entered the Customer Experience Mystery Shopper Award this past year?

No I said – how did it go?

Well – we aren’t so sure. Because in this workshop I’m getting a sense of the complexity that goes into setting & measuring quality – but I’m not so sure it was this rigorous in our Awards entry.

He continued…

I have the final report from the Mystery Shopper vendor here on my laptop – can we flash it up and talk about it?

But of course!

The cover slide whirred up on the screen.

Opening slide – very formal – The Customer Experience Mystery Shopper Report etc. etc.

We were all ready. And then, next slide…

THE GREETING – score 98%

What? The Greeting? Oh – ok. Anyway 98%

Then the next slide…

GET THE CUSTOMER NAME – score 97%

Oh…really?

And it carried on from there.

Slide after slide after slide reported on a compliance measurement – even the Hold Technique was featured.

As we hit slide 20+ something someone in the room turned to me and asked – So Dan — you look a bit pale – what do you think?

Well it was an easy question to answer.

Well guys – I said– what you have here is a wonderfully presented compliance report – but I haven’t seen anything yet that even remotely measures or talks about the Customer experience.

And the room agreed.

Interestingly – in this report there was a final measurement slide that said CUSTOMER EXPERIENCE (yes – that’s right – a single slide).

Score – 58%.

But the legend was unclear as to how the score was derived.

After some discussion around the table we guessed that perhaps this was the personal score or viewpoint of the Mystery Shopper.

So let’s put it on the table right now.

If the first thing that comes to your mind when planning a Customer Experience-based Mystery Shopper program is THE GREETING – then you are on the wrong track.

 

There’s a lot of compliance-based Mystery Shopper work going on out there

There are certainly some valid reasons for having a solid compliance-based Mystery Shopper program.

They’re used extensively in the banking & finance industry – especially for ensuring regulatory compliance.

In the Public Sector, compliance-based programs provide a basic ‘minimum-standard’ dipstick – that provides high level assurance that when an email gets sent – it receives a reply.

Or when a telephone call is placed, some kind of basic response – along with basic courtesy – is provided.

While it’s rare to see a Public Sector program skew heavily to the Customer experience (now there’s an opportunity I’d love to be part of!) compliance based programs ensure a level of essential service is provided.

Another example of a smart compliance program is ensuring that things work the way they are supposed to work.

That when a certain telephone number is dialed at a certain time of day – that the call goes to the right place (you’d be surprised how many times it doesn’t).

Or when a certain set of IVR options or digital instructions are followed, that the Customer ends up where they were supposed to and got what they were supposed to get.

As channels proliferate and overlap, it’s really important to ensure that channel mechanisms work the way they are supposed to – the omni-channel Mystery Shopper program.

It’s not right to say that compliance-based programs are ‘bad’ while CX-based programs are ‘better’.

It’s always about defining what you want to learn and then figuring out the best way to learn it.

But there’s a big opportunity in putting together a solid Customer Experience-based Mystery Shopper program.

And no – adding the word Customer experience in front of something doesn’t make it so.

 

If you are considering a compliance-based Mystery Shopper program ask yourself – what am I going to learn from this program that I couldn’t learn from my own Team Members?

Assuming that you’re not conducting Mystery Shopper because you have to (such as described earlier for the finance or Public Sectors), I’d ask myself a very simple question before starting.

What am I going to learn from this Mystery Shopper program that my own Team Members – both Management & Frontline – wouldn’t have already picked up on? 

Once, when I met with a fancy hotel chain, the resident Trainer told me (in a very proud tone) that their Mystery Shopper – apparently a hotel expert who traveled the world – had picked up that the wheels on the room service trolley were squeaky.

And before I could think (and perhaps keep my mouth shut) I blurted out – why would you pay someone for that? 

Shouldn’t your Room Service People & Supervisor pick up on that? 

What kind of culture exists around here if your own Team Members wouldn’t find and fix such matters on their own?

At the end of the day, if the Mystery Shopper program looks and feels ‘police-based’ it will be wildly unpopular – and that makes improvement efforts very difficult.

Because when a program has limited credibility – it automatically has limited impact.

The key is always to define the purpose – a set of objectives for the program – that will resonate with Stakeholders and set the Organization up for future success.

 

So what does a real Customer experience-based Mystery Shopper program look like?

There is no one single model – that’s the beauty of deep dive research – and we share a few models here from our work with innovative Clients.

Let’s start this discussion with the brand

Colin Shaw of Beyond Philosophy says that a brand is perception – nothing more, nothing less. It is what you think and feel about that company: an opinion, a viewpoint, an expectation.

So the Customer experience is the journey the Customer has with your brand.

When you look at it like that – then opening the Mystery Shopper design conversation with a discussion of the brand makes a lot of sense.

If your brand proposition incorporates things like trust, or accuracy, or ownership – then these values can be codified and studied during the Mystery Shopper journey.

The gaps between the ‘brand’ and the ‘Customer experience’ can be identified for further action.

One of favorite Customer experience-based Mystery Shopper programs was with a high end hotel where the GM & Team wanted to focus exclusively on brand values. So we designed everything to effectively measure the success (or gap) in bringing brand values to life.

It was a privilege to work with such forward thinking management and I share this example in many of my talks and workshops on Customer experience.

 

And what about emotion? If you’re executing a real Customer experience-based Mystery Shopperprogram then studying the emotion is a must

One of my favorite things about the rise of Customer Experience is the inclusion of emotion in business discussions.

For too long, Customers (and Employees as well) have been treated as batches of numbers, or ‘segments’ that are expected to behave and perform in certain ways.

If they follow ‘your rules’ – then they can get what they want or what they need.

But if you read any established Customer experience authority you’ll note how quickly (and powerfully) the topic of emotion comes up – in fact Bruce Temkin argues that more than 50% of the Customer experience is driven by emotion – so how can that be ignored?

So in our work designing Customer-experience based Mystery Shopper programs we always talk about emotions.

During the course of booking a dining reservation what emotion do we want to ‘bring out’? It’s definitely not using the Customer’s name 2 times!

Let’s be frank – if you don’t know what emotions you are trying to evoke – how will your Team Members know?

Testing emotion is one of the best things you can do in a Customer Experience-based Mystery Shopper program.

 

We also like The Diary approach to recording thoughts & feelings over the course of the journey

For a well known theme park, we conducted a series of lengthy (6 – 8 hour) Mystery Shopper visits that incorporated thoughts & feelings.

Structured in a diary format and supported by photographs, each final report was quite lengthy.

But after each visit was done, we were able to boil down observations across the journey into a number of themes.

We then cross referenced all the themes across all the visits.

Mystery Shopper research – like Focus Groups – is a deep dive qualitative research methodology – and lends itself beautifully to this kind of study.

What was also great about this program was that no score was assigned.

It was about designing an observation through the eyes of a ‘stand-in’ Customer to document the Customer journey.

The report became legendary and we still have company management write to us now and then on how useful (and revolutionary) the approach had been for them.

At the very minimum

At the very minimum – if you are ready to use Mystery Shopper as a Customer experience tool, consider upgrading your measurements beyond simple compliance standards.

Sure – compliance standards are easy to measure.

But they have very little to tell you with regard to the thoughts, emotions, feelings & Customer journey.

With compliance standards, you can get excellent marks and still deliver a lousy experience.

And just adding the phrase ‘Customer Experience’ to something doesn’t make it so.

Thank you for reading!

Daniel