I share a 15-question Quiz on the topic of Mystery Shopper Research.
This article is part of our Mystery Shopper Research Series — practical guidance on designing, running, and learning from Mystery Shopper programs.
Mystery Shopper is Formal Research
Mystery Shopper Research provides a window into what Customers really experience – not just what the organization thinks they experience.
And as with any form of research, there are better and worse practices to follow.
So we developed this Mystery Shopper Research Quiz drawn from our 25+ years of global Mystery Shopper work with Clients.
Instructions for the Quiz
Below you’ll find 15 multiple choice questions on the fundamentals of Mystery Shopper Research. For each question, select one correct answer: either a, b, c or d.
15 Quiz Questions
1. Which statement best describes Mystery Shopper Research?
a. A mixed-methods evaluation that uses trained shoppers in pre-planned scenarios, producing a quantitative scorecard plus qualitative insights
b. A purely quantitative method requiring random sampling and statistical significance for population-level inference
c. A complete substitute for Customer Satisfaction/VoC programs
d. Unstructured feedback gathered from real Customers during routine interactions
2. Which of the following are common misconceptions about Mystery Shopper programs?
I. Mystery Shopper programs must be run internally to be effective
II. They can replace Customer Satisfaction/VoC surveys
III. They require random sampling and statistical significance to be valid
a. I only
b. II and III only
c. I and III only
d. I, II and III
3. What is the first step in designing an effective Mystery Shopper program?
a. Choose the channels, touchpoints, and scenarios to be shopped
b. Define the research objectives with stakeholders (what decisions will this inform?)
c. Determine volumes, sampling, and timing
d. Build the scorecard and reporting outputs
4. In Mystery Shopper Research, what is a “scenario”?
a. A data-analysis technique
b. The design of a customer satisfaction survey
c. A defined customer journey or touchpoint interaction—with clear starting conditions and intent—to be executed by a trained shopper
d. An interaction used only for competitive benchmarking
5. According to OmniTouch, what does the “Magic 20%” refer to in Mystery Shopper research?
a. The minimum shopper sample size required for reliable inference
b. The small share (~20%) of observations that surface unexpected qualitative insights with outsized impact
c. The acceptable error margin in reported results
d. The typical proportion of shops that fail quality checks
6. What are the two broad types of performance standards used in Mystery Shopper research?
a. Quantitative vs. qualitative measures
b. Binary (compliance) standards and scaled (range/calibre) standards
c. Journey vs. transaction standards
d. Internal vs. external standards
7. Which statement is true about scoring performance standards in Mystery Shopper research?
a. Scores should reflect the Mystery Shopper’s personal opinion of the experience
b. Calibration—using clear rubrics, worked examples, and inter-rater checks—ensures consistent interpretation across different Mystery Shoppers
c. Only scaled (range-based) items require definitions; binary items do not
d. Quality-assurance review is unnecessary if shoppers are experienced
8. What keeps a Mystery Shopper program focused?
a. Let each function define its own standards independently
b. Limit scenarios to a single journey or touchpoint
c. Tie all scenarios and performance standards directly to the primary research objective and decisions to be made
d. Expand to as many touchpoints as possible regardless of goals
9. How do Mystery Shopper Research findings best complement Customer survey (VoC) results?
a. They reveal the operational “why” behind the feelings captured in survey scores (e.g., which behaviors or gaps drove the ratings)
b. Mystery Shopper findings provide statistically representative measures of Customer sentiment
c. Findings from Mystery Shopper replace the need for Customer journey mapping
d. They eliminate the need to collect qualitative feedback from real Customers
10. When designing Mystery Shopper Programs for Customer Service chatbots, what did OmniTouch find important?
a. Use only binary/compliance scoring
b. Assume chatbot language is easily understood by Customers
c. Test the journey with realistic Customer needs and the Experience pyramid (Effectiveness, Ease, Emotion)
d. Avoid involving cross-functional colleagues
11. According to OmniTouch, what is Mystery Shopper Research’s unique contribution to Customer Experience improvement?
a. Provides statistically representative, population-level performance metrics
b. Reveals—via direct observation of defined scenarios—what actually happens
c. Fully replaces Voice of Customer surveys
d. Makes it unnecessary to capture Customers’ emotions or narratives
12. When designing Mystery Shopper scenarios, which grouping is commonly used?
a. Group by metric type (quantitative vs. qualitative)
b. Internal vs. external audience grouping
c. Group by: prospective customer, existing customer, or observation-only
d. Scripted vs. unscripted grouping is best
13. Why should Mystery Shopper program design be cross-functional?
a. To keep the process confidential and reduce bias
b. So each function can set its own measurements without needing alignment
c. To secure early alignment on objectives and standards, ensure operational feasibility, and build stakeholder buy-in from the start
d. To speed delivery by skipping reviews and quality assurance.
14. What does the “Magic 20%” highlight for CX leaders?
a. 20% of shoppers typically fail quality-control checks
b. A 20% statistical margin of error is standard in mystery shopping
c. A small share (~20%) of observations contain unexpected qualitative details that spark disproportionate, actionable improvements
d. The top 20% of scenarios produce the most accurate performance scores
15. The Mystery Shoppers selected to conduct interactions/visits should be:
I. Company employees
II. Capable of natural role-play and following scenario instructions (“good actors”)
III. Screened for any required profile (e.g., age, location, eligibility, accessibility)
IV. Customer service experts
a. I only
b. I and IV only
c. II and III only
d. III and IV only
Here’s How to Check Your Answers
If you’d like to know if your answers are correct we’re happy to help.
And we’ve intentionally gone low-tech here. There’s no need to register anywhere, set-up an account or pay to access the practice questions.
Once you’ve answered all (15) questions just drop an email to me at [email protected]
Because we have a number of different practice question sets out there please tell me which set of practice questions you’ve taken.
These Quiz Questions are for Mystery Shopper Research.
Then let me know the Question # and the Answer that you chose (either a, b, c or d).
You can use the following format in your email to me:
- a
- d
- c
- c (and so on for all 15 Questions)
I always do my best to answer quickly and let you know which ones you got right and which need correction.
Thank You for Taking the Mystery Shopper Research Quiz
I regularly share stories, strategies, and insights from our work across Contact Centers, Customer Service, and Customer Experience. If this resonates, I’d love to stay connected.
You can drop me a line anytime, or subscribe via our website.
Daniel Ord
[email protected]
www.omnitouchinternational.com
