Summary
You should not be doing research for the sake of doing research. Research takes time and needs to be well throughout. More importantly, you need to determine if your findings are actually meaningful to the organization. In this session we will look at the idea of statistical significance and meaningfulness when reporting research findings.
Key Insights
-
•
Effective CX research requires a clear alignment with business imperatives and KPIs.
-
•
Statistical significance alone does not guarantee that findings are meaningful to the business.
-
•
Qualitative research provides context and meaning to quantitative data, enriching understanding.
-
•
Competitive benchmarking is essential for assessing relative performance against industry standards.
-
•
Increased sample size doesn’t automatically ensure significance; the context and distribution of data matter.
-
•
Understanding the relationship between statistical significance and meaningfulness is crucial in research interpretation.
-
•
Not all metrics have the same impact on business objectives; prioritizing findings is key.
-
•
Driver modeling is a valuable technique to identify effective perception metrics that influence outcomes.
-
•
CX research should not only measure but also interpret changes in customer sentiment meaningfully.
-
•
Engaging stakeholders by relating findings to their specific interests enhances research impact.
Notable Quotes
"Research is not easy to do; it requires thoughtful planning and execution."
"You don't just want to be doing research for the sake of doing research; it has to have an outcome."
"Qualitative research is extremely important; it gives a clear picture of what the numbers mean."
"Statistical significance does not always correlate with meaningfulness; you need to dive deeper into the data."
"You should not measure more often unless you've made changes that have had time to be adopted."
"Seeing data without context can lead to misinterpretation; it's about understanding what the scores tell you."
"The findings must be relatable to what executives care about, like increasing revenue or reducing costs."
"You should focus on results that are meaningful to your business, not just statistically significant findings."
"Benchmarking your results across different industries is crucial because customers compare experiences beyond your sector."
"Utilizing driver modeling can help determine which metrics are most impactful on your business results."
More Videos
"It's important to ensure that participants feel respected and valued for their time and input."
Sarit GeertjesPeople, not Petri Dishes: Stories from a Research Recruiter
September 23, 2019
"People don’t learn when they’re rushed and stressed or don’t trust the source of the knowledge."
Kate TowseyAsk Me Anything (AMA) with Kate Towsey
April 2, 2025
"It's really up to you to advocate for your long-term sustainability and growth early and often."
Stephanie WadeBuilding and Sustaining Design in Government
December 8, 2021
"Joey Chung described the satisfaction of seeing team members grow as a source of fulfillment in management."
Amy Jiménez Márquez Michael J. Metts Joie ChungThe Atypical UX Manager Path
July 23, 2020
"Building great products is a team sport; you need to support one another."
Alastair SimpsonDebunking the Myths of Cross-Disciplinary Collaboration
October 24, 2019
"When launching AI solutions, build complexity gradually to avoid overwhelming challenges."
Sarah BarrettAI in Real Life: Using LLMs to Turbocharge Microsoft Learn
February 13, 2025
"You have to recognize the effects of vicarious trauma and get in tune with your own boundaries."
Jane Reid Janice HannawaySelf-care in User Research
April 2, 2020
"When designing better experiences, we need to go beyond the immediate scope of UX."
Milan GuentherA Shared Language for Co-Creating Ambitious Endeavours
June 6, 2023
"Collaboration requires both agency and shared goals among participants."
Julie Norvaisas Pert Eilers Mina JonssonBack to basics, or start from scratch?
March 12, 2025
