Why customer satisfaction scores are declining

Jun 18 / Hanna Milieva
Customer satisfaction scores are dropping across your organization, but before you panic about service quality, consider this: the problem might not be your customers' experience—it might be how you're measuring it.

Recent research from the International Journal of Quality and Service Sciences reveals a fundamental flaw in how we interpret customer satisfaction data across different cultural contexts. The study, conducted across four countries, demonstrates that
traditional satisfaction surveys suffer from systematic measurement bias that can lead to completely wrong conclusions about customer experience quality.
When Swedish customers rate a mobile service experience as "excellent" (scoring
85/100), and Thai customers rate the identical experience as "good" (scoring 65/100), which group is more satisfied? Traditional surveys would suggest Swedish customers are happier, but research shows this interpretation is fundamentally flawed.

The study used a methodology called "anchoring vignettes"—hypothetical scenarios that customers evaluate alongside their own experiences. When researchers presented identical service scenarios to customers in Costa Rica, Poland, Sweden, and Thailand, they discovered significant cultural differences in how people use rating scales.

Swedish respondents consistently rated positive scenarios very high and negative
scenarios very low, showing extreme response patterns. Thai respondents, by contrast, rated the same positive scenarios moderately and negative scenarios less severely.

These aren't differences in satisfaction—they're differences in how cultures express evaluation.

The scale usage

This phenomenon, known in research as "differential item functioning," means that a satisfaction score of 7/10 from a Swedish customer might indicate the same level of satisfaction as a 6/10 from a Thai customer. The numbers look different, but the underlying satisfaction is equivalent.

The implications are profound. Organizations using traditional satisfaction surveys to allocate resources between markets may be systematically over-investing in culturesthat express satisfaction more moderately and under-investing in cultures that use rating scales more extremely.