...And the No. 1 Insight to be Wary of: Lists Like These

Share: Print

As anyone who has a read a magazine, surfed a consumer Web site or spent the pre-bed hour tuned in to Letterman knows, the world is in love with lists. Lists that aim to show the best, worst, priciest, cheapest, sexiest - whatever the metric, we are captivated by Top Tens.

And that's fine. Humans by nature look to place the world around them into a hierarchy.

But you don't have to be a statistics student to know that lists by definition are limiting and therefore limited in their ability to guide decisions. Think about all those "Top Stocks/Clothes/Gadgets You Must Buy in the New Year" lists plastered on magazine fronts at year end every year. Now think about how well those lists stand up to the whims of an extraordinarily diverse population over the next 12 months.

Which brings me to the headline of my blog, which you now know was made in jest. But this is no laughing matter. My company is data driven, so we understand and support the development of effective measures for the sourcing industry. But given our wide body of experience in a variety of sourcing situations - situations as diverse and unique as the world at large - we also know that best thinking critical to business decisions isn't captured in lists that purport to reduce to 10 lines all you need to know about your service provider, offshore locale or advisors.

Yet every day we are seeing more of these rankings lists produced in and around the outsourcing world. To the extent they garner headlines and further discussion about an evolving, global industry, they are helpful (albeit often misleading). But if they are the sole or main basis for a sourcing decision by an organization, then the organization and its clients aren't being well served.

For example, some rankings show that countries such as Brazil and South Africa are garnering more interest from corporations looking to source out select business services. Those are broad measures of interest, and valid ones. Whether they prove prescient only time will tell, and a whole lot of really relevant factors - local workforce quality, infrastructure, flexibility of government - will shape and shift the final results.

Other rankings, however, fall short by casting providers and advisors as being categorically better or worse than their competitors at managing business process, IT, HR or financial outsourcing. Among the problems with these rankings: They don't make any allowances for the very different circumstances of the organizations seeking sourcing relationships.

For example: If your company is a large multinational that already has multiple sourcing relations in place and wants to outsource an additional function, your needs and goals may be sharply different from an up-and-coming firm that's just dipping its toe into the sourcing water. The former may be comfortable dealing with a certain type of counselor that's demonstrably good at its job. The latter may want to be guided by a different set of advisors who are equally good at their jobs but better tasked to serve the needs of this type of client.

As for the Black Book of Outsourcing's "rankings" of service providers, advisors and law firms, one must be wary of ordinal lists conceived from a "sampling" of 22,000 people.  The industry doesn't have 22,000 decision-makers informed enough to offer judgment.  Further, a quick scan shows an uninformed intermingling of providers and advisors - a sign of confusion among either/both the survey-takers or survey-makers.  Finally, the dramatic changes year-over-year on such rank-ordered lists - radical shifts in players, providers and advisors is an indicator that the ranking is not performance or capability-based, but rather evaluation-based.  It's easy to get a new list if one changes the rules – and changes the sampling techniques. 

Indeed, the flaws I'm talking about here also get exposed in the fine print of many rankings, where we learn that any and all respondents' views are reflected in results, including multiple views from companies that end up counting for as much or more as the views of a real decision maker at another company. Thousands of responses without any polling control do not constitute a categorical portrait of any industry or its participants. All in all, broad and general rankings are poor, and often irrelevant, contributors to corporate sourcing strategies.

Anyway, the larger point - the one above all the noise – is one you’ve heard from me
before: Sourcing has become part science, where the best deals have to factor
in a whole lot of unique data specific to each client. The very particulars of
your context matter most. The best provider is the one that takes the time to
learn the most about your needs, which is not necessarily the same as the one
at the top of all those lists.

Recognize lists for what they are: Fun reading, even a jumping off point – but not the
basis for a major budget initiative that’s going to go to your bottom line.

Share: