DataFlux - The Leader in Data Quality and Data Integration

Data Quality Lip Service

Phil Simon

March 4, 2010

One of the cool things about the Internet is that you can constantly expand your knowledge base. I have already learned a great deal reading the posts on this forum. I had posted a few weeks ago on my own site about how writing books counts as my second IT education, and perhaps being a part of this community is my third. After two months of posting on this site, one thing to me is crystal clear:

I’m certainly not alone in my belief that many organizations don’t take data quality seriously–or at least as seriously as they should.

In this post, I’d like to focus on why leaders at many organizations merely pay lip service to data quality.

At some level, they know that DQ is important.

I’ve had many spirited discussions with both IT folks and line managers in my years of consulting. I have yet to encounter anyone who would admit that the integrity and quality of his/her organization’s data was not important.

In a way, this reminds me of some of my early career frustrations working in HR, before I turned to consulting. No one would admit that HR (the department or its overall) was, er, “less than strategic.” Unfortunately, their actions belied their comments.

Simon Says

It’s not enough to admit that DQ matters. Of course it does. Actions matter much more than words.

They realize that they are often powerless to effect standards and consistent DQ practices throughout the organization.

The bigger the organization, the more difficult it is for change agents and DQ proponents to put their ideas into action. Building consensus within a department is often difficult enough. Throw multiple departments and multiple countries into the equation and your job just got exponentially harder.

Simon Says

A DQ “maverick” may be just as likely to tick someone off as he is to effect actual change. Without support and commitment at the highest levels of the organization, it’s hard to buy into the “single bullet” theory of DQ. You need a DQ conspiracy or tipping point. Hopefully, this will spring from an epiphany, not a government audit or lost clients due to a horrible data in a CRM app.

Their systems’ architecture doesn’t permit meaningful DQ change.

I suppose that this is related to the previous point. If data is generated, stored, and retrieved from multiple systems without any type of MDM solution, then it’s really difficult to maintain the quality of an organization’s data.

At one large organization at which I worked, I saw more times than I could count the discrepancies among systems with respect to core employee information. The data was housed in something like ten different systems and imported into the theoretical data warehouse once every two months.

You could scream and yell about DQ (and I did, many times.) Trust me. I ruffled more than a few feathers.

Simon Says

DQ is a function of many things, not the least of which is systems’ architecture. By hook or by crook, fix that and then DQ change becomes a legitimate possibility.

It makes for good posturing.

Ah, the wonderful world of organizational politics. You have to love those that say the obvious, such as “DQ is important.”  Thanks, Sherlock. To me, the better position to take involves hard data (or at least approximations of the overall impacts to the business). Examples might include:

  • incorrectly paid employees costs us approximately $X/year
  • we mismatched invoices X% of the time last year
  • we have to carry excess inventory because our sloppy item master has redundant codes

Do that and the decision makers will be more inclined to listen.

Simon Says

Resist the facile position of stating the obvious. Try to make the business case for DQ.

What do you think? Are there other reasons that people pay lip service to DQ?

tags:  , ,

  1. #1 by Jim Harris at March 4th, 2010

    Great post, Phil.

    In many ways, only paying lip service to data quality is far more frustrating that either ignoring or denying its vital importance to the success of the organization.

    And excellent point that without stating a tangible business case for data quality based on business impacting metrics (costs incurred, revenue lost, regulatory risk), lip service will remain all that you manage to achieve.

    Best Regards,

    Jim

  2. #2 by Phil Simon at March 4th, 2010

    Jim

    Thanks. I’m with you. It’s kind of like saying that dieting is important as you wolf down three cheese burgers–and a Diet Coke. I have more respect for those that just chomp away.

  3. #3 by Merv Adrian at March 4th, 2010

    Right on, Phil! None of the technology, or good intentions, will help until the value of governance is articulated in business terms to people who have money to spend and a willingness to drive cultural change.

  4. #4 by Garnie Bolling at March 4th, 2010

    hear here Phil (what Merv and Jim said)

    The fun is finding that DQ Maverick, or being that person. That is when we start talking about risk, and costs (of not doing it).

    Walk the Walk, or risk having this a thorn in your side for a long while. (maybe we should have that manager part of the “accountability team”)

    Keep it up Phil… I am enjoying the community and information provided.

  5. #5 by Walter Howard at March 7th, 2010

    Yes sir, no disagreement here. You could even swap “data quality” with “data modeling” and the post would still be accurate. Most companies don’t even have a data management organization. What does that tell you?

  6. #6 by Phil Simon at March 8th, 2010

    Merv, Garnie, and Walter

    Thanks for the comments. It’s a sad state of affairs at most organizations. I completely agree.

    I wonder if an uptick in the economy will increase the chances that more organizations get on board…

  7. #7 by Jackie Roberts at March 10th, 2010

    Great post! In my experience that data quality consequences affect those other than the IT system applications owners. Until an enterprise data governance program is setup reflecting the business needs and users requirements, the field is populated data quality mentality is in control. I participated in a meeting with core business silos represented (engineering, facilities, finance, purchasing, IT and maintenance) to discuss data quality and implementation of a data cleansing program. It was quite amusing to watch the maintenance end users response when IT and purchasing stated that there was not issues with the data quality. The maintenance manager’s response was “you haven’t had to deal with a down production line, hours spent searching systems for parts, items returns or inventory duplication.”

  8. #8 by Phil Simon at March 10th, 2010

    Jackie

    Thanks. I’m glad that I wasn’t in that meeting!

Comments are closed.