Information-Driven Business
Robert Hillard

Is a data warehouse necessary for good data management?
by Robert Hillard

Our profession is not a large one globally.  In fact, a couple of years ago I did a back-of-the-envelope calculation that there are about 50,000 to 100,000 people around the world who would regard themselves as primarily working in data or information management.  We worked this out by estimating that to specialise you would have to be working in one of the 5,000 largest organisations (private and government) and a reasonably constrained number of professional services organisations.

Regardless of whether the numbers are right, the numbers are not large given the impact that the profession has.  Most of us are connected in some way through the conferences we attend or the communities that we participate in (such as this one).  Looking at who are in the roles, anecdotally there appears to be a disproportionately large number of people with a data warehousing background.  I include myself in this category.

Over the past five or even ten years the field has broadened out to apply standardised approaches to data management.  The scope of this includes data quality, master data management, data integration, linking metadata to taxonomies and so on.  With a reach and impact that touches every aspect of the organisation, why is it that so many people in the field still come from a data warehousing background?

What is even more interesting, when you pull groups together to talk about data management, they almost always end-up referring back to the role that the data warehouse plays in the enterprise.  A discussion on master data management will almost always include reference to the standardisation that has happened within the data warehouse.  A discussion on data quality generally refers back to the process to cleanse the data warehouse.  A discussion on data integration seems to include a debate on the operational role of the data warehouse.

I am very interested in the view of our community.  Do we refer back to data warehouses because that is where so many of us came from, or is it that an architecture which has a data warehouse playing an important role is conducive to good data management?

comments powered by Disqus


blogThe Information-Driven Business blog is published monthly:

   2018   2017   2016   2015   2014
   2013   2012   2011   2010


Also featured from the Information-Driven Business blog:

What is a consultant?
I’ve been a consultant for twenty years and have heard every variation of the joke about borrowing a client’s watch to tell the time. Like many, I didn’t start out intending to be a professional consultant and yet it has … Continue reading

Deliberate design
Organisations evolve and, with so many people spending less and less time in any one job, managing that evolution is more important than ever. At the same time the huge changes being wrought by technology combined with new global dynamics … Continue reading

Opportunities beyond startups
Is it just me or has the world gone mad for startups and writing software? Don’t get me wrong, I am a big fan of startups and all that they bring to the economy. However, if you read the business … Continue reading

Email works too well
Everyone who regularly feels overwhelmed by their email would agree that there is a problem.  The hundreds of articles about the issue typically make the same assumption and are wrong. Writer after writer bemoans email as inefficient and an obstacle … Continue reading

The Internet was a mistake, now let’s fix it
Each generation over the last century has seen new technologies that become so embedded in their lives that its absence would be unimaginable. Early in the 20th century it was radio, which quickly become the entertainment of choice, then television, … Continue reading




© 2010-2018 Robert Hillard