Search the site
Subscribe to Data Quality Pro

 via email            RSS Feed

external resources
« Do you struggle to create a compelling introduction to your DQ proposition? Learn how to tell stories that will boost your DQ opportunities. | Main | Data Quality Rules by Arkady Maydanchik - Tutorial 1 of 4: Attribute Domain Constraints »
Tuesday
Sep092008

How to create an online data quality management repository (in less than an hour)

As the scale of your DQ projects increase it becomes ever more important to manage project information in an effective manner. We show you how to scrap those Excel spreadsheets and build a web-based app to manage all your DQ project information.

Why do we need a data quality project repository?


Data quality projects create a lot of information and the ability to manage this as a business resource is increasingly important.

Risks, tasks, issues, defects, data quality rules, project costs, stakeholder details, data dictionaries, data schemas, design specifications, user questionnaires – the sheer volume of data quality project metadata can, rather ironically, create your very own data quality dilemma.

Spreadsheets and documents typically form the backbone for storing project information but have several disadvantages:

  • They become out of date and can spread uncontrolled
  • Multiple people cannot work on them simultaneously
  • Searching for data across all the files can prove difficult
  • No integrity checks to ensure key fields are populated
  • Correct workflow is hard to train and enforce

So, all the classic situations for data quality defects to arise which therefore means we need to explore a possible solution.

What are the benefits of creating a "web-based" data quality project repository?


In recent years there have been significant advances that enable organisations to store vital information relating to their projects in online repositories.

These online tools allow the various project metadata to be configured, linked, stored and retrieved by the entire project team including external partners, business users and stakeholders.

The advantages are:

  • Project data only has one “source of truth” – it therefore never gets stale
  • All project members can access the right information for their role whenever they need and security can be significantly improved
  • Searching and manipulating project data is far easier and faster
  • Data quality rules can be enforced so as to ensure project metadata integrity
  • Project workflows can be implemented so that the necessary controls, checks and balances can be enforced

What could you include in your online repository?


The simple answer is – anything you wish. However, change management is important.

People like to store information in spreadsheets and files because it is easy and comfortable. Introducing a new concept into a project (particularly after the project has started) can often lead to resistance.

To counter this I recommend that you focus on 2 or 3 key areas that will benefit a cross-section of the entire project.

Here are some examples to choose from:

  • Risk log
  • Issue log
  • Data quality rules specification
  • Data dictionary/definitions
  • Data profiling results
  • Project task assignments
  • User surveys/questionnaires
  • Project RAG report

TIP: If you want some great examples of data quality project information required for your project check out Danette McGilvray's resource page for her latest book: http://tensteps.gfalls.com/

She lists some really useful resources that you could incorporate into your online repository.

How easy is it to create a web-based management tool like this?


Simple, we built one in less than an hour that totally eliminated the need for spreadsheets in our entire DQ project.


The online tool we used to create our online DQ management app was Coghead (www.coghead.com).

This is free (for one user) and allows you to be up and running straight away, our tutorial provides all the training you will need to create a compelling solution.


Where can I find the tutorial?



Click here to download our tutorial to create your own online DQ management tool (you will need to register and be logged in to gain access).



What Next? 6 Ways to Benefit From Online DQ Web Apps


We’ve given you the basics with our free tutorial so once you're comfortable with creating your own DQ web application here are some ideas that can help you profit from the concept:


  • Do you work for a DQ consultancy? Why not create your own bespoke tool, it will help you be more productive, cut costs for the customer (and your firm), will differentiate you from the crowd and create a lasting impression with your customers meaning they're more inclined to get you in for follow-on work or referrals
  • Running an in-house DQ project? This tool will save you time and dazzle your seniors, these kind of tools typically take in-house IT departments months to build and roll-out. You can be up and running in 24 hours, how impressive is that to your new sponsors!
  • Leverage existing materials. There are a lot of resources on Data Quality Pro to help you gain ideas for what to include your DQ online repository, why not visit our DQ QuickLink resource for inspiration
  • Why not use Danett McGilvrays Templates as a starting point? As mentioned above, Danette has published an excellent book entitled “Executing Data Quality Projects: Ten Steps to Quality Data and Trusted Information”. To support many of the concepts in the book she has added Excel templates you could use in your online app. Click here for more details. If you want to buy Danette’s book (highly recommended) just  visit our online book store.
  • Why not create and sell your DQ Online Repository Tool? Coghead allows you to create, distribute and sell any online apps you create so why not build a product and sell it. We’ll even help you publicise and promote it on our community sites: Data Quality Pro and Data Migration Pro
  • Why not share your work and help create a community version we can all benefit? Use our forums and the community aspects of Data Quality Pro to find others to help you build a truly industry standard product. We will help you all the way.

Click here to download our tutorial to create your own online DQ management tool (you will need to register and be logged in to gain access).


Reader Comments (2)

Useful article. Coghead seems to have been acquired by SAP and the website is no longer functioning properly. Can you suggest alternative tools for creating a respoitory?

Jun 4, 2009 | Registered CommenterMatt Stones

Hi Matt, ironically I'm doing one right now using DabbleDB.com.

It was a crying shame when I read that SAP were asset stripping and cutting the service but there are options, not quite as effective as Coghead but still very capable product, will post details asap.

PostPost a New Comment

Enter your information below to add a new comment.

My response is on my own website »
Author Email (optional):
Author URL (optional):
Post:
 
Some HTML allowed: <a href="" title=""> <abbr title=""> <acronym title=""> <b> <blockquote cite=""> <code> <em> <i> <strike> <strong>