I always recommend that one of the early processes you should introduce in your Data Governance initiative is a Data Quality Issue Resolution process. For reference, about a year ago I wrote column titled What Do You Include in a Data Quality Issue Log?
I have been asked on numerous occasions, recently, to clarify what the Data Governance (or Data Quality) Team are responsible for doing when managing and resolving data quality issues. This often gets particularly asked by newly formed teams.
There seems to be a lot of confusion around who does what and I have often come across the expectation that the Data Governance Team will do or solve everything. There are times when I truly wish that I had a magic wand and could simply fix all the data problems but sadly that isn’t the case. Over time, of course your Data Governance Team will develop knowledge and expertise about the data your organisation creates and uses, but they are not responsible for deciding what the remedial actions should be and especially not for undertaking any manual data cleansing that may be required.
However, I am not saying that they have no part to play in the process. The best way to understand what the Data Governance Team are responsible for is to look at a high level simple data quality issue resolution process:
Raise Data Quality Issue
It will usually be a Data Consumer (business user of that data) who spots an issue and will be the ones to notify the Data Governance Team.
The Data Governance Team will then log the issue on the Data Quality Issue log and identify the data owner(s) of the data concerned.
The Data Governance Team notifies the Data Owner of the issue, who will advise whether or not they are the correct owner of the issue.
In addition, the Data Governance Team reports the current status of all open material data quality issues to the Data Governance Committee (usually as part of their regular agenda).
The Data Governance Committee reviews the open material data quality issues and prioritizes/directs on the remedial activities if needed.
Impact Assess and Root Cause Analysis
The business user who notified the issue, the Data Governance Team, and the Data Owner(s) assess and agree about the impact of the issue. If the issue is agreed to have a material impact its resolution will be prioritised.
The Data Governance Team works with the Data Owner(s) to identify the cause of the issue.
The Data Owner(s) consider possible remedial actions to rectify the issue.
Remedial Action Plan
The Data Owner(s) proposes an approach to resolve the issue and prevent it from re-occurring.
The business user who raised the issue agrees whether the proposed action plan is appropriate (the Data Governance Team can facilitate discussions between the parties if needed).
The Data Governance Team updates the Data Quality Issue Log with the agreed actions and target dates.
The Data Owner(s) plans how and when the remedial activities will take place.
Monitor and Report on Action Plans
The Data Owner(s) and their team(s) undertake the agreed remedial actions (N.B. this may need the support of IT).
The Data Governance Team monitors progress on remedial actions against agreed target dates and reports on progress to both the impacted business user(s) and the Data Governance Committee.
The impacted business user(s) advise if timescales for resolution are not appropriate.
The Data Governance Committee then reviews progress and prioritizes/directs on the remedial activities if needed.
Of course, in practice, solving data quality issues takes more than the four steps listed above, but the additional steps will be sub-sets of the stages discussed above. In addition, keeping it simple like this will help your stakeholders quickly understand who is responsible for what.
As with all things Data Governance, communication is key. I would recommend creating a simple high-level diagram of your data quality issue resolution process and using that in your communications to help people not only understand the process but also everyone’s role in it.
The Data Governance Team’s role in the data quality issue resolution process can be summarized as followed:
- Identifying which Data Owner is responsible for the data which needs fixing and liaising with them
- Maintaining the Data Quality Issue Log
- Monitoring and reporting on open issues and associated action plans
I hope that has clarified the situation for you and remember you can find out more about what to include in a Data Quality Issue log here or download a free template for an issue log here.
