According to a 2005 Deloitte Consulting survey, nearly 80 percent of respondents reported problems with the accuracy, timeliness, and availability of information for management decision making. Through the use of the Enterprise Common Data Framework we will significantly improve the quality of common data elements in the Enterprise.
Within the Enterprise Data toolset agencies will have access to a data profiling tool, which will allow us to document the quality of the data in a system via appropriate ratings criteria. Gartner reports that agencies that measure data quality are three times more likely to report higher data quality over a three-year period.
The Data Warehousing Institute (TDWI) estimates that poor quality customer data costs U.S. businesses a staggering $611 billion a year in postage, printing and staff overhead. COT’s Office of Application Development Data Integration Branch will offer a service to agencies to evaluate the quality of their data. They will be able to use this service to identify redundant data records (e.g., Bill Smith, William Smith, and Mr. W. Smith) as well as to evaluate the accuracy of the data input or, no less importantly, not input by staff (e.g., phone number ‘999-999-9999’). These profiling efforts will be essential to the success of large enterprise legacy system replacements or upgrades and related data conversion projects, reducing source data analysis time by up to 70% over manual analysis. During initial data profiling efforts, COT staff will work with agency Data Stewards and staff to explain data monitoring as a long-term function versus a quick-win task. Agencies will also be able to acquire licenses to the product to allow their own staff to perform data profiling.
Organization that have not been paying attention to data quality – can expect to recoup 15% of operating profit if bad data is greatly reduced or eliminated. COT’s Office of Application Development Data Integration Branch is currently evaluating tools which will be used to perform actual data cleansing and standardize data. Once a tool is available the service will be offered to other agencies as a companion to the data profiling service. These tools will also be essential to the success of enterprise legacy system replacements, upgrades and data conversion projects.Documentation on Data Profiling and Conversion procedures and best practices can be found at http://gotsource.ky.gov/docushare/dsweb/View/Collection-37234.