Overview
In the last decade, incredible improvements have been made on the data collection side that helps the processing pipeline. However, various datasets are managed and maintained by several organizations in disconnected systems. This causes some information about the data to be lost during this transition, and people doing the cleaning have no control over the collection. The solutions to data cleaning challenges that arise demand varying degrees of personnel hours, which in some cases could be avoided through automation.
Do you have feedback on this resource?
Thank you for your feedback as we strive to curate and publish resources to help social impact organizations succeed with data.
Explore More
Related Guides & Resources
Overview The principles of data quality management are a set of fundamental beliefs, standards, rules, and values that are accepted as true and can be used as a foundation for guiding an organization’s data quality management. This guide details seven principles for businesses to follow to maintain quality data across…
Overview Unfortunately, real-life data collection is often messy and disorganized. There might be surveys collected in different formats, or have various nuances from several collectors. The situation becomes even worse when the project involves collation and aggregation of already existing data sources, where there is no complete knowledge of the methodology,…
Overview As data proliferates, organizations are seeing the need to develop a practice of data governance. Effective data governance leads to better data analytics, which in turn leads to better decision-making and improved operations support. It also helps to avoid data inconsistencies or errors in data, which lead to integrity…