Please note: In order to keep Hive up to date and provide users with the best features, we are no longer able to fully support Internet Explorer. The site is still available to you, however some sections of the site may appear broken. We would encourage you to move to a more modern browser like Firefox, Edge or Chrome in order to experience the site fully.

Data Cleaning, PDF eBook

Data Cleaning PDF

Part of the Synthesis Lectures on Data Management series

PDF

Please note: eBooks can only be purchased with a UK issued credit card and all our eBooks (ePub and PDF) are DRM protected.

Description

Data warehouses consolidate various activities of a business and often form the backbone for generating reports that support important business decisions.

Errors in data tend to creep in for a variety of reasons.

Some of these reasons include errors during input data collection and errors while merging data collected independently across different databases.

These errors in data warehouses often result in erroneous upstream reports, and could impact business decisions negatively.

Therefore, one of the critical challenges while maintaining large data warehouses is that of ensuring the quality of data in the data warehouse remains high.

The process of maintaining high data quality is commonly referred to as data cleaning.

In this book, we first discuss the goals of data cleaning.

Often, the goals of data cleaning are not well defined and could mean different solutions in different scenarios.

Toward clarifying these goals, we abstract out a common set of data cleaning tasks that often need to be addressed.

This abstraction allows us to develop solutions for these common data cleaning tasks.

We then discuss a few popular approaches for developing such solutions.

In particular, we focus on an operator-centric approach for developing a data cleaning platform.

The operator-centric approach involves the development of customizable operators that could be used as building blocks for developing common solutions.

This is similar to the approach of relational algebra for query processing.

The basic set of operators can be put together to build complex queries.

Finally, we discuss the development of custom scripts which leverage the basic data cleaning operators along with relational operators to implement effective solutions for data cleaning tasks.

Information

Other Formats

Information

Also in the Synthesis Lectures on Data Management series