Cleaning Data for Effective Data Science

Cleaning Data for Effective Data Science
Author :
Publisher : Packt Publishing Ltd
Total Pages : 499
Release :
ISBN-10 : 9781801074407
ISBN-13 : 1801074402
Rating : 4/5 (402 Downloads)

Book Synopsis Cleaning Data for Effective Data Science by : David Mertz

Download or read book Cleaning Data for Effective Data Science written by David Mertz and published by Packt Publishing Ltd. This book was released on 2021-03-31 with total page 499 pages. Available in PDF, EPUB and Kindle. Book excerpt: Think about your data intelligently and ask the right questions Key FeaturesMaster data cleaning techniques necessary to perform real-world data science and machine learning tasksSpot common problems with dirty data and develop flexible solutions from first principlesTest and refine your newly acquired skills through detailed exercises at the end of each chapterBook Description Data cleaning is the all-important first step to successful data science, data analysis, and machine learning. If you work with any kind of data, this book is your go-to resource, arming you with the insights and heuristics experienced data scientists had to learn the hard way. In a light-hearted and engaging exploration of different tools, techniques, and datasets real and fictitious, Python veteran David Mertz teaches you the ins and outs of data preparation and the essential questions you should be asking of every piece of data you work with. Using a mixture of Python, R, and common command-line tools, Cleaning Data for Effective Data Science follows the data cleaning pipeline from start to end, focusing on helping you understand the principles underlying each step of the process. You'll look at data ingestion of a vast range of tabular, hierarchical, and other data formats, impute missing values, detect unreliable data and statistical anomalies, and generate synthetic features. The long-form exercises at the end of each chapter let you get hands-on with the skills you've acquired along the way, also providing a valuable resource for academic courses. What you will learnIngest and work with common data formats like JSON, CSV, SQL and NoSQL databases, PDF, and binary serialized data structuresUnderstand how and why we use tools such as pandas, SciPy, scikit-learn, Tidyverse, and BashApply useful rules and heuristics for assessing data quality and detecting bias, like Benford’s law and the 68-95-99.7 ruleIdentify and handle unreliable data and outliers, examining z-score and other statistical propertiesImpute sensible values into missing data and use sampling to fix imbalancesUse dimensionality reduction, quantization, one-hot encoding, and other feature engineering techniques to draw out patterns in your dataWork carefully with time series data, performing de-trending and interpolationWho this book is for This book is designed to benefit software developers, data scientists, aspiring data scientists, teachers, and students who work with data. If you want to improve your rigor in data hygiene or are looking for a refresher, this book is for you. Basic familiarity with statistics, general concepts in machine learning, knowledge of a programming language (Python or R), and some exposure to data science are helpful.

Cleaning Data for Effective Data Science Related Books

Cleaning Data for Effective Data Science
Language: en
Pages: 499
Authors: David Mertz
Categories: Mathematics
Type: BOOK - Published: 2021-03-31 - Publisher: Packt Publishing Ltd

GET EBOOK

Think about your data intelligently and ask the right questions Key FeaturesMaster data cleaning techniques necessary to perform real-world data science and mac
Cleaning Data for Effective Data Science
Language: en
Pages: 498
Authors: David Mertz
Categories:
Type: BOOK - Published: 2021-03-31 - Publisher: Packt Publishing

GET EBOOK

A comprehensive guide for data scientists to master effective data cleaning tools and techniques Key Features: Master data cleaning techniques in a language-agn
Data Cleaning
Language: en
Pages: 284
Authors: Ihab F. Ilyas
Categories: Computers
Type: BOOK - Published: 2019-06-18 - Publisher: Morgan & Claypool

GET EBOOK

This is an overview of the end-to-end data cleaning process. Data quality is one of the most important problems in data management, since dirty data often leads
Effective Data Science Infrastructure
Language: en
Pages: 350
Authors: Ville Tuulos
Categories: Computers
Type: BOOK - Published: 2022-08-16 - Publisher: Simon and Schuster

GET EBOOK

Effective Data Science Infrastructure: How to make data scientists more productive is a hands-on guide to assembling infrastructure for data science and machine
Development Research in Practice
Language: en
Pages: 388
Authors: Kristoffer Bjärkefur
Categories: Business & Economics
Type: BOOK - Published: 2021-07-16 - Publisher: World Bank Publications

GET EBOOK

Development Research in Practice leads the reader through a complete empirical research project, providing links to continuously updated resources on the DIME W