Fundamentals of Data Engineering

Reis and Housley describe the data engineering lifecycle, which runs from generation through ingestion, storage, transformation and serving, with governance, security and architecture cutting across all of it. The book is deliberately tool agnostic, so it explains the trade offs between batch and streaming, between different storage abstractions, and between building and buying, rather than teaching a particular vendor's stack. There are chapters on source systems, on queries and data modelling, and on serving data for analytics, machine learning and operational use. It closes with material on security, privacy and where the field appears to be heading. Written for people entering data engineering and for the product and analytics people who depend on them.