Data Engineering Design Patterns Recipes for Solving the Most Common Data Engineering Problems

Author Bartosz Konieczny guides you through the process of building reliable end-to-end data engineering projects, from data ingestion to data observability, focusing on data engineering design patterns that solve common business problems in a secure and storage-optimized manner. Each pattern includes a user-facing description of the problem, solutions, and consequences that place the pattern into the context of real-life scenarios.
Throughout this journey, you'll use open source data tools and public cloud services to apply each pattern.
You'll learn:
* Challenges data engineers face and their impact on data systems
* How these challenges relate to data system components
* Useful applications of data engineering patterns
* How to identify and fix issues with your current data components
* TTechnology-agnostic solutions to new and existing data projects, with open source implementation examples
Bartosz Konieczny is a freelance data engineer who's been coding since 2010. He's held various senior hands-on positions that allowed him to work on many data engineering problems in batch and stream processing.