The Data Engineer's Guide to Apache Spark™ and Delta Lake
For data engineers looking to leverage Apache Spark™’s and Delta Lake’s immense growth to build faster and more reliable data pipelines, Databricks is happy to provide The Data Engineer’s Guide to Apache Spark and Delta Lake. This eBook features excerpts from the larger Definitive Guide to Apache Spark and the Delta Lake Quick Start.
Download this eBook to:
- Walk through the core architecture of a cluster, Spark Application, and Spark’s Structured APIs using DataFrames and SQL.
- Get a tour of Spark’s toolset that developers use for different tasks from graph analysis and machine learning to streaming and integrations with a host of libraries and databases. Cover working with different kinds of data including Booleans, Numbers, Strings, Dates and Timestamps, Handling Null, Complex Types, and User-Defined Functions.
- Learn to get more reliable and higher quality data with Delta Lake, including loading, updating, and rolling back data in your data lake