Skip to main content

Apache Spark™ Programming with Databricks

In this course, you will explore the fundamentals of Apache Spark and Delta Lake on Databricks. You will learn the architectural components of Spark, the DataFrame and Structured Streaming APIs, and how Delta Lake can improve your data pipelines. Lastly, you will execute streaming queries to process streaming data and understand the advantages of using Delta Lake.

   
Skill Level
Associate
Duration
12h
Prerequisites
  • Familiarity with Python and basic programming concepts, including data types, lists, dictionaries, variables, functions, loops, conditional statements, exception handling, accessing classes, and using third-party libraries
  • Basic knowledge of SQL, including writing queries using SELECT, WHERE, GROUP BY, ORDER BY, LIMIT, and JOIN

Outline

Day 1

  • Spark overview
  • Databricks platform overview
  • SparkSQL
  • DataFrame reader, writer, transformation, and aggregation
  • Datetimes
  • Complex types


Day 2

  • User-defined functions (UDFs) and vectorized UDFs
  • Spark internals
  • Query optimization
  • Partitioning
  • Streaming API
  • Delta Lake

Upcoming Public Classes

Date
Time
Language
Price
Apr 21 - 24
11 AM - 03 PM (Asia/Singapore)
English
$1500.00
Apr 21 - 24
02 PM - 06 PM (America/New_York)
English
$1500.00
May 01 - 02
09 AM - 05 PM (Australia/Sydney)
English
$1500.00
May 01 - 02
09 AM - 05 PM (Europe/Paris)
English
$1500.00
May 05 - 08
02 PM - 06 PM (America/New_York)
English
$1500.00
May 14 - 15
09 AM - 05 PM (Asia/Tokyo)
Japanese
$1500.00
May 26 - 29
11 AM - 03 PM (Asia/Singapore)
English
$1500.00
May 26 - 29
02 PM - 06 PM (Europe/Paris)
English
$1500.00
May 26 - 27
09 AM - 05 PM (America/Los_Angeles)
English
$1500.00
Jun 02 - 03
09 AM - 05 PM (Europe/Paris)
English
$1500.00
Jun 02 - 03
09 AM - 05 PM (America/Los_Angeles)
English
$1500.00
Jun 03 - 04
09 AM - 05 PM (Australia/Sydney)
English
$1500.00
Jun 23 - 26
02 PM - 06 PM (Europe/Paris)
English
$1500.00
Jun 23 - 26
02 PM - 06 PM (America/New_York)
English
$1500.00
Jul 01 - 02
09 AM - 05 PM (Europe/Paris)
English
$1500.00
Jul 01 - 02
09 AM - 05 PM (America/Los_Angeles)
English
$1500.00
Jul 07 - 08
09 AM - 05 PM (Asia/Tokyo)
Japanese
$1500.00
Jul 10 - 11
09 AM - 05 PM (Australia/Sydney)
English
$1500.00
Jul 21 - 24
11 AM - 03 PM (Asia/Singapore)
English
$1500.00
Jul 28 - 31
02 PM - 06 PM (Europe/Paris)
English
$1500.00
Jul 28 - 31
02 PM - 06 PM (America/New_York)
English
$1500.00

Public Class Registration

If your company has purchased success credits or has a learning subscription, please fill out the Training Request form. Otherwise, you can register below.

Private Class Request

If your company is interested in private training, please submit a request.

See all our registration options

Registration options

Databricks has a delivery method for wherever you are on your learning journey

Runtime

Self-Paced

Custom-fit learning paths for data, analytics, and AI roles and career paths through on-demand videos

Register now

Instructors

Instructor-Led

Public and private courses taught by expert instructors across half-day to two-day courses

Register now

Learning

Blended Learning

Self-paced and weekly instructor-led sessions for every style of learner to optimize course completion and knowledge retention. Go to Subscriptions Catalog tab to purchase

Purchase now

Scale

Skills@Scale

Comprehensive training offering for large scale customers that includes learning elements for every style of learning. Inquire with your account executive for details

Upcoming Public Classes

Data Engineer

Automated Deployment with Databricks Asset Bundles

This course provides a comprehensive review of DevOps principles and their application to Databricks projects. It begins with an overview of core DevOps, DataOps, continuous integration (CI), continuous deployment (CD), and testing, and explores how these principles can be applied to data engineering pipelines.

The course then focuses on continuous deployment within the CI/CD process, examining tools like the Databricks REST API, SDK, and CLI for project deployment. You will learn about Databricks Asset Bundles (DABs) and how they fit into the CI/CD process. You’ll dive into their key components, folder structure, and how they streamline deployment across various target environments in Databricks. You will also learn how to add variables, modify, validate, deploy, and execute Databricks Asset Bundles for multiple environments with different configurations using the Databricks CLI.

Finally, the course introduces Visual Studio Code as an Interactive Development Environment (IDE) for building, testing, and deploying Databricks Asset Bundles locally, optimizing your development process. The course concludes with an introduction to automating deployment pipelines using GitHub Actions to enhance the CI/CD workflow with Databricks Asset Bundles.

By the end of this course, you will be equipped to automate Databricks project deployments with Databricks Asset Bundles, improving efficiency through DevOps practices.

Paid
4h
Lab
instructor-led
Professional

Questions?

If you have any questions, please refer to our Frequently Asked Questions page.