MEAPSA

Run Azure Databricks Notebooks with Azure Data Factory

Using pipelines in Azure Data Factory to run notebooks in Azure Databricks enables you to automate data engineering processes at cloud scale.

Data Engineer

Data Factory

Databricks

Module Objectives

In this module, you'll learn how to:

Describe how Azure Databricks notebooks can be run in a pipeline.
Create an Azure Data Factory linked service for Azure Databricks.
Use a Notebook activity in a pipeline.
Pass parameters to a notebook.

Units

Introduction min
Understand Azure Databricks notebooks and pipelines min
Create a linked service for Azure Databricks min
Use a Notebook activity in a pipeline min
Use parameters in a notebook min
Exercise - Run an Azure Databricks Notebook with Azure Data Factory min
Knowledge check min
Summary min

Prerequisites

Before starting this module, you should have a basic knowledge of Azure Databricks. Consider completing the Explore Azure Databricks module before this one.