Azure Data Factory Databricks Integration 2025

Databricks Job Activity (Recommended 2025)

CRITICAL UPDATE (2025): The Databricks Job activity is now the ONLY recommended method for orchestrating Databricks in ADF. Microsoft strongly recommends migrating from legacy Notebook, Python, and JAR activities.

Quick Reference

• Activity type: DatabricksJob (NOT DatabricksSparkJob or DatabricksNotebook)
• Parameter property: jobParameters (NOT parameters)
• Linked service auth: Managed Identity ("authentication": "MSI") recommended
• Cluster config: Do NOT specify cluster properties in linked service; the Databricks Job controls compute

Why Databricks Job Activity?