Azure Databricks

Single Sign-On with Azure Active Directory is the best way to sign in to Azure Databricks. Azure Databricks also supports automated user provisioning with Azure AD to create new users, give them the proper level of access, and remove users to deprovision access.

The Azure Databricks native connector to ADLS supports multiple methods of access to your data lake.  Simplify data access security by using the same Azure AD identity that you use to log into Azure Databricks with Azure Active Directory Credential Passthrough.  Your data access is controlled via the ADLS roles and Access Control Lists you have already set up.

Seamlessly run Azure Databricks jobs using Azure Data Factory and leverage 90+ built-in data source connectors to ingest all of your data sources into a single data lake. ADF provides built-in workflow control, data transformation, pipeline scheduling, data integration, and many more capabilities to help you create reliable data pipelines.

Azure Databricks integrates with Microsoft Azure Machine Learning (AML) via MLflow to centrally track ML experiments and deploy models to Azure containers for on-demand inferencing.  Azure Databricks can also use AML’s automated machine learning capabilities through the AML SDK.

Azure Databricks integrates with Azure services to bring analytics, business intelligence (BI), and data science together in Microsoft’s build web and mobile applications.  The high-performance connector between Azure Databricks and Azure Synapse enables fast data transfer between the services, including support for streaming data.

One of the key features customers look for when adopting a Lakehouse strategy is the ability to efficiently and securely consume data directly from the data lake with BI tools. This typically reduces the additional latency, compute, and storage costs associated with the traditional flow of copying data already stored in a data lake to a data warehouse for BI consumption. The Azure Databricks connector in Power BI makes for a more secure, more interactive data visualization experience for data stored in your data lake.

Azure Databricks connects with Azure DevOps to help enable Continuous Integration and Continuous Deployment (CI/CD). Configure Azure DevOps as your Git provider and take advantage of the integrated version control features.

The default deployment of Azure Databricks is a fully managed service on Azure that includes a virtual network (VNet).  Azure Databricks also supports deployment in your own virtual network (sometimes called VNet injection) that enables full control of network security rules.

Get insights from live streaming data by connecting Azure Event Hubs to Azure Databricks, then process messages as they arrive. With Event Hubs and Azure Databricks, stream millions of events per second from any IoT device, or logs from website clickstreams, and process it in near-real time.

Manage your secrets such as keys and passwords with integration to Azure Key Vault. By default, all Azure Databricks notebooks and results are encrypted at rest with a different encryption key. If you want to own and manage the key used for encrypting your notebooks and results yourself, you can bring your own key (BYOK).