January 2023

Article
10/14/2024

These features and Azure Databricks platform improvements were released in January 2023.

Note

The release date and content listed below only corresponds to actual deployment of the Azure Public Cloud in most case.

It provide the evolution history of Azure Databricks service on Azure Public Cloud for your reference that may not be suitable for Azure operated by 21Vianet.

Note

Releases are staged. Your Azure Databricks account may not be updated until a week or more after the initial release date.

Enable private connectivity with Azure Private Link (GA)

January 31, 2023

Azure Databricks supports enabling Azure Private Link connections for private connectivity between users and their Azure Databricks workspaces, and also between clusters on the compute plane and the core services on the control plane within the Azure Databricks workspace infrastructure. This feature is now generally available. See Enable Azure Private Link back-end and front-end connections.

Account SCIM is now GA

January 31, 2023

The Account SCIM API is now generally available.

Account SCIM lets you use an identity provider (IdP) to create users in an Azure Databricks account, give users the proper level of access, and remove access (deprovision users) when they leave your organization or no longer need access to Azure Databricks.

You can use a SCIM provisioning connector in your IdP or invoke the SCIM APIs to manage provisioning. For more information, see Sync users and groups from Microsoft Entra ID.

Easier creation and editing of Azure Databricks jobs in the UI

January 30, 2023

The Azure Databricks Jobs user interface now shows a view of your entire job when you add or make changes to job tasks. This unified view simplifies job creation and editing by allowing you to see the full details of your job as you make changes. See Schedule and orchestrate workflows.

Improvements to the Azure Databricks Jobs UI when viewing job runs

January 30, 2023

The Azure Databricks Jobs user interface now shows the job runs matrix and the job runs list in a single panel, improving your visibility into the status and details of your job runs. Previously, viewing the runs matrix or the runs list required switching between the two views. See View runs for a job.

New account console home screen provides better account management experience

January 26, 2023

Admins can use the new account console home screen to better navigate between Databricks products.

Databricks Terraform provider updated to version 1.9.1

January 25, 2023

Version 1.9.1 adds max_clusters_per_user to databricks_cluster_policy, support for cluster_mount_infos in databricks_cluster, a parent attribute to databricks_sql_query and databricks_sql_dashboard, and more. For more details, see the changelog for version 1.9.1.

Account users can update email preferences in the account console

January 23, 2023

You can now update instructional product and feature email preferences in your Azure Databricks account console. For more information, see Manage email preferences.

Region support consolidated onto one page

January 20, 2023

A new supported regions article consolidates all information about supported regions, including:

Region-specific feature support
IP addresses, domains, and endpoints for allow lists and custom network configurations

Databricks Runtime 12.1 and Databricks Runtime 12.1 ML are GA

January 19, 2023

Databricks Runtime 12.1 and Databricks Runtime 12.1 ML are now generally available.

See Databricks Runtime 12.1 (EoS) and Databricks Runtime 12.1 for Machine Learning (EoS).

Cluster policies now support limiting the max number of clusters per user

January 18, 2023

You can now use cluster policies to restrict the number of clusters a user can create. For more information, see restrict the number of clusters per user.

Databricks Terraform provider updated to version 1.9.0

January 17, 2023

Version 1.9.0 includes fixes to the databricks_sql_endpoint and databricks_sql_permissions resources, makes several documentation improvements, and more. For more details, see the changelog for version 1.9.0.

Databricks Terraform provider updated to version 1.8.0

January 10, 2023

Version 1.8.0 includes new resources such as databricks_instance_pool, databricks_provider for Delta Sharing, and databricks_permission_assignment. Several existing resources are improved. For more details, see the changelog for version 1.8.0.

Databricks Runtime 12.1 (Beta)

January 9, 2023

Databricks Runtime 12.1 and Databricks Runtime 12.1 ML are now available as Beta releases.