DLT release 2023.03

January 24 - 31, 2023

These features and improvements were released with the 2023.03 release of DLT.

Databricks Runtime versions used by this release

Channel:

  • CURRENT (default): Databricks Runtime 11.0.12
  • PREVIEW: Databricks Runtime 11.3.3

New features and improvements in this release

  • You can now use files in a Databricks repo in your pipelines to import code from a source file stored in a repo. See Configure a DLT pipeline.

  • You can now store your code as a Python package in an Azure Databricks repo and import that code in your DLT notebook.

  • The DLT UI is enhanced to include a label specifying the table type for each table in your pipeline DAG.

Bug fixes in this release

  • This release fixes a bug where the Permissions button was hidden during rendering of the DLT UI. With this change, the Permissions button is displayed but is disabled until the UI completes loading.

  • This release fixes a bug causing maintenance tasks to fail when DLT starts a new pipeline update while the maintenance task is running.

  • This release fixes an issue where applying a filter to a DLT view might lead to out-of-memory errors or long GC pauses.