Discover · databricks.com

No picture published by databricks.com

Unit testing for pipelines (Beta)

docs.databricks.com databricks.com

This is what was read here when it was published. databricks.com no longer carries it in what it publishes now.

You can now write and run Python unit tests for your Spark Declarative Pipelines on Lakeflow transformation logic directly in the Lakeflow Pipelines Editor. Validate Python and SQL transformations against mock data using catalog-table redirection, including Auto CDC, streaming tables, expectations, and append flows. Test edge cases and iterate using mock inputs for supported table-identifier operations; review the isolation limitations before running tests. This feature is in Beta.

More ways to use this
Open on another device
Scan this QR code to open the same public page

Scan to open this page. Your saved notes and account access are not included.

Download QR code

Open the page link

Keep going

Each of these is read from what this estate already kept: the feed a piece came through, the publisher behind it, the credits and topics the publisher printed. None of it is a recommendation, an identity or a record kept anywhere else.

Also from docs.databricks.com

  1. Genie Code analysis for alerts is in Betadatabricks.com
  2. MCP tools in Genie Agents are generally availabledatabricks.com
  3. Lakebase now available in three additional regionsdatabricks.com
  4. Warehouse-level statement timeouts are now generally availabledatabricks.com
  5. OAuth authentication for webhook destinations will soon be available by default for workspaces with the compliance security profile enableddatabricks.com
  6. The Databricks GitHub app will request permission to create and manage pull requestsdatabricks.com