Metadata-driven pipeline orchestration pattern on Databricks — dynamic DAG from a Delta control table, Jobs API v2.2, Unity Catalog, Lakeflow. Deployable via Databricks Asset Bundle.
orchestration data-engineering banking databricks metadata-driven jobs-api unity-catalog databricks-asset-bundle lakeflow adf-migration
-
Updated
Apr 17, 2026 - Python