Output
Databricks Output
Writes the rows that reach it into an existing Databricks (Delta) table, and passes them on unchanged.
When to use it
Use it to land cleaned files or app extracts in the lakehouse for analysts and notebooks.
In a pipeline
File InputType ConversionDatabricks Output
Settings
| Setting | Type | Required | Default or hint |
|---|---|---|---|
| Connection | select | Yes | Add a connection below |
| Target Table | select | Yes | Select a table |
| Write Mode | select | — | append |
| Key columns | select | — | Columns that identify a row |
Example
Land a partner file in bronze
- Target Table=bronze.partner_orders
- Write Mode=Append rows
| order_id | total |
|---|---|
| 5001 | 120 |
| 5002 | 89.5 |
| order_id | total |
|---|---|
| 5001 | 120 |
| 5002 | 89.5 |
Worth knowing
- Rows go into the columns whose names match, in multi-row INSERT statements.
- Upsert is a MERGE on the Key columns: matching rows are updated, the others inserted.
- Delta commits each statement on its own: Replace (DELETE, then INSERT) is not one transaction there.
- Previews never write.