Databricks Unity Catalog

Connect RisingWave to Databricks Unity Catalog for Apache Iceberg.

You can sink data from RisingWave directly to a Databricks-managed Iceberg table using Unity Catalog. RisingWave acts as a streaming ETL engine, writing data directly into your Unity Catalog.

For a complete guide on configuring the full integration, see Integrate with Databricks.

For a complete list of all catalog-related parameters, see the main Catalog configuration page.

Example

vended_credentials is added in v2.7.0. For more information, see Vended credentials.

Databricks Unity Catalog integration is intended for Databricks-managed external Iceberg tables. In RisingWave, this catalog is documented for writing via CREATE SINK (currently append-only only).

CREATE SINK databricks_uc_sink FROM my_source
WITH (
  connector = 'iceberg',
  type = 'append-only',
  force_append_only = 'true',

  warehouse.path = '<your-uc-catalog-name>',
  database.name = '<your-schema-name>',
  create_table_if_not_exists = 'true',
  table.name = '<your-table-name>',

  catalog.type = 'rest',
  vended_credentials = true,
  catalog.uri = 'https://<workspace-url>/api/2.1/unity-catalog/iceberg-rest',
  catalog.oauth2_server_uri = 'https://<workspace-url>/oidc/v1/token',
  catalog.credential = '<oauth_client_id>:<oauth_client_secret>',
  catalog.scope = 'all-apis',

  s3.region = 'ap-southeast-1'
);

Unity Catalog integration does not support CREATE CONNECTION (internal Iceberg tables) or CREATE SOURCE in this doc.