Object storage configuration

Configure the object storage backend (such as AWS S3, GCS, or Azure Blob Storage) for your Iceberg warehouse.

This guide provides the configuration parameters for connecting RisingWave to the object storage backend for your Apache Iceberg data. These parameters are used in the WITH clause when creating an Iceberg source, sink, or connection.

S3-compatible storage

These parameters configure the connection to an S3-compatible storage system, such as AWS S3 or MinIO, where your Iceberg data files are stored.

Parameter	Description
warehouse.path	Required. The base path to your Iceberg warehouse. Example: 's3://my-bucket/iceberg-warehouse'
s3.region	Required. The AWS region where the bucket is hosted.
s3.access.key	Conditional. The AWS access key ID.
s3.secret.key	Conditional. The AWS secret access key.
s3.endpoint	Optional. The endpoint for S3-compatible services like MinIO. For AWS S3, this is typically not needed.
s3.path.style.access	Optional. Set to true to use path-style access (e.g., for MinIO). Defaults to false for virtual-hosted–style access.

In RisingWave Cloud, AWS credentials (s3.access.key, s3.secret.key) are required and cannot be omitted. In self-hosted deployments, you may omit them to rely on the AWS SDK default credential chain (for example, EC2 instance profile or environment variables).

Google Cloud Storage (GCS)

These parameters configure the connection to Google Cloud Storage.

Support for GCS was added in RisingWave v2.3.0.

Parameter	Description
warehouse.path	Required. The GCS path to your warehouse. Example: 'gs://my-bucket/iceberg-warehouse'
gcs.credential	Optional. The Base64-encoded credential key from a GCS service account JSON file. If not provided, Application Default Credentials (ADC) will be used.

Example

CREATE SINK my_iceberg_sink FROM my_mv WITH (
    connector = 'iceberg',
    type = 'append-only',
    catalog.type = 'rest',
    catalog.uri = 'http://127.0.0.1:8181',
    warehouse.path = 'gs://my-bucket/warehouse',
    gcs.credential = '...'
);

Azure Blob Storage

These parameters configure the connection to Azure Blob Storage.

Support for Azure Blob Storage was added in RisingWave v2.4.0.

Parameter	Description
warehouse.path	Required. The Azure Blob Storage path. Example: 'azblob://container-name/warehouse'
azblob.account_name	Required. The Azure Storage account name.
azblob.account_key	Required. The Azure Storage account key.
azblob.endpoint_url	Optional. The endpoint URL for the Azure Blob service. Defaults to https://<account_name>.blob.core.windows.net/.

Example

CREATE SINK my_iceberg_sink FROM my_mv WITH (
    connector = 'iceberg',
    type = 'append-only',
    catalog.type = 'storage',
    warehouse.path = 'azblob://my-container/warehouse',
    azblob.account_name = 'myaccount',
    azblob.account_key = '...'
);