WITH
clause when creating an Iceberg source, sink, or connection.
S3-compatible storage
These parameters configure the connection to an S3-compatible storage system, such as AWS S3 or MinIO, where your Iceberg data files are stored.Parameter | Description |
---|---|
warehouse.path | Required. The base path to your Iceberg warehouse. Example: 's3://my-bucket/iceberg-warehouse' |
s3.region | Required. The AWS region where the bucket is hosted. |
s3.access.key | Required. The AWS access key ID. |
s3.secret.key | Required. The AWS secret access key. |
s3.endpoint | Optional. The endpoint for S3-compatible services like MinIO. For AWS S3, this is typically not needed. |
s3.path.style.access | Optional. Set to true to use path-style access (e.g., for MinIO). Defaults to false for virtual-hosted–style access. |
Google Cloud Storage (GCS)
These parameters configure the connection to Google Cloud Storage.Support for GCS was added in RisingWave v2.3.0.
Parameter | Description |
---|---|
warehouse.path | Required. The GCS path to your warehouse. Example: 'gs://my-bucket/iceberg-warehouse' |
gcs.credential | Optional. The Base64-encoded credential key from a GCS service account JSON file. If not provided, Application Default Credentials (ADC) will be used. |
Example
Azure Blob Storage
These parameters configure the connection to Azure Blob Storage.Support for Azure Blob Storage was added in RisingWave v2.4.0.
Parameter | Description |
---|---|
warehouse.path | Required. The Azure Blob Storage path. Example: 'azblob://container-name/warehouse' |
azblob.account_name | Required. The Azure Storage account name. |
azblob.account_key | Required. The Azure Storage account key. |
azblob.endpoint_url | Optional. The endpoint URL for the Azure Blob service. Defaults to https://<account_name>.blob.core.windows.net/ . |
Example