Sink data from RisingWave to Azure Blob

This guide describes how to sink data from RisingWave to Azure Blob storage using the Azblob connector in RisingWave.

Azure Blob Storage is Microsoft’s object storage solution that allows you to store and manage massive amounts of unstructured data.

Syntax

CREATE SINK [ IF NOT EXISTS ] sink_name
[FROM sink_from | AS select_query]
WITH (
   connector='azblob',
   connector_parameter = 'value', ...
);

Parameters

Parameter names	Description
azblob.container_name	Required. The name of the Azure Blob Storage container.
azblob.path	Required. The directory where the sink file is located.
azblob.credentials.account_name	Optional. The Azure Storage account name for authentication.
azblob.credentials.account_key	Optional. The access key for the Azure Storage account.
azblob.endpoint_url	Required. The URL endpoint for the Azure Blob Storage service.
type	Required. Defines the type of the sink. Options include append-only or upsert.

Example

CREATE SINK azblob_sink AS SELECT v1
FROM t
WITH (
    connector='azblob',
    azblob.path = 'test_sink/',
    azblob.container_name = '<container_name>',
    azblob.credentials.account_name = '<account_name>',
    azblob.credentials.account_key = '<account_key>',
    azblob.endpoint_url = '<endpoint_url>',
    type = 'append-only',
)FORMAT PLAIN ENCODE PARQUET(force_append_only=true);

Advanced topics

For more information about encode Parquet or JSON, see Sink data in parquet or json format.

For more information about batching strategy, see Batching strategy for file sink.