- An Azure Blob Storage account
- Azure connection string
- Container name
- A running ClickHouse Cloud service
2
Select the data source
Select Azure Blob Storage as data type
3
Setup your ClickPipe connection
- Give your ClickPipe a descriptive name
- Select Connection String from the authentication method dropdown
- Paste your Azure connection string in the field for Connection string
- Enter your container name
- Enter your Azure Blob Storage file path, using wildcards if you want to ingest multiple files
4
Select data format
- Select file type
- File compression (
detect automatically,none,gzip,brotli,xzorzstd) - Complete additional format specific configuration such as delimiter used for comma-separated formats
- Click Parse information
5
Configure table, schema and settings
Now you need to create a new table or select an existing one where the incoming data can be stored.
- Select whether to upload data to a new table or an existing table
- Select the database to use, and which name to give the table if it is a new table
- Choose a sorting key or keys
- Define any mappings from the source file to destination table for column name, column type, default value and nullability
- Finally, specify advanced settings such as the engine type you wish to use, the expression to partition by and the primary key
6
Configure permissions
ClickPipes will set up a dedicated database user for data writing.
You can select a role for this user.
For materialized views or dictionary access from the destination table, opt for “Full access”.
7
Complete setup
Click Create ClickPipe to complete setupYou should now see your ClickPipe in a provisioning status.
After a few moments it will change from provisioning to completed.