Nj-kol commented on issue #57980: URL: https://github.com/apache/doris/issues/57980#issuecomment-3640813285
> [@Nj-kol](https://github.com/Nj-kol) I just stood up a disagragated storage cluster using azure blob and had to make a few changes. > > Your provider needs to be AZURE seems the case matters > > The docs say this > > ``` > CREATE STORAGE VAULT IF NOT EXISTS azure_demo_vault > PROPERTIES ( > "type" = "S3", -- required > "s3.endpoint" = "blob.core.windows.net", -- required > "s3.access_key" = "xxxxxx", -- required, Your Azure AccountName > "s3.secret_key" = "xxxxxx", -- required, Your Azure AccountKey > "s3.region" = "us-east-1", -- required > "s3.root.path" = "azure_demo_vault_prefix", -- required > "s3.bucket" = "xxxxxx", -- required, Your Azure StorageAccount > "provider" = "AZURE" -- required > ); > ``` > > My example looks like this, the major change was that you MUST put the storage account name in the endpoint > > ``` > CREATE STORAGE VAULT IF NOT EXISTS azure_vault > PROPERTIES ( > "type" = "S3", > "s3.endpoint" = "${STORAGE_ACCOUNT}.blob.core.windows.net", > "s3.access_key" = "${STORAGE_ACCOUNT}", > "s3.secret_key" = "${AZURE_STORAGE_ACCOUNT_KEY}", > "s3.region" = "us-east-1", > "s3.bucket" = "${AZURE_CONTAINER}", > "s3.root.path" = "doris-${PROFILE}-${REGION}", > "provider" = "AZURE" > ); > ``` > > These are the definitions of my variables > > ``` > STORAGE_ACCOUNT = dorisstoragebucket > AZURE_STORAGE_ACCOUNT_KEY = xxxxxxxxxxxxxx > AZURE_CONTAINER = blob_container > PROFILE = dev, qa, prod, etc > REGION = eastus, eastus2, etc > ``` > > AZURE_STORAGE_ACCOUNT_KEY is the secret in the vault mounted with eso PROFILE and REGION are specific to my deployment these can be what ever. > > I also had to set specific configuration to make this work in fe and be, i set it in ms just to be safe. Without the below setting configured the fe and be both balked trying to connect to the _wrong_ endpoints or the the http endpoints. > > ``` > force_azure_blob_global_endpoint = true > ``` > > Also based on this > > ``` > F20251118 10:19:04.645164 209 s3_util.cpp:255] BE is not compiled with azure support, export BUILD_AZURE=ON before building > ``` > > I would bet you are running on ARM, i was not able to make this run on ARM using azure blob, you will need to use x86. Hi @plastikman thank you so much for your detailed reply on this. I had got this working fortuntelty from this blog - https://ai.feishu.cn/docx/ULT8dYXKtoP1MrxSeNwcEYgVn0d I just wish the official doc had this level of clarity. For me, it has worked even without `force_azure_blob_global_endpoint=true`. Also, for doris 4.x, I struggled to make it work and ultimatelty downgraded to 3.x -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected] --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
