Hi everyone,
I am trying to setup Drill and connect it to Azure BLOB storage (WASB). I have
been following these blog posts on how to set it up:
https://blogs.msdn.microsoft.com/data_otaku/2016/05/30/configuration-of-azure-blob-storage-aka-wasb-as-a-drill-data-source/
<https://blogs.msdn.microsoft.com/data_otaku/2016/05/30/configuration-of-azure-blob-storage-aka-wasb-as-a-drill-data-source/>
The main difference in my case is that I used version 5.3 for the azure-storage
plugin, as it’s the most recent.
When I try to run a query like this (the file exists in the container, and
“my_account” is replaced by my actual storage account):
select * from my_account.root.`test.txt`;
It fails with the error:
org.apache.drill.common.exceptions.UserRemoteException: VALIDATION ERROR: From
line 1, column 15 to line 1, column 29: Table 'my_account.root.test.txt' not
found SQL Query null [Error Id: xxxx on xxxx:31010]
And if I run this:
show tables in my_account;
It just says “no results”
I followed the instructions in the post for the storage plugin configuration,
which in short means that I copied the “dfs” config, replacing the connection
by this:
"connection": "wasb://my_container@my_account.blob.core.windows.net/“
And in the “core-site.xml” config, I added the access key for the account:
<property>
<name>fs.azure.account.key.my_account.blob.core.windows.net</name>
<value>my-access-key</value>
</property>
Is there something I’m missing?
Thanks a lot for your help!
Kind regards,
Albert