Hi, Stack Trace: https://paste.ubuntu.com/p/nFvygSpcjy/ Yes DataNode port is opening and accessible and any firewall problem is impossible because the Drill was established on the same nodes with Cloudera cluster. I consider there is no problem with authentication. Because I can list the hdfs folder clearly as below: [image: image.png] [image: image.png]
*Via Terminal (Note: I have used the same kerberos user that I set within Drill's jaas.conf folder. );* [image: image.png] Thank you. BR. luoc <[email protected]>, 26 Şub 2021 Cum, 17:58 tarihinde şunu yazdı: > Hi, > The storage config is correct. then enabled the Kerberos security. So, > please check the java stack trace to ensure not the authentication problem. > Is it possible to use dfs client connect the HDFS for reading the csv > file? > The DataNode port is opening and accessible? > > > 2021年2月26日 下午9:52,Mehmet - <[email protected]> 写道: > > > > Hi, > > > > 1. Drill version: 1.18.0 > > 2. HDFS Version: Hadoop 3.0-cdh6.3.3 > > 3. Storage config: https://paste.ubuntu.com/p/5Dk9jVCxYr/ > > 4. drill-env.sh file: https://paste.ubuntu.com/p/MGNG4zhbrk/ > > > > Thank you. > > BR. > > > > luoc <[email protected]>, 26 Şub 2021 Cum, 16:14 tarihinde şunu yazdı: > > > >> Hi, > >> That does not seem like an issues with Drill. > >> Would you please provides more helpful information : > >> 1. Drill version > >> 2. HDFS version > >> 3. Storage config > >> > >>> 2021年2月26日 下午3:32,Mehmet - <[email protected]> 写道: > >>> > >>> Hi Team, > >>> > >>> I have a problem with Hdfs query on Drill. When I run a "SHOW FILES in > >>> root.`tmp/` ", I can list the files correctly. > >>> Bu when I run a select query like "Select * from root.`tmp/` it throws > >>> below error. > >>> Notes: > >>> - I have already checked the state of hdfs health(via dfsadmin and hdfs > >> ui) > >>> and there is no any corruption or block error. > >>> - Drillbits are on the same cluster with Hadoop. So I think any network > >>> problem is impossible. > >>> - I have also set dfs.client.use.datanode.hostname as true ( > >>> https://stackoverflow.com/a/55290406/7894534 ) > >>> > >>> org.apache.drill.common.exceptions.UserRemoteException: DATA_READ > ERROR: > >>> Could not obtain block: BP-2026912985-<namenode_ip>- > >>> 1569935018133:blk_1073842201_101390 file=/tmp/2015-summary.csv > >>> File Path: hdfs://<drillbit_ip>:8020/tmp/2015-summary.csv > >>> Fragment: 0:0 [Error Id: 466835bd-6512-4854-b231-eaa439eba6f2 on > >>> <drillbit_ip>:31010] > >>> > >>> Thank you. > >>> -- > >>> Mehmet ERSOY > >> > >> > > > > -- > > Mehmet ERSOY > > -- Mehmet ERSOY
