[
https://issues.apache.org/jira/browse/HIVE-27029?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Mahesh Raju Somalaraju updated HIVE-27029:
------------------------------------------
Description:
Caused by: java.io.IOException: Filesystem closed
at org.apache.hadoop.hdfs.DFSClient.checkOpen(DFSClient.java:483)
~[hadoop-hdfs-client-3.1.1.7.1.8.11-3.jar:?]
at org.apache.hadoop.hdfs.DFSClient.getEZForPath(DFSClient.java:2771)
~[hadoop-hdfs-client-3.1.1.7.1.8.11-3.jar:?]
at
org.apache.hadoop.hdfs.DistributedFileSystem$54.doCall(DistributedFileSystem.java:2796)
~[hadoop-hdfs-client-3.1.1.7.1.8.11-3.jar:?]
at
org.apache.hadoop.hdfs.DistributedFileSystem$54.doCall(DistributedFileSystem.java:2793)
~[hadoop-hdfs-client-3.1.1.7.1.8.11-3.jar:?]
at
org.apache.hadoop.fs.FileSystemLinkResolver.resolve(FileSystemLinkResolver.java:81)
~[hadoop-common-3.1.1.7.1.8.11-3.jar:?]
at
org.apache.hadoop.hdfs.DistributedFileSystem.getEZForPath(DistributedFileSystem.java:2812)
~[hadoop-hdfs-client-3.1.1.7.1.8.11-3.jar:?]
at
org.apache.hadoop.hdfs.client.HdfsAdmin.getEncryptionZoneForPath(HdfsAdmin.java:374)
~[hadoop-hdfs-client-3.1.1.7.1.8.11-3.jar:?]
at
org.apache.hadoop.hive.shims.Hadoop23Shims$HdfsEncryptionShim.getEncryptionZoneForPath(Hadoop23Shims.java:1384)
~[hive-exec-3.1.3000.7.1.8.11-3.jar:3.1.3000.7.1.8.11-3]
at
org.apache.hadoop.hive.shims.Hadoop23Shims$HdfsEncryptionShim.isPathEncrypted(Hadoop23Shims.java:1379)
~[hive-exec-3.1.3000.7.1.8.11-3.jar:3.1.3000.7.1.8.11-3]
at
org.apache.hadoop.hive.ql.parse.SemanticAnalyzer.isPathEncrypted(SemanticAnalyzer.java:2484)
~[hive-exec-3.1.3000.7.1.8.11-3.jar:3.1.3000.7.1.8.11-3]
was:
Caused by: java.io.IOException: Filesystem closed
at org.apache.hadoop.hdfs.DFSClient.checkOpen(DFSClient.java:483)
~[hadoop-hdfs-client-3.1.1.7.1.8.11-3.jar:?]
at org.apache.hadoop.hdfs.DFSClient.getEZForPath(DFSClient.java:2771)
~[hadoop-hdfs-client-3.1.1.7.1.8.11-3.jar:?]
at
org.apache.hadoop.hdfs.DistributedFileSystem$54.doCall(DistributedFileSystem.java:2796)
~[hadoop-hdfs-client-3.1.1.7.1.8.11-3.jar:?]
at
org.apache.hadoop.hdfs.DistributedFileSystem$54.doCall(DistributedFileSystem.java:2793)
~[hadoop-hdfs-client-3.1.1.7.1.8.11-3.jar:?]
at
org.apache.hadoop.fs.FileSystemLinkResolver.resolve(FileSystemLinkResolver.java:81)
~[hadoop-common-3.1.1.7.1.8.11-3.jar:?]
at
org.apache.hadoop.hdfs.DistributedFileSystem.getEZForPath(DistributedFileSystem.java:2812)
~[hadoop-hdfs-client-3.1.1.7.1.8.11-3.jar:?]
at
org.apache.hadoop.hdfs.client.HdfsAdmin.getEncryptionZoneForPath(HdfsAdmin.java:374)
~[hadoop-hdfs-client-3.1.1.7.1.8.11-3.jar:?]
at
org.apache.hadoop.hive.shims.Hadoop23Shims$HdfsEncryptionShim.getEncryptionZoneForPath(Hadoop23Shims.java:1384)
~[hive-exec-3.1.3000.7.1.8.11-3.jar:3.1.3000.7.1.8.11-3]
at
org.apache.hadoop.hive.shims.Hadoop23Shims$HdfsEncryptionShim.isPathEncrypted(Hadoop23Shims.java:1379)
~[hive-exec-3.1.3000.7.1.8.11-3.jar:3.1.3000.7.1.8.11-3]
at
org.apache.hadoop.hive.ql.parse.SemanticAnalyzer.isPathEncrypted(SemanticAnalyzer.java:2484)
~[hive-exec-3.1.3000.7.1.8.11-3.jar:3.1.3000.7.1.8.11-3]
steps:
1. When using explicit queue name the tez.queue.access is used. If statistics
gathering is enabled the second insert fails at the compute_stats() phase.
beeline --hiveconf tez.queue.name=default -e "
SET hive.query.results.cache.enabled=false;
SET hive.fetch.task.conversion=none;
SET hive.stats.autogather=true;
drop table if exists default.bigd35368p100;
create table default.bigd35368p100 (name string) partitioned by ( id int);
insert into default.bigd35368p100 select * from default.bigd35368e100;
drop table if exists default.bigd35368p100;
create table default.bigd35368p100 (name string) partitioned by ( id int);
insert into default.bigd35368p100 select * from default.bigd35368e100;
"
> hive query fails with Filesystem closed error
> ---------------------------------------------
>
> Key: HIVE-27029
> URL: https://issues.apache.org/jira/browse/HIVE-27029
> Project: Hive
> Issue Type: Bug
> Reporter: Mahesh Raju Somalaraju
> Assignee: Mahesh Raju Somalaraju
> Priority: Major
>
> Caused by: java.io.IOException: Filesystem closed
> at org.apache.hadoop.hdfs.DFSClient.checkOpen(DFSClient.java:483)
> ~[hadoop-hdfs-client-3.1.1.7.1.8.11-3.jar:?]
> at org.apache.hadoop.hdfs.DFSClient.getEZForPath(DFSClient.java:2771)
> ~[hadoop-hdfs-client-3.1.1.7.1.8.11-3.jar:?]
> at
> org.apache.hadoop.hdfs.DistributedFileSystem$54.doCall(DistributedFileSystem.java:2796)
> ~[hadoop-hdfs-client-3.1.1.7.1.8.11-3.jar:?]
> at
> org.apache.hadoop.hdfs.DistributedFileSystem$54.doCall(DistributedFileSystem.java:2793)
> ~[hadoop-hdfs-client-3.1.1.7.1.8.11-3.jar:?]
> at
> org.apache.hadoop.fs.FileSystemLinkResolver.resolve(FileSystemLinkResolver.java:81)
> ~[hadoop-common-3.1.1.7.1.8.11-3.jar:?]
> at
> org.apache.hadoop.hdfs.DistributedFileSystem.getEZForPath(DistributedFileSystem.java:2812)
> ~[hadoop-hdfs-client-3.1.1.7.1.8.11-3.jar:?]
> at
> org.apache.hadoop.hdfs.client.HdfsAdmin.getEncryptionZoneForPath(HdfsAdmin.java:374)
> ~[hadoop-hdfs-client-3.1.1.7.1.8.11-3.jar:?]
> at
> org.apache.hadoop.hive.shims.Hadoop23Shims$HdfsEncryptionShim.getEncryptionZoneForPath(Hadoop23Shims.java:1384)
> ~[hive-exec-3.1.3000.7.1.8.11-3.jar:3.1.3000.7.1.8.11-3]
> at
> org.apache.hadoop.hive.shims.Hadoop23Shims$HdfsEncryptionShim.isPathEncrypted(Hadoop23Shims.java:1379)
> ~[hive-exec-3.1.3000.7.1.8.11-3.jar:3.1.3000.7.1.8.11-3]
> at
> org.apache.hadoop.hive.ql.parse.SemanticAnalyzer.isPathEncrypted(SemanticAnalyzer.java:2484)
> ~[hive-exec-3.1.3000.7.1.8.11-3.jar:3.1.3000.7.1.8.11-3]
>
>
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
