[
https://issues.apache.org/jira/browse/TEZ-3403?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Ashish Kumar updated TEZ-3403:
------------------------------
Description:
Hi,
I'm experiencing few failures with TEZ regarding Hive partitions. Even though
there is no partition column used in the query still it is giving partition
file path not found error.
Hive version 1.2
Tez version 0.7
Format: ORC
*Error:*
DAG did not succeed due to VERTEX_FAILURE. failedVertices:1 killedVertices:4
FAILED: Execution Error, return code 2 from
org.apache.hadoop.hive.ql.exec.tez.TezTask. Vertex failed, vertexName=Map 1,
vertexId=vertex_1470240409111_2339_1_06, diagnostics=[Vertex
vertex_1470240409111_2339_1_06 [Map 1] killed/failed due
to:ROOT_INPUT_INIT_FAILURE, Vertex Input: app_sessions initializer failed,
vertex=vertex_1470240409111_2339_1_06 [Map 1], java.io.FileNotFoundException:
No such file or directory:
s3n://<bucket>/warehouse/<table>/year=2015/month=02/day=14/hour=03
at
org.apache.hadoop.fs.s3a.S3AFileSystem.getFileStatus(S3AFileSystem.java:1078)
at org.apache.hadoop.fs.s3a.S3AFileSystem.listStatus(S3AFileSystem.java:783)
at org.apache.hadoop.fs.FileSystem.listStatus(FileSystem.java:1500)
at org.apache.hadoop.fs.FileSystem.listStatus(FileSystem.java:1540)
at org.apache.hadoop.fs.FileSystem$4.(FileSystem.java:1704)
at org.apache.hadoop.fs.FileSystem.listLocatedStatus(FileSystem.java:1703)
at
org.apache.hadoop.mapred.InputPathProcessor.perPathComputation(InputPathProcessor.java:235)
at
org.apache.hadoop.mapred.InputPathProcessor.access$000(InputPathProcessor.java:28)
at
org.apache.hadoop.mapred.InputPathProcessor$2.run(InputPathProcessor.java:338)
at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)
at java.util.concurrent.FutureTask.run(FutureTask.java:266)
at
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)
at
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
at java.lang.Thread.run(Thread.java:745)
was:
Hi,
I'm experiencing few failures with TEZ regarding Hive partitions. Even though
there is no partition column used in the query still it is giving partition
file path not found error.
*Error:*
DAG did not succeed due to VERTEX_FAILURE. failedVertices:1 killedVertices:4
FAILED: Execution Error, return code 2 from
org.apache.hadoop.hive.ql.exec.tez.TezTask. Vertex failed, vertexName=Map 1,
vertexId=vertex_1470240409111_2339_1_06, diagnostics=[Vertex
vertex_1470240409111_2339_1_06 [Map 1] killed/failed due
to:ROOT_INPUT_INIT_FAILURE, Vertex Input: app_sessions initializer failed,
vertex=vertex_1470240409111_2339_1_06 [Map 1], java.io.FileNotFoundException:
No such file or directory:
s3n://<bucket>/warehouse/<table>/year=2015/month=02/day=14/hour=03
at
org.apache.hadoop.fs.s3a.S3AFileSystem.getFileStatus(S3AFileSystem.java:1078)
at org.apache.hadoop.fs.s3a.S3AFileSystem.listStatus(S3AFileSystem.java:783)
at org.apache.hadoop.fs.FileSystem.listStatus(FileSystem.java:1500)
at org.apache.hadoop.fs.FileSystem.listStatus(FileSystem.java:1540)
at org.apache.hadoop.fs.FileSystem$4.(FileSystem.java:1704)
at org.apache.hadoop.fs.FileSystem.listLocatedStatus(FileSystem.java:1703)
at
org.apache.hadoop.mapred.InputPathProcessor.perPathComputation(InputPathProcessor.java:235)
at
org.apache.hadoop.mapred.InputPathProcessor.access$000(InputPathProcessor.java:28)
at
org.apache.hadoop.mapred.InputPathProcessor$2.run(InputPathProcessor.java:338)
at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)
at java.util.concurrent.FutureTask.run(FutureTask.java:266)
at
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)
at
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
at java.lang.Thread.run(Thread.java:745)
> Empty partition issue with Hive on TEZ
> --------------------------------------
>
> Key: TEZ-3403
> URL: https://issues.apache.org/jira/browse/TEZ-3403
> Project: Apache Tez
> Issue Type: Bug
> Reporter: Ashish Kumar
>
> Hi,
> I'm experiencing few failures with TEZ regarding Hive partitions. Even though
> there is no partition column used in the query still it is giving partition
> file path not found error.
> Hive version 1.2
> Tez version 0.7
> Format: ORC
> *Error:*
> DAG did not succeed due to VERTEX_FAILURE. failedVertices:1 killedVertices:4
> FAILED: Execution Error, return code 2 from
> org.apache.hadoop.hive.ql.exec.tez.TezTask. Vertex failed, vertexName=Map 1,
> vertexId=vertex_1470240409111_2339_1_06, diagnostics=[Vertex
> vertex_1470240409111_2339_1_06 [Map 1] killed/failed due
> to:ROOT_INPUT_INIT_FAILURE, Vertex Input: app_sessions initializer failed,
> vertex=vertex_1470240409111_2339_1_06 [Map 1], java.io.FileNotFoundException:
> No such file or directory:
> s3n://<bucket>/warehouse/<table>/year=2015/month=02/day=14/hour=03
> at
> org.apache.hadoop.fs.s3a.S3AFileSystem.getFileStatus(S3AFileSystem.java:1078)
> at org.apache.hadoop.fs.s3a.S3AFileSystem.listStatus(S3AFileSystem.java:783)
> at org.apache.hadoop.fs.FileSystem.listStatus(FileSystem.java:1500)
> at org.apache.hadoop.fs.FileSystem.listStatus(FileSystem.java:1540)
> at org.apache.hadoop.fs.FileSystem$4.(FileSystem.java:1704)
> at org.apache.hadoop.fs.FileSystem.listLocatedStatus(FileSystem.java:1703)
> at
> org.apache.hadoop.mapred.InputPathProcessor.perPathComputation(InputPathProcessor.java:235)
>
> at
> org.apache.hadoop.mapred.InputPathProcessor.access$000(InputPathProcessor.java:28)
>
> at
> org.apache.hadoop.mapred.InputPathProcessor$2.run(InputPathProcessor.java:338)
>
> at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)
> at java.util.concurrent.FutureTask.run(FutureTask.java:266)
> at
> java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)
>
> at
> java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
>
> at java.lang.Thread.run(Thread.java:745)
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
