[jira] [Commented] (HIVE-11356) SMB join on tez fails when one of the tables is empty
[
https://issues.apache.org/jira/browse/HIVE-11356?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15950062#comment-15950062
]
Vaibhav Gumashta commented on HIVE-11356:
-
Removing 1.2.2 and reverting this from branch-1.2 as the test this patch adds
fails on commit itself.
> SMB join on tez fails when one of the tables is empty
> -
>
> Key: HIVE-11356
> URL: https://issues.apache.org/jira/browse/HIVE-11356
> Project: Hive
> Issue Type: Bug
>Affects Versions: 1.2.0
>Reporter: Vikram Dixit K
>Assignee: Vikram Dixit K
> Fix For: 1.3.0, 2.0.0
>
> Attachments: HIVE-11356.1.patch, HIVE-11356.3.patch,
> HIVE-11356.4.patch, HIVE-11356.5.patch, HIVE-11356.6.patch
>
>
> {code}
> :java.lang.IllegalStateException: Unexpected event. All physical sources
> already initialized
> at com.google.common.base.Preconditions.checkState(Preconditions.java:145)
> at
> org.apache.tez.mapreduce.input.MultiMRInput.handleEvents(MultiMRInput.java:142)
>
> at
> org.apache.tez.runtime.LogicalIOProcessorRuntimeTask.handleEvent(LogicalIOProcessorRuntimeTask.java:610)
>
> at
> org.apache.tez.runtime.LogicalIOProcessorRuntimeTask.access$1100(LogicalIOProcessorRuntimeTask.java:90)
>
> at
> org.apache.tez.runtime.LogicalIOProcessorRuntimeTask$1.run(LogicalIOProcessorRuntimeTask.java:673)
>
> at java.lang.Thread.run(Thread.java:745)
> ]], Vertex failed as one or more tasks failed. failedTasks:1, Vertex
> vertex_1437168420060_17787_1_01 [Map 4] killed/failed due to:null]
> Vertex killed, vertexName=Reducer 5,
> vertexId=vertex_1437168420060_17787_1_02, diagnostics=[Vertex received Kill
> while in RUNNING state., Vertex killed as other vertex failed. failedTasks:0,
> Vertex vertex_1437168420060_17787_1_02 [Reducer 5] killed/failed due to:null]
> DAG failed due to vertex failure. failedVertices:1 killedVertices:1
> FAILED: Execution Error, return code 2 from
> org.apache.hadoop.hive.ql.exec.tez.TezTask
> HQL-FAILED
> {code}
--
This message was sent by Atlassian JIRA
(v6.3.15#6346)
[jira] [Commented] (HIVE-11356) SMB join on tez fails when one of the tables is empty
[
https://issues.apache.org/jira/browse/HIVE-11356?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14978838#comment-14978838
]
Hive QA commented on HIVE-11356:
Here are the results of testing the latest attachment:
https://issues.apache.org/jira/secure/attachment/12769090/HIVE-11356.6.patch
{color:red}ERROR:{color} -1 due to build exiting with an error
Test results:
http://ec2-174-129-184-35.compute-1.amazonaws.com/jenkins/job/PreCommit-HIVE-TRUNK-Build/5830/testReport
Console output:
http://ec2-174-129-184-35.compute-1.amazonaws.com/jenkins/job/PreCommit-HIVE-TRUNK-Build/5830/console
Test logs:
http://ec2-174-129-184-35.compute-1.amazonaws.com/logs/PreCommit-HIVE-TRUNK-Build-5830/
Messages:
{noformat}
This message was trimmed, see log for full details
[INFO]
[INFO] --- maven-surefire-plugin:2.16:test (default-test) @ hive-hwi ---
[INFO] Tests are skipped.
[INFO]
[INFO] --- maven-jar-plugin:2.2:jar (default-jar) @ hive-hwi ---
[INFO] Building jar:
/data/hive-ptest/working/apache-github-source-source/hwi/target/hive-hwi-2.0.0-SNAPSHOT.jar
[INFO]
[INFO] --- maven-site-plugin:3.3:attach-descriptor (attach-descriptor) @
hive-hwi ---
[INFO]
[INFO] --- maven-install-plugin:2.4:install (default-install) @ hive-hwi ---
[INFO] Installing
/data/hive-ptest/working/apache-github-source-source/hwi/target/hive-hwi-2.0.0-SNAPSHOT.jar
to
/data/hive-ptest/working/maven/org/apache/hive/hive-hwi/2.0.0-SNAPSHOT/hive-hwi-2.0.0-SNAPSHOT.jar
[INFO] Installing
/data/hive-ptest/working/apache-github-source-source/hwi/pom.xml to
/data/hive-ptest/working/maven/org/apache/hive/hive-hwi/2.0.0-SNAPSHOT/hive-hwi-2.0.0-SNAPSHOT.pom
[INFO]
[INFO]
[INFO] Building Hive ODBC 2.0.0-SNAPSHOT
[INFO]
[INFO]
[INFO] --- maven-clean-plugin:2.5:clean (default-clean) @ hive-odbc ---
[INFO] Deleting /data/hive-ptest/working/apache-github-source-source/odbc/target
[INFO] Deleting /data/hive-ptest/working/apache-github-source-source/odbc
(includes = [datanucleus.log, derby.log], excludes = [])
[INFO]
[INFO] --- maven-enforcer-plugin:1.3.1:enforce (enforce-no-snapshots) @
hive-odbc ---
[INFO]
[INFO] --- maven-remote-resources-plugin:1.5:process (default) @ hive-odbc ---
[WARNING] Invalid project model for artifact
[pentaho-aggdesigner-algorithm:org.pentaho:5.1.5-jhyde]. It will be ignored by
the remote resources Mojo.
[INFO]
[INFO] --- maven-antrun-plugin:1.7:run (define-classpath) @ hive-odbc ---
[INFO] Executing tasks
main:
[INFO] Executed tasks
[INFO]
[INFO] --- maven-antrun-plugin:1.7:run (setup-test-dirs) @ hive-odbc ---
[INFO] Executing tasks
main:
[mkdir] Created dir:
/data/hive-ptest/working/apache-github-source-source/odbc/target/tmp
[mkdir] Created dir:
/data/hive-ptest/working/apache-github-source-source/odbc/target/warehouse
[mkdir] Created dir:
/data/hive-ptest/working/apache-github-source-source/odbc/target/tmp/conf
[copy] Copying 14 files to
/data/hive-ptest/working/apache-github-source-source/odbc/target/tmp/conf
[INFO] Executed tasks
[INFO]
[INFO] --- maven-site-plugin:3.3:attach-descriptor (attach-descriptor) @
hive-odbc ---
[INFO]
[INFO] --- maven-install-plugin:2.4:install (default-install) @ hive-odbc ---
[INFO] Installing
/data/hive-ptest/working/apache-github-source-source/odbc/pom.xml to
/data/hive-ptest/working/maven/org/apache/hive/hive-odbc/2.0.0-SNAPSHOT/hive-odbc-2.0.0-SNAPSHOT.pom
[INFO]
[INFO]
[INFO] Building Hive Shims Aggregator 2.0.0-SNAPSHOT
[INFO]
[INFO]
[INFO] --- maven-clean-plugin:2.5:clean (default-clean) @ hive-shims-aggregator
---
[INFO] Deleting
/data/hive-ptest/working/apache-github-source-source/shims/target
[INFO] Deleting /data/hive-ptest/working/apache-github-source-source/shims
(includes = [datanucleus.log, derby.log], excludes = [])
[INFO]
[INFO] --- maven-enforcer-plugin:1.3.1:enforce (enforce-no-snapshots) @
hive-shims-aggregator ---
[INFO]
[INFO] --- maven-remote-resources-plugin:1.5:process (default) @
hive-shims-aggregator ---
[INFO]
[INFO] --- maven-antrun-plugin:1.7:run (define-classpath) @
hive-shims-aggregator ---
[INFO] Executing tasks
main:
[INFO] Executed tasks
[INFO]
[INFO] --- maven-antrun-plugin:1.7:run (setup-test-dirs) @
hive-shims-aggregator ---
[INFO] Executing tasks
main:
[mkdir] Created dir:
/data/hive-ptest/working/apache-github-source-source/shims/target/tmp
[mkdir] Created dir:
/data/hive-ptest/working/apache-github-source-source/shims/target/warehouse
[mkdir] Created dir:
[jira] [Commented] (HIVE-11356) SMB join on tez fails when one of the tables is empty
[
https://issues.apache.org/jira/browse/HIVE-11356?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14662916#comment-14662916
]
Hive QA commented on HIVE-11356:
{color:red}Overall{color}: -1 at least one tests failed
Here are the results of testing the latest attachment:
https://issues.apache.org/jira/secure/attachment/12749325/HIVE-11356.5.patch
{color:red}ERROR:{color} -1 due to 1 failed/errored test(s), 9345 tests executed
*Failed tests:*
{noformat}
org.apache.hadoop.hive.cli.TestMiniTezCliDriver.testCliDriver_tez_smb_empty
{noformat}
Test results:
http://ec2-174-129-184-35.compute-1.amazonaws.com/jenkins/job/PreCommit-HIVE-TRUNK-Build/4871/testReport
Console output:
http://ec2-174-129-184-35.compute-1.amazonaws.com/jenkins/job/PreCommit-HIVE-TRUNK-Build/4871/console
Test logs:
http://ec2-174-129-184-35.compute-1.amazonaws.com/logs/PreCommit-HIVE-TRUNK-Build-4871/
Messages:
{noformat}
Executing org.apache.hive.ptest.execution.PrepPhase
Executing org.apache.hive.ptest.execution.ExecutionPhase
Executing org.apache.hive.ptest.execution.ReportingPhase
Tests exited with: TestsFailedException: 1 tests failed
{noformat}
This message is automatically generated.
ATTACHMENT ID: 12749325 - PreCommit-HIVE-TRUNK-Build
SMB join on tez fails when one of the tables is empty
-
Key: HIVE-11356
URL: https://issues.apache.org/jira/browse/HIVE-11356
Project: Hive
Issue Type: Bug
Affects Versions: 1.2.0
Reporter: Vikram Dixit K
Assignee: Vikram Dixit K
Attachments: HIVE-11356.1.patch, HIVE-11356.3.patch,
HIVE-11356.4.patch, HIVE-11356.5.patch
{code}
:java.lang.IllegalStateException: Unexpected event. All physical sources
already initialized
at com.google.common.base.Preconditions.checkState(Preconditions.java:145)
at
org.apache.tez.mapreduce.input.MultiMRInput.handleEvents(MultiMRInput.java:142)
at
org.apache.tez.runtime.LogicalIOProcessorRuntimeTask.handleEvent(LogicalIOProcessorRuntimeTask.java:610)
at
org.apache.tez.runtime.LogicalIOProcessorRuntimeTask.access$1100(LogicalIOProcessorRuntimeTask.java:90)
at
org.apache.tez.runtime.LogicalIOProcessorRuntimeTask$1.run(LogicalIOProcessorRuntimeTask.java:673)
at java.lang.Thread.run(Thread.java:745)
]], Vertex failed as one or more tasks failed. failedTasks:1, Vertex
vertex_1437168420060_17787_1_01 [Map 4] killed/failed due to:null]
Vertex killed, vertexName=Reducer 5,
vertexId=vertex_1437168420060_17787_1_02, diagnostics=[Vertex received Kill
while in RUNNING state., Vertex killed as other vertex failed. failedTasks:0,
Vertex vertex_1437168420060_17787_1_02 [Reducer 5] killed/failed due to:null]
DAG failed due to vertex failure. failedVertices:1 killedVertices:1
FAILED: Execution Error, return code 2 from
org.apache.hadoop.hive.ql.exec.tez.TezTask
HQL-FAILED
{code}
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
[jira] [Commented] (HIVE-11356) SMB join on tez fails when one of the tables is empty
[
https://issues.apache.org/jira/browse/HIVE-11356?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14661241#comment-14661241
]
Vikram Dixit K commented on HIVE-11356:
---
[~jdere] review please.
SMB join on tez fails when one of the tables is empty
-
Key: HIVE-11356
URL: https://issues.apache.org/jira/browse/HIVE-11356
Project: Hive
Issue Type: Bug
Affects Versions: 1.2.0
Reporter: Vikram Dixit K
Assignee: Vikram Dixit K
Attachments: HIVE-11356.1.patch, HIVE-11356.3.patch
{code}
:java.lang.IllegalStateException: Unexpected event. All physical sources
already initialized
at com.google.common.base.Preconditions.checkState(Preconditions.java:145)
at
org.apache.tez.mapreduce.input.MultiMRInput.handleEvents(MultiMRInput.java:142)
at
org.apache.tez.runtime.LogicalIOProcessorRuntimeTask.handleEvent(LogicalIOProcessorRuntimeTask.java:610)
at
org.apache.tez.runtime.LogicalIOProcessorRuntimeTask.access$1100(LogicalIOProcessorRuntimeTask.java:90)
at
org.apache.tez.runtime.LogicalIOProcessorRuntimeTask$1.run(LogicalIOProcessorRuntimeTask.java:673)
at java.lang.Thread.run(Thread.java:745)
]], Vertex failed as one or more tasks failed. failedTasks:1, Vertex
vertex_1437168420060_17787_1_01 [Map 4] killed/failed due to:null]
Vertex killed, vertexName=Reducer 5,
vertexId=vertex_1437168420060_17787_1_02, diagnostics=[Vertex received Kill
while in RUNNING state., Vertex killed as other vertex failed. failedTasks:0,
Vertex vertex_1437168420060_17787_1_02 [Reducer 5] killed/failed due to:null]
DAG failed due to vertex failure. failedVertices:1 killedVertices:1
FAILED: Execution Error, return code 2 from
org.apache.hadoop.hive.ql.exec.tez.TezTask
HQL-FAILED
{code}
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
[jira] [Commented] (HIVE-11356) SMB join on tez fails when one of the tables is empty
[
https://issues.apache.org/jira/browse/HIVE-11356?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14643511#comment-14643511
]
Gunther Hagleitner commented on HIVE-11356:
---
LGTM +1. Can we add a q file test to it?
SMB join on tez fails when one of the tables is empty
-
Key: HIVE-11356
URL: https://issues.apache.org/jira/browse/HIVE-11356
Project: Hive
Issue Type: Bug
Affects Versions: 1.2.0
Reporter: Vikram Dixit K
Assignee: Vikram Dixit K
Attachments: HIVE-11356.1.patch
{code}
:java.lang.IllegalStateException: Unexpected event. All physical sources
already initialized
at com.google.common.base.Preconditions.checkState(Preconditions.java:145)
at
org.apache.tez.mapreduce.input.MultiMRInput.handleEvents(MultiMRInput.java:142)
at
org.apache.tez.runtime.LogicalIOProcessorRuntimeTask.handleEvent(LogicalIOProcessorRuntimeTask.java:610)
at
org.apache.tez.runtime.LogicalIOProcessorRuntimeTask.access$1100(LogicalIOProcessorRuntimeTask.java:90)
at
org.apache.tez.runtime.LogicalIOProcessorRuntimeTask$1.run(LogicalIOProcessorRuntimeTask.java:673)
at java.lang.Thread.run(Thread.java:745)
]], Vertex failed as one or more tasks failed. failedTasks:1, Vertex
vertex_1437168420060_17787_1_01 [Map 4] killed/failed due to:null]
Vertex killed, vertexName=Reducer 5,
vertexId=vertex_1437168420060_17787_1_02, diagnostics=[Vertex received Kill
while in RUNNING state., Vertex killed as other vertex failed. failedTasks:0,
Vertex vertex_1437168420060_17787_1_02 [Reducer 5] killed/failed due to:null]
DAG failed due to vertex failure. failedVertices:1 killedVertices:1
FAILED: Execution Error, return code 2 from
org.apache.hadoop.hive.ql.exec.tez.TezTask
HQL-FAILED
{code}
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
[jira] [Commented] (HIVE-11356) SMB join on tez fails when one of the tables is empty
[
https://issues.apache.org/jira/browse/HIVE-11356?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14640795#comment-14640795
]
Hive QA commented on HIVE-11356:
{color:red}Overall{color}: -1 at least one tests failed
Here are the results of testing the latest attachment:
https://issues.apache.org/jira/secure/attachment/12746849/HIVE-11356.1.patch
{color:red}ERROR:{color} -1 due to 2 failed/errored test(s), 9229 tests executed
*Failed tests:*
{noformat}
TestContribCliDriver - did not produce a TEST-*.xml file
org.apache.hive.hcatalog.hbase.TestPigHBaseStorageHandler.org.apache.hive.hcatalog.hbase.TestPigHBaseStorageHandler
{noformat}
Test results:
http://ec2-174-129-184-35.compute-1.amazonaws.com/jenkins/job/PreCommit-HIVE-TRUNK-Build/4707/testReport
Console output:
http://ec2-174-129-184-35.compute-1.amazonaws.com/jenkins/job/PreCommit-HIVE-TRUNK-Build/4707/console
Test logs:
http://ec2-174-129-184-35.compute-1.amazonaws.com/logs/PreCommit-HIVE-TRUNK-Build-4707/
Messages:
{noformat}
Executing org.apache.hive.ptest.execution.PrepPhase
Executing org.apache.hive.ptest.execution.ExecutionPhase
Executing org.apache.hive.ptest.execution.ReportingPhase
Tests exited with: TestsFailedException: 2 tests failed
{noformat}
This message is automatically generated.
ATTACHMENT ID: 12746849 - PreCommit-HIVE-TRUNK-Build
SMB join on tez fails when one of the tables is empty
-
Key: HIVE-11356
URL: https://issues.apache.org/jira/browse/HIVE-11356
Project: Hive
Issue Type: Bug
Affects Versions: 1.2.0
Reporter: Vikram Dixit K
Assignee: Vikram Dixit K
Attachments: HIVE-11356.1.patch
{code}
:java.lang.IllegalStateException: Unexpected event. All physical sources
already initialized
at com.google.common.base.Preconditions.checkState(Preconditions.java:145)
at
org.apache.tez.mapreduce.input.MultiMRInput.handleEvents(MultiMRInput.java:142)
at
org.apache.tez.runtime.LogicalIOProcessorRuntimeTask.handleEvent(LogicalIOProcessorRuntimeTask.java:610)
at
org.apache.tez.runtime.LogicalIOProcessorRuntimeTask.access$1100(LogicalIOProcessorRuntimeTask.java:90)
at
org.apache.tez.runtime.LogicalIOProcessorRuntimeTask$1.run(LogicalIOProcessorRuntimeTask.java:673)
at java.lang.Thread.run(Thread.java:745)
]], Vertex failed as one or more tasks failed. failedTasks:1, Vertex
vertex_1437168420060_17787_1_01 [Map 4] killed/failed due to:null]
Vertex killed, vertexName=Reducer 5,
vertexId=vertex_1437168420060_17787_1_02, diagnostics=[Vertex received Kill
while in RUNNING state., Vertex killed as other vertex failed. failedTasks:0,
Vertex vertex_1437168420060_17787_1_02 [Reducer 5] killed/failed due to:null]
DAG failed due to vertex failure. failedVertices:1 killedVertices:1
FAILED: Execution Error, return code 2 from
org.apache.hadoop.hive.ql.exec.tez.TezTask
HQL-FAILED
{code}
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
