[jira] [Commented] (HIVE-8614) Upgrade hive to use tez version 0.5.2-SNAPSHOT
[ https://issues.apache.org/jira/browse/HIVE-8614?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14312442#comment-14312442 ] Thejas M Nair commented on HIVE-8614: - bq. Hive should not depend on SNAPSHOT releases. I agree. This was an oversight in 0.14 release. HIVE-8933 has added a check in build to detect this. Upgrade hive to use tez version 0.5.2-SNAPSHOT -- Key: HIVE-8614 URL: https://issues.apache.org/jira/browse/HIVE-8614 Project: Hive Issue Type: Bug Affects Versions: 0.14.0 Reporter: Vikram Dixit K Assignee: Vikram Dixit K Priority: Critical Fix For: 0.14.0 Attachments: HIVE-8614.1.patch, HIVE-8614.2.patch, HIVE-8614.3.patch, HIVE-8614.4.patch -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Commented] (HIVE-8614) Upgrade hive to use tez version 0.5.2-SNAPSHOT
[ https://issues.apache.org/jira/browse/HIVE-8614?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14312431#comment-14312431 ] Edward Capriolo commented on HIVE-8614: --- This is bad. Hive should not depend on SNAPSHOT releases. Why do we keep doing this? Upgrade hive to use tez version 0.5.2-SNAPSHOT -- Key: HIVE-8614 URL: https://issues.apache.org/jira/browse/HIVE-8614 Project: Hive Issue Type: Bug Affects Versions: 0.14.0 Reporter: Vikram Dixit K Assignee: Vikram Dixit K Priority: Critical Fix For: 0.14.0 Attachments: HIVE-8614.1.patch, HIVE-8614.2.patch, HIVE-8614.3.patch, HIVE-8614.4.patch -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Commented] (HIVE-8614) Upgrade hive to use tez version 0.5.2-SNAPSHOT
[ https://issues.apache.org/jira/browse/HIVE-8614?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14305191#comment-14305191 ] Thejas M Nair commented on HIVE-8614: - [~shreymehrotra] You can edit that entry in pom to use 0.5.2 . This has been fixed in 1.0 release of hive, the vote just passed yesterday, and the release announcement should be sent very soon. 1.0 release is essentially 0.14 + bug fixes + removal of hiveserver1 . It is a very stable release, you might want to use that. Upgrade hive to use tez version 0.5.2-SNAPSHOT -- Key: HIVE-8614 URL: https://issues.apache.org/jira/browse/HIVE-8614 Project: Hive Issue Type: Bug Affects Versions: 0.14.0 Reporter: Vikram Dixit K Assignee: Vikram Dixit K Priority: Critical Fix For: 0.14.0 Attachments: HIVE-8614.1.patch, HIVE-8614.2.patch, HIVE-8614.3.patch, HIVE-8614.4.patch -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Commented] (HIVE-8614) Upgrade hive to use tez version 0.5.2-SNAPSHOT
[ https://issues.apache.org/jira/browse/HIVE-8614?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14305344#comment-14305344 ] Shrey Mehrotra commented on HIVE-8614: -- Thanks for the updates [~thejas] Upgrade hive to use tez version 0.5.2-SNAPSHOT -- Key: HIVE-8614 URL: https://issues.apache.org/jira/browse/HIVE-8614 Project: Hive Issue Type: Bug Affects Versions: 0.14.0 Reporter: Vikram Dixit K Assignee: Vikram Dixit K Priority: Critical Fix For: 0.14.0 Attachments: HIVE-8614.1.patch, HIVE-8614.2.patch, HIVE-8614.3.patch, HIVE-8614.4.patch -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Commented] (HIVE-8614) Upgrade hive to use tez version 0.5.2-SNAPSHOT
[ https://issues.apache.org/jira/browse/HIVE-8614?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14304996#comment-14304996 ] Shrey Mehrotra commented on HIVE-8614: -- I am facing hive source code compilation issue. I have downloaded the source of 0.14.0 from one of apache mirror (http://apache.bytenet.in/hive/hive-0.14.0/apache-hive-0.14.0-src.tar.gz). I am getting the following error in compilation. [INFO] Reactor Summary: [INFO] [INFO] Hive .. SUCCESS [ 2.895 s] [INFO] Hive Shims Common . SUCCESS [ 2.518 s] [INFO] Hive Shims 0.20 ... SUCCESS [ 0.984 s] [INFO] Hive Shims Secure Common .. SUCCESS [ 1.644 s] [INFO] Hive Shims 0.20S .. SUCCESS [ 0.829 s] [INFO] Hive Shims 0.23 ... FAILURE [ 0.412 s] [INFO] Hive Shims SKIPPED [INFO] Hive Common ... SKIPPED [INFO] Hive Serde SKIPPED [INFO] Hive Metastore SKIPPED [INFO] Hive Ant Utilities SKIPPED [INFO] Hive Query Language ... SKIPPED [INFO] Hive Service .. SKIPPED [INFO] Hive Accumulo Handler . SKIPPED [INFO] Hive JDBC . SKIPPED [INFO] Hive Beeline .. SKIPPED [INFO] Hive CLI .. SKIPPED [INFO] Hive Contrib .. SKIPPED [INFO] Hive HBase Handler SKIPPED [INFO] Hive HCatalog . SKIPPED [INFO] Hive HCatalog Core SKIPPED [INFO] Hive HCatalog Pig Adapter . SKIPPED [INFO] Hive HCatalog Server Extensions ... SKIPPED [INFO] Hive HCatalog Webhcat Java Client . SKIPPED [INFO] Hive HCatalog Webhcat . SKIPPED [INFO] Hive HCatalog Streaming ... SKIPPED [INFO] Hive HWI .. SKIPPED [INFO] Hive ODBC . SKIPPED [INFO] Hive Shims Aggregator . SKIPPED [INFO] Hive TestUtils SKIPPED [INFO] Hive Packaging SKIPPED [INFO] [INFO] BUILD FAILURE [INFO] [INFO] Total time: 9.905 s [INFO] Finished at: 2015-02-04T14:44:16+05:30 [INFO] Final Memory: 40M/185M [INFO] [ERROR] Failed to execute goal on project hive-shims-0.23: Could not resolve dep endencies for project org.apache.hive.shims:hive-shims-0.23:jar:0.14.0: The foll owing artifacts could not be resolved: org.apache.tez:tez-api:jar:0.5.2-SNAPSHOT , org.apache.tez:tez-runtime-library:jar:0.5.2-SNAPSHOT, org.apache.tez:tez-mapr educe:jar:0.5.2-SNAPSHOT, org.apache.tez:tez-tests:jar:tests:0.5.2-SNAPSHOT: Fai lure to find org.apache.tez:tez-api:jar:0.5.2-SNAPSHOT in http://repository.apac he.org/snapshots was cached in the local repository, resolution will not be reat tempted until the update interval of apache.snapshots has elapsed or updates are forced - [Help 1] [ERROR] I checked the POM for tez version in the source, it is tez.version0.5.2-SNAPSHOT/tez.version Please suggest a solution for compiling the source. Upgrade hive to use tez version 0.5.2-SNAPSHOT -- Key: HIVE-8614 URL: https://issues.apache.org/jira/browse/HIVE-8614 Project: Hive Issue Type: Bug Affects Versions: 0.14.0 Reporter: Vikram Dixit K Assignee: Vikram Dixit K Priority: Critical Fix For: 0.14.0 Attachments: HIVE-8614.1.patch, HIVE-8614.2.patch, HIVE-8614.3.patch, HIVE-8614.4.patch -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Commented] (HIVE-8614) Upgrade hive to use tez version 0.5.2-SNAPSHOT
[
https://issues.apache.org/jira/browse/HIVE-8614?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14186670#comment-14186670
]
Hive QA commented on HIVE-8614:
---
{color:red}Overall{color}: -1 at least one tests failed
Here are the results of testing the latest attachment:
https://issues.apache.org/jira/secure/attachment/12677506/HIVE-8614.3.patch
{color:red}ERROR:{color} -1 due to 3 failed/errored test(s), 6580 tests executed
*Failed tests:*
{noformat}
org.apache.hadoop.hive.cli.TestMiniTezCliDriver.testCliDriver_auto_sortmerge_join_5
org.apache.hadoop.hive.cli.TestMiniTezCliDriver.testCliDriver_optimize_nullscan
org.apache.hive.minikdc.TestJdbcWithMiniKdc.testNegativeTokenAuth
{noformat}
Test results:
http://ec2-174-129-184-35.compute-1.amazonaws.com/jenkins/job/PreCommit-HIVE-TRUNK-Build/1497/testReport
Console output:
http://ec2-174-129-184-35.compute-1.amazonaws.com/jenkins/job/PreCommit-HIVE-TRUNK-Build/1497/console
Test logs:
http://ec2-174-129-184-35.compute-1.amazonaws.com/logs/PreCommit-HIVE-TRUNK-Build-1497/
Messages:
{noformat}
Executing org.apache.hive.ptest.execution.PrepPhase
Executing org.apache.hive.ptest.execution.ExecutionPhase
Executing org.apache.hive.ptest.execution.ReportingPhase
Tests exited with: TestsFailedException: 3 tests failed
{noformat}
This message is automatically generated.
ATTACHMENT ID: 12677506 - PreCommit-HIVE-TRUNK-Build
Upgrade hive to use tez version 0.5.2-SNAPSHOT
--
Key: HIVE-8614
URL: https://issues.apache.org/jira/browse/HIVE-8614
Project: Hive
Issue Type: Bug
Affects Versions: 0.14.0
Reporter: Vikram Dixit K
Assignee: Vikram Dixit K
Priority: Critical
Fix For: 0.14.0
Attachments: HIVE-8614.1.patch, HIVE-8614.2.patch, HIVE-8614.3.patch
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
[jira] [Commented] (HIVE-8614) Upgrade hive to use tez version 0.5.2-SNAPSHOT
[
https://issues.apache.org/jira/browse/HIVE-8614?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14187303#comment-14187303
]
Gunther Hagleitner commented on HIVE-8614:
--
Ran the failing test (sortmerge_join_5) after applying HIVE-8628. Now it
produces NPE with this patch:
{noformat}
ava.lang.RuntimeException: java.lang.RuntimeException: Hive Runtime Error while
closing operators
at
org.apache.hadoop.hive.ql.exec.tez.TezProcessor.initializeAndRunProcessor(TezProcessor.java:186)
at org.apache.hadoop.hive.ql.exec.tez.TezProcessor.run(TezProcessor.java:138)
at
org.apache.tez.runtime.LogicalIOProcessorRuntimeTask.run(LogicalIOProcessorRuntimeTask.java:324)
at
org.apache.tez.runtime.task.TezTaskRunner$TaskRunnerCallable$1.run(TezTaskRunner.java:176)
at
org.apache.tez.runtime.task.TezTaskRunner$TaskRunnerCallable$1.run(TezTaskRunner.java:168)
at java.security.AccessController.doPrivileged(Native Method)
at javax.security.auth.Subject.doAs(Subject.java:394)
at
org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1614)
at
org.apache.tez.runtime.task.TezTaskRunner$TaskRunnerCallable.call(TezTaskRunner.java:168)
at
org.apache.tez.runtime.task.TezTaskRunner$TaskRunnerCallable.call(TezTaskRunner.java:163)
at java.util.concurrent.FutureTask$Sync.innerRun(FutureTask.java:303)
at java.util.concurrent.FutureTask.run(FutureTask.java:138)
at
java.util.concurrent.ThreadPoolExecutor$Worker.runTask(ThreadPoolExecutor.java:895)
at
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:918)
at java.lang.Thread.run(Thread.java:695)
Caused by: java.lang.RuntimeException: Hive Runtime Error while closing
operators
at
org.apache.hadoop.hive.ql.exec.tez.MapRecordProcessor.close(MapRecordProcessor.java:333)
at
org.apache.hadoop.hive.ql.exec.tez.TezProcessor.initializeAndRunProcessor(TezProcessor.java:177)
... 14 more
Caused by: java.lang.NullPointerException
at
org.apache.hadoop.hive.ql.exec.CommonMergeJoinOperator.closeOp(CommonMergeJoinOperator.java:309)
at org.apache.hadoop.hive.ql.exec.Operator.close(Operator.java:598)
at org.apache.hadoop.hive.ql.exec.Operator.close(Operator.java:610)
at org.apache.hadoop.hive.ql.exec.Operator.close(Operator.java:610)
at org.apache.hadoop.hive.ql.exec.Operator.close(Operator.java:610)
at org.apache.hadoop.hive.ql.exec.Operator.close(Operator.java:610)
at
org.apache.hadoop.hive.ql.exec.tez.MapRecordProcessor.close(MapRecordProcessor.java:312)
... 15 more
{noformat}
Upgrade hive to use tez version 0.5.2-SNAPSHOT
--
Key: HIVE-8614
URL: https://issues.apache.org/jira/browse/HIVE-8614
Project: Hive
Issue Type: Bug
Affects Versions: 0.14.0
Reporter: Vikram Dixit K
Assignee: Vikram Dixit K
Priority: Critical
Fix For: 0.14.0
Attachments: HIVE-8614.1.patch, HIVE-8614.2.patch, HIVE-8614.3.patch
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
[jira] [Commented] (HIVE-8614) Upgrade hive to use tez version 0.5.2-SNAPSHOT
[
https://issues.apache.org/jira/browse/HIVE-8614?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14187917#comment-14187917
]
Hive QA commented on HIVE-8614:
---
{color:red}Overall{color}: -1 at least one tests failed
Here are the results of testing the latest attachment:
https://issues.apache.org/jira/secure/attachment/12677676/HIVE-8614.4.patch
{color:red}ERROR:{color} -1 due to 3 failed/errored test(s), 6581 tests executed
*Failed tests:*
{noformat}
org.apache.hadoop.hive.cli.TestCliDriver.testCliDriver_insert_values_dynamic_partitioned
org.apache.hadoop.hive.cli.TestMiniTezCliDriver.testCliDriver_optimize_nullscan
org.apache.hive.minikdc.TestJdbcWithMiniKdc.testNegativeTokenAuth
{noformat}
Test results:
http://ec2-174-129-184-35.compute-1.amazonaws.com/jenkins/job/PreCommit-HIVE-TRUNK-Build/1512/testReport
Console output:
http://ec2-174-129-184-35.compute-1.amazonaws.com/jenkins/job/PreCommit-HIVE-TRUNK-Build/1512/console
Test logs:
http://ec2-174-129-184-35.compute-1.amazonaws.com/logs/PreCommit-HIVE-TRUNK-Build-1512/
Messages:
{noformat}
Executing org.apache.hive.ptest.execution.PrepPhase
Executing org.apache.hive.ptest.execution.ExecutionPhase
Executing org.apache.hive.ptest.execution.ReportingPhase
Tests exited with: TestsFailedException: 3 tests failed
{noformat}
This message is automatically generated.
ATTACHMENT ID: 12677676 - PreCommit-HIVE-TRUNK-Build
Upgrade hive to use tez version 0.5.2-SNAPSHOT
--
Key: HIVE-8614
URL: https://issues.apache.org/jira/browse/HIVE-8614
Project: Hive
Issue Type: Bug
Affects Versions: 0.14.0
Reporter: Vikram Dixit K
Assignee: Vikram Dixit K
Priority: Critical
Fix For: 0.14.0
Attachments: HIVE-8614.1.patch, HIVE-8614.2.patch, HIVE-8614.3.patch,
HIVE-8614.4.patch
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
[jira] [Commented] (HIVE-8614) Upgrade hive to use tez version 0.5.2-SNAPSHOT
[
https://issues.apache.org/jira/browse/HIVE-8614?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14185618#comment-14185618
]
Hive QA commented on HIVE-8614:
---
{color:red}Overall{color}: -1 no tests executed
Here are the results of testing the latest attachment:
https://issues.apache.org/jira/secure/attachment/12677363/HIVE-8614.2.patch
Test results:
http://ec2-174-129-184-35.compute-1.amazonaws.com/jenkins/job/PreCommit-HIVE-TRUNK-Build/1480/testReport
Console output:
http://ec2-174-129-184-35.compute-1.amazonaws.com/jenkins/job/PreCommit-HIVE-TRUNK-Build/1480/console
Test logs:
http://ec2-174-129-184-35.compute-1.amazonaws.com/logs/PreCommit-HIVE-TRUNK-Build-1480/
Messages:
{noformat}
This message was trimmed, see log for full details
[INFO]
[INFO] --- maven-compiler-plugin:3.1:testCompile (default-testCompile) @
hive-shims-0.20 ---
[INFO] No sources to compile
[INFO]
[INFO] --- maven-surefire-plugin:2.16:test (default-test) @ hive-shims-0.20 ---
[INFO] Tests are skipped.
[INFO]
[INFO] --- maven-jar-plugin:2.2:jar (default-jar) @ hive-shims-0.20 ---
[INFO] Building jar:
/data/hive-ptest/working/apache-svn-trunk-source/shims/0.20/target/hive-shims-0.20-0.15.0-SNAPSHOT.jar
[INFO]
[INFO] --- maven-site-plugin:3.3:attach-descriptor (attach-descriptor) @
hive-shims-0.20 ---
[INFO]
[INFO] --- maven-install-plugin:2.4:install (default-install) @ hive-shims-0.20
---
[INFO] Installing
/data/hive-ptest/working/apache-svn-trunk-source/shims/0.20/target/hive-shims-0.20-0.15.0-SNAPSHOT.jar
to
/data/hive-ptest/working/maven/org/apache/hive/shims/hive-shims-0.20/0.15.0-SNAPSHOT/hive-shims-0.20-0.15.0-SNAPSHOT.jar
[INFO] Installing
/data/hive-ptest/working/apache-svn-trunk-source/shims/0.20/pom.xml to
/data/hive-ptest/working/maven/org/apache/hive/shims/hive-shims-0.20/0.15.0-SNAPSHOT/hive-shims-0.20-0.15.0-SNAPSHOT.pom
[INFO]
[INFO]
[INFO] Building Hive Shims Secure Common 0.15.0-SNAPSHOT
[INFO]
[INFO]
[INFO] --- maven-clean-plugin:2.5:clean (default-clean) @
hive-shims-common-secure ---
[INFO] Deleting
/data/hive-ptest/working/apache-svn-trunk-source/shims/common-secure (includes
= [datanucleus.log, derby.log], excludes = [])
[INFO]
[INFO] --- maven-remote-resources-plugin:1.5:process (default) @
hive-shims-common-secure ---
[INFO]
[INFO] --- maven-resources-plugin:2.6:resources (default-resources) @
hive-shims-common-secure ---
[INFO] Using 'UTF-8' encoding to copy filtered resources.
[INFO] skip non existing resourceDirectory
/data/hive-ptest/working/apache-svn-trunk-source/shims/common-secure/src/main/resources
[INFO] Copying 3 resources
[INFO]
[INFO] --- maven-antrun-plugin:1.7:run (define-classpath) @
hive-shims-common-secure ---
[INFO] Executing tasks
main:
[INFO] Executed tasks
[INFO]
[INFO] --- maven-compiler-plugin:3.1:compile (default-compile) @
hive-shims-common-secure ---
[INFO] Compiling 12 source files to
/data/hive-ptest/working/apache-svn-trunk-source/shims/common-secure/target/classes
[WARNING]
/data/hive-ptest/working/apache-svn-trunk-source/shims/common-secure/src/main/java/org/apache/hadoop/hive/shims/HadoopShimsSecure.java:
/data/hive-ptest/working/apache-svn-trunk-source/shims/common-secure/src/main/java/org/apache/hadoop/hive/shims/HadoopShimsSecure.java
uses or overrides a deprecated API.
[WARNING]
/data/hive-ptest/working/apache-svn-trunk-source/shims/common-secure/src/main/java/org/apache/hadoop/hive/shims/HadoopShimsSecure.java:
Recompile with -Xlint:deprecation for details.
[WARNING]
/data/hive-ptest/working/apache-svn-trunk-source/shims/common-secure/src/main/java/org/apache/hadoop/hive/shims/HadoopShimsSecure.java:
Some input files use unchecked or unsafe operations.
[WARNING]
/data/hive-ptest/working/apache-svn-trunk-source/shims/common-secure/src/main/java/org/apache/hadoop/hive/shims/HadoopShimsSecure.java:
Recompile with -Xlint:unchecked for details.
[INFO]
[INFO] --- maven-resources-plugin:2.6:testResources (default-testResources) @
hive-shims-common-secure ---
[INFO] Using 'UTF-8' encoding to copy filtered resources.
[INFO] skip non existing resourceDirectory
/data/hive-ptest/working/apache-svn-trunk-source/shims/common-secure/src/test/resources
[INFO] Copying 3 resources
[INFO]
[INFO] --- maven-antrun-plugin:1.7:run (setup-test-dirs) @
hive-shims-common-secure ---
[INFO] Executing tasks
main:
[mkdir] Created dir:
/data/hive-ptest/working/apache-svn-trunk-source/shims/common-secure/target/tmp
[mkdir] Created dir:
/data/hive-ptest/working/apache-svn-trunk-source/shims/common-secure/target/warehouse
[mkdir] Created dir:
/data/hive-ptest/working/apache-svn-trunk-source/shims/common-secure/target/tmp/conf
[copy]
[jira] [Commented] (HIVE-8614) Upgrade hive to use tez version 0.5.2-SNAPSHOT
[ https://issues.apache.org/jira/browse/HIVE-8614?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14186361#comment-14186361 ] Gunther Hagleitner commented on HIVE-8614: -- HIVE-8614 is a dup. This also makes the hang in the unit tests go away. Upgrade hive to use tez version 0.5.2-SNAPSHOT -- Key: HIVE-8614 URL: https://issues.apache.org/jira/browse/HIVE-8614 Project: Hive Issue Type: Bug Affects Versions: 0.14.0 Reporter: Vikram Dixit K Assignee: Vikram Dixit K Priority: Critical Fix For: 0.14.0 Attachments: HIVE-8614.1.patch, HIVE-8614.2.patch, HIVE-8614.3.patch -- This message was sent by Atlassian JIRA (v6.3.4#6332)
