[jira] [Commented] (HIVE-14818) Reduce number of retries while starting HiveServer for tests
[ https://issues.apache.org/jira/browse/HIVE-14818?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15518448#comment-15518448 ] Lefty Leverenz commented on HIVE-14818: --- Doc note: This creates a new configuration parameter (*hive.server2.sleep.interval.between.start.attempts*) and changes the function and description of another (*hive.server2.max.start.attempts*) so they need to be documented in the wiki. Note that the description change should include version information. * [Configuration Properties -- HiveServer2 | https://cwiki.apache.org/confluence/display/Hive/Configuration+Properties#ConfigurationProperties-HiveServer2] * [Configuration Properties -- HiveServer2 -- hive.server2.max.start.attempts | https://cwiki.apache.org/confluence/display/Hive/Configuration+Properties#ConfigurationProperties-hive.server2.max.start.attempts] Added a TODOC2.2 label. > Reduce number of retries while starting HiveServer for tests > > > Key: HIVE-14818 > URL: https://issues.apache.org/jira/browse/HIVE-14818 > Project: Hive > Issue Type: Sub-task >Reporter: Siddharth Seth >Assignee: Siddharth Seth > Labels: TODOC2.2 > Fix For: 2.2.0 > > Attachments: HIVE-14818.01.patch, HIVE-14818.02.patch > > > Current is 30 retries, with a 1minute sleep between each one. > The settings are likely bad for a production cluster as well. For tests, this > should be a lot lower. -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Commented] (HIVE-14818) Reduce number of retries while starting HiveServer for tests
[ https://issues.apache.org/jira/browse/HIVE-14818?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15518446#comment-15518446 ] Lefty Leverenz commented on HIVE-14818: --- Doc note: This creates a new configuration parameter (*hive.server2.sleep.interval.between.start.attempts*) and changes the function and description of another (*hive.server2.max.start.attempts*) so they need to be documented in the wiki. Note that the description change should include version information. * [Configuration Properties -- HiveServer2 | https://cwiki.apache.org/confluence/display/Hive/Configuration+Properties#ConfigurationProperties-HiveServer2] * [Configuration Properties -- HiveServer2 -- hive.server2.max.start.attempts | https://cwiki.apache.org/confluence/display/Hive/Configuration+Properties#ConfigurationProperties-hive.server2.max.start.attempts] Added a TODOC2.2 label. > Reduce number of retries while starting HiveServer for tests > > > Key: HIVE-14818 > URL: https://issues.apache.org/jira/browse/HIVE-14818 > Project: Hive > Issue Type: Sub-task >Reporter: Siddharth Seth >Assignee: Siddharth Seth > Labels: TODOC2.2 > Fix For: 2.2.0 > > Attachments: HIVE-14818.01.patch, HIVE-14818.02.patch > > > Current is 30 retries, with a 1minute sleep between each one. > The settings are likely bad for a production cluster as well. For tests, this > should be a lot lower. -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Commented] (HIVE-14818) Reduce number of retries while starting HiveServer for tests
[
https://issues.apache.org/jira/browse/HIVE-14818?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15517213#comment-15517213
]
Hive QA commented on HIVE-14818:
Here are the results of testing the latest attachment:
https://issues.apache.org/jira/secure/attachment/12829972/HIVE-14818.02.patch
{color:red}ERROR:{color} -1 due to no test(s) being added or modified.
{color:red}ERROR:{color} -1 due to 6 failed/errored test(s), 10559 tests
executed
*Failed tests:*
{noformat}
org.apache.hadoop.hive.cli.TestCliDriver.testCliDriver[acid_mapjoin]
org.apache.hadoop.hive.cli.TestCliDriver.testCliDriver[ctas]
org.apache.hadoop.hive.cli.TestCliDriver.testCliDriver[vector_join_part_col_char]
org.apache.hadoop.hive.cli.TestMiniTezCliDriver.testCliDriver[explainuser_3]
org.apache.hadoop.hive.metastore.TestMetaStoreMetrics.testMetaDataCounts
org.apache.hive.jdbc.TestJdbcWithMiniHS2.testAddJarConstructorUnCaching
{noformat}
Test results: https://builds.apache.org/job/PreCommit-HIVE-Build/1289/testReport
Console output: https://builds.apache.org/job/PreCommit-HIVE-Build/1289/console
Test logs:
http://ec2-204-236-174-241.us-west-1.compute.amazonaws.com/logs/PreCommit-HIVE-Build-1289/
Messages:
{noformat}
Executing org.apache.hive.ptest.execution.TestCheckPhase
Executing org.apache.hive.ptest.execution.PrepPhase
Executing org.apache.hive.ptest.execution.ExecutionPhase
Executing org.apache.hive.ptest.execution.ReportingPhase
Tests exited with: TestsFailedException: 6 tests failed
{noformat}
This message is automatically generated.
ATTACHMENT ID: 12829972 - PreCommit-HIVE-Build
> Reduce number of retries while starting HiveServer for tests
>
>
> Key: HIVE-14818
> URL: https://issues.apache.org/jira/browse/HIVE-14818
> Project: Hive
> Issue Type: Sub-task
>Reporter: Siddharth Seth
>Assignee: Siddharth Seth
> Attachments: HIVE-14818.01.patch, HIVE-14818.02.patch
>
>
> Current is 30 retries, with a 1minute sleep between each one.
> The settings are likely bad for a production cluster as well. For tests, this
> should be a lot lower.
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
[jira] [Commented] (HIVE-14818) Reduce number of retries while starting HiveServer for tests
[
https://issues.apache.org/jira/browse/HIVE-14818?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15515020#comment-15515020
]
Hive QA commented on HIVE-14818:
Here are the results of testing the latest attachment:
https://issues.apache.org/jira/secure/attachment/12829919/HIVE-14818.01.patch
{color:red}ERROR:{color} -1 due to build exiting with an error
Test results: https://builds.apache.org/job/PreCommit-HIVE-Build/1281/testReport
Console output: https://builds.apache.org/job/PreCommit-HIVE-Build/1281/console
Test logs:
http://ec2-204-236-174-241.us-west-1.compute.amazonaws.com/logs/PreCommit-HIVE-Build-1281/
Messages:
{noformat}
This message was trimmed, see log for full details
main:
[mkdir] Created dir:
/data/hive-ptest/working/apache-github-source-source/storage-api/target/tmp
[mkdir] Created dir:
/data/hive-ptest/working/apache-github-source-source/storage-api/target/warehouse
[mkdir] Created dir:
/data/hive-ptest/working/apache-github-source-source/storage-api/target/tmp/conf
[copy] Copying 15 files to
/data/hive-ptest/working/apache-github-source-source/storage-api/target/tmp/conf
[INFO] Executed tasks
[INFO]
[INFO] --- maven-compiler-plugin:3.1:testCompile (default-testCompile) @
hive-storage-api ---
[INFO] Compiling 7 source files to
/data/hive-ptest/working/apache-github-source-source/storage-api/target/test-classes
[INFO]
[INFO] --- maven-surefire-plugin:2.19.1:test (default-test) @ hive-storage-api
---
[INFO] Tests are skipped.
[INFO]
[INFO] --- maven-jar-plugin:2.4:jar (default-jar) @ hive-storage-api ---
[INFO] Building jar:
/data/hive-ptest/working/apache-github-source-source/storage-api/target/hive-storage-api-2.2.0-SNAPSHOT.jar
[INFO]
[INFO] --- maven-site-plugin:3.3:attach-descriptor (attach-descriptor) @
hive-storage-api ---
[INFO]
[INFO] --- maven-install-plugin:2.4:install (default-install) @
hive-storage-api ---
[INFO] Installing
/data/hive-ptest/working/apache-github-source-source/storage-api/target/hive-storage-api-2.2.0-SNAPSHOT.jar
to
/data/hive-ptest/working/maven/org/apache/hive/hive-storage-api/2.2.0-SNAPSHOT/hive-storage-api-2.2.0-SNAPSHOT.jar
[INFO] Installing
/data/hive-ptest/working/apache-github-source-source/storage-api/pom.xml to
/data/hive-ptest/working/maven/org/apache/hive/hive-storage-api/2.2.0-SNAPSHOT/hive-storage-api-2.2.0-SNAPSHOT.pom
[INFO]
[INFO]
[INFO] Building Hive ORC 2.2.0-SNAPSHOT
[INFO]
[INFO]
[INFO] --- maven-clean-plugin:2.5:clean (default-clean) @ hive-orc ---
[INFO] Deleting /data/hive-ptest/working/apache-github-source-source/orc/target
[INFO] Deleting /data/hive-ptest/working/apache-github-source-source/orc
(includes = [datanucleus.log, derby.log], excludes = [])
[INFO]
[INFO] --- maven-enforcer-plugin:1.3.1:enforce (enforce-no-snapshots) @
hive-orc ---
[INFO]
[INFO] --- build-helper-maven-plugin:1.8:add-source (add-source) @ hive-orc ---
[INFO] Source directory:
/data/hive-ptest/working/apache-github-source-source/orc/src/gen/protobuf-java
added.
[INFO]
[INFO] --- maven-remote-resources-plugin:1.5:process (default) @ hive-orc ---
[INFO]
[INFO] --- maven-resources-plugin:2.6:resources (default-resources) @ hive-orc
---
[INFO] Using 'UTF-8' encoding to copy filtered resources.
[INFO] skip non existing resourceDirectory
/data/hive-ptest/working/apache-github-source-source/orc/src/main/resources
[INFO] Copying 3 resources
[INFO]
[INFO] --- maven-antrun-plugin:1.7:run (define-classpath) @ hive-orc ---
[INFO] Executing tasks
main:
[INFO] Executed tasks
[INFO]
[INFO] --- maven-compiler-plugin:3.1:compile (default-compile) @ hive-orc ---
[INFO] Compiling 71 source files to
/data/hive-ptest/working/apache-github-source-source/orc/target/classes
[WARNING]
/data/hive-ptest/working/apache-github-source-source/orc/src/java/org/apache/orc/tools/FileDump.java:
Some input files use or override a deprecated API.
[WARNING]
/data/hive-ptest/working/apache-github-source-source/orc/src/java/org/apache/orc/tools/FileDump.java:
Recompile with -Xlint:deprecation for details.
[WARNING]
/data/hive-ptest/working/apache-github-source-source/orc/src/java/org/apache/orc/impl/RecordReaderImpl.java:
/data/hive-ptest/working/apache-github-source-source/orc/src/java/org/apache/orc/impl/RecordReaderImpl.java
uses unchecked or unsafe operations.
[WARNING]
/data/hive-ptest/working/apache-github-source-source/orc/src/java/org/apache/orc/impl/RecordReaderImpl.java:
Recompile with -Xlint:unchecked for details.
[INFO]
[INFO] --- maven-resources-plugin:2.6:testResources (default-testResources) @
hive-orc ---
[INFO] Using 'UTF-8' encoding to copy filtered resources.
[INFO] Copying 7 resources
[INFO] Copying 3 reso
[jira] [Commented] (HIVE-14818) Reduce number of retries while starting HiveServer for tests
[ https://issues.apache.org/jira/browse/HIVE-14818?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15514259#comment-15514259 ] Prasanth Jayachandran commented on HIVE-14818: -- Not relevant to this issue. But default 30 min sleep time feels a lot to me. Other than that patch lgtm +1 > Reduce number of retries while starting HiveServer for tests > > > Key: HIVE-14818 > URL: https://issues.apache.org/jira/browse/HIVE-14818 > Project: Hive > Issue Type: Sub-task >Reporter: Siddharth Seth >Assignee: Siddharth Seth > Attachments: HIVE-14818.01.patch > > > Current is 30 retries, with a 1minute sleep between each one. > The settings are likely bad for a production cluster as well. For tests, this > should be a lot lower. -- This message was sent by Atlassian JIRA (v6.3.4#6332)
