[jira] [Commented] (HIVE-15078) Flaky dummy
[
https://issues.apache.org/jira/browse/HIVE-15078?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16980477#comment-16980477
]
Hive QA commented on HIVE-15078:
Here are the results of testing the latest attachment:
https://issues.apache.org/jira/secure/attachment/12951221/some.file.patch
{color:red}ERROR:{color} -1 due to build exiting with an error
Test results:
https://builds.apache.org/job/PreCommit-HIVE-Build/19553/testReport
Console output: https://builds.apache.org/job/PreCommit-HIVE-Build/19553/console
Test logs: http://104.198.109.242/logs/PreCommit-HIVE-Build-19553/
Messages:
{noformat}
Executing org.apache.hive.ptest.execution.TestCheckPhase
Executing org.apache.hive.ptest.execution.PrepPhase
Tests exited with: NonZeroExitCodeException
Command 'bash /data/hiveptest/working/scratch/source-prep.sh' failed with exit
status 1 and output '+ date '+%Y-%m-%d %T.%3N'
2019-11-22 20:07:56.179
+ [[ -n /usr/lib/jvm/java-8-openjdk-amd64 ]]
+ export JAVA_HOME=/usr/lib/jvm/java-8-openjdk-amd64
+ JAVA_HOME=/usr/lib/jvm/java-8-openjdk-amd64
+ export
PATH=/usr/lib/jvm/java-8-openjdk-amd64/bin/:/usr/local/bin:/usr/bin:/bin:/usr/local/games:/usr/games
+
PATH=/usr/lib/jvm/java-8-openjdk-amd64/bin/:/usr/local/bin:/usr/bin:/bin:/usr/local/games:/usr/games
+ export 'ANT_OPTS=-Xmx1g -XX:MaxPermSize=256m '
+ ANT_OPTS='-Xmx1g -XX:MaxPermSize=256m '
+ export 'MAVEN_OPTS=-Xmx1g '
+ MAVEN_OPTS='-Xmx1g '
+ cd /data/hiveptest/working/
+ tee /data/hiveptest/logs/PreCommit-HIVE-Build-19553/source-prep.txt
+ [[ false == \t\r\u\e ]]
+ mkdir -p maven ivy
+ [[ git = \s\v\n ]]
+ [[ git = \g\i\t ]]
+ [[ -z master ]]
+ [[ -d apache-github-source-source ]]
+ [[ ! -d apache-github-source-source/.git ]]
+ [[ ! -d apache-github-source-source ]]
+ date '+%Y-%m-%d %T.%3N'
2019-11-22 20:07:56.183
+ cd apache-github-source-source
+ git fetch origin
+ git reset --hard HEAD
HEAD is now at d6ae486 HIVE-22514: HiveProtoLoggingHook might consume lots of
memory (Attila Magyar via Slim Bouguerra)
+ git clean -f -d
Removing standalone-metastore/metastore-server/src/gen/
+ git checkout master
Already on 'master'
Your branch is up-to-date with 'origin/master'.
+ git reset --hard origin/master
HEAD is now at d6ae486 HIVE-22514: HiveProtoLoggingHook might consume lots of
memory (Attila Magyar via Slim Bouguerra)
+ git merge --ff-only origin/master
Already up-to-date.
+ date '+%Y-%m-%d %T.%3N'
2019-11-22 20:07:57.417
+ rm -rf ../yetus_PreCommit-HIVE-Build-19553
+ mkdir ../yetus_PreCommit-HIVE-Build-19553
+ git gc
+ cp -R . ../yetus_PreCommit-HIVE-Build-19553
+ mkdir /data/hiveptest/logs/PreCommit-HIVE-Build-19553/yetus
+ patchCommandPath=/data/hiveptest/working/scratch/smart-apply-patch.sh
+ patchFilePath=/data/hiveptest/working/scratch/build.patch
+ [[ -f /data/hiveptest/working/scratch/build.patch ]]
+ chmod +x /data/hiveptest/working/scratch/smart-apply-patch.sh
+ /data/hiveptest/working/scratch/smart-apply-patch.sh
/data/hiveptest/working/scratch/build.patch
fatal: unrecognized input
fatal: unrecognized input
fatal: unrecognized input
The patch does not appear to apply with p0, p1, or p2
+ result=1
+ '[' 1 -ne 0 ']'
+ rm -rf yetus_PreCommit-HIVE-Build-19553
+ exit 1
'
{noformat}
This message is automatically generated.
ATTACHMENT ID: 12951221 - PreCommit-HIVE-Build
> Flaky dummy
> ---
>
> Key: HIVE-15078
> URL: https://issues.apache.org/jira/browse/HIVE-15078
> Project: Hive
> Issue Type: Test
>Reporter: Zoltan Haindrich
>Assignee: Zoltan Haindrich
>Priority: Major
> Attachments: HIVE-15078.01-branch-3.patch, HIVE-15078.1.patch,
> HIVE-15078.1.patch, some.file.patch
>
>
> I think it would be intresting to see what will happen if all currently known
> flaky test would be ignored...
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
[jira] [Commented] (HIVE-15078) Flaky dummy
[
https://issues.apache.org/jira/browse/HIVE-15078?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16715328#comment-16715328
]
Hive QA commented on HIVE-15078:
Here are the results of testing the latest attachment:
https://issues.apache.org/jira/secure/attachment/12951221/some.file.patch
{color:red}ERROR:{color} -1 due to build exiting with an error
Test results:
https://builds.apache.org/job/PreCommit-HIVE-Build/15245/testReport
Console output: https://builds.apache.org/job/PreCommit-HIVE-Build/15245/console
Test logs: http://104.198.109.242/logs/PreCommit-HIVE-Build-15245/
Messages:
{noformat}
Executing org.apache.hive.ptest.execution.TestCheckPhase
Executing org.apache.hive.ptest.execution.PrepPhase
Tests exited with: NonZeroExitCodeException
Command 'bash /data/hiveptest/working/scratch/source-prep.sh' failed with exit
status 1 and output '+ date '+%Y-%m-%d %T.%3N'
2018-12-10 18:38:30.034
+ [[ -n /usr/lib/jvm/java-8-openjdk-amd64 ]]
+ export JAVA_HOME=/usr/lib/jvm/java-8-openjdk-amd64
+ JAVA_HOME=/usr/lib/jvm/java-8-openjdk-amd64
+ export
PATH=/usr/lib/jvm/java-8-openjdk-amd64/bin/:/usr/local/bin:/usr/bin:/bin:/usr/local/games:/usr/games
+
PATH=/usr/lib/jvm/java-8-openjdk-amd64/bin/:/usr/local/bin:/usr/bin:/bin:/usr/local/games:/usr/games
+ export 'ANT_OPTS=-Xmx1g -XX:MaxPermSize=256m '
+ ANT_OPTS='-Xmx1g -XX:MaxPermSize=256m '
+ export 'MAVEN_OPTS=-Xmx1g '
+ MAVEN_OPTS='-Xmx1g '
+ cd /data/hiveptest/working/
+ tee /data/hiveptest/logs/PreCommit-HIVE-Build-15245/source-prep.txt
+ [[ false == \t\r\u\e ]]
+ mkdir -p maven ivy
+ [[ git = \s\v\n ]]
+ [[ git = \g\i\t ]]
+ [[ -z master ]]
+ [[ -d apache-github-source-source ]]
+ [[ ! -d apache-github-source-source/.git ]]
+ [[ ! -d apache-github-source-source ]]
+ date '+%Y-%m-%d %T.%3N'
2018-12-10 18:38:30.037
+ cd apache-github-source-source
+ git fetch origin
>From https://github.com/apache/hive
b42fdc2..9493dcf master -> origin/master
+ git reset --hard HEAD
HEAD is now at b42fdc2 HIVE-21018: Grouping/distinct on more than 64 columns
should be possible (Zoltan Haindrich reviewed by Jesus Camacho Rodriguez)
+ git clean -f -d
Removing standalone-metastore/metastore-server/src/gen/
+ git checkout master
Already on 'master'
Your branch is behind 'origin/master' by 1 commit, and can be fast-forwarded.
(use "git pull" to update your local branch)
+ git reset --hard origin/master
HEAD is now at 9493dcf HIVE-21007: Semi join + Union can lead to wrong plans
(Vineet Garg, reviewed by Jesus Camacho Rodriguez)
+ git merge --ff-only origin/master
Already up-to-date.
+ date '+%Y-%m-%d %T.%3N'
2018-12-10 18:38:31.369
+ rm -rf ../yetus_PreCommit-HIVE-Build-15245
+ mkdir ../yetus_PreCommit-HIVE-Build-15245
+ git gc
+ cp -R . ../yetus_PreCommit-HIVE-Build-15245
+ mkdir /data/hiveptest/logs/PreCommit-HIVE-Build-15245/yetus
+ patchCommandPath=/data/hiveptest/working/scratch/smart-apply-patch.sh
+ patchFilePath=/data/hiveptest/working/scratch/build.patch
+ [[ -f /data/hiveptest/working/scratch/build.patch ]]
+ chmod +x /data/hiveptest/working/scratch/smart-apply-patch.sh
+ /data/hiveptest/working/scratch/smart-apply-patch.sh
/data/hiveptest/working/scratch/build.patch
fatal: unrecognized input
fatal: unrecognized input
fatal: unrecognized input
The patch does not appear to apply with p0, p1, or p2
+ result=1
+ '[' 1 -ne 0 ']'
+ rm -rf yetus_PreCommit-HIVE-Build-15245
+ exit 1
'
{noformat}
This message is automatically generated.
ATTACHMENT ID: 12951221 - PreCommit-HIVE-Build
> Flaky dummy
> ---
>
> Key: HIVE-15078
> URL: https://issues.apache.org/jira/browse/HIVE-15078
> Project: Hive
> Issue Type: Test
>Reporter: Zoltan Haindrich
>Assignee: Zoltan Haindrich
>Priority: Major
> Attachments: HIVE-15078.01-branch-3.patch, HIVE-15078.1.patch,
> HIVE-15078.1.patch, some.file.patch
>
>
> I think it would be intresting to see what will happen if all currently known
> flaky test would be ignored...
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
[jira] [Commented] (HIVE-15078) Flaky dummy
[
https://issues.apache.org/jira/browse/HIVE-15078?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16497901#comment-16497901
]
Hive QA commented on HIVE-15078:
Here are the results of testing the latest attachment:
https://issues.apache.org/jira/secure/attachment/12925615/HIVE-15078.01-branch-3.patch
{color:red}ERROR:{color} -1 due to no test(s) being added or modified.
{color:red}ERROR:{color} -1 due to 5 failed/errored test(s), 14371 tests
executed
*Failed tests:*
{noformat}
TestUpgradeTool - did not produce a TEST-*.xml file (likely timed out)
(batchId=309)
org.apache.hadoop.hive.cli.TestMiniDruidCliDriver.testCliDriver[druidkafkamini_basic]
(batchId=253)
org.apache.hadoop.hive.cli.TestNegativeCliDriver.testCliDriver[insertsel_fail]
(batchId=95)
org.apache.hive.jdbc.TestJdbcWithMiniLlapArrow.testDataTypes (batchId=240)
org.apache.hive.spark.client.rpc.TestRpc.testServerPort (batchId=304)
{noformat}
Test results:
https://builds.apache.org/job/PreCommit-HIVE-Build/11407/testReport
Console output: https://builds.apache.org/job/PreCommit-HIVE-Build/11407/console
Test logs: http://104.198.109.242/logs/PreCommit-HIVE-Build-11407/
Messages:
{noformat}
Executing org.apache.hive.ptest.execution.TestCheckPhase
Executing org.apache.hive.ptest.execution.PrepPhase
Executing org.apache.hive.ptest.execution.YetusPhase
Executing org.apache.hive.ptest.execution.ExecutionPhase
Executing org.apache.hive.ptest.execution.ReportingPhase
Tests exited with: TestsFailedException: 5 tests failed
{noformat}
This message is automatically generated.
ATTACHMENT ID: 12925615 - PreCommit-HIVE-Build
> Flaky dummy
> ---
>
> Key: HIVE-15078
> URL: https://issues.apache.org/jira/browse/HIVE-15078
> Project: Hive
> Issue Type: Test
>Reporter: Zoltan Haindrich
>Assignee: Zoltan Haindrich
>Priority: Major
> Attachments: HIVE-15078.01-branch-3.patch, HIVE-15078.1.patch,
> HIVE-15078.1.patch
>
>
> I think it would be intresting to see what will happen if all currently known
> flaky test would be ignored...
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
[jira] [Commented] (HIVE-15078) Flaky dummy
[
https://issues.apache.org/jira/browse/HIVE-15078?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16497870#comment-16497870
]
Hive QA commented on HIVE-15078:
| (x) *{color:red}-1 overall{color}* |
\\
\\
|| Vote || Subsystem || Runtime || Comment ||
|| || || || {color:brown} Prechecks {color} ||
| {color:green}+1{color} | {color:green} @author {color} | {color:green} 0m
0s{color} | {color:green} The patch does not contain any @author tags. {color} |
|| || || || {color:brown} master Compile Tests {color} ||
| {color:green}+1{color} | {color:green} mvninstall {color} | {color:green} 6m
7s{color} | {color:green} master passed {color} |
| {color:green}+1{color} | {color:green} compile {color} | {color:green} 4m
27s{color} | {color:green} master passed {color} |
| {color:green}+1{color} | {color:green} javadoc {color} | {color:green} 5m
6s{color} | {color:green} master passed {color} |
|| || || || {color:brown} Patch Compile Tests {color} ||
| {color:green}+1{color} | {color:green} mvninstall {color} | {color:green} 5m
28s{color} | {color:green} the patch passed {color} |
| {color:green}+1{color} | {color:green} compile {color} | {color:green} 4m
27s{color} | {color:green} the patch passed {color} |
| {color:green}+1{color} | {color:green} javac {color} | {color:green} 4m
27s{color} | {color:green} the patch passed {color} |
| {color:green}+1{color} | {color:green} whitespace {color} | {color:green} 0m
0s{color} | {color:green} The patch has no whitespace issues. {color} |
| {color:red}-1{color} | {color:red} xml {color} | {color:red} 0m 1s{color} |
{color:red} The patch has 1 ill-formed XML file(s). {color} |
| {color:green}+1{color} | {color:green} javadoc {color} | {color:green} 5m
0s{color} | {color:green} the patch passed {color} |
|| || || || {color:brown} Other Tests {color} ||
| {color:green}+1{color} | {color:green} asflicense {color} | {color:green} 0m
10s{color} | {color:green} The patch does not generate ASF License warnings.
{color} |
| {color:black}{color} | {color:black} {color} | {color:black} 31m 0s{color} |
{color:black} {color} |
\\
\\
|| Subsystem || Report/Notes ||
| Optional Tests | asflicense javac javadoc xml compile |
| uname | Linux hiveptest-server-upstream 3.16.0-4-amd64 #1 SMP Debian
3.16.36-1+deb8u1 (2016-09-03) x86_64 GNU/Linux |
| Build tool | maven |
| Personality |
/data/hiveptest/working/yetus_PreCommit-HIVE-Build-11407/dev-support/hive-personality.sh
|
| git revision | master / 28779d2 |
| Default Java | 1.8.0_111 |
| xml | http://104.198.109.242/logs//PreCommit-HIVE-Build-11407/yetus/xml.txt |
| modules | C: . U: . |
| Console output |
http://104.198.109.242/logs//PreCommit-HIVE-Build-11407/yetus.txt |
| Powered by | Apache Yetushttp://yetus.apache.org |
This message was automatically generated.
> Flaky dummy
> ---
>
> Key: HIVE-15078
> URL: https://issues.apache.org/jira/browse/HIVE-15078
> Project: Hive
> Issue Type: Test
>Reporter: Zoltan Haindrich
>Assignee: Zoltan Haindrich
>Priority: Major
> Attachments: HIVE-15078.01-branch-3.patch, HIVE-15078.1.patch,
> HIVE-15078.1.patch
>
>
> I think it would be intresting to see what will happen if all currently known
> flaky test would be ignored...
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
[jira] [Commented] (HIVE-15078) Flaky dummy
[ https://issues.apache.org/jira/browse/HIVE-15078?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15616692#comment-15616692 ] Siddharth Seth commented on HIVE-15078: --- For CliDriver tests - Tez/Spark sessions are re-used across tests. I believe the Hive Client session gets resset each time - and this is supposed to make sure tests start with a clean base, and whatever settings are in the qfile get applied. I wonder if this is not working as it should. Also, I read a comment somewhere about tests modifying and writing the configuration back to disk. That would cause all kinds of problems when running in a batch. Thanks for looking into this. > Flaky dummy > --- > > Key: HIVE-15078 > URL: https://issues.apache.org/jira/browse/HIVE-15078 > Project: Hive > Issue Type: Test >Reporter: Zoltan Haindrich >Assignee: Zoltan Haindrich > Attachments: HIVE-15078.1.patch, HIVE-15078.1.patch > > > I think it would be intresting to see what will happen if all currently known > flaky test would be ignored... -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Commented] (HIVE-15078) Flaky dummy
[ https://issues.apache.org/jira/browse/HIVE-15078?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15616509#comment-15616509 ] Zoltan Haindrich commented on HIVE-15078: - i've forgot to re-attach the patch... very intresting...i suspect that there are a few problematic cases in there which when get into the same batch will fail - but these unstable tests may even help bugs to play hide and seek ;) I will start some standalone mvn test executions...which will probably take a few days - but there outputs might be intresting... until then...i will reschedule this a few times...because this doesn't contain any real change; just some disabled tests - this may detect some fluctuating tests > Flaky dummy > --- > > Key: HIVE-15078 > URL: https://issues.apache.org/jira/browse/HIVE-15078 > Project: Hive > Issue Type: Test >Reporter: Zoltan Haindrich >Assignee: Zoltan Haindrich > Attachments: HIVE-15078.1.patch, HIVE-15078.1.patch > > > I think it would be intresting to see what will happen if all currently known > flaky test would be ignored... -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Commented] (HIVE-15078) Flaky dummy
[
https://issues.apache.org/jira/browse/HIVE-15078?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15610353#comment-15610353
]
Hive QA commented on HIVE-15078:
Here are the results of testing the latest attachment:
https://issues.apache.org/jira/secure/attachment/12835427/HIVE-15078.1.patch
{color:green}SUCCESS:{color} +1 due to 6 test(s) being added or modified.
{color:red}ERROR:{color} -1 due to 2 failed/errored test(s), 10530 tests
executed
*Failed tests:*
{noformat}
TestSemanticAnalysis - did not produce a TEST-*.xml file (likely timed out)
(batchId=171)
org.apache.hadoop.hive.cli.TestCliDriver.testCliDriver[acid_bucket_pruning]
(batchId=29)
{noformat}
Test results: https://builds.apache.org/job/PreCommit-HIVE-Build/1833/testReport
Console output: https://builds.apache.org/job/PreCommit-HIVE-Build/1833/console
Test logs: http://104.198.109.242/logs/PreCommit-HIVE-Build-1833/
Messages:
{noformat}
Executing org.apache.hive.ptest.execution.TestCheckPhase
Executing org.apache.hive.ptest.execution.PrepPhase
Executing org.apache.hive.ptest.execution.ExecutionPhase
Executing org.apache.hive.ptest.execution.ReportingPhase
Tests exited with: TestsFailedException: 2 tests failed
{noformat}
This message is automatically generated.
ATTACHMENT ID: 12835427 - PreCommit-HIVE-Build
> Flaky dummy
> ---
>
> Key: HIVE-15078
> URL: https://issues.apache.org/jira/browse/HIVE-15078
> Project: Hive
> Issue Type: Test
>Reporter: Zoltan Haindrich
>Assignee: Zoltan Haindrich
> Attachments: HIVE-15078.1.patch
>
>
> I think it would be intresting to see what will happen if all currently known
> flaky test would be ignored...
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
[jira] [Commented] (HIVE-15078) Flaky dummy
[ https://issues.apache.org/jira/browse/HIVE-15078?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15610233#comment-15610233 ] Siddharth Seth commented on HIVE-15078: --- [~kgyrtkirk] - as a data point. When I changed the ptest configuration to remove some isolated tests, and convert them over to just skipBatching, as well as some batchSize changes - the number of failures changed. Nothing should have changed with this config change, except for test runs being several minutes faster. I'm going to try that change again one of these days. > Flaky dummy > --- > > Key: HIVE-15078 > URL: https://issues.apache.org/jira/browse/HIVE-15078 > Project: Hive > Issue Type: Test >Reporter: Zoltan Haindrich >Assignee: Zoltan Haindrich > Attachments: HIVE-15078.1.patch > > > I think it would be intresting to see what will happen if all currently known > flaky test would be ignored... -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Commented] (HIVE-15078) Flaky dummy
[ https://issues.apache.org/jira/browse/HIVE-15078?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15610214#comment-15610214 ] Siddharth Seth commented on HIVE-15078: --- The next set of flaky tests will surface :) Honestly, I think some of these actually point to a product bug - potential races. It could ofcourse also be bugs in the tests / test framework. > Flaky dummy > --- > > Key: HIVE-15078 > URL: https://issues.apache.org/jira/browse/HIVE-15078 > Project: Hive > Issue Type: Test >Reporter: Zoltan Haindrich >Assignee: Zoltan Haindrich > Attachments: HIVE-15078.1.patch > > > I think it would be intresting to see what will happen if all currently known > flaky test would be ignored... -- This message was sent by Atlassian JIRA (v6.3.4#6332)
