[jira] [Commented] (HIVE-21794) Add materialized view parameters to sqlStdAuthSafeVarNameRegexes
[
https://issues.apache.org/jira/browse/HIVE-21794?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16848043#comment-16848043
]
Hive QA commented on HIVE-21794:
Here are the results of testing the latest attachment:
https://issues.apache.org/jira/secure/attachment/12969715/HIVE-21794.01.patch
{color:red}ERROR:{color} -1 due to build exiting with an error
Test results:
https://builds.apache.org/job/PreCommit-HIVE-Build/17310/testReport
Console output: https://builds.apache.org/job/PreCommit-HIVE-Build/17310/console
Test logs: http://104.198.109.242/logs/PreCommit-HIVE-Build-17310/
Messages:
{noformat}
Executing org.apache.hive.ptest.execution.TestCheckPhase
Tests exited with: Exception: Patch URL
https://issues.apache.org/jira/secure/attachment/12969715/HIVE-21794.01.patch
was found in seen patch url's cache and a test was probably run already on it.
Aborting...
{noformat}
This message is automatically generated.
ATTACHMENT ID: 12969715 - PreCommit-HIVE-Build
> Add materialized view parameters to sqlStdAuthSafeVarNameRegexes
>
>
> Key: HIVE-21794
> URL: https://issues.apache.org/jira/browse/HIVE-21794
> Project: Hive
> Issue Type: Bug
> Components: CBO
>Reporter: Jesus Camacho Rodriguez
>Assignee: Jesus Camacho Rodriguez
>Priority: Major
> Attachments: HIVE-21794.01.patch, HIVE-21794.patch
>
>
> {code}
> > set hive.materializedview.rewriting=false;
> Error: Error while processing statement: Cannot modify
> hive.materializedview.rewriting at runtime. It is not in list of params that
> are allowed to be modified at runtime (state=42000,code=1)
> {code}
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
[jira] [Commented] (HIVE-21793) CBO retrieves column stats even if hive.stats.fetch.column.stats is set to false
[
https://issues.apache.org/jira/browse/HIVE-21793?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16848042#comment-16848042
]
Hive QA commented on HIVE-21793:
Here are the results of testing the latest attachment:
https://issues.apache.org/jira/secure/attachment/12969714/HIVE-21793.01.patch
{color:red}ERROR:{color} -1 due to build exiting with an error
Test results:
https://builds.apache.org/job/PreCommit-HIVE-Build/17309/testReport
Console output: https://builds.apache.org/job/PreCommit-HIVE-Build/17309/console
Test logs: http://104.198.109.242/logs/PreCommit-HIVE-Build-17309/
Messages:
{noformat}
Executing org.apache.hive.ptest.execution.TestCheckPhase
Tests exited with: Exception: Patch URL
https://issues.apache.org/jira/secure/attachment/12969714/HIVE-21793.01.patch
was found in seen patch url's cache and a test was probably run already on it.
Aborting...
{noformat}
This message is automatically generated.
ATTACHMENT ID: 12969714 - PreCommit-HIVE-Build
> CBO retrieves column stats even if hive.stats.fetch.column.stats is set to
> false
>
>
> Key: HIVE-21793
> URL: https://issues.apache.org/jira/browse/HIVE-21793
> Project: Hive
> Issue Type: Bug
> Components: CBO
>Reporter: Jesus Camacho Rodriguez
>Assignee: Jesus Camacho Rodriguez
>Priority: Major
> Attachments: HIVE-21793.01.patch, HIVE-21793.patch
>
>
> When we go through CBO, we end up ignoring the flag value and we always
> retrieve column stats.
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
[jira] [Commented] (HIVE-21794) Add materialized view parameters to sqlStdAuthSafeVarNameRegexes
[
https://issues.apache.org/jira/browse/HIVE-21794?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16848041#comment-16848041
]
Hive QA commented on HIVE-21794:
Here are the results of testing the latest attachment:
https://issues.apache.org/jira/secure/attachment/12969715/HIVE-21794.01.patch
{color:green}SUCCESS:{color} +1 due to 1 test(s) being added or modified.
{color:red}ERROR:{color} -1 due to 1 failed/errored test(s), 16059 tests
executed
*Failed tests:*
{noformat}
org.apache.hadoop.hive.ql.exec.spark.TestSparkSessionTimeout.testMultiSessionSparkSessionTimeout
(batchId=265)
{noformat}
Test results:
https://builds.apache.org/job/PreCommit-HIVE-Build/17308/testReport
Console output: https://builds.apache.org/job/PreCommit-HIVE-Build/17308/console
Test logs: http://104.198.109.242/logs/PreCommit-HIVE-Build-17308/
Messages:
{noformat}
Executing org.apache.hive.ptest.execution.TestCheckPhase
Executing org.apache.hive.ptest.execution.PrepPhase
Executing org.apache.hive.ptest.execution.YetusPhase
Executing org.apache.hive.ptest.execution.ExecutionPhase
Executing org.apache.hive.ptest.execution.ReportingPhase
Tests exited with: TestsFailedException: 1 tests failed
{noformat}
This message is automatically generated.
ATTACHMENT ID: 12969715 - PreCommit-HIVE-Build
> Add materialized view parameters to sqlStdAuthSafeVarNameRegexes
>
>
> Key: HIVE-21794
> URL: https://issues.apache.org/jira/browse/HIVE-21794
> Project: Hive
> Issue Type: Bug
> Components: CBO
>Reporter: Jesus Camacho Rodriguez
>Assignee: Jesus Camacho Rodriguez
>Priority: Major
> Attachments: HIVE-21794.01.patch, HIVE-21794.patch
>
>
> {code}
> > set hive.materializedview.rewriting=false;
> Error: Error while processing statement: Cannot modify
> hive.materializedview.rewriting at runtime. It is not in list of params that
> are allowed to be modified at runtime (state=42000,code=1)
> {code}
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
[jira] [Commented] (HIVE-21794) Add materialized view parameters to sqlStdAuthSafeVarNameRegexes
[
https://issues.apache.org/jira/browse/HIVE-21794?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16848033#comment-16848033
]
Hive QA commented on HIVE-21794:
| (x) *{color:red}-1 overall{color}* |
\\
\\
|| Vote || Subsystem || Runtime || Comment ||
|| || || || {color:brown} Prechecks {color} ||
| {color:green}+1{color} | {color:green} @author {color} | {color:green} 0m
0s{color} | {color:green} The patch does not contain any @author tags. {color} |
|| || || || {color:brown} master Compile Tests {color} ||
| {color:blue}0{color} | {color:blue} mvndep {color} | {color:blue} 2m
26s{color} | {color:blue} Maven dependency ordering for branch {color} |
| {color:green}+1{color} | {color:green} mvninstall {color} | {color:green} 8m
44s{color} | {color:green} master passed {color} |
| {color:green}+1{color} | {color:green} compile {color} | {color:green} 1m
43s{color} | {color:green} master passed {color} |
| {color:green}+1{color} | {color:green} checkstyle {color} | {color:green} 1m
6s{color} | {color:green} master passed {color} |
| {color:blue}0{color} | {color:blue} findbugs {color} | {color:blue} 0m
46s{color} | {color:blue} common in master has 62 extant Findbugs warnings.
{color} |
| {color:blue}0{color} | {color:blue} findbugs {color} | {color:blue} 4m
54s{color} | {color:blue} ql in master has 2258 extant Findbugs warnings.
{color} |
| {color:green}+1{color} | {color:green} javadoc {color} | {color:green} 1m
32s{color} | {color:green} master passed {color} |
|| || || || {color:brown} Patch Compile Tests {color} ||
| {color:blue}0{color} | {color:blue} mvndep {color} | {color:blue} 0m
32s{color} | {color:blue} Maven dependency ordering for patch {color} |
| {color:green}+1{color} | {color:green} mvninstall {color} | {color:green} 2m
5s{color} | {color:green} the patch passed {color} |
| {color:green}+1{color} | {color:green} compile {color} | {color:green} 1m
46s{color} | {color:green} the patch passed {color} |
| {color:green}+1{color} | {color:green} javac {color} | {color:green} 1m
46s{color} | {color:green} the patch passed {color} |
| {color:red}-1{color} | {color:red} checkstyle {color} | {color:red} 0m
19s{color} | {color:red} common: The patch generated 1 new + 431 unchanged - 0
fixed = 432 total (was 431) {color} |
| {color:green}+1{color} | {color:green} whitespace {color} | {color:green} 0m
0s{color} | {color:green} The patch has no whitespace issues. {color} |
| {color:green}+1{color} | {color:green} findbugs {color} | {color:green} 5m
47s{color} | {color:green} the patch passed {color} |
| {color:green}+1{color} | {color:green} javadoc {color} | {color:green} 1m
25s{color} | {color:green} the patch passed {color} |
|| || || || {color:brown} Other Tests {color} ||
| {color:green}+1{color} | {color:green} asflicense {color} | {color:green} 0m
16s{color} | {color:green} The patch does not generate ASF License warnings.
{color} |
| {color:black}{color} | {color:black} {color} | {color:black} 34m 55s{color} |
{color:black} {color} |
\\
\\
|| Subsystem || Report/Notes ||
| Optional Tests | asflicense javac javadoc findbugs checkstyle compile |
| uname | Linux hiveptest-server-upstream 3.16.0-4-amd64 #1 SMP Debian
3.16.43-2+deb8u5 (2017-09-19) x86_64 GNU/Linux |
| Build tool | maven |
| Personality |
/data/hiveptest/working/yetus_PreCommit-HIVE-Build-17308/dev-support/hive-personality.sh
|
| git revision | master / 728b385 |
| Default Java | 1.8.0_111 |
| findbugs | v3.0.0 |
| checkstyle |
http://104.198.109.242/logs//PreCommit-HIVE-Build-17308/yetus/diff-checkstyle-common.txt
|
| modules | C: common ql U: . |
| Console output |
http://104.198.109.242/logs//PreCommit-HIVE-Build-17308/yetus.txt |
| Powered by | Apache Yetushttp://yetus.apache.org |
This message was automatically generated.
> Add materialized view parameters to sqlStdAuthSafeVarNameRegexes
>
>
> Key: HIVE-21794
> URL: https://issues.apache.org/jira/browse/HIVE-21794
> Project: Hive
> Issue Type: Bug
> Components: CBO
>Reporter: Jesus Camacho Rodriguez
>Assignee: Jesus Camacho Rodriguez
>Priority: Major
> Attachments: HIVE-21794.01.patch, HIVE-21794.patch
>
>
> {code}
> > set hive.materializedview.rewriting=false;
> Error: Error while processing statement: Cannot modify
> hive.materializedview.rewriting at runtime. It is not in list of params that
> are allowed to be modified at runtime (state=42000,code=1)
> {code}
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
[jira] [Commented] (HIVE-21793) CBO retrieves column stats even if hive.stats.fetch.column.stats is set to false
[
https://issues.apache.org/jira/browse/HIVE-21793?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16848028#comment-16848028
]
Hive QA commented on HIVE-21793:
Here are the results of testing the latest attachment:
https://issues.apache.org/jira/secure/attachment/12969714/HIVE-21793.01.patch
{color:green}SUCCESS:{color} +1 due to 1 test(s) being added or modified.
{color:red}ERROR:{color} -1 due to 73 failed/errored test(s), 16060 tests
executed
*Failed tests:*
{noformat}
org.apache.hadoop.hive.cli.TestCliDriver.testCliDriver[mapjoin_mapjoin]
(batchId=55)
org.apache.hadoop.hive.cli.TestMiniLlapCliDriver.testCliDriver[explainuser_2]
(batchId=158)
org.apache.hadoop.hive.cli.TestSparkCliDriver.testCliDriver[auto_join_without_localtask]
(batchId=112)
org.apache.hadoop.hive.cli.TestSparkCliDriver.testCliDriver[auto_sortmerge_join_6]
(batchId=119)
org.apache.hadoop.hive.cli.TestSparkCliDriver.testCliDriver[bucket_map_join_tez1]
(batchId=151)
org.apache.hadoop.hive.cli.TestSparkCliDriver.testCliDriver[bucket_map_join_tez2]
(batchId=117)
org.apache.hadoop.hive.cli.TestSparkCliDriver.testCliDriver[join32]
(batchId=120)
org.apache.hadoop.hive.cli.TestSparkCliDriver.testCliDriver[join32_lessSize]
(batchId=115)
org.apache.hadoop.hive.cli.TestSparkCliDriver.testCliDriver[join33]
(batchId=119)
org.apache.hadoop.hive.cli.TestSparkCliDriver.testCliDriver[join_alt_syntax]
(batchId=148)
org.apache.hadoop.hive.cli.TestSparkCliDriver.testCliDriver[join_cond_pushdown_2]
(batchId=139)
org.apache.hadoop.hive.cli.TestSparkCliDriver.testCliDriver[join_cond_pushdown_4]
(batchId=150)
org.apache.hadoop.hive.cli.TestSparkCliDriver.testCliDriver[join_merging]
(batchId=149)
org.apache.hadoop.hive.cli.TestSparkCliDriver.testCliDriver[leftsemijoin]
(batchId=133)
org.apache.hadoop.hive.cli.TestSparkCliDriver.testCliDriver[mapjoin_mapjoin]
(batchId=135)
org.apache.hadoop.hive.cli.TestSparkCliDriver.testCliDriver[subquery_in]
(batchId=141)
org.apache.hadoop.hive.cli.TestSparkCliDriver.testCliDriver[subquery_notin]
(batchId=144)
org.apache.hadoop.hive.cli.TestSparkCliDriver.testCliDriver[subquery_scalar]
(batchId=130)
org.apache.hadoop.hive.cli.TestSparkCliDriver.testCliDriver[subquery_select]
(batchId=130)
org.apache.hadoop.hive.cli.TestSparkCliDriver.testCliDriver[subquery_views]
(batchId=118)
org.apache.hadoop.hive.cli.TestSparkCliDriver.testCliDriver[vectorized_nested_mapjoin]
(batchId=120)
org.apache.hadoop.hive.cli.TestSparkPerfCliDriver.testCliDriver[query13]
(batchId=288)
org.apache.hadoop.hive.cli.TestSparkPerfCliDriver.testCliDriver[query15]
(batchId=288)
org.apache.hadoop.hive.cli.TestSparkPerfCliDriver.testCliDriver[query16]
(batchId=288)
org.apache.hadoop.hive.cli.TestSparkPerfCliDriver.testCliDriver[query18]
(batchId=288)
org.apache.hadoop.hive.cli.TestSparkPerfCliDriver.testCliDriver[query19]
(batchId=288)
org.apache.hadoop.hive.cli.TestSparkPerfCliDriver.testCliDriver[query21]
(batchId=288)
org.apache.hadoop.hive.cli.TestSparkPerfCliDriver.testCliDriver[query23]
(batchId=288)
org.apache.hadoop.hive.cli.TestSparkPerfCliDriver.testCliDriver[query24]
(batchId=288)
org.apache.hadoop.hive.cli.TestSparkPerfCliDriver.testCliDriver[query25]
(batchId=288)
org.apache.hadoop.hive.cli.TestSparkPerfCliDriver.testCliDriver[query29]
(batchId=288)
org.apache.hadoop.hive.cli.TestSparkPerfCliDriver.testCliDriver[query32]
(batchId=288)
org.apache.hadoop.hive.cli.TestSparkPerfCliDriver.testCliDriver[query35]
(batchId=288)
org.apache.hadoop.hive.cli.TestSparkPerfCliDriver.testCliDriver[query37]
(batchId=288)
org.apache.hadoop.hive.cli.TestSparkPerfCliDriver.testCliDriver[query40]
(batchId=288)
org.apache.hadoop.hive.cli.TestSparkPerfCliDriver.testCliDriver[query44]
(batchId=288)
org.apache.hadoop.hive.cli.TestSparkPerfCliDriver.testCliDriver[query45]
(batchId=288)
org.apache.hadoop.hive.cli.TestSparkPerfCliDriver.testCliDriver[query46]
(batchId=288)
org.apache.hadoop.hive.cli.TestSparkPerfCliDriver.testCliDriver[query47]
(batchId=288)
org.apache.hadoop.hive.cli.TestSparkPerfCliDriver.testCliDriver[query48]
(batchId=288)
org.apache.hadoop.hive.cli.TestSparkPerfCliDriver.testCliDriver[query4]
(batchId=288)
org.apache.hadoop.hive.cli.TestSparkPerfCliDriver.testCliDriver[query50]
(batchId=288)
org.apache.hadoop.hive.cli.TestSparkPerfCliDriver.testCliDriver[query53]
(batchId=288)
org.apache.hadoop.hive.cli.TestSparkPerfCliDriver.testCliDriver[query54]
(batchId=288)
org.apache.hadoop.hive.cli.TestSparkPerfCliDriver.testCliDriver[query57]
(batchId=288)
org.apache.hadoop.hive.cli.TestSparkPerfCliDriver.testCliDriver[query58]
(batchId=288)
org.apache.hadoop.hive.cli.TestSparkPerfCliDriver.testCliDriver[query5]
(batchId=288)
org.apache.hadoop.hive.cli.TestSparkPerfCliDriver.testCliDriver[query61]
(batchId=288)
org.apache.hadoop.hive.cli.TestSparkPerfCliDriver.testCliDriver[query63]
(batchId=288)
[jira] [Commented] (HIVE-20854) Sensible Defaults: Hive's Zookeeper heartbeat interval is 20 minutes, change to 2
[
https://issues.apache.org/jira/browse/HIVE-20854?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16848016#comment-16848016
]
Hive QA commented on HIVE-20854:
Here are the results of testing the latest attachment:
https://issues.apache.org/jira/secure/attachment/12969691/HIVE-20854.2.patch
{color:red}ERROR:{color} -1 due to no test(s) being added or modified.
{color:red}ERROR:{color} -1 due to 2 failed/errored test(s), 16056 tests
executed
*Failed tests:*
{noformat}
org.apache.hadoop.hive.ql.lockmgr.TestDbTxnManager2.testWriteSetTracking3
(batchId=338)
org.apache.hadoop.hive.ql.parse.TestStatsReplicationScenarios.org.apache.hadoop.hive.ql.parse.TestStatsReplicationScenarios
(batchId=265)
{noformat}
Test results:
https://builds.apache.org/job/PreCommit-HIVE-Build/17306/testReport
Console output: https://builds.apache.org/job/PreCommit-HIVE-Build/17306/console
Test logs: http://104.198.109.242/logs/PreCommit-HIVE-Build-17306/
Messages:
{noformat}
Executing org.apache.hive.ptest.execution.TestCheckPhase
Executing org.apache.hive.ptest.execution.PrepPhase
Executing org.apache.hive.ptest.execution.YetusPhase
Executing org.apache.hive.ptest.execution.ExecutionPhase
Executing org.apache.hive.ptest.execution.ReportingPhase
Tests exited with: TestsFailedException: 2 tests failed
{noformat}
This message is automatically generated.
ATTACHMENT ID: 12969691 - PreCommit-HIVE-Build
> Sensible Defaults: Hive's Zookeeper heartbeat interval is 20 minutes, change
> to 2
> -
>
> Key: HIVE-20854
> URL: https://issues.apache.org/jira/browse/HIVE-20854
> Project: Hive
> Issue Type: Bug
>Reporter: Gopal V
>Assignee: Gopal V
>Priority: Major
> Attachments: HIVE-20854.1.patch, HIVE-20854.2.patch
>
>
> {code}
> HIVE_ZOOKEEPER_SESSION_TIMEOUT("hive.zookeeper.session.timeout",
> "120ms",
> new TimeValidator(TimeUnit.MILLISECONDS),
> "ZooKeeper client's session timeout (in milliseconds). The client is
> disconnected, and as a result, all locks released, \n" +
> "if a heartbeat is not sent in the timeout."),
> {code}
> That's 1,200,000ms which is too long for all practical purposes - a 20 minute
> outage in case a node has a failure is too long.
> That is too long for the JDBC load-balancing, LLAP failure tolerance and the
> lock manager expiry.
> Change to 2 minutes, as a sensible default
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
[jira] [Commented] (HIVE-20854) Sensible Defaults: Hive's Zookeeper heartbeat interval is 20 minutes, change to 2
[
https://issues.apache.org/jira/browse/HIVE-20854?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16848008#comment-16848008
]
Hive QA commented on HIVE-20854:
| (/) *{color:green}+1 overall{color}* |
\\
\\
|| Vote || Subsystem || Runtime || Comment ||
|| || || || {color:brown} Prechecks {color} ||
| {color:green}+1{color} | {color:green} @author {color} | {color:green} 0m
0s{color} | {color:green} The patch does not contain any @author tags. {color} |
|| || || || {color:brown} master Compile Tests {color} ||
| {color:blue}0{color} | {color:blue} mvndep {color} | {color:blue} 2m
10s{color} | {color:blue} Maven dependency ordering for branch {color} |
| {color:green}+1{color} | {color:green} mvninstall {color} | {color:green} 8m
38s{color} | {color:green} master passed {color} |
| {color:green}+1{color} | {color:green} compile {color} | {color:green} 1m
40s{color} | {color:green} master passed {color} |
| {color:green}+1{color} | {color:green} checkstyle {color} | {color:green} 1m
6s{color} | {color:green} master passed {color} |
| {color:blue}0{color} | {color:blue} findbugs {color} | {color:blue} 0m
40s{color} | {color:blue} common in master has 62 extant Findbugs warnings.
{color} |
| {color:blue}0{color} | {color:blue} findbugs {color} | {color:blue} 4m
51s{color} | {color:blue} ql in master has 2258 extant Findbugs warnings.
{color} |
| {color:green}+1{color} | {color:green} javadoc {color} | {color:green} 1m
26s{color} | {color:green} master passed {color} |
|| || || || {color:brown} Patch Compile Tests {color} ||
| {color:blue}0{color} | {color:blue} mvndep {color} | {color:blue} 0m
31s{color} | {color:blue} Maven dependency ordering for patch {color} |
| {color:green}+1{color} | {color:green} mvninstall {color} | {color:green} 2m
5s{color} | {color:green} the patch passed {color} |
| {color:green}+1{color} | {color:green} compile {color} | {color:green} 1m
42s{color} | {color:green} the patch passed {color} |
| {color:green}+1{color} | {color:green} javac {color} | {color:green} 1m
42s{color} | {color:green} the patch passed {color} |
| {color:green}+1{color} | {color:green} checkstyle {color} | {color:green} 1m
7s{color} | {color:green} the patch passed {color} |
| {color:green}+1{color} | {color:green} whitespace {color} | {color:green} 0m
0s{color} | {color:green} The patch has no whitespace issues. {color} |
| {color:green}+1{color} | {color:green} findbugs {color} | {color:green} 5m
47s{color} | {color:green} the patch passed {color} |
| {color:green}+1{color} | {color:green} javadoc {color} | {color:green} 1m
23s{color} | {color:green} the patch passed {color} |
|| || || || {color:brown} Other Tests {color} ||
| {color:green}+1{color} | {color:green} asflicense {color} | {color:green} 0m
16s{color} | {color:green} The patch does not generate ASF License warnings.
{color} |
| {color:black}{color} | {color:black} {color} | {color:black} 34m 14s{color} |
{color:black} {color} |
\\
\\
|| Subsystem || Report/Notes ||
| Optional Tests | asflicense javac javadoc findbugs checkstyle compile |
| uname | Linux hiveptest-server-upstream 3.16.0-4-amd64 #1 SMP Debian
3.16.43-2+deb8u5 (2017-09-19) x86_64 GNU/Linux |
| Build tool | maven |
| Personality |
/data/hiveptest/working/yetus_PreCommit-HIVE-Build-17306/dev-support/hive-personality.sh
|
| git revision | master / 728b385 |
| Default Java | 1.8.0_111 |
| findbugs | v3.0.0 |
| modules | C: common ql U: . |
| Console output |
http://104.198.109.242/logs//PreCommit-HIVE-Build-17306/yetus.txt |
| Powered by | Apache Yetushttp://yetus.apache.org |
This message was automatically generated.
> Sensible Defaults: Hive's Zookeeper heartbeat interval is 20 minutes, change
> to 2
> -
>
> Key: HIVE-20854
> URL: https://issues.apache.org/jira/browse/HIVE-20854
> Project: Hive
> Issue Type: Bug
>Reporter: Gopal V
>Assignee: Gopal V
>Priority: Major
> Attachments: HIVE-20854.1.patch, HIVE-20854.2.patch
>
>
> {code}
> HIVE_ZOOKEEPER_SESSION_TIMEOUT("hive.zookeeper.session.timeout",
> "120ms",
> new TimeValidator(TimeUnit.MILLISECONDS),
> "ZooKeeper client's session timeout (in milliseconds). The client is
> disconnected, and as a result, all locks released, \n" +
> "if a heartbeat is not sent in the timeout."),
> {code}
> That's 1,200,000ms which is too long for all practical purposes - a 20 minute
> outage in case a node has a failure is too long.
> That is too long for the JDBC load-balancing, LLAP failure tolerance and the
> lock manager expiry.
> Change to 2 minutes, as a sensible default
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
[jira] [Commented] (HIVE-21768) JDBC: Strip the default union prefix for un-enclosed UNION queries
[
https://issues.apache.org/jira/browse/HIVE-21768?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16847999#comment-16847999
]
Jesus Camacho Rodriguez commented on HIVE-21768:
+1
> JDBC: Strip the default union prefix for un-enclosed UNION queries
> --
>
> Key: HIVE-21768
> URL: https://issues.apache.org/jira/browse/HIVE-21768
> Project: Hive
> Issue Type: Bug
> Components: Logical Optimizer
>Affects Versions: 4.0.0, 3.1.1
>Reporter: Gopal V
>Assignee: Gopal V
>Priority: Major
> Attachments: HIVE-21768.1.patch, HIVE-21768.2.patch,
> HIVE-21768.3.patch, HIVE-21768.4.patch
>
>
> {code}
> beeline> select 1 union all select 2;
> +--+
> | _u1._c0 |
> +--+
> | 2|
> | 1|
> +--+
> {code}
> The _u1 is superfluous and harmful to result schema parsing.
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
[jira] [Commented] (HIVE-21768) JDBC: Strip the default union prefix for un-enclosed UNION queries
[
https://issues.apache.org/jira/browse/HIVE-21768?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16847995#comment-16847995
]
Hive QA commented on HIVE-21768:
Here are the results of testing the latest attachment:
https://issues.apache.org/jira/secure/attachment/12969675/HIVE-21768.4.patch
{color:green}SUCCESS:{color} +1 due to 1 test(s) being added or modified.
{color:green}SUCCESS:{color} +1 due to 16060 tests passed
Test results:
https://builds.apache.org/job/PreCommit-HIVE-Build/17305/testReport
Console output: https://builds.apache.org/job/PreCommit-HIVE-Build/17305/console
Test logs: http://104.198.109.242/logs/PreCommit-HIVE-Build-17305/
Messages:
{noformat}
Executing org.apache.hive.ptest.execution.TestCheckPhase
Executing org.apache.hive.ptest.execution.PrepPhase
Executing org.apache.hive.ptest.execution.YetusPhase
Executing org.apache.hive.ptest.execution.ExecutionPhase
Executing org.apache.hive.ptest.execution.ReportingPhase
{noformat}
This message is automatically generated.
ATTACHMENT ID: 12969675 - PreCommit-HIVE-Build
> JDBC: Strip the default union prefix for un-enclosed UNION queries
> --
>
> Key: HIVE-21768
> URL: https://issues.apache.org/jira/browse/HIVE-21768
> Project: Hive
> Issue Type: Bug
> Components: Logical Optimizer
>Affects Versions: 4.0.0, 3.1.1
>Reporter: Gopal V
>Assignee: Gopal V
>Priority: Major
> Attachments: HIVE-21768.1.patch, HIVE-21768.2.patch,
> HIVE-21768.3.patch, HIVE-21768.4.patch
>
>
> {code}
> beeline> select 1 union all select 2;
> +--+
> | _u1._c0 |
> +--+
> | 2|
> | 1|
> +--+
> {code}
> The _u1 is superfluous and harmful to result schema parsing.
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
[jira] [Commented] (HIVE-21768) JDBC: Strip the default union prefix for un-enclosed UNION queries
[
https://issues.apache.org/jira/browse/HIVE-21768?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16847981#comment-16847981
]
Hive QA commented on HIVE-21768:
| (x) *{color:red}-1 overall{color}* |
\\
\\
|| Vote || Subsystem || Runtime || Comment ||
|| || || || {color:brown} Prechecks {color} ||
| {color:green}+1{color} | {color:green} @author {color} | {color:green} 0m
0s{color} | {color:green} The patch does not contain any @author tags. {color} |
|| || || || {color:brown} master Compile Tests {color} ||
| {color:blue}0{color} | {color:blue} mvndep {color} | {color:blue} 2m
7s{color} | {color:blue} Maven dependency ordering for branch {color} |
| {color:green}+1{color} | {color:green} mvninstall {color} | {color:green} 8m
49s{color} | {color:green} master passed {color} |
| {color:green}+1{color} | {color:green} compile {color} | {color:green} 2m
16s{color} | {color:green} master passed {color} |
| {color:green}+1{color} | {color:green} checkstyle {color} | {color:green} 1m
15s{color} | {color:green} master passed {color} |
| {color:blue}0{color} | {color:blue} findbugs {color} | {color:blue} 4m
50s{color} | {color:blue} ql in master has 2258 extant Findbugs warnings.
{color} |
| {color:blue}0{color} | {color:blue} findbugs {color} | {color:blue} 0m
49s{color} | {color:blue} itests/hive-unit in master has 2 extant Findbugs
warnings. {color} |
| {color:green}+1{color} | {color:green} javadoc {color} | {color:green} 1m
39s{color} | {color:green} master passed {color} |
|| || || || {color:brown} Patch Compile Tests {color} ||
| {color:blue}0{color} | {color:blue} mvndep {color} | {color:blue} 0m
33s{color} | {color:blue} Maven dependency ordering for patch {color} |
| {color:green}+1{color} | {color:green} mvninstall {color} | {color:green} 2m
32s{color} | {color:green} the patch passed {color} |
| {color:green}+1{color} | {color:green} compile {color} | {color:green} 2m
9s{color} | {color:green} the patch passed {color} |
| {color:green}+1{color} | {color:green} javac {color} | {color:green} 2m
9s{color} | {color:green} the patch passed {color} |
| {color:red}-1{color} | {color:red} checkstyle {color} | {color:red} 0m
51s{color} | {color:red} ql: The patch generated 1 new + 464 unchanged - 0
fixed = 465 total (was 464) {color} |
| {color:green}+1{color} | {color:green} whitespace {color} | {color:green} 0m
0s{color} | {color:green} The patch has no whitespace issues. {color} |
| {color:green}+1{color} | {color:green} findbugs {color} | {color:green} 5m
54s{color} | {color:green} the patch passed {color} |
| {color:green}+1{color} | {color:green} javadoc {color} | {color:green} 1m
40s{color} | {color:green} the patch passed {color} |
|| || || || {color:brown} Other Tests {color} ||
| {color:green}+1{color} | {color:green} asflicense {color} | {color:green} 0m
16s{color} | {color:green} The patch does not generate ASF License warnings.
{color} |
| {color:black}{color} | {color:black} {color} | {color:black} 36m 53s{color} |
{color:black} {color} |
\\
\\
|| Subsystem || Report/Notes ||
| Optional Tests | asflicense javac javadoc findbugs checkstyle compile |
| uname | Linux hiveptest-server-upstream 3.16.0-4-amd64 #1 SMP Debian
3.16.43-2+deb8u5 (2017-09-19) x86_64 GNU/Linux |
| Build tool | maven |
| Personality |
/data/hiveptest/working/yetus_PreCommit-HIVE-Build-17305/dev-support/hive-personality.sh
|
| git revision | master / 728b385 |
| Default Java | 1.8.0_111 |
| findbugs | v3.0.0 |
| checkstyle |
http://104.198.109.242/logs//PreCommit-HIVE-Build-17305/yetus/diff-checkstyle-ql.txt
|
| modules | C: ql itests/hive-unit U: . |
| Console output |
http://104.198.109.242/logs//PreCommit-HIVE-Build-17305/yetus.txt |
| Powered by | Apache Yetushttp://yetus.apache.org |
This message was automatically generated.
> JDBC: Strip the default union prefix for un-enclosed UNION queries
> --
>
> Key: HIVE-21768
> URL: https://issues.apache.org/jira/browse/HIVE-21768
> Project: Hive
> Issue Type: Bug
> Components: Logical Optimizer
>Affects Versions: 4.0.0, 3.1.1
>Reporter: Gopal V
>Assignee: Gopal V
>Priority: Major
> Attachments: HIVE-21768.1.patch, HIVE-21768.2.patch,
> HIVE-21768.3.patch, HIVE-21768.4.patch
>
>
> {code}
> beeline> select 1 union all select 2;
> +--+
> | _u1._c0 |
> +--+
> | 2|
> | 1|
> +--+
> {code}
> The _u1 is superfluous and harmful to result schema parsing.
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
[jira] [Updated] (HIVE-21794) Add materialized view parameters to sqlStdAuthSafeVarNameRegexes
[
https://issues.apache.org/jira/browse/HIVE-21794?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Jesus Camacho Rodriguez updated HIVE-21794:
---
Description:
{code}
> set hive.materializedview.rewriting=false;
Error: Error while processing statement: Cannot modify
hive.materializedview.rewriting at runtime. It is not in list of params that
are allowed to be modified at runtime (state=42000,code=1)
{code}
> Add materialized view parameters to sqlStdAuthSafeVarNameRegexes
>
>
> Key: HIVE-21794
> URL: https://issues.apache.org/jira/browse/HIVE-21794
> Project: Hive
> Issue Type: Bug
> Components: CBO
>Reporter: Jesus Camacho Rodriguez
>Assignee: Jesus Camacho Rodriguez
>Priority: Major
> Attachments: HIVE-21794.01.patch, HIVE-21794.patch
>
>
> {code}
> > set hive.materializedview.rewriting=false;
> Error: Error while processing statement: Cannot modify
> hive.materializedview.rewriting at runtime. It is not in list of params that
> are allowed to be modified at runtime (state=42000,code=1)
> {code}
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
[jira] [Updated] (HIVE-21794) Add materialized view parameters to sqlStdAuthSafeVarNameRegexes
[ https://issues.apache.org/jira/browse/HIVE-21794?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jesus Camacho Rodriguez updated HIVE-21794: --- Attachment: HIVE-21794.01.patch > Add materialized view parameters to sqlStdAuthSafeVarNameRegexes > > > Key: HIVE-21794 > URL: https://issues.apache.org/jira/browse/HIVE-21794 > Project: Hive > Issue Type: Bug > Components: CBO >Reporter: Jesus Camacho Rodriguez >Assignee: Jesus Camacho Rodriguez >Priority: Major > Attachments: HIVE-21794.01.patch, HIVE-21794.patch > > -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[jira] [Updated] (HIVE-21793) CBO retrieves column stats even if hive.stats.fetch.column.stats is set to false
[ https://issues.apache.org/jira/browse/HIVE-21793?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jesus Camacho Rodriguez updated HIVE-21793: --- Attachment: HIVE-21793.01.patch > CBO retrieves column stats even if hive.stats.fetch.column.stats is set to > false > > > Key: HIVE-21793 > URL: https://issues.apache.org/jira/browse/HIVE-21793 > Project: Hive > Issue Type: Bug > Components: CBO >Reporter: Jesus Camacho Rodriguez >Assignee: Jesus Camacho Rodriguez >Priority: Major > Attachments: HIVE-21793.01.patch, HIVE-21793.patch > > > When we go through CBO, we end up ignoring the flag value and we always > retrieve column stats. -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[jira] [Commented] (HIVE-16906) Hive ATSHook should check for yarn.timeline-service.enabled before connecting to ATS
[
https://issues.apache.org/jira/browse/HIVE-16906?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16847967#comment-16847967
]
Hive QA commented on HIVE-16906:
Here are the results of testing the latest attachment:
https://issues.apache.org/jira/secure/attachment/12969674/HIVE-16906.3.patch
{color:red}ERROR:{color} -1 due to build exiting with an error
Test results:
https://builds.apache.org/job/PreCommit-HIVE-Build/17304/testReport
Console output: https://builds.apache.org/job/PreCommit-HIVE-Build/17304/console
Test logs: http://104.198.109.242/logs/PreCommit-HIVE-Build-17304/
Messages:
{noformat}
Executing org.apache.hive.ptest.execution.TestCheckPhase
Tests exited with: Exception: Patch URL
https://issues.apache.org/jira/secure/attachment/12969674/HIVE-16906.3.patch
was found in seen patch url's cache and a test was probably run already on it.
Aborting...
{noformat}
This message is automatically generated.
ATTACHMENT ID: 12969674 - PreCommit-HIVE-Build
> Hive ATSHook should check for yarn.timeline-service.enabled before connecting
> to ATS
>
>
> Key: HIVE-16906
> URL: https://issues.apache.org/jira/browse/HIVE-16906
> Project: Hive
> Issue Type: Bug
> Components: Hive
>Affects Versions: 1.2.2
>Reporter: Prabhu Joseph
>Assignee: Naresh P R
>Priority: Major
> Attachments: HIVE-16906.1.patch, HIVE-16906.2.patch,
> HIVE-16906.3.patch
>
>
> Hive ATShook has to check yarn.timeline-service.enabled (Indicate to clients
> whether timeline service is enabled or not. If enabled, clients will put
> entities and events to the timeline server.) before creating TimelineClient
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
[jira] [Commented] (HIVE-21786) Update repo URLs in poms
[
https://issues.apache.org/jira/browse/HIVE-21786?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16847963#comment-16847963
]
Hive QA commented on HIVE-21786:
Here are the results of testing the latest attachment:
https://issues.apache.org/jira/secure/attachment/12969659/HIVE-21786.patch
{color:red}ERROR:{color} -1 due to no test(s) being added or modified.
{color:green}SUCCESS:{color} +1 due to 16059 tests passed
Test results:
https://builds.apache.org/job/PreCommit-HIVE-Build/17303/testReport
Console output: https://builds.apache.org/job/PreCommit-HIVE-Build/17303/console
Test logs: http://104.198.109.242/logs/PreCommit-HIVE-Build-17303/
Messages:
{noformat}
Executing org.apache.hive.ptest.execution.TestCheckPhase
Executing org.apache.hive.ptest.execution.PrepPhase
Executing org.apache.hive.ptest.execution.YetusPhase
Executing org.apache.hive.ptest.execution.ExecutionPhase
Executing org.apache.hive.ptest.execution.ReportingPhase
{noformat}
This message is automatically generated.
ATTACHMENT ID: 12969659 - PreCommit-HIVE-Build
> Update repo URLs in poms
>
>
> Key: HIVE-21786
> URL: https://issues.apache.org/jira/browse/HIVE-21786
> Project: Hive
> Issue Type: Bug
> Components: Build Infrastructure
>Affects Versions: 4.0.0, 3.1.1, 2.3.5
>Reporter: Alan Gates
>Assignee: Alan Gates
>Priority: Major
> Attachments: HIVE-21786.patch
>
>
> Need to update repo URLs in the poms.
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
[jira] [Commented] (HIVE-21786) Update repo URLs in poms
[
https://issues.apache.org/jira/browse/HIVE-21786?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16847955#comment-16847955
]
Hive QA commented on HIVE-21786:
| (x) *{color:red}-1 overall{color}* |
\\
\\
|| Vote || Subsystem || Runtime || Comment ||
|| || || || {color:brown} Prechecks {color} ||
| {color:green}+1{color} | {color:green} @author {color} | {color:green} 0m
0s{color} | {color:green} The patch does not contain any @author tags. {color} |
|| || || || {color:brown} master Compile Tests {color} ||
| {color:blue}0{color} | {color:blue} mvndep {color} | {color:blue} 2m
6s{color} | {color:blue} Maven dependency ordering for branch {color} |
| {color:green}+1{color} | {color:green} mvninstall {color} | {color:green} 8m
15s{color} | {color:green} master passed {color} |
| {color:green}+1{color} | {color:green} compile {color} | {color:green} 8m
36s{color} | {color:green} master passed {color} |
| {color:green}+1{color} | {color:green} javadoc {color} | {color:green} 9m
15s{color} | {color:green} master passed {color} |
|| || || || {color:brown} Patch Compile Tests {color} ||
| {color:blue}0{color} | {color:blue} mvndep {color} | {color:blue} 0m
26s{color} | {color:blue} Maven dependency ordering for patch {color} |
| {color:green}+1{color} | {color:green} mvninstall {color} | {color:green} 9m
34s{color} | {color:green} the patch passed {color} |
| {color:green}+1{color} | {color:green} compile {color} | {color:green} 8m
25s{color} | {color:green} the patch passed {color} |
| {color:green}+1{color} | {color:green} javac {color} | {color:green} 8m
25s{color} | {color:green} the patch passed {color} |
| {color:green}+1{color} | {color:green} whitespace {color} | {color:green} 0m
0s{color} | {color:green} The patch has no whitespace issues. {color} |
| {color:green}+1{color} | {color:green} xml {color} | {color:green} 0m
5s{color} | {color:green} The patch has no ill-formed XML file. {color} |
| {color:green}+1{color} | {color:green} javadoc {color} | {color:green} 9m
31s{color} | {color:green} the patch passed {color} |
|| || || || {color:brown} Other Tests {color} ||
| {color:red}-1{color} | {color:red} asflicense {color} | {color:red} 0m
14s{color} | {color:red} The patch generated 3 ASF License warnings. {color} |
| {color:black}{color} | {color:black} {color} | {color:black} 57m 5s{color} |
{color:black} {color} |
\\
\\
|| Subsystem || Report/Notes ||
| Optional Tests | asflicense javac javadoc xml compile |
| uname | Linux hiveptest-server-upstream 3.16.0-4-amd64 #1 SMP Debian
3.16.43-2+deb8u5 (2017-09-19) x86_64 GNU/Linux |
| Build tool | maven |
| Personality |
/data/hiveptest/working/yetus_PreCommit-HIVE-Build-17303/dev-support/hive-personality.sh
|
| git revision | master / 728b385 |
| Default Java | 1.8.0_111 |
| asflicense |
http://104.198.109.242/logs//PreCommit-HIVE-Build-17303/yetus/patch-asflicense-problems.txt
|
| modules | C: standalone-metastore/metastore-common
standalone-metastore/metastore-server . testutils/ptest2 U: . |
| Console output |
http://104.198.109.242/logs//PreCommit-HIVE-Build-17303/yetus.txt |
| Powered by | Apache Yetushttp://yetus.apache.org |
This message was automatically generated.
> Update repo URLs in poms
>
>
> Key: HIVE-21786
> URL: https://issues.apache.org/jira/browse/HIVE-21786
> Project: Hive
> Issue Type: Bug
> Components: Build Infrastructure
>Affects Versions: 4.0.0, 3.1.1, 2.3.5
>Reporter: Alan Gates
>Assignee: Alan Gates
>Priority: Major
> Attachments: HIVE-21786.patch
>
>
> Need to update repo URLs in the poms.
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
[jira] [Assigned] (HIVE-21794) Add materialized view parameters to sqlStdAuthSafeVarNameRegexes
[ https://issues.apache.org/jira/browse/HIVE-21794?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jesus Camacho Rodriguez reassigned HIVE-21794: -- > Add materialized view parameters to sqlStdAuthSafeVarNameRegexes > > > Key: HIVE-21794 > URL: https://issues.apache.org/jira/browse/HIVE-21794 > Project: Hive > Issue Type: Bug > Components: CBO >Reporter: Jesus Camacho Rodriguez >Assignee: Jesus Camacho Rodriguez >Priority: Major > Attachments: HIVE-21794.patch > > -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[jira] [Updated] (HIVE-21794) Add materialized view parameters to sqlStdAuthSafeVarNameRegexes
[ https://issues.apache.org/jira/browse/HIVE-21794?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jesus Camacho Rodriguez updated HIVE-21794: --- Attachment: HIVE-21794.patch > Add materialized view parameters to sqlStdAuthSafeVarNameRegexes > > > Key: HIVE-21794 > URL: https://issues.apache.org/jira/browse/HIVE-21794 > Project: Hive > Issue Type: Bug > Components: CBO >Reporter: Jesus Camacho Rodriguez >Assignee: Jesus Camacho Rodriguez >Priority: Major > Attachments: HIVE-21794.patch > > -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[jira] [Work started] (HIVE-21794) Add materialized view parameters to sqlStdAuthSafeVarNameRegexes
[ https://issues.apache.org/jira/browse/HIVE-21794?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Work on HIVE-21794 started by Jesus Camacho Rodriguez. -- > Add materialized view parameters to sqlStdAuthSafeVarNameRegexes > > > Key: HIVE-21794 > URL: https://issues.apache.org/jira/browse/HIVE-21794 > Project: Hive > Issue Type: Bug > Components: CBO >Reporter: Jesus Camacho Rodriguez >Assignee: Jesus Camacho Rodriguez >Priority: Major > Attachments: HIVE-21794.patch > > -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[jira] [Updated] (HIVE-21794) Add materialized view parameters to sqlStdAuthSafeVarNameRegexes
[ https://issues.apache.org/jira/browse/HIVE-21794?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jesus Camacho Rodriguez updated HIVE-21794: --- Status: Patch Available (was: In Progress) > Add materialized view parameters to sqlStdAuthSafeVarNameRegexes > > > Key: HIVE-21794 > URL: https://issues.apache.org/jira/browse/HIVE-21794 > Project: Hive > Issue Type: Bug > Components: CBO >Reporter: Jesus Camacho Rodriguez >Assignee: Jesus Camacho Rodriguez >Priority: Major > Attachments: HIVE-21794.patch > > -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[jira] [Updated] (HIVE-21793) CBO retrieves column stats even if hive.stats.fetch.column.stats is set to false
[ https://issues.apache.org/jira/browse/HIVE-21793?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jesus Camacho Rodriguez updated HIVE-21793: --- Status: Patch Available (was: In Progress) > CBO retrieves column stats even if hive.stats.fetch.column.stats is set to > false > > > Key: HIVE-21793 > URL: https://issues.apache.org/jira/browse/HIVE-21793 > Project: Hive > Issue Type: Bug > Components: CBO >Reporter: Jesus Camacho Rodriguez >Assignee: Jesus Camacho Rodriguez >Priority: Major > Attachments: HIVE-21793.patch > > > When we go through CBO, we end up ignoring the flag value and we always > retrieve column stats. -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[jira] [Work started] (HIVE-21793) CBO retrieves column stats even if hive.stats.fetch.column.stats is set to false
[ https://issues.apache.org/jira/browse/HIVE-21793?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Work on HIVE-21793 started by Jesus Camacho Rodriguez. -- > CBO retrieves column stats even if hive.stats.fetch.column.stats is set to > false > > > Key: HIVE-21793 > URL: https://issues.apache.org/jira/browse/HIVE-21793 > Project: Hive > Issue Type: Bug > Components: CBO >Reporter: Jesus Camacho Rodriguez >Assignee: Jesus Camacho Rodriguez >Priority: Major > Attachments: HIVE-21793.patch > > > When we go through CBO, we end up ignoring the flag value and we always > retrieve column stats. -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[jira] [Updated] (HIVE-21793) CBO retrieves column stats even if hive.stats.fetch.column.stats is set to false
[ https://issues.apache.org/jira/browse/HIVE-21793?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jesus Camacho Rodriguez updated HIVE-21793: --- Attachment: HIVE-21793.patch > CBO retrieves column stats even if hive.stats.fetch.column.stats is set to > false > > > Key: HIVE-21793 > URL: https://issues.apache.org/jira/browse/HIVE-21793 > Project: Hive > Issue Type: Bug > Components: CBO >Reporter: Jesus Camacho Rodriguez >Assignee: Jesus Camacho Rodriguez >Priority: Major > Attachments: HIVE-21793.patch > > > When we go through CBO, we end up ignoring the flag value and we always > retrieve column stats. -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[jira] [Assigned] (HIVE-21793) CBO retrieves column stats even if hive.stats.fetch.column.stats is set to false
[ https://issues.apache.org/jira/browse/HIVE-21793?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jesus Camacho Rodriguez reassigned HIVE-21793: -- > CBO retrieves column stats even if hive.stats.fetch.column.stats is set to > false > > > Key: HIVE-21793 > URL: https://issues.apache.org/jira/browse/HIVE-21793 > Project: Hive > Issue Type: Bug > Components: CBO >Reporter: Jesus Camacho Rodriguez >Assignee: Jesus Camacho Rodriguez >Priority: Major > > When we go through CBO, we end up ignoring the flag value and we always > retrieve column stats. -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[jira] [Comment Edited] (HIVE-21792) Hive Indexes... Again
[
https://issues.apache.org/jira/browse/HIVE-21792?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16847889#comment-16847889
]
Jesus Camacho Rodriguez edited comment on HIVE-21792 at 5/24/19 10:17 PM:
--
Posted from a discussion summary.
{quote}
Since this keeps coming up again, the mental model I was working off was the
Postgres one (the old Hive index was the Mysql one).
The MV UNION rewrite from Jesus allows for the equivalent of
https://www.postgresql.org/docs/9.2/indexes-partial.html
+
https://www.postgresql.org/docs/9.2/indexes-expressional.html
+
new hotness ("Covering indexes") -
https://www.postgresql.org/docs/current/indexes-index-only-scans.html
So the MV + ORC internal index can also the cover the new CREATE INDEX tab_x_y
ON tab\(x) INCLUDE \(y); internally.
We however need to support CLUSTER BY / SORT BY in the MVs to refine the
internal indexes (i.e to match the ROW__ID sort order to the data key order).
And we keep evolving our ACID story, the Postgres model becomes even more
relevant (rather than the mysql one), because every row has a unique identifier
which the index can refer to & that all ORC files are always sorted on the
row-identifier (i.e = of row-id will always read only 10k row-batch, even with
just min-max).
For a comparison between the INDEX model of Postgres v Mysql, look at the index
issues discussed in (though this calls Postgres as bad).
https://eng.uber.com/mysql-migration/
The Mysql model is superior when you have a large number of indexes + OLTP
workloads (which Hive definitely is not).
{quote}
{quote}
The HDFS based Hive index handler proved to be mostly useless with columnar
data + bloom filter indexes within files. The performance improvements indexes
offered for Avro & RCFile have since disappeared.
The feature linked here is the storage of index as flat files on HDFS (they are
immutable & force a full rebuild) & instead move to the more advanced
materialized views lifecycle (which are transactionally updatable & can store
aggregate rollups too).
In a lot of production scenarios, the index scan was slower than the ORC
scanners - which led us to implement indexes stored as ORC, which has
eventually morphed into a full scale materialized view implementation with
incremental refresh instead of being limited to indexes.
So we went from asking folks to do indexes over denormalized tables like
CREATE INDEX idx_c_zip
ON TABLE CUSTOMER_DENORM (c_zipcode) AS
‘org.apache.hadoop.hive.ql.index.compact.CompactIndexHandler’
WITH DEFERRED REBUILD
STORED AS ORC
;
to asking them to build them over relational tables with joins & pk/fk
relationships.
CREATE MATERIALIZED VIEW
SELECT CA_zip, CA_state, count(distinct C_CUSTOMER_ID)
FROM customer, customer_address WHERE
c_current_addr_sk = ca_addr_sk
GROUP BY CA_state, CA_zip
;
We did not remove that feature as much as make it match entire plan fragments,
rather than just a single scan + filter + aggregate.
{quote}
was (Author: gopalv):
Posted from a discussion summary.
{quote}
Since this keeps coming up again, the mental model I was working off was the
Postgres one (the old Hive index was the Mysql one).
The MV UNION rewrite from Jesus allows for the equivalent of
https://www.postgresql.org/docs/9.2/indexes-partial.html
+
https://www.postgresql.org/docs/9.2/indexes-expressional.html
+
new hotness ("Covering indexes") -
https://www.postgresql.org/docs/current/indexes-index-only-scans.html
So the MV + ORC internal index can also the cover the new CREATE INDEX tab_x_y
ON tab(x) INCLUDE (y); internally.
We however need to support CLUSTER BY / SORT BY in the MVs to refine the
internal indexes (i.e to match the ROW__ID sort order to the data key order).
And we keep evolving our ACID story, the Postgres model becomes even more
relevant (rather than the mysql one), because every row has a unique identifier
which the index can refer to & that all ORC files are always sorted on the
row-identifier (i.e = of row-id will always read only 10k row-batch, even with
just min-max).
For a comparison between the INDEX model of Postgres v Mysql, look at the index
issues discussed in (though this calls Postgres as bad).
https://eng.uber.com/mysql-migration/
The Mysql model is superior when you have a large number of indexes + OLTP
workloads (which Hive definitely is not).
{quote}
{quote}
The HDFS based Hive index handler proved to be mostly useless with columnar
data + bloom filter indexes within files. The performance improvements indexes
offered for Avro & RCFile have since disappeared.
The feature linked here is the storage of index as flat files on HDFS (they are
immutable & force a full rebuild) & instead move to the more advanced
materialized views lifecycle (which are transactionally updatable & can store
aggregate rollups too).
In a lot of production scenarios, the index scan
[jira] [Commented] (HIVE-16906) Hive ATSHook should check for yarn.timeline-service.enabled before connecting to ATS
[
https://issues.apache.org/jira/browse/HIVE-16906?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16847921#comment-16847921
]
Hive QA commented on HIVE-16906:
Here are the results of testing the latest attachment:
https://issues.apache.org/jira/secure/attachment/12969674/HIVE-16906.3.patch
{color:red}ERROR:{color} -1 due to no test(s) being added or modified.
{color:red}ERROR:{color} -1 due to 1 failed/errored test(s), 16059 tests
executed
*Failed tests:*
{noformat}
org.apache.hive.hcatalog.mapreduce.TestHCatPartitioned.testHCatPartitionedTable[2]
(batchId=211)
{noformat}
Test results:
https://builds.apache.org/job/PreCommit-HIVE-Build/17302/testReport
Console output: https://builds.apache.org/job/PreCommit-HIVE-Build/17302/console
Test logs: http://104.198.109.242/logs/PreCommit-HIVE-Build-17302/
Messages:
{noformat}
Executing org.apache.hive.ptest.execution.TestCheckPhase
Executing org.apache.hive.ptest.execution.PrepPhase
Executing org.apache.hive.ptest.execution.YetusPhase
Executing org.apache.hive.ptest.execution.ExecutionPhase
Executing org.apache.hive.ptest.execution.ReportingPhase
Tests exited with: TestsFailedException: 1 tests failed
{noformat}
This message is automatically generated.
ATTACHMENT ID: 12969674 - PreCommit-HIVE-Build
> Hive ATSHook should check for yarn.timeline-service.enabled before connecting
> to ATS
>
>
> Key: HIVE-16906
> URL: https://issues.apache.org/jira/browse/HIVE-16906
> Project: Hive
> Issue Type: Bug
> Components: Hive
>Affects Versions: 1.2.2
>Reporter: Prabhu Joseph
>Assignee: Naresh P R
>Priority: Major
> Attachments: HIVE-16906.1.patch, HIVE-16906.2.patch,
> HIVE-16906.3.patch
>
>
> Hive ATShook has to check yarn.timeline-service.enabled (Indicate to clients
> whether timeline service is enabled or not. If enabled, clients will put
> entities and events to the timeline server.) before creating TimelineClient
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
[jira] [Commented] (HIVE-16906) Hive ATSHook should check for yarn.timeline-service.enabled before connecting to ATS
[
https://issues.apache.org/jira/browse/HIVE-16906?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16847893#comment-16847893
]
Hive QA commented on HIVE-16906:
| (/) *{color:green}+1 overall{color}* |
\\
\\
|| Vote || Subsystem || Runtime || Comment ||
|| || || || {color:brown} Prechecks {color} ||
| {color:green}+1{color} | {color:green} @author {color} | {color:green} 0m
0s{color} | {color:green} The patch does not contain any @author tags. {color} |
|| || || || {color:brown} master Compile Tests {color} ||
| {color:green}+1{color} | {color:green} mvninstall {color} | {color:green} 9m
55s{color} | {color:green} master passed {color} |
| {color:green}+1{color} | {color:green} compile {color} | {color:green} 1m
20s{color} | {color:green} master passed {color} |
| {color:green}+1{color} | {color:green} checkstyle {color} | {color:green} 0m
50s{color} | {color:green} master passed {color} |
| {color:blue}0{color} | {color:blue} findbugs {color} | {color:blue} 4m
45s{color} | {color:blue} ql in master has 2258 extant Findbugs warnings.
{color} |
| {color:green}+1{color} | {color:green} javadoc {color} | {color:green} 1m
11s{color} | {color:green} master passed {color} |
|| || || || {color:brown} Patch Compile Tests {color} ||
| {color:green}+1{color} | {color:green} mvninstall {color} | {color:green} 1m
44s{color} | {color:green} the patch passed {color} |
| {color:green}+1{color} | {color:green} compile {color} | {color:green} 1m
18s{color} | {color:green} the patch passed {color} |
| {color:green}+1{color} | {color:green} javac {color} | {color:green} 1m
18s{color} | {color:green} the patch passed {color} |
| {color:green}+1{color} | {color:green} checkstyle {color} | {color:green} 0m
48s{color} | {color:green} the patch passed {color} |
| {color:green}+1{color} | {color:green} whitespace {color} | {color:green} 0m
0s{color} | {color:green} The patch has no whitespace issues. {color} |
| {color:green}+1{color} | {color:green} findbugs {color} | {color:green} 5m
3s{color} | {color:green} the patch passed {color} |
| {color:green}+1{color} | {color:green} javadoc {color} | {color:green} 1m
13s{color} | {color:green} the patch passed {color} |
|| || || || {color:brown} Other Tests {color} ||
| {color:green}+1{color} | {color:green} asflicense {color} | {color:green} 0m
17s{color} | {color:green} The patch does not generate ASF License warnings.
{color} |
| {color:black}{color} | {color:black} {color} | {color:black} 28m 57s{color} |
{color:black} {color} |
\\
\\
|| Subsystem || Report/Notes ||
| Optional Tests | asflicense javac javadoc findbugs checkstyle compile |
| uname | Linux hiveptest-server-upstream 3.16.0-4-amd64 #1 SMP Debian
3.16.43-2+deb8u5 (2017-09-19) x86_64 GNU/Linux |
| Build tool | maven |
| Personality |
/data/hiveptest/working/yetus_PreCommit-HIVE-Build-17302/dev-support/hive-personality.sh
|
| git revision | master / 728b385 |
| Default Java | 1.8.0_111 |
| findbugs | v3.0.0 |
| modules | C: ql U: ql |
| Console output |
http://104.198.109.242/logs//PreCommit-HIVE-Build-17302/yetus.txt |
| Powered by | Apache Yetushttp://yetus.apache.org |
This message was automatically generated.
> Hive ATSHook should check for yarn.timeline-service.enabled before connecting
> to ATS
>
>
> Key: HIVE-16906
> URL: https://issues.apache.org/jira/browse/HIVE-16906
> Project: Hive
> Issue Type: Bug
> Components: Hive
>Affects Versions: 1.2.2
>Reporter: Prabhu Joseph
>Assignee: Naresh P R
>Priority: Major
> Attachments: HIVE-16906.1.patch, HIVE-16906.2.patch,
> HIVE-16906.3.patch
>
>
> Hive ATShook has to check yarn.timeline-service.enabled (Indicate to clients
> whether timeline service is enabled or not. If enabled, clients will put
> entities and events to the timeline server.) before creating TimelineClient
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
[jira] [Updated] (HIVE-20854) Sensible Defaults: Hive's Zookeeper heartbeat interval is 20 minutes, change to 2
[
https://issues.apache.org/jira/browse/HIVE-20854?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Gopal V updated HIVE-20854:
---
Attachment: HIVE-20854.2.patch
> Sensible Defaults: Hive's Zookeeper heartbeat interval is 20 minutes, change
> to 2
> -
>
> Key: HIVE-20854
> URL: https://issues.apache.org/jira/browse/HIVE-20854
> Project: Hive
> Issue Type: Bug
>Reporter: Gopal V
>Assignee: Gopal V
>Priority: Major
> Attachments: HIVE-20854.1.patch, HIVE-20854.2.patch
>
>
> {code}
> HIVE_ZOOKEEPER_SESSION_TIMEOUT("hive.zookeeper.session.timeout",
> "120ms",
> new TimeValidator(TimeUnit.MILLISECONDS),
> "ZooKeeper client's session timeout (in milliseconds). The client is
> disconnected, and as a result, all locks released, \n" +
> "if a heartbeat is not sent in the timeout."),
> {code}
> That's 1,200,000ms which is too long for all practical purposes - a 20 minute
> outage in case a node has a failure is too long.
> That is too long for the JDBC load-balancing, LLAP failure tolerance and the
> lock manager expiry.
> Change to 2 minutes, as a sensible default
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
[jira] [Comment Edited] (HIVE-21792) Hive Indexes... Again
[
https://issues.apache.org/jira/browse/HIVE-21792?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16847889#comment-16847889
]
Gopal V edited comment on HIVE-21792 at 5/24/19 8:56 PM:
-
Posted from a discussion summary.
{quote}
Since this keeps coming up again, the mental model I was working off was the
Postgres one (the old Hive index was the Mysql one).
The MV UNION rewrite from Jesus allows for the equivalent of
https://www.postgresql.org/docs/9.2/indexes-partial.html
+
https://www.postgresql.org/docs/9.2/indexes-expressional.html
+
new hotness ("Covering indexes") -
https://www.postgresql.org/docs/current/indexes-index-only-scans.html
So the MV + ORC internal index can also the cover the new CREATE INDEX tab_x_y
ON tab(x) INCLUDE (y); internally.
We however need to support CLUSTER BY / SORT BY in the MVs to refine the
internal indexes (i.e to match the ROW__ID sort order to the data key order).
And we keep evolving our ACID story, the Postgres model becomes even more
relevant (rather than the mysql one), because every row has a unique identifier
which the index can refer to & that all ORC files are always sorted on the
row-identifier (i.e = of row-id will always read only 10k row-batch, even with
just min-max).
For a comparison between the INDEX model of Postgres v Mysql, look at the index
issues discussed in (though this calls Postgres as bad).
https://eng.uber.com/mysql-migration/
The Mysql model is superior when you have a large number of indexes + OLTP
workloads (which Hive definitely is not).
{quote}
{quote}
The HDFS based Hive index handler proved to be mostly useless with columnar
data + bloom filter indexes within files. The performance improvements indexes
offered for Avro & RCFile have since disappeared.
The feature linked here is the storage of index as flat files on HDFS (they are
immutable & force a full rebuild) & instead move to the more advanced
materialized views lifecycle (which are transactionally updatable & can store
aggregate rollups too).
In a lot of production scenarios, the index scan was slower than the ORC
scanners - which led us to implement indexes stored as ORC, which has
eventually morphed into a full scale materialized view implementation with
incremental refresh instead of being limited to indexes.
So we went from asking folks to do indexes over denormalized tables like
CREATE INDEX idx_c_zip
ON TABLE CUSTOMER_DENORM (c_zipcode) AS
‘org.apache.hadoop.hive.ql.index.compact.CompactIndexHandler’
WITH DEFERRED REBUILD
STORED AS ORC
;
to asking them to build them over relational tables with joins & pk/fk
relationships.
CREATE MATERIALIZED VIEW
SELECT CA_zip, CA_state, count(distinct C_CUSTOMER_ID)
FROM customer, customer_address WHERE
c_current_addr_sk = ca_addr_sk
GROUP BY CA_state, CA_zip
;
We did not remove that feature as much as make it match entire plan fragments,
rather than just a single scan + filter + aggregate.
{quote}
was (Author: gopalv):
Posted from a discussion summary.
{noformat}
Since this keeps coming up again, the mental model I was working off was the
Postgres one (the old Hive index was the Mysql one).
The MV UNION rewrite from Jesus allows for the equivalent of
https://www.postgresql.org/docs/9.2/indexes-partial.html
+
https://www.postgresql.org/docs/9.2/indexes-expressional.html
+
new hotness ("Covering indexes") -
https://www.postgresql.org/docs/current/indexes-index-only-scans.html
So the MV + ORC internal index can also the cover the new CREATE INDEX tab_x_y
ON tab(x) INCLUDE (y); internally.
We however need to support CLUSTER BY / SORT BY in the MVs to refine the
internal indexes (i.e to match the ROW__ID sort order to the data key order).
And we keep evolving our ACID story, the Postgres model becomes even more
relevant (rather than the mysql one), because every row has a unique identifier
which the index can refer to & that all ORC files are always sorted on the
row-identifier (i.e = of row-id will always read only 10k row-batch, even with
just min-max).
For a comparison between the INDEX model of Postgres v Mysql, look at the index
issues discussed in (though this calls Postgres as bad).
https://eng.uber.com/mysql-migration/
The Mysql model is superior when you have a large number of indexes + OLTP
workloads (which Hive definitely is not).
{noformat}
{noformat}
The HDFS based Hive index handler proved to be mostly useless with columnar
data + bloom filter indexes within files. The performance improvements indexes
offered for Avro & RCFile have since disappeared.
The feature linked here is the storage of index as flat files on HDFS (they are
immutable & force a full rebuild) & instead move to the more advanced
materialized views lifecycle (which are transactionally updatable & can store
aggregate rollups too).
In a lot of production scenarios, the index scan was slower than the ORC
[jira] [Commented] (HIVE-21792) Hive Indexes... Again
[
https://issues.apache.org/jira/browse/HIVE-21792?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16847889#comment-16847889
]
Gopal V commented on HIVE-21792:
Posted from a discussion summary.
{noformat}
Since this keeps coming up again, the mental model I was working off was the
Postgres one (the old Hive index was the Mysql one).
The MV UNION rewrite from Jesus allows for the equivalent of
https://www.postgresql.org/docs/9.2/indexes-partial.html
+
https://www.postgresql.org/docs/9.2/indexes-expressional.html
+
new hotness ("Covering indexes") -
https://www.postgresql.org/docs/current/indexes-index-only-scans.html
So the MV + ORC internal index can also the cover the new CREATE INDEX tab_x_y
ON tab(x) INCLUDE (y); internally.
We however need to support CLUSTER BY / SORT BY in the MVs to refine the
internal indexes (i.e to match the ROW__ID sort order to the data key order).
And we keep evolving our ACID story, the Postgres model becomes even more
relevant (rather than the mysql one), because every row has a unique identifier
which the index can refer to & that all ORC files are always sorted on the
row-identifier (i.e = of row-id will always read only 10k row-batch, even with
just min-max).
For a comparison between the INDEX model of Postgres v Mysql, look at the index
issues discussed in (though this calls Postgres as bad).
https://eng.uber.com/mysql-migration/
The Mysql model is superior when you have a large number of indexes + OLTP
workloads (which Hive definitely is not).
{noformat}
{noformat}
The HDFS based Hive index handler proved to be mostly useless with columnar
data + bloom filter indexes within files. The performance improvements indexes
offered for Avro & RCFile have since disappeared.
The feature linked here is the storage of index as flat files on HDFS (they are
immutable & force a full rebuild) & instead move to the more advanced
materialized views lifecycle (which are transactionally updatable & can store
aggregate rollups too).
In a lot of production scenarios, the index scan was slower than the ORC
scanners - which led us to implement indexes stored as ORC, which has
eventually morphed into a full scale materialized view implementation with
incremental refresh instead of being limited to indexes.
So we went from asking folks to do indexes over denormalized tables like
CREATE INDEX idx_c_zip
ON TABLE CUSTOMER_DENORM (c_zipcode) AS
‘org.apache.hadoop.hive.ql.index.compact.CompactIndexHandler’
WITH DEFERRED REBUILD
STORED AS ORC
;
to asking them to build them over relational tables with joins & pk/fk
relationships.
CREATE MATERIALIZED VIEW
SELECT CA_zip, CA_state, count(distinct C_CUSTOMER_ID)
FROM customer, customer_address WHERE
c_current_addr_sk = ca_addr_sk
GROUP BY CA_state, CA_zip
;
We did not remove that feature as much as make it match entire plan fragments,
rather than just a single scan + filter + aggregate.
{noformat}
> Hive Indexes... Again
> -
>
> Key: HIVE-21792
> URL: https://issues.apache.org/jira/browse/HIVE-21792
> Project: Hive
> Issue Type: New Feature
> Components: Indexing
>Reporter: David Mollitor
>Priority: Major
>
> Hive had an implementation of indexing that was made somewhat obsolete given
> the introduction of columnar file formats with their own internal indexing.
> I propose that Hive introduce Indexing again.
> # Column Index: Stored in HBase
> # Full-Text Index: Stored in Solr
> The basic idea is that, the key in HBase is the record and the value is the
> relative file path of the data in the Hive table.
> Performing an INSERT statement creates the index for each record.
> https://dev.mysql.com/doc/refman/8.0/en/create-index.html
> When generating the explain plan, only the files involved in the query are
> considered.
> This would prevents having to scan large amounts of data for the typical BI
> tools when the set of data is known to be very small.
> {code:sql}
> -- Quick retrieval of small sets of records
> select * from user where userid=27;
> -- Full scans
> select count(1) from user;
> {code}
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
[jira] [Commented] (HIVE-21784) Insert overwrite on an acid (not mm) table is ineffective if the input is empty
[
https://issues.apache.org/jira/browse/HIVE-21784?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16847876#comment-16847876
]
Hive QA commented on HIVE-21784:
Here are the results of testing the latest attachment:
https://issues.apache.org/jira/secure/attachment/12969647/HIVE-21784.2.patch
{color:green}SUCCESS:{color} +1 due to 1 test(s) being added or modified.
{color:red}ERROR:{color} -1 due to 2 failed/errored test(s), 16059 tests
executed
*Failed tests:*
{noformat}
org.apache.hadoop.hive.ql.io.orc.TestOrcRawRecordMerger.testEmpty (batchId=313)
org.apache.hadoop.hive.ql.parse.TestReplAcidTablesBootstrapWithJsonMessage.testBootstrapAcidTablesDuringIncrementalWithConcurrentWrites
(batchId=248)
{noformat}
Test results:
https://builds.apache.org/job/PreCommit-HIVE-Build/17301/testReport
Console output: https://builds.apache.org/job/PreCommit-HIVE-Build/17301/console
Test logs: http://104.198.109.242/logs/PreCommit-HIVE-Build-17301/
Messages:
{noformat}
Executing org.apache.hive.ptest.execution.TestCheckPhase
Executing org.apache.hive.ptest.execution.PrepPhase
Executing org.apache.hive.ptest.execution.YetusPhase
Executing org.apache.hive.ptest.execution.ExecutionPhase
Executing org.apache.hive.ptest.execution.ReportingPhase
Tests exited with: TestsFailedException: 2 tests failed
{noformat}
This message is automatically generated.
ATTACHMENT ID: 12969647 - PreCommit-HIVE-Build
> Insert overwrite on an acid (not mm) table is ineffective if the input is
> empty
> ---
>
> Key: HIVE-21784
> URL: https://issues.apache.org/jira/browse/HIVE-21784
> Project: Hive
> Issue Type: Bug
> Components: HiveServer2
>Reporter: Ivan Suller
>Assignee: Ivan Suller
>Priority: Major
> Fix For: 4.0.0
>
> Attachments: HIVE-21784.1.patch, HIVE-21784.2.patch
>
>
> The issue of HIVE-18702 is present for ACID tables as well.
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
[jira] [Commented] (HIVE-21784) Insert overwrite on an acid (not mm) table is ineffective if the input is empty
[
https://issues.apache.org/jira/browse/HIVE-21784?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16847852#comment-16847852
]
Hive QA commented on HIVE-21784:
| (/) *{color:green}+1 overall{color}* |
\\
\\
|| Vote || Subsystem || Runtime || Comment ||
|| || || || {color:brown} Prechecks {color} ||
| {color:green}+1{color} | {color:green} @author {color} | {color:green} 0m
0s{color} | {color:green} The patch does not contain any @author tags. {color} |
|| || || || {color:brown} master Compile Tests {color} ||
| {color:green}+1{color} | {color:green} mvninstall {color} | {color:green} 10m
40s{color} | {color:green} master passed {color} |
| {color:green}+1{color} | {color:green} compile {color} | {color:green} 1m
23s{color} | {color:green} master passed {color} |
| {color:green}+1{color} | {color:green} checkstyle {color} | {color:green} 0m
50s{color} | {color:green} master passed {color} |
| {color:blue}0{color} | {color:blue} findbugs {color} | {color:blue} 5m
1s{color} | {color:blue} ql in master has 2258 extant Findbugs warnings.
{color} |
| {color:green}+1{color} | {color:green} javadoc {color} | {color:green} 1m
16s{color} | {color:green} master passed {color} |
|| || || || {color:brown} Patch Compile Tests {color} ||
| {color:green}+1{color} | {color:green} mvninstall {color} | {color:green} 1m
49s{color} | {color:green} the patch passed {color} |
| {color:green}+1{color} | {color:green} compile {color} | {color:green} 1m
23s{color} | {color:green} the patch passed {color} |
| {color:green}+1{color} | {color:green} javac {color} | {color:green} 1m
23s{color} | {color:green} the patch passed {color} |
| {color:green}+1{color} | {color:green} checkstyle {color} | {color:green} 0m
50s{color} | {color:green} the patch passed {color} |
| {color:green}+1{color} | {color:green} whitespace {color} | {color:green} 0m
0s{color} | {color:green} The patch has no whitespace issues. {color} |
| {color:green}+1{color} | {color:green} findbugs {color} | {color:green} 5m
15s{color} | {color:green} the patch passed {color} |
| {color:green}+1{color} | {color:green} javadoc {color} | {color:green} 1m
13s{color} | {color:green} the patch passed {color} |
|| || || || {color:brown} Other Tests {color} ||
| {color:green}+1{color} | {color:green} asflicense {color} | {color:green} 0m
17s{color} | {color:green} The patch does not generate ASF License warnings.
{color} |
| {color:black}{color} | {color:black} {color} | {color:black} 30m 32s{color} |
{color:black} {color} |
\\
\\
|| Subsystem || Report/Notes ||
| Optional Tests | asflicense javac javadoc findbugs checkstyle compile |
| uname | Linux hiveptest-server-upstream 3.16.0-4-amd64 #1 SMP Debian
3.16.43-2+deb8u5 (2017-09-19) x86_64 GNU/Linux |
| Build tool | maven |
| Personality |
/data/hiveptest/working/yetus_PreCommit-HIVE-Build-17301/dev-support/hive-personality.sh
|
| git revision | master / 728b385 |
| Default Java | 1.8.0_111 |
| findbugs | v3.0.0 |
| modules | C: ql U: ql |
| Console output |
http://104.198.109.242/logs//PreCommit-HIVE-Build-17301/yetus.txt |
| Powered by | Apache Yetushttp://yetus.apache.org |
This message was automatically generated.
> Insert overwrite on an acid (not mm) table is ineffective if the input is
> empty
> ---
>
> Key: HIVE-21784
> URL: https://issues.apache.org/jira/browse/HIVE-21784
> Project: Hive
> Issue Type: Bug
> Components: HiveServer2
>Reporter: Ivan Suller
>Assignee: Ivan Suller
>Priority: Major
> Fix For: 4.0.0
>
> Attachments: HIVE-21784.1.patch, HIVE-21784.2.patch
>
>
> The issue of HIVE-18702 is present for ACID tables as well.
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
[jira] [Commented] (HIVE-21791) Fix Surrogate Key issue for insert with select with limit operations
[
https://issues.apache.org/jira/browse/HIVE-21791?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16847835#comment-16847835
]
Hive QA commented on HIVE-21791:
Here are the results of testing the latest attachment:
https://issues.apache.org/jira/secure/attachment/12969648/HIVE-21791.01.patch
{color:red}ERROR:{color} -1 due to no test(s) being added or modified.
{color:green}SUCCESS:{color} +1 due to 16059 tests passed
Test results:
https://builds.apache.org/job/PreCommit-HIVE-Build/17300/testReport
Console output: https://builds.apache.org/job/PreCommit-HIVE-Build/17300/console
Test logs: http://104.198.109.242/logs/PreCommit-HIVE-Build-17300/
Messages:
{noformat}
Executing org.apache.hive.ptest.execution.TestCheckPhase
Executing org.apache.hive.ptest.execution.PrepPhase
Executing org.apache.hive.ptest.execution.YetusPhase
Executing org.apache.hive.ptest.execution.ExecutionPhase
Executing org.apache.hive.ptest.execution.ReportingPhase
{noformat}
This message is automatically generated.
ATTACHMENT ID: 12969648 - PreCommit-HIVE-Build
> Fix Surrogate Key issue for insert with select with limit operations
>
>
> Key: HIVE-21791
> URL: https://issues.apache.org/jira/browse/HIVE-21791
> Project: Hive
> Issue Type: Bug
> Components: Hive
>Affects Versions: 3.1.1
>Reporter: Miklos Gergely
>Assignee: Miklos Gergely
>Priority: Major
> Attachments: HIVE-21791.01.patch
>
>
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
[jira] [Commented] (HIVE-21791) Fix Surrogate Key issue for insert with select with limit operations
[
https://issues.apache.org/jira/browse/HIVE-21791?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16847797#comment-16847797
]
Hive QA commented on HIVE-21791:
| (/) *{color:green}+1 overall{color}* |
\\
\\
|| Vote || Subsystem || Runtime || Comment ||
|| || || || {color:brown} Prechecks {color} ||
| {color:green}+1{color} | {color:green} @author {color} | {color:green} 0m
1s{color} | {color:green} The patch does not contain any @author tags. {color} |
|| || || || {color:brown} master Compile Tests {color} ||
| {color:green}+1{color} | {color:green} mvninstall {color} | {color:green} 10m
26s{color} | {color:green} master passed {color} |
| {color:green}+1{color} | {color:green} compile {color} | {color:green} 1m
29s{color} | {color:green} master passed {color} |
| {color:green}+1{color} | {color:green} checkstyle {color} | {color:green} 0m
54s{color} | {color:green} master passed {color} |
| {color:blue}0{color} | {color:blue} findbugs {color} | {color:blue} 5m
6s{color} | {color:blue} ql in master has 2258 extant Findbugs warnings.
{color} |
| {color:green}+1{color} | {color:green} javadoc {color} | {color:green} 1m
14s{color} | {color:green} master passed {color} |
|| || || || {color:brown} Patch Compile Tests {color} ||
| {color:green}+1{color} | {color:green} mvninstall {color} | {color:green} 1m
42s{color} | {color:green} the patch passed {color} |
| {color:green}+1{color} | {color:green} compile {color} | {color:green} 1m
20s{color} | {color:green} the patch passed {color} |
| {color:green}+1{color} | {color:green} javac {color} | {color:green} 1m
20s{color} | {color:green} the patch passed {color} |
| {color:green}+1{color} | {color:green} checkstyle {color} | {color:green} 0m
53s{color} | {color:green} the patch passed {color} |
| {color:green}+1{color} | {color:green} whitespace {color} | {color:green} 0m
0s{color} | {color:green} The patch has no whitespace issues. {color} |
| {color:green}+1{color} | {color:green} findbugs {color} | {color:green} 5m
18s{color} | {color:green} the patch passed {color} |
| {color:green}+1{color} | {color:green} javadoc {color} | {color:green} 1m
18s{color} | {color:green} the patch passed {color} |
|| || || || {color:brown} Other Tests {color} ||
| {color:green}+1{color} | {color:green} asflicense {color} | {color:green} 0m
17s{color} | {color:green} The patch does not generate ASF License warnings.
{color} |
| {color:black}{color} | {color:black} {color} | {color:black} 30m 37s{color} |
{color:black} {color} |
\\
\\
|| Subsystem || Report/Notes ||
| Optional Tests | asflicense javac javadoc findbugs checkstyle compile |
| uname | Linux hiveptest-server-upstream 3.16.0-4-amd64 #1 SMP Debian
3.16.43-2+deb8u5 (2017-09-19) x86_64 GNU/Linux |
| Build tool | maven |
| Personality |
/data/hiveptest/working/yetus_PreCommit-HIVE-Build-17300/dev-support/hive-personality.sh
|
| git revision | master / 728b385 |
| Default Java | 1.8.0_111 |
| findbugs | v3.0.0 |
| modules | C: ql U: ql |
| Console output |
http://104.198.109.242/logs//PreCommit-HIVE-Build-17300/yetus.txt |
| Powered by | Apache Yetushttp://yetus.apache.org |
This message was automatically generated.
> Fix Surrogate Key issue for insert with select with limit operations
>
>
> Key: HIVE-21791
> URL: https://issues.apache.org/jira/browse/HIVE-21791
> Project: Hive
> Issue Type: Bug
> Components: Hive
>Affects Versions: 3.1.1
>Reporter: Miklos Gergely
>Assignee: Miklos Gergely
>Priority: Major
> Attachments: HIVE-21791.01.patch
>
>
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
[jira] [Updated] (HIVE-21768) JDBC: Strip the default union prefix for un-enclosed UNION queries
[
https://issues.apache.org/jira/browse/HIVE-21768?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Gopal V updated HIVE-21768:
---
Attachment: HIVE-21768.4.patch
> JDBC: Strip the default union prefix for un-enclosed UNION queries
> --
>
> Key: HIVE-21768
> URL: https://issues.apache.org/jira/browse/HIVE-21768
> Project: Hive
> Issue Type: Bug
> Components: Logical Optimizer
>Affects Versions: 4.0.0, 3.1.1
>Reporter: Gopal V
>Assignee: Gopal V
>Priority: Major
> Attachments: HIVE-21768.1.patch, HIVE-21768.2.patch,
> HIVE-21768.3.patch, HIVE-21768.4.patch
>
>
> {code}
> beeline> select 1 union all select 2;
> +--+
> | _u1._c0 |
> +--+
> | 2|
> | 1|
> +--+
> {code}
> The _u1 is superfluous and harmful to result schema parsing.
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
[jira] [Updated] (HIVE-16906) Hive ATSHook should check for yarn.timeline-service.enabled before connecting to ATS
[ https://issues.apache.org/jira/browse/HIVE-16906?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Naresh P R updated HIVE-16906: -- Attachment: HIVE-16906.3.patch > Hive ATSHook should check for yarn.timeline-service.enabled before connecting > to ATS > > > Key: HIVE-16906 > URL: https://issues.apache.org/jira/browse/HIVE-16906 > Project: Hive > Issue Type: Bug > Components: Hive >Affects Versions: 1.2.2 >Reporter: Prabhu Joseph >Assignee: Naresh P R >Priority: Major > Attachments: HIVE-16906.1.patch, HIVE-16906.2.patch, > HIVE-16906.3.patch > > > Hive ATShook has to check yarn.timeline-service.enabled (Indicate to clients > whether timeline service is enabled or not. If enabled, clients will put > entities and events to the timeline server.) before creating TimelineClient -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[jira] [Commented] (HIVE-21790) Bump Java to 1.8
[ https://issues.apache.org/jira/browse/HIVE-21790?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16847776#comment-16847776 ] Alan Gates commented on HIVE-21790: --- We can't change Java versions in a bug fix release, so we couldn't release a 2.3.6 with this change. We would need a 2.4 branch if we want to push this change in the 2 line. I'm ok with doing that, but it's more work than just this pom change. > Bump Java to 1.8 > > > Key: HIVE-21790 > URL: https://issues.apache.org/jira/browse/HIVE-21790 > Project: Hive > Issue Type: Improvement >Affects Versions: 2.3.5 >Reporter: Fokko Driesprong >Assignee: Fokko Driesprong >Priority: Major > Labels: pull-request-available > Attachments: 0001-HIVE-21790-Update-to-Java-1.8.patch > > Time Spent: 10m > Remaining Estimate: 0h > > We're using Hive for reading Parquet files, but we would like to move from > gzip to zstandard compression. Currently, the Parquet support of Hive is old > because we can't upgrade since Parquet is Java 1.8+. Therefore it is a good > idea to upgrade Hive as well. > GA support of Java 1.7 is also almost over: > https://www.oracle.com/technetwork/java/java-se-support-roadmap.html -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[jira] [Commented] (HIVE-21145) Enable cbo to use runtime statistics during re-optimization
[
https://issues.apache.org/jira/browse/HIVE-21145?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16847766#comment-16847766
]
Hive QA commented on HIVE-21145:
Here are the results of testing the latest attachment:
https://issues.apache.org/jira/secure/attachment/12969643/HIVE-21145.03.patch
{color:red}ERROR:{color} -1 due to build exiting with an error
Test results:
https://builds.apache.org/job/PreCommit-HIVE-Build/17299/testReport
Console output: https://builds.apache.org/job/PreCommit-HIVE-Build/17299/console
Test logs: http://104.198.109.242/logs/PreCommit-HIVE-Build-17299/
Messages:
{noformat}
Executing org.apache.hive.ptest.execution.TestCheckPhase
Tests exited with: Exception: Patch URL
https://issues.apache.org/jira/secure/attachment/12969643/HIVE-21145.03.patch
was found in seen patch url's cache and a test was probably run already on it.
Aborting...
{noformat}
This message is automatically generated.
ATTACHMENT ID: 12969643 - PreCommit-HIVE-Build
> Enable cbo to use runtime statistics during re-optimization
> ---
>
> Key: HIVE-21145
> URL: https://issues.apache.org/jira/browse/HIVE-21145
> Project: Hive
> Issue Type: Improvement
> Components: CBO, Statistics
>Reporter: Zoltan Haindrich
>Assignee: Zoltan Haindrich
>Priority: Major
> Attachments: HIVE-21145.01.patch, HIVE-21145.02.patch,
> HIVE-21145.03.patch
>
>
> This could enable to reorder joins according to runtime rowcounts.
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
[jira] [Commented] (HIVE-21790) Bump Java to 1.8
[
https://issues.apache.org/jira/browse/HIVE-21790?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16847765#comment-16847765
]
Hive QA commented on HIVE-21790:
Here are the results of testing the latest attachment:
https://issues.apache.org/jira/secure/attachment/12969644/0001-HIVE-21790-Update-to-Java-1.8.patch
{color:red}ERROR:{color} -1 due to build exiting with an error
Test results:
https://builds.apache.org/job/PreCommit-HIVE-Build/17298/testReport
Console output: https://builds.apache.org/job/PreCommit-HIVE-Build/17298/console
Test logs: http://104.198.109.242/logs/PreCommit-HIVE-Build-17298/
Messages:
{noformat}
Executing org.apache.hive.ptest.execution.TestCheckPhase
Executing org.apache.hive.ptest.execution.PrepPhase
Tests exited with: NonZeroExitCodeException
Command 'bash /data/hiveptest/working/scratch/source-prep.sh' failed with exit
status 1 and output '+ date '+%Y-%m-%d %T.%3N'
2019-05-24 17:36:41.922
+ [[ -n /usr/lib/jvm/java-8-openjdk-amd64 ]]
+ export JAVA_HOME=/usr/lib/jvm/java-8-openjdk-amd64
+ JAVA_HOME=/usr/lib/jvm/java-8-openjdk-amd64
+ export
PATH=/usr/lib/jvm/java-8-openjdk-amd64/bin/:/usr/local/bin:/usr/bin:/bin:/usr/local/games:/usr/games
+
PATH=/usr/lib/jvm/java-8-openjdk-amd64/bin/:/usr/local/bin:/usr/bin:/bin:/usr/local/games:/usr/games
+ export 'ANT_OPTS=-Xmx1g -XX:MaxPermSize=256m '
+ ANT_OPTS='-Xmx1g -XX:MaxPermSize=256m '
+ export 'MAVEN_OPTS=-Xmx1g '
+ MAVEN_OPTS='-Xmx1g '
+ cd /data/hiveptest/working/
+ tee /data/hiveptest/logs/PreCommit-HIVE-Build-17298/source-prep.txt
+ [[ false == \t\r\u\e ]]
+ mkdir -p maven ivy
+ [[ git = \s\v\n ]]
+ [[ git = \g\i\t ]]
+ [[ -z master ]]
+ [[ -d apache-github-source-source ]]
+ [[ ! -d apache-github-source-source/.git ]]
+ [[ ! -d apache-github-source-source ]]
+ date '+%Y-%m-%d %T.%3N'
2019-05-24 17:36:41.926
+ cd apache-github-source-source
+ git fetch origin
+ git reset --hard HEAD
HEAD is now at 728b385 HIVE-21776: Replication fails to replicate a UDF with
jar on HDFS during incremental (Ashutosh Bapat, reviewed by Sankar Hariappan)
+ git clean -f -d
Removing standalone-metastore/metastore-server/src/gen/
+ git checkout master
Already on 'master'
Your branch is up-to-date with 'origin/master'.
+ git reset --hard origin/master
HEAD is now at 728b385 HIVE-21776: Replication fails to replicate a UDF with
jar on HDFS during incremental (Ashutosh Bapat, reviewed by Sankar Hariappan)
+ git merge --ff-only origin/master
Already up-to-date.
+ date '+%Y-%m-%d %T.%3N'
2019-05-24 17:36:43.205
+ rm -rf ../yetus_PreCommit-HIVE-Build-17298
+ mkdir ../yetus_PreCommit-HIVE-Build-17298
+ git gc
+ cp -R . ../yetus_PreCommit-HIVE-Build-17298
+ mkdir /data/hiveptest/logs/PreCommit-HIVE-Build-17298/yetus
+ patchCommandPath=/data/hiveptest/working/scratch/smart-apply-patch.sh
+ patchFilePath=/data/hiveptest/working/scratch/build.patch
+ [[ -f /data/hiveptest/working/scratch/build.patch ]]
+ chmod +x /data/hiveptest/working/scratch/smart-apply-patch.sh
+ /data/hiveptest/working/scratch/smart-apply-patch.sh
/data/hiveptest/working/scratch/build.patch
error: a/README.md: does not exist in index
error: a/pom.xml: does not exist in index
error: patch failed: README.md:75
Falling back to three-way merge...
Applied patch to 'README.md' cleanly.
error: patch failed: pom.xml:804
Falling back to three-way merge...
Applied patch to 'pom.xml' with conflicts.
Going to apply patch with: git apply -p1
error: patch failed: README.md:75
Falling back to three-way merge...
Applied patch to 'README.md' cleanly.
error: patch failed: pom.xml:804
Falling back to three-way merge...
Applied patch to 'pom.xml' with conflicts.
U pom.xml
+ result=1
+ '[' 1 -ne 0 ']'
+ rm -rf yetus_PreCommit-HIVE-Build-17298
+ exit 1
'
{noformat}
This message is automatically generated.
ATTACHMENT ID: 12969644 - PreCommit-HIVE-Build
> Bump Java to 1.8
>
>
> Key: HIVE-21790
> URL: https://issues.apache.org/jira/browse/HIVE-21790
> Project: Hive
> Issue Type: Improvement
>Affects Versions: 2.3.5
>Reporter: Fokko Driesprong
>Assignee: Fokko Driesprong
>Priority: Major
> Labels: pull-request-available
> Attachments: 0001-HIVE-21790-Update-to-Java-1.8.patch
>
> Time Spent: 10m
> Remaining Estimate: 0h
>
> We're using Hive for reading Parquet files, but we would like to move from
> gzip to zstandard compression. Currently, the Parquet support of Hive is old
> because we can't upgrade since Parquet is Java 1.8+. Therefore it is a good
> idea to upgrade Hive as well.
> GA support of Java 1.7 is also almost over:
> https://www.oracle.com/technetwork/java/java-se-support-roadmap.html
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
[jira] [Commented] (HIVE-21732) Configurable injection of load for LLAP task execution
[
https://issues.apache.org/jira/browse/HIVE-21732?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16847743#comment-16847743
]
Hive QA commented on HIVE-21732:
Here are the results of testing the latest attachment:
https://issues.apache.org/jira/secure/attachment/12969637/HIVE-21732.10.patch
{color:green}SUCCESS:{color} +1 due to 1 test(s) being added or modified.
{color:red}ERROR:{color} -1 due to 14 failed/errored test(s), 16061 tests
executed
*Failed tests:*
{noformat}
org.apache.hadoop.hive.metastore.TestObjectStore.catalogs (batchId=232)
org.apache.hadoop.hive.metastore.TestObjectStore.testDatabaseOps (batchId=232)
org.apache.hadoop.hive.metastore.TestObjectStore.testDeprecatedConfigIsOverwritten
(batchId=232)
org.apache.hadoop.hive.metastore.TestObjectStore.testDirectSQLDropParitionsCleanup
(batchId=232)
org.apache.hadoop.hive.metastore.TestObjectStore.testDirectSQLDropPartitionsCacheCrossSession
(batchId=232)
org.apache.hadoop.hive.metastore.TestObjectStore.testDirectSqlErrorMetrics
(batchId=232)
org.apache.hadoop.hive.metastore.TestObjectStore.testEmptyTrustStoreProps
(batchId=232)
org.apache.hadoop.hive.metastore.TestObjectStore.testMasterKeyOps (batchId=232)
org.apache.hadoop.hive.metastore.TestObjectStore.testMaxEventResponse
(batchId=232)
org.apache.hadoop.hive.metastore.TestObjectStore.testPartitionOps (batchId=232)
org.apache.hadoop.hive.metastore.TestObjectStore.testQueryCloseOnError
(batchId=232)
org.apache.hadoop.hive.metastore.TestObjectStore.testRoleOps (batchId=232)
org.apache.hadoop.hive.metastore.TestObjectStore.testTableOps (batchId=232)
org.apache.hadoop.hive.metastore.TestObjectStore.testUseSSLProperty
(batchId=232)
{noformat}
Test results:
https://builds.apache.org/job/PreCommit-HIVE-Build/17297/testReport
Console output: https://builds.apache.org/job/PreCommit-HIVE-Build/17297/console
Test logs: http://104.198.109.242/logs/PreCommit-HIVE-Build-17297/
Messages:
{noformat}
Executing org.apache.hive.ptest.execution.TestCheckPhase
Executing org.apache.hive.ptest.execution.PrepPhase
Executing org.apache.hive.ptest.execution.YetusPhase
Executing org.apache.hive.ptest.execution.ExecutionPhase
Executing org.apache.hive.ptest.execution.ReportingPhase
Tests exited with: TestsFailedException: 14 tests failed
{noformat}
This message is automatically generated.
ATTACHMENT ID: 12969637 - PreCommit-HIVE-Build
> Configurable injection of load for LLAP task execution
> --
>
> Key: HIVE-21732
> URL: https://issues.apache.org/jira/browse/HIVE-21732
> Project: Hive
> Issue Type: Test
>Reporter: Peter Vary
>Assignee: Peter Vary
>Priority: Major
> Labels: pull-request-available
> Attachments: HIVE-21732.10.patch, HIVE-21732.2.patch,
> HIVE-21732.3.patch, HIVE-21732.4.patch, HIVE-21732.5.patch,
> HIVE-21732.6.patch, HIVE-21732.7.patch, HIVE-21732.8.patch,
> HIVE-21732.9.patch, HIVE-21732.patch
>
> Time Spent: 5h 40m
> Remaining Estimate: 0h
>
> For evaluating testing, it would be good to have a configurable way to inject
> latency for LLAP tasks.
> The configuration should be able to control how much latency is injected into
> each daemon.
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
[jira] [Commented] (HIVE-16906) Hive ATSHook should check for yarn.timeline-service.enabled before connecting to ATS
[ https://issues.apache.org/jira/browse/HIVE-16906?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16847713#comment-16847713 ] Thejas M Nair commented on HIVE-16906: -- +1 > Hive ATSHook should check for yarn.timeline-service.enabled before connecting > to ATS > > > Key: HIVE-16906 > URL: https://issues.apache.org/jira/browse/HIVE-16906 > Project: Hive > Issue Type: Bug > Components: Hive >Affects Versions: 1.2.2 >Reporter: Prabhu Joseph >Assignee: Naresh P R >Priority: Major > Attachments: HIVE-16906.1.patch, HIVE-16906.2.patch > > > Hive ATShook has to check yarn.timeline-service.enabled (Indicate to clients > whether timeline service is enabled or not. If enabled, clients will put > entities and events to the timeline server.) before creating TimelineClient -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[jira] [Commented] (HIVE-21732) Configurable injection of load for LLAP task execution
[
https://issues.apache.org/jira/browse/HIVE-21732?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16847691#comment-16847691
]
Hive QA commented on HIVE-21732:
| (x) *{color:red}-1 overall{color}* |
\\
\\
|| Vote || Subsystem || Runtime || Comment ||
|| || || || {color:brown} Prechecks {color} ||
| {color:green}+1{color} | {color:green} @author {color} | {color:green} 0m
0s{color} | {color:green} The patch does not contain any @author tags. {color} |
|| || || || {color:brown} master Compile Tests {color} ||
| {color:blue}0{color} | {color:blue} mvndep {color} | {color:blue} 2m
0s{color} | {color:blue} Maven dependency ordering for branch {color} |
| {color:green}+1{color} | {color:green} mvninstall {color} | {color:green} 9m
36s{color} | {color:green} master passed {color} |
| {color:green}+1{color} | {color:green} compile {color} | {color:green} 0m
46s{color} | {color:green} master passed {color} |
| {color:green}+1{color} | {color:green} checkstyle {color} | {color:green} 0m
34s{color} | {color:green} master passed {color} |
| {color:blue}0{color} | {color:blue} findbugs {color} | {color:blue} 0m
42s{color} | {color:blue} common in master has 62 extant Findbugs warnings.
{color} |
| {color:blue}0{color} | {color:blue} findbugs {color} | {color:blue} 0m
52s{color} | {color:blue} llap-server in master has 81 extant Findbugs
warnings. {color} |
| {color:green}+1{color} | {color:green} javadoc {color} | {color:green} 0m
33s{color} | {color:green} master passed {color} |
|| || || || {color:brown} Patch Compile Tests {color} ||
| {color:blue}0{color} | {color:blue} mvndep {color} | {color:blue} 0m
31s{color} | {color:blue} Maven dependency ordering for patch {color} |
| {color:red}-1{color} | {color:red} mvninstall {color} | {color:red} 0m
25s{color} | {color:red} llap-server in the patch failed. {color} |
| {color:red}-1{color} | {color:red} compile {color} | {color:red} 0m
24s{color} | {color:red} llap-server in the patch failed. {color} |
| {color:red}-1{color} | {color:red} javac {color} | {color:red} 0m 24s{color}
| {color:red} llap-server in the patch failed. {color} |
| {color:green}+1{color} | {color:green} checkstyle {color} | {color:green} 0m
34s{color} | {color:green} the patch passed {color} |
| {color:green}+1{color} | {color:green} whitespace {color} | {color:green} 0m
0s{color} | {color:green} The patch has no whitespace issues. {color} |
| {color:red}-1{color} | {color:red} findbugs {color} | {color:red} 0m
23s{color} | {color:red} llap-server in the patch failed. {color} |
| {color:green}+1{color} | {color:green} javadoc {color} | {color:green} 0m
32s{color} | {color:green} the patch passed {color} |
|| || || || {color:brown} Other Tests {color} ||
| {color:green}+1{color} | {color:green} asflicense {color} | {color:green} 0m
16s{color} | {color:green} The patch does not generate ASF License warnings.
{color} |
| {color:black}{color} | {color:black} {color} | {color:black} 20m 26s{color} |
{color:black} {color} |
\\
\\
|| Subsystem || Report/Notes ||
| Optional Tests | asflicense javac javadoc findbugs checkstyle compile |
| uname | Linux hiveptest-server-upstream 3.16.0-4-amd64 #1 SMP Debian
3.16.43-2+deb8u5 (2017-09-19) x86_64 GNU/Linux |
| Build tool | maven |
| Personality |
/data/hiveptest/working/yetus_PreCommit-HIVE-Build-17297/dev-support/hive-personality.sh
|
| git revision | master / 728b385 |
| Default Java | 1.8.0_111 |
| findbugs | v3.0.0 |
| mvninstall |
http://104.198.109.242/logs//PreCommit-HIVE-Build-17297/yetus/patch-mvninstall-llap-server.txt
|
| compile |
http://104.198.109.242/logs//PreCommit-HIVE-Build-17297/yetus/patch-compile-llap-server.txt
|
| javac |
http://104.198.109.242/logs//PreCommit-HIVE-Build-17297/yetus/patch-compile-llap-server.txt
|
| findbugs |
http://104.198.109.242/logs//PreCommit-HIVE-Build-17297/yetus/patch-findbugs-llap-server.txt
|
| modules | C: common llap-server U: . |
| Console output |
http://104.198.109.242/logs//PreCommit-HIVE-Build-17297/yetus.txt |
| Powered by | Apache Yetushttp://yetus.apache.org |
This message was automatically generated.
> Configurable injection of load for LLAP task execution
> --
>
> Key: HIVE-21732
> URL: https://issues.apache.org/jira/browse/HIVE-21732
> Project: Hive
> Issue Type: Test
>Reporter: Peter Vary
>Assignee: Peter Vary
>Priority: Major
> Labels: pull-request-available
> Attachments: HIVE-21732.10.patch, HIVE-21732.2.patch,
> HIVE-21732.3.patch, HIVE-21732.4.patch, HIVE-21732.5.patch,
> HIVE-21732.6.patch, HIVE-21732.7.patch, HIVE-21732.8.patch,
> HIVE-21732.9.patch, HIVE-21732.patch
>
> Time Spent: 5h 40m
> Remaining Estimate: 0h
>
> For evaluating testing, it would be good to have a configurable way
[jira] [Updated] (HIVE-21786) Update repo URLs in poms
[ https://issues.apache.org/jira/browse/HIVE-21786?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Alan Gates updated HIVE-21786: -- Status: Patch Available (was: Open) There were three repos in the top level pom using http. The glassfish and sonatype ones were disabled. The datanucleus repo does not support https. I removed all three and found everything still builds. The repos in ptest2's pom I updated to https. I also added license headers to two poms in standalone-metastore that were missing them. And I updated the hive website reference in the top level pom to be https. > Update repo URLs in poms > > > Key: HIVE-21786 > URL: https://issues.apache.org/jira/browse/HIVE-21786 > Project: Hive > Issue Type: Bug > Components: Build Infrastructure >Affects Versions: 2.3.5, 3.1.1, 4.0.0 >Reporter: Alan Gates >Assignee: Alan Gates >Priority: Major > Attachments: HIVE-21786.patch > > > Need to update repo URLs in the poms. -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[jira] [Commented] (HIVE-21145) Enable cbo to use runtime statistics during re-optimization
[
https://issues.apache.org/jira/browse/HIVE-21145?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16847657#comment-16847657
]
Hive QA commented on HIVE-21145:
Here are the results of testing the latest attachment:
https://issues.apache.org/jira/secure/attachment/12969643/HIVE-21145.03.patch
{color:green}SUCCESS:{color} +1 due to 4 test(s) being added or modified.
{color:red}ERROR:{color} -1 due to 76 failed/errored test(s), 16060 tests
executed
*Failed tests:*
{noformat}
org.apache.hadoop.hive.cli.TestMiniLlapCliDriver.testCliDriver[explainuser_2]
(batchId=158)
org.apache.hadoop.hive.cli.TestMiniLlapLocalCliDriver.testCliDriver[auto_smb_mapjoin_14]
(batchId=177)
org.apache.hadoop.hive.cli.TestMiniLlapLocalCliDriver.testCliDriver[auto_sortmerge_join_10]
(batchId=180)
org.apache.hadoop.hive.cli.TestMiniLlapLocalCliDriver.testCliDriver[auto_sortmerge_join_11]
(batchId=185)
org.apache.hadoop.hive.cli.TestMiniLlapLocalCliDriver.testCliDriver[auto_sortmerge_join_12]
(batchId=169)
org.apache.hadoop.hive.cli.TestMiniLlapLocalCliDriver.testCliDriver[auto_sortmerge_join_14]
(batchId=163)
org.apache.hadoop.hive.cli.TestMiniLlapLocalCliDriver.testCliDriver[auto_sortmerge_join_15]
(batchId=163)
org.apache.hadoop.hive.cli.TestMiniLlapLocalCliDriver.testCliDriver[auto_sortmerge_join_16]
(batchId=175)
org.apache.hadoop.hive.cli.TestMiniLlapLocalCliDriver.testCliDriver[auto_sortmerge_join_1]
(batchId=173)
org.apache.hadoop.hive.cli.TestMiniLlapLocalCliDriver.testCliDriver[auto_sortmerge_join_2]
(batchId=173)
org.apache.hadoop.hive.cli.TestMiniLlapLocalCliDriver.testCliDriver[auto_sortmerge_join_3]
(batchId=160)
org.apache.hadoop.hive.cli.TestMiniLlapLocalCliDriver.testCliDriver[auto_sortmerge_join_4]
(batchId=178)
org.apache.hadoop.hive.cli.TestMiniLlapLocalCliDriver.testCliDriver[auto_sortmerge_join_5]
(batchId=185)
org.apache.hadoop.hive.cli.TestMiniLlapLocalCliDriver.testCliDriver[auto_sortmerge_join_6]
(batchId=164)
org.apache.hadoop.hive.cli.TestMiniLlapLocalCliDriver.testCliDriver[auto_sortmerge_join_7]
(batchId=186)
org.apache.hadoop.hive.cli.TestMiniLlapLocalCliDriver.testCliDriver[auto_sortmerge_join_8]
(batchId=181)
org.apache.hadoop.hive.cli.TestMiniLlapLocalCliDriver.testCliDriver[auto_sortmerge_join_9]
(batchId=179)
org.apache.hadoop.hive.cli.TestMiniLlapLocalCliDriver.testCliDriver[bucketmapjoin6]
(batchId=175)
org.apache.hadoop.hive.cli.TestMiniLlapLocalCliDriver.testCliDriver[bucketsortoptimize_insert_2]
(batchId=161)
org.apache.hadoop.hive.cli.TestMiniLlapLocalCliDriver.testCliDriver[bucketsortoptimize_insert_7]
(batchId=175)
org.apache.hadoop.hive.cli.TestMiniLlapLocalCliDriver.testCliDriver[cbo_subq_exists]
(batchId=182)
org.apache.hadoop.hive.cli.TestMiniLlapLocalCliDriver.testCliDriver[cbo_subq_not_in]
(batchId=174)
org.apache.hadoop.hive.cli.TestMiniLlapLocalCliDriver.testCliDriver[correlationoptimizer2]
(batchId=174)
org.apache.hadoop.hive.cli.TestMiniLlapLocalCliDriver.testCliDriver[correlationoptimizer6]
(batchId=174)
org.apache.hadoop.hive.cli.TestMiniLlapLocalCliDriver.testCliDriver[dynamic_semijoin_reduction_2]
(batchId=181)
org.apache.hadoop.hive.cli.TestMiniLlapLocalCliDriver.testCliDriver[explainanalyze_2]
(batchId=179)
org.apache.hadoop.hive.cli.TestMiniLlapLocalCliDriver.testCliDriver[explainuser_1]
(batchId=170)
org.apache.hadoop.hive.cli.TestMiniLlapLocalCliDriver.testCliDriver[join_filters]
(batchId=178)
org.apache.hadoop.hive.cli.TestMiniLlapLocalCliDriver.testCliDriver[join_is_not_distinct_from]
(batchId=185)
org.apache.hadoop.hive.cli.TestMiniLlapLocalCliDriver.testCliDriver[join_nulls]
(batchId=160)
org.apache.hadoop.hive.cli.TestMiniLlapLocalCliDriver.testCliDriver[join_nullsafe]
(batchId=180)
org.apache.hadoop.hive.cli.TestMiniLlapLocalCliDriver.testCliDriver[llap_smb]
(batchId=186)
org.apache.hadoop.hive.cli.TestMiniLlapLocalCliDriver.testCliDriver[mergejoin]
(batchId=177)
org.apache.hadoop.hive.cli.TestMiniLlapLocalCliDriver.testCliDriver[mrr]
(batchId=163)
org.apache.hadoop.hive.cli.TestMiniLlapLocalCliDriver.testCliDriver[offset_limit_ppd_optimizer]
(batchId=179)
org.apache.hadoop.hive.cli.TestMiniLlapLocalCliDriver.testCliDriver[quotedid_smb]
(batchId=167)
org.apache.hadoop.hive.cli.TestMiniLlapLocalCliDriver.testCliDriver[reopt_dpp]
(batchId=180)
org.apache.hadoop.hive.cli.TestMiniLlapLocalCliDriver.testCliDriver[reopt_semijoin]
(batchId=184)
org.apache.hadoop.hive.cli.TestMiniLlapLocalCliDriver.testCliDriver[results_cache_1]
(batchId=178)
org.apache.hadoop.hive.cli.TestMiniLlapLocalCliDriver.testCliDriver[retry_failure_reorder]
(batchId=171)
org.apache.hadoop.hive.cli.TestMiniLlapLocalCliDriver.testCliDriver[retry_failure_stat_changes]
(batchId=165)
org.apache.hadoop.hive.cli.TestMiniLlapLocalCliDriver.testCliDriver[runtime_stats_hs2]
(batchId=183)
org.apache.hadoop.hive.cli.TestMiniLlapLocalCliDriver.testCliDriver[runtime_stats_merge]
(batchId=183)
[jira] [Updated] (HIVE-21786) Update repo URLs in poms
[ https://issues.apache.org/jira/browse/HIVE-21786?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Alan Gates updated HIVE-21786: -- Attachment: HIVE-21786.patch > Update repo URLs in poms > > > Key: HIVE-21786 > URL: https://issues.apache.org/jira/browse/HIVE-21786 > Project: Hive > Issue Type: Bug > Components: Build Infrastructure >Affects Versions: 4.0.0, 3.1.1, 2.3.5 >Reporter: Alan Gates >Assignee: Alan Gates >Priority: Major > Attachments: HIVE-21786.patch > > > Need to update repo URLs in the poms. -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[jira] [Resolved] (HIVE-1502) finish the index design doc
[ https://issues.apache.org/jira/browse/HIVE-1502?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] David Mollitor resolved HIVE-1502. -- Resolution: Won't Do Hive Indexes have been dropped starting in Hive 3.0 [HIVE-18448] > finish the index design doc > --- > > Key: HIVE-1502 > URL: https://issues.apache.org/jira/browse/HIVE-1502 > Project: Hive > Issue Type: Improvement > Components: Indexing >Affects Versions: 0.7.0 >Reporter: John Sichi >Priority: Major > > * regenerate the metastore schema diagram to match the final column names > * update Plugin Interface section to match the latest code > * fill out TBD's in the Reference Implementation section > * resolve other TBD's or link them to followup JIRA's -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[jira] [Commented] (HIVE-21145) Enable cbo to use runtime statistics during re-optimization
[
https://issues.apache.org/jira/browse/HIVE-21145?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16847629#comment-16847629
]
Hive QA commented on HIVE-21145:
| (x) *{color:red}-1 overall{color}* |
\\
\\
|| Vote || Subsystem || Runtime || Comment ||
|| || || || {color:brown} Prechecks {color} ||
| {color:green}+1{color} | {color:green} @author {color} | {color:green} 0m
0s{color} | {color:green} The patch does not contain any @author tags. {color} |
|| || || || {color:brown} master Compile Tests {color} ||
| {color:blue}0{color} | {color:blue} mvndep {color} | {color:blue} 2m
4s{color} | {color:blue} Maven dependency ordering for branch {color} |
| {color:green}+1{color} | {color:green} mvninstall {color} | {color:green} 8m
17s{color} | {color:green} master passed {color} |
| {color:green}+1{color} | {color:green} compile {color} | {color:green} 1m
19s{color} | {color:green} master passed {color} |
| {color:green}+1{color} | {color:green} checkstyle {color} | {color:green} 0m
57s{color} | {color:green} master passed {color} |
| {color:blue}0{color} | {color:blue} findbugs {color} | {color:blue} 4m
49s{color} | {color:blue} ql in master has 2258 extant Findbugs warnings.
{color} |
| {color:green}+1{color} | {color:green} javadoc {color} | {color:green} 1m
12s{color} | {color:green} master passed {color} |
|| || || || {color:brown} Patch Compile Tests {color} ||
| {color:blue}0{color} | {color:blue} mvndep {color} | {color:blue} 0m
30s{color} | {color:blue} Maven dependency ordering for patch {color} |
| {color:green}+1{color} | {color:green} mvninstall {color} | {color:green} 1m
43s{color} | {color:green} the patch passed {color} |
| {color:green}+1{color} | {color:green} compile {color} | {color:green} 1m
21s{color} | {color:green} the patch passed {color} |
| {color:green}+1{color} | {color:green} javac {color} | {color:green} 1m
21s{color} | {color:green} the patch passed {color} |
| {color:red}-1{color} | {color:red} checkstyle {color} | {color:red} 0m
58s{color} | {color:red} ql: The patch generated 14 new + 794 unchanged - 3
fixed = 808 total (was 797) {color} |
| {color:red}-1{color} | {color:red} whitespace {color} | {color:red} 0m
0s{color} | {color:red} The patch 5 line(s) with tabs. {color} |
| {color:red}-1{color} | {color:red} findbugs {color} | {color:red} 5m
8s{color} | {color:red} ql generated 5 new + 2257 unchanged - 1 fixed = 2262
total (was 2258) {color} |
| {color:green}+1{color} | {color:green} javadoc {color} | {color:green} 1m
12s{color} | {color:green} the patch passed {color} |
|| || || || {color:brown} Other Tests {color} ||
| {color:green}+1{color} | {color:green} asflicense {color} | {color:green} 0m
18s{color} | {color:green} The patch does not generate ASF License warnings.
{color} |
| {color:black}{color} | {color:black} {color} | {color:black} 30m 35s{color} |
{color:black} {color} |
\\
\\
|| Reason || Tests ||
| FindBugs | module:ql |
| | Dead store to ss1 in
org.apache.hadoop.hive.ql.optimizer.calcite.HiveRelFactories$HiveFilterFactoryImpl.createFilter(RelNode,
RexNode) At
HiveRelFactories.java:org.apache.hadoop.hive.ql.optimizer.calcite.HiveRelFactories$HiveFilterFactoryImpl.createFilter(RelNode,
RexNode) At HiveRelFactories.java:[line 144] |
| | Dead store to ar in
org.apache.hadoop.hive.ql.parse.TezCompiler$CollectAll.process(Node, Stack,
NodeProcessorCtx, Object[]) At
TezCompiler.java:org.apache.hadoop.hive.ql.parse.TezCompiler$CollectAll.process(Node,
Stack, NodeProcessorCtx, Object[]) At TezCompiler.java:[line 967] |
| | Dead store to sig in
org.apache.hadoop.hive.ql.parse.TezCompiler$CollectAll.process(Node, Stack,
NodeProcessorCtx, Object[]) At
TezCompiler.java:org.apache.hadoop.hive.ql.parse.TezCompiler$CollectAll.process(Node,
Stack, NodeProcessorCtx, Object[]) At TezCompiler.java:[line 966] |
| | org.apache.hadoop.hive.ql.plan.mapper.AuxOpTreeSignature.equals(Object)
does not check for null argument At AuxOpTreeSignature.java:null argument At
AuxOpTreeSignature.java:[line 51] |
| | Format-string method String.format(String, Object[]) called with format
string "expected(stat-sig) 1-1, got {}-{} ;" wants 0 arguments but is given 2
in
org.apache.hadoop.hive.ql.plan.mapper.StatsSources.extractStatsFromPlanMapper(PlanMapper)
At StatsSources.java:with format string "expected(stat-sig) 1-1, got {}-{} ;"
wants 0 arguments but is given 2 in
org.apache.hadoop.hive.ql.plan.mapper.StatsSources.extractStatsFromPlanMapper(PlanMapper)
At StatsSources.java:[line 88] |
\\
\\
|| Subsystem || Report/Notes ||
| Optional Tests | asflicense javac javadoc findbugs checkstyle compile |
| uname | Linux hiveptest-server-upstream 3.16.0-4-amd64 #1 SMP Debian
3.16.43-2+deb8u5 (2017-09-19) x86_64 GNU/Linux |
| Build tool | maven |
| Personality |
/data/hiveptest/working/yetus_PreCommit-HIVE-Build-17296/dev-support/hive-personality.sh
[jira] [Updated] (HIVE-16906) Hive ATSHook should check for yarn.timeline-service.enabled before connecting to ATS
[ https://issues.apache.org/jira/browse/HIVE-16906?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Naresh P R updated HIVE-16906: -- Attachment: HIVE-16906.2.patch > Hive ATSHook should check for yarn.timeline-service.enabled before connecting > to ATS > > > Key: HIVE-16906 > URL: https://issues.apache.org/jira/browse/HIVE-16906 > Project: Hive > Issue Type: Bug > Components: Hive >Affects Versions: 1.2.2 >Reporter: Prabhu Joseph >Assignee: Naresh P R >Priority: Major > Attachments: HIVE-16906.1.patch, HIVE-16906.2.patch > > > Hive ATShook has to check yarn.timeline-service.enabled (Indicate to clients > whether timeline service is enabled or not. If enabled, clients will put > entities and events to the timeline server.) before creating TimelineClient -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[jira] [Commented] (HIVE-16906) Hive ATSHook should check for yarn.timeline-service.enabled before connecting to ATS
[
https://issues.apache.org/jira/browse/HIVE-16906?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16847591#comment-16847591
]
Hive QA commented on HIVE-16906:
Here are the results of testing the latest attachment:
https://issues.apache.org/jira/secure/attachment/12969627/HIVE-16906.1.patch
{color:red}ERROR:{color} -1 due to build exiting with an error
Test results:
https://builds.apache.org/job/PreCommit-HIVE-Build/17295/testReport
Console output: https://builds.apache.org/job/PreCommit-HIVE-Build/17295/console
Test logs: http://104.198.109.242/logs/PreCommit-HIVE-Build-17295/
Messages:
{noformat}
Executing org.apache.hive.ptest.execution.TestCheckPhase
Tests exited with: Exception: Patch URL
https://issues.apache.org/jira/secure/attachment/12969627/HIVE-16906.1.patch
was found in seen patch url's cache and a test was probably run already on it.
Aborting...
{noformat}
This message is automatically generated.
ATTACHMENT ID: 12969627 - PreCommit-HIVE-Build
> Hive ATSHook should check for yarn.timeline-service.enabled before connecting
> to ATS
>
>
> Key: HIVE-16906
> URL: https://issues.apache.org/jira/browse/HIVE-16906
> Project: Hive
> Issue Type: Bug
> Components: Hive
>Affects Versions: 1.2.2
>Reporter: Prabhu Joseph
>Assignee: Naresh P R
>Priority: Major
> Attachments: HIVE-16906.1.patch
>
>
> Hive ATShook has to check yarn.timeline-service.enabled (Indicate to clients
> whether timeline service is enabled or not. If enabled, clients will put
> entities and events to the timeline server.) before creating TimelineClient
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
[jira] [Updated] (HIVE-21776) Replication fails to replicate a UDF with jar on HDFS during incremental
[ https://issues.apache.org/jira/browse/HIVE-21776?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ashutosh Bapat updated HIVE-21776: -- Description: When a UDF with jar on HDFS is replicated, we add the jar path to the dump. The dumped URL of jar has checksum and cmroot added to it. During load, we load the jar on target. ReplCopyTask handles the jar paths separately from the paths in _files and it uses the presence of checksum and cmroot for that decision. (Those two are not present in _files URL). If ReplChangeManager is not initialized during dump, dumped URL of jar does not contain checksum and cmroot and thus ReplCopyTask fails to copy the UDF jar to the target. This fails the repl load since the function can not be created. Fix is to initialize ReplChangeManager always. (was: TestReplicationScenariosAcrossInstances has test to test bootstrap of a UDF with jar on HDFS but no test for incremental. Add the same.) > Replication fails to replicate a UDF with jar on HDFS during incremental > > > Key: HIVE-21776 > URL: https://issues.apache.org/jira/browse/HIVE-21776 > Project: Hive > Issue Type: Bug >Affects Versions: 4.0.0 >Reporter: Ashutosh Bapat >Assignee: Ashutosh Bapat >Priority: Major > Labels: pull-request-available > Fix For: 4.0.0 > > Attachments: HIVE-21776.01.patch, HIVE-21776.02.patch, > HIVE-21776.03.patch, HIVE-21776.04.patch > > Time Spent: 1h 10m > Remaining Estimate: 0h > > When a UDF with jar on HDFS is replicated, we add the jar path to the dump. > The dumped URL of jar has checksum and cmroot added to it. During load, we > load the jar on target. ReplCopyTask handles the jar paths separately from > the paths in _files and it uses the presence of checksum and cmroot for that > decision. (Those two are not present in _files URL). If ReplChangeManager is > not initialized during dump, dumped URL of jar does not contain checksum and > cmroot and thus ReplCopyTask fails to copy the UDF jar to the target. This > fails the repl load since the function can not be created. Fix is to > initialize ReplChangeManager always. -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[jira] [Updated] (HIVE-21791) Fix Surrogate Key issue for insert with select with limit operations
[ https://issues.apache.org/jira/browse/HIVE-21791?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Miklos Gergely updated HIVE-21791: -- Attachment: HIVE-21791.01.patch > Fix Surrogate Key issue for insert with select with limit operations > > > Key: HIVE-21791 > URL: https://issues.apache.org/jira/browse/HIVE-21791 > Project: Hive > Issue Type: Bug > Components: Hive >Affects Versions: 3.1.1 >Reporter: Miklos Gergely >Assignee: Miklos Gergely >Priority: Major > Attachments: HIVE-21791.01.patch > > -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[jira] [Updated] (HIVE-21791) Fix Surrogate Key issue for insert with select with limit operations
[ https://issues.apache.org/jira/browse/HIVE-21791?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Miklos Gergely updated HIVE-21791: -- Status: Patch Available (was: Open) > Fix Surrogate Key issue for insert with select with limit operations > > > Key: HIVE-21791 > URL: https://issues.apache.org/jira/browse/HIVE-21791 > Project: Hive > Issue Type: Bug > Components: Hive >Affects Versions: 3.1.1 >Reporter: Miklos Gergely >Assignee: Miklos Gergely >Priority: Major > Attachments: HIVE-21791.01.patch > > -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[jira] [Updated] (HIVE-21791) Fix Surrogate Key issue for insert with select with limit operations
[ https://issues.apache.org/jira/browse/HIVE-21791?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Miklos Gergely updated HIVE-21791: -- Affects Version/s: 3.1.1 Component/s: Hive > Fix Surrogate Key issue for insert with select with limit operations > > > Key: HIVE-21791 > URL: https://issues.apache.org/jira/browse/HIVE-21791 > Project: Hive > Issue Type: Bug > Components: Hive >Affects Versions: 3.1.1 >Reporter: Miklos Gergely >Assignee: Miklos Gergely >Priority: Major > -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[jira] [Updated] (HIVE-21791) Fix Surrogate Key issue for insert with select with limit operations
[ https://issues.apache.org/jira/browse/HIVE-21791?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Miklos Gergely updated HIVE-21791: -- Summary: Fix Surrogate Key issue for insert with select with limit operations (was: Fix Surrogat Key issue for insert with select with limit operations) > Fix Surrogate Key issue for insert with select with limit operations > > > Key: HIVE-21791 > URL: https://issues.apache.org/jira/browse/HIVE-21791 > Project: Hive > Issue Type: Bug >Reporter: Miklos Gergely >Assignee: Miklos Gergely >Priority: Major > -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[jira] [Commented] (HIVE-16906) Hive ATSHook should check for yarn.timeline-service.enabled before connecting to ATS
[
https://issues.apache.org/jira/browse/HIVE-16906?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16847583#comment-16847583
]
Hive QA commented on HIVE-16906:
Here are the results of testing the latest attachment:
https://issues.apache.org/jira/secure/attachment/12969627/HIVE-16906.1.patch
{color:red}ERROR:{color} -1 due to no test(s) being added or modified.
{color:green}SUCCESS:{color} +1 due to 16057 tests passed
Test results:
https://builds.apache.org/job/PreCommit-HIVE-Build/17294/testReport
Console output: https://builds.apache.org/job/PreCommit-HIVE-Build/17294/console
Test logs: http://104.198.109.242/logs/PreCommit-HIVE-Build-17294/
Messages:
{noformat}
Executing org.apache.hive.ptest.execution.TestCheckPhase
Executing org.apache.hive.ptest.execution.PrepPhase
Executing org.apache.hive.ptest.execution.YetusPhase
Executing org.apache.hive.ptest.execution.ExecutionPhase
Executing org.apache.hive.ptest.execution.ReportingPhase
{noformat}
This message is automatically generated.
ATTACHMENT ID: 12969627 - PreCommit-HIVE-Build
> Hive ATSHook should check for yarn.timeline-service.enabled before connecting
> to ATS
>
>
> Key: HIVE-16906
> URL: https://issues.apache.org/jira/browse/HIVE-16906
> Project: Hive
> Issue Type: Bug
> Components: Hive
>Affects Versions: 1.2.2
>Reporter: Prabhu Joseph
>Assignee: Naresh P R
>Priority: Major
> Attachments: HIVE-16906.1.patch
>
>
> Hive ATShook has to check yarn.timeline-service.enabled (Indicate to clients
> whether timeline service is enabled or not. If enabled, clients will put
> entities and events to the timeline server.) before creating TimelineClient
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
[jira] [Updated] (HIVE-21784) Insert overwrite on an acid (not mm) table is ineffective if the input is empty
[ https://issues.apache.org/jira/browse/HIVE-21784?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ivan Suller updated HIVE-21784: --- Attachment: HIVE-21784.2.patch > Insert overwrite on an acid (not mm) table is ineffective if the input is > empty > --- > > Key: HIVE-21784 > URL: https://issues.apache.org/jira/browse/HIVE-21784 > Project: Hive > Issue Type: Bug > Components: HiveServer2 >Reporter: Ivan Suller >Assignee: Ivan Suller >Priority: Major > Fix For: 4.0.0 > > Attachments: HIVE-21784.1.patch, HIVE-21784.2.patch > > > The issue of HIVE-18702 is present for ACID tables as well. -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[jira] [Assigned] (HIVE-21791) Fix Surrogat Key issue for insert with select with limit operations
[ https://issues.apache.org/jira/browse/HIVE-21791?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Miklos Gergely reassigned HIVE-21791: - Assignee: Miklos Gergely > Fix Surrogat Key issue for insert with select with limit operations > --- > > Key: HIVE-21791 > URL: https://issues.apache.org/jira/browse/HIVE-21791 > Project: Hive > Issue Type: Bug >Reporter: Miklos Gergely >Assignee: Miklos Gergely >Priority: Major > -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[jira] [Updated] (HIVE-21776) Replication fails to replicate a UDF with jar on HDFS during incremental
[ https://issues.apache.org/jira/browse/HIVE-21776?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sankar Hariappan updated HIVE-21776: Resolution: Fixed Status: Resolved (was: Patch Available) Committed to master. Thanks [~ashutosh.bapat] for the contribution! > Replication fails to replicate a UDF with jar on HDFS during incremental > > > Key: HIVE-21776 > URL: https://issues.apache.org/jira/browse/HIVE-21776 > Project: Hive > Issue Type: Bug >Affects Versions: 4.0.0 >Reporter: Ashutosh Bapat >Assignee: Ashutosh Bapat >Priority: Major > Labels: pull-request-available > Fix For: 4.0.0 > > Attachments: HIVE-21776.01.patch, HIVE-21776.02.patch, > HIVE-21776.03.patch, HIVE-21776.04.patch > > Time Spent: 1h 10m > Remaining Estimate: 0h > > TestReplicationScenariosAcrossInstances has test to test bootstrap of a UDF > with jar on HDFS but no test for incremental. Add the same. -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[jira] [Commented] (HIVE-21776) Replication fails to replicate a UDF with jar on HDFS during incremental
[ https://issues.apache.org/jira/browse/HIVE-21776?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16847574#comment-16847574 ] Sankar Hariappan commented on HIVE-21776: - +1, LGTM > Replication fails to replicate a UDF with jar on HDFS during incremental > > > Key: HIVE-21776 > URL: https://issues.apache.org/jira/browse/HIVE-21776 > Project: Hive > Issue Type: Bug >Affects Versions: 4.0.0 >Reporter: Ashutosh Bapat >Assignee: Ashutosh Bapat >Priority: Major > Labels: pull-request-available > Fix For: 4.0.0 > > Attachments: HIVE-21776.01.patch, HIVE-21776.02.patch, > HIVE-21776.03.patch, HIVE-21776.04.patch > > Time Spent: 1h 10m > Remaining Estimate: 0h > > TestReplicationScenariosAcrossInstances has test to test bootstrap of a UDF > with jar on HDFS but no test for incremental. Add the same. -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[jira] [Work logged] (HIVE-21790) Bump Java to 1.8
[ https://issues.apache.org/jira/browse/HIVE-21790?focusedWorklogId=248041=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-248041 ] ASF GitHub Bot logged work on HIVE-21790: - Author: ASF GitHub Bot Created on: 24/May/19 13:53 Start Date: 24/May/19 13:53 Worklog Time Spent: 10m Work Description: Fokko commented on pull request #645: HIVE-21790 Bump Java to 1.8 URL: https://github.com/apache/hive/pull/645 We're using Hive for reading Parquet files, but we would like to move from gzip to zstandard compression. Currently, the Parquet support of Hive is old because we can't upgrade since Parquet is Java 1.8+. Therefore it is a good idea to upgrade Hive as well. GA support of Java 1.7 is also almost over: https://www.oracle.com/technetwork/java/java-se-support-roadmap.html This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org Issue Time Tracking --- Worklog Id: (was: 248041) Time Spent: 10m Remaining Estimate: 0h > Bump Java to 1.8 > > > Key: HIVE-21790 > URL: https://issues.apache.org/jira/browse/HIVE-21790 > Project: Hive > Issue Type: Improvement >Affects Versions: 2.3.5 >Reporter: Fokko Driesprong >Assignee: Fokko Driesprong >Priority: Major > Labels: pull-request-available > Attachments: 0001-HIVE-21790-Update-to-Java-1.8.patch > > Time Spent: 10m > Remaining Estimate: 0h > > We're using Hive for reading Parquet files, but we would like to move from > gzip to zstandard compression. Currently, the Parquet support of Hive is old > because we can't upgrade since Parquet is Java 1.8+. Therefore it is a good > idea to upgrade Hive as well. > GA support of Java 1.7 is also almost over: > https://www.oracle.com/technetwork/java/java-se-support-roadmap.html -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[jira] [Updated] (HIVE-21790) Bump Java to 1.8
[ https://issues.apache.org/jira/browse/HIVE-21790?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated HIVE-21790: -- Labels: pull-request-available (was: ) > Bump Java to 1.8 > > > Key: HIVE-21790 > URL: https://issues.apache.org/jira/browse/HIVE-21790 > Project: Hive > Issue Type: Improvement >Affects Versions: 2.3.5 >Reporter: Fokko Driesprong >Assignee: Fokko Driesprong >Priority: Major > Labels: pull-request-available > Attachments: 0001-HIVE-21790-Update-to-Java-1.8.patch > > > We're using Hive for reading Parquet files, but we would like to move from > gzip to zstandard compression. Currently, the Parquet support of Hive is old > because we can't upgrade since Parquet is Java 1.8+. Therefore it is a good > idea to upgrade Hive as well. > GA support of Java 1.7 is also almost over: > https://www.oracle.com/technetwork/java/java-se-support-roadmap.html -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[jira] [Updated] (HIVE-21790) Bump Java to 1.8
[ https://issues.apache.org/jira/browse/HIVE-21790?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Fokko Driesprong updated HIVE-21790: Attachment: 0001-HIVE-21790-Update-to-Java-1.8.patch Status: Patch Available (was: Open) > Bump Java to 1.8 > > > Key: HIVE-21790 > URL: https://issues.apache.org/jira/browse/HIVE-21790 > Project: Hive > Issue Type: Improvement >Affects Versions: 2.3.5 >Reporter: Fokko Driesprong >Assignee: Fokko Driesprong >Priority: Major > Attachments: 0001-HIVE-21790-Update-to-Java-1.8.patch > > > We're using Hive for reading Parquet files, but we would like to move from > gzip to zstandard compression. Currently, the Parquet support of Hive is old > because we can't upgrade since Parquet is Java 1.8+. Therefore it is a good > idea to upgrade Hive as well. > GA support of Java 1.7 is also almost over: > https://www.oracle.com/technetwork/java/java-se-support-roadmap.html -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[jira] [Assigned] (HIVE-21790) Bump Java to 1.8
[ https://issues.apache.org/jira/browse/HIVE-21790?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Fokko Driesprong reassigned HIVE-21790: --- > Bump Java to 1.8 > > > Key: HIVE-21790 > URL: https://issues.apache.org/jira/browse/HIVE-21790 > Project: Hive > Issue Type: Improvement >Affects Versions: 2.3.5 >Reporter: Fokko Driesprong >Assignee: Fokko Driesprong >Priority: Major > > We're using Hive for reading Parquet files, but we would like to move from > gzip to zstandard compression. Currently, the Parquet support of Hive is old > because we can't upgrade since Parquet is Java 1.8+. Therefore it is a good > idea to upgrade Hive as well. > GA support of Java 1.7 is also almost over: > https://www.oracle.com/technetwork/java/java-se-support-roadmap.html -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[jira] [Updated] (HIVE-21145) Enable cbo to use runtime statistics during re-optimization
[ https://issues.apache.org/jira/browse/HIVE-21145?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zoltan Haindrich updated HIVE-21145: Attachment: HIVE-21145.03.patch > Enable cbo to use runtime statistics during re-optimization > --- > > Key: HIVE-21145 > URL: https://issues.apache.org/jira/browse/HIVE-21145 > Project: Hive > Issue Type: Improvement > Components: CBO, Statistics >Reporter: Zoltan Haindrich >Assignee: Zoltan Haindrich >Priority: Major > Attachments: HIVE-21145.01.patch, HIVE-21145.02.patch, > HIVE-21145.03.patch > > > This could enable to reorder joins according to runtime rowcounts. -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[jira] [Work logged] (HIVE-21776) Replication fails to replicate a UDF with jar on HDFS during incremental
[
https://issues.apache.org/jira/browse/HIVE-21776?focusedWorklogId=248033=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-248033
]
ASF GitHub Bot logged work on HIVE-21776:
-
Author: ASF GitHub Bot
Created on: 24/May/19 13:44
Start Date: 24/May/19 13:44
Worklog Time Spent: 10m
Work Description: sankarh commented on pull request #642: HIVE-21776 :
Replication fails to replicate a UDF with jar on HDFS during incremental
URL: https://github.com/apache/hive/pull/642#discussion_r287365528
##
File path:
standalone-metastore/metastore-common/src/main/java/org/apache/hadoop/hive/metastore/ReplChangeManager.java
##
@@ -356,6 +356,9 @@ public static FileInfo getFileInfo(Path src, String
checksumString, String srcCM
// Currently using fileuri#checksum#cmrooturi#subdirs as the format
public static String encodeFileUri(String fileUriStr, String fileChecksum,
String encodedSubDir)
throws IOException {
+if (instance == null) {
+ throw new IOException("Uninitialized ReplChangeManager instance.");
+}
String encodedUri = fileUriStr;
Review comment:
I agree that we need not fix it right away as we currently enforce to enable
CM for replication to work.
But, in HDP 2.6, we already support replication even when CM is disabled
which is broken in HDP 3.1. This is due to difference in implementation of
isCMFileUri method in both these versions.
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
us...@infra.apache.org
Issue Time Tracking
---
Worklog Id: (was: 248033)
Time Spent: 1h 10m (was: 1h)
> Replication fails to replicate a UDF with jar on HDFS during incremental
>
>
> Key: HIVE-21776
> URL: https://issues.apache.org/jira/browse/HIVE-21776
> Project: Hive
> Issue Type: Bug
>Affects Versions: 4.0.0
>Reporter: Ashutosh Bapat
>Assignee: Ashutosh Bapat
>Priority: Major
> Labels: pull-request-available
> Fix For: 4.0.0
>
> Attachments: HIVE-21776.01.patch, HIVE-21776.02.patch,
> HIVE-21776.03.patch, HIVE-21776.04.patch
>
> Time Spent: 1h 10m
> Remaining Estimate: 0h
>
> TestReplicationScenariosAcrossInstances has test to test bootstrap of a UDF
> with jar on HDFS but no test for incremental. Add the same.
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
[jira] [Commented] (HIVE-16906) Hive ATSHook should check for yarn.timeline-service.enabled before connecting to ATS
[
https://issues.apache.org/jira/browse/HIVE-16906?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16847544#comment-16847544
]
Hive QA commented on HIVE-16906:
| (/) *{color:green}+1 overall{color}* |
\\
\\
|| Vote || Subsystem || Runtime || Comment ||
|| || || || {color:brown} Prechecks {color} ||
| {color:green}+1{color} | {color:green} @author {color} | {color:green} 0m
0s{color} | {color:green} The patch does not contain any @author tags. {color} |
|| || || || {color:brown} master Compile Tests {color} ||
| {color:green}+1{color} | {color:green} mvninstall {color} | {color:green} 9m
56s{color} | {color:green} master passed {color} |
| {color:green}+1{color} | {color:green} compile {color} | {color:green} 1m
22s{color} | {color:green} master passed {color} |
| {color:green}+1{color} | {color:green} checkstyle {color} | {color:green} 0m
45s{color} | {color:green} master passed {color} |
| {color:blue}0{color} | {color:blue} findbugs {color} | {color:blue} 4m
46s{color} | {color:blue} ql in master has 2258 extant Findbugs warnings.
{color} |
| {color:green}+1{color} | {color:green} javadoc {color} | {color:green} 1m
9s{color} | {color:green} master passed {color} |
|| || || || {color:brown} Patch Compile Tests {color} ||
| {color:green}+1{color} | {color:green} mvninstall {color} | {color:green} 1m
41s{color} | {color:green} the patch passed {color} |
| {color:green}+1{color} | {color:green} compile {color} | {color:green} 1m
19s{color} | {color:green} the patch passed {color} |
| {color:green}+1{color} | {color:green} javac {color} | {color:green} 1m
19s{color} | {color:green} the patch passed {color} |
| {color:green}+1{color} | {color:green} checkstyle {color} | {color:green} 0m
47s{color} | {color:green} the patch passed {color} |
| {color:green}+1{color} | {color:green} whitespace {color} | {color:green} 0m
0s{color} | {color:green} The patch has no whitespace issues. {color} |
| {color:green}+1{color} | {color:green} findbugs {color} | {color:green} 4m
55s{color} | {color:green} the patch passed {color} |
| {color:green}+1{color} | {color:green} javadoc {color} | {color:green} 1m
8s{color} | {color:green} the patch passed {color} |
|| || || || {color:brown} Other Tests {color} ||
| {color:green}+1{color} | {color:green} asflicense {color} | {color:green} 0m
17s{color} | {color:green} The patch does not generate ASF License warnings.
{color} |
| {color:black}{color} | {color:black} {color} | {color:black} 28m 42s{color} |
{color:black} {color} |
\\
\\
|| Subsystem || Report/Notes ||
| Optional Tests | asflicense javac javadoc findbugs checkstyle compile |
| uname | Linux hiveptest-server-upstream 3.16.0-4-amd64 #1 SMP Debian
3.16.43-2+deb8u5 (2017-09-19) x86_64 GNU/Linux |
| Build tool | maven |
| Personality |
/data/hiveptest/working/yetus_PreCommit-HIVE-Build-17294/dev-support/hive-personality.sh
|
| git revision | master / 07e671c |
| Default Java | 1.8.0_111 |
| findbugs | v3.0.0 |
| modules | C: ql U: ql |
| Console output |
http://104.198.109.242/logs//PreCommit-HIVE-Build-17294/yetus.txt |
| Powered by | Apache Yetushttp://yetus.apache.org |
This message was automatically generated.
> Hive ATSHook should check for yarn.timeline-service.enabled before connecting
> to ATS
>
>
> Key: HIVE-16906
> URL: https://issues.apache.org/jira/browse/HIVE-16906
> Project: Hive
> Issue Type: Bug
> Components: Hive
>Affects Versions: 1.2.2
>Reporter: Prabhu Joseph
>Assignee: Naresh P R
>Priority: Major
> Attachments: HIVE-16906.1.patch
>
>
> Hive ATShook has to check yarn.timeline-service.enabled (Indicate to clients
> whether timeline service is enabled or not. If enabled, clients will put
> entities and events to the timeline server.) before creating TimelineClient
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
[jira] [Commented] (HIVE-21784) Insert overwrite on an acid (not mm) table is ineffective if the input is empty
[
https://issues.apache.org/jira/browse/HIVE-21784?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16847526#comment-16847526
]
Hive QA commented on HIVE-21784:
Here are the results of testing the latest attachment:
https://issues.apache.org/jira/secure/attachment/12969610/HIVE-21784.1.patch
{color:green}SUCCESS:{color} +1 due to 1 test(s) being added or modified.
{color:red}ERROR:{color} -1 due to 1 failed/errored test(s), 16057 tests
executed
*Failed tests:*
{noformat}
org.apache.hadoop.hive.ql.io.orc.TestOrcRawRecordMerger.testEmpty (batchId=313)
{noformat}
Test results:
https://builds.apache.org/job/PreCommit-HIVE-Build/17293/testReport
Console output: https://builds.apache.org/job/PreCommit-HIVE-Build/17293/console
Test logs: http://104.198.109.242/logs/PreCommit-HIVE-Build-17293/
Messages:
{noformat}
Executing org.apache.hive.ptest.execution.TestCheckPhase
Executing org.apache.hive.ptest.execution.PrepPhase
Executing org.apache.hive.ptest.execution.YetusPhase
Executing org.apache.hive.ptest.execution.ExecutionPhase
Executing org.apache.hive.ptest.execution.ReportingPhase
Tests exited with: TestsFailedException: 1 tests failed
{noformat}
This message is automatically generated.
ATTACHMENT ID: 12969610 - PreCommit-HIVE-Build
> Insert overwrite on an acid (not mm) table is ineffective if the input is
> empty
> ---
>
> Key: HIVE-21784
> URL: https://issues.apache.org/jira/browse/HIVE-21784
> Project: Hive
> Issue Type: Bug
> Components: HiveServer2
>Reporter: Ivan Suller
>Assignee: Ivan Suller
>Priority: Major
> Fix For: 4.0.0
>
> Attachments: HIVE-21784.1.patch
>
>
> The issue of HIVE-18702 is present for ACID tables as well.
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
[jira] [Assigned] (HIVE-21789) HiveFileFormatUtils.getRecordWriter is unnecessary
[ https://issues.apache.org/jira/browse/HIVE-21789?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ivan Suller reassigned HIVE-21789: -- > HiveFileFormatUtils.getRecordWriter is unnecessary > -- > > Key: HIVE-21789 > URL: https://issues.apache.org/jira/browse/HIVE-21789 > Project: Hive > Issue Type: Improvement >Reporter: Ivan Suller >Assignee: Ivan Suller >Priority: Minor > > The method org.apache.hadoop.hive.ql.io.HiveFileFormatUtils.getRecordWriter > checks if the given outputFormat parameter is a HiveOutputFormat, but it is > always true. So this way the check and thus the method is unnecessary. -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[jira] [Updated] (HIVE-21732) Configurable injection of load for LLAP task execution
[ https://issues.apache.org/jira/browse/HIVE-21732?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Peter Vary updated HIVE-21732: -- Attachment: HIVE-21732.10.patch > Configurable injection of load for LLAP task execution > -- > > Key: HIVE-21732 > URL: https://issues.apache.org/jira/browse/HIVE-21732 > Project: Hive > Issue Type: Test >Reporter: Peter Vary >Assignee: Peter Vary >Priority: Major > Labels: pull-request-available > Attachments: HIVE-21732.10.patch, HIVE-21732.2.patch, > HIVE-21732.3.patch, HIVE-21732.4.patch, HIVE-21732.5.patch, > HIVE-21732.6.patch, HIVE-21732.7.patch, HIVE-21732.8.patch, > HIVE-21732.9.patch, HIVE-21732.patch > > Time Spent: 5h 40m > Remaining Estimate: 0h > > For evaluating testing, it would be good to have a configurable way to inject > latency for LLAP tasks. > The configuration should be able to control how much latency is injected into > each daemon. -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[jira] [Updated] (HIVE-21145) Enable cbo to use runtime statistics during re-optimization
[ https://issues.apache.org/jira/browse/HIVE-21145?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zoltan Haindrich updated HIVE-21145: Attachment: HIVE-21145.02.patch > Enable cbo to use runtime statistics during re-optimization > --- > > Key: HIVE-21145 > URL: https://issues.apache.org/jira/browse/HIVE-21145 > Project: Hive > Issue Type: Improvement > Components: CBO, Statistics >Reporter: Zoltan Haindrich >Assignee: Zoltan Haindrich >Priority: Major > Attachments: HIVE-21145.01.patch, HIVE-21145.02.patch > > > This could enable to reorder joins according to runtime rowcounts. -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[jira] [Commented] (HIVE-21784) Insert overwrite on an acid (not mm) table is ineffective if the input is empty
[
https://issues.apache.org/jira/browse/HIVE-21784?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16847496#comment-16847496
]
Hive QA commented on HIVE-21784:
| (/) *{color:green}+1 overall{color}* |
\\
\\
|| Vote || Subsystem || Runtime || Comment ||
|| || || || {color:brown} Prechecks {color} ||
| {color:green}+1{color} | {color:green} @author {color} | {color:green} 0m
0s{color} | {color:green} The patch does not contain any @author tags. {color} |
|| || || || {color:brown} master Compile Tests {color} ||
| {color:green}+1{color} | {color:green} mvninstall {color} | {color:green} 9m
56s{color} | {color:green} master passed {color} |
| {color:green}+1{color} | {color:green} compile {color} | {color:green} 1m
19s{color} | {color:green} master passed {color} |
| {color:green}+1{color} | {color:green} checkstyle {color} | {color:green} 0m
47s{color} | {color:green} master passed {color} |
| {color:blue}0{color} | {color:blue} findbugs {color} | {color:blue} 4m
48s{color} | {color:blue} ql in master has 2258 extant Findbugs warnings.
{color} |
| {color:green}+1{color} | {color:green} javadoc {color} | {color:green} 1m
10s{color} | {color:green} master passed {color} |
|| || || || {color:brown} Patch Compile Tests {color} ||
| {color:green}+1{color} | {color:green} mvninstall {color} | {color:green} 1m
43s{color} | {color:green} the patch passed {color} |
| {color:green}+1{color} | {color:green} compile {color} | {color:green} 1m
21s{color} | {color:green} the patch passed {color} |
| {color:green}+1{color} | {color:green} javac {color} | {color:green} 1m
21s{color} | {color:green} the patch passed {color} |
| {color:green}+1{color} | {color:green} checkstyle {color} | {color:green} 0m
48s{color} | {color:green} the patch passed {color} |
| {color:green}+1{color} | {color:green} whitespace {color} | {color:green} 0m
0s{color} | {color:green} The patch has no whitespace issues. {color} |
| {color:green}+1{color} | {color:green} findbugs {color} | {color:green} 5m
6s{color} | {color:green} the patch passed {color} |
| {color:green}+1{color} | {color:green} javadoc {color} | {color:green} 1m
9s{color} | {color:green} the patch passed {color} |
|| || || || {color:brown} Other Tests {color} ||
| {color:green}+1{color} | {color:green} asflicense {color} | {color:green} 0m
16s{color} | {color:green} The patch does not generate ASF License warnings.
{color} |
| {color:black}{color} | {color:black} {color} | {color:black} 28m 59s{color} |
{color:black} {color} |
\\
\\
|| Subsystem || Report/Notes ||
| Optional Tests | asflicense javac javadoc findbugs checkstyle compile |
| uname | Linux hiveptest-server-upstream 3.16.0-4-amd64 #1 SMP Debian
3.16.43-2+deb8u5 (2017-09-19) x86_64 GNU/Linux |
| Build tool | maven |
| Personality |
/data/hiveptest/working/yetus_PreCommit-HIVE-Build-17293/dev-support/hive-personality.sh
|
| git revision | master / 07e671c |
| Default Java | 1.8.0_111 |
| findbugs | v3.0.0 |
| modules | C: ql U: ql |
| Console output |
http://104.198.109.242/logs//PreCommit-HIVE-Build-17293/yetus.txt |
| Powered by | Apache Yetushttp://yetus.apache.org |
This message was automatically generated.
> Insert overwrite on an acid (not mm) table is ineffective if the input is
> empty
> ---
>
> Key: HIVE-21784
> URL: https://issues.apache.org/jira/browse/HIVE-21784
> Project: Hive
> Issue Type: Bug
> Components: HiveServer2
>Reporter: Ivan Suller
>Assignee: Ivan Suller
>Priority: Major
> Fix For: 4.0.0
>
> Attachments: HIVE-21784.1.patch
>
>
> The issue of HIVE-18702 is present for ACID tables as well.
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
[jira] [Updated] (HIVE-16906) Hive ATSHook should check for yarn.timeline-service.enabled before connecting to ATS
[ https://issues.apache.org/jira/browse/HIVE-16906?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Naresh P R updated HIVE-16906: -- Attachment: (was: HIVE-16906.1.patch) > Hive ATSHook should check for yarn.timeline-service.enabled before connecting > to ATS > > > Key: HIVE-16906 > URL: https://issues.apache.org/jira/browse/HIVE-16906 > Project: Hive > Issue Type: Bug > Components: Hive >Affects Versions: 1.2.2 >Reporter: Prabhu Joseph >Assignee: Naresh P R >Priority: Major > Attachments: HIVE-16906.1.patch > > > Hive ATShook has to check yarn.timeline-service.enabled (Indicate to clients > whether timeline service is enabled or not. If enabled, clients will put > entities and events to the timeline server.) before creating TimelineClient -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[jira] [Updated] (HIVE-16906) Hive ATSHook should check for yarn.timeline-service.enabled before connecting to ATS
[ https://issues.apache.org/jira/browse/HIVE-16906?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Naresh P R updated HIVE-16906: -- Attachment: HIVE-16906.1.patch > Hive ATSHook should check for yarn.timeline-service.enabled before connecting > to ATS > > > Key: HIVE-16906 > URL: https://issues.apache.org/jira/browse/HIVE-16906 > Project: Hive > Issue Type: Bug > Components: Hive >Affects Versions: 1.2.2 >Reporter: Prabhu Joseph >Assignee: Naresh P R >Priority: Major > Attachments: HIVE-16906.1.patch > > > Hive ATShook has to check yarn.timeline-service.enabled (Indicate to clients > whether timeline service is enabled or not. If enabled, clients will put > entities and events to the timeline server.) before creating TimelineClient -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[jira] [Commented] (HIVE-21732) Configurable injection of load for LLAP task execution
[
https://issues.apache.org/jira/browse/HIVE-21732?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16847478#comment-16847478
]
Hive QA commented on HIVE-21732:
Here are the results of testing the latest attachment:
https://issues.apache.org/jira/secure/attachment/12969603/HIVE-21732.9.patch
{color:green}SUCCESS:{color} +1 due to 1 test(s) being added or modified.
{color:red}ERROR:{color} -1 due to 14 failed/errored test(s), 16059 tests
executed
*Failed tests:*
{noformat}
org.apache.hadoop.hive.metastore.TestObjectStore.catalogs (batchId=232)
org.apache.hadoop.hive.metastore.TestObjectStore.testDatabaseOps (batchId=232)
org.apache.hadoop.hive.metastore.TestObjectStore.testDeprecatedConfigIsOverwritten
(batchId=232)
org.apache.hadoop.hive.metastore.TestObjectStore.testDirectSQLDropParitionsCleanup
(batchId=232)
org.apache.hadoop.hive.metastore.TestObjectStore.testDirectSQLDropPartitionsCacheCrossSession
(batchId=232)
org.apache.hadoop.hive.metastore.TestObjectStore.testDirectSqlErrorMetrics
(batchId=232)
org.apache.hadoop.hive.metastore.TestObjectStore.testEmptyTrustStoreProps
(batchId=232)
org.apache.hadoop.hive.metastore.TestObjectStore.testMasterKeyOps (batchId=232)
org.apache.hadoop.hive.metastore.TestObjectStore.testMaxEventResponse
(batchId=232)
org.apache.hadoop.hive.metastore.TestObjectStore.testPartitionOps (batchId=232)
org.apache.hadoop.hive.metastore.TestObjectStore.testQueryCloseOnError
(batchId=232)
org.apache.hadoop.hive.metastore.TestObjectStore.testRoleOps (batchId=232)
org.apache.hadoop.hive.metastore.TestObjectStore.testTableOps (batchId=232)
org.apache.hadoop.hive.metastore.TestObjectStore.testUseSSLProperty
(batchId=232)
{noformat}
Test results:
https://builds.apache.org/job/PreCommit-HIVE-Build/17292/testReport
Console output: https://builds.apache.org/job/PreCommit-HIVE-Build/17292/console
Test logs: http://104.198.109.242/logs/PreCommit-HIVE-Build-17292/
Messages:
{noformat}
Executing org.apache.hive.ptest.execution.TestCheckPhase
Executing org.apache.hive.ptest.execution.PrepPhase
Executing org.apache.hive.ptest.execution.YetusPhase
Executing org.apache.hive.ptest.execution.ExecutionPhase
Executing org.apache.hive.ptest.execution.ReportingPhase
Tests exited with: TestsFailedException: 14 tests failed
{noformat}
This message is automatically generated.
ATTACHMENT ID: 12969603 - PreCommit-HIVE-Build
> Configurable injection of load for LLAP task execution
> --
>
> Key: HIVE-21732
> URL: https://issues.apache.org/jira/browse/HIVE-21732
> Project: Hive
> Issue Type: Test
>Reporter: Peter Vary
>Assignee: Peter Vary
>Priority: Major
> Labels: pull-request-available
> Attachments: HIVE-21732.2.patch, HIVE-21732.3.patch,
> HIVE-21732.4.patch, HIVE-21732.5.patch, HIVE-21732.6.patch,
> HIVE-21732.7.patch, HIVE-21732.8.patch, HIVE-21732.9.patch, HIVE-21732.patch
>
> Time Spent: 5h 40m
> Remaining Estimate: 0h
>
> For evaluating testing, it would be good to have a configurable way to inject
> latency for LLAP tasks.
> The configuration should be able to control how much latency is injected into
> each daemon.
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
[jira] [Updated] (HIVE-16906) Hive ATSHook should check for yarn.timeline-service.enabled before connecting to ATS
[ https://issues.apache.org/jira/browse/HIVE-16906?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Naresh P R updated HIVE-16906: -- Status: Patch Available (was: In Progress) > Hive ATSHook should check for yarn.timeline-service.enabled before connecting > to ATS > > > Key: HIVE-16906 > URL: https://issues.apache.org/jira/browse/HIVE-16906 > Project: Hive > Issue Type: Bug > Components: Hive >Affects Versions: 1.2.2 >Reporter: Prabhu Joseph >Assignee: Naresh P R >Priority: Major > Attachments: HIVE-16906.1.patch > > > Hive ATShook has to check yarn.timeline-service.enabled (Indicate to clients > whether timeline service is enabled or not. If enabled, clients will put > entities and events to the timeline server.) before creating TimelineClient -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[jira] [Updated] (HIVE-16906) Hive ATSHook should check for yarn.timeline-service.enabled before connecting to ATS
[ https://issues.apache.org/jira/browse/HIVE-16906?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Naresh P R updated HIVE-16906: -- Attachment: (was: HIVE-16906.1.patch) > Hive ATSHook should check for yarn.timeline-service.enabled before connecting > to ATS > > > Key: HIVE-16906 > URL: https://issues.apache.org/jira/browse/HIVE-16906 > Project: Hive > Issue Type: Bug > Components: Hive >Affects Versions: 1.2.2 >Reporter: Prabhu Joseph >Assignee: Naresh P R >Priority: Major > Attachments: HIVE-16906.1.patch > > > Hive ATShook has to check yarn.timeline-service.enabled (Indicate to clients > whether timeline service is enabled or not. If enabled, clients will put > entities and events to the timeline server.) before creating TimelineClient -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[jira] [Updated] (HIVE-16906) Hive ATSHook should check for yarn.timeline-service.enabled before connecting to ATS
[ https://issues.apache.org/jira/browse/HIVE-16906?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Naresh P R updated HIVE-16906: -- Attachment: HIVE-16906.1.patch > Hive ATSHook should check for yarn.timeline-service.enabled before connecting > to ATS > > > Key: HIVE-16906 > URL: https://issues.apache.org/jira/browse/HIVE-16906 > Project: Hive > Issue Type: Bug > Components: Hive >Affects Versions: 1.2.2 >Reporter: Prabhu Joseph >Assignee: Naresh P R >Priority: Major > Attachments: HIVE-16906.1.patch > > > Hive ATShook has to check yarn.timeline-service.enabled (Indicate to clients > whether timeline service is enabled or not. If enabled, clients will put > entities and events to the timeline server.) before creating TimelineClient -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[jira] [Work started] (HIVE-16906) Hive ATSHook should check for yarn.timeline-service.enabled before connecting to ATS
[ https://issues.apache.org/jira/browse/HIVE-16906?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Work on HIVE-16906 started by Naresh P R. - > Hive ATSHook should check for yarn.timeline-service.enabled before connecting > to ATS > > > Key: HIVE-16906 > URL: https://issues.apache.org/jira/browse/HIVE-16906 > Project: Hive > Issue Type: Bug > Components: Hive >Affects Versions: 1.2.2 >Reporter: Prabhu Joseph >Assignee: Naresh P R >Priority: Major > Attachments: HIVE-16906.1.patch > > > Hive ATShook has to check yarn.timeline-service.enabled (Indicate to clients > whether timeline service is enabled or not. If enabled, clients will put > entities and events to the timeline server.) before creating TimelineClient -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[jira] [Updated] (HIVE-16906) Hive ATSHook should check for yarn.timeline-service.enabled before connecting to ATS
[ https://issues.apache.org/jira/browse/HIVE-16906?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Naresh P R updated HIVE-16906: -- Attachment: HIVE-16906.1.patch > Hive ATSHook should check for yarn.timeline-service.enabled before connecting > to ATS > > > Key: HIVE-16906 > URL: https://issues.apache.org/jira/browse/HIVE-16906 > Project: Hive > Issue Type: Bug > Components: Hive >Affects Versions: 1.2.2 >Reporter: Prabhu Joseph >Assignee: Naresh P R >Priority: Major > Attachments: HIVE-16906.1.patch > > > Hive ATShook has to check yarn.timeline-service.enabled (Indicate to clients > whether timeline service is enabled or not. If enabled, clients will put > entities and events to the timeline server.) before creating TimelineClient -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[jira] [Assigned] (HIVE-16906) Hive ATSHook should check for yarn.timeline-service.enabled before connecting to ATS
[ https://issues.apache.org/jira/browse/HIVE-16906?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Naresh P R reassigned HIVE-16906: - Assignee: Naresh P R (was: Bing Li) > Hive ATSHook should check for yarn.timeline-service.enabled before connecting > to ATS > > > Key: HIVE-16906 > URL: https://issues.apache.org/jira/browse/HIVE-16906 > Project: Hive > Issue Type: Bug > Components: Hive >Affects Versions: 1.2.2 >Reporter: Prabhu Joseph >Assignee: Naresh P R >Priority: Major > Attachments: HIVE-16906.1.patch > > > Hive ATShook has to check yarn.timeline-service.enabled (Indicate to clients > whether timeline service is enabled or not. If enabled, clients will put > entities and events to the timeline server.) before creating TimelineClient -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[jira] [Commented] (HIVE-21732) Configurable injection of load for LLAP task execution
[
https://issues.apache.org/jira/browse/HIVE-21732?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16847453#comment-16847453
]
Hive QA commented on HIVE-21732:
| (x) *{color:red}-1 overall{color}* |
\\
\\
|| Vote || Subsystem || Runtime || Comment ||
|| || || || {color:brown} Prechecks {color} ||
| {color:green}+1{color} | {color:green} @author {color} | {color:green} 0m
0s{color} | {color:green} The patch does not contain any @author tags. {color} |
|| || || || {color:brown} master Compile Tests {color} ||
| {color:blue}0{color} | {color:blue} mvndep {color} | {color:blue} 2m
11s{color} | {color:blue} Maven dependency ordering for branch {color} |
| {color:green}+1{color} | {color:green} mvninstall {color} | {color:green} 8m
24s{color} | {color:green} master passed {color} |
| {color:green}+1{color} | {color:green} compile {color} | {color:green} 0m
46s{color} | {color:green} master passed {color} |
| {color:green}+1{color} | {color:green} checkstyle {color} | {color:green} 0m
34s{color} | {color:green} master passed {color} |
| {color:blue}0{color} | {color:blue} findbugs {color} | {color:blue} 0m
40s{color} | {color:blue} common in master has 62 extant Findbugs warnings.
{color} |
| {color:blue}0{color} | {color:blue} findbugs {color} | {color:blue} 0m
52s{color} | {color:blue} llap-server in master has 81 extant Findbugs
warnings. {color} |
| {color:green}+1{color} | {color:green} javadoc {color} | {color:green} 0m
31s{color} | {color:green} master passed {color} |
|| || || || {color:brown} Patch Compile Tests {color} ||
| {color:blue}0{color} | {color:blue} mvndep {color} | {color:blue} 0m
30s{color} | {color:blue} Maven dependency ordering for patch {color} |
| {color:red}-1{color} | {color:red} mvninstall {color} | {color:red} 0m
24s{color} | {color:red} llap-server in the patch failed. {color} |
| {color:red}-1{color} | {color:red} compile {color} | {color:red} 0m
24s{color} | {color:red} llap-server in the patch failed. {color} |
| {color:red}-1{color} | {color:red} javac {color} | {color:red} 0m 24s{color}
| {color:red} llap-server in the patch failed. {color} |
| {color:green}+1{color} | {color:green} checkstyle {color} | {color:green} 0m
35s{color} | {color:green} the patch passed {color} |
| {color:green}+1{color} | {color:green} whitespace {color} | {color:green} 0m
0s{color} | {color:green} The patch has no whitespace issues. {color} |
| {color:red}-1{color} | {color:red} findbugs {color} | {color:red} 0m
21s{color} | {color:red} llap-server in the patch failed. {color} |
| {color:green}+1{color} | {color:green} javadoc {color} | {color:green} 0m
32s{color} | {color:green} the patch passed {color} |
|| || || || {color:brown} Other Tests {color} ||
| {color:green}+1{color} | {color:green} asflicense {color} | {color:green} 0m
16s{color} | {color:green} The patch does not generate ASF License warnings.
{color} |
| {color:black}{color} | {color:black} {color} | {color:black} 19m 8s{color} |
{color:black} {color} |
\\
\\
|| Subsystem || Report/Notes ||
| Optional Tests | asflicense javac javadoc findbugs checkstyle compile |
| uname | Linux hiveptest-server-upstream 3.16.0-4-amd64 #1 SMP Debian
3.16.43-2+deb8u5 (2017-09-19) x86_64 GNU/Linux |
| Build tool | maven |
| Personality |
/data/hiveptest/working/yetus_PreCommit-HIVE-Build-17292/dev-support/hive-personality.sh
|
| git revision | master / 07e671c |
| Default Java | 1.8.0_111 |
| findbugs | v3.0.0 |
| mvninstall |
http://104.198.109.242/logs//PreCommit-HIVE-Build-17292/yetus/patch-mvninstall-llap-server.txt
|
| compile |
http://104.198.109.242/logs//PreCommit-HIVE-Build-17292/yetus/patch-compile-llap-server.txt
|
| javac |
http://104.198.109.242/logs//PreCommit-HIVE-Build-17292/yetus/patch-compile-llap-server.txt
|
| findbugs |
http://104.198.109.242/logs//PreCommit-HIVE-Build-17292/yetus/patch-findbugs-llap-server.txt
|
| modules | C: common llap-server U: . |
| Console output |
http://104.198.109.242/logs//PreCommit-HIVE-Build-17292/yetus.txt |
| Powered by | Apache Yetushttp://yetus.apache.org |
This message was automatically generated.
> Configurable injection of load for LLAP task execution
> --
>
> Key: HIVE-21732
> URL: https://issues.apache.org/jira/browse/HIVE-21732
> Project: Hive
> Issue Type: Test
>Reporter: Peter Vary
>Assignee: Peter Vary
>Priority: Major
> Labels: pull-request-available
> Attachments: HIVE-21732.2.patch, HIVE-21732.3.patch,
> HIVE-21732.4.patch, HIVE-21732.5.patch, HIVE-21732.6.patch,
> HIVE-21732.7.patch, HIVE-21732.8.patch, HIVE-21732.9.patch, HIVE-21732.patch
>
> Time Spent: 5h 40m
> Remaining Estimate: 0h
>
> For evaluating testing, it would be good to have a configurable way to inject
> latency for
[jira] [Commented] (HIVE-21768) JDBC: Strip the default union prefix for un-enclosed UNION queries
[
https://issues.apache.org/jira/browse/HIVE-21768?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16847434#comment-16847434
]
Hive QA commented on HIVE-21768:
Here are the results of testing the latest attachment:
https://issues.apache.org/jira/secure/attachment/12969589/HIVE-21768.3.patch
{color:green}SUCCESS:{color} +1 due to 1 test(s) being added or modified.
{color:red}ERROR:{color} -1 due to 5 failed/errored test(s), 16058 tests
executed
*Failed tests:*
{noformat}
org.apache.hadoop.hive.cli.TestCliDriver.testCliDriver[input_part7] (batchId=18)
org.apache.hadoop.hive.cli.TestCliDriver.testCliDriver[union_ppr] (batchId=21)
org.apache.hadoop.hive.cli.TestSparkCliDriver.testCliDriver[optimize_nullscan]
(batchId=149)
org.apache.hadoop.hive.cli.TestSparkCliDriver.testCliDriver[union_ppr]
(batchId=120)
org.apache.hive.jdbc.authorization.TestJdbcWithSQLAuthUDFBlacklist.testBlackListedUdfUsage
(batchId=276)
{noformat}
Test results:
https://builds.apache.org/job/PreCommit-HIVE-Build/17291/testReport
Console output: https://builds.apache.org/job/PreCommit-HIVE-Build/17291/console
Test logs: http://104.198.109.242/logs/PreCommit-HIVE-Build-17291/
Messages:
{noformat}
Executing org.apache.hive.ptest.execution.TestCheckPhase
Executing org.apache.hive.ptest.execution.PrepPhase
Executing org.apache.hive.ptest.execution.YetusPhase
Executing org.apache.hive.ptest.execution.ExecutionPhase
Executing org.apache.hive.ptest.execution.ReportingPhase
Tests exited with: TestsFailedException: 5 tests failed
{noformat}
This message is automatically generated.
ATTACHMENT ID: 12969589 - PreCommit-HIVE-Build
> JDBC: Strip the default union prefix for un-enclosed UNION queries
> --
>
> Key: HIVE-21768
> URL: https://issues.apache.org/jira/browse/HIVE-21768
> Project: Hive
> Issue Type: Bug
> Components: Logical Optimizer
>Affects Versions: 4.0.0, 3.1.1
>Reporter: Gopal V
>Assignee: Gopal V
>Priority: Major
> Attachments: HIVE-21768.1.patch, HIVE-21768.2.patch,
> HIVE-21768.3.patch
>
>
> {code}
> beeline> select 1 union all select 2;
> +--+
> | _u1._c0 |
> +--+
> | 2|
> | 1|
> +--+
> {code}
> The _u1 is superfluous and harmful to result schema parsing.
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
[jira] [Commented] (HIVE-21768) JDBC: Strip the default union prefix for un-enclosed UNION queries
[
https://issues.apache.org/jira/browse/HIVE-21768?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16847390#comment-16847390
]
Hive QA commented on HIVE-21768:
| (x) *{color:red}-1 overall{color}* |
\\
\\
|| Vote || Subsystem || Runtime || Comment ||
|| || || || {color:brown} Prechecks {color} ||
| {color:green}+1{color} | {color:green} @author {color} | {color:green} 0m
0s{color} | {color:green} The patch does not contain any @author tags. {color} |
|| || || || {color:brown} master Compile Tests {color} ||
| {color:blue}0{color} | {color:blue} mvndep {color} | {color:blue} 1m
53s{color} | {color:blue} Maven dependency ordering for branch {color} |
| {color:green}+1{color} | {color:green} mvninstall {color} | {color:green} 8m
27s{color} | {color:green} master passed {color} |
| {color:green}+1{color} | {color:green} compile {color} | {color:green} 2m
6s{color} | {color:green} master passed {color} |
| {color:green}+1{color} | {color:green} checkstyle {color} | {color:green} 1m
14s{color} | {color:green} master passed {color} |
| {color:blue}0{color} | {color:blue} findbugs {color} | {color:blue} 4m
53s{color} | {color:blue} ql in master has 2258 extant Findbugs warnings.
{color} |
| {color:blue}0{color} | {color:blue} findbugs {color} | {color:blue} 0m
48s{color} | {color:blue} itests/hive-unit in master has 2 extant Findbugs
warnings. {color} |
| {color:green}+1{color} | {color:green} javadoc {color} | {color:green} 1m
39s{color} | {color:green} master passed {color} |
|| || || || {color:brown} Patch Compile Tests {color} ||
| {color:blue}0{color} | {color:blue} mvndep {color} | {color:blue} 0m
30s{color} | {color:blue} Maven dependency ordering for patch {color} |
| {color:green}+1{color} | {color:green} mvninstall {color} | {color:green} 2m
30s{color} | {color:green} the patch passed {color} |
| {color:green}+1{color} | {color:green} compile {color} | {color:green} 2m
8s{color} | {color:green} the patch passed {color} |
| {color:green}+1{color} | {color:green} javac {color} | {color:green} 2m
8s{color} | {color:green} the patch passed {color} |
| {color:red}-1{color} | {color:red} checkstyle {color} | {color:red} 0m
53s{color} | {color:red} ql: The patch generated 1 new + 464 unchanged - 0
fixed = 465 total (was 464) {color} |
| {color:green}+1{color} | {color:green} whitespace {color} | {color:green} 0m
0s{color} | {color:green} The patch has no whitespace issues. {color} |
| {color:green}+1{color} | {color:green} findbugs {color} | {color:green} 5m
49s{color} | {color:green} the patch passed {color} |
| {color:green}+1{color} | {color:green} javadoc {color} | {color:green} 1m
39s{color} | {color:green} the patch passed {color} |
|| || || || {color:brown} Other Tests {color} ||
| {color:green}+1{color} | {color:green} asflicense {color} | {color:green} 0m
16s{color} | {color:green} The patch does not generate ASF License warnings.
{color} |
| {color:black}{color} | {color:black} {color} | {color:black} 35m 58s{color} |
{color:black} {color} |
\\
\\
|| Subsystem || Report/Notes ||
| Optional Tests | asflicense javac javadoc findbugs checkstyle compile |
| uname | Linux hiveptest-server-upstream 3.16.0-4-amd64 #1 SMP Debian
3.16.43-2+deb8u5 (2017-09-19) x86_64 GNU/Linux |
| Build tool | maven |
| Personality |
/data/hiveptest/working/yetus_PreCommit-HIVE-Build-17291/dev-support/hive-personality.sh
|
| git revision | master / 07e671c |
| Default Java | 1.8.0_111 |
| findbugs | v3.0.0 |
| checkstyle |
http://104.198.109.242/logs//PreCommit-HIVE-Build-17291/yetus/diff-checkstyle-ql.txt
|
| modules | C: ql itests/hive-unit U: . |
| Console output |
http://104.198.109.242/logs//PreCommit-HIVE-Build-17291/yetus.txt |
| Powered by | Apache Yetushttp://yetus.apache.org |
This message was automatically generated.
> JDBC: Strip the default union prefix for un-enclosed UNION queries
> --
>
> Key: HIVE-21768
> URL: https://issues.apache.org/jira/browse/HIVE-21768
> Project: Hive
> Issue Type: Bug
> Components: Logical Optimizer
>Affects Versions: 4.0.0, 3.1.1
>Reporter: Gopal V
>Assignee: Gopal V
>Priority: Major
> Attachments: HIVE-21768.1.patch, HIVE-21768.2.patch,
> HIVE-21768.3.patch
>
>
> {code}
> beeline> select 1 union all select 2;
> +--+
> | _u1._c0 |
> +--+
> | 2|
> | 1|
> +--+
> {code}
> The _u1 is superfluous and harmful to result schema parsing.
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
[jira] [Commented] (HIVE-21784) Insert overwrite on an acid (not mm) table is ineffective if the input is empty
[ https://issues.apache.org/jira/browse/HIVE-21784?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16847362#comment-16847362 ] Zoltan Haindrich commented on HIVE-21784: - +1 pending tests > Insert overwrite on an acid (not mm) table is ineffective if the input is > empty > --- > > Key: HIVE-21784 > URL: https://issues.apache.org/jira/browse/HIVE-21784 > Project: Hive > Issue Type: Bug > Components: HiveServer2 >Reporter: Ivan Suller >Assignee: Ivan Suller >Priority: Major > Fix For: 4.0.0 > > Attachments: HIVE-21784.1.patch > > > The issue of HIVE-18702 is present for ACID tables as well. -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[jira] [Work started] (HIVE-21784) Insert overwrite on an acid (not mm) table is ineffective if the input is empty
[ https://issues.apache.org/jira/browse/HIVE-21784?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Work on HIVE-21784 started by Ivan Suller. -- > Insert overwrite on an acid (not mm) table is ineffective if the input is > empty > --- > > Key: HIVE-21784 > URL: https://issues.apache.org/jira/browse/HIVE-21784 > Project: Hive > Issue Type: Bug > Components: HiveServer2 >Reporter: Ivan Suller >Assignee: Ivan Suller >Priority: Major > Fix For: 4.0.0 > > Attachments: HIVE-21784.1.patch > > > The issue of HIVE-18702 is present for ACID tables as well. -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[jira] [Updated] (HIVE-21784) Insert overwrite on an acid (not mm) table is ineffective if the input is empty
[ https://issues.apache.org/jira/browse/HIVE-21784?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ivan Suller updated HIVE-21784: --- Attachment: HIVE-21784.1.patch > Insert overwrite on an acid (not mm) table is ineffective if the input is > empty > --- > > Key: HIVE-21784 > URL: https://issues.apache.org/jira/browse/HIVE-21784 > Project: Hive > Issue Type: Bug > Components: HiveServer2 >Reporter: Ivan Suller >Assignee: Ivan Suller >Priority: Major > Fix For: 4.0.0 > > Attachments: HIVE-21784.1.patch > > > The issue of HIVE-18702 is present for ACID tables as well. -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[jira] [Updated] (HIVE-21784) Insert overwrite on an acid (not mm) table is ineffective if the input is empty
[ https://issues.apache.org/jira/browse/HIVE-21784?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ivan Suller updated HIVE-21784: --- Status: Patch Available (was: In Progress) > Insert overwrite on an acid (not mm) table is ineffective if the input is > empty > --- > > Key: HIVE-21784 > URL: https://issues.apache.org/jira/browse/HIVE-21784 > Project: Hive > Issue Type: Bug > Components: HiveServer2 >Reporter: Ivan Suller >Assignee: Ivan Suller >Priority: Major > Fix For: 4.0.0 > > Attachments: HIVE-21784.1.patch > > > The issue of HIVE-18702 is present for ACID tables as well. -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[jira] [Commented] (HIVE-21776) Replication fails to replicate a UDF with jar on HDFS during incremental
[
https://issues.apache.org/jira/browse/HIVE-21776?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16847346#comment-16847346
]
Hive QA commented on HIVE-21776:
Here are the results of testing the latest attachment:
https://issues.apache.org/jira/secure/attachment/12969587/HIVE-21776.04.patch
{color:green}SUCCESS:{color} +1 due to 1 test(s) being added or modified.
{color:green}SUCCESS:{color} +1 due to 16059 tests passed
Test results:
https://builds.apache.org/job/PreCommit-HIVE-Build/17290/testReport
Console output: https://builds.apache.org/job/PreCommit-HIVE-Build/17290/console
Test logs: http://104.198.109.242/logs/PreCommit-HIVE-Build-17290/
Messages:
{noformat}
Executing org.apache.hive.ptest.execution.TestCheckPhase
Executing org.apache.hive.ptest.execution.PrepPhase
Executing org.apache.hive.ptest.execution.YetusPhase
Executing org.apache.hive.ptest.execution.ExecutionPhase
Executing org.apache.hive.ptest.execution.ReportingPhase
{noformat}
This message is automatically generated.
ATTACHMENT ID: 12969587 - PreCommit-HIVE-Build
> Replication fails to replicate a UDF with jar on HDFS during incremental
>
>
> Key: HIVE-21776
> URL: https://issues.apache.org/jira/browse/HIVE-21776
> Project: Hive
> Issue Type: Bug
>Affects Versions: 4.0.0
>Reporter: Ashutosh Bapat
>Assignee: Ashutosh Bapat
>Priority: Major
> Labels: pull-request-available
> Fix For: 4.0.0
>
> Attachments: HIVE-21776.01.patch, HIVE-21776.02.patch,
> HIVE-21776.03.patch, HIVE-21776.04.patch
>
> Time Spent: 1h
> Remaining Estimate: 0h
>
> TestReplicationScenariosAcrossInstances has test to test bootstrap of a UDF
> with jar on HDFS but no test for incremental. Add the same.
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
[jira] [Updated] (HIVE-21732) Configurable injection of load for LLAP task execution
[ https://issues.apache.org/jira/browse/HIVE-21732?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Peter Vary updated HIVE-21732: -- Attachment: HIVE-21732.9.patch > Configurable injection of load for LLAP task execution > -- > > Key: HIVE-21732 > URL: https://issues.apache.org/jira/browse/HIVE-21732 > Project: Hive > Issue Type: Test >Reporter: Peter Vary >Assignee: Peter Vary >Priority: Major > Labels: pull-request-available > Attachments: HIVE-21732.2.patch, HIVE-21732.3.patch, > HIVE-21732.4.patch, HIVE-21732.5.patch, HIVE-21732.6.patch, > HIVE-21732.7.patch, HIVE-21732.8.patch, HIVE-21732.9.patch, HIVE-21732.patch > > Time Spent: 5h 40m > Remaining Estimate: 0h > > For evaluating testing, it would be good to have a configurable way to inject > latency for LLAP tasks. > The configuration should be able to control how much latency is injected into > each daemon. -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[jira] [Commented] (HIVE-21776) Replication fails to replicate a UDF with jar on HDFS during incremental
[
https://issues.apache.org/jira/browse/HIVE-21776?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16847324#comment-16847324
]
Hive QA commented on HIVE-21776:
| (x) *{color:red}-1 overall{color}* |
\\
\\
|| Vote || Subsystem || Runtime || Comment ||
|| || || || {color:brown} Prechecks {color} ||
| {color:green}+1{color} | {color:green} @author {color} | {color:green} 0m
0s{color} | {color:green} The patch does not contain any @author tags. {color} |
|| || || || {color:brown} master Compile Tests {color} ||
| {color:blue}0{color} | {color:blue} mvndep {color} | {color:blue} 1m
58s{color} | {color:blue} Maven dependency ordering for branch {color} |
| {color:green}+1{color} | {color:green} mvninstall {color} | {color:green} 8m
38s{color} | {color:green} master passed {color} |
| {color:green}+1{color} | {color:green} compile {color} | {color:green} 2m
51s{color} | {color:green} master passed {color} |
| {color:green}+1{color} | {color:green} checkstyle {color} | {color:green} 1m
20s{color} | {color:green} master passed {color} |
| {color:blue}0{color} | {color:blue} findbugs {color} | {color:blue} 3m
8s{color} | {color:blue} standalone-metastore/metastore-common in master has 31
extant Findbugs warnings. {color} |
| {color:blue}0{color} | {color:blue} findbugs {color} | {color:blue} 4m
57s{color} | {color:blue} ql in master has 2258 extant Findbugs warnings.
{color} |
| {color:blue}0{color} | {color:blue} findbugs {color} | {color:blue} 0m
49s{color} | {color:blue} itests/hive-unit in master has 2 extant Findbugs
warnings. {color} |
| {color:green}+1{color} | {color:green} javadoc {color} | {color:green} 2m
45s{color} | {color:green} master passed {color} |
|| || || || {color:brown} Patch Compile Tests {color} ||
| {color:blue}0{color} | {color:blue} mvndep {color} | {color:blue} 0m
32s{color} | {color:blue} Maven dependency ordering for patch {color} |
| {color:green}+1{color} | {color:green} mvninstall {color} | {color:green} 3m
28s{color} | {color:green} the patch passed {color} |
| {color:green}+1{color} | {color:green} compile {color} | {color:green} 2m
59s{color} | {color:green} the patch passed {color} |
| {color:green}+1{color} | {color:green} javac {color} | {color:green} 2m
59s{color} | {color:green} the patch passed {color} |
| {color:red}-1{color} | {color:red} checkstyle {color} | {color:red} 0m
21s{color} | {color:red} itests/hive-unit: The patch generated 5 new + 121
unchanged - 0 fixed = 126 total (was 121) {color} |
| {color:green}+1{color} | {color:green} whitespace {color} | {color:green} 0m
0s{color} | {color:green} The patch has no whitespace issues. {color} |
| {color:green}+1{color} | {color:green} findbugs {color} | {color:green} 9m
3s{color} | {color:green} the patch passed {color} |
| {color:green}+1{color} | {color:green} javadoc {color} | {color:green} 2m
44s{color} | {color:green} the patch passed {color} |
|| || || || {color:brown} Other Tests {color} ||
| {color:green}+1{color} | {color:green} asflicense {color} | {color:green} 0m
17s{color} | {color:green} The patch does not generate ASF License warnings.
{color} |
| {color:black}{color} | {color:black} {color} | {color:black} 48m 3s{color} |
{color:black} {color} |
\\
\\
|| Subsystem || Report/Notes ||
| Optional Tests | asflicense javac javadoc findbugs checkstyle compile |
| uname | Linux hiveptest-server-upstream 3.16.0-4-amd64 #1 SMP Debian
3.16.43-2+deb8u5 (2017-09-19) x86_64 GNU/Linux |
| Build tool | maven |
| Personality |
/data/hiveptest/working/yetus_PreCommit-HIVE-Build-17290/dev-support/hive-personality.sh
|
| git revision | master / 07e671c |
| Default Java | 1.8.0_111 |
| findbugs | v3.0.0 |
| checkstyle |
http://104.198.109.242/logs//PreCommit-HIVE-Build-17290/yetus/diff-checkstyle-itests_hive-unit.txt
|
| modules | C: standalone-metastore/metastore-common ql itests/hive-unit U: . |
| Console output |
http://104.198.109.242/logs//PreCommit-HIVE-Build-17290/yetus.txt |
| Powered by | Apache Yetushttp://yetus.apache.org |
This message was automatically generated.
> Replication fails to replicate a UDF with jar on HDFS during incremental
>
>
> Key: HIVE-21776
> URL: https://issues.apache.org/jira/browse/HIVE-21776
> Project: Hive
> Issue Type: Bug
>Affects Versions: 4.0.0
>Reporter: Ashutosh Bapat
>Assignee: Ashutosh Bapat
>Priority: Major
> Labels: pull-request-available
> Fix For: 4.0.0
>
> Attachments: HIVE-21776.01.patch, HIVE-21776.02.patch,
> HIVE-21776.03.patch, HIVE-21776.04.patch
>
> Time Spent: 1h
> Remaining Estimate: 0h
>
> TestReplicationScenariosAcrossInstances has test to test bootstrap of a UDF
> with jar on HDFS but no test for incremental. Add the same.
[jira] [Updated] (HIVE-21646) Tez: Prevent TezTasks from escaping thread logging context
[ https://issues.apache.org/jira/browse/HIVE-21646?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gopal V updated HIVE-21646: --- Resolution: Fixed Fix Version/s: 4.0.0 Status: Resolved (was: Patch Available) > Tez: Prevent TezTasks from escaping thread logging context > -- > > Key: HIVE-21646 > URL: https://issues.apache.org/jira/browse/HIVE-21646 > Project: Hive > Issue Type: Bug > Components: Tez >Reporter: Gopal V >Assignee: Gopal V >Priority: Major > Fix For: 4.0.0 > > Attachments: HIVE-21646.1.patch, HIVE-21646.1.patch > > > If hive.exec.parallel is set to true to parallelize MoveTasks or StatsTasks, > the Tez task does not benefit from a new thread and will lose all the thread > context of the current query. > Multiple threads even if they are spawned, will lock on SyncDagClient & make > progress sequentially. -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[jira] [Updated] (HIVE-21768) JDBC: Strip the default union prefix for un-enclosed UNION queries
[
https://issues.apache.org/jira/browse/HIVE-21768?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Gopal V updated HIVE-21768:
---
Attachment: HIVE-21768.3.patch
> JDBC: Strip the default union prefix for un-enclosed UNION queries
> --
>
> Key: HIVE-21768
> URL: https://issues.apache.org/jira/browse/HIVE-21768
> Project: Hive
> Issue Type: Bug
> Components: Logical Optimizer
>Affects Versions: 4.0.0, 3.1.1
>Reporter: Gopal V
>Assignee: Gopal V
>Priority: Major
> Attachments: HIVE-21768.1.patch, HIVE-21768.2.patch,
> HIVE-21768.3.patch
>
>
> {code}
> beeline> select 1 union all select 2;
> +--+
> | _u1._c0 |
> +--+
> | 2|
> | 1|
> +--+
> {code}
> The _u1 is superfluous and harmful to result schema parsing.
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
[jira] [Work logged] (HIVE-21753) Update HiveMetastore authorization to enable use of HiveAuthorizer implementation
[
https://issues.apache.org/jira/browse/HIVE-21753?focusedWorklogId=247905=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-247905
]
ASF GitHub Bot logged work on HIVE-21753:
-
Author: ASF GitHub Bot
Created on: 24/May/19 06:11
Start Date: 24/May/19 06:11
Worklog Time Spent: 10m
Work Description: daijyc commented on pull request #644: HIVE-21753:
Update HiveMetastore authorization to enable use of HiveA…
URL: https://github.com/apache/hive/pull/644#discussion_r287215044
##
File path:
ql/src/java/org/apache/hadoop/hive/ql/security/authorization/plugin/metastore/HiveMetaStoreAuthorizer.java
##
@@ -0,0 +1,314 @@
+/*
+ * Licensed to the Apache Software Foundation (ASF) under one
+ * or more contributor license agreements. See the NOTICE file
+ * distributed with this work for additional information
+ * regarding copyright ownership. The ASF licenses this file
+ * to you under the Apache License, Version 2.0 (the
+ * "License"); you may not use this file except in compliance
+ * with the License. You may obtain a copy of the License at
+ *
+ * http://www.apache.org/licenses/LICENSE-2.0
+ *
+ * Unless required by applicable law or agreed to in writing,
+ * software distributed under the License is distributed on an
+ * "AS IS" BASIS, WITHOUT WARRANTIES OR CONDITIONS OF ANY
+ * KIND, either express or implied. See the License for the
+ * specific language governing permissions and limitations
+ * under the License.
+ */
+package org.apache.hadoop.hive.ql.security.authorization.plugin.metastore;
+
+import org.apache.commons.logging.Log;
+import org.apache.commons.logging.LogFactory;
+import org.apache.hadoop.conf.Configuration;
+import org.apache.hadoop.hive.conf.HiveConf;
+import org.apache.hadoop.hive.metastore.HiveMetaStore;
+import org.apache.hadoop.hive.metastore.MetaStorePreEventListener;
+import org.apache.hadoop.hive.metastore.TableType;
+import org.apache.hadoop.hive.metastore.api.InvalidOperationException;
+import org.apache.hadoop.hive.metastore.api.MetaException;
+import org.apache.hadoop.hive.metastore.api.NoSuchObjectException;
+import org.apache.hadoop.hive.metastore.api.Table;
+import org.apache.hadoop.hive.metastore.events.PreAlterTableEvent;
+import org.apache.hadoop.hive.metastore.events.PreCreateTableEvent;
+import org.apache.hadoop.hive.metastore.events.PreDropTableEvent;
+import org.apache.hadoop.hive.metastore.events.PreEventContext;
+import org.apache.hadoop.hive.metastore.utils.MetaStoreServerUtils;
+import org.apache.hadoop.hive.ql.metadata.HiveException;
+import org.apache.hadoop.hive.ql.metadata.HiveUtils;
+import org.apache.hadoop.hive.ql.security.HiveMetastoreAuthenticationProvider;
+import
org.apache.hadoop.hive.ql.security.authorization.plugin.metastore.events.*;
+import org.apache.hadoop.hive.ql.security.authorization.plugin.HiveAuthorizer;
+import
org.apache.hadoop.hive.ql.security.authorization.plugin.HiveAuthorizerFactory;
+import
org.apache.hadoop.hive.ql.security.authorization.plugin.HiveAuthzContext;
+import
org.apache.hadoop.hive.ql.security.authorization.plugin.HiveAuthzSessionContext;
+import
org.apache.hadoop.hive.ql.security.authorization.plugin.HiveMetastoreClientFactoryImpl;
+import
org.apache.hadoop.hive.ql.security.authorization.plugin.HiveOperationType;
+import
org.apache.hadoop.hive.ql.security.authorization.plugin.HivePrivilegeObject;
+import org.apache.hadoop.security.UserGroupInformation;
+
+import java.util.List;
+
+/**
+ * HiveMetaStoreAuthorizer : Do authorization checks on MetaStore Events in
MetaStorePreEventListener
+ */
+
+public class HiveMetaStoreAuthorizer extends MetaStorePreEventListener {
+ private static final LogLOG =
LogFactory.getLog(HiveMetaStoreAuthorizer.class);
+ private static PreEventContext preEventContext = null;
+
+ private static final ThreadLocal tConfig = new
ThreadLocal() {
+@Override
+protected Configuration initialValue() {
+return new HiveConf(HiveMetaStoreAuthorizer.class);
+}
+ };
+
+ private static final ThreadLocal
tAuthenticator = new ThreadLocal() {
+ @Override
+ protected HiveMetastoreAuthenticationProvider initialValue() {
Review comment:
another formatting issue
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
us...@infra.apache.org
Issue Time Tracking
---
Worklog Id: (was: 247905)
Time Spent: 3.5h (was: 3h 20m)
> Update HiveMetastore authorization to enable use of HiveAuthorizer
> implementation
> -
>
> Key: HIVE-21753
>
[jira] [Work logged] (HIVE-21753) Update HiveMetastore authorization to enable use of HiveAuthorizer implementation
[
https://issues.apache.org/jira/browse/HIVE-21753?focusedWorklogId=247906=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-247906
]
ASF GitHub Bot logged work on HIVE-21753:
-
Author: ASF GitHub Bot
Created on: 24/May/19 06:11
Start Date: 24/May/19 06:11
Worklog Time Spent: 10m
Work Description: daijyc commented on pull request #644: HIVE-21753:
Update HiveMetastore authorization to enable use of HiveA…
URL: https://github.com/apache/hive/pull/644#discussion_r287215016
##
File path:
ql/src/java/org/apache/hadoop/hive/ql/security/authorization/plugin/metastore/HiveMetaStoreAuthorizer.java
##
@@ -0,0 +1,314 @@
+/*
+ * Licensed to the Apache Software Foundation (ASF) under one
+ * or more contributor license agreements. See the NOTICE file
+ * distributed with this work for additional information
+ * regarding copyright ownership. The ASF licenses this file
+ * to you under the Apache License, Version 2.0 (the
+ * "License"); you may not use this file except in compliance
+ * with the License. You may obtain a copy of the License at
+ *
+ * http://www.apache.org/licenses/LICENSE-2.0
+ *
+ * Unless required by applicable law or agreed to in writing,
+ * software distributed under the License is distributed on an
+ * "AS IS" BASIS, WITHOUT WARRANTIES OR CONDITIONS OF ANY
+ * KIND, either express or implied. See the License for the
+ * specific language governing permissions and limitations
+ * under the License.
+ */
+package org.apache.hadoop.hive.ql.security.authorization.plugin.metastore;
+
+import org.apache.commons.logging.Log;
+import org.apache.commons.logging.LogFactory;
+import org.apache.hadoop.conf.Configuration;
+import org.apache.hadoop.hive.conf.HiveConf;
+import org.apache.hadoop.hive.metastore.HiveMetaStore;
+import org.apache.hadoop.hive.metastore.MetaStorePreEventListener;
+import org.apache.hadoop.hive.metastore.TableType;
+import org.apache.hadoop.hive.metastore.api.InvalidOperationException;
+import org.apache.hadoop.hive.metastore.api.MetaException;
+import org.apache.hadoop.hive.metastore.api.NoSuchObjectException;
+import org.apache.hadoop.hive.metastore.api.Table;
+import org.apache.hadoop.hive.metastore.events.PreAlterTableEvent;
+import org.apache.hadoop.hive.metastore.events.PreCreateTableEvent;
+import org.apache.hadoop.hive.metastore.events.PreDropTableEvent;
+import org.apache.hadoop.hive.metastore.events.PreEventContext;
+import org.apache.hadoop.hive.metastore.utils.MetaStoreServerUtils;
+import org.apache.hadoop.hive.ql.metadata.HiveException;
+import org.apache.hadoop.hive.ql.metadata.HiveUtils;
+import org.apache.hadoop.hive.ql.security.HiveMetastoreAuthenticationProvider;
+import
org.apache.hadoop.hive.ql.security.authorization.plugin.metastore.events.*;
+import org.apache.hadoop.hive.ql.security.authorization.plugin.HiveAuthorizer;
+import
org.apache.hadoop.hive.ql.security.authorization.plugin.HiveAuthorizerFactory;
+import
org.apache.hadoop.hive.ql.security.authorization.plugin.HiveAuthzContext;
+import
org.apache.hadoop.hive.ql.security.authorization.plugin.HiveAuthzSessionContext;
+import
org.apache.hadoop.hive.ql.security.authorization.plugin.HiveMetastoreClientFactoryImpl;
+import
org.apache.hadoop.hive.ql.security.authorization.plugin.HiveOperationType;
+import
org.apache.hadoop.hive.ql.security.authorization.plugin.HivePrivilegeObject;
+import org.apache.hadoop.security.UserGroupInformation;
+
+import java.util.List;
+
+/**
+ * HiveMetaStoreAuthorizer : Do authorization checks on MetaStore Events in
MetaStorePreEventListener
+ */
+
+public class HiveMetaStoreAuthorizer extends MetaStorePreEventListener {
+ private static final LogLOG =
LogFactory.getLog(HiveMetaStoreAuthorizer.class);
+ private static PreEventContext preEventContext = null;
+
+ private static final ThreadLocal tConfig = new
ThreadLocal() {
+@Override
+protected Configuration initialValue() {
+return new HiveConf(HiveMetaStoreAuthorizer.class);
Review comment:
formatting
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
us...@infra.apache.org
Issue Time Tracking
---
Worklog Id: (was: 247906)
Time Spent: 3h 40m (was: 3.5h)
> Update HiveMetastore authorization to enable use of HiveAuthorizer
> implementation
> -
>
> Key: HIVE-21753
> URL: https://issues.apache.org/jira/browse/HIVE-21753
> Project: Hive
> Issue Type: Bug
> Components: Hive
>Affects Versions: 3.1.2
>
[jira] [Work logged] (HIVE-21753) Update HiveMetastore authorization to enable use of HiveAuthorizer implementation
[
https://issues.apache.org/jira/browse/HIVE-21753?focusedWorklogId=247904=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-247904
]
ASF GitHub Bot logged work on HIVE-21753:
-
Author: ASF GitHub Bot
Created on: 24/May/19 06:11
Start Date: 24/May/19 06:11
Worklog Time Spent: 10m
Work Description: daijyc commented on pull request #644: HIVE-21753:
Update HiveMetastore authorization to enable use of HiveA…
URL: https://github.com/apache/hive/pull/644#discussion_r287226190
##
File path:
ql/src/test/org/apache/hadoop/hive/ql/security/authorization/plugin/metastore/TestHiveMetaStoreAuthorizer.java
##
@@ -0,0 +1,80 @@
+/*
+ * Licensed to the Apache Software Foundation (ASF) under one
+ * or more contributor license agreements. See the NOTICE file
+ * distributed with this work for additional information
+ * regarding copyright ownership. The ASF licenses this file
+ * to you under the Apache License, Version 2.0 (the
+ * "License"); you may not use this file except in compliance
+ * with the License. You may obtain a copy of the License at
+ *
+ * http://www.apache.org/licenses/LICENSE-2.0
+ *
+ * Unless required by applicable law or agreed to in writing, software
+ * distributed under the License is distributed on an "AS IS" BASIS,
+ * WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
+ * See the License for the specific language governing permissions and
+ * limitations under the License.
+ */
+
+package org.apache.hadoop.hive.ql.security.authorization.plugin.metastore;
+
+import org.apache.hadoop.conf.Configuration;
+import org.apache.hadoop.hive.metastore.DummyPreListener;
+import org.apache.hadoop.hive.metastore.HiveMetaStore;
+import org.apache.hadoop.hive.metastore.HiveMetaStoreClient;
+import org.apache.hadoop.hive.metastore.MetaStoreTestUtils;
+import org.apache.hadoop.hive.metastore.api.Database;
+import org.apache.hadoop.hive.metastore.api.Table;
+import org.apache.hadoop.hive.metastore.client.builder.DatabaseBuilder;
+import org.apache.hadoop.hive.metastore.client.builder.TableBuilder;
+import org.apache.hadoop.hive.metastore.conf.MetastoreConf;
+import org.apache.hadoop.hive.metastore.conf.MetastoreConf.ConfVars;;
+import org.apache.hadoop.hive.metastore.events.PreCreateDatabaseEvent;
+import org.apache.hadoop.hive.metastore.events.PreCreateTableEvent;
+import org.apache.hadoop.hive.metastore.security.HadoopThriftAuthBridge;
+import org.junit.Assert;
+import org.junit.Before;
+import org.junit.Test;
+
+import static org.junit.Assert.assertEquals;
+
+/*
+Test whether HiveAuthorizer for MetaStore operation is trigger and
HiveMetaStoreAuthzInfo is created by HiveMetaStoreAuthorizer
+ */
+public class TestHiveMetaStoreAuthorizer {
+ private Configuration conf;
+ private HiveMetaStoreClient msc;
+
+ private static final String dbName = "test";
+ private static final String tblName = "tmptbl";
+ private static final String metaConfVal = "";
+
+
+ @Before
+ public void setUp() throws Exception {
+conf = MetastoreConf.newMetastoreConf();
+
+MetastoreConf.setVar(conf, ConfVars.PARTITION_NAME_WHITELIST_PATTERN,
metaConfVal);
+MetastoreConf.setLongVar(conf, ConfVars.THRIFT_CONNECTION_RETRIES, 3);
+MetastoreConf.setBoolVar(conf, ConfVars.HIVE_SUPPORT_CONCURRENCY, false);
+MetastoreConf.setVar(conf, ConfVars.HIVE_AUTHORIZATION_MANAGER,
DummyHiveAuthorizerFactory.class.getName());
+MetastoreConf.setVar(conf, ConfVars.PRE_EVENT_LISTENERS,
DummyDenyAccessHiveMetaStoreAuthorizer.class.getName());
+MetaStoreTestUtils.setConfForStandloneMode(conf);
+
MetaStoreTestUtils.startMetaStoreWithRetry(HadoopThriftAuthBridge.getBridge(),
conf);
+msc = new HiveMetaStoreClient(conf);
+msc.dropDatabase(dbName, true, true, true);
+ }
+
+ @Test
+ public void testHiveMetaStoreAuthorizer() throws Exception {
Review comment:
Can we add couple of more tests, such as:
1. CREATE_CATALOG
2. AUTHORIZATION_API_CALL
3. Create View
4. Create Table negative case
5. Create Table positive case (different user than #4)
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
us...@infra.apache.org
Issue Time Tracking
---
Worklog Id: (was: 247904)
Time Spent: 3h 20m (was: 3h 10m)
> Update HiveMetastore authorization to enable use of HiveAuthorizer
> implementation
> -
>
> Key: HIVE-21753
> URL: https://issues.apache.org/jira/browse/HIVE-21753
> Project: Hive
> Issue Type: Bug
>
[jira] [Work logged] (HIVE-21753) Update HiveMetastore authorization to enable use of HiveAuthorizer implementation
[
https://issues.apache.org/jira/browse/HIVE-21753?focusedWorklogId=247903=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-247903
]
ASF GitHub Bot logged work on HIVE-21753:
-
Author: ASF GitHub Bot
Created on: 24/May/19 06:11
Start Date: 24/May/19 06:11
Worklog Time Spent: 10m
Work Description: daijyc commented on pull request #644: HIVE-21753:
Update HiveMetastore authorization to enable use of HiveA…
URL: https://github.com/apache/hive/pull/644#discussion_r287222451
##
File path:
ql/src/java/org/apache/hadoop/hive/ql/security/authorization/plugin/metastore/HiveMetaStoreAuthorizer.java
##
@@ -0,0 +1,314 @@
+/*
+ * Licensed to the Apache Software Foundation (ASF) under one
+ * or more contributor license agreements. See the NOTICE file
+ * distributed with this work for additional information
+ * regarding copyright ownership. The ASF licenses this file
+ * to you under the Apache License, Version 2.0 (the
+ * "License"); you may not use this file except in compliance
+ * with the License. You may obtain a copy of the License at
+ *
+ * http://www.apache.org/licenses/LICENSE-2.0
+ *
+ * Unless required by applicable law or agreed to in writing,
+ * software distributed under the License is distributed on an
+ * "AS IS" BASIS, WITHOUT WARRANTIES OR CONDITIONS OF ANY
+ * KIND, either express or implied. See the License for the
+ * specific language governing permissions and limitations
+ * under the License.
+ */
+package org.apache.hadoop.hive.ql.security.authorization.plugin.metastore;
+
+import org.apache.commons.logging.Log;
+import org.apache.commons.logging.LogFactory;
+import org.apache.hadoop.conf.Configuration;
+import org.apache.hadoop.hive.conf.HiveConf;
+import org.apache.hadoop.hive.metastore.HiveMetaStore;
+import org.apache.hadoop.hive.metastore.MetaStorePreEventListener;
+import org.apache.hadoop.hive.metastore.TableType;
+import org.apache.hadoop.hive.metastore.api.InvalidOperationException;
+import org.apache.hadoop.hive.metastore.api.MetaException;
+import org.apache.hadoop.hive.metastore.api.NoSuchObjectException;
+import org.apache.hadoop.hive.metastore.api.Table;
+import org.apache.hadoop.hive.metastore.events.PreAlterTableEvent;
+import org.apache.hadoop.hive.metastore.events.PreCreateTableEvent;
+import org.apache.hadoop.hive.metastore.events.PreDropTableEvent;
+import org.apache.hadoop.hive.metastore.events.PreEventContext;
+import org.apache.hadoop.hive.metastore.utils.MetaStoreServerUtils;
+import org.apache.hadoop.hive.ql.metadata.HiveException;
+import org.apache.hadoop.hive.ql.metadata.HiveUtils;
+import org.apache.hadoop.hive.ql.security.HiveMetastoreAuthenticationProvider;
+import
org.apache.hadoop.hive.ql.security.authorization.plugin.metastore.events.*;
+import org.apache.hadoop.hive.ql.security.authorization.plugin.HiveAuthorizer;
+import
org.apache.hadoop.hive.ql.security.authorization.plugin.HiveAuthorizerFactory;
+import
org.apache.hadoop.hive.ql.security.authorization.plugin.HiveAuthzContext;
+import
org.apache.hadoop.hive.ql.security.authorization.plugin.HiveAuthzSessionContext;
+import
org.apache.hadoop.hive.ql.security.authorization.plugin.HiveMetastoreClientFactoryImpl;
+import
org.apache.hadoop.hive.ql.security.authorization.plugin.HiveOperationType;
+import
org.apache.hadoop.hive.ql.security.authorization.plugin.HivePrivilegeObject;
+import org.apache.hadoop.security.UserGroupInformation;
+
+import java.util.List;
+
+/**
+ * HiveMetaStoreAuthorizer : Do authorization checks on MetaStore Events in
MetaStorePreEventListener
+ */
+
+public class HiveMetaStoreAuthorizer extends MetaStorePreEventListener {
+ private static final LogLOG =
LogFactory.getLog(HiveMetaStoreAuthorizer.class);
+ private static PreEventContext preEventContext = null;
+
+ private static final ThreadLocal tConfig = new
ThreadLocal() {
+@Override
+protected Configuration initialValue() {
+return new HiveConf(HiveMetaStoreAuthorizer.class);
+}
+ };
+
+ private static final ThreadLocal
tAuthenticator = new ThreadLocal() {
+ @Override
+ protected HiveMetastoreAuthenticationProvider initialValue() {
+try {
+ return (HiveMetastoreAuthenticationProvider)
HiveUtils.getAuthenticator(tConfig.get(),
HiveConf.ConfVars.HIVE_METASTORE_AUTHENTICATOR_MANAGER);
+} catch (HiveException excp) {
+ throw new IllegalStateException("Authentication provider instantiation
failure", excp);
+}
+ }
+ };
+
+ public HiveMetaStoreAuthorizer(Configuration config) {
+super(config);
+ }
+
+ @Override
+ public final void onEvent(PreEventContext preEventContext) throws
MetaException, NoSuchObjectException, InvalidOperationException {
+if (LOG.isDebugEnabled()) {
+ LOG.debug("==> HiveMetaStoreAuthorizer.onEvent(): EventType=" +
preEventContext.getEventType());
+
