[jira] [Commented] (HIVE-22136) Turn on tez.bucket.pruning
[ https://issues.apache.org/jira/browse/HIVE-22136?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16938297#comment-16938297 ] Hive QA commented on HIVE-22136: | (/) *{color:green}+1 overall{color}* | \\ \\ || Vote || Subsystem || Runtime || Comment || || || || || {color:brown} Prechecks {color} || | {color:green}+1{color} | {color:green} @author {color} | {color:green} 0m 0s{color} | {color:green} The patch does not contain any @author tags. {color} | || || || || {color:brown} master Compile Tests {color} || | {color:green}+1{color} | {color:green} mvninstall {color} | {color:green} 8m 20s{color} | {color:green} master passed {color} | | {color:green}+1{color} | {color:green} compile {color} | {color:green} 0m 16s{color} | {color:green} master passed {color} | | {color:green}+1{color} | {color:green} checkstyle {color} | {color:green} 0m 14s{color} | {color:green} master passed {color} | | {color:blue}0{color} | {color:blue} findbugs {color} | {color:blue} 0m 32s{color} | {color:blue} common in master has 65 extant Findbugs warnings. {color} | | {color:green}+1{color} | {color:green} javadoc {color} | {color:green} 0m 13s{color} | {color:green} master passed {color} | || || || || {color:brown} Patch Compile Tests {color} || | {color:green}+1{color} | {color:green} mvninstall {color} | {color:green} 0m 17s{color} | {color:green} the patch passed {color} | | {color:green}+1{color} | {color:green} compile {color} | {color:green} 0m 17s{color} | {color:green} the patch passed {color} | | {color:green}+1{color} | {color:green} javac {color} | {color:green} 0m 17s{color} | {color:green} the patch passed {color} | | {color:green}+1{color} | {color:green} checkstyle {color} | {color:green} 0m 13s{color} | {color:green} the patch passed {color} | | {color:green}+1{color} | {color:green} whitespace {color} | {color:green} 0m 0s{color} | {color:green} The patch has no whitespace issues. {color} | | {color:green}+1{color} | {color:green} findbugs {color} | {color:green} 0m 39s{color} | {color:green} the patch passed {color} | | {color:green}+1{color} | {color:green} javadoc {color} | {color:green} 0m 13s{color} | {color:green} the patch passed {color} | || || || || {color:brown} Other Tests {color} || | {color:green}+1{color} | {color:green} asflicense {color} | {color:green} 0m 13s{color} | {color:green} The patch does not generate ASF License warnings. {color} | | {color:black}{color} | {color:black} {color} | {color:black} 11m 51s{color} | {color:black} {color} | \\ \\ || Subsystem || Report/Notes || | Optional Tests | asflicense javac javadoc findbugs checkstyle compile | | uname | Linux hiveptest-server-upstream 3.16.0-4-amd64 #1 SMP Debian 3.16.43-2+deb8u5 (2017-09-19) x86_64 GNU/Linux | | Build tool | maven | | Personality | /data/hiveptest/working/yetus_PreCommit-HIVE-Build-18736/dev-support/hive-personality.sh | | git revision | master / c660cba | | Default Java | 1.8.0_111 | | findbugs | v3.0.1 | | modules | C: common U: common | | Console output | http://104.198.109.242/logs//PreCommit-HIVE-Build-18736/yetus.txt | | Powered by | Apache Yetushttp://yetus.apache.org | This message was automatically generated. > Turn on tez.bucket.pruning > --- > > Key: HIVE-22136 > URL: https://issues.apache.org/jira/browse/HIVE-22136 > Project: Hive > Issue Type: Task >Reporter: Vineet Garg >Assignee: Vineet Garg >Priority: Major > Attachments: HIVE-22136.1.patch, HIVE-22136.2.patch > > -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Commented] (HIVE-22236) Fail to create View selecting View containing NOT IN subquery
[ https://issues.apache.org/jira/browse/HIVE-22236?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16938287#comment-16938287 ] Hive QA commented on HIVE-22236: Here are the results of testing the latest attachment: https://issues.apache.org/jira/secure/attachment/12981364/HIVE-22236.02.patch {color:green}SUCCESS:{color} +1 due to 1 test(s) being added or modified. {color:red}ERROR:{color} -1 due to 1 failed/errored test(s), 17008 tests executed *Failed tests:* {noformat} org.apache.hadoop.hive.cli.TestCliDriver.testCliDriver[create_view_disable_cbo] (batchId=42) {noformat} Test results: https://builds.apache.org/job/PreCommit-HIVE-Build/18735/testReport Console output: https://builds.apache.org/job/PreCommit-HIVE-Build/18735/console Test logs: http://104.198.109.242/logs/PreCommit-HIVE-Build-18735/ Messages: {noformat} Executing org.apache.hive.ptest.execution.TestCheckPhase Executing org.apache.hive.ptest.execution.PrepPhase Executing org.apache.hive.ptest.execution.YetusPhase Executing org.apache.hive.ptest.execution.ExecutionPhase Executing org.apache.hive.ptest.execution.ReportingPhase Tests exited with: TestsFailedException: 1 tests failed {noformat} This message is automatically generated. ATTACHMENT ID: 12981364 - PreCommit-HIVE-Build > Fail to create View selecting View containing NOT IN subquery > - > > Key: HIVE-22236 > URL: https://issues.apache.org/jira/browse/HIVE-22236 > Project: Hive > Issue Type: Bug >Reporter: Zoltan Matyus >Assignee: Zoltan Matyus >Priority: Minor > Attachments: HIVE-22236.01.patch, HIVE-22236.02.patch, HIVE-22236.q > > > * Given a complicated view with a select statement that has subquery > containing "{{NOT IN}}" > * Hive fails to create a simple view as {{SELECT * FROM complicated_view}} > * (with CBO disabled). > The unparse replacements of the complicated view will be applied to the text > of the simple view, resulting in {{IllegalArgumentException: replace: range > invalid}} exceptions from {{org.antlr.runtime.TokenRewriteStream.replace}}. -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Updated] (HIVE-21884) Scheduled query support
[ https://issues.apache.org/jira/browse/HIVE-21884?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zoltan Haindrich updated HIVE-21884: Attachment: HIVE-21884.18.patch > Scheduled query support > --- > > Key: HIVE-21884 > URL: https://issues.apache.org/jira/browse/HIVE-21884 > Project: Hive > Issue Type: Improvement >Reporter: Zoltan Haindrich >Assignee: Zoltan Haindrich >Priority: Major > Attachments: HIVE-21844.04.patch, HIVE-21844.05.patch, > HIVE-21844.06.patch, HIVE-21844.07.patch, HIVE-21844.08.patch, > HIVE-21844.09.patch, HIVE-21844.15.patch, HIVE-21884.01.patch, > HIVE-21884.02.patch, HIVE-21884.03.patch, HIVE-21884.09.patch, > HIVE-21884.10.patch, HIVE-21884.10.patch, HIVE-21884.11.patch, > HIVE-21884.12.patch, HIVE-21884.13.patch, HIVE-21884.14.patch, > HIVE-21884.14.patch, HIVE-21884.14.patch, HIVE-21884.16.patch, > HIVE-21884.17.patch, HIVE-21884.18.patch, Scheduled queries2.pdf > > > design document: > https://docs.google.com/document/d/1mJSFdJi_1cbxJTXC9QvGw2rQ3zzJkNfxOO6b5esmyCE/edit# > in case the google doc is not reachable: [^Scheduled queries2.pdf] -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Updated] (HIVE-22245) Make qtest feature parser reuseable
[ https://issues.apache.org/jira/browse/HIVE-22245?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zoltan Haindrich updated HIVE-22245: Attachment: HIVE-22245.03.patch > Make qtest feature parser reuseable > --- > > Key: HIVE-22245 > URL: https://issues.apache.org/jira/browse/HIVE-22245 > Project: Hive > Issue Type: Improvement > Components: Test >Reporter: Zoltan Haindrich >Assignee: Zoltan Haindrich >Priority: Major > Attachments: HIVE-22245.01.patch, HIVE-22245.02.patch, > HIVE-22245.03.patch, HIVE-22245.03.patch > > > right now we have a parser for {{--! qt:dataset}} ; to enable further > addition of things (I would like to run scheduled query service for some > qtests ) -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Updated] (HIVE-21449) implement 'WITHIN GROUP' clause
[ https://issues.apache.org/jira/browse/HIVE-21449?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Krisztian Kasa updated HIVE-21449: -- Attachment: HIVE-21449.6.patch > implement 'WITHIN GROUP' clause > --- > > Key: HIVE-21449 > URL: https://issues.apache.org/jira/browse/HIVE-21449 > Project: Hive > Issue Type: Improvement >Reporter: László Bodor >Assignee: Krisztian Kasa >Priority: Major > Fix For: 4.0.0 > > Attachments: HIVE-21449.1.patch, HIVE-21449.2.patch, > HIVE-21449.3.patch, HIVE-21449.4.patch, HIVE-21449.5.patch, > HIVE-21449.5.patch, HIVE-21449.6.patch, HIVE-21449.6.patch, HIVE-21449.6.patch > > -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Updated] (HIVE-21449) implement 'WITHIN GROUP' clause
[ https://issues.apache.org/jira/browse/HIVE-21449?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Krisztian Kasa updated HIVE-21449: -- Status: Open (was: Patch Available) > implement 'WITHIN GROUP' clause > --- > > Key: HIVE-21449 > URL: https://issues.apache.org/jira/browse/HIVE-21449 > Project: Hive > Issue Type: Improvement >Reporter: László Bodor >Assignee: Krisztian Kasa >Priority: Major > Fix For: 4.0.0 > > Attachments: HIVE-21449.1.patch, HIVE-21449.2.patch, > HIVE-21449.3.patch, HIVE-21449.4.patch, HIVE-21449.5.patch, > HIVE-21449.5.patch, HIVE-21449.6.patch, HIVE-21449.6.patch, HIVE-21449.6.patch > > -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Updated] (HIVE-21449) implement 'WITHIN GROUP' clause
[ https://issues.apache.org/jira/browse/HIVE-21449?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Krisztian Kasa updated HIVE-21449: -- Status: Patch Available (was: Open) > implement 'WITHIN GROUP' clause > --- > > Key: HIVE-21449 > URL: https://issues.apache.org/jira/browse/HIVE-21449 > Project: Hive > Issue Type: Improvement >Reporter: László Bodor >Assignee: Krisztian Kasa >Priority: Major > Fix For: 4.0.0 > > Attachments: HIVE-21449.1.patch, HIVE-21449.2.patch, > HIVE-21449.3.patch, HIVE-21449.4.patch, HIVE-21449.5.patch, > HIVE-21449.5.patch, HIVE-21449.6.patch, HIVE-21449.6.patch, HIVE-21449.6.patch > > -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Commented] (HIVE-22236) Fail to create View selecting View containing NOT IN subquery
[ https://issues.apache.org/jira/browse/HIVE-22236?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16938263#comment-16938263 ] Hive QA commented on HIVE-22236: | (/) *{color:green}+1 overall{color}* | \\ \\ || Vote || Subsystem || Runtime || Comment || || || || || {color:brown} Prechecks {color} || | {color:green}+1{color} | {color:green} @author {color} | {color:green} 0m 0s{color} | {color:green} The patch does not contain any @author tags. {color} | || || || || {color:brown} master Compile Tests {color} || | {color:green}+1{color} | {color:green} mvninstall {color} | {color:green} 8m 27s{color} | {color:green} master passed {color} | | {color:green}+1{color} | {color:green} compile {color} | {color:green} 1m 6s{color} | {color:green} master passed {color} | | {color:green}+1{color} | {color:green} checkstyle {color} | {color:green} 0m 36s{color} | {color:green} master passed {color} | | {color:blue}0{color} | {color:blue} findbugs {color} | {color:blue} 3m 48s{color} | {color:blue} ql in master has 1567 extant Findbugs warnings. {color} | | {color:green}+1{color} | {color:green} javadoc {color} | {color:green} 0m 56s{color} | {color:green} master passed {color} | || || || || {color:brown} Patch Compile Tests {color} || | {color:green}+1{color} | {color:green} mvninstall {color} | {color:green} 1m 25s{color} | {color:green} the patch passed {color} | | {color:green}+1{color} | {color:green} compile {color} | {color:green} 1m 3s{color} | {color:green} the patch passed {color} | | {color:green}+1{color} | {color:green} javac {color} | {color:green} 1m 3s{color} | {color:green} the patch passed {color} | | {color:green}+1{color} | {color:green} checkstyle {color} | {color:green} 0m 37s{color} | {color:green} the patch passed {color} | | {color:green}+1{color} | {color:green} whitespace {color} | {color:green} 0m 0s{color} | {color:green} The patch has no whitespace issues. {color} | | {color:green}+1{color} | {color:green} findbugs {color} | {color:green} 4m 10s{color} | {color:green} the patch passed {color} | | {color:green}+1{color} | {color:green} javadoc {color} | {color:green} 0m 54s{color} | {color:green} the patch passed {color} | || || || || {color:brown} Other Tests {color} || | {color:green}+1{color} | {color:green} asflicense {color} | {color:green} 0m 13s{color} | {color:green} The patch does not generate ASF License warnings. {color} | | {color:black}{color} | {color:black} {color} | {color:black} 23m 49s{color} | {color:black} {color} | \\ \\ || Subsystem || Report/Notes || | Optional Tests | asflicense javac javadoc findbugs checkstyle compile | | uname | Linux hiveptest-server-upstream 3.16.0-4-amd64 #1 SMP Debian 3.16.43-2+deb8u5 (2017-09-19) x86_64 GNU/Linux | | Build tool | maven | | Personality | /data/hiveptest/working/yetus_PreCommit-HIVE-Build-18735/dev-support/hive-personality.sh | | git revision | master / c660cba | | Default Java | 1.8.0_111 | | findbugs | v3.0.1 | | modules | C: ql U: ql | | Console output | http://104.198.109.242/logs//PreCommit-HIVE-Build-18735/yetus.txt | | Powered by | Apache Yetushttp://yetus.apache.org | This message was automatically generated. > Fail to create View selecting View containing NOT IN subquery > - > > Key: HIVE-22236 > URL: https://issues.apache.org/jira/browse/HIVE-22236 > Project: Hive > Issue Type: Bug >Reporter: Zoltan Matyus >Assignee: Zoltan Matyus >Priority: Minor > Attachments: HIVE-22236.01.patch, HIVE-22236.02.patch, HIVE-22236.q > > > * Given a complicated view with a select statement that has subquery > containing "{{NOT IN}}" > * Hive fails to create a simple view as {{SELECT * FROM complicated_view}} > * (with CBO disabled). > The unparse replacements of the complicated view will be applied to the text > of the simple view, resulting in {{IllegalArgumentException: replace: range > invalid}} exceptions from {{org.antlr.runtime.TokenRewriteStream.replace}}. -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Updated] (HIVE-22234) Hive replication fails with table already exist error when replicating from old version of hive.
[ https://issues.apache.org/jira/browse/HIVE-22234?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] mahesh kumar behera updated HIVE-22234: --- Status: Patch Available (was: Open) > Hive replication fails with table already exist error when replicating from > old version of hive. > > > Key: HIVE-22234 > URL: https://issues.apache.org/jira/browse/HIVE-22234 > Project: Hive > Issue Type: Bug >Reporter: mahesh kumar behera >Assignee: mahesh kumar behera >Priority: Major > Labels: pull-request-available > Attachments: HIVE-22234.01.patch, HIVE-22234.02.patch > > Time Spent: 40m > Remaining Estimate: 0h > > HIve replication from old version where HIVE-22046 is not patched will not > have engine column set in the table column stats. This causes "ERROR: null > value in column "ENGINE" violates not-null constraint" error during create > table while updating the column stats. As the column stats are updated after > the create table txn is committed, the next retry by HMS client throws table > already exist error. Need to update the ENGINE column to default value while > importing the table if the column value is not set. The column stat and > create table in same txn can be done as part of separate Jira. -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Updated] (HIVE-22234) Hive replication fails with table already exist error when replicating from old version of hive.
[ https://issues.apache.org/jira/browse/HIVE-22234?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] mahesh kumar behera updated HIVE-22234: --- Status: Open (was: Patch Available) > Hive replication fails with table already exist error when replicating from > old version of hive. > > > Key: HIVE-22234 > URL: https://issues.apache.org/jira/browse/HIVE-22234 > Project: Hive > Issue Type: Bug >Reporter: mahesh kumar behera >Assignee: mahesh kumar behera >Priority: Major > Labels: pull-request-available > Attachments: HIVE-22234.01.patch, HIVE-22234.02.patch > > Time Spent: 40m > Remaining Estimate: 0h > > HIve replication from old version where HIVE-22046 is not patched will not > have engine column set in the table column stats. This causes "ERROR: null > value in column "ENGINE" violates not-null constraint" error during create > table while updating the column stats. As the column stats are updated after > the create table txn is committed, the next retry by HMS client throws table > already exist error. Need to update the ENGINE column to default value while > importing the table if the column value is not set. The column stat and > create table in same txn can be done as part of separate Jira. -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Updated] (HIVE-22234) Hive replication fails with table already exist error when replicating from old version of hive.
[ https://issues.apache.org/jira/browse/HIVE-22234?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] mahesh kumar behera updated HIVE-22234: --- Attachment: HIVE-22234.02.patch > Hive replication fails with table already exist error when replicating from > old version of hive. > > > Key: HIVE-22234 > URL: https://issues.apache.org/jira/browse/HIVE-22234 > Project: Hive > Issue Type: Bug >Reporter: mahesh kumar behera >Assignee: mahesh kumar behera >Priority: Major > Labels: pull-request-available > Attachments: HIVE-22234.01.patch, HIVE-22234.02.patch > > Time Spent: 40m > Remaining Estimate: 0h > > HIve replication from old version where HIVE-22046 is not patched will not > have engine column set in the table column stats. This causes "ERROR: null > value in column "ENGINE" violates not-null constraint" error during create > table while updating the column stats. As the column stats are updated after > the create table txn is committed, the next retry by HMS client throws table > already exist error. Need to update the ENGINE column to default value while > importing the table if the column value is not set. The column stat and > create table in same txn can be done as part of separate Jira. -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Commented] (HIVE-22244) Added default ACLs for znodes on a non-kerberized cluster
[ https://issues.apache.org/jira/browse/HIVE-22244?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16938259#comment-16938259 ] Gopal Vijayaraghavan commented on HIVE-22244: - Thanks, that covers my question. > Added default ACLs for znodes on a non-kerberized cluster > - > > Key: HIVE-22244 > URL: https://issues.apache.org/jira/browse/HIVE-22244 > Project: Hive > Issue Type: Bug > Components: Metastore >Reporter: Denys Kuzmenko >Assignee: Denys Kuzmenko >Priority: Major > Attachments: HIVE-22244.1.patch, HIVE-22244.2.patch > > > Set default ACLs for znodes on a non-kerberized cluster: > Create/Read/Delete/Write/Admin to the world -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Commented] (HIVE-22079) Post order walker for iterating over expression tree
[ https://issues.apache.org/jira/browse/HIVE-22079?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16938250#comment-16938250 ] Hive QA commented on HIVE-22079: Here are the results of testing the latest attachment: https://issues.apache.org/jira/secure/attachment/12981359/HIVE-22079.9.patch {color:red}ERROR:{color} -1 due to no test(s) being added or modified. {color:green}SUCCESS:{color} +1 due to 17007 tests passed Test results: https://builds.apache.org/job/PreCommit-HIVE-Build/18734/testReport Console output: https://builds.apache.org/job/PreCommit-HIVE-Build/18734/console Test logs: http://104.198.109.242/logs/PreCommit-HIVE-Build-18734/ Messages: {noformat} Executing org.apache.hive.ptest.execution.TestCheckPhase Executing org.apache.hive.ptest.execution.PrepPhase Executing org.apache.hive.ptest.execution.YetusPhase Executing org.apache.hive.ptest.execution.ExecutionPhase Executing org.apache.hive.ptest.execution.ReportingPhase {noformat} This message is automatically generated. ATTACHMENT ID: 12981359 - PreCommit-HIVE-Build > Post order walker for iterating over expression tree > > > Key: HIVE-22079 > URL: https://issues.apache.org/jira/browse/HIVE-22079 > Project: Hive > Issue Type: Improvement > Components: Logical Optimizer, Physical Optimizer >Affects Versions: 4.0.0 >Reporter: Vineet Garg >Assignee: Vineet Garg >Priority: Major > Labels: pull-request-available > Attachments: HIVE-22079.1.patch, HIVE-22079.2.patch, > HIVE-22079.3.patch, HIVE-22079.4.patch, HIVE-22079.5.patch, > HIVE-22079.6.patch, HIVE-22079.7.patch, HIVE-22079.8.patch, HIVE-22079.9.patch > > Time Spent: 1h > Remaining Estimate: 0h > > Current {{DefaultGraphWalker}} is used to iterate over an expression tree. > This walker uses hash map to keep track of visited/processed nodes. If an > expression tree is large this adds significant overhead due to map lookup. > For an expression trees we can instead use post order traversal and avoid > using map. -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Commented] (HIVE-21884) Scheduled query support
[ https://issues.apache.org/jira/browse/HIVE-21884?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16938227#comment-16938227 ] Hive QA commented on HIVE-21884: | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem || Runtime || Comment || || || || || {color:brown} Prechecks {color} || | {color:green}+1{color} | {color:green} @author {color} | {color:green} 0m 1s{color} | {color:green} The patch does not contain any @author tags. {color} | || || || || {color:brown} master Compile Tests {color} || | {color:blue}0{color} | {color:blue} mvndep {color} | {color:blue} 1m 57s{color} | {color:blue} Maven dependency ordering for branch {color} | | {color:green}+1{color} | {color:green} mvninstall {color} | {color:green} 7m 21s{color} | {color:green} master passed {color} | | {color:green}+1{color} | {color:green} compile {color} | {color:green} 13m 57s{color} | {color:green} master passed {color} | | {color:green}+1{color} | {color:green} checkstyle {color} | {color:green} 6m 15s{color} | {color:green} master passed {color} | | {color:blue}0{color} | {color:blue} findbugs {color} | {color:blue} 3m 26s{color} | {color:blue} standalone-metastore/metastore-common in master has 32 extant Findbugs warnings. {color} | | {color:blue}0{color} | {color:blue} findbugs {color} | {color:blue} 0m 48s{color} | {color:blue} common in master has 65 extant Findbugs warnings. {color} | | {color:blue}0{color} | {color:blue} findbugs {color} | {color:blue} 1m 13s{color} | {color:blue} standalone-metastore/metastore-server in master has 170 extant Findbugs warnings. {color} | | {color:blue}0{color} | {color:blue} findbugs {color} | {color:blue} 4m 32s{color} | {color:blue} ql in master has 1567 extant Findbugs warnings. {color} | | {color:blue}0{color} | {color:blue} findbugs {color} | {color:blue} 0m 45s{color} | {color:blue} service in master has 49 extant Findbugs warnings. {color} | | {color:blue}0{color} | {color:blue} findbugs {color} | {color:blue} 0m 41s{color} | {color:blue} itests/hive-unit in master has 2 extant Findbugs warnings. {color} | | {color:blue}0{color} | {color:blue} findbugs {color} | {color:blue} 0m 54s{color} | {color:blue} itests/util in master has 51 extant Findbugs warnings. {color} | | {color:green}+1{color} | {color:green} javadoc {color} | {color:green} 12m 53s{color} | {color:green} master passed {color} | || || || || {color:brown} Patch Compile Tests {color} || | {color:blue}0{color} | {color:blue} mvndep {color} | {color:blue} 0m 27s{color} | {color:blue} Maven dependency ordering for patch {color} | | {color:green}+1{color} | {color:green} mvninstall {color} | {color:green} 14m 3s{color} | {color:green} the patch passed {color} | | {color:green}+1{color} | {color:green} compile {color} | {color:green} 15m 41s{color} | {color:green} the patch passed {color} | | {color:green}+1{color} | {color:green} javac {color} | {color:green} 15m 41s{color} | {color:green} the patch passed {color} | | {color:red}-1{color} | {color:red} checkstyle {color} | {color:red} 1m 4s{color} | {color:red} standalone-metastore: The patch generated 19 new + 1679 unchanged - 15 fixed = 1698 total (was 1694) {color} | | {color:red}-1{color} | {color:red} checkstyle {color} | {color:red} 0m 38s{color} | {color:red} standalone-metastore/metastore-common: The patch generated 1 new + 493 unchanged - 0 fixed = 494 total (was 493) {color} | | {color:red}-1{color} | {color:red} checkstyle {color} | {color:red} 0m 28s{color} | {color:red} common: The patch generated 2 new + 367 unchanged - 0 fixed = 369 total (was 367) {color} | | {color:green}+1{color} | {color:green} checkstyle {color} | {color:green} 0m 14s{color} | {color:green} The patch metastore passed checkstyle {color} | | {color:red}-1{color} | {color:red} checkstyle {color} | {color:red} 2m 54s{color} | {color:red} standalone-metastore/metastore-server: The patch generated 18 new + 1186 unchanged - 15 fixed = 1204 total (was 1201) {color} | | {color:red}-1{color} | {color:red} checkstyle {color} | {color:red} 1m 12s{color} | {color:red} ql: The patch generated 59 new + 656 unchanged - 0 fixed = 715 total (was 656) {color} | | {color:green}+1{color} | {color:green} checkstyle {color} | {color:green} 0m 22s{color} | {color:green} service: The patch generated 0 new + 38 unchanged - 1 fixed = 38 total (was 39) {color} | | {color:red}-1{color} | {color:red} checkstyle {color} | {color:red} 2m 55s{color} | {color:red} root: The patch generated 108 new + 2831 unchanged - 21 fixed = 2939 total (was 2852) {color} | | {color:green}+1{color} | {color:green} checkstyle {color} | {color:green} 0m 13s{color} | {color:green} The patch hcatalog-unit passed checkstyle {color} | | {color:green}+1{color} | {color:green} checkstyle {color} | {color:green} 0m 18s{color} | {color:green} The patch hive-minikdc passed checkstyle {color} | |
[jira] [Commented] (HIVE-22079) Post order walker for iterating over expression tree
[ https://issues.apache.org/jira/browse/HIVE-22079?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16938223#comment-16938223 ] Hive QA commented on HIVE-22079: | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem || Runtime || Comment || || || || || {color:brown} Prechecks {color} || | {color:green}+1{color} | {color:green} @author {color} | {color:green} 0m 0s{color} | {color:green} The patch does not contain any @author tags. {color} | || || || || {color:brown} master Compile Tests {color} || | {color:green}+1{color} | {color:green} mvninstall {color} | {color:green} 10m 51s{color} | {color:green} master passed {color} | | {color:green}+1{color} | {color:green} compile {color} | {color:green} 1m 49s{color} | {color:green} master passed {color} | | {color:green}+1{color} | {color:green} checkstyle {color} | {color:green} 1m 2s{color} | {color:green} master passed {color} | | {color:blue}0{color} | {color:blue} findbugs {color} | {color:blue} 6m 22s{color} | {color:blue} ql in master has 1567 extant Findbugs warnings. {color} | | {color:green}+1{color} | {color:green} javadoc {color} | {color:green} 1m 22s{color} | {color:green} master passed {color} | || || || || {color:brown} Patch Compile Tests {color} || | {color:green}+1{color} | {color:green} mvninstall {color} | {color:green} 2m 19s{color} | {color:green} the patch passed {color} | | {color:green}+1{color} | {color:green} compile {color} | {color:green} 1m 37s{color} | {color:green} the patch passed {color} | | {color:green}+1{color} | {color:green} javac {color} | {color:green} 1m 37s{color} | {color:green} the patch passed {color} | | {color:red}-1{color} | {color:red} checkstyle {color} | {color:red} 1m 1s{color} | {color:red} ql: The patch generated 2 new + 103 unchanged - 1 fixed = 105 total (was 104) {color} | | {color:green}+1{color} | {color:green} whitespace {color} | {color:green} 0m 0s{color} | {color:green} The patch has no whitespace issues. {color} | | {color:green}+1{color} | {color:green} findbugs {color} | {color:green} 5m 52s{color} | {color:green} the patch passed {color} | | {color:green}+1{color} | {color:green} javadoc {color} | {color:green} 1m 31s{color} | {color:green} the patch passed {color} | || || || || {color:brown} Other Tests {color} || | {color:green}+1{color} | {color:green} asflicense {color} | {color:green} 0m 23s{color} | {color:green} The patch does not generate ASF License warnings. {color} | | {color:black}{color} | {color:black} {color} | {color:black} 34m 55s{color} | {color:black} {color} | \\ \\ || Subsystem || Report/Notes || | Optional Tests | asflicense javac javadoc findbugs checkstyle compile | | uname | Linux hiveptest-server-upstream 3.16.0-4-amd64 #1 SMP Debian 3.16.43-2+deb8u5 (2017-09-19) x86_64 GNU/Linux | | Build tool | maven | | Personality | /data/hiveptest/working/yetus_PreCommit-HIVE-Build-18734/dev-support/hive-personality.sh | | git revision | master / c660cba | | Default Java | 1.8.0_111 | | findbugs | v3.0.1 | | checkstyle | http://104.198.109.242/logs//PreCommit-HIVE-Build-18734/yetus/diff-checkstyle-ql.txt | | modules | C: ql U: ql | | Console output | http://104.198.109.242/logs//PreCommit-HIVE-Build-18734/yetus.txt | | Powered by | Apache Yetushttp://yetus.apache.org | This message was automatically generated. > Post order walker for iterating over expression tree > > > Key: HIVE-22079 > URL: https://issues.apache.org/jira/browse/HIVE-22079 > Project: Hive > Issue Type: Improvement > Components: Logical Optimizer, Physical Optimizer >Affects Versions: 4.0.0 >Reporter: Vineet Garg >Assignee: Vineet Garg >Priority: Major > Labels: pull-request-available > Attachments: HIVE-22079.1.patch, HIVE-22079.2.patch, > HIVE-22079.3.patch, HIVE-22079.4.patch, HIVE-22079.5.patch, > HIVE-22079.6.patch, HIVE-22079.7.patch, HIVE-22079.8.patch, HIVE-22079.9.patch > > Time Spent: 1h > Remaining Estimate: 0h > > Current {{DefaultGraphWalker}} is used to iterate over an expression tree. > This walker uses hash map to keep track of visited/processed nodes. If an > expression tree is large this adds significant overhead due to map lookup. > For an expression trees we can instead use post order traversal and avoid > using map. -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Commented] (HIVE-22163) CBO: Enabling CBO turns on stats estimation, even when the estimation is disabled
[ https://issues.apache.org/jira/browse/HIVE-22163?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16938172#comment-16938172 ] Vineet Garg commented on HIVE-22163: +1 LGTM > CBO: Enabling CBO turns on stats estimation, even when the estimation is > disabled > - > > Key: HIVE-22163 > URL: https://issues.apache.org/jira/browse/HIVE-22163 > Project: Hive > Issue Type: Bug > Components: CBO >Reporter: Gopal Vijayaraghavan >Assignee: Krisztian Kasa >Priority: Major > Attachments: HIVE-22163.1.patch, HIVE-22163.1.patch, > HIVE-22163.1.patch, HIVE-22163.2.patch, HIVE-22163.3.patch, > HIVE-22163.4.patch, HIVE-22163.4.patch, HIVE-22163.5.patch, > HIVE-22163.5.patch, HIVE-22163.5.patch, HIVE-22163.5.patch, > HIVE-22163.5.patch, HIVE-22163.5.patch, HIVE-22163.5.patch > > > {code} > create table claims(claim_rec_id bigint, claim_invoice_num string, typ_c int); > alter table claims update statistics set > ('numRows'='1154941534','rawDataSize'='1135307527922'); > set hive.stats.estimate=false; > explain extended select count(1) from claims where typ_c=3; > set hive.stats.ndv.estimate.percent=5e-7; > explain extended select count(1) from claims where typ_c=3; > {code} > Expecting the standard /2 for the single filter, but we instead get 5 rows. > {code} > 'Map Operator Tree:' > 'TableScan' > ' alias: claims' > ' filterExpr: (typ_c = 3) (type: boolean)' > ' Statistics: Num rows: 1154941534 Data size: 4388777832 > Basic stats: COMPLETE Column stats: NONE' > ' GatherStats: false' > ' Filter Operator' > 'isSamplingPred: false' > 'predicate: (typ_c = 3) (type: boolean)' > 'Statistics: Num rows: 5 Data size: 19 Basic stats: > COMPLETE Column stats: NONE' > {code} > The estimation is in effect, as changing the estimate.percent changes this. > {code} > ' filterExpr: (typ_c = 3) (type: boolean)' > ' Statistics: Num rows: 1154941534 Data size: 4388777832 > Basic stats: COMPLETE Column stats: NONE' > ' GatherStats: false' > ' Filter Operator' > 'isSamplingPred: false' > 'predicate: (typ_c = 3) (type: boolean)' > 'Statistics: Num rows: 230988307 Data size: 877755567 > Basic stats: COMPLETE Column stats: NONE' > {code} -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Commented] (HIVE-22205) Upgrade zookeeper and curator versions
[ https://issues.apache.org/jira/browse/HIVE-22205?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16938171#comment-16938171 ] Thejas Nair commented on HIVE-22205: +1 > Upgrade zookeeper and curator versions > -- > > Key: HIVE-22205 > URL: https://issues.apache.org/jira/browse/HIVE-22205 > Project: Hive > Issue Type: Improvement > Components: HiveServer2 >Affects Versions: 4.0.0 >Reporter: Naveen Gangam >Assignee: Naveen Gangam >Priority: Minor > Attachments: HIVE-22205.2.patch, HIVE-22205.3.patch, > HIVE-22205.4.patch, HIVE-22205.6.patch, HIVE-22205.7.patch, HIVE-22205.patch > > > Other components like hadoop have switched to using new ZK versions. So these > jars end up in classpath for hive services and could cause issues due to > in-compatible curator versions that hive uses. > So it makes sense for hive to upgrade the ZK and curator versions to try to > keep up. -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Commented] (HIVE-22225) add owner name for create database if missing
[ https://issues.apache.org/jira/browse/HIVE-5?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16938165#comment-16938165 ] Hive QA commented on HIVE-5: Here are the results of testing the latest attachment: https://issues.apache.org/jira/secure/attachment/12981353/Hive-5.3.patch {color:green}SUCCESS:{color} +1 due to 1 test(s) being added or modified. {color:green}SUCCESS:{color} +1 due to 17009 tests passed Test results: https://builds.apache.org/job/PreCommit-HIVE-Build/18732/testReport Console output: https://builds.apache.org/job/PreCommit-HIVE-Build/18732/console Test logs: http://104.198.109.242/logs/PreCommit-HIVE-Build-18732/ Messages: {noformat} Executing org.apache.hive.ptest.execution.TestCheckPhase Executing org.apache.hive.ptest.execution.PrepPhase Executing org.apache.hive.ptest.execution.YetusPhase Executing org.apache.hive.ptest.execution.ExecutionPhase Executing org.apache.hive.ptest.execution.ReportingPhase {noformat} This message is automatically generated. ATTACHMENT ID: 12981353 - PreCommit-HIVE-Build > add owner name for create database if missing > - > > Key: HIVE-5 > URL: https://issues.apache.org/jira/browse/HIVE-5 > Project: Hive > Issue Type: Task > Components: Hive >Reporter: Sam An >Assignee: Sam An >Priority: Minor > Attachments: HIVE-5.1.patch, HIVE-5.2.patch, > HIVE-5.4.patch, Hive-5.3.patch > > > When Spark connects to HMS, the database owner name is not filled. This could > happen to other clients as well. We shall fill this in HMS. Ownership info is > useful for authorizer component in Ranger, etc. -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Updated] (HIVE-22225) add owner name for create database if missing
[ https://issues.apache.org/jira/browse/HIVE-5?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sam An updated HIVE-5: -- Attachment: HIVE-5.4.patch > add owner name for create database if missing > - > > Key: HIVE-5 > URL: https://issues.apache.org/jira/browse/HIVE-5 > Project: Hive > Issue Type: Task > Components: Hive >Reporter: Sam An >Assignee: Sam An >Priority: Minor > Attachments: HIVE-5.1.patch, HIVE-5.2.patch, > HIVE-5.4.patch, Hive-5.3.patch > > > When Spark connects to HMS, the database owner name is not filled. This could > happen to other clients as well. We shall fill this in HMS. Ownership info is > useful for authorizer component in Ranger, etc. -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Commented] (HIVE-22225) add owner name for create database if missing
[ https://issues.apache.org/jira/browse/HIVE-5?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16938143#comment-16938143 ] Hive QA commented on HIVE-5: | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem || Runtime || Comment || || || || || {color:brown} Prechecks {color} || | {color:green}+1{color} | {color:green} @author {color} | {color:green} 0m 0s{color} | {color:green} The patch does not contain any @author tags. {color} | || || || || {color:brown} master Compile Tests {color} || | {color:green}+1{color} | {color:green} mvninstall {color} | {color:green} 9m 8s{color} | {color:green} master passed {color} | | {color:green}+1{color} | {color:green} compile {color} | {color:green} 0m 28s{color} | {color:green} master passed {color} | | {color:green}+1{color} | {color:green} checkstyle {color} | {color:green} 0m 21s{color} | {color:green} master passed {color} | | {color:blue}0{color} | {color:blue} findbugs {color} | {color:blue} 1m 15s{color} | {color:blue} standalone-metastore/metastore-server in master has 170 extant Findbugs warnings. {color} | | {color:green}+1{color} | {color:green} javadoc {color} | {color:green} 0m 21s{color} | {color:green} master passed {color} | || || || || {color:brown} Patch Compile Tests {color} || | {color:green}+1{color} | {color:green} mvninstall {color} | {color:green} 0m 34s{color} | {color:green} the patch passed {color} | | {color:green}+1{color} | {color:green} compile {color} | {color:green} 0m 27s{color} | {color:green} the patch passed {color} | | {color:green}+1{color} | {color:green} javac {color} | {color:green} 0m 27s{color} | {color:green} the patch passed {color} | | {color:red}-1{color} | {color:red} checkstyle {color} | {color:red} 0m 21s{color} | {color:red} standalone-metastore/metastore-server: The patch generated 2 new + 426 unchanged - 0 fixed = 428 total (was 426) {color} | | {color:green}+1{color} | {color:green} whitespace {color} | {color:green} 0m 0s{color} | {color:green} The patch has no whitespace issues. {color} | | {color:green}+1{color} | {color:green} findbugs {color} | {color:green} 1m 20s{color} | {color:green} the patch passed {color} | | {color:green}+1{color} | {color:green} javadoc {color} | {color:green} 0m 21s{color} | {color:green} the patch passed {color} | || || || || {color:brown} Other Tests {color} || | {color:green}+1{color} | {color:green} asflicense {color} | {color:green} 0m 14s{color} | {color:green} The patch does not generate ASF License warnings. {color} | | {color:black}{color} | {color:black} {color} | {color:black} 15m 16s{color} | {color:black} {color} | \\ \\ || Subsystem || Report/Notes || | Optional Tests | asflicense javac javadoc findbugs checkstyle compile | | uname | Linux hiveptest-server-upstream 3.16.0-4-amd64 #1 SMP Debian 3.16.43-2+deb8u5 (2017-09-19) x86_64 GNU/Linux | | Build tool | maven | | Personality | /data/hiveptest/working/yetus_PreCommit-HIVE-Build-18732/dev-support/hive-personality.sh | | git revision | master / d6668c7 | | Default Java | 1.8.0_111 | | findbugs | v3.0.0 | | checkstyle | http://104.198.109.242/logs//PreCommit-HIVE-Build-18732/yetus/diff-checkstyle-standalone-metastore_metastore-server.txt | | modules | C: standalone-metastore/metastore-server U: standalone-metastore/metastore-server | | Console output | http://104.198.109.242/logs//PreCommit-HIVE-Build-18732/yetus.txt | | Powered by | Apache Yetushttp://yetus.apache.org | This message was automatically generated. > add owner name for create database if missing > - > > Key: HIVE-5 > URL: https://issues.apache.org/jira/browse/HIVE-5 > Project: Hive > Issue Type: Task > Components: Hive >Reporter: Sam An >Assignee: Sam An >Priority: Minor > Attachments: HIVE-5.1.patch, HIVE-5.2.patch, > Hive-5.3.patch > > > When Spark connects to HMS, the database owner name is not filled. This could > happen to other clients as well. We shall fill this in HMS. Ownership info is > useful for authorizer component in Ranger, etc. -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Commented] (HIVE-21449) implement 'WITHIN GROUP' clause
[ https://issues.apache.org/jira/browse/HIVE-21449?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16938137#comment-16938137 ] Hive QA commented on HIVE-21449: Here are the results of testing the latest attachment: https://issues.apache.org/jira/secure/attachment/12981347/HIVE-21449.6.patch {color:green}SUCCESS:{color} +1 due to 6 test(s) being added or modified. {color:red}ERROR:{color} -1 due to 1 failed/errored test(s), 17010 tests executed *Failed tests:* {noformat} org.apache.hadoop.hive.llap.cache.TestBuddyAllocator.testMTT[2] (batchId=363) {noformat} Test results: https://builds.apache.org/job/PreCommit-HIVE-Build/18731/testReport Console output: https://builds.apache.org/job/PreCommit-HIVE-Build/18731/console Test logs: http://104.198.109.242/logs/PreCommit-HIVE-Build-18731/ Messages: {noformat} Executing org.apache.hive.ptest.execution.TestCheckPhase Executing org.apache.hive.ptest.execution.PrepPhase Executing org.apache.hive.ptest.execution.YetusPhase Executing org.apache.hive.ptest.execution.ExecutionPhase Executing org.apache.hive.ptest.execution.ReportingPhase Tests exited with: TestsFailedException: 1 tests failed {noformat} This message is automatically generated. ATTACHMENT ID: 12981347 - PreCommit-HIVE-Build > implement 'WITHIN GROUP' clause > --- > > Key: HIVE-21449 > URL: https://issues.apache.org/jira/browse/HIVE-21449 > Project: Hive > Issue Type: Improvement >Reporter: László Bodor >Assignee: Krisztian Kasa >Priority: Major > Fix For: 4.0.0 > > Attachments: HIVE-21449.1.patch, HIVE-21449.2.patch, > HIVE-21449.3.patch, HIVE-21449.4.patch, HIVE-21449.5.patch, > HIVE-21449.5.patch, HIVE-21449.6.patch, HIVE-21449.6.patch > > -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Work logged] (HIVE-22232) NPE when hive.order.columnalignment is set to false
[ https://issues.apache.org/jira/browse/HIVE-22232?focusedWorklogId=318661=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-318661 ] ASF GitHub Bot logged work on HIVE-22232: - Author: ASF GitHub Bot Created on: 25/Sep/19 23:40 Start Date: 25/Sep/19 23:40 Worklog Time Spent: 10m Work Description: jcamachor commented on pull request #783: HIVE-22232 URL: https://github.com/apache/hive/pull/783#discussion_r328383460 ## File path: ql/src/java/org/apache/hadoop/hive/ql/optimizer/calcite/translator/ASTConverter.java ## @@ -160,17 +160,27 @@ private ASTNode convert() throws CalciteSemanticException { } HiveAggregate hiveAgg = (HiveAggregate) groupBy; - for (int pos : hiveAgg.getAggregateColumnsOrder()) { -RexInputRef iRef = new RexInputRef(groupBy.getGroupSet().nth(pos), - groupBy.getCluster().getTypeFactory().createSqlType(SqlTypeName.ANY)); -b.add(iRef.accept(new RexVisitor(schema, false, root.getCluster().getRexBuilder(; - } - for (int pos = 0; pos < groupBy.getGroupCount(); pos++) { -if (!hiveAgg.getAggregateColumnsOrder().contains(pos)) { + if (hiveAgg.getAggregateColumnsOrder() != null) { +// Aggregation columns may have been sorted in specific order +for (int pos : hiveAgg.getAggregateColumnsOrder()) { RexInputRef iRef = new RexInputRef(groupBy.getGroupSet().nth(pos), groupBy.getCluster().getTypeFactory().createSqlType(SqlTypeName.ANY)); b.add(iRef.accept(new RexVisitor(schema, false, root.getCluster().getRexBuilder(; } +for (int pos = 0; pos < groupBy.getGroupCount(); pos++) { + if (!hiveAgg.getAggregateColumnsOrder().contains(pos)) { Review comment: That will remove the duplicate code at the cost of checking if condition within the loop. Instead, I will create an aux method with the following code: ``` RexInputRef iRef = new RexInputRef(i, groupBy.getCluster().getTypeFactory().createSqlType(SqlTypeName.ANY)); b.add(iRef.accept(new RexVisitor(schema, false, root.getCluster().getRexBuilder(; ``` This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org Issue Time Tracking --- Worklog Id: (was: 318661) Time Spent: 0.5h (was: 20m) > NPE when hive.order.columnalignment is set to false > --- > > Key: HIVE-22232 > URL: https://issues.apache.org/jira/browse/HIVE-22232 > Project: Hive > Issue Type: Bug > Components: CBO >Reporter: Jesus Camacho Rodriguez >Assignee: Jesus Camacho Rodriguez >Priority: Major > Labels: pull-request-available > Attachments: HIVE-22232.patch > > Time Spent: 0.5h > Remaining Estimate: 0h > > When {{hive.order.columnalignment}} is disabled and the plan contains an > Aggregate operator, we hit a NPE. > {code} > java.lang.NullPointerException > at > org.apache.hadoop.hive.ql.optimizer.calcite.translator.ASTConverter.convert(ASTConverter.java:163) > at > org.apache.hadoop.hive.ql.optimizer.calcite.translator.ASTConverter.convert(ASTConverter.java:111) > at > org.apache.hadoop.hive.ql.parse.CalcitePlanner.getOptimizedAST(CalcitePlanner.java:1555) > at > org.apache.hadoop.hive.ql.parse.CalcitePlanner.genOPTree(CalcitePlanner.java:483) > at > org.apache.hadoop.hive.ql.parse.SemanticAnalyzer.analyzeInternal(SemanticAnalyzer.java:12630) > at > org.apache.hadoop.hive.ql.parse.CalcitePlanner.analyzeInternal(CalcitePlanner.java:357) > at > org.apache.hadoop.hive.ql.parse.BaseSemanticAnalyzer.analyze(BaseSemanticAnalyzer.java:285) > at > org.apache.hadoop.hive.ql.parse.ExplainSemanticAnalyzer.analyzeInternal(ExplainSemanticAnalyzer.java:175) > at > org.apache.hadoop.hive.ql.parse.BaseSemanticAnalyzer.analyze(BaseSemanticAnalyzer.java:285) > at org.apache.hadoop.hive.ql.Driver.compile(Driver.java:522) > at org.apache.hadoop.hive.ql.Driver.compileInternal(Driver.java:1385) > at org.apache.hadoop.hive.ql.Driver.compileAndRespond(Driver.java:1332) > at org.apache.hadoop.hive.ql.Driver.compileAndRespond(Driver.java:1327) > at > org.apache.hadoop.hive.ql.reexec.ReExecDriver.compileAndRespond(ReExecDriver.java:124) > at > org.apache.hadoop.hive.ql.reexec.ReExecDriver.run(ReExecDriver.java:217) > at >
[jira] [Commented] (HIVE-22205) Upgrade zookeeper and curator versions
[ https://issues.apache.org/jira/browse/HIVE-22205?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16938128#comment-16938128 ] Sam An commented on HIVE-22205: --- +1 > Upgrade zookeeper and curator versions > -- > > Key: HIVE-22205 > URL: https://issues.apache.org/jira/browse/HIVE-22205 > Project: Hive > Issue Type: Improvement > Components: HiveServer2 >Affects Versions: 4.0.0 >Reporter: Naveen Gangam >Assignee: Naveen Gangam >Priority: Minor > Attachments: HIVE-22205.2.patch, HIVE-22205.3.patch, > HIVE-22205.4.patch, HIVE-22205.6.patch, HIVE-22205.7.patch, HIVE-22205.patch > > > Other components like hadoop have switched to using new ZK versions. So these > jars end up in classpath for hive services and could cause issues due to > in-compatible curator versions that hive uses. > So it makes sense for hive to upgrade the ZK and curator versions to try to > keep up. -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Updated] (HIVE-21884) Scheduled query support
[ https://issues.apache.org/jira/browse/HIVE-21884?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zoltan Haindrich updated HIVE-21884: Attachment: HIVE-21884.17.patch > Scheduled query support > --- > > Key: HIVE-21884 > URL: https://issues.apache.org/jira/browse/HIVE-21884 > Project: Hive > Issue Type: Improvement >Reporter: Zoltan Haindrich >Assignee: Zoltan Haindrich >Priority: Major > Attachments: HIVE-21844.04.patch, HIVE-21844.05.patch, > HIVE-21844.06.patch, HIVE-21844.07.patch, HIVE-21844.08.patch, > HIVE-21844.09.patch, HIVE-21844.15.patch, HIVE-21884.01.patch, > HIVE-21884.02.patch, HIVE-21884.03.patch, HIVE-21884.09.patch, > HIVE-21884.10.patch, HIVE-21884.10.patch, HIVE-21884.11.patch, > HIVE-21884.12.patch, HIVE-21884.13.patch, HIVE-21884.14.patch, > HIVE-21884.14.patch, HIVE-21884.14.patch, HIVE-21884.16.patch, > HIVE-21884.17.patch, Scheduled queries2.pdf > > > design document: > https://docs.google.com/document/d/1mJSFdJi_1cbxJTXC9QvGw2rQ3zzJkNfxOO6b5esmyCE/edit# > in case the google doc is not reachable: [^Scheduled queries2.pdf] -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Updated] (HIVE-22245) Make qtest feature parser reuseable
[ https://issues.apache.org/jira/browse/HIVE-22245?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zoltan Haindrich updated HIVE-22245: Attachment: HIVE-22245.03.patch > Make qtest feature parser reuseable > --- > > Key: HIVE-22245 > URL: https://issues.apache.org/jira/browse/HIVE-22245 > Project: Hive > Issue Type: Improvement > Components: Test >Reporter: Zoltan Haindrich >Assignee: Zoltan Haindrich >Priority: Major > Attachments: HIVE-22245.01.patch, HIVE-22245.02.patch, > HIVE-22245.03.patch > > > right now we have a parser for {{--! qt:dataset}} ; to enable further > addition of things (I would like to run scheduled query service for some > qtests ) -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Updated] (HIVE-22208) Column name with reserved keyword is unescaped when query including join on table with mask column is re-written
[ https://issues.apache.org/jira/browse/HIVE-22208?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zoltan Matyus updated HIVE-22208: - Status: Patch Available (was: Open) > Column name with reserved keyword is unescaped when query including join on > table with mask column is re-written > > > Key: HIVE-22208 > URL: https://issues.apache.org/jira/browse/HIVE-22208 > Project: Hive > Issue Type: Bug > Components: Hive >Affects Versions: 3.1.0, 4.0.0 >Reporter: Riju Trivedi >Assignee: Zoltan Matyus >Priority: Critical > Attachments: HIVE-22208.01.patch > > > Join query involving table with mask column and other having reserved > keyword as column name fails with SemanticException during parsing re-written > query : > Original Query : > {code:java} > select a.`date`, b.nm > from sample_keyword a > join sample_mask b > on b.id = a.id; > {code} > Re-written Query : > > {code:java} > select a.date, b.nm > from sample_keyword a > join (SELECT `id`, CAST(mask_hash(nm) AS string) AS `nm`, > BLOCK__OFFSET__INSIDE__FILE, INPUT__FILE__NAME, ROW__ID FROM > `default`.`sample_mask` )`b` > on b.id = a.id; > {code} > Re-written query does not have escape quotes for date column which cause > SemanticException while parsing : > {code:java} > org.apache.hadoop.hive.ql.parse.ParseException: line 1:9 cannot recognize > input near 'a' '.' 'date' in selection target > > at > org.apache.hadoop.hive.ql.parse.SemanticAnalyzer.rewriteASTWithMaskAndFilter( > SemanticAnalyzer.java:12084) > at > org.apache.hadoop.hive.ql.parse.SemanticAnalyzer.analyzeInternal( > SemanticAnalyzer.java:12298) > at org.apache.hadoop.hive.ql.parse.CalcitePlanner.analyzeInternal( > CalcitePlanner.java:360) > at org.apache.hadoop.hive.ql.parse.BaseSemanticAnalyzer.analyze( > BaseSemanticAnalyzer.java:289) > at org.apache.hadoop.hive.ql.Driver.compile(Driver.java:664) > at org.apache.hadoop.hive.ql.Driver.compileInternal(Driver.java:1869) > {code} -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Updated] (HIVE-22208) Column name with reserved keyword is unescaped when query including join on table with mask column is re-written
[ https://issues.apache.org/jira/browse/HIVE-22208?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zoltan Matyus updated HIVE-22208: - Attachment: HIVE-22208.01.patch > Column name with reserved keyword is unescaped when query including join on > table with mask column is re-written > > > Key: HIVE-22208 > URL: https://issues.apache.org/jira/browse/HIVE-22208 > Project: Hive > Issue Type: Bug > Components: Hive >Affects Versions: 3.1.0, 4.0.0 >Reporter: Riju Trivedi >Assignee: Zoltan Matyus >Priority: Critical > Attachments: HIVE-22208.01.patch > > > Join query involving table with mask column and other having reserved > keyword as column name fails with SemanticException during parsing re-written > query : > Original Query : > {code:java} > select a.`date`, b.nm > from sample_keyword a > join sample_mask b > on b.id = a.id; > {code} > Re-written Query : > > {code:java} > select a.date, b.nm > from sample_keyword a > join (SELECT `id`, CAST(mask_hash(nm) AS string) AS `nm`, > BLOCK__OFFSET__INSIDE__FILE, INPUT__FILE__NAME, ROW__ID FROM > `default`.`sample_mask` )`b` > on b.id = a.id; > {code} > Re-written query does not have escape quotes for date column which cause > SemanticException while parsing : > {code:java} > org.apache.hadoop.hive.ql.parse.ParseException: line 1:9 cannot recognize > input near 'a' '.' 'date' in selection target > > at > org.apache.hadoop.hive.ql.parse.SemanticAnalyzer.rewriteASTWithMaskAndFilter( > SemanticAnalyzer.java:12084) > at > org.apache.hadoop.hive.ql.parse.SemanticAnalyzer.analyzeInternal( > SemanticAnalyzer.java:12298) > at org.apache.hadoop.hive.ql.parse.CalcitePlanner.analyzeInternal( > CalcitePlanner.java:360) > at org.apache.hadoop.hive.ql.parse.BaseSemanticAnalyzer.analyze( > BaseSemanticAnalyzer.java:289) > at org.apache.hadoop.hive.ql.Driver.compile(Driver.java:664) > at org.apache.hadoop.hive.ql.Driver.compileInternal(Driver.java:1869) > {code} -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Assigned] (HIVE-22208) Column name with reserved keyword is unescaped when query including join on table with mask column is re-written
[ https://issues.apache.org/jira/browse/HIVE-22208?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zoltan Matyus reassigned HIVE-22208: Assignee: Zoltan Matyus (was: Jesus Camacho Rodriguez) > Column name with reserved keyword is unescaped when query including join on > table with mask column is re-written > > > Key: HIVE-22208 > URL: https://issues.apache.org/jira/browse/HIVE-22208 > Project: Hive > Issue Type: Bug > Components: Hive >Affects Versions: 3.1.0, 4.0.0 >Reporter: Riju Trivedi >Assignee: Zoltan Matyus >Priority: Critical > Attachments: HIVE-22208.01.patch > > > Join query involving table with mask column and other having reserved > keyword as column name fails with SemanticException during parsing re-written > query : > Original Query : > {code:java} > select a.`date`, b.nm > from sample_keyword a > join sample_mask b > on b.id = a.id; > {code} > Re-written Query : > > {code:java} > select a.date, b.nm > from sample_keyword a > join (SELECT `id`, CAST(mask_hash(nm) AS string) AS `nm`, > BLOCK__OFFSET__INSIDE__FILE, INPUT__FILE__NAME, ROW__ID FROM > `default`.`sample_mask` )`b` > on b.id = a.id; > {code} > Re-written query does not have escape quotes for date column which cause > SemanticException while parsing : > {code:java} > org.apache.hadoop.hive.ql.parse.ParseException: line 1:9 cannot recognize > input near 'a' '.' 'date' in selection target > > at > org.apache.hadoop.hive.ql.parse.SemanticAnalyzer.rewriteASTWithMaskAndFilter( > SemanticAnalyzer.java:12084) > at > org.apache.hadoop.hive.ql.parse.SemanticAnalyzer.analyzeInternal( > SemanticAnalyzer.java:12298) > at org.apache.hadoop.hive.ql.parse.CalcitePlanner.analyzeInternal( > CalcitePlanner.java:360) > at org.apache.hadoop.hive.ql.parse.BaseSemanticAnalyzer.analyze( > BaseSemanticAnalyzer.java:289) > at org.apache.hadoop.hive.ql.Driver.compile(Driver.java:664) > at org.apache.hadoop.hive.ql.Driver.compileInternal(Driver.java:1869) > {code} -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Commented] (HIVE-21449) implement 'WITHIN GROUP' clause
[ https://issues.apache.org/jira/browse/HIVE-21449?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16938119#comment-16938119 ] Hive QA commented on HIVE-21449: | (/) *{color:green}+1 overall{color}* | \\ \\ || Vote || Subsystem || Runtime || Comment || || || || || {color:brown} Prechecks {color} || | {color:green}+1{color} | {color:green} @author {color} | {color:green} 0m 0s{color} | {color:green} The patch does not contain any @author tags. {color} | || || || || {color:brown} master Compile Tests {color} || | {color:green}+1{color} | {color:green} mvninstall {color} | {color:green} 9m 15s{color} | {color:green} master passed {color} | | {color:green}+1{color} | {color:green} compile {color} | {color:green} 1m 8s{color} | {color:green} master passed {color} | | {color:green}+1{color} | {color:green} checkstyle {color} | {color:green} 0m 47s{color} | {color:green} master passed {color} | | {color:blue}0{color} | {color:blue} findbugs {color} | {color:blue} 4m 21s{color} | {color:blue} ql in master has 1567 extant Findbugs warnings. {color} | | {color:green}+1{color} | {color:green} javadoc {color} | {color:green} 1m 0s{color} | {color:green} master passed {color} | || || || || {color:brown} Patch Compile Tests {color} || | {color:green}+1{color} | {color:green} mvninstall {color} | {color:green} 1m 30s{color} | {color:green} the patch passed {color} | | {color:green}+1{color} | {color:green} compile {color} | {color:green} 1m 10s{color} | {color:green} the patch passed {color} | | {color:green}+1{color} | {color:green} javac {color} | {color:green} 1m 10s{color} | {color:green} the patch passed {color} | | {color:green}+1{color} | {color:green} checkstyle {color} | {color:green} 0m 47s{color} | {color:green} the patch passed {color} | | {color:green}+1{color} | {color:green} whitespace {color} | {color:green} 0m 0s{color} | {color:green} The patch has no whitespace issues. {color} | | {color:green}+1{color} | {color:green} findbugs {color} | {color:green} 4m 21s{color} | {color:green} the patch passed {color} | | {color:green}+1{color} | {color:green} javadoc {color} | {color:green} 1m 0s{color} | {color:green} the patch passed {color} | || || || || {color:brown} Other Tests {color} || | {color:green}+1{color} | {color:green} asflicense {color} | {color:green} 0m 14s{color} | {color:green} The patch does not generate ASF License warnings. {color} | | {color:black}{color} | {color:black} {color} | {color:black} 26m 9s{color} | {color:black} {color} | \\ \\ || Subsystem || Report/Notes || | Optional Tests | asflicense javac javadoc findbugs checkstyle compile | | uname | Linux hiveptest-server-upstream 3.16.0-4-amd64 #1 SMP Debian 3.16.43-2+deb8u5 (2017-09-19) x86_64 GNU/Linux | | Build tool | maven | | Personality | /data/hiveptest/working/yetus_PreCommit-HIVE-Build-18731/dev-support/hive-personality.sh | | git revision | master / d6668c7 | | Default Java | 1.8.0_111 | | findbugs | v3.0.1 | | modules | C: ql U: ql | | Console output | http://104.198.109.242/logs//PreCommit-HIVE-Build-18731/yetus.txt | | Powered by | Apache Yetushttp://yetus.apache.org | This message was automatically generated. > implement 'WITHIN GROUP' clause > --- > > Key: HIVE-21449 > URL: https://issues.apache.org/jira/browse/HIVE-21449 > Project: Hive > Issue Type: Improvement >Reporter: László Bodor >Assignee: Krisztian Kasa >Priority: Major > Fix For: 4.0.0 > > Attachments: HIVE-21449.1.patch, HIVE-21449.2.patch, > HIVE-21449.3.patch, HIVE-21449.4.patch, HIVE-21449.5.patch, > HIVE-21449.5.patch, HIVE-21449.6.patch, HIVE-21449.6.patch > > -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Commented] (HIVE-22245) Make qtest feature parser reuseable
[ https://issues.apache.org/jira/browse/HIVE-22245?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16938104#comment-16938104 ] Hive QA commented on HIVE-22245: Here are the results of testing the latest attachment: https://issues.apache.org/jira/secure/attachment/12981345/HIVE-22245.02.patch {color:red}ERROR:{color} -1 due to build exiting with an error Test results: https://builds.apache.org/job/PreCommit-HIVE-Build/18730/testReport Console output: https://builds.apache.org/job/PreCommit-HIVE-Build/18730/console Test logs: http://104.198.109.242/logs/PreCommit-HIVE-Build-18730/ Messages: {noformat} Executing org.apache.hive.ptest.execution.TestCheckPhase Tests exited with: Exception: Patch URL https://issues.apache.org/jira/secure/attachment/12981345/HIVE-22245.02.patch was found in seen patch url's cache and a test was probably run already on it. Aborting... {noformat} This message is automatically generated. ATTACHMENT ID: 12981345 - PreCommit-HIVE-Build > Make qtest feature parser reuseable > --- > > Key: HIVE-22245 > URL: https://issues.apache.org/jira/browse/HIVE-22245 > Project: Hive > Issue Type: Improvement > Components: Test >Reporter: Zoltan Haindrich >Assignee: Zoltan Haindrich >Priority: Major > Attachments: HIVE-22245.01.patch, HIVE-22245.02.patch > > > right now we have a parser for {{--! qt:dataset}} ; to enable further > addition of things (I would like to run scheduled query service for some > qtests ) -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Commented] (HIVE-22241) Implement UDF to convert a date/timestamp from Gregorian-Julian hybrid calendar to proleptic Gregorian calendar
[ https://issues.apache.org/jira/browse/HIVE-22241?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16938103#comment-16938103 ] Hive QA commented on HIVE-22241: Here are the results of testing the latest attachment: https://issues.apache.org/jira/secure/attachment/12981346/HIVE-22241.01.patch {color:green}SUCCESS:{color} +1 due to 2 test(s) being added or modified. {color:green}SUCCESS:{color} +1 due to 17010 tests passed Test results: https://builds.apache.org/job/PreCommit-HIVE-Build/18729/testReport Console output: https://builds.apache.org/job/PreCommit-HIVE-Build/18729/console Test logs: http://104.198.109.242/logs/PreCommit-HIVE-Build-18729/ Messages: {noformat} Executing org.apache.hive.ptest.execution.TestCheckPhase Executing org.apache.hive.ptest.execution.PrepPhase Executing org.apache.hive.ptest.execution.YetusPhase Executing org.apache.hive.ptest.execution.ExecutionPhase Executing org.apache.hive.ptest.execution.ReportingPhase {noformat} This message is automatically generated. ATTACHMENT ID: 12981346 - PreCommit-HIVE-Build > Implement UDF to convert a date/timestamp from Gregorian-Julian hybrid > calendar to proleptic Gregorian calendar > --- > > Key: HIVE-22241 > URL: https://issues.apache.org/jira/browse/HIVE-22241 > Project: Hive > Issue Type: Improvement > Components: UDF >Reporter: Jesus Camacho Rodriguez >Assignee: Jesus Camacho Rodriguez >Priority: Major > Labels: pull-request-available > Attachments: HIVE-22241.01.patch, HIVE-22241.patch > > Time Spent: 10m > Remaining Estimate: 0h > > UDF that converts a date/timestamp from *Gregorian-Julian hybrid* calendar, > i.e., calendar that supports both the Julian and Gregorian calendar systems > with the support of a single discontinuity, which corresponds by default to > the Gregorian date when the Gregorian calendar was instituted, to *proleptic > Gregorian calendar* (ISO 8601 standard), which is produced by extending the > Gregorian calendar backward to dates preceding its official introduction in > 1582. -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Commented] (HIVE-22241) Implement UDF to convert a date/timestamp from Gregorian-Julian hybrid calendar to proleptic Gregorian calendar
[ https://issues.apache.org/jira/browse/HIVE-22241?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16938081#comment-16938081 ] Hive QA commented on HIVE-22241: | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem || Runtime || Comment || || || || || {color:brown} Prechecks {color} || | {color:green}+1{color} | {color:green} @author {color} | {color:green} 0m 0s{color} | {color:green} The patch does not contain any @author tags. {color} | || || || || {color:brown} master Compile Tests {color} || | {color:green}+1{color} | {color:green} mvninstall {color} | {color:green} 8m 56s{color} | {color:green} master passed {color} | | {color:green}+1{color} | {color:green} compile {color} | {color:green} 1m 8s{color} | {color:green} master passed {color} | | {color:green}+1{color} | {color:green} checkstyle {color} | {color:green} 0m 40s{color} | {color:green} master passed {color} | | {color:blue}0{color} | {color:blue} findbugs {color} | {color:blue} 4m 18s{color} | {color:blue} ql in master has 1567 extant Findbugs warnings. {color} | | {color:green}+1{color} | {color:green} javadoc {color} | {color:green} 0m 58s{color} | {color:green} master passed {color} | || || || || {color:brown} Patch Compile Tests {color} || | {color:green}+1{color} | {color:green} mvninstall {color} | {color:green} 1m 28s{color} | {color:green} the patch passed {color} | | {color:green}+1{color} | {color:green} compile {color} | {color:green} 1m 9s{color} | {color:green} the patch passed {color} | | {color:green}+1{color} | {color:green} javac {color} | {color:green} 1m 9s{color} | {color:green} the patch passed {color} | | {color:red}-1{color} | {color:red} checkstyle {color} | {color:red} 0m 41s{color} | {color:red} ql: The patch generated 35 new + 83 unchanged - 0 fixed = 118 total (was 83) {color} | | {color:green}+1{color} | {color:green} whitespace {color} | {color:green} 0m 0s{color} | {color:green} The patch has no whitespace issues. {color} | | {color:green}+1{color} | {color:green} findbugs {color} | {color:green} 4m 24s{color} | {color:green} the patch passed {color} | | {color:green}+1{color} | {color:green} javadoc {color} | {color:green} 1m 2s{color} | {color:green} the patch passed {color} | || || || || {color:brown} Other Tests {color} || | {color:green}+1{color} | {color:green} asflicense {color} | {color:green} 0m 15s{color} | {color:green} The patch does not generate ASF License warnings. {color} | | {color:black}{color} | {color:black} {color} | {color:black} 25m 27s{color} | {color:black} {color} | \\ \\ || Subsystem || Report/Notes || | Optional Tests | asflicense javac javadoc findbugs checkstyle compile | | uname | Linux hiveptest-server-upstream 3.16.0-4-amd64 #1 SMP Debian 3.16.43-2+deb8u5 (2017-09-19) x86_64 GNU/Linux | | Build tool | maven | | Personality | /data/hiveptest/working/yetus_PreCommit-HIVE-Build-18729/dev-support/hive-personality.sh | | git revision | master / d6668c7 | | Default Java | 1.8.0_111 | | findbugs | v3.0.1 | | checkstyle | http://104.198.109.242/logs//PreCommit-HIVE-Build-18729/yetus/diff-checkstyle-ql.txt | | modules | C: ql U: ql | | Console output | http://104.198.109.242/logs//PreCommit-HIVE-Build-18729/yetus.txt | | Powered by | Apache Yetushttp://yetus.apache.org | This message was automatically generated. > Implement UDF to convert a date/timestamp from Gregorian-Julian hybrid > calendar to proleptic Gregorian calendar > --- > > Key: HIVE-22241 > URL: https://issues.apache.org/jira/browse/HIVE-22241 > Project: Hive > Issue Type: Improvement > Components: UDF >Reporter: Jesus Camacho Rodriguez >Assignee: Jesus Camacho Rodriguez >Priority: Major > Labels: pull-request-available > Attachments: HIVE-22241.01.patch, HIVE-22241.patch > > Time Spent: 10m > Remaining Estimate: 0h > > UDF that converts a date/timestamp from *Gregorian-Julian hybrid* calendar, > i.e., calendar that supports both the Julian and Gregorian calendar systems > with the support of a single discontinuity, which corresponds by default to > the Gregorian date when the Gregorian calendar was instituted, to *proleptic > Gregorian calendar* (ISO 8601 standard), which is produced by extending the > Gregorian calendar backward to dates preceding its official introduction in > 1582. -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Commented] (HIVE-22197) Common Merge join throwing class cast exception
[ https://issues.apache.org/jira/browse/HIVE-22197?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16938073#comment-16938073 ] Vineet Garg commented on HIVE-22197: +1 LGTM. > Common Merge join throwing class cast exception > > > Key: HIVE-22197 > URL: https://issues.apache.org/jira/browse/HIVE-22197 > Project: Hive > Issue Type: Bug > Components: Hive >Affects Versions: 4.0.0 >Reporter: mahesh kumar behera >Assignee: mahesh kumar behera >Priority: Major > Fix For: 4.0.0 > > Attachments: HIVE-22197.01.patch, HIVE-22197.05.patch > > > In DummyStoreOperator the row is cached to fix HIVE-5973. The row is copyed > and stored in the writable format, but the object inspector is initialized to > default. So when join operator is fetching the data from dummy store > operator, its getting the OI is Long and the row as LongWritable. This is > causing the class cast exception. -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Commented] (HIVE-22245) Make qtest feature parser reuseable
[ https://issues.apache.org/jira/browse/HIVE-22245?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16938059#comment-16938059 ] Hive QA commented on HIVE-22245: Here are the results of testing the latest attachment: https://issues.apache.org/jira/secure/attachment/12981345/HIVE-22245.02.patch {color:red}ERROR:{color} -1 due to build exiting with an error Test results: https://builds.apache.org/job/PreCommit-HIVE-Build/18728/testReport Console output: https://builds.apache.org/job/PreCommit-HIVE-Build/18728/console Test logs: http://104.198.109.242/logs/PreCommit-HIVE-Build-18728/ Messages: {noformat} Executing org.apache.hive.ptest.execution.TestCheckPhase Tests exited with: Exception: Patch URL https://issues.apache.org/jira/secure/attachment/12981345/HIVE-22245.02.patch was found in seen patch url's cache and a test was probably run already on it. Aborting... {noformat} This message is automatically generated. ATTACHMENT ID: 12981345 - PreCommit-HIVE-Build > Make qtest feature parser reuseable > --- > > Key: HIVE-22245 > URL: https://issues.apache.org/jira/browse/HIVE-22245 > Project: Hive > Issue Type: Improvement > Components: Test >Reporter: Zoltan Haindrich >Assignee: Zoltan Haindrich >Priority: Major > Attachments: HIVE-22245.01.patch, HIVE-22245.02.patch > > > right now we have a parser for {{--! qt:dataset}} ; to enable further > addition of things (I would like to run scheduled query service for some > qtests ) -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Commented] (HIVE-22245) Make qtest feature parser reuseable
[ https://issues.apache.org/jira/browse/HIVE-22245?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16938058#comment-16938058 ] Hive QA commented on HIVE-22245: Here are the results of testing the latest attachment: https://issues.apache.org/jira/secure/attachment/12981345/HIVE-22245.02.patch {color:green}SUCCESS:{color} +1 due to 4 test(s) being added or modified. {color:red}ERROR:{color} -1 due to 367 failed/errored test(s), 17003 tests executed *Failed tests:* {noformat} org.apache.hadoop.hive.cli.TestCliDriver.testCliDriver[bucket7] (batchId=35) org.apache.hadoop.hive.cli.TestCliDriver.testCliDriver[create_default_prop] (batchId=35) org.apache.hadoop.hive.cli.TestCliDriver.testCliDriver[cte_mat_1] (batchId=35) org.apache.hadoop.hive.cli.TestCliDriver.testCliDriver[dynpart_sort_optimization_acid2] (batchId=35) org.apache.hadoop.hive.cli.TestCliDriver.testCliDriver[groupby13] (batchId=35) org.apache.hadoop.hive.cli.TestCliDriver.testCliDriver[groupby3_map_multi_distinct] (batchId=35) org.apache.hadoop.hive.cli.TestCliDriver.testCliDriver[groupby_grouping_sets4] (batchId=35) org.apache.hadoop.hive.cli.TestCliDriver.testCliDriver[groupby_grouping_window] (batchId=35) org.apache.hadoop.hive.cli.TestCliDriver.testCliDriver[inoutdriver] (batchId=35) org.apache.hadoop.hive.cli.TestCliDriver.testCliDriver[input4_limit] (batchId=35) org.apache.hadoop.hive.cli.TestCliDriver.testCliDriver[join47] (batchId=35) org.apache.hadoop.hive.cli.TestCliDriver.testCliDriver[list_bucket_dml_6] (batchId=35) org.apache.hadoop.hive.cli.TestCliDriver.testCliDriver[metadata_only_queries] (batchId=35) org.apache.hadoop.hive.cli.TestCliDriver.testCliDriver[partition_timestamp2] (batchId=35) org.apache.hadoop.hive.cli.TestCliDriver.testCliDriver[ppd_outer_join2] (batchId=35) org.apache.hadoop.hive.cli.TestCliDriver.testCliDriver[smb_mapjoin_13] (batchId=35) org.apache.hadoop.hive.cli.TestCliDriver.testCliDriver[structin] (batchId=35) org.apache.hadoop.hive.cli.TestCliDriver.testCliDriver[udf_bitwise_and] (batchId=35) org.apache.hadoop.hive.cli.TestCliDriver.testCliDriver[udf_octet_length] (batchId=35) org.apache.hadoop.hive.cli.TestCliDriver.testCliDriver[union_remove_1] (batchId=35) org.apache.hadoop.hive.cli.TestCliDriver.testCliDriver[vector_reduce_groupby_decimal] (batchId=35) org.apache.hadoop.hive.cli.TestCliDriver.testCliDriver[vector_string_concat] (batchId=35) org.apache.hadoop.hive.cli.TestCompareCliDriver.testCliDriver[llap_0] (batchId=294) org.apache.hadoop.hive.cli.TestCompareCliDriver.testCliDriver[vectorized_math_funcs] (batchId=294) org.apache.hadoop.hive.cli.TestNegativeCliDriver.testCliDriver[authorization_jdbc_keystore] (batchId=101) org.apache.hadoop.hive.cli.TestNegativeCliDriver.testCliDriver[authorization_msck] (batchId=101) org.apache.hadoop.hive.cli.TestNegativeCliDriver.testCliDriver[authorization_not_owner_alter_tab_rename] (batchId=101) org.apache.hadoop.hive.cli.TestNegativeCliDriver.testCliDriver[authorization_not_owner_drop_tab2] (batchId=101) org.apache.hadoop.hive.cli.TestNegativeCliDriver.testCliDriver[authorization_not_owner_drop_tab] (batchId=101) org.apache.hadoop.hive.cli.TestNegativeCliDriver.testCliDriver[authorization_not_owner_drop_view] (batchId=101) org.apache.hadoop.hive.cli.TestNegativeCliDriver.testCliDriver[authorization_priv_current_role_neg] (batchId=101) org.apache.hadoop.hive.cli.TestNegativeCliDriver.testCliDriver[authorization_revoke_table_fail1] (batchId=101) org.apache.hadoop.hive.cli.TestNegativeCliDriver.testCliDriver[authorization_revoke_table_fail2] (batchId=101) org.apache.hadoop.hive.cli.TestNegativeCliDriver.testCliDriver[authorization_role_cycles1] (batchId=101) org.apache.hadoop.hive.cli.TestNegativeCliDriver.testCliDriver[authorization_role_grant2] (batchId=101) org.apache.hadoop.hive.cli.TestNegativeCliDriver.testCliDriver[authorization_role_grant_otheruser] (batchId=101) org.apache.hadoop.hive.cli.TestNegativeCliDriver.testCliDriver[authorization_set_invalidconf] (batchId=101) org.apache.hadoop.hive.cli.TestNegativeCliDriver.testCliDriver[authorization_set_nonexistent_conf] (batchId=101) org.apache.hadoop.hive.cli.TestNegativeCliDriver.testCliDriver[authorization_set_role_neg1] (batchId=101) org.apache.hadoop.hive.cli.TestNegativeCliDriver.testCliDriver[authorization_set_role_neg2] (batchId=101) org.apache.hadoop.hive.cli.TestNegativeCliDriver.testCliDriver[authorization_show_grant_otheruser_alltabs] (batchId=101) org.apache.hadoop.hive.cli.TestNegativeCliDriver.testCliDriver[authorization_show_parts_nosel] (batchId=101) org.apache.hadoop.hive.cli.TestNegativeCliDriver.testCliDriver[authorization_show_roles_no_admin] (batchId=101) org.apache.hadoop.hive.cli.TestNegativeCliDriver.testCliDriver[authorization_table_grant_nosuchrole] (batchId=101) org.apache.hadoop.hive.cli.TestNegativeCliDriver.testCliDriver[authorization_update_noupdatepriv] (batchId=101)
[jira] [Updated] (HIVE-22136) Turn on tez.bucket.pruning
[ https://issues.apache.org/jira/browse/HIVE-22136?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vineet Garg updated HIVE-22136: --- Status: Patch Available (was: Open) > Turn on tez.bucket.pruning > --- > > Key: HIVE-22136 > URL: https://issues.apache.org/jira/browse/HIVE-22136 > Project: Hive > Issue Type: Task >Reporter: Vineet Garg >Assignee: Vineet Garg >Priority: Major > Attachments: HIVE-22136.1.patch, HIVE-22136.2.patch > > -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Updated] (HIVE-22136) Turn on tez.bucket.pruning
[ https://issues.apache.org/jira/browse/HIVE-22136?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vineet Garg updated HIVE-22136: --- Attachment: HIVE-22136.2.patch > Turn on tez.bucket.pruning > --- > > Key: HIVE-22136 > URL: https://issues.apache.org/jira/browse/HIVE-22136 > Project: Hive > Issue Type: Task >Reporter: Vineet Garg >Assignee: Vineet Garg >Priority: Major > Attachments: HIVE-22136.1.patch, HIVE-22136.2.patch > > -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Updated] (HIVE-22136) Turn on tez.bucket.pruning
[ https://issues.apache.org/jira/browse/HIVE-22136?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vineet Garg updated HIVE-22136: --- Status: Open (was: Patch Available) > Turn on tez.bucket.pruning > --- > > Key: HIVE-22136 > URL: https://issues.apache.org/jira/browse/HIVE-22136 > Project: Hive > Issue Type: Task >Reporter: Vineet Garg >Assignee: Vineet Garg >Priority: Major > Attachments: HIVE-22136.1.patch, HIVE-22136.2.patch > > -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Updated] (HIVE-22236) Fail to create View selecting View containing NOT IN subquery
[ https://issues.apache.org/jira/browse/HIVE-22236?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zoltan Matyus updated HIVE-22236: - Attachment: HIVE-22236.02.patch > Fail to create View selecting View containing NOT IN subquery > - > > Key: HIVE-22236 > URL: https://issues.apache.org/jira/browse/HIVE-22236 > Project: Hive > Issue Type: Bug >Reporter: Zoltan Matyus >Assignee: Zoltan Matyus >Priority: Minor > Attachments: HIVE-22236.01.patch, HIVE-22236.02.patch, HIVE-22236.q > > > * Given a complicated view with a select statement that has subquery > containing "{{NOT IN}}" > * Hive fails to create a simple view as {{SELECT * FROM complicated_view}} > * (with CBO disabled). > The unparse replacements of the complicated view will be applied to the text > of the simple view, resulting in {{IllegalArgumentException: replace: range > invalid}} exceptions from {{org.antlr.runtime.TokenRewriteStream.replace}}. -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Commented] (HIVE-22245) Make qtest feature parser reuseable
[ https://issues.apache.org/jira/browse/HIVE-22245?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16938013#comment-16938013 ] Hive QA commented on HIVE-22245: | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem || Runtime || Comment || || || || || {color:brown} Prechecks {color} || | {color:green}+1{color} | {color:green} @author {color} | {color:green} 0m 0s{color} | {color:green} The patch does not contain any @author tags. {color} | || || || || {color:brown} master Compile Tests {color} || | {color:green}+1{color} | {color:green} mvninstall {color} | {color:green} 8m 36s{color} | {color:green} master passed {color} | | {color:green}+1{color} | {color:green} compile {color} | {color:green} 0m 28s{color} | {color:green} master passed {color} | | {color:green}+1{color} | {color:green} checkstyle {color} | {color:green} 0m 14s{color} | {color:green} master passed {color} | | {color:blue}0{color} | {color:blue} findbugs {color} | {color:blue} 0m 45s{color} | {color:blue} itests/util in master has 51 extant Findbugs warnings. {color} | | {color:green}+1{color} | {color:green} javadoc {color} | {color:green} 0m 18s{color} | {color:green} master passed {color} | || || || || {color:brown} Patch Compile Tests {color} || | {color:green}+1{color} | {color:green} mvninstall {color} | {color:green} 0m 28s{color} | {color:green} the patch passed {color} | | {color:green}+1{color} | {color:green} compile {color} | {color:green} 0m 28s{color} | {color:green} the patch passed {color} | | {color:green}+1{color} | {color:green} javac {color} | {color:green} 0m 28s{color} | {color:green} the patch passed {color} | | {color:red}-1{color} | {color:red} checkstyle {color} | {color:red} 0m 14s{color} | {color:red} itests/util: The patch generated 5 new + 26 unchanged - 5 fixed = 31 total (was 31) {color} | | {color:red}-1{color} | {color:red} whitespace {color} | {color:red} 0m 0s{color} | {color:red} The patch has 1 line(s) that end in whitespace. Use git apply --whitespace=fix <>. Refer https://git-scm.com/docs/git-apply {color} | | {color:red}-1{color} | {color:red} findbugs {color} | {color:red} 0m 53s{color} | {color:red} itests/util generated 1 new + 50 unchanged - 1 fixed = 51 total (was 51) {color} | | {color:green}+1{color} | {color:green} javadoc {color} | {color:green} 0m 18s{color} | {color:green} the patch passed {color} | || || || || {color:brown} Other Tests {color} || | {color:green}+1{color} | {color:green} asflicense {color} | {color:green} 0m 14s{color} | {color:green} The patch does not generate ASF License warnings. {color} | | {color:black}{color} | {color:black} {color} | {color:black} 13m 25s{color} | {color:black} {color} | \\ \\ || Reason || Tests || | FindBugs | module:itests/util | | | Found reliance on default encoding in org.apache.hadoop.hive.ql.qoption.QTestOptionDispatcher.parse(File):in org.apache.hadoop.hive.ql.qoption.QTestOptionDispatcher.parse(File): new java.io.FileReader(File) At QTestOptionDispatcher.java:[line 51] | \\ \\ || Subsystem || Report/Notes || | Optional Tests | asflicense javac javadoc findbugs checkstyle compile | | uname | Linux hiveptest-server-upstream 3.16.0-4-amd64 #1 SMP Debian 3.16.43-2+deb8u5 (2017-09-19) x86_64 GNU/Linux | | Build tool | maven | | Personality | /data/hiveptest/working/yetus_PreCommit-HIVE-Build-18727/dev-support/hive-personality.sh | | git revision | master / d6668c7 | | Default Java | 1.8.0_111 | | findbugs | v3.0.1 | | checkstyle | http://104.198.109.242/logs//PreCommit-HIVE-Build-18727/yetus/diff-checkstyle-itests_util.txt | | whitespace | http://104.198.109.242/logs//PreCommit-HIVE-Build-18727/yetus/whitespace-eol.txt | | findbugs | http://104.198.109.242/logs//PreCommit-HIVE-Build-18727/yetus/new-findbugs-itests_util.html | | modules | C: itests/util U: itests/util | | Console output | http://104.198.109.242/logs//PreCommit-HIVE-Build-18727/yetus.txt | | Powered by | Apache Yetushttp://yetus.apache.org | This message was automatically generated. > Make qtest feature parser reuseable > --- > > Key: HIVE-22245 > URL: https://issues.apache.org/jira/browse/HIVE-22245 > Project: Hive > Issue Type: Improvement > Components: Test >Reporter: Zoltan Haindrich >Assignee: Zoltan Haindrich >Priority: Major > Attachments: HIVE-22245.01.patch, HIVE-22245.02.patch > > > right now we have a parser for {{--! qt:dataset}} ; to enable further > addition of things (I would like to run scheduled query service for some > qtests ) -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Updated] (HIVE-22244) Added default ACLs for znodes on a non-kerberized cluster
[ https://issues.apache.org/jira/browse/HIVE-22244?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Denys Kuzmenko updated HIVE-22244: -- Attachment: HIVE-22244.2.patch > Added default ACLs for znodes on a non-kerberized cluster > - > > Key: HIVE-22244 > URL: https://issues.apache.org/jira/browse/HIVE-22244 > Project: Hive > Issue Type: Bug > Components: Metastore >Reporter: Denys Kuzmenko >Assignee: Denys Kuzmenko >Priority: Major > Attachments: HIVE-22244.1.patch, HIVE-22244.2.patch > > > Set default ACLs for znodes on a non-kerberized cluster: > Create/Read/Delete/Write/Admin to the world -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Updated] (HIVE-22244) Added default ACLs for znodes on a non-kerberized cluster
[ https://issues.apache.org/jira/browse/HIVE-22244?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Denys Kuzmenko updated HIVE-22244: -- Attachment: (was: HIVE-22244.2.patch) > Added default ACLs for znodes on a non-kerberized cluster > - > > Key: HIVE-22244 > URL: https://issues.apache.org/jira/browse/HIVE-22244 > Project: Hive > Issue Type: Bug > Components: Metastore >Reporter: Denys Kuzmenko >Assignee: Denys Kuzmenko >Priority: Major > Attachments: HIVE-22244.1.patch, HIVE-22244.2.patch > > > Set default ACLs for znodes on a non-kerberized cluster: > Create/Read/Delete/Write/Admin to the world -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Commented] (HIVE-22191) Simplify SemanticAnalyzer by removing unused code
[ https://issues.apache.org/jira/browse/HIVE-22191?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16938006#comment-16938006 ] Hive QA commented on HIVE-22191: Here are the results of testing the latest attachment: https://issues.apache.org/jira/secure/attachment/12981337/HIVE-22191.5.patch {color:red}ERROR:{color} -1 due to no test(s) being added or modified. {color:green}SUCCESS:{color} +1 due to 17007 tests passed Test results: https://builds.apache.org/job/PreCommit-HIVE-Build/18726/testReport Console output: https://builds.apache.org/job/PreCommit-HIVE-Build/18726/console Test logs: http://104.198.109.242/logs/PreCommit-HIVE-Build-18726/ Messages: {noformat} Executing org.apache.hive.ptest.execution.TestCheckPhase Executing org.apache.hive.ptest.execution.PrepPhase Executing org.apache.hive.ptest.execution.YetusPhase Executing org.apache.hive.ptest.execution.ExecutionPhase Executing org.apache.hive.ptest.execution.ReportingPhase {noformat} This message is automatically generated. ATTACHMENT ID: 12981337 - PreCommit-HIVE-Build > Simplify SemanticAnalyzer by removing unused code > - > > Key: HIVE-22191 > URL: https://issues.apache.org/jira/browse/HIVE-22191 > Project: Hive > Issue Type: Task > Components: Hive >Reporter: Akos Dombi >Assignee: Akos Dombi >Priority: Major > Attachments: HIVE-22191.2.patch, HIVE-22191.3.patch, > HIVE-22191.4.patch, HIVE-22191.5.patch, HIVE-22191.5.patch, HIVE-22191.patch > > > Simplify {{SemanticAnalyzer}} by: > - Remove dead code > - Simplify returning statements > - Use interfaces types for parameters/fields/variables where it is > straightforward to migrate > - Make visibility stricter where it is possible > - Check logging to use parametrised logging > - Removing unnecessary keywords (e.g.: {{static}}) > - Some code part could be simplified by using Java 8 features > I think this is crucial step as this class already contains 15000+ lines of > code which is screaming for splitting into more reasonable classes. -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Commented] (HIVE-22244) Added default ACLs for znodes on a non-kerberized cluster
[ https://issues.apache.org/jira/browse/HIVE-22244?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16938005#comment-16938005 ] Denys Kuzmenko commented on HIVE-22244: --- Removed world-readable access for secure use-case (was added by mistake). However, when Zookeeper doesn't have security enabled (DWX use-case) and rest is kerberized, we need to have fallback. > Added default ACLs for znodes on a non-kerberized cluster > - > > Key: HIVE-22244 > URL: https://issues.apache.org/jira/browse/HIVE-22244 > Project: Hive > Issue Type: Bug > Components: Metastore >Reporter: Denys Kuzmenko >Assignee: Denys Kuzmenko >Priority: Major > Attachments: HIVE-22244.1.patch, HIVE-22244.2.patch > > > Set default ACLs for znodes on a non-kerberized cluster: > Create/Read/Delete/Write/Admin to the world -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Updated] (HIVE-22244) Added default ACLs for znodes on a non-kerberized cluster
[ https://issues.apache.org/jira/browse/HIVE-22244?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Denys Kuzmenko updated HIVE-22244: -- Attachment: HIVE-22244.2.patch > Added default ACLs for znodes on a non-kerberized cluster > - > > Key: HIVE-22244 > URL: https://issues.apache.org/jira/browse/HIVE-22244 > Project: Hive > Issue Type: Bug > Components: Metastore >Reporter: Denys Kuzmenko >Assignee: Denys Kuzmenko >Priority: Major > Attachments: HIVE-22244.1.patch, HIVE-22244.2.patch > > > Set default ACLs for znodes on a non-kerberized cluster: > Create/Read/Delete/Write/Admin to the world -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Updated] (HIVE-22079) Post order walker for iterating over expression tree
[ https://issues.apache.org/jira/browse/HIVE-22079?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vineet Garg updated HIVE-22079: --- Status: Open (was: Patch Available) > Post order walker for iterating over expression tree > > > Key: HIVE-22079 > URL: https://issues.apache.org/jira/browse/HIVE-22079 > Project: Hive > Issue Type: Improvement > Components: Logical Optimizer, Physical Optimizer >Affects Versions: 4.0.0 >Reporter: Vineet Garg >Assignee: Vineet Garg >Priority: Major > Labels: pull-request-available > Attachments: HIVE-22079.1.patch, HIVE-22079.2.patch, > HIVE-22079.3.patch, HIVE-22079.4.patch, HIVE-22079.5.patch, > HIVE-22079.6.patch, HIVE-22079.7.patch, HIVE-22079.8.patch, HIVE-22079.9.patch > > Time Spent: 1h > Remaining Estimate: 0h > > Current {{DefaultGraphWalker}} is used to iterate over an expression tree. > This walker uses hash map to keep track of visited/processed nodes. If an > expression tree is large this adds significant overhead due to map lookup. > For an expression trees we can instead use post order traversal and avoid > using map. -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Updated] (HIVE-22079) Post order walker for iterating over expression tree
[ https://issues.apache.org/jira/browse/HIVE-22079?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vineet Garg updated HIVE-22079: --- Status: Patch Available (was: Open) > Post order walker for iterating over expression tree > > > Key: HIVE-22079 > URL: https://issues.apache.org/jira/browse/HIVE-22079 > Project: Hive > Issue Type: Improvement > Components: Logical Optimizer, Physical Optimizer >Affects Versions: 4.0.0 >Reporter: Vineet Garg >Assignee: Vineet Garg >Priority: Major > Labels: pull-request-available > Attachments: HIVE-22079.1.patch, HIVE-22079.2.patch, > HIVE-22079.3.patch, HIVE-22079.4.patch, HIVE-22079.5.patch, > HIVE-22079.6.patch, HIVE-22079.7.patch, HIVE-22079.8.patch, HIVE-22079.9.patch > > Time Spent: 1h > Remaining Estimate: 0h > > Current {{DefaultGraphWalker}} is used to iterate over an expression tree. > This walker uses hash map to keep track of visited/processed nodes. If an > expression tree is large this adds significant overhead due to map lookup. > For an expression trees we can instead use post order traversal and avoid > using map. -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Updated] (HIVE-22079) Post order walker for iterating over expression tree
[ https://issues.apache.org/jira/browse/HIVE-22079?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vineet Garg updated HIVE-22079: --- Attachment: HIVE-22079.9.patch > Post order walker for iterating over expression tree > > > Key: HIVE-22079 > URL: https://issues.apache.org/jira/browse/HIVE-22079 > Project: Hive > Issue Type: Improvement > Components: Logical Optimizer, Physical Optimizer >Affects Versions: 4.0.0 >Reporter: Vineet Garg >Assignee: Vineet Garg >Priority: Major > Labels: pull-request-available > Attachments: HIVE-22079.1.patch, HIVE-22079.2.patch, > HIVE-22079.3.patch, HIVE-22079.4.patch, HIVE-22079.5.patch, > HIVE-22079.6.patch, HIVE-22079.7.patch, HIVE-22079.8.patch, HIVE-22079.9.patch > > Time Spent: 1h > Remaining Estimate: 0h > > Current {{DefaultGraphWalker}} is used to iterate over an expression tree. > This walker uses hash map to keep track of visited/processed nodes. If an > expression tree is large this adds significant overhead due to map lookup. > For an expression trees we can instead use post order traversal and avoid > using map. -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Commented] (HIVE-22205) Upgrade zookeeper and curator versions
[ https://issues.apache.org/jira/browse/HIVE-22205?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16937999#comment-16937999 ] Hive QA commented on HIVE-22205: | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem || Runtime || Comment || || || || || {color:brown} Prechecks {color} || | {color:green}+1{color} | {color:green} @author {color} | {color:green} 0m 0s{color} | {color:green} The patch does not contain any @author tags. {color} | || || || || {color:brown} master Compile Tests {color} || | {color:blue}0{color} | {color:blue} mvndep {color} | {color:blue} 1m 39s{color} | {color:blue} Maven dependency ordering for branch {color} | | {color:green}+1{color} | {color:green} mvninstall {color} | {color:green} 6m 58s{color} | {color:green} master passed {color} | | {color:green}+1{color} | {color:green} compile {color} | {color:green} 13m 34s{color} | {color:green} master passed {color} | | {color:green}+1{color} | {color:green} checkstyle {color} | {color:green} 5m 42s{color} | {color:green} master passed {color} | | {color:blue}0{color} | {color:blue} findbugs {color} | {color:blue} 0m 20s{color} | {color:blue} storage-api in master has 48 extant Findbugs warnings. {color} | | {color:blue}0{color} | {color:blue} findbugs {color} | {color:blue} 2m 30s{color} | {color:blue} standalone-metastore/metastore-common in master has 32 extant Findbugs warnings. {color} | | {color:blue}0{color} | {color:blue} findbugs {color} | {color:blue} 0m 23s{color} | {color:blue} llap-client in master has 27 extant Findbugs warnings. {color} | | {color:blue}0{color} | {color:blue} findbugs {color} | {color:blue} 1m 5s{color} | {color:blue} standalone-metastore/metastore-server in master has 170 extant Findbugs warnings. {color} | | {color:blue}0{color} | {color:blue} findbugs {color} | {color:blue} 3m 52s{color} | {color:blue} ql in master has 1567 extant Findbugs warnings. {color} | | {color:blue}0{color} | {color:blue} findbugs {color} | {color:blue} 0m 40s{color} | {color:blue} llap-server in master has 90 extant Findbugs warnings. {color} | | {color:blue}0{color} | {color:blue} findbugs {color} | {color:blue} 0m 29s{color} | {color:blue} accumulo-handler in master has 21 extant Findbugs warnings. {color} | | {color:blue}0{color} | {color:blue} findbugs {color} | {color:blue} 0m 25s{color} | {color:blue} standalone-metastore/metastore-tools/metastore-benchmarks in master has 3 extant Findbugs warnings. {color} | | {color:blue}0{color} | {color:blue} findbugs {color} | {color:blue} 0m 20s{color} | {color:blue} upgrade-acid/pre-upgrade in master has 1 extant Findbugs warnings. {color} | | {color:blue}0{color} | {color:blue} findbugs {color} | {color:blue} 0m 39s{color} | {color:blue} itests/hive-unit in master has 2 extant Findbugs warnings. {color} | | {color:blue}0{color} | {color:blue} findbugs {color} | {color:blue} 0m 47s{color} | {color:blue} itests/util in master has 51 extant Findbugs warnings. {color} | | {color:green}+1{color} | {color:green} javadoc {color} | {color:green} 12m 25s{color} | {color:green} master passed {color} | || || || || {color:brown} Patch Compile Tests {color} || | {color:blue}0{color} | {color:blue} mvndep {color} | {color:blue} 0m 24s{color} | {color:blue} Maven dependency ordering for patch {color} | | {color:green}+1{color} | {color:green} mvninstall {color} | {color:green} 14m 54s{color} | {color:green} the patch passed {color} | | {color:green}+1{color} | {color:green} compile {color} | {color:green} 17m 31s{color} | {color:green} the patch passed {color} | | {color:green}+1{color} | {color:green} javac {color} | {color:green} 17m 31s{color} | {color:green} the patch passed {color} | | {color:green}+1{color} | {color:green} checkstyle {color} | {color:green} 0m 14s{color} | {color:green} The patch storage-api passed checkstyle {color} | | {color:green}+1{color} | {color:green} checkstyle {color} | {color:green} 0m 30s{color} | {color:green} The patch standalone-metastore passed checkstyle {color} | | {color:green}+1{color} | {color:green} checkstyle {color} | {color:green} 0m 16s{color} | {color:green} The patch metastore-common passed checkstyle {color} | | {color:green}+1{color} | {color:green} checkstyle {color} | {color:green} 0m 18s{color} | {color:green} The patch llap-client passed checkstyle {color} | | {color:green}+1{color} | {color:green} checkstyle {color} | {color:green} 0m 31s{color} | {color:green} The patch metastore-server passed checkstyle {color} | | {color:green}+1{color} | {color:green} checkstyle {color} | {color:green} 2m 25s{color} | {color:green} ql: The patch generated 0 new + 6 unchanged - 2 fixed = 6 total (was 8) {color} | | {color:green}+1{color} | {color:green} checkstyle {color} | {color:green} 1m 10s{color} | {color:green} The patch llap-server passed checkstyle {color} | | {color:green}+1{color} |
[jira] [Work logged] (HIVE-22232) NPE when hive.order.columnalignment is set to false
[ https://issues.apache.org/jira/browse/HIVE-22232?focusedWorklogId=318512=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-318512 ] ASF GitHub Bot logged work on HIVE-22232: - Author: ASF GitHub Bot Created on: 25/Sep/19 18:49 Start Date: 25/Sep/19 18:49 Worklog Time Spent: 10m Work Description: vineetgarg02 commented on pull request #783: HIVE-22232 URL: https://github.com/apache/hive/pull/783#discussion_r328282487 ## File path: ql/src/java/org/apache/hadoop/hive/ql/optimizer/calcite/translator/ASTConverter.java ## @@ -160,17 +160,27 @@ private ASTNode convert() throws CalciteSemanticException { } HiveAggregate hiveAgg = (HiveAggregate) groupBy; - for (int pos : hiveAgg.getAggregateColumnsOrder()) { -RexInputRef iRef = new RexInputRef(groupBy.getGroupSet().nth(pos), - groupBy.getCluster().getTypeFactory().createSqlType(SqlTypeName.ANY)); -b.add(iRef.accept(new RexVisitor(schema, false, root.getCluster().getRexBuilder(; - } - for (int pos = 0; pos < groupBy.getGroupCount(); pos++) { -if (!hiveAgg.getAggregateColumnsOrder().contains(pos)) { + if (hiveAgg.getAggregateColumnsOrder() != null) { +// Aggregation columns may have been sorted in specific order +for (int pos : hiveAgg.getAggregateColumnsOrder()) { RexInputRef iRef = new RexInputRef(groupBy.getGroupSet().nth(pos), groupBy.getCluster().getTypeFactory().createSqlType(SqlTypeName.ANY)); b.add(iRef.accept(new RexVisitor(schema, false, root.getCluster().getRexBuilder(; } +for (int pos = 0; pos < groupBy.getGroupCount(); pos++) { + if (!hiveAgg.getAggregateColumnsOrder().contains(pos)) { Review comment: Can we change this to `hiveAgg.getAggregateColumnsOrder == null || !hiveAgg.getAggregateColumnsOrder().contains(pos`) ?. Take this for loop off if condition and get rid of the repetitive else block This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org Issue Time Tracking --- Worklog Id: (was: 318512) Time Spent: 20m (was: 10m) > NPE when hive.order.columnalignment is set to false > --- > > Key: HIVE-22232 > URL: https://issues.apache.org/jira/browse/HIVE-22232 > Project: Hive > Issue Type: Bug > Components: CBO >Reporter: Jesus Camacho Rodriguez >Assignee: Jesus Camacho Rodriguez >Priority: Major > Labels: pull-request-available > Attachments: HIVE-22232.patch > > Time Spent: 20m > Remaining Estimate: 0h > > When {{hive.order.columnalignment}} is disabled and the plan contains an > Aggregate operator, we hit a NPE. > {code} > java.lang.NullPointerException > at > org.apache.hadoop.hive.ql.optimizer.calcite.translator.ASTConverter.convert(ASTConverter.java:163) > at > org.apache.hadoop.hive.ql.optimizer.calcite.translator.ASTConverter.convert(ASTConverter.java:111) > at > org.apache.hadoop.hive.ql.parse.CalcitePlanner.getOptimizedAST(CalcitePlanner.java:1555) > at > org.apache.hadoop.hive.ql.parse.CalcitePlanner.genOPTree(CalcitePlanner.java:483) > at > org.apache.hadoop.hive.ql.parse.SemanticAnalyzer.analyzeInternal(SemanticAnalyzer.java:12630) > at > org.apache.hadoop.hive.ql.parse.CalcitePlanner.analyzeInternal(CalcitePlanner.java:357) > at > org.apache.hadoop.hive.ql.parse.BaseSemanticAnalyzer.analyze(BaseSemanticAnalyzer.java:285) > at > org.apache.hadoop.hive.ql.parse.ExplainSemanticAnalyzer.analyzeInternal(ExplainSemanticAnalyzer.java:175) > at > org.apache.hadoop.hive.ql.parse.BaseSemanticAnalyzer.analyze(BaseSemanticAnalyzer.java:285) > at org.apache.hadoop.hive.ql.Driver.compile(Driver.java:522) > at org.apache.hadoop.hive.ql.Driver.compileInternal(Driver.java:1385) > at org.apache.hadoop.hive.ql.Driver.compileAndRespond(Driver.java:1332) > at org.apache.hadoop.hive.ql.Driver.compileAndRespond(Driver.java:1327) > at > org.apache.hadoop.hive.ql.reexec.ReExecDriver.compileAndRespond(ReExecDriver.java:124) > at > org.apache.hadoop.hive.ql.reexec.ReExecDriver.run(ReExecDriver.java:217) > at > org.apache.hadoop.hive.cli.CliDriver.processLocalCmd(CliDriver.java:242) > ... > {code} -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Commented] (HIVE-22191) Simplify SemanticAnalyzer by removing unused code
[ https://issues.apache.org/jira/browse/HIVE-22191?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16937993#comment-16937993 ] Hive QA commented on HIVE-22191: | (/) *{color:green}+1 overall{color}* | \\ \\ || Vote || Subsystem || Runtime || Comment || || || || || {color:brown} Prechecks {color} || | {color:green}+1{color} | {color:green} @author {color} | {color:green} 0m 1s{color} | {color:green} The patch does not contain any @author tags. {color} | || || || || {color:brown} master Compile Tests {color} || | {color:green}+1{color} | {color:green} mvninstall {color} | {color:green} 11m 23s{color} | {color:green} master passed {color} | | {color:green}+1{color} | {color:green} compile {color} | {color:green} 1m 41s{color} | {color:green} master passed {color} | | {color:green}+1{color} | {color:green} checkstyle {color} | {color:green} 1m 13s{color} | {color:green} master passed {color} | | {color:blue}0{color} | {color:blue} findbugs {color} | {color:blue} 6m 40s{color} | {color:blue} ql in master has 1567 extant Findbugs warnings. {color} | | {color:green}+1{color} | {color:green} javadoc {color} | {color:green} 1m 34s{color} | {color:green} master passed {color} | || || || || {color:brown} Patch Compile Tests {color} || | {color:green}+1{color} | {color:green} mvninstall {color} | {color:green} 2m 19s{color} | {color:green} the patch passed {color} | | {color:green}+1{color} | {color:green} compile {color} | {color:green} 1m 43s{color} | {color:green} the patch passed {color} | | {color:green}+1{color} | {color:green} javac {color} | {color:green} 1m 43s{color} | {color:green} the patch passed {color} | | {color:green}+1{color} | {color:green} checkstyle {color} | {color:green} 1m 8s{color} | {color:green} ql: The patch generated 0 new + 526 unchanged - 38 fixed = 526 total (was 564) {color} | | {color:green}+1{color} | {color:green} whitespace {color} | {color:green} 0m 0s{color} | {color:green} The patch has no whitespace issues. {color} | | {color:green}+1{color} | {color:green} findbugs {color} | {color:green} 6m 4s{color} | {color:green} ql generated 0 new + 1551 unchanged - 16 fixed = 1551 total (was 1567) {color} | | {color:green}+1{color} | {color:green} javadoc {color} | {color:green} 1m 26s{color} | {color:green} the patch passed {color} | || || || || {color:brown} Other Tests {color} || | {color:green}+1{color} | {color:green} asflicense {color} | {color:green} 0m 24s{color} | {color:green} The patch does not generate ASF License warnings. {color} | | {color:black}{color} | {color:black} {color} | {color:black} 36m 19s{color} | {color:black} {color} | \\ \\ || Subsystem || Report/Notes || | Optional Tests | asflicense javac javadoc findbugs checkstyle compile | | uname | Linux hiveptest-server-upstream 3.16.0-4-amd64 #1 SMP Debian 3.16.43-2+deb8u5 (2017-09-19) x86_64 GNU/Linux | | Build tool | maven | | Personality | /data/hiveptest/working/yetus_PreCommit-HIVE-Build-18726/dev-support/hive-personality.sh | | git revision | master / d6668c7 | | Default Java | 1.8.0_111 | | findbugs | v3.0.1 | | modules | C: ql U: ql | | Console output | http://104.198.109.242/logs//PreCommit-HIVE-Build-18726/yetus.txt | | Powered by | Apache Yetushttp://yetus.apache.org | This message was automatically generated. > Simplify SemanticAnalyzer by removing unused code > - > > Key: HIVE-22191 > URL: https://issues.apache.org/jira/browse/HIVE-22191 > Project: Hive > Issue Type: Task > Components: Hive >Reporter: Akos Dombi >Assignee: Akos Dombi >Priority: Major > Attachments: HIVE-22191.2.patch, HIVE-22191.3.patch, > HIVE-22191.4.patch, HIVE-22191.5.patch, HIVE-22191.5.patch, HIVE-22191.patch > > > Simplify {{SemanticAnalyzer}} by: > - Remove dead code > - Simplify returning statements > - Use interfaces types for parameters/fields/variables where it is > straightforward to migrate > - Make visibility stricter where it is possible > - Check logging to use parametrised logging > - Removing unnecessary keywords (e.g.: {{static}}) > - Some code part could be simplified by using Java 8 features > I think this is crucial step as this class already contains 15000+ lines of > code which is screaming for splitting into more reasonable classes. -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Commented] (HIVE-22244) Added default ACLs for znodes on a non-kerberized cluster
[ https://issues.apache.org/jira/browse/HIVE-22244?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16937967#comment-16937967 ] Prasanth Jayachandran commented on HIVE-22244: -- Can you provide more details on why this change is required? Making token store znode world-readable seems bad as it stores sensitive data. > Added default ACLs for znodes on a non-kerberized cluster > - > > Key: HIVE-22244 > URL: https://issues.apache.org/jira/browse/HIVE-22244 > Project: Hive > Issue Type: Bug > Components: Metastore >Reporter: Denys Kuzmenko >Assignee: Denys Kuzmenko >Priority: Major > Attachments: HIVE-22244.1.patch > > > Set default ACLs for znodes on a non-kerberized cluster: > Create/Read/Delete/Write/Admin to the world -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Commented] (HIVE-22244) Added default ACLs for znodes on a non-kerberized cluster
[ https://issues.apache.org/jira/browse/HIVE-22244?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16937960#comment-16937960 ] Gopal V commented on HIVE-22244: This is a delegation token store, so the unauthenticated user part looks suspicious. Is there a scenario for this patch? > Added default ACLs for znodes on a non-kerberized cluster > - > > Key: HIVE-22244 > URL: https://issues.apache.org/jira/browse/HIVE-22244 > Project: Hive > Issue Type: Bug > Components: Metastore >Reporter: Denys Kuzmenko >Assignee: Denys Kuzmenko >Priority: Major > Attachments: HIVE-22244.1.patch > > > Set default ACLs for znodes on a non-kerberized cluster: > Create/Read/Delete/Write/Admin to the world -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Commented] (HIVE-22236) Fail to create View selecting View containing NOT IN subquery
[ https://issues.apache.org/jira/browse/HIVE-22236?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16937953#comment-16937953 ] Hive QA commented on HIVE-22236: Here are the results of testing the latest attachment: https://issues.apache.org/jira/secure/attachment/12981327/HIVE-22236.01.patch {color:red}ERROR:{color} -1 due to build exiting with an error Test results: https://builds.apache.org/job/PreCommit-HIVE-Build/18725/testReport Console output: https://builds.apache.org/job/PreCommit-HIVE-Build/18725/console Test logs: http://104.198.109.242/logs/PreCommit-HIVE-Build-18725/ Messages: {noformat} Executing org.apache.hive.ptest.execution.TestCheckPhase Executing org.apache.hive.ptest.execution.PrepPhase Tests exited with: NonZeroExitCodeException Command 'bash /data/hiveptest/working/scratch/source-prep.sh' failed with exit status 1 and output '+ date '+%Y-%m-%d %T.%3N' 2019-09-25 18:00:04.059 + [[ -n /usr/lib/jvm/java-8-openjdk-amd64 ]] + export JAVA_HOME=/usr/lib/jvm/java-8-openjdk-amd64 + JAVA_HOME=/usr/lib/jvm/java-8-openjdk-amd64 + export PATH=/usr/lib/jvm/java-8-openjdk-amd64/bin/:/usr/local/bin:/usr/bin:/bin:/usr/local/games:/usr/games + PATH=/usr/lib/jvm/java-8-openjdk-amd64/bin/:/usr/local/bin:/usr/bin:/bin:/usr/local/games:/usr/games + export 'ANT_OPTS=-Xmx1g -XX:MaxPermSize=256m ' + ANT_OPTS='-Xmx1g -XX:MaxPermSize=256m ' + export 'MAVEN_OPTS=-Xmx1g ' + MAVEN_OPTS='-Xmx1g ' + cd /data/hiveptest/working/ + tee /data/hiveptest/logs/PreCommit-HIVE-Build-18725/source-prep.txt + [[ false == \t\r\u\e ]] + mkdir -p maven ivy + [[ git = \s\v\n ]] + [[ git = \g\i\t ]] + [[ -z master ]] + [[ -d apache-github-source-source ]] + [[ ! -d apache-github-source-source/.git ]] + [[ ! -d apache-github-source-source ]] + date '+%Y-%m-%d %T.%3N' 2019-09-25 18:00:04.062 + cd apache-github-source-source + git fetch origin + git reset --hard HEAD HEAD is now at d6668c7 HIVE-1: Llap external client - Need to reduce LlapBaseInputFormat#getSplits() footprint (Shubham Chaurasia, reviewed by Jason Dere) + git clean -f -d Removing standalone-metastore/metastore-server/src/gen/ + git checkout master Already on 'master' Your branch is up-to-date with 'origin/master'. + git reset --hard origin/master HEAD is now at d6668c7 HIVE-1: Llap external client - Need to reduce LlapBaseInputFormat#getSplits() footprint (Shubham Chaurasia, reviewed by Jason Dere) + git merge --ff-only origin/master Already up-to-date. + date '+%Y-%m-%d %T.%3N' 2019-09-25 18:00:05.164 + rm -rf ../yetus_PreCommit-HIVE-Build-18725 + mkdir ../yetus_PreCommit-HIVE-Build-18725 + git gc + cp -R . ../yetus_PreCommit-HIVE-Build-18725 + mkdir /data/hiveptest/logs/PreCommit-HIVE-Build-18725/yetus + patchCommandPath=/data/hiveptest/working/scratch/smart-apply-patch.sh + patchFilePath=/data/hiveptest/working/scratch/build.patch + [[ -f /data/hiveptest/working/scratch/build.patch ]] + chmod +x /data/hiveptest/working/scratch/smart-apply-patch.sh + /data/hiveptest/working/scratch/smart-apply-patch.sh /data/hiveptest/working/scratch/build.patch error: patch failed: ql/src/java/org/apache/hadoop/hive/ql/parse/SubQueryUtils.java:519 error: repository lacks the necessary blob to fall back on 3-way merge. error: ql/src/java/org/apache/hadoop/hive/ql/parse/SubQueryUtils.java: patch does not apply error: src/java/org/apache/hadoop/hive/ql/parse/SubQueryUtils.java: does not exist in index error: java/org/apache/hadoop/hive/ql/parse/SubQueryUtils.java: does not exist in index The patch does not appear to apply with p0, p1, or p2 + result=1 + '[' 1 -ne 0 ']' + rm -rf yetus_PreCommit-HIVE-Build-18725 + exit 1 ' {noformat} This message is automatically generated. ATTACHMENT ID: 12981327 - PreCommit-HIVE-Build > Fail to create View selecting View containing NOT IN subquery > - > > Key: HIVE-22236 > URL: https://issues.apache.org/jira/browse/HIVE-22236 > Project: Hive > Issue Type: Bug >Reporter: Zoltan Matyus >Assignee: Zoltan Matyus >Priority: Minor > Attachments: HIVE-22236.01.patch, HIVE-22236.q > > > * Given a complicated view with a select statement that has subquery > containing "{{NOT IN}}" > * Hive fails to create a simple view as {{SELECT * FROM complicated_view}} > * (with CBO disabled). > The unparse replacements of the complicated view will be applied to the text > of the simple view, resulting in {{IllegalArgumentException: replace: range > invalid}} exceptions from {{org.antlr.runtime.TokenRewriteStream.replace}}. -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Commented] (HIVE-22205) Upgrade zookeeper and curator versions
[ https://issues.apache.org/jira/browse/HIVE-22205?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16937951#comment-16937951 ] Hive QA commented on HIVE-22205: Here are the results of testing the latest attachment: https://issues.apache.org/jira/secure/attachment/12981321/HIVE-22205.7.patch {color:green}SUCCESS:{color} +1 due to 6 test(s) being added or modified. {color:green}SUCCESS:{color} +1 due to 17007 tests passed Test results: https://builds.apache.org/job/PreCommit-HIVE-Build/18724/testReport Console output: https://builds.apache.org/job/PreCommit-HIVE-Build/18724/console Test logs: http://104.198.109.242/logs/PreCommit-HIVE-Build-18724/ Messages: {noformat} Executing org.apache.hive.ptest.execution.TestCheckPhase Executing org.apache.hive.ptest.execution.PrepPhase Executing org.apache.hive.ptest.execution.YetusPhase Executing org.apache.hive.ptest.execution.ExecutionPhase Executing org.apache.hive.ptest.execution.ReportingPhase {noformat} This message is automatically generated. ATTACHMENT ID: 12981321 - PreCommit-HIVE-Build > Upgrade zookeeper and curator versions > -- > > Key: HIVE-22205 > URL: https://issues.apache.org/jira/browse/HIVE-22205 > Project: Hive > Issue Type: Improvement > Components: HiveServer2 >Affects Versions: 4.0.0 >Reporter: Naveen Gangam >Assignee: Naveen Gangam >Priority: Minor > Attachments: HIVE-22205.2.patch, HIVE-22205.3.patch, > HIVE-22205.4.patch, HIVE-22205.6.patch, HIVE-22205.7.patch, HIVE-22205.patch > > > Other components like hadoop have switched to using new ZK versions. So these > jars end up in classpath for hive services and could cause issues due to > in-compatible curator versions that hive uses. > So it makes sense for hive to upgrade the ZK and curator versions to try to > keep up. -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Updated] (HIVE-21884) Scheduled query support
[ https://issues.apache.org/jira/browse/HIVE-21884?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zoltan Haindrich updated HIVE-21884: Attachment: HIVE-21884.16.patch > Scheduled query support > --- > > Key: HIVE-21884 > URL: https://issues.apache.org/jira/browse/HIVE-21884 > Project: Hive > Issue Type: Improvement >Reporter: Zoltan Haindrich >Assignee: Zoltan Haindrich >Priority: Major > Attachments: HIVE-21844.04.patch, HIVE-21844.05.patch, > HIVE-21844.06.patch, HIVE-21844.07.patch, HIVE-21844.08.patch, > HIVE-21844.09.patch, HIVE-21844.15.patch, HIVE-21884.01.patch, > HIVE-21884.02.patch, HIVE-21884.03.patch, HIVE-21884.09.patch, > HIVE-21884.10.patch, HIVE-21884.10.patch, HIVE-21884.11.patch, > HIVE-21884.12.patch, HIVE-21884.13.patch, HIVE-21884.14.patch, > HIVE-21884.14.patch, HIVE-21884.14.patch, HIVE-21884.16.patch, Scheduled > queries2.pdf > > > design document: > https://docs.google.com/document/d/1mJSFdJi_1cbxJTXC9QvGw2rQ3zzJkNfxOO6b5esmyCE/edit# > in case the google doc is not reachable: [^Scheduled queries2.pdf] -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Commented] (HIVE-22225) add owner name for create database if missing
[ https://issues.apache.org/jira/browse/HIVE-5?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16937935#comment-16937935 ] Sam An commented on HIVE-5: --- Test failures for .2 patch do not seem to be related to my changes. Recheck... > add owner name for create database if missing > - > > Key: HIVE-5 > URL: https://issues.apache.org/jira/browse/HIVE-5 > Project: Hive > Issue Type: Task > Components: Hive >Reporter: Sam An >Assignee: Sam An >Priority: Minor > Attachments: HIVE-5.1.patch, HIVE-5.2.patch, > Hive-5.3.patch > > > When Spark connects to HMS, the database owner name is not filled. This could > happen to other clients as well. We shall fill this in HMS. Ownership info is > useful for authorizer component in Ranger, etc. -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Work logged] (HIVE-22234) Hive replication fails with table already exist error when replicating from old version of hive.
[ https://issues.apache.org/jira/browse/HIVE-22234?focusedWorklogId=318475=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-318475 ] ASF GitHub Bot logged work on HIVE-22234: - Author: ASF GitHub Bot Created on: 25/Sep/19 17:33 Start Date: 25/Sep/19 17:33 Worklog Time Spent: 10m Work Description: sankarh commented on pull request #788: HIVE-22234 : Hive replication fails with table already exist error when replicating from old version of hive. URL: https://github.com/apache/hive/pull/788#discussion_r328249792 ## File path: standalone-metastore/metastore-common/src/main/thrift/hive_metastore.thrift ## @@ -592,7 +592,7 @@ struct ColumnStatistics { 2: required list statsObj, 3: optional bool isStatsCompliant, // Are the stats isolation-level-compliant with the // the calling query? -4: required string engine +4: optional string engine Review comment: ok got it. This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org Issue Time Tracking --- Worklog Id: (was: 318475) Time Spent: 40m (was: 0.5h) > Hive replication fails with table already exist error when replicating from > old version of hive. > > > Key: HIVE-22234 > URL: https://issues.apache.org/jira/browse/HIVE-22234 > Project: Hive > Issue Type: Bug >Reporter: mahesh kumar behera >Assignee: mahesh kumar behera >Priority: Major > Labels: pull-request-available > Attachments: HIVE-22234.01.patch > > Time Spent: 40m > Remaining Estimate: 0h > > HIve replication from old version where HIVE-22046 is not patched will not > have engine column set in the table column stats. This causes "ERROR: null > value in column "ENGINE" violates not-null constraint" error during create > table while updating the column stats. As the column stats are updated after > the create table txn is committed, the next retry by HMS client throws table > already exist error. Need to update the ENGINE column to default value while > importing the table if the column value is not set. The column stat and > create table in same txn can be done as part of separate Jira. -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Updated] (HIVE-22225) add owner name for create database if missing
[ https://issues.apache.org/jira/browse/HIVE-5?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sam An updated HIVE-5: -- Attachment: Hive-5.3.patch > add owner name for create database if missing > - > > Key: HIVE-5 > URL: https://issues.apache.org/jira/browse/HIVE-5 > Project: Hive > Issue Type: Task > Components: Hive >Reporter: Sam An >Assignee: Sam An >Priority: Minor > Attachments: HIVE-5.1.patch, HIVE-5.2.patch, > Hive-5.3.patch > > > When Spark connects to HMS, the database owner name is not filled. This could > happen to other clients as well. We shall fill this in HMS. Ownership info is > useful for authorizer component in Ranger, etc. -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Commented] (HIVE-22234) Hive replication fails with table already exist error when replicating from old version of hive.
[ https://issues.apache.org/jira/browse/HIVE-22234?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16937929#comment-16937929 ] Sankar Hariappan commented on HIVE-22234: - +1, pending tests > Hive replication fails with table already exist error when replicating from > old version of hive. > > > Key: HIVE-22234 > URL: https://issues.apache.org/jira/browse/HIVE-22234 > Project: Hive > Issue Type: Bug >Reporter: mahesh kumar behera >Assignee: mahesh kumar behera >Priority: Major > Labels: pull-request-available > Attachments: HIVE-22234.01.patch > > Time Spent: 40m > Remaining Estimate: 0h > > HIve replication from old version where HIVE-22046 is not patched will not > have engine column set in the table column stats. This causes "ERROR: null > value in column "ENGINE" violates not-null constraint" error during create > table while updating the column stats. As the column stats are updated after > the create table txn is committed, the next retry by HMS client throws table > already exist error. Need to update the ENGINE column to default value while > importing the table if the column value is not set. The column stat and > create table in same txn can be done as part of separate Jira. -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Commented] (HIVE-22243) Align Apache Thrift version to 0.9.3-1 in standalone-metastore as well
[ https://issues.apache.org/jira/browse/HIVE-22243?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16937899#comment-16937899 ] Hive QA commented on HIVE-22243: Here are the results of testing the latest attachment: https://issues.apache.org/jira/secure/attachment/12981319/HIVE-22243.patch {color:red}ERROR:{color} -1 due to no test(s) being added or modified. {color:green}SUCCESS:{color} +1 due to 17007 tests passed Test results: https://builds.apache.org/job/PreCommit-HIVE-Build/18723/testReport Console output: https://builds.apache.org/job/PreCommit-HIVE-Build/18723/console Test logs: http://104.198.109.242/logs/PreCommit-HIVE-Build-18723/ Messages: {noformat} Executing org.apache.hive.ptest.execution.TestCheckPhase Executing org.apache.hive.ptest.execution.PrepPhase Executing org.apache.hive.ptest.execution.YetusPhase Executing org.apache.hive.ptest.execution.ExecutionPhase Executing org.apache.hive.ptest.execution.ReportingPhase {noformat} This message is automatically generated. ATTACHMENT ID: 12981319 - PreCommit-HIVE-Build > Align Apache Thrift version to 0.9.3-1 in standalone-metastore as well > -- > > Key: HIVE-22243 > URL: https://issues.apache.org/jira/browse/HIVE-22243 > Project: Hive > Issue Type: Bug >Reporter: David Lavati >Assignee: David Lavati >Priority: Major > Attachments: HIVE-22243.patch > > > Thrift was bumped to 0.9.3-1 in HIVE-21173, but standalone-metastore was left > out of this. > Thanks for pointing this out [~ashutosh.bapat]! -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Updated] (HIVE-21449) implement 'WITHIN GROUP' clause
[ https://issues.apache.org/jira/browse/HIVE-21449?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Krisztian Kasa updated HIVE-21449: -- Status: Open (was: Patch Available) > implement 'WITHIN GROUP' clause > --- > > Key: HIVE-21449 > URL: https://issues.apache.org/jira/browse/HIVE-21449 > Project: Hive > Issue Type: Improvement >Reporter: Laszlo Bodor >Assignee: Krisztian Kasa >Priority: Major > Fix For: 4.0.0 > > Attachments: HIVE-21449.1.patch, HIVE-21449.2.patch, > HIVE-21449.3.patch, HIVE-21449.4.patch, HIVE-21449.5.patch, > HIVE-21449.5.patch, HIVE-21449.6.patch, HIVE-21449.6.patch > > -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Updated] (HIVE-21449) implement 'WITHIN GROUP' clause
[ https://issues.apache.org/jira/browse/HIVE-21449?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Krisztian Kasa updated HIVE-21449: -- Status: Patch Available (was: Open) > implement 'WITHIN GROUP' clause > --- > > Key: HIVE-21449 > URL: https://issues.apache.org/jira/browse/HIVE-21449 > Project: Hive > Issue Type: Improvement >Reporter: Laszlo Bodor >Assignee: Krisztian Kasa >Priority: Major > Fix For: 4.0.0 > > Attachments: HIVE-21449.1.patch, HIVE-21449.2.patch, > HIVE-21449.3.patch, HIVE-21449.4.patch, HIVE-21449.5.patch, > HIVE-21449.5.patch, HIVE-21449.6.patch, HIVE-21449.6.patch > > -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Updated] (HIVE-21449) implement 'WITHIN GROUP' clause
[ https://issues.apache.org/jira/browse/HIVE-21449?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Krisztian Kasa updated HIVE-21449: -- Attachment: HIVE-21449.6.patch > implement 'WITHIN GROUP' clause > --- > > Key: HIVE-21449 > URL: https://issues.apache.org/jira/browse/HIVE-21449 > Project: Hive > Issue Type: Improvement >Reporter: Laszlo Bodor >Assignee: Krisztian Kasa >Priority: Major > Fix For: 4.0.0 > > Attachments: HIVE-21449.1.patch, HIVE-21449.2.patch, > HIVE-21449.3.patch, HIVE-21449.4.patch, HIVE-21449.5.patch, > HIVE-21449.5.patch, HIVE-21449.6.patch, HIVE-21449.6.patch > > -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Commented] (HIVE-22241) Implement UDF to convert a date/timestamp from Gregorian-Julian hybrid calendar to proleptic Gregorian calendar
[ https://issues.apache.org/jira/browse/HIVE-22241?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16937886#comment-16937886 ] Jesus Camacho Rodriguez commented on HIVE-22241: [~klcopp], [~szita], [~vgarg], can you review this? https://github.com/apache/hive/pull/789 Thanks > Implement UDF to convert a date/timestamp from Gregorian-Julian hybrid > calendar to proleptic Gregorian calendar > --- > > Key: HIVE-22241 > URL: https://issues.apache.org/jira/browse/HIVE-22241 > Project: Hive > Issue Type: Improvement > Components: UDF >Reporter: Jesus Camacho Rodriguez >Assignee: Jesus Camacho Rodriguez >Priority: Major > Labels: pull-request-available > Attachments: HIVE-22241.01.patch, HIVE-22241.patch > > Time Spent: 10m > Remaining Estimate: 0h > > UDF that converts a date/timestamp from *Gregorian-Julian hybrid* calendar, > i.e., calendar that supports both the Julian and Gregorian calendar systems > with the support of a single discontinuity, which corresponds by default to > the Gregorian date when the Gregorian calendar was instituted, to *proleptic > Gregorian calendar* (ISO 8601 standard), which is produced by extending the > Gregorian calendar backward to dates preceding its official introduction in > 1582. -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Updated] (HIVE-22241) Implement UDF to convert a date/timestamp from Gregorian-Julian hybrid calendar to proleptic Gregorian calendar
[ https://issues.apache.org/jira/browse/HIVE-22241?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jesus Camacho Rodriguez updated HIVE-22241: --- Attachment: HIVE-22241.01.patch > Implement UDF to convert a date/timestamp from Gregorian-Julian hybrid > calendar to proleptic Gregorian calendar > --- > > Key: HIVE-22241 > URL: https://issues.apache.org/jira/browse/HIVE-22241 > Project: Hive > Issue Type: Improvement > Components: UDF >Reporter: Jesus Camacho Rodriguez >Assignee: Jesus Camacho Rodriguez >Priority: Major > Attachments: HIVE-22241.01.patch, HIVE-22241.patch > > > UDF that converts a date/timestamp from *Gregorian-Julian hybrid* calendar, > i.e., calendar that supports both the Julian and Gregorian calendar systems > with the support of a single discontinuity, which corresponds by default to > the Gregorian date when the Gregorian calendar was instituted, to *proleptic > Gregorian calendar* (ISO 8601 standard), which is produced by extending the > Gregorian calendar backward to dates preceding its official introduction in > 1582. -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Updated] (HIVE-22241) Implement UDF to convert a date/timestamp from Gregorian-Julian hybrid calendar to proleptic Gregorian calendar
[ https://issues.apache.org/jira/browse/HIVE-22241?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated HIVE-22241: -- Labels: pull-request-available (was: ) > Implement UDF to convert a date/timestamp from Gregorian-Julian hybrid > calendar to proleptic Gregorian calendar > --- > > Key: HIVE-22241 > URL: https://issues.apache.org/jira/browse/HIVE-22241 > Project: Hive > Issue Type: Improvement > Components: UDF >Reporter: Jesus Camacho Rodriguez >Assignee: Jesus Camacho Rodriguez >Priority: Major > Labels: pull-request-available > Attachments: HIVE-22241.01.patch, HIVE-22241.patch > > > UDF that converts a date/timestamp from *Gregorian-Julian hybrid* calendar, > i.e., calendar that supports both the Julian and Gregorian calendar systems > with the support of a single discontinuity, which corresponds by default to > the Gregorian date when the Gregorian calendar was instituted, to *proleptic > Gregorian calendar* (ISO 8601 standard), which is produced by extending the > Gregorian calendar backward to dates preceding its official introduction in > 1582. -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Work logged] (HIVE-22241) Implement UDF to convert a date/timestamp from Gregorian-Julian hybrid calendar to proleptic Gregorian calendar
[ https://issues.apache.org/jira/browse/HIVE-22241?focusedWorklogId=318431=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-318431 ] ASF GitHub Bot logged work on HIVE-22241: - Author: ASF GitHub Bot Created on: 25/Sep/19 16:15 Start Date: 25/Sep/19 16:15 Worklog Time Spent: 10m Work Description: jcamachor commented on pull request #789: HIVE-22241 URL: https://github.com/apache/hive/pull/789 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org Issue Time Tracking --- Worklog Id: (was: 318431) Remaining Estimate: 0h Time Spent: 10m > Implement UDF to convert a date/timestamp from Gregorian-Julian hybrid > calendar to proleptic Gregorian calendar > --- > > Key: HIVE-22241 > URL: https://issues.apache.org/jira/browse/HIVE-22241 > Project: Hive > Issue Type: Improvement > Components: UDF >Reporter: Jesus Camacho Rodriguez >Assignee: Jesus Camacho Rodriguez >Priority: Major > Labels: pull-request-available > Attachments: HIVE-22241.01.patch, HIVE-22241.patch > > Time Spent: 10m > Remaining Estimate: 0h > > UDF that converts a date/timestamp from *Gregorian-Julian hybrid* calendar, > i.e., calendar that supports both the Julian and Gregorian calendar systems > with the support of a single discontinuity, which corresponds by default to > the Gregorian date when the Gregorian calendar was instituted, to *proleptic > Gregorian calendar* (ISO 8601 standard), which is produced by extending the > Gregorian calendar backward to dates preceding its official introduction in > 1582. -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Updated] (HIVE-22245) Make qtest feature parser reuseable
[ https://issues.apache.org/jira/browse/HIVE-22245?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zoltan Haindrich updated HIVE-22245: Attachment: (was: HIVE-22245.02.patch) > Make qtest feature parser reuseable > --- > > Key: HIVE-22245 > URL: https://issues.apache.org/jira/browse/HIVE-22245 > Project: Hive > Issue Type: Improvement > Components: Test >Reporter: Zoltan Haindrich >Assignee: Zoltan Haindrich >Priority: Major > Attachments: HIVE-22245.01.patch, HIVE-22245.02.patch > > > right now we have a parser for {{--! qt:dataset}} ; to enable further > addition of things (I would like to run scheduled query service for some > qtests ) -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Updated] (HIVE-22245) Make qtest feature parser reuseable
[ https://issues.apache.org/jira/browse/HIVE-22245?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zoltan Haindrich updated HIVE-22245: Attachment: HIVE-22245.02.patch > Make qtest feature parser reuseable > --- > > Key: HIVE-22245 > URL: https://issues.apache.org/jira/browse/HIVE-22245 > Project: Hive > Issue Type: Improvement > Components: Test >Reporter: Zoltan Haindrich >Assignee: Zoltan Haindrich >Priority: Major > Attachments: HIVE-22245.01.patch, HIVE-22245.02.patch > > > right now we have a parser for {{--! qt:dataset}} ; to enable further > addition of things (I would like to run scheduled query service for some > qtests ) -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Updated] (HIVE-22245) Make qtest feature parser reuseable
[ https://issues.apache.org/jira/browse/HIVE-22245?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zoltan Haindrich updated HIVE-22245: Attachment: HIVE-22245.02.patch > Make qtest feature parser reuseable > --- > > Key: HIVE-22245 > URL: https://issues.apache.org/jira/browse/HIVE-22245 > Project: Hive > Issue Type: Improvement > Components: Test >Reporter: Zoltan Haindrich >Assignee: Zoltan Haindrich >Priority: Major > Attachments: HIVE-22245.01.patch, HIVE-22245.02.patch > > > right now we have a parser for {{--! qt:dataset}} ; to enable further > addition of things (I would like to run scheduled query service for some > qtests ) -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Commented] (HIVE-22239) Scale data size using column value ranges
[ https://issues.apache.org/jira/browse/HIVE-22239?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16937862#comment-16937862 ] Jesus Camacho Rodriguez commented on HIVE-22239: Thanks [~kgyrtkirk]. That makes sense, I will introduce a config parameter to disable it if desired. > Scale data size using column value ranges > - > > Key: HIVE-22239 > URL: https://issues.apache.org/jira/browse/HIVE-22239 > Project: Hive > Issue Type: Improvement > Components: Physical Optimizer >Reporter: Jesus Camacho Rodriguez >Assignee: Jesus Camacho Rodriguez >Priority: Major > Labels: pull-request-available > Attachments: HIVE-22239.patch > > Time Spent: 10m > Remaining Estimate: 0h > > Currently, min/max values for columns are only used to determine whether a > certain range filter falls out of range and thus filters all rows or none at > all. If it does not, we just use a heuristic that the condition will filter > 1/3 of the input rows. Instead of using that heuristic, we can use another > one that assumes that data will be uniformly distributed across that range, > and calculate the selectivity for the condition accordingly. > This patch also includes the propagation of min/max column values from > statistics to the optimizer for timestamp type. -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Commented] (HIVE-22243) Align Apache Thrift version to 0.9.3-1 in standalone-metastore as well
[ https://issues.apache.org/jira/browse/HIVE-22243?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16937842#comment-16937842 ] Hive QA commented on HIVE-22243: | (/) *{color:green}+1 overall{color}* | \\ \\ || Vote || Subsystem || Runtime || Comment || || || || || {color:brown} Prechecks {color} || | {color:green}+1{color} | {color:green} @author {color} | {color:green} 0m 0s{color} | {color:green} The patch does not contain any @author tags. {color} | || || || || {color:brown} master Compile Tests {color} || | {color:green}+1{color} | {color:green} mvninstall {color} | {color:green} 8m 9s{color} | {color:green} master passed {color} | | {color:green}+1{color} | {color:green} compile {color} | {color:green} 1m 0s{color} | {color:green} master passed {color} | | {color:green}+1{color} | {color:green} javadoc {color} | {color:green} 1m 10s{color} | {color:green} master passed {color} | || || || || {color:brown} Patch Compile Tests {color} || | {color:green}+1{color} | {color:green} mvninstall {color} | {color:green} 1m 3s{color} | {color:green} the patch passed {color} | | {color:green}+1{color} | {color:green} compile {color} | {color:green} 0m 59s{color} | {color:green} the patch passed {color} | | {color:green}+1{color} | {color:green} javac {color} | {color:green} 0m 59s{color} | {color:green} the patch passed {color} | | {color:green}+1{color} | {color:green} whitespace {color} | {color:green} 0m 0s{color} | {color:green} The patch has no whitespace issues. {color} | | {color:green}+1{color} | {color:green} xml {color} | {color:green} 0m 2s{color} | {color:green} The patch has no ill-formed XML file. {color} | | {color:green}+1{color} | {color:green} javadoc {color} | {color:green} 1m 10s{color} | {color:green} the patch passed {color} | || || || || {color:brown} Other Tests {color} || | {color:green}+1{color} | {color:green} asflicense {color} | {color:green} 0m 13s{color} | {color:green} The patch does not generate ASF License warnings. {color} | | {color:black}{color} | {color:black} {color} | {color:black} 14m 11s{color} | {color:black} {color} | \\ \\ || Subsystem || Report/Notes || | Optional Tests | asflicense javac javadoc xml compile | | uname | Linux hiveptest-server-upstream 3.16.0-4-amd64 #1 SMP Debian 3.16.43-2+deb8u5 (2017-09-19) x86_64 GNU/Linux | | Build tool | maven | | Personality | /data/hiveptest/working/yetus_PreCommit-HIVE-Build-18723/dev-support/hive-personality.sh | | git revision | master / d6668c7 | | Default Java | 1.8.0_111 | | modules | C: standalone-metastore U: standalone-metastore | | Console output | http://104.198.109.242/logs//PreCommit-HIVE-Build-18723/yetus.txt | | Powered by | Apache Yetushttp://yetus.apache.org | This message was automatically generated. > Align Apache Thrift version to 0.9.3-1 in standalone-metastore as well > -- > > Key: HIVE-22243 > URL: https://issues.apache.org/jira/browse/HIVE-22243 > Project: Hive > Issue Type: Bug >Reporter: David Lavati >Assignee: David Lavati >Priority: Major > Attachments: HIVE-22243.patch > > > Thrift was bumped to 0.9.3-1 in HIVE-21173, but standalone-metastore was left > out of this. > Thanks for pointing this out [~ashutosh.bapat]! -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Assigned] (HIVE-21924) Split text files even if header/footer exists
[ https://issues.apache.org/jira/browse/HIVE-21924?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Richard Zhang reassigned HIVE-21924: Assignee: Mustafa Iman > Split text files even if header/footer exists > - > > Key: HIVE-21924 > URL: https://issues.apache.org/jira/browse/HIVE-21924 > Project: Hive > Issue Type: Improvement > Components: File Formats >Affects Versions: 2.4.0, 4.0.0, 3.2.0 >Reporter: Prasanth Jayachandran >Assignee: Mustafa Iman >Priority: Major > > https://github.com/apache/hive/blob/967a1cc98beede8e6568ce750ebeb6e0d048b8ea/ql/src/java/org/apache/hadoop/hive/ql/io/HiveInputFormat.java#L494-L503 > > {code} > int headerCount = 0; > int footerCount = 0; > if (table != null) { > headerCount = Utilities.getHeaderCount(table); > footerCount = Utilities.getFooterCount(table, conf); > if (headerCount != 0 || footerCount != 0) { > // Input file has header or footer, cannot be splitted. > HiveConf.setLongVar(conf, ConfVars.MAPREDMINSPLITSIZE, > Long.MAX_VALUE); > } > } > {code} > this piece of code makes the CSV (or any text files with header/footer) files > not splittable if header or footer is present. > If only header is present, we can find the offset after first line break and > use that to split. Similarly for footer, may be read few KB's of data at the > end and find the last line break offset. Use that to determine the data range > which can be used for splitting. Few reads during split generation are > cheaper than not splitting the file at all. -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Commented] (HIVE-22242) Move TempTable and PartitionTree out of SessionHiveMetastoreClient
[ https://issues.apache.org/jira/browse/HIVE-22242?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16937823#comment-16937823 ] Hive QA commented on HIVE-22242: Here are the results of testing the latest attachment: https://issues.apache.org/jira/secure/attachment/12981313/HIVE-22242.02.patch {color:red}ERROR:{color} -1 due to no test(s) being added or modified. {color:red}ERROR:{color} -1 due to 1 failed/errored test(s), 17007 tests executed *Failed tests:* {noformat} org.apache.hadoop.hive.metastore.TestPartitionManagement.testPartitionDiscoveryTransactionalTable (batchId=223) {noformat} Test results: https://builds.apache.org/job/PreCommit-HIVE-Build/18722/testReport Console output: https://builds.apache.org/job/PreCommit-HIVE-Build/18722/console Test logs: http://104.198.109.242/logs/PreCommit-HIVE-Build-18722/ Messages: {noformat} Executing org.apache.hive.ptest.execution.TestCheckPhase Executing org.apache.hive.ptest.execution.PrepPhase Executing org.apache.hive.ptest.execution.YetusPhase Executing org.apache.hive.ptest.execution.ExecutionPhase Executing org.apache.hive.ptest.execution.ReportingPhase Tests exited with: TestsFailedException: 1 tests failed {noformat} This message is automatically generated. ATTACHMENT ID: 12981313 - PreCommit-HIVE-Build > Move TempTable and PartitionTree out of SessionHiveMetastoreClient > -- > > Key: HIVE-22242 > URL: https://issues.apache.org/jira/browse/HIVE-22242 > Project: Hive > Issue Type: Sub-task > Components: Hive >Reporter: Laszlo Pinter >Assignee: Laszlo Pinter >Priority: Major > Attachments: HIVE-22242.01.patch, HIVE-22242.02.patch > > > SessionHiveMetastoreClient is getting too crowded and unreadable. TempTable > and PartitionTree should moved into a separate class. -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Updated] (HIVE-22245) Make qtest feature parser reuseable
[ https://issues.apache.org/jira/browse/HIVE-22245?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zoltan Haindrich updated HIVE-22245: Status: Patch Available (was: Open) > Make qtest feature parser reuseable > --- > > Key: HIVE-22245 > URL: https://issues.apache.org/jira/browse/HIVE-22245 > Project: Hive > Issue Type: Improvement > Components: Test >Reporter: Zoltan Haindrich >Assignee: Zoltan Haindrich >Priority: Major > Attachments: HIVE-22245.01.patch > > > right now we have a parser for {{--! qt:dataset}} ; to enable further > addition of things (I would like to run scheduled query service for some > qtests ) -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Updated] (HIVE-22245) Make qtest feature parser reuseable
[ https://issues.apache.org/jira/browse/HIVE-22245?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zoltan Haindrich updated HIVE-22245: Attachment: HIVE-22245.01.patch > Make qtest feature parser reuseable > --- > > Key: HIVE-22245 > URL: https://issues.apache.org/jira/browse/HIVE-22245 > Project: Hive > Issue Type: Improvement > Components: Test >Reporter: Zoltan Haindrich >Assignee: Zoltan Haindrich >Priority: Major > Attachments: HIVE-22245.01.patch > > > right now we have a parser for {{--! qt:dataset}} ; to enable further > addition of things (I would like to run scheduled query service for some > qtests ) -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Assigned] (HIVE-22245) Make qtest feature parser reuseable
[ https://issues.apache.org/jira/browse/HIVE-22245?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zoltan Haindrich reassigned HIVE-22245: --- > Make qtest feature parser reuseable > --- > > Key: HIVE-22245 > URL: https://issues.apache.org/jira/browse/HIVE-22245 > Project: Hive > Issue Type: Improvement > Components: Test >Reporter: Zoltan Haindrich >Assignee: Zoltan Haindrich >Priority: Major > > right now we have a parser for {{--! qt:dataset}} ; to enable further > addition of things (I would like to run scheduled query service for some > qtests ) -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Updated] (HIVE-22191) Simplify SemanticAnalyzer by removing unused code
[ https://issues.apache.org/jira/browse/HIVE-22191?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Akos Dombi updated HIVE-22191: -- Attachment: HIVE-22191.5.patch > Simplify SemanticAnalyzer by removing unused code > - > > Key: HIVE-22191 > URL: https://issues.apache.org/jira/browse/HIVE-22191 > Project: Hive > Issue Type: Task > Components: Hive >Reporter: Akos Dombi >Assignee: Akos Dombi >Priority: Major > Attachments: HIVE-22191.2.patch, HIVE-22191.3.patch, > HIVE-22191.4.patch, HIVE-22191.5.patch, HIVE-22191.5.patch, HIVE-22191.patch > > > Simplify {{SemanticAnalyzer}} by: > - Remove dead code > - Simplify returning statements > - Use interfaces types for parameters/fields/variables where it is > straightforward to migrate > - Make visibility stricter where it is possible > - Check logging to use parametrised logging > - Removing unnecessary keywords (e.g.: {{static}}) > - Some code part could be simplified by using Java 8 features > I think this is crucial step as this class already contains 15000+ lines of > code which is screaming for splitting into more reasonable classes. -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Work logged] (HIVE-21737) Upgrade Avro to version 1.9.1
[ https://issues.apache.org/jira/browse/HIVE-21737?focusedWorklogId=318366=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-318366 ] ASF GitHub Bot logged work on HIVE-21737: - Author: ASF GitHub Bot Created on: 25/Sep/19 14:35 Start Date: 25/Sep/19 14:35 Worklog Time Spent: 10m Work Description: iemejia commented on issue #785: [WIP] HIVE-21737: Bump Apache Avro to 1.9.0 URL: https://github.com/apache/hive/pull/785#issuecomment-535053319 Oh I see thanks @nandorKollar I will move this there then. This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org Issue Time Tracking --- Worklog Id: (was: 318366) Time Spent: 40m (was: 0.5h) > Upgrade Avro to version 1.9.1 > - > > Key: HIVE-21737 > URL: https://issues.apache.org/jira/browse/HIVE-21737 > Project: Hive > Issue Type: Improvement > Components: Hive >Reporter: Ismaël Mejía >Assignee: Fokko Driesprong >Priority: Minor > Labels: pull-request-available > Attachments: 0001-HIVE-21737-Bump-Apache-Avro-to-1.9.1.patch > > Time Spent: 40m > Remaining Estimate: 0h > > Avro 1.9.0 was released recently. It brings a lot of fixes including a leaner > version of Avro without Jackson in the public API. Worth the update. -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Commented] (HIVE-22244) Added default ACLs for znodes on a non-kerberized cluster
[ https://issues.apache.org/jira/browse/HIVE-22244?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16937791#comment-16937791 ] Peter Vary commented on HIVE-22244: --- +1 pending tests > Added default ACLs for znodes on a non-kerberized cluster > - > > Key: HIVE-22244 > URL: https://issues.apache.org/jira/browse/HIVE-22244 > Project: Hive > Issue Type: Bug > Components: Metastore >Reporter: Denys Kuzmenko >Assignee: Denys Kuzmenko >Priority: Major > Attachments: HIVE-22244.1.patch > > > Set default ACLs for znodes on a non-kerberized cluster: > Create/Read/Delete/Write/Admin to the world -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Commented] (HIVE-22242) Move TempTable and PartitionTree out of SessionHiveMetastoreClient
[ https://issues.apache.org/jira/browse/HIVE-22242?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16937776#comment-16937776 ] Hive QA commented on HIVE-22242: | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem || Runtime || Comment || || || || || {color:brown} Prechecks {color} || | {color:green}+1{color} | {color:green} @author {color} | {color:green} 0m 0s{color} | {color:green} The patch does not contain any @author tags. {color} | || || || || {color:brown} master Compile Tests {color} || | {color:green}+1{color} | {color:green} mvninstall {color} | {color:green} 8m 22s{color} | {color:green} master passed {color} | | {color:green}+1{color} | {color:green} compile {color} | {color:green} 1m 1s{color} | {color:green} master passed {color} | | {color:green}+1{color} | {color:green} checkstyle {color} | {color:green} 0m 39s{color} | {color:green} master passed {color} | | {color:blue}0{color} | {color:blue} findbugs {color} | {color:blue} 3m 54s{color} | {color:blue} ql in master has 1567 extant Findbugs warnings. {color} | | {color:green}+1{color} | {color:green} javadoc {color} | {color:green} 0m 56s{color} | {color:green} master passed {color} | || || || || {color:brown} Patch Compile Tests {color} || | {color:green}+1{color} | {color:green} mvninstall {color} | {color:green} 1m 23s{color} | {color:green} the patch passed {color} | | {color:green}+1{color} | {color:green} compile {color} | {color:green} 1m 3s{color} | {color:green} the patch passed {color} | | {color:green}+1{color} | {color:green} javac {color} | {color:green} 1m 3s{color} | {color:green} the patch passed {color} | | {color:red}-1{color} | {color:red} checkstyle {color} | {color:red} 0m 39s{color} | {color:red} ql: The patch generated 1 new + 75 unchanged - 0 fixed = 76 total (was 75) {color} | | {color:green}+1{color} | {color:green} whitespace {color} | {color:green} 0m 0s{color} | {color:green} The patch has no whitespace issues. {color} | | {color:red}-1{color} | {color:red} findbugs {color} | {color:red} 4m 3s{color} | {color:red} ql generated 1 new + 1566 unchanged - 1 fixed = 1567 total (was 1567) {color} | | {color:green}+1{color} | {color:green} javadoc {color} | {color:green} 0m 56s{color} | {color:green} the patch passed {color} | || || || || {color:brown} Other Tests {color} || | {color:green}+1{color} | {color:green} asflicense {color} | {color:green} 0m 14s{color} | {color:green} The patch does not generate ASF License warnings. {color} | | {color:black}{color} | {color:black} {color} | {color:black} 23m 37s{color} | {color:black} {color} | \\ \\ || Reason || Tests || | FindBugs | module:ql | | | org.apache.hadoop.hive.ql.metadata.PartitionTree.getPartitionsByPartitionVals(List) makes inefficient use of keySet iterator instead of entrySet iterator At PartitionTree.java:keySet iterator instead of entrySet iterator At PartitionTree.java:[line 123] | \\ \\ || Subsystem || Report/Notes || | Optional Tests | asflicense javac javadoc findbugs checkstyle compile | | uname | Linux hiveptest-server-upstream 3.16.0-4-amd64 #1 SMP Debian 3.16.43-2+deb8u5 (2017-09-19) x86_64 GNU/Linux | | Build tool | maven | | Personality | /data/hiveptest/working/yetus_PreCommit-HIVE-Build-18722/dev-support/hive-personality.sh | | git revision | master / d6668c7 | | Default Java | 1.8.0_111 | | findbugs | v3.0.1 | | checkstyle | http://104.198.109.242/logs//PreCommit-HIVE-Build-18722/yetus/diff-checkstyle-ql.txt | | findbugs | http://104.198.109.242/logs//PreCommit-HIVE-Build-18722/yetus/new-findbugs-ql.html | | modules | C: ql U: ql | | Console output | http://104.198.109.242/logs//PreCommit-HIVE-Build-18722/yetus.txt | | Powered by | Apache Yetushttp://yetus.apache.org | This message was automatically generated. > Move TempTable and PartitionTree out of SessionHiveMetastoreClient > -- > > Key: HIVE-22242 > URL: https://issues.apache.org/jira/browse/HIVE-22242 > Project: Hive > Issue Type: Sub-task > Components: Hive >Reporter: Laszlo Pinter >Assignee: Laszlo Pinter >Priority: Major > Attachments: HIVE-22242.01.patch, HIVE-22242.02.patch > > > SessionHiveMetastoreClient is getting too crowded and unreadable. TempTable > and PartitionTree should moved into a separate class. -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Updated] (HIVE-22244) Added default ACLs for znodes on a non-kerberized cluster
[ https://issues.apache.org/jira/browse/HIVE-22244?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Denys Kuzmenko updated HIVE-22244: -- Attachment: HIVE-22244.1.patch > Added default ACLs for znodes on a non-kerberized cluster > - > > Key: HIVE-22244 > URL: https://issues.apache.org/jira/browse/HIVE-22244 > Project: Hive > Issue Type: Bug > Components: Metastore >Reporter: Denys Kuzmenko >Assignee: Denys Kuzmenko >Priority: Major > Attachments: HIVE-22244.1.patch > > > Set default ACLs for znodes on a non-kerberized cluster: > Create/Read/Delete/Write/Admin to the world -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Assigned] (HIVE-22244) Added default ACLs for znodes on a non-kerberized cluster
[ https://issues.apache.org/jira/browse/HIVE-22244?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Denys Kuzmenko reassigned HIVE-22244: - Assignee: Denys Kuzmenko > Added default ACLs for znodes on a non-kerberized cluster > - > > Key: HIVE-22244 > URL: https://issues.apache.org/jira/browse/HIVE-22244 > Project: Hive > Issue Type: Bug > Components: Metastore >Reporter: Denys Kuzmenko >Assignee: Denys Kuzmenko >Priority: Major > > Set default ACLs for znodes on a non-kerberized cluster: > Create/Read/Delete/Write/Admin to the world -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Commented] (HIVE-22242) Move TempTable and PartitionTree out of SessionHiveMetastoreClient
[ https://issues.apache.org/jira/browse/HIVE-22242?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16937763#comment-16937763 ] Peter Vary commented on HIVE-22242: --- +1 pending tests > Move TempTable and PartitionTree out of SessionHiveMetastoreClient > -- > > Key: HIVE-22242 > URL: https://issues.apache.org/jira/browse/HIVE-22242 > Project: Hive > Issue Type: Sub-task > Components: Hive >Reporter: Laszlo Pinter >Assignee: Laszlo Pinter >Priority: Major > Attachments: HIVE-22242.01.patch, HIVE-22242.02.patch > > > SessionHiveMetastoreClient is getting too crowded and unreadable. TempTable > and PartitionTree should moved into a separate class. -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Commented] (HIVE-21449) implement 'WITHIN GROUP' clause
[ https://issues.apache.org/jira/browse/HIVE-21449?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16937746#comment-16937746 ] Hive QA commented on HIVE-21449: Here are the results of testing the latest attachment: https://issues.apache.org/jira/secure/attachment/12981304/HIVE-21449.6.patch {color:green}SUCCESS:{color} +1 due to 6 test(s) being added or modified. {color:red}ERROR:{color} -1 due to 1 failed/errored test(s), 17010 tests executed *Failed tests:* {noformat} org.apache.hadoop.hive.cli.TestMiniDruidKafkaCliDriver.testCliDriver[druidkafkamini_avro] (batchId=298) {noformat} Test results: https://builds.apache.org/job/PreCommit-HIVE-Build/18721/testReport Console output: https://builds.apache.org/job/PreCommit-HIVE-Build/18721/console Test logs: http://104.198.109.242/logs/PreCommit-HIVE-Build-18721/ Messages: {noformat} Executing org.apache.hive.ptest.execution.TestCheckPhase Executing org.apache.hive.ptest.execution.PrepPhase Executing org.apache.hive.ptest.execution.YetusPhase Executing org.apache.hive.ptest.execution.ExecutionPhase Executing org.apache.hive.ptest.execution.ReportingPhase Tests exited with: TestsFailedException: 1 tests failed {noformat} This message is automatically generated. ATTACHMENT ID: 12981304 - PreCommit-HIVE-Build > implement 'WITHIN GROUP' clause > --- > > Key: HIVE-21449 > URL: https://issues.apache.org/jira/browse/HIVE-21449 > Project: Hive > Issue Type: Improvement >Reporter: Laszlo Bodor >Assignee: Krisztian Kasa >Priority: Major > Fix For: 4.0.0 > > Attachments: HIVE-21449.1.patch, HIVE-21449.2.patch, > HIVE-21449.3.patch, HIVE-21449.4.patch, HIVE-21449.5.patch, > HIVE-21449.5.patch, HIVE-21449.6.patch > > -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Updated] (HIVE-22236) Fail to create View selecting View containing NOT IN subquery
[ https://issues.apache.org/jira/browse/HIVE-22236?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zoltan Matyus updated HIVE-22236: - Status: Patch Available (was: Open) > Fail to create View selecting View containing NOT IN subquery > - > > Key: HIVE-22236 > URL: https://issues.apache.org/jira/browse/HIVE-22236 > Project: Hive > Issue Type: Bug >Reporter: Zoltan Matyus >Assignee: Zoltan Matyus >Priority: Minor > Attachments: HIVE-22236.01.patch, HIVE-22236.q > > > * Given a complicated view with a select statement that has subquery > containing "{{NOT IN}}" > * Hive fails to create a simple view as {{SELECT * FROM complicated_view}} > * (with CBO disabled). > The unparse replacements of the complicated view will be applied to the text > of the simple view, resulting in {{IllegalArgumentException: replace: range > invalid}} exceptions from {{org.antlr.runtime.TokenRewriteStream.replace}}. -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Updated] (HIVE-22236) Fail to create View selecting View containing NOT IN subquery
[ https://issues.apache.org/jira/browse/HIVE-22236?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zoltan Matyus updated HIVE-22236: - Attachment: HIVE-22236.01.patch > Fail to create View selecting View containing NOT IN subquery > - > > Key: HIVE-22236 > URL: https://issues.apache.org/jira/browse/HIVE-22236 > Project: Hive > Issue Type: Bug >Reporter: Zoltan Matyus >Assignee: Zoltan Matyus >Priority: Minor > Attachments: HIVE-22236.01.patch, HIVE-22236.q > > > * Given a complicated view with a select statement that has subquery > containing "{{NOT IN}}" > * Hive fails to create a simple view as {{SELECT * FROM complicated_view}} > * (with CBO disabled). > The unparse replacements of the complicated view will be applied to the text > of the simple view, resulting in {{IllegalArgumentException: replace: range > invalid}} exceptions from {{org.antlr.runtime.TokenRewriteStream.replace}}. -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Work logged] (HIVE-21737) Upgrade Avro to version 1.9.1
[ https://issues.apache.org/jira/browse/HIVE-21737?focusedWorklogId=318319=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-318319 ] ASF GitHub Bot logged work on HIVE-21737: - Author: ASF GitHub Bot Created on: 25/Sep/19 13:26 Start Date: 25/Sep/19 13:26 Worklog Time Spent: 10m Work Description: nandorKollar commented on issue #785: [WIP] HIVE-21737: Bump Apache Avro to 1.9.0 URL: https://github.com/apache/hive/pull/785#issuecomment-535021548 @iemejia I'm afraid that Hive mostly cares about patches attached to Jiras - at least the [How to contribute](https://cwiki.apache.org/confluence/display/Hive/HowToContribute#HowToContribute-CreatingaPatch) tells about patches and doesn't mentione PRs. I think that for a PR, not all of the tests that are relevant are executed (I guess `mvn clean install -DskipTests -q -Pitests` from travis.yaml isn't too much), but I'm not sure that. This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org Issue Time Tracking --- Worklog Id: (was: 318319) Time Spent: 0.5h (was: 20m) > Upgrade Avro to version 1.9.1 > - > > Key: HIVE-21737 > URL: https://issues.apache.org/jira/browse/HIVE-21737 > Project: Hive > Issue Type: Improvement > Components: Hive >Reporter: Ismaël Mejía >Assignee: Fokko Driesprong >Priority: Minor > Labels: pull-request-available > Attachments: 0001-HIVE-21737-Bump-Apache-Avro-to-1.9.1.patch > > Time Spent: 0.5h > Remaining Estimate: 0h > > Avro 1.9.0 was released recently. It brings a lot of fixes including a leaner > version of Avro without Jackson in the public API. Worth the update. -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Updated] (HIVE-22205) Upgrade zookeeper and curator versions
[ https://issues.apache.org/jira/browse/HIVE-22205?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Naveen Gangam updated HIVE-22205: - Status: Patch Available (was: Open) The AccumuloCliDriver tests continue to fail with the new ZooKeeper release as the AdminServer fails to start because of port conflict. This latest patch, v7, addresses this issue with the AccumuloMiniCluster code setting the property to disable the AdminServer for the zookeeper. The tests are now passing locally. Thanks > Upgrade zookeeper and curator versions > -- > > Key: HIVE-22205 > URL: https://issues.apache.org/jira/browse/HIVE-22205 > Project: Hive > Issue Type: Improvement > Components: HiveServer2 >Affects Versions: 4.0.0 >Reporter: Naveen Gangam >Assignee: Naveen Gangam >Priority: Minor > Attachments: HIVE-22205.2.patch, HIVE-22205.3.patch, > HIVE-22205.4.patch, HIVE-22205.6.patch, HIVE-22205.7.patch, HIVE-22205.patch > > > Other components like hadoop have switched to using new ZK versions. So these > jars end up in classpath for hive services and could cause issues due to > in-compatible curator versions that hive uses. > So it makes sense for hive to upgrade the ZK and curator versions to try to > keep up. -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Updated] (HIVE-22205) Upgrade zookeeper and curator versions
[ https://issues.apache.org/jira/browse/HIVE-22205?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Naveen Gangam updated HIVE-22205: - Attachment: HIVE-22205.7.patch > Upgrade zookeeper and curator versions > -- > > Key: HIVE-22205 > URL: https://issues.apache.org/jira/browse/HIVE-22205 > Project: Hive > Issue Type: Improvement > Components: HiveServer2 >Affects Versions: 4.0.0 >Reporter: Naveen Gangam >Assignee: Naveen Gangam >Priority: Minor > Attachments: HIVE-22205.2.patch, HIVE-22205.3.patch, > HIVE-22205.4.patch, HIVE-22205.6.patch, HIVE-22205.7.patch, HIVE-22205.patch > > > Other components like hadoop have switched to using new ZK versions. So these > jars end up in classpath for hive services and could cause issues due to > in-compatible curator versions that hive uses. > So it makes sense for hive to upgrade the ZK and curator versions to try to > keep up. -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Updated] (HIVE-22205) Upgrade zookeeper and curator versions
[ https://issues.apache.org/jira/browse/HIVE-22205?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Naveen Gangam updated HIVE-22205: - Status: Open (was: Patch Available) > Upgrade zookeeper and curator versions > -- > > Key: HIVE-22205 > URL: https://issues.apache.org/jira/browse/HIVE-22205 > Project: Hive > Issue Type: Improvement > Components: HiveServer2 >Affects Versions: 4.0.0 >Reporter: Naveen Gangam >Assignee: Naveen Gangam >Priority: Minor > Attachments: HIVE-22205.2.patch, HIVE-22205.3.patch, > HIVE-22205.4.patch, HIVE-22205.6.patch, HIVE-22205.patch > > > Other components like hadoop have switched to using new ZK versions. So these > jars end up in classpath for hive services and could cause issues due to > in-compatible curator versions that hive uses. > So it makes sense for hive to upgrade the ZK and curator versions to try to > keep up. -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Commented] (HIVE-21449) implement 'WITHIN GROUP' clause
[ https://issues.apache.org/jira/browse/HIVE-21449?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16937699#comment-16937699 ] Hive QA commented on HIVE-21449: | (/) *{color:green}+1 overall{color}* | \\ \\ || Vote || Subsystem || Runtime || Comment || || || || || {color:brown} Prechecks {color} || | {color:green}+1{color} | {color:green} @author {color} | {color:green} 0m 0s{color} | {color:green} The patch does not contain any @author tags. {color} | || || || || {color:brown} master Compile Tests {color} || | {color:green}+1{color} | {color:green} mvninstall {color} | {color:green} 8m 7s{color} | {color:green} master passed {color} | | {color:green}+1{color} | {color:green} compile {color} | {color:green} 1m 0s{color} | {color:green} master passed {color} | | {color:green}+1{color} | {color:green} checkstyle {color} | {color:green} 0m 41s{color} | {color:green} master passed {color} | | {color:blue}0{color} | {color:blue} findbugs {color} | {color:blue} 3m 51s{color} | {color:blue} ql in master has 1567 extant Findbugs warnings. {color} | | {color:green}+1{color} | {color:green} javadoc {color} | {color:green} 0m 54s{color} | {color:green} master passed {color} | || || || || {color:brown} Patch Compile Tests {color} || | {color:green}+1{color} | {color:green} mvninstall {color} | {color:green} 1m 24s{color} | {color:green} the patch passed {color} | | {color:green}+1{color} | {color:green} compile {color} | {color:green} 1m 1s{color} | {color:green} the patch passed {color} | | {color:green}+1{color} | {color:green} javac {color} | {color:green} 1m 1s{color} | {color:green} the patch passed {color} | | {color:green}+1{color} | {color:green} checkstyle {color} | {color:green} 0m 41s{color} | {color:green} the patch passed {color} | | {color:green}+1{color} | {color:green} whitespace {color} | {color:green} 0m 0s{color} | {color:green} The patch has no whitespace issues. {color} | | {color:green}+1{color} | {color:green} findbugs {color} | {color:green} 4m 2s{color} | {color:green} the patch passed {color} | | {color:green}+1{color} | {color:green} javadoc {color} | {color:green} 0m 54s{color} | {color:green} the patch passed {color} | || || || || {color:brown} Other Tests {color} || | {color:green}+1{color} | {color:green} asflicense {color} | {color:green} 0m 14s{color} | {color:green} The patch does not generate ASF License warnings. {color} | | {color:black}{color} | {color:black} {color} | {color:black} 23m 22s{color} | {color:black} {color} | \\ \\ || Subsystem || Report/Notes || | Optional Tests | asflicense javac javadoc findbugs checkstyle compile | | uname | Linux hiveptest-server-upstream 3.16.0-4-amd64 #1 SMP Debian 3.16.43-2+deb8u5 (2017-09-19) x86_64 GNU/Linux | | Build tool | maven | | Personality | /data/hiveptest/working/yetus_PreCommit-HIVE-Build-18721/dev-support/hive-personality.sh | | git revision | master / d6668c7 | | Default Java | 1.8.0_111 | | findbugs | v3.0.1 | | modules | C: ql U: ql | | Console output | http://104.198.109.242/logs//PreCommit-HIVE-Build-18721/yetus.txt | | Powered by | Apache Yetushttp://yetus.apache.org | This message was automatically generated. > implement 'WITHIN GROUP' clause > --- > > Key: HIVE-21449 > URL: https://issues.apache.org/jira/browse/HIVE-21449 > Project: Hive > Issue Type: Improvement >Reporter: Laszlo Bodor >Assignee: Krisztian Kasa >Priority: Major > Fix For: 4.0.0 > > Attachments: HIVE-21449.1.patch, HIVE-21449.2.patch, > HIVE-21449.3.patch, HIVE-21449.4.patch, HIVE-21449.5.patch, > HIVE-21449.5.patch, HIVE-21449.6.patch > > -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Commented] (HIVE-21975) Fix incremental compilation
[ https://issues.apache.org/jira/browse/HIVE-21975?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16937692#comment-16937692 ] Zoltan Haindrich commented on HIVE-21975: - [~scarlin] could you please attach the patch file here in the jira; so that hiveqa could run on it? > Fix incremental compilation > --- > > Key: HIVE-21975 > URL: https://issues.apache.org/jira/browse/HIVE-21975 > Project: Hive > Issue Type: Bug >Reporter: Zoltan Haindrich >Assignee: Steve Carlin >Priority: Major > Labels: pull-request-available > Attachments: HIVE-21975.1.patch, HIVE-21975.2.patch, HIVE-21975.patch > > Time Spent: 10m > Remaining Estimate: 0h > > we have an incremental compilation issue around SA ; mostly because of "? > extends Serializable" > it could be reproduced with: > {code} > git clean -dfx > mvn install -pl ql -am -DskipTests > touch `find . -name Sema*A*java` `find . -name Task*Factory.java` > mvn install -pl ql -DskipTests > {code} > error is: > {code} > [ERROR] Failed to execute goal > org.apache.maven.plugins:maven-compiler-plugin:3.6.1:compile > (default-compile) on project hive-exec: Compilation failure: Compilation > failure: > [ERROR] > /mnt/work/hwx/hive/master/ql/src/java/org/apache/hadoop/hive/ql/parse/SemanticAnalyzer.java:[12573,60] > incompatible types: java.util.List extends java.io.Serializable>> cannot be converted to > java.util.List> > [ERROR] > /mnt/work/hwx/hive/master/ql/src/java/org/apache/hadoop/hive/ql/parse/SemanticAnalyzer.java:[15187,49] > incompatible types: java.util.List> > cannot be converted to java.util.List extends java.io.Serializable>> > {code} -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Commented] (HIVE-22191) Simplify SemanticAnalyzer by removing unused code
[ https://issues.apache.org/jira/browse/HIVE-22191?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16937682#comment-16937682 ] Hive QA commented on HIVE-22191: Here are the results of testing the latest attachment: https://issues.apache.org/jira/secure/attachment/12981301/HIVE-22191.5.patch {color:red}ERROR:{color} -1 due to no test(s) being added or modified. {color:red}ERROR:{color} -1 due to 1 failed/errored test(s), 17007 tests executed *Failed tests:* {noformat} org.apache.hadoop.hive.llap.cache.TestBuddyAllocator.testMTT[2] (batchId=363) {noformat} Test results: https://builds.apache.org/job/PreCommit-HIVE-Build/18720/testReport Console output: https://builds.apache.org/job/PreCommit-HIVE-Build/18720/console Test logs: http://104.198.109.242/logs/PreCommit-HIVE-Build-18720/ Messages: {noformat} Executing org.apache.hive.ptest.execution.TestCheckPhase Executing org.apache.hive.ptest.execution.PrepPhase Executing org.apache.hive.ptest.execution.YetusPhase Executing org.apache.hive.ptest.execution.ExecutionPhase Executing org.apache.hive.ptest.execution.ReportingPhase Tests exited with: TestsFailedException: 1 tests failed {noformat} This message is automatically generated. ATTACHMENT ID: 12981301 - PreCommit-HIVE-Build > Simplify SemanticAnalyzer by removing unused code > - > > Key: HIVE-22191 > URL: https://issues.apache.org/jira/browse/HIVE-22191 > Project: Hive > Issue Type: Task > Components: Hive >Reporter: Akos Dombi >Assignee: Akos Dombi >Priority: Major > Attachments: HIVE-22191.2.patch, HIVE-22191.3.patch, > HIVE-22191.4.patch, HIVE-22191.5.patch, HIVE-22191.patch > > > Simplify {{SemanticAnalyzer}} by: > - Remove dead code > - Simplify returning statements > - Use interfaces types for parameters/fields/variables where it is > straightforward to migrate > - Make visibility stricter where it is possible > - Check logging to use parametrised logging > - Removing unnecessary keywords (e.g.: {{static}}) > - Some code part could be simplified by using Java 8 features > I think this is crucial step as this class already contains 15000+ lines of > code which is screaming for splitting into more reasonable classes. -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Commented] (HIVE-22239) Scale data size using column value ranges
[ https://issues.apache.org/jira/browse/HIVE-22239?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16937680#comment-16937680 ] Zoltan Haindrich commented on HIVE-22239: - I think it would be good to have a feature toggle for this - because if the distribution is not uniform; it might get into trouble > Scale data size using column value ranges > - > > Key: HIVE-22239 > URL: https://issues.apache.org/jira/browse/HIVE-22239 > Project: Hive > Issue Type: Improvement > Components: Physical Optimizer >Reporter: Jesus Camacho Rodriguez >Assignee: Jesus Camacho Rodriguez >Priority: Major > Labels: pull-request-available > Attachments: HIVE-22239.patch > > Time Spent: 10m > Remaining Estimate: 0h > > Currently, min/max values for columns are only used to determine whether a > certain range filter falls out of range and thus filters all rows or none at > all. If it does not, we just use a heuristic that the condition will filter > 1/3 of the input rows. Instead of using that heuristic, we can use another > one that assumes that data will be uniformly distributed across that range, > and calculate the selectivity for the condition accordingly. > This patch also includes the propagation of min/max column values from > statistics to the optimizer for timestamp type. -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Updated] (HIVE-22243) Align Apache Thrift version to 0.9.3-1 in standalone-metastore as well
[ https://issues.apache.org/jira/browse/HIVE-22243?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] David Lavati updated HIVE-22243: Attachment: HIVE-22243.patch Status: Patch Available (was: In Progress) > Align Apache Thrift version to 0.9.3-1 in standalone-metastore as well > -- > > Key: HIVE-22243 > URL: https://issues.apache.org/jira/browse/HIVE-22243 > Project: Hive > Issue Type: Bug >Reporter: David Lavati >Assignee: David Lavati >Priority: Major > Attachments: HIVE-22243.patch > > > Thrift was bumped to 0.9.3-1 in HIVE-21173, but standalone-metastore was left > out of this. > Thanks for pointing this out [~ashutosh.bapat]! -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Assigned] (HIVE-22243) Align Apache Thrift version to 0.9.3-1 in standalone-metastore as well
[ https://issues.apache.org/jira/browse/HIVE-22243?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] David Lavati reassigned HIVE-22243: --- > Align Apache Thrift version to 0.9.3-1 in standalone-metastore as well > -- > > Key: HIVE-22243 > URL: https://issues.apache.org/jira/browse/HIVE-22243 > Project: Hive > Issue Type: Bug >Reporter: David Lavati >Assignee: David Lavati >Priority: Major > > Thrift was bumped to 0.9.3-1 in HIVE-21173, but standalone-metastore was left > out of this. > Thanks for pointing this out [~ashutosh.bapat]! -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Work started] (HIVE-22243) Align Apache Thrift version to 0.9.3-1 in standalone-metastore as well
[ https://issues.apache.org/jira/browse/HIVE-22243?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Work on HIVE-22243 started by David Lavati. --- > Align Apache Thrift version to 0.9.3-1 in standalone-metastore as well > -- > > Key: HIVE-22243 > URL: https://issues.apache.org/jira/browse/HIVE-22243 > Project: Hive > Issue Type: Bug >Reporter: David Lavati >Assignee: David Lavati >Priority: Major > > Thrift was bumped to 0.9.3-1 in HIVE-21173, but standalone-metastore was left > out of this. > Thanks for pointing this out [~ashutosh.bapat]! -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Commented] (HIVE-22191) Simplify SemanticAnalyzer by removing unused code
[ https://issues.apache.org/jira/browse/HIVE-22191?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16937642#comment-16937642 ] Hive QA commented on HIVE-22191: | (/) *{color:green}+1 overall{color}* | \\ \\ || Vote || Subsystem || Runtime || Comment || || || || || {color:brown} Prechecks {color} || | {color:green}+1{color} | {color:green} @author {color} | {color:green} 0m 0s{color} | {color:green} The patch does not contain any @author tags. {color} | || || || || {color:brown} master Compile Tests {color} || | {color:green}+1{color} | {color:green} mvninstall {color} | {color:green} 8m 20s{color} | {color:green} master passed {color} | | {color:green}+1{color} | {color:green} compile {color} | {color:green} 1m 1s{color} | {color:green} master passed {color} | | {color:green}+1{color} | {color:green} checkstyle {color} | {color:green} 0m 40s{color} | {color:green} master passed {color} | | {color:blue}0{color} | {color:blue} findbugs {color} | {color:blue} 3m 58s{color} | {color:blue} ql in master has 1567 extant Findbugs warnings. {color} | | {color:green}+1{color} | {color:green} javadoc {color} | {color:green} 0m 55s{color} | {color:green} master passed {color} | || || || || {color:brown} Patch Compile Tests {color} || | {color:green}+1{color} | {color:green} mvninstall {color} | {color:green} 1m 22s{color} | {color:green} the patch passed {color} | | {color:green}+1{color} | {color:green} compile {color} | {color:green} 1m 3s{color} | {color:green} the patch passed {color} | | {color:green}+1{color} | {color:green} javac {color} | {color:green} 1m 3s{color} | {color:green} the patch passed {color} | | {color:green}+1{color} | {color:green} checkstyle {color} | {color:green} 0m 43s{color} | {color:green} ql: The patch generated 0 new + 526 unchanged - 38 fixed = 526 total (was 564) {color} | | {color:green}+1{color} | {color:green} whitespace {color} | {color:green} 0m 0s{color} | {color:green} The patch has no whitespace issues. {color} | | {color:green}+1{color} | {color:green} findbugs {color} | {color:green} 4m 2s{color} | {color:green} ql generated 0 new + 1551 unchanged - 16 fixed = 1551 total (was 1567) {color} | | {color:green}+1{color} | {color:green} javadoc {color} | {color:green} 0m 55s{color} | {color:green} the patch passed {color} | || || || || {color:brown} Other Tests {color} || | {color:green}+1{color} | {color:green} asflicense {color} | {color:green} 0m 13s{color} | {color:green} The patch does not generate ASF License warnings. {color} | | {color:black}{color} | {color:black} {color} | {color:black} 23m 43s{color} | {color:black} {color} | \\ \\ || Subsystem || Report/Notes || | Optional Tests | asflicense javac javadoc findbugs checkstyle compile | | uname | Linux hiveptest-server-upstream 3.16.0-4-amd64 #1 SMP Debian 3.16.43-2+deb8u5 (2017-09-19) x86_64 GNU/Linux | | Build tool | maven | | Personality | /data/hiveptest/working/yetus_PreCommit-HIVE-Build-18720/dev-support/hive-personality.sh | | git revision | master / d6668c7 | | Default Java | 1.8.0_111 | | findbugs | v3.0.1 | | modules | C: ql U: ql | | Console output | http://104.198.109.242/logs//PreCommit-HIVE-Build-18720/yetus.txt | | Powered by | Apache Yetushttp://yetus.apache.org | This message was automatically generated. > Simplify SemanticAnalyzer by removing unused code > - > > Key: HIVE-22191 > URL: https://issues.apache.org/jira/browse/HIVE-22191 > Project: Hive > Issue Type: Task > Components: Hive >Reporter: Akos Dombi >Assignee: Akos Dombi >Priority: Major > Attachments: HIVE-22191.2.patch, HIVE-22191.3.patch, > HIVE-22191.4.patch, HIVE-22191.5.patch, HIVE-22191.patch > > > Simplify {{SemanticAnalyzer}} by: > - Remove dead code > - Simplify returning statements > - Use interfaces types for parameters/fields/variables where it is > straightforward to migrate > - Make visibility stricter where it is possible > - Check logging to use parametrised logging > - Removing unnecessary keywords (e.g.: {{static}}) > - Some code part could be simplified by using Java 8 features > I think this is crucial step as this class already contains 15000+ lines of > code which is screaming for splitting into more reasonable classes. -- This message was sent by Atlassian Jira (v8.3.4#803005)