[jira] [Commented] (HIVE-21231) HiveJoinAddNotNullRule support for range predicates
[ https://issues.apache.org/jira/browse/HIVE-21231?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16812371#comment-16812371 ] Hive QA commented on HIVE-21231: Here are the results of testing the latest attachment: https://issues.apache.org/jira/secure/attachment/12965162/HIVE-21231.14.patch {color:green}SUCCESS:{color} +1 due to 1 test(s) being added or modified. {color:green}SUCCESS:{color} +1 due to 15894 tests passed Test results: https://builds.apache.org/job/PreCommit-HIVE-Build/16890/testReport Console output: https://builds.apache.org/job/PreCommit-HIVE-Build/16890/console Test logs: http://104.198.109.242/logs/PreCommit-HIVE-Build-16890/ Messages: {noformat} Executing org.apache.hive.ptest.execution.TestCheckPhase Executing org.apache.hive.ptest.execution.PrepPhase Executing org.apache.hive.ptest.execution.YetusPhase Executing org.apache.hive.ptest.execution.ExecutionPhase Executing org.apache.hive.ptest.execution.ReportingPhase {noformat} This message is automatically generated. ATTACHMENT ID: 12965162 - PreCommit-HIVE-Build > HiveJoinAddNotNullRule support for range predicates > --- > > Key: HIVE-21231 > URL: https://issues.apache.org/jira/browse/HIVE-21231 > Project: Hive > Issue Type: Improvement > Components: CBO >Reporter: Jesus Camacho Rodriguez >Assignee: Miklos Gergely >Priority: Major > Labels: newbie, pull-request-available > Attachments: HIVE-21231.01.patch, HIVE-21231.02.patch, > HIVE-21231.03.patch, HIVE-21231.04.patch, HIVE-21231.05.patch, > HIVE-21231.06.patch, HIVE-21231.07.patch, HIVE-21231.08.patch, > HIVE-21231.09.patch, HIVE-21231.10.patch, HIVE-21231.11.patch, > HIVE-21231.12.patch, HIVE-21231.13.patch, HIVE-21231.14.patch > > Time Spent: 10m > Remaining Estimate: 0h > > For instance, given the following query: > {code:sql} > SELECT t0.col0, t0.col1 > FROM > ( > SELECT col0, col1 FROM tab > ) AS t0 > INNER JOIN > ( > SELECT col0, col1 FROM tab > ) AS t1 > ON t0.col0 < t1.col0 AND t0.col1 > t1.col1 > {code} > we could still infer that col0 and col1 cannot be null for any of the inputs. > Currently we do not. -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[jira] [Commented] (HIVE-21231) HiveJoinAddNotNullRule support for range predicates
[ https://issues.apache.org/jira/browse/HIVE-21231?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16812351#comment-16812351 ] Hive QA commented on HIVE-21231: | (/) *{color:green}+1 overall{color}* | \\ \\ || Vote || Subsystem || Runtime || Comment || || || || || {color:brown} Prechecks {color} || | {color:green}+1{color} | {color:green} @author {color} | {color:green} 0m 0s{color} | {color:green} The patch does not contain any @author tags. {color} | || || || || {color:brown} master Compile Tests {color} || | {color:green}+1{color} | {color:green} mvninstall {color} | {color:green} 8m 30s{color} | {color:green} master passed {color} | | {color:green}+1{color} | {color:green} compile {color} | {color:green} 1m 6s{color} | {color:green} master passed {color} | | {color:green}+1{color} | {color:green} checkstyle {color} | {color:green} 0m 41s{color} | {color:green} master passed {color} | | {color:blue}0{color} | {color:blue} findbugs {color} | {color:blue} 4m 11s{color} | {color:blue} ql in master has 2258 extant Findbugs warnings. {color} | | {color:green}+1{color} | {color:green} javadoc {color} | {color:green} 0m 59s{color} | {color:green} master passed {color} | || || || || {color:brown} Patch Compile Tests {color} || | {color:green}+1{color} | {color:green} mvninstall {color} | {color:green} 1m 27s{color} | {color:green} the patch passed {color} | | {color:green}+1{color} | {color:green} compile {color} | {color:green} 1m 6s{color} | {color:green} the patch passed {color} | | {color:green}+1{color} | {color:green} javac {color} | {color:green} 1m 6s{color} | {color:green} the patch passed {color} | | {color:green}+1{color} | {color:green} checkstyle {color} | {color:green} 0m 42s{color} | {color:green} ql: The patch generated 0 new + 16 unchanged - 2 fixed = 16 total (was 18) {color} | | {color:green}+1{color} | {color:green} whitespace {color} | {color:green} 0m 0s{color} | {color:green} The patch has no whitespace issues. {color} | | {color:green}+1{color} | {color:green} findbugs {color} | {color:green} 4m 16s{color} | {color:green} the patch passed {color} | | {color:green}+1{color} | {color:green} javadoc {color} | {color:green} 1m 1s{color} | {color:green} the patch passed {color} | || || || || {color:brown} Other Tests {color} || | {color:green}+1{color} | {color:green} asflicense {color} | {color:green} 0m 14s{color} | {color:green} The patch does not generate ASF License warnings. {color} | | {color:black}{color} | {color:black} {color} | {color:black} 25m 0s{color} | {color:black} {color} | \\ \\ || Subsystem || Report/Notes || | Optional Tests | asflicense javac javadoc findbugs checkstyle compile | | uname | Linux hiveptest-server-upstream 3.16.0-4-amd64 #1 SMP Debian 3.16.43-2+deb8u5 (2017-09-19) x86_64 GNU/Linux | | Build tool | maven | | Personality | /data/hiveptest/working/yetus_PreCommit-HIVE-Build-16890/dev-support/hive-personality.sh | | git revision | master / bf6a610 | | Default Java | 1.8.0_111 | | findbugs | v3.0.0 | | modules | C: ql U: ql | | Console output | http://104.198.109.242/logs//PreCommit-HIVE-Build-16890/yetus.txt | | Powered by | Apache Yetushttp://yetus.apache.org | This message was automatically generated. > HiveJoinAddNotNullRule support for range predicates > --- > > Key: HIVE-21231 > URL: https://issues.apache.org/jira/browse/HIVE-21231 > Project: Hive > Issue Type: Improvement > Components: CBO >Reporter: Jesus Camacho Rodriguez >Assignee: Miklos Gergely >Priority: Major > Labels: newbie, pull-request-available > Attachments: HIVE-21231.01.patch, HIVE-21231.02.patch, > HIVE-21231.03.patch, HIVE-21231.04.patch, HIVE-21231.05.patch, > HIVE-21231.06.patch, HIVE-21231.07.patch, HIVE-21231.08.patch, > HIVE-21231.09.patch, HIVE-21231.10.patch, HIVE-21231.11.patch, > HIVE-21231.12.patch, HIVE-21231.13.patch, HIVE-21231.14.patch > > Time Spent: 10m > Remaining Estimate: 0h > > For instance, given the following query: > {code:sql} > SELECT t0.col0, t0.col1 > FROM > ( > SELECT col0, col1 FROM tab > ) AS t0 > INNER JOIN > ( > SELECT col0, col1 FROM tab > ) AS t1 > ON t0.col0 < t1.col0 AND t0.col1 > t1.col1 > {code} > we could still infer that col0 and col1 cannot be null for any of the inputs. > Currently we do not. -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[jira] [Commented] (HIVE-21231) HiveJoinAddNotNullRule support for range predicates
[ https://issues.apache.org/jira/browse/HIVE-21231?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16812007#comment-16812007 ] Hive QA commented on HIVE-21231: Here are the results of testing the latest attachment: https://issues.apache.org/jira/secure/attachment/12965134/HIVE-21231.13.patch {color:red}ERROR:{color} -1 due to build exiting with an error Test results: https://builds.apache.org/job/PreCommit-HIVE-Build/16883/testReport Console output: https://builds.apache.org/job/PreCommit-HIVE-Build/16883/console Test logs: http://104.198.109.242/logs/PreCommit-HIVE-Build-16883/ Messages: {noformat} Executing org.apache.hive.ptest.execution.TestCheckPhase Tests exited with: Exception: Patch URL https://issues.apache.org/jira/secure/attachment/12965134/HIVE-21231.13.patch was found in seen patch url's cache and a test was probably run already on it. Aborting... {noformat} This message is automatically generated. ATTACHMENT ID: 12965134 - PreCommit-HIVE-Build > HiveJoinAddNotNullRule support for range predicates > --- > > Key: HIVE-21231 > URL: https://issues.apache.org/jira/browse/HIVE-21231 > Project: Hive > Issue Type: Improvement > Components: CBO >Reporter: Jesus Camacho Rodriguez >Assignee: Miklos Gergely >Priority: Major > Labels: newbie, pull-request-available > Attachments: HIVE-21231.01.patch, HIVE-21231.02.patch, > HIVE-21231.03.patch, HIVE-21231.04.patch, HIVE-21231.05.patch, > HIVE-21231.06.patch, HIVE-21231.07.patch, HIVE-21231.08.patch, > HIVE-21231.09.patch, HIVE-21231.10.patch, HIVE-21231.11.patch, > HIVE-21231.12.patch, HIVE-21231.13.patch > > Time Spent: 10m > Remaining Estimate: 0h > > For instance, given the following query: > {code:sql} > SELECT t0.col0, t0.col1 > FROM > ( > SELECT col0, col1 FROM tab > ) AS t0 > INNER JOIN > ( > SELECT col0, col1 FROM tab > ) AS t1 > ON t0.col0 < t1.col0 AND t0.col1 > t1.col1 > {code} > we could still infer that col0 and col1 cannot be null for any of the inputs. > Currently we do not. -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[jira] [Commented] (HIVE-21231) HiveJoinAddNotNullRule support for range predicates
[ https://issues.apache.org/jira/browse/HIVE-21231?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16812006#comment-16812006 ] Hive QA commented on HIVE-21231: Here are the results of testing the latest attachment: https://issues.apache.org/jira/secure/attachment/12965134/HIVE-21231.13.patch {color:green}SUCCESS:{color} +1 due to 1 test(s) being added or modified. {color:red}ERROR:{color} -1 due to 1 failed/errored test(s), 15887 tests executed *Failed tests:* {noformat} org.apache.hadoop.hive.ql.parse.TestReplicationWithTableMigrationEx.org.apache.hadoop.hive.ql.parse.TestReplicationWithTableMigrationEx (batchId=252) {noformat} Test results: https://builds.apache.org/job/PreCommit-HIVE-Build/16882/testReport Console output: https://builds.apache.org/job/PreCommit-HIVE-Build/16882/console Test logs: http://104.198.109.242/logs/PreCommit-HIVE-Build-16882/ Messages: {noformat} Executing org.apache.hive.ptest.execution.TestCheckPhase Executing org.apache.hive.ptest.execution.PrepPhase Executing org.apache.hive.ptest.execution.YetusPhase Executing org.apache.hive.ptest.execution.ExecutionPhase Executing org.apache.hive.ptest.execution.ReportingPhase Tests exited with: TestsFailedException: 1 tests failed {noformat} This message is automatically generated. ATTACHMENT ID: 12965134 - PreCommit-HIVE-Build > HiveJoinAddNotNullRule support for range predicates > --- > > Key: HIVE-21231 > URL: https://issues.apache.org/jira/browse/HIVE-21231 > Project: Hive > Issue Type: Improvement > Components: CBO >Reporter: Jesus Camacho Rodriguez >Assignee: Miklos Gergely >Priority: Major > Labels: newbie, pull-request-available > Attachments: HIVE-21231.01.patch, HIVE-21231.02.patch, > HIVE-21231.03.patch, HIVE-21231.04.patch, HIVE-21231.05.patch, > HIVE-21231.06.patch, HIVE-21231.07.patch, HIVE-21231.08.patch, > HIVE-21231.09.patch, HIVE-21231.10.patch, HIVE-21231.11.patch, > HIVE-21231.12.patch, HIVE-21231.13.patch > > Time Spent: 10m > Remaining Estimate: 0h > > For instance, given the following query: > {code:sql} > SELECT t0.col0, t0.col1 > FROM > ( > SELECT col0, col1 FROM tab > ) AS t0 > INNER JOIN > ( > SELECT col0, col1 FROM tab > ) AS t1 > ON t0.col0 < t1.col0 AND t0.col1 > t1.col1 > {code} > we could still infer that col0 and col1 cannot be null for any of the inputs. > Currently we do not. -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[jira] [Commented] (HIVE-21231) HiveJoinAddNotNullRule support for range predicates
[ https://issues.apache.org/jira/browse/HIVE-21231?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16811992#comment-16811992 ] Hive QA commented on HIVE-21231: | (/) *{color:green}+1 overall{color}* | \\ \\ || Vote || Subsystem || Runtime || Comment || || || || || {color:brown} Prechecks {color} || | {color:green}+1{color} | {color:green} @author {color} | {color:green} 0m 0s{color} | {color:green} The patch does not contain any @author tags. {color} | || || || || {color:brown} master Compile Tests {color} || | {color:green}+1{color} | {color:green} mvninstall {color} | {color:green} 8m 26s{color} | {color:green} master passed {color} | | {color:green}+1{color} | {color:green} compile {color} | {color:green} 1m 9s{color} | {color:green} master passed {color} | | {color:green}+1{color} | {color:green} checkstyle {color} | {color:green} 0m 43s{color} | {color:green} master passed {color} | | {color:blue}0{color} | {color:blue} findbugs {color} | {color:blue} 4m 1s{color} | {color:blue} ql in master has 2258 extant Findbugs warnings. {color} | | {color:green}+1{color} | {color:green} javadoc {color} | {color:green} 0m 59s{color} | {color:green} master passed {color} | || || || || {color:brown} Patch Compile Tests {color} || | {color:green}+1{color} | {color:green} mvninstall {color} | {color:green} 1m 27s{color} | {color:green} the patch passed {color} | | {color:green}+1{color} | {color:green} compile {color} | {color:green} 1m 8s{color} | {color:green} the patch passed {color} | | {color:green}+1{color} | {color:green} javac {color} | {color:green} 1m 8s{color} | {color:green} the patch passed {color} | | {color:green}+1{color} | {color:green} checkstyle {color} | {color:green} 0m 41s{color} | {color:green} ql: The patch generated 0 new + 16 unchanged - 2 fixed = 16 total (was 18) {color} | | {color:green}+1{color} | {color:green} whitespace {color} | {color:green} 0m 0s{color} | {color:green} The patch has no whitespace issues. {color} | | {color:green}+1{color} | {color:green} findbugs {color} | {color:green} 4m 23s{color} | {color:green} the patch passed {color} | | {color:green}+1{color} | {color:green} javadoc {color} | {color:green} 0m 58s{color} | {color:green} the patch passed {color} | || || || || {color:brown} Other Tests {color} || | {color:green}+1{color} | {color:green} asflicense {color} | {color:green} 0m 14s{color} | {color:green} The patch does not generate ASF License warnings. {color} | | {color:black}{color} | {color:black} {color} | {color:black} 24m 55s{color} | {color:black} {color} | \\ \\ || Subsystem || Report/Notes || | Optional Tests | asflicense javac javadoc findbugs checkstyle compile | | uname | Linux hiveptest-server-upstream 3.16.0-4-amd64 #1 SMP Debian 3.16.43-2+deb8u5 (2017-09-19) x86_64 GNU/Linux | | Build tool | maven | | Personality | /data/hiveptest/working/yetus_PreCommit-HIVE-Build-16882/dev-support/hive-personality.sh | | git revision | master / baae1aa | | Default Java | 1.8.0_111 | | findbugs | v3.0.0 | | modules | C: ql U: ql | | Console output | http://104.198.109.242/logs//PreCommit-HIVE-Build-16882/yetus.txt | | Powered by | Apache Yetushttp://yetus.apache.org | This message was automatically generated. > HiveJoinAddNotNullRule support for range predicates > --- > > Key: HIVE-21231 > URL: https://issues.apache.org/jira/browse/HIVE-21231 > Project: Hive > Issue Type: Improvement > Components: CBO >Reporter: Jesus Camacho Rodriguez >Assignee: Miklos Gergely >Priority: Major > Labels: newbie, pull-request-available > Attachments: HIVE-21231.01.patch, HIVE-21231.02.patch, > HIVE-21231.03.patch, HIVE-21231.04.patch, HIVE-21231.05.patch, > HIVE-21231.06.patch, HIVE-21231.07.patch, HIVE-21231.08.patch, > HIVE-21231.09.patch, HIVE-21231.10.patch, HIVE-21231.11.patch, > HIVE-21231.12.patch, HIVE-21231.13.patch > > Time Spent: 10m > Remaining Estimate: 0h > > For instance, given the following query: > {code:sql} > SELECT t0.col0, t0.col1 > FROM > ( > SELECT col0, col1 FROM tab > ) AS t0 > INNER JOIN > ( > SELECT col0, col1 FROM tab > ) AS t1 > ON t0.col0 < t1.col0 AND t0.col1 > t1.col1 > {code} > we could still infer that col0 and col1 cannot be null for any of the inputs. > Currently we do not. -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[jira] [Commented] (HIVE-21231) HiveJoinAddNotNullRule support for range predicates
[ https://issues.apache.org/jira/browse/HIVE-21231?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16811890#comment-16811890 ] Hive QA commented on HIVE-21231: Here are the results of testing the latest attachment: https://issues.apache.org/jira/secure/attachment/12965088/HIVE-21231.12.patch {color:green}SUCCESS:{color} +1 due to 1 test(s) being added or modified. {color:red}ERROR:{color} -1 due to 2 failed/errored test(s), 15862 tests executed *Failed tests:* {noformat} TestDataSourceProviderFactory - did not produce a TEST-*.xml file (likely timed out) (batchId=230) TestObjectStore - did not produce a TEST-*.xml file (likely timed out) (batchId=230) {noformat} Test results: https://builds.apache.org/job/PreCommit-HIVE-Build/16879/testReport Console output: https://builds.apache.org/job/PreCommit-HIVE-Build/16879/console Test logs: http://104.198.109.242/logs/PreCommit-HIVE-Build-16879/ Messages: {noformat} Executing org.apache.hive.ptest.execution.TestCheckPhase Executing org.apache.hive.ptest.execution.PrepPhase Executing org.apache.hive.ptest.execution.YetusPhase Executing org.apache.hive.ptest.execution.ExecutionPhase Executing org.apache.hive.ptest.execution.ReportingPhase Tests exited with: TestsFailedException: 2 tests failed {noformat} This message is automatically generated. ATTACHMENT ID: 12965088 - PreCommit-HIVE-Build > HiveJoinAddNotNullRule support for range predicates > --- > > Key: HIVE-21231 > URL: https://issues.apache.org/jira/browse/HIVE-21231 > Project: Hive > Issue Type: Improvement > Components: CBO >Reporter: Jesus Camacho Rodriguez >Assignee: Miklos Gergely >Priority: Major > Labels: newbie, pull-request-available > Attachments: HIVE-21231.01.patch, HIVE-21231.02.patch, > HIVE-21231.03.patch, HIVE-21231.04.patch, HIVE-21231.05.patch, > HIVE-21231.06.patch, HIVE-21231.07.patch, HIVE-21231.08.patch, > HIVE-21231.09.patch, HIVE-21231.10.patch, HIVE-21231.11.patch, > HIVE-21231.12.patch > > Time Spent: 10m > Remaining Estimate: 0h > > For instance, given the following query: > {code:sql} > SELECT t0.col0, t0.col1 > FROM > ( > SELECT col0, col1 FROM tab > ) AS t0 > INNER JOIN > ( > SELECT col0, col1 FROM tab > ) AS t1 > ON t0.col0 < t1.col0 AND t0.col1 > t1.col1 > {code} > we could still infer that col0 and col1 cannot be null for any of the inputs. > Currently we do not. -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[jira] [Commented] (HIVE-21231) HiveJoinAddNotNullRule support for range predicates
[ https://issues.apache.org/jira/browse/HIVE-21231?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16811876#comment-16811876 ] Hive QA commented on HIVE-21231: | (/) *{color:green}+1 overall{color}* | \\ \\ || Vote || Subsystem || Runtime || Comment || || || || || {color:brown} Prechecks {color} || | {color:green}+1{color} | {color:green} @author {color} | {color:green} 0m 0s{color} | {color:green} The patch does not contain any @author tags. {color} | || || || || {color:brown} master Compile Tests {color} || | {color:green}+1{color} | {color:green} mvninstall {color} | {color:green} 8m 40s{color} | {color:green} master passed {color} | | {color:green}+1{color} | {color:green} compile {color} | {color:green} 1m 6s{color} | {color:green} master passed {color} | | {color:green}+1{color} | {color:green} checkstyle {color} | {color:green} 0m 40s{color} | {color:green} master passed {color} | | {color:blue}0{color} | {color:blue} findbugs {color} | {color:blue} 4m 2s{color} | {color:blue} ql in master has 2258 extant Findbugs warnings. {color} | | {color:green}+1{color} | {color:green} javadoc {color} | {color:green} 1m 1s{color} | {color:green} master passed {color} | || || || || {color:brown} Patch Compile Tests {color} || | {color:green}+1{color} | {color:green} mvninstall {color} | {color:green} 1m 28s{color} | {color:green} the patch passed {color} | | {color:green}+1{color} | {color:green} compile {color} | {color:green} 1m 8s{color} | {color:green} the patch passed {color} | | {color:green}+1{color} | {color:green} javac {color} | {color:green} 1m 8s{color} | {color:green} the patch passed {color} | | {color:green}+1{color} | {color:green} checkstyle {color} | {color:green} 0m 42s{color} | {color:green} ql: The patch generated 0 new + 16 unchanged - 2 fixed = 16 total (was 18) {color} | | {color:green}+1{color} | {color:green} whitespace {color} | {color:green} 0m 0s{color} | {color:green} The patch has no whitespace issues. {color} | | {color:green}+1{color} | {color:green} findbugs {color} | {color:green} 4m 15s{color} | {color:green} the patch passed {color} | | {color:green}+1{color} | {color:green} javadoc {color} | {color:green} 0m 57s{color} | {color:green} the patch passed {color} | || || || || {color:brown} Other Tests {color} || | {color:green}+1{color} | {color:green} asflicense {color} | {color:green} 0m 14s{color} | {color:green} The patch does not generate ASF License warnings. {color} | | {color:black}{color} | {color:black} {color} | {color:black} 25m 16s{color} | {color:black} {color} | \\ \\ || Subsystem || Report/Notes || | Optional Tests | asflicense javac javadoc findbugs checkstyle compile | | uname | Linux hiveptest-server-upstream 3.16.0-4-amd64 #1 SMP Debian 3.16.43-2+deb8u5 (2017-09-19) x86_64 GNU/Linux | | Build tool | maven | | Personality | /data/hiveptest/working/yetus_PreCommit-HIVE-Build-16879/dev-support/hive-personality.sh | | git revision | master / baae1aa | | Default Java | 1.8.0_111 | | findbugs | v3.0.0 | | modules | C: ql U: ql | | Console output | http://104.198.109.242/logs//PreCommit-HIVE-Build-16879/yetus.txt | | Powered by | Apache Yetushttp://yetus.apache.org | This message was automatically generated. > HiveJoinAddNotNullRule support for range predicates > --- > > Key: HIVE-21231 > URL: https://issues.apache.org/jira/browse/HIVE-21231 > Project: Hive > Issue Type: Improvement > Components: CBO >Reporter: Jesus Camacho Rodriguez >Assignee: Miklos Gergely >Priority: Major > Labels: newbie, pull-request-available > Attachments: HIVE-21231.01.patch, HIVE-21231.02.patch, > HIVE-21231.03.patch, HIVE-21231.04.patch, HIVE-21231.05.patch, > HIVE-21231.06.patch, HIVE-21231.07.patch, HIVE-21231.08.patch, > HIVE-21231.09.patch, HIVE-21231.10.patch, HIVE-21231.11.patch, > HIVE-21231.12.patch > > Time Spent: 10m > Remaining Estimate: 0h > > For instance, given the following query: > {code:sql} > SELECT t0.col0, t0.col1 > FROM > ( > SELECT col0, col1 FROM tab > ) AS t0 > INNER JOIN > ( > SELECT col0, col1 FROM tab > ) AS t1 > ON t0.col0 < t1.col0 AND t0.col1 > t1.col1 > {code} > we could still infer that col0 and col1 cannot be null for any of the inputs. > Currently we do not. -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[jira] [Commented] (HIVE-21231) HiveJoinAddNotNullRule support for range predicates
[ https://issues.apache.org/jira/browse/HIVE-21231?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16811403#comment-16811403 ] Hive QA commented on HIVE-21231: Here are the results of testing the latest attachment: https://issues.apache.org/jira/secure/attachment/12964951/HIVE-21231.11.patch {color:red}ERROR:{color} -1 due to no test(s) being added or modified. {color:red}ERROR:{color} -1 due to 1 failed/errored test(s), 15893 tests executed *Failed tests:* {noformat} org.apache.hadoop.hive.ql.lockmgr.TestDbTxnManager2.testValidWriteIdListSnapshot (batchId=327) {noformat} Test results: https://builds.apache.org/job/PreCommit-HIVE-Build/16863/testReport Console output: https://builds.apache.org/job/PreCommit-HIVE-Build/16863/console Test logs: http://104.198.109.242/logs/PreCommit-HIVE-Build-16863/ Messages: {noformat} Executing org.apache.hive.ptest.execution.TestCheckPhase Executing org.apache.hive.ptest.execution.PrepPhase Executing org.apache.hive.ptest.execution.YetusPhase Executing org.apache.hive.ptest.execution.ExecutionPhase Executing org.apache.hive.ptest.execution.ReportingPhase Tests exited with: TestsFailedException: 1 tests failed {noformat} This message is automatically generated. ATTACHMENT ID: 12964951 - PreCommit-HIVE-Build > HiveJoinAddNotNullRule support for range predicates > --- > > Key: HIVE-21231 > URL: https://issues.apache.org/jira/browse/HIVE-21231 > Project: Hive > Issue Type: Improvement > Components: CBO >Reporter: Jesus Camacho Rodriguez >Assignee: Miklos Gergely >Priority: Major > Labels: newbie, pull-request-available > Attachments: HIVE-21231.01.patch, HIVE-21231.02.patch, > HIVE-21231.03.patch, HIVE-21231.04.patch, HIVE-21231.05.patch, > HIVE-21231.06.patch, HIVE-21231.07.patch, HIVE-21231.08.patch, > HIVE-21231.09.patch, HIVE-21231.10.patch, HIVE-21231.11.patch > > Time Spent: 10m > Remaining Estimate: 0h > > For instance, given the following query: > {code:sql} > SELECT t0.col0, t0.col1 > FROM > ( > SELECT col0, col1 FROM tab > ) AS t0 > INNER JOIN > ( > SELECT col0, col1 FROM tab > ) AS t1 > ON t0.col0 < t1.col0 AND t0.col1 > t1.col1 > {code} > we could still infer that col0 and col1 cannot be null for any of the inputs. > Currently we do not. -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[jira] [Commented] (HIVE-21231) HiveJoinAddNotNullRule support for range predicates
[ https://issues.apache.org/jira/browse/HIVE-21231?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16811396#comment-16811396 ] Hive QA commented on HIVE-21231: | (/) *{color:green}+1 overall{color}* | \\ \\ || Vote || Subsystem || Runtime || Comment || || || || || {color:brown} Prechecks {color} || | {color:green}+1{color} | {color:green} @author {color} | {color:green} 0m 0s{color} | {color:green} The patch does not contain any @author tags. {color} | || || || || {color:brown} master Compile Tests {color} || | {color:green}+1{color} | {color:green} mvninstall {color} | {color:green} 8m 30s{color} | {color:green} master passed {color} | | {color:green}+1{color} | {color:green} compile {color} | {color:green} 1m 9s{color} | {color:green} master passed {color} | | {color:green}+1{color} | {color:green} checkstyle {color} | {color:green} 0m 41s{color} | {color:green} master passed {color} | | {color:blue}0{color} | {color:blue} findbugs {color} | {color:blue} 4m 23s{color} | {color:blue} ql in master has 2258 extant Findbugs warnings. {color} | | {color:green}+1{color} | {color:green} javadoc {color} | {color:green} 1m 4s{color} | {color:green} master passed {color} | || || || || {color:brown} Patch Compile Tests {color} || | {color:green}+1{color} | {color:green} mvninstall {color} | {color:green} 1m 32s{color} | {color:green} the patch passed {color} | | {color:green}+1{color} | {color:green} compile {color} | {color:green} 1m 8s{color} | {color:green} the patch passed {color} | | {color:green}+1{color} | {color:green} javac {color} | {color:green} 1m 8s{color} | {color:green} the patch passed {color} | | {color:green}+1{color} | {color:green} checkstyle {color} | {color:green} 0m 41s{color} | {color:green} ql: The patch generated 0 new + 16 unchanged - 2 fixed = 16 total (was 18) {color} | | {color:green}+1{color} | {color:green} whitespace {color} | {color:green} 0m 0s{color} | {color:green} The patch has no whitespace issues. {color} | | {color:green}+1{color} | {color:green} findbugs {color} | {color:green} 4m 30s{color} | {color:green} the patch passed {color} | | {color:green}+1{color} | {color:green} javadoc {color} | {color:green} 1m 4s{color} | {color:green} the patch passed {color} | || || || || {color:brown} Other Tests {color} || | {color:green}+1{color} | {color:green} asflicense {color} | {color:green} 0m 13s{color} | {color:green} The patch does not generate ASF License warnings. {color} | | {color:black}{color} | {color:black} {color} | {color:black} 25m 48s{color} | {color:black} {color} | \\ \\ || Subsystem || Report/Notes || | Optional Tests | asflicense javac javadoc findbugs checkstyle compile | | uname | Linux hiveptest-server-upstream 3.16.0-4-amd64 #1 SMP Debian 3.16.43-2+deb8u5 (2017-09-19) x86_64 GNU/Linux | | Build tool | maven | | Personality | /data/hiveptest/working/yetus_PreCommit-HIVE-Build-16863/dev-support/hive-personality.sh | | git revision | master / baae1aa | | Default Java | 1.8.0_111 | | findbugs | v3.0.0 | | modules | C: ql U: ql | | Console output | http://104.198.109.242/logs//PreCommit-HIVE-Build-16863/yetus.txt | | Powered by | Apache Yetushttp://yetus.apache.org | This message was automatically generated. > HiveJoinAddNotNullRule support for range predicates > --- > > Key: HIVE-21231 > URL: https://issues.apache.org/jira/browse/HIVE-21231 > Project: Hive > Issue Type: Improvement > Components: CBO >Reporter: Jesus Camacho Rodriguez >Assignee: Miklos Gergely >Priority: Major > Labels: newbie, pull-request-available > Attachments: HIVE-21231.01.patch, HIVE-21231.02.patch, > HIVE-21231.03.patch, HIVE-21231.04.patch, HIVE-21231.05.patch, > HIVE-21231.06.patch, HIVE-21231.07.patch, HIVE-21231.08.patch, > HIVE-21231.09.patch, HIVE-21231.10.patch, HIVE-21231.11.patch > > Time Spent: 10m > Remaining Estimate: 0h > > For instance, given the following query: > {code:sql} > SELECT t0.col0, t0.col1 > FROM > ( > SELECT col0, col1 FROM tab > ) AS t0 > INNER JOIN > ( > SELECT col0, col1 FROM tab > ) AS t1 > ON t0.col0 < t1.col0 AND t0.col1 > t1.col1 > {code} > we could still infer that col0 and col1 cannot be null for any of the inputs. > Currently we do not. -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[jira] [Commented] (HIVE-21231) HiveJoinAddNotNullRule support for range predicates
[ https://issues.apache.org/jira/browse/HIVE-21231?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16809346#comment-16809346 ] Vineet Garg commented on HIVE-21231: HIVE-21572 has a patch to fix these regressions. Once this patch is pushed to master, I'll get HIVE-21572 in. > HiveJoinAddNotNullRule support for range predicates > --- > > Key: HIVE-21231 > URL: https://issues.apache.org/jira/browse/HIVE-21231 > Project: Hive > Issue Type: Improvement > Components: CBO >Reporter: Jesus Camacho Rodriguez >Assignee: Miklos Gergely >Priority: Major > Labels: newbie, pull-request-available > Attachments: HIVE-21231.01.patch, HIVE-21231.02.patch, > HIVE-21231.03.patch, HIVE-21231.04.patch, HIVE-21231.05.patch, > HIVE-21231.06.patch, HIVE-21231.07.patch, HIVE-21231.08.patch, > HIVE-21231.09.patch > > Time Spent: 10m > Remaining Estimate: 0h > > For instance, given the following query: > {code:sql} > SELECT t0.col0, t0.col1 > FROM > ( > SELECT col0, col1 FROM tab > ) AS t0 > INNER JOIN > ( > SELECT col0, col1 FROM tab > ) AS t1 > ON t0.col0 < t1.col0 AND t0.col1 > t1.col1 > {code} > we could still infer that col0 and col1 cannot be null for any of the inputs. > Currently we do not. -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[jira] [Commented] (HIVE-21231) HiveJoinAddNotNullRule support for range predicates
[ https://issues.apache.org/jira/browse/HIVE-21231?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16809315#comment-16809315 ] Vineet Garg commented on HIVE-21231: There are still some queries which are still regressing (queries have sq_count_check branch now) e.g. query44 and couple of queries in subquery_scalar I'll open a separate jira to fix it. +1 (pending tests) for this patch. > HiveJoinAddNotNullRule support for range predicates > --- > > Key: HIVE-21231 > URL: https://issues.apache.org/jira/browse/HIVE-21231 > Project: Hive > Issue Type: Improvement > Components: CBO >Reporter: Jesus Camacho Rodriguez >Assignee: Miklos Gergely >Priority: Major > Labels: newbie, pull-request-available > Attachments: HIVE-21231.01.patch, HIVE-21231.02.patch, > HIVE-21231.03.patch, HIVE-21231.04.patch, HIVE-21231.05.patch, > HIVE-21231.06.patch, HIVE-21231.07.patch, HIVE-21231.08.patch, > HIVE-21231.09.patch > > Time Spent: 10m > Remaining Estimate: 0h > > For instance, given the following query: > {code:sql} > SELECT t0.col0, t0.col1 > FROM > ( > SELECT col0, col1 FROM tab > ) AS t0 > INNER JOIN > ( > SELECT col0, col1 FROM tab > ) AS t1 > ON t0.col0 < t1.col0 AND t0.col1 > t1.col1 > {code} > we could still infer that col0 and col1 cannot be null for any of the inputs. > Currently we do not. -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[jira] [Commented] (HIVE-21231) HiveJoinAddNotNullRule support for range predicates
[ https://issues.apache.org/jira/browse/HIVE-21231?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16808469#comment-16808469 ] Miklos Gergely commented on HIVE-21231: --- [~vgarg] I've updated it. Wanted to wait for a clean build here, but the Precommit-HIVE-Build job seems to have some issue. Hopefully this is the final version. > HiveJoinAddNotNullRule support for range predicates > --- > > Key: HIVE-21231 > URL: https://issues.apache.org/jira/browse/HIVE-21231 > Project: Hive > Issue Type: Improvement > Components: CBO >Reporter: Jesus Camacho Rodriguez >Assignee: Miklos Gergely >Priority: Major > Labels: newbie, pull-request-available > Attachments: HIVE-21231.01.patch, HIVE-21231.02.patch, > HIVE-21231.03.patch, HIVE-21231.04.patch, HIVE-21231.05.patch, > HIVE-21231.06.patch, HIVE-21231.07.patch, HIVE-21231.08.patch, > HIVE-21231.09.patch > > Time Spent: 10m > Remaining Estimate: 0h > > For instance, given the following query: > {code:sql} > SELECT t0.col0, t0.col1 > FROM > ( > SELECT col0, col1 FROM tab > ) AS t0 > INNER JOIN > ( > SELECT col0, col1 FROM tab > ) AS t1 > ON t0.col0 < t1.col0 AND t0.col1 > t1.col1 > {code} > we could still infer that col0 and col1 cannot be null for any of the inputs. > Currently we do not. -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[jira] [Commented] (HIVE-21231) HiveJoinAddNotNullRule support for range predicates
[ https://issues.apache.org/jira/browse/HIVE-21231?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16808105#comment-16808105 ] Vineet Garg commented on HIVE-21231: [~mgergely] Can you update the pull request as well? > HiveJoinAddNotNullRule support for range predicates > --- > > Key: HIVE-21231 > URL: https://issues.apache.org/jira/browse/HIVE-21231 > Project: Hive > Issue Type: Improvement > Components: CBO >Reporter: Jesus Camacho Rodriguez >Assignee: Miklos Gergely >Priority: Major > Labels: newbie, pull-request-available > Attachments: HIVE-21231.01.patch, HIVE-21231.02.patch, > HIVE-21231.03.patch, HIVE-21231.04.patch, HIVE-21231.05.patch, > HIVE-21231.06.patch, HIVE-21231.07.patch > > Time Spent: 10m > Remaining Estimate: 0h > > For instance, given the following query: > {code:sql} > SELECT t0.col0, t0.col1 > FROM > ( > SELECT col0, col1 FROM tab > ) AS t0 > INNER JOIN > ( > SELECT col0, col1 FROM tab > ) AS t1 > ON t0.col0 < t1.col0 AND t0.col1 > t1.col1 > {code} > we could still infer that col0 and col1 cannot be null for any of the inputs. > Currently we do not. -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[jira] [Commented] (HIVE-21231) HiveJoinAddNotNullRule support for range predicates
[ https://issues.apache.org/jira/browse/HIVE-21231?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16807944#comment-16807944 ] Hive QA commented on HIVE-21231: Here are the results of testing the latest attachment: https://issues.apache.org/jira/secure/attachment/12964543/HIVE-21231.07.patch {color:red}ERROR:{color} -1 due to no test(s) being added or modified. {color:red}ERROR:{color} -1 due to 2 failed/errored test(s), 15892 tests executed *Failed tests:* {noformat} org.apache.hadoop.hive.cli.TestMiniLlapLocalCliDriver.testCliDriver[dynamic_semijoin_reduction] (batchId=172) org.apache.hadoop.hive.cli.TestMiniLlapLocalCliDriver.testCliDriver[transitive_not_null] (batchId=181) {noformat} Test results: https://builds.apache.org/job/PreCommit-HIVE-Build/16823/testReport Console output: https://builds.apache.org/job/PreCommit-HIVE-Build/16823/console Test logs: http://104.198.109.242/logs/PreCommit-HIVE-Build-16823/ Messages: {noformat} Executing org.apache.hive.ptest.execution.TestCheckPhase Executing org.apache.hive.ptest.execution.PrepPhase Executing org.apache.hive.ptest.execution.YetusPhase Executing org.apache.hive.ptest.execution.ExecutionPhase Executing org.apache.hive.ptest.execution.ReportingPhase Tests exited with: TestsFailedException: 2 tests failed {noformat} This message is automatically generated. ATTACHMENT ID: 12964543 - PreCommit-HIVE-Build > HiveJoinAddNotNullRule support for range predicates > --- > > Key: HIVE-21231 > URL: https://issues.apache.org/jira/browse/HIVE-21231 > Project: Hive > Issue Type: Improvement > Components: CBO >Reporter: Jesus Camacho Rodriguez >Assignee: Miklos Gergely >Priority: Major > Labels: newbie, pull-request-available > Attachments: HIVE-21231.01.patch, HIVE-21231.02.patch, > HIVE-21231.03.patch, HIVE-21231.04.patch, HIVE-21231.05.patch, > HIVE-21231.06.patch, HIVE-21231.07.patch > > Time Spent: 10m > Remaining Estimate: 0h > > For instance, given the following query: > {code:sql} > SELECT t0.col0, t0.col1 > FROM > ( > SELECT col0, col1 FROM tab > ) AS t0 > INNER JOIN > ( > SELECT col0, col1 FROM tab > ) AS t1 > ON t0.col0 < t1.col0 AND t0.col1 > t1.col1 > {code} > we could still infer that col0 and col1 cannot be null for any of the inputs. > Currently we do not. -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[jira] [Commented] (HIVE-21231) HiveJoinAddNotNullRule support for range predicates
[ https://issues.apache.org/jira/browse/HIVE-21231?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16807917#comment-16807917 ] Hive QA commented on HIVE-21231: | (/) *{color:green}+1 overall{color}* | \\ \\ || Vote || Subsystem || Runtime || Comment || || || || || {color:brown} Prechecks {color} || | {color:green}+1{color} | {color:green} @author {color} | {color:green} 0m 0s{color} | {color:green} The patch does not contain any @author tags. {color} | || || || || {color:brown} master Compile Tests {color} || | {color:green}+1{color} | {color:green} mvninstall {color} | {color:green} 9m 0s{color} | {color:green} master passed {color} | | {color:green}+1{color} | {color:green} compile {color} | {color:green} 1m 17s{color} | {color:green} master passed {color} | | {color:green}+1{color} | {color:green} checkstyle {color} | {color:green} 0m 43s{color} | {color:green} master passed {color} | | {color:blue}0{color} | {color:blue} findbugs {color} | {color:blue} 4m 16s{color} | {color:blue} ql in master has 2258 extant Findbugs warnings. {color} | | {color:green}+1{color} | {color:green} javadoc {color} | {color:green} 1m 4s{color} | {color:green} master passed {color} | || || || || {color:brown} Patch Compile Tests {color} || | {color:green}+1{color} | {color:green} mvninstall {color} | {color:green} 1m 38s{color} | {color:green} the patch passed {color} | | {color:green}+1{color} | {color:green} compile {color} | {color:green} 1m 18s{color} | {color:green} the patch passed {color} | | {color:green}+1{color} | {color:green} javac {color} | {color:green} 1m 18s{color} | {color:green} the patch passed {color} | | {color:green}+1{color} | {color:green} checkstyle {color} | {color:green} 0m 43s{color} | {color:green} ql: The patch generated 0 new + 16 unchanged - 2 fixed = 16 total (was 18) {color} | | {color:green}+1{color} | {color:green} whitespace {color} | {color:green} 0m 0s{color} | {color:green} The patch has no whitespace issues. {color} | | {color:green}+1{color} | {color:green} findbugs {color} | {color:green} 4m 26s{color} | {color:green} the patch passed {color} | | {color:green}+1{color} | {color:green} javadoc {color} | {color:green} 1m 5s{color} | {color:green} the patch passed {color} | || || || || {color:brown} Other Tests {color} || | {color:green}+1{color} | {color:green} asflicense {color} | {color:green} 0m 15s{color} | {color:green} The patch does not generate ASF License warnings. {color} | | {color:black}{color} | {color:black} {color} | {color:black} 26m 31s{color} | {color:black} {color} | \\ \\ || Subsystem || Report/Notes || | Optional Tests | asflicense javac javadoc findbugs checkstyle compile | | uname | Linux hiveptest-server-upstream 3.16.0-4-amd64 #1 SMP Debian 3.16.36-1+deb8u1 (2016-09-03) x86_64 GNU/Linux | | Build tool | maven | | Personality | /data/hiveptest/working/yetus_PreCommit-HIVE-Build-16823/dev-support/hive-personality.sh | | git revision | master / 606d3f2 | | Default Java | 1.8.0_111 | | findbugs | v3.0.0 | | modules | C: ql U: ql | | Console output | http://104.198.109.242/logs//PreCommit-HIVE-Build-16823/yetus.txt | | Powered by | Apache Yetushttp://yetus.apache.org | This message was automatically generated. > HiveJoinAddNotNullRule support for range predicates > --- > > Key: HIVE-21231 > URL: https://issues.apache.org/jira/browse/HIVE-21231 > Project: Hive > Issue Type: Improvement > Components: CBO >Reporter: Jesus Camacho Rodriguez >Assignee: Miklos Gergely >Priority: Major > Labels: newbie, pull-request-available > Attachments: HIVE-21231.01.patch, HIVE-21231.02.patch, > HIVE-21231.03.patch, HIVE-21231.04.patch, HIVE-21231.05.patch, > HIVE-21231.06.patch, HIVE-21231.07.patch > > Time Spent: 10m > Remaining Estimate: 0h > > For instance, given the following query: > {code:sql} > SELECT t0.col0, t0.col1 > FROM > ( > SELECT col0, col1 FROM tab > ) AS t0 > INNER JOIN > ( > SELECT col0, col1 FROM tab > ) AS t1 > ON t0.col0 < t1.col0 AND t0.col1 > t1.col1 > {code} > we could still infer that col0 and col1 cannot be null for any of the inputs. > Currently we do not. -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[jira] [Commented] (HIVE-21231) HiveJoinAddNotNullRule support for range predicates
[ https://issues.apache.org/jira/browse/HIVE-21231?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16804381#comment-16804381 ] Vineet Garg commented on HIVE-21231: There is a query in subquery_scalar (and query44) which has an extra join now (due to {{sq_count_check}} not being removed). I am looking into this (HIVE-21537) > HiveJoinAddNotNullRule support for range predicates > --- > > Key: HIVE-21231 > URL: https://issues.apache.org/jira/browse/HIVE-21231 > Project: Hive > Issue Type: Improvement > Components: CBO >Reporter: Jesus Camacho Rodriguez >Assignee: Miklos Gergely >Priority: Major > Labels: newbie, pull-request-available > Attachments: HIVE-21231.01.patch, HIVE-21231.02.patch, > HIVE-21231.03.patch, HIVE-21231.04.patch, HIVE-21231.05.patch, > HIVE-21231.06.patch > > Time Spent: 10m > Remaining Estimate: 0h > > For instance, given the following query: > {code:sql} > SELECT t0.col0, t0.col1 > FROM > ( > SELECT col0, col1 FROM tab > ) AS t0 > INNER JOIN > ( > SELECT col0, col1 FROM tab > ) AS t1 > ON t0.col0 < t1.col0 AND t0.col1 > t1.col1 > {code} > we could still infer that col0 and col1 cannot be null for any of the inputs. > Currently we do not. -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[jira] [Commented] (HIVE-21231) HiveJoinAddNotNullRule support for range predicates
[ https://issues.apache.org/jira/browse/HIVE-21231?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16804304#comment-16804304 ] Miklos Gergely commented on HIVE-21231: --- I've checked those too for a long time, and I got to the conclusion that the order of the tablescans / reducers that can be executed in any order have changed, which looks odd in the changes view, but otherwise they are just the same stuff written in different order. > HiveJoinAddNotNullRule support for range predicates > --- > > Key: HIVE-21231 > URL: https://issues.apache.org/jira/browse/HIVE-21231 > Project: Hive > Issue Type: Improvement > Components: CBO >Reporter: Jesus Camacho Rodriguez >Assignee: Miklos Gergely >Priority: Major > Labels: newbie, pull-request-available > Attachments: HIVE-21231.01.patch, HIVE-21231.02.patch, > HIVE-21231.03.patch, HIVE-21231.04.patch, HIVE-21231.05.patch, > HIVE-21231.06.patch > > Time Spent: 10m > Remaining Estimate: 0h > > For instance, given the following query: > {code:sql} > SELECT t0.col0, t0.col1 > FROM > ( > SELECT col0, col1 FROM tab > ) AS t0 > INNER JOIN > ( > SELECT col0, col1 FROM tab > ) AS t1 > ON t0.col0 < t1.col0 AND t0.col1 > t1.col1 > {code} > we could still infer that col0 and col1 cannot be null for any of the inputs. > Currently we do not. -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[jira] [Commented] (HIVE-21231) HiveJoinAddNotNullRule support for range predicates
[ https://issues.apache.org/jira/browse/HIVE-21231?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16804282#comment-16804282 ] Vineet Garg commented on HIVE-21231: Code changes look good to me but I notice plan changes in subquery_scalar and query44 which looks like regression to me. Looking more into it. > HiveJoinAddNotNullRule support for range predicates > --- > > Key: HIVE-21231 > URL: https://issues.apache.org/jira/browse/HIVE-21231 > Project: Hive > Issue Type: Improvement > Components: CBO >Reporter: Jesus Camacho Rodriguez >Assignee: Miklos Gergely >Priority: Major > Labels: newbie, pull-request-available > Attachments: HIVE-21231.01.patch, HIVE-21231.02.patch, > HIVE-21231.03.patch, HIVE-21231.04.patch, HIVE-21231.05.patch, > HIVE-21231.06.patch > > Time Spent: 10m > Remaining Estimate: 0h > > For instance, given the following query: > {code:sql} > SELECT t0.col0, t0.col1 > FROM > ( > SELECT col0, col1 FROM tab > ) AS t0 > INNER JOIN > ( > SELECT col0, col1 FROM tab > ) AS t1 > ON t0.col0 < t1.col0 AND t0.col1 > t1.col1 > {code} > we could still infer that col0 and col1 cannot be null for any of the inputs. > Currently we do not. -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[jira] [Commented] (HIVE-21231) HiveJoinAddNotNullRule support for range predicates
[ https://issues.apache.org/jira/browse/HIVE-21231?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16803300#comment-16803300 ] Miklos Gergely commented on HIVE-21231: --- [~vgarg], opened [https://github.com/apache/hive/pull/580]. > HiveJoinAddNotNullRule support for range predicates > --- > > Key: HIVE-21231 > URL: https://issues.apache.org/jira/browse/HIVE-21231 > Project: Hive > Issue Type: Improvement > Components: CBO >Reporter: Jesus Camacho Rodriguez >Assignee: Miklos Gergely >Priority: Major > Labels: newbie, pull-request-available > Attachments: HIVE-21231.01.patch, HIVE-21231.02.patch, > HIVE-21231.03.patch, HIVE-21231.04.patch, HIVE-21231.05.patch, > HIVE-21231.06.patch > > Time Spent: 10m > Remaining Estimate: 0h > > For instance, given the following query: > {code:sql} > SELECT t0.col0, t0.col1 > FROM > ( > SELECT col0, col1 FROM tab > ) AS t0 > INNER JOIN > ( > SELECT col0, col1 FROM tab > ) AS t1 > ON t0.col0 < t1.col0 AND t0.col1 > t1.col1 > {code} > we could still infer that col0 and col1 cannot be null for any of the inputs. > Currently we do not. -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[jira] [Commented] (HIVE-21231) HiveJoinAddNotNullRule support for range predicates
[ https://issues.apache.org/jira/browse/HIVE-21231?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16803148#comment-16803148 ] Vineet Garg commented on HIVE-21231: [~mgergely] Can you open a pull request? > HiveJoinAddNotNullRule support for range predicates > --- > > Key: HIVE-21231 > URL: https://issues.apache.org/jira/browse/HIVE-21231 > Project: Hive > Issue Type: Improvement > Components: CBO >Reporter: Jesus Camacho Rodriguez >Assignee: Miklos Gergely >Priority: Major > Labels: newbie > Attachments: HIVE-21231.01.patch, HIVE-21231.02.patch, > HIVE-21231.03.patch, HIVE-21231.04.patch, HIVE-21231.05.patch, > HIVE-21231.06.patch > > > For instance, given the following query: > {code:sql} > SELECT t0.col0, t0.col1 > FROM > ( > SELECT col0, col1 FROM tab > ) AS t0 > INNER JOIN > ( > SELECT col0, col1 FROM tab > ) AS t1 > ON t0.col0 < t1.col0 AND t0.col1 > t1.col1 > {code} > we could still infer that col0 and col1 cannot be null for any of the inputs. > Currently we do not. -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[jira] [Commented] (HIVE-21231) HiveJoinAddNotNullRule support for range predicates
[ https://issues.apache.org/jira/browse/HIVE-21231?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16803116#comment-16803116 ] Miklos Gergely commented on HIVE-21231: --- [~vgarg] we have a clean build, please take a look, and merge it if you agree. I've slightly refactored HiveJoinAddNotNullRule to have a cleaner structure. > HiveJoinAddNotNullRule support for range predicates > --- > > Key: HIVE-21231 > URL: https://issues.apache.org/jira/browse/HIVE-21231 > Project: Hive > Issue Type: Improvement > Components: CBO >Reporter: Jesus Camacho Rodriguez >Assignee: Miklos Gergely >Priority: Major > Labels: newbie > Attachments: HIVE-21231.01.patch, HIVE-21231.02.patch, > HIVE-21231.03.patch, HIVE-21231.04.patch, HIVE-21231.05.patch, > HIVE-21231.06.patch > > > For instance, given the following query: > {code:sql} > SELECT t0.col0, t0.col1 > FROM > ( > SELECT col0, col1 FROM tab > ) AS t0 > INNER JOIN > ( > SELECT col0, col1 FROM tab > ) AS t1 > ON t0.col0 < t1.col0 AND t0.col1 > t1.col1 > {code} > we could still infer that col0 and col1 cannot be null for any of the inputs. > Currently we do not. -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[jira] [Commented] (HIVE-21231) HiveJoinAddNotNullRule support for range predicates
[ https://issues.apache.org/jira/browse/HIVE-21231?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16803110#comment-16803110 ] Hive QA commented on HIVE-21231: Here are the results of testing the latest attachment: https://issues.apache.org/jira/secure/attachment/12963855/HIVE-21231.06.patch {color:green}SUCCESS:{color} +1 due to 1 test(s) being added or modified. {color:green}SUCCESS:{color} +1 due to 15877 tests passed Test results: https://builds.apache.org/job/PreCommit-HIVE-Build/16713/testReport Console output: https://builds.apache.org/job/PreCommit-HIVE-Build/16713/console Test logs: http://104.198.109.242/logs/PreCommit-HIVE-Build-16713/ Messages: {noformat} Executing org.apache.hive.ptest.execution.TestCheckPhase Executing org.apache.hive.ptest.execution.PrepPhase Executing org.apache.hive.ptest.execution.YetusPhase Executing org.apache.hive.ptest.execution.ExecutionPhase Executing org.apache.hive.ptest.execution.ReportingPhase {noformat} This message is automatically generated. ATTACHMENT ID: 12963855 - PreCommit-HIVE-Build > HiveJoinAddNotNullRule support for range predicates > --- > > Key: HIVE-21231 > URL: https://issues.apache.org/jira/browse/HIVE-21231 > Project: Hive > Issue Type: Improvement > Components: CBO >Reporter: Jesus Camacho Rodriguez >Assignee: Miklos Gergely >Priority: Major > Labels: newbie > Attachments: HIVE-21231.01.patch, HIVE-21231.02.patch, > HIVE-21231.03.patch, HIVE-21231.04.patch, HIVE-21231.05.patch, > HIVE-21231.06.patch > > > For instance, given the following query: > {code:sql} > SELECT t0.col0, t0.col1 > FROM > ( > SELECT col0, col1 FROM tab > ) AS t0 > INNER JOIN > ( > SELECT col0, col1 FROM tab > ) AS t1 > ON t0.col0 < t1.col0 AND t0.col1 > t1.col1 > {code} > we could still infer that col0 and col1 cannot be null for any of the inputs. > Currently we do not. -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[jira] [Commented] (HIVE-21231) HiveJoinAddNotNullRule support for range predicates
[ https://issues.apache.org/jira/browse/HIVE-21231?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16803053#comment-16803053 ] Hive QA commented on HIVE-21231: | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem || Runtime || Comment || || || || || {color:brown} Prechecks {color} || | {color:green}+1{color} | {color:green} @author {color} | {color:green} 0m 0s{color} | {color:green} The patch does not contain any @author tags. {color} | || || || || {color:brown} master Compile Tests {color} || | {color:green}+1{color} | {color:green} mvninstall {color} | {color:green} 8m 42s{color} | {color:green} master passed {color} | | {color:green}+1{color} | {color:green} compile {color} | {color:green} 1m 20s{color} | {color:green} master passed {color} | | {color:green}+1{color} | {color:green} checkstyle {color} | {color:green} 0m 45s{color} | {color:green} master passed {color} | | {color:blue}0{color} | {color:blue} findbugs {color} | {color:blue} 4m 37s{color} | {color:blue} ql in master has 2256 extant Findbugs warnings. {color} | | {color:green}+1{color} | {color:green} javadoc {color} | {color:green} 1m 8s{color} | {color:green} master passed {color} | || || || || {color:brown} Patch Compile Tests {color} || | {color:green}+1{color} | {color:green} mvninstall {color} | {color:green} 1m 40s{color} | {color:green} the patch passed {color} | | {color:green}+1{color} | {color:green} compile {color} | {color:green} 1m 16s{color} | {color:green} the patch passed {color} | | {color:green}+1{color} | {color:green} javac {color} | {color:green} 1m 16s{color} | {color:green} the patch passed {color} | | {color:green}+1{color} | {color:green} checkstyle {color} | {color:green} 0m 44s{color} | {color:green} ql: The patch generated 0 new + 16 unchanged - 11 fixed = 16 total (was 27) {color} | | {color:green}+1{color} | {color:green} whitespace {color} | {color:green} 0m 1s{color} | {color:green} The patch has no whitespace issues. {color} | | {color:green}+1{color} | {color:green} findbugs {color} | {color:green} 4m 53s{color} | {color:green} the patch passed {color} | | {color:green}+1{color} | {color:green} javadoc {color} | {color:green} 1m 10s{color} | {color:green} the patch passed {color} | || || || || {color:brown} Other Tests {color} || | {color:red}-1{color} | {color:red} asflicense {color} | {color:red} 0m 16s{color} | {color:red} The patch generated 7 ASF License warnings. {color} | | {color:black}{color} | {color:black} {color} | {color:black} 27m 29s{color} | {color:black} {color} | \\ \\ || Subsystem || Report/Notes || | Optional Tests | asflicense javac javadoc findbugs checkstyle compile | | uname | Linux hiveptest-server-upstream 3.16.0-4-amd64 #1 SMP Debian 3.16.36-1+deb8u1 (2016-09-03) x86_64 GNU/Linux | | Build tool | maven | | Personality | /data/hiveptest/working/yetus_PreCommit-HIVE-Build-16713/dev-support/hive-personality.sh | | git revision | master / 368a8fe | | Default Java | 1.8.0_111 | | findbugs | v3.0.0 | | asflicense | http://104.198.109.242/logs//PreCommit-HIVE-Build-16713/yetus/patch-asflicense-problems.txt | | modules | C: ql U: ql | | Console output | http://104.198.109.242/logs//PreCommit-HIVE-Build-16713/yetus.txt | | Powered by | Apache Yetushttp://yetus.apache.org | This message was automatically generated. > HiveJoinAddNotNullRule support for range predicates > --- > > Key: HIVE-21231 > URL: https://issues.apache.org/jira/browse/HIVE-21231 > Project: Hive > Issue Type: Improvement > Components: CBO >Reporter: Jesus Camacho Rodriguez >Assignee: Miklos Gergely >Priority: Major > Labels: newbie > Attachments: HIVE-21231.01.patch, HIVE-21231.02.patch, > HIVE-21231.03.patch, HIVE-21231.04.patch, HIVE-21231.05.patch, > HIVE-21231.06.patch > > > For instance, given the following query: > {code:sql} > SELECT t0.col0, t0.col1 > FROM > ( > SELECT col0, col1 FROM tab > ) AS t0 > INNER JOIN > ( > SELECT col0, col1 FROM tab > ) AS t1 > ON t0.col0 < t1.col0 AND t0.col1 > t1.col1 > {code} > we could still infer that col0 and col1 cannot be null for any of the inputs. > Currently we do not. -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[jira] [Commented] (HIVE-21231) HiveJoinAddNotNullRule support for range predicates
[ https://issues.apache.org/jira/browse/HIVE-21231?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16802556#comment-16802556 ] Hive QA commented on HIVE-21231: Here are the results of testing the latest attachment: https://issues.apache.org/jira/secure/attachment/12963832/HIVE-21231.05.patch {color:green}SUCCESS:{color} +1 due to 1 test(s) being added or modified. {color:red}ERROR:{color} -1 due to 3 failed/errored test(s), 15846 tests executed *Failed tests:* {noformat} org.apache.hadoop.hive.cli.TestCliDriver.testCliDriver[join_by_range_rule_not_null] (batchId=62) org.apache.hadoop.hive.cli.TestCliDriver.testCliDriver[parquet_historical_timestamp] (batchId=7) org.apache.hadoop.hive.cli.TestMiniLlapLocalCliDriver.testCliDriver[dynamic_semijoin_reduction] (batchId=172) {noformat} Test results: https://builds.apache.org/job/PreCommit-HIVE-Build/16707/testReport Console output: https://builds.apache.org/job/PreCommit-HIVE-Build/16707/console Test logs: http://104.198.109.242/logs/PreCommit-HIVE-Build-16707/ Messages: {noformat} Executing org.apache.hive.ptest.execution.TestCheckPhase Executing org.apache.hive.ptest.execution.PrepPhase Executing org.apache.hive.ptest.execution.YetusPhase Executing org.apache.hive.ptest.execution.ExecutionPhase Executing org.apache.hive.ptest.execution.ReportingPhase Tests exited with: TestsFailedException: 3 tests failed {noformat} This message is automatically generated. ATTACHMENT ID: 12963832 - PreCommit-HIVE-Build > HiveJoinAddNotNullRule support for range predicates > --- > > Key: HIVE-21231 > URL: https://issues.apache.org/jira/browse/HIVE-21231 > Project: Hive > Issue Type: Improvement > Components: CBO >Reporter: Jesus Camacho Rodriguez >Assignee: Miklos Gergely >Priority: Major > Labels: newbie > Attachments: HIVE-21231.01.patch, HIVE-21231.02.patch, > HIVE-21231.03.patch, HIVE-21231.04.patch, HIVE-21231.05.patch > > > For instance, given the following query: > {code:sql} > SELECT t0.col0, t0.col1 > FROM > ( > SELECT col0, col1 FROM tab > ) AS t0 > INNER JOIN > ( > SELECT col0, col1 FROM tab > ) AS t1 > ON t0.col0 < t1.col0 AND t0.col1 > t1.col1 > {code} > we could still infer that col0 and col1 cannot be null for any of the inputs. > Currently we do not. -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[jira] [Commented] (HIVE-21231) HiveJoinAddNotNullRule support for range predicates
[ https://issues.apache.org/jira/browse/HIVE-21231?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16802532#comment-16802532 ] Hive QA commented on HIVE-21231: | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem || Runtime || Comment || || || || || {color:brown} Prechecks {color} || | {color:green}+1{color} | {color:green} @author {color} | {color:green} 0m 0s{color} | {color:green} The patch does not contain any @author tags. {color} | || || || || {color:brown} master Compile Tests {color} || | {color:green}+1{color} | {color:green} mvninstall {color} | {color:green} 8m 50s{color} | {color:green} master passed {color} | | {color:green}+1{color} | {color:green} compile {color} | {color:green} 1m 17s{color} | {color:green} master passed {color} | | {color:green}+1{color} | {color:green} checkstyle {color} | {color:green} 0m 45s{color} | {color:green} master passed {color} | | {color:blue}0{color} | {color:blue} findbugs {color} | {color:blue} 4m 20s{color} | {color:blue} ql in master has 2255 extant Findbugs warnings. {color} | | {color:green}+1{color} | {color:green} javadoc {color} | {color:green} 1m 9s{color} | {color:green} master passed {color} | || || || || {color:brown} Patch Compile Tests {color} || | {color:green}+1{color} | {color:green} mvninstall {color} | {color:green} 1m 36s{color} | {color:green} the patch passed {color} | | {color:green}+1{color} | {color:green} compile {color} | {color:green} 1m 14s{color} | {color:green} the patch passed {color} | | {color:green}+1{color} | {color:green} javac {color} | {color:green} 1m 14s{color} | {color:green} the patch passed {color} | | {color:green}+1{color} | {color:green} checkstyle {color} | {color:green} 0m 44s{color} | {color:green} ql: The patch generated 0 new + 16 unchanged - 11 fixed = 16 total (was 27) {color} | | {color:red}-1{color} | {color:red} whitespace {color} | {color:red} 0m 0s{color} | {color:red} The patch has 1 line(s) that end in whitespace. Use git apply --whitespace=fix <>. Refer https://git-scm.com/docs/git-apply {color} | | {color:green}+1{color} | {color:green} findbugs {color} | {color:green} 4m 43s{color} | {color:green} the patch passed {color} | | {color:green}+1{color} | {color:green} javadoc {color} | {color:green} 1m 7s{color} | {color:green} the patch passed {color} | || || || || {color:brown} Other Tests {color} || | {color:green}+1{color} | {color:green} asflicense {color} | {color:green} 0m 15s{color} | {color:green} The patch does not generate ASF License warnings. {color} | | {color:black}{color} | {color:black} {color} | {color:black} 27m 3s{color} | {color:black} {color} | \\ \\ || Subsystem || Report/Notes || | Optional Tests | asflicense javac javadoc findbugs checkstyle compile | | uname | Linux hiveptest-server-upstream 3.16.0-4-amd64 #1 SMP Debian 3.16.36-1+deb8u1 (2016-09-03) x86_64 GNU/Linux | | Build tool | maven | | Personality | /data/hiveptest/working/yetus_PreCommit-HIVE-Build-16707/dev-support/hive-personality.sh | | git revision | master / 5708a0b | | Default Java | 1.8.0_111 | | findbugs | v3.0.0 | | whitespace | http://104.198.109.242/logs//PreCommit-HIVE-Build-16707/yetus/whitespace-eol.txt | | modules | C: ql U: ql | | Console output | http://104.198.109.242/logs//PreCommit-HIVE-Build-16707/yetus.txt | | Powered by | Apache Yetushttp://yetus.apache.org | This message was automatically generated. > HiveJoinAddNotNullRule support for range predicates > --- > > Key: HIVE-21231 > URL: https://issues.apache.org/jira/browse/HIVE-21231 > Project: Hive > Issue Type: Improvement > Components: CBO >Reporter: Jesus Camacho Rodriguez >Assignee: Miklos Gergely >Priority: Major > Labels: newbie > Attachments: HIVE-21231.01.patch, HIVE-21231.02.patch, > HIVE-21231.03.patch, HIVE-21231.04.patch, HIVE-21231.05.patch > > > For instance, given the following query: > {code:sql} > SELECT t0.col0, t0.col1 > FROM > ( > SELECT col0, col1 FROM tab > ) AS t0 > INNER JOIN > ( > SELECT col0, col1 FROM tab > ) AS t1 > ON t0.col0 < t1.col0 AND t0.col1 > t1.col1 > {code} > we could still infer that col0 and col1 cannot be null for any of the inputs. > Currently we do not. -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[jira] [Commented] (HIVE-21231) HiveJoinAddNotNullRule support for range predicates
[ https://issues.apache.org/jira/browse/HIVE-21231?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16802313#comment-16802313 ] Hive QA commented on HIVE-21231: Here are the results of testing the latest attachment: https://issues.apache.org/jira/secure/attachment/12963779/HIVE-21231.04.patch {color:red}ERROR:{color} -1 due to build exiting with an error Test results: https://builds.apache.org/job/PreCommit-HIVE-Build/16700/testReport Console output: https://builds.apache.org/job/PreCommit-HIVE-Build/16700/console Test logs: http://104.198.109.242/logs/PreCommit-HIVE-Build-16700/ Messages: {noformat} Executing org.apache.hive.ptest.execution.TestCheckPhase Tests exited with: Exception: Patch URL https://issues.apache.org/jira/secure/attachment/12963779/HIVE-21231.04.patch was found in seen patch url's cache and a test was probably run already on it. Aborting... {noformat} This message is automatically generated. ATTACHMENT ID: 12963779 - PreCommit-HIVE-Build > HiveJoinAddNotNullRule support for range predicates > --- > > Key: HIVE-21231 > URL: https://issues.apache.org/jira/browse/HIVE-21231 > Project: Hive > Issue Type: Improvement > Components: CBO >Reporter: Jesus Camacho Rodriguez >Assignee: Miklos Gergely >Priority: Major > Labels: newbie > Attachments: HIVE-21231.01.patch, HIVE-21231.02.patch, > HIVE-21231.03.patch, HIVE-21231.04.patch > > > For instance, given the following query: > {code:sql} > SELECT t0.col0, t0.col1 > FROM > ( > SELECT col0, col1 FROM tab > ) AS t0 > INNER JOIN > ( > SELECT col0, col1 FROM tab > ) AS t1 > ON t0.col0 < t1.col0 AND t0.col1 > t1.col1 > {code} > we could still infer that col0 and col1 cannot be null for any of the inputs. > Currently we do not. -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[jira] [Commented] (HIVE-21231) HiveJoinAddNotNullRule support for range predicates
[ https://issues.apache.org/jira/browse/HIVE-21231?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16802307#comment-16802307 ] Vineet Garg commented on HIVE-21231: [~mgergely] Whenever this patch is ready create a RB/pull request. I can take a look at it. Also FYI HIVE-21230 touches the same part of the code. > HiveJoinAddNotNullRule support for range predicates > --- > > Key: HIVE-21231 > URL: https://issues.apache.org/jira/browse/HIVE-21231 > Project: Hive > Issue Type: Improvement > Components: CBO >Reporter: Jesus Camacho Rodriguez >Assignee: Miklos Gergely >Priority: Major > Labels: newbie > Attachments: HIVE-21231.01.patch, HIVE-21231.02.patch, > HIVE-21231.03.patch, HIVE-21231.04.patch > > > For instance, given the following query: > {code:sql} > SELECT t0.col0, t0.col1 > FROM > ( > SELECT col0, col1 FROM tab > ) AS t0 > INNER JOIN > ( > SELECT col0, col1 FROM tab > ) AS t1 > ON t0.col0 < t1.col0 AND t0.col1 > t1.col1 > {code} > we could still infer that col0 and col1 cannot be null for any of the inputs. > Currently we do not. -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[jira] [Commented] (HIVE-21231) HiveJoinAddNotNullRule support for range predicates
[ https://issues.apache.org/jira/browse/HIVE-21231?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16802273#comment-16802273 ] Hive QA commented on HIVE-21231: Here are the results of testing the latest attachment: https://issues.apache.org/jira/secure/attachment/12963779/HIVE-21231.04.patch {color:red}ERROR:{color} -1 due to build exiting with an error Test results: https://builds.apache.org/job/PreCommit-HIVE-Build/16698/testReport Console output: https://builds.apache.org/job/PreCommit-HIVE-Build/16698/console Test logs: http://104.198.109.242/logs/PreCommit-HIVE-Build-16698/ Messages: {noformat} Executing org.apache.hive.ptest.execution.TestCheckPhase Executing org.apache.hive.ptest.execution.PrepPhase Tests exited with: NonZeroExitCodeException Command 'bash /data/hiveptest/working/scratch/source-prep.sh' failed with exit status 1 and output '+ date '+%Y-%m-%d %T.%3N' 2019-03-26 23:30:54.498 + [[ -n /usr/lib/jvm/java-8-openjdk-amd64 ]] + export JAVA_HOME=/usr/lib/jvm/java-8-openjdk-amd64 + JAVA_HOME=/usr/lib/jvm/java-8-openjdk-amd64 + export PATH=/usr/lib/jvm/java-8-openjdk-amd64/bin/:/usr/local/bin:/usr/bin:/bin:/usr/local/games:/usr/games + PATH=/usr/lib/jvm/java-8-openjdk-amd64/bin/:/usr/local/bin:/usr/bin:/bin:/usr/local/games:/usr/games + export 'ANT_OPTS=-Xmx1g -XX:MaxPermSize=256m ' + ANT_OPTS='-Xmx1g -XX:MaxPermSize=256m ' + export 'MAVEN_OPTS=-Xmx1g ' + MAVEN_OPTS='-Xmx1g ' + cd /data/hiveptest/working/ + tee /data/hiveptest/logs/PreCommit-HIVE-Build-16698/source-prep.txt + [[ false == \t\r\u\e ]] + mkdir -p maven ivy + [[ git = \s\v\n ]] + [[ git = \g\i\t ]] + [[ -z master ]] + [[ -d apache-github-source-source ]] + [[ ! -d apache-github-source-source/.git ]] + [[ ! -d apache-github-source-source ]] + date '+%Y-%m-%d %T.%3N' 2019-03-26 23:30:54.502 + cd apache-github-source-source + git fetch origin >From https://github.com/apache/hive 0b8cfa7..298f749 branch-2 -> origin/branch-2 + git reset --hard HEAD HEAD is now at 5708a0b HIVE-21479: NPE during metastore cache update (Daniel Dai, reviewed by Zoltan Haindrich) + git clean -f -d Removing standalone-metastore/metastore-server/src/gen/ + git checkout master Already on 'master' Your branch is up-to-date with 'origin/master'. + git reset --hard origin/master HEAD is now at 5708a0b HIVE-21479: NPE during metastore cache update (Daniel Dai, reviewed by Zoltan Haindrich) + git merge --ff-only origin/master Already up-to-date. + date '+%Y-%m-%d %T.%3N' 2019-03-26 23:30:57.435 + rm -rf ../yetus_PreCommit-HIVE-Build-16698 + mkdir ../yetus_PreCommit-HIVE-Build-16698 + git gc + cp -R . ../yetus_PreCommit-HIVE-Build-16698 + mkdir /data/hiveptest/logs/PreCommit-HIVE-Build-16698/yetus + patchCommandPath=/data/hiveptest/working/scratch/smart-apply-patch.sh + patchFilePath=/data/hiveptest/working/scratch/build.patch + [[ -f /data/hiveptest/working/scratch/build.patch ]] + chmod +x /data/hiveptest/working/scratch/smart-apply-patch.sh + /data/hiveptest/working/scratch/smart-apply-patch.sh /data/hiveptest/working/scratch/build.patch error: a/ql/src/java/org/apache/hadoop/hive/ql/optimizer/calcite/HiveCalciteUtil.java: does not exist in index error: a/ql/src/java/org/apache/hadoop/hive/ql/optimizer/calcite/rules/HiveJoinAddNotNullRule.java: does not exist in index error: a/ql/src/java/org/apache/hadoop/hive/ql/optimizer/calcite/rules/HiveRulesRegistry.java: does not exist in index error: a/ql/src/test/results/clientnegative/subquery_scalar_multi_rows.q.out: does not exist in index error: a/ql/src/test/results/clientpositive/interval_3.q.out: does not exist in index error: a/ql/src/test/results/clientpositive/join43.q.out: does not exist in index error: a/ql/src/test/results/clientpositive/join_merging.q.out: does not exist in index error: a/ql/src/test/results/clientpositive/llap/cross_prod_1.q.out: does not exist in index error: a/ql/src/test/results/clientpositive/llap/groupby_groupingset_bug.q.out: does not exist in index error: a/ql/src/test/results/clientpositive/llap/semijoin.q.out: does not exist in index error: a/ql/src/test/results/clientpositive/llap/subquery_corr.q.out: does not exist in index error: a/ql/src/test/results/clientpositive/llap/subquery_in.q.out: does not exist in index error: a/ql/src/test/results/clientpositive/llap/subquery_notin.q.out: does not exist in index error: a/ql/src/test/results/clientpositive/llap/subquery_scalar.q.out: does not exist in index error: a/ql/src/test/results/clientpositive/llap/subquery_select.q.out: does not exist in index error: a/ql/src/test/results/clientpositive/perf/spark/query1.q.out: does not exist in index error: a/ql/src/test/results/clientpositive/perf/spark/query23.q.out: does not exist in index error: a/ql/src/test/results/clientpositive/perf/spark/query24.q.out: does not exist in index error: a/ql/src/test/results/clientpositive/perf/spark/query30.q.out: does not exist in index error:
[jira] [Commented] (HIVE-21231) HiveJoinAddNotNullRule support for range predicates
[ https://issues.apache.org/jira/browse/HIVE-21231?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16801752#comment-16801752 ] Hive QA commented on HIVE-21231: Here are the results of testing the latest attachment: https://issues.apache.org/jira/secure/attachment/12963731/HIVE-21231.02.patch {color:red}ERROR:{color} -1 due to build exiting with an error Test results: https://builds.apache.org/job/PreCommit-HIVE-Build/16689/testReport Console output: https://builds.apache.org/job/PreCommit-HIVE-Build/16689/console Test logs: http://104.198.109.242/logs/PreCommit-HIVE-Build-16689/ Messages: {noformat} This message was trimmed, see log for full details + [[ -n /usr/lib/jvm/java-8-openjdk-amd64 ]] + export JAVA_HOME=/usr/lib/jvm/java-8-openjdk-amd64 + JAVA_HOME=/usr/lib/jvm/java-8-openjdk-amd64 + export PATH=/usr/lib/jvm/java-8-openjdk-amd64/bin/:/usr/local/bin:/usr/bin:/bin:/usr/local/games:/usr/games + PATH=/usr/lib/jvm/java-8-openjdk-amd64/bin/:/usr/local/bin:/usr/bin:/bin:/usr/local/games:/usr/games + export 'ANT_OPTS=-Xmx1g -XX:MaxPermSize=256m ' + ANT_OPTS='-Xmx1g -XX:MaxPermSize=256m ' + export 'MAVEN_OPTS=-Xmx1g ' + MAVEN_OPTS='-Xmx1g ' + cd /data/hiveptest/working/ + tee /data/hiveptest/logs/PreCommit-HIVE-Build-16689/source-prep.txt + [[ false == \t\r\u\e ]] + mkdir -p maven ivy + [[ git = \s\v\n ]] + [[ git = \g\i\t ]] + [[ -z master ]] + [[ -d apache-github-source-source ]] + [[ ! -d apache-github-source-source/.git ]] + [[ ! -d apache-github-source-source ]] + date '+%Y-%m-%d %T.%3N' 2019-03-26 14:01:13.298 + cd apache-github-source-source + git fetch origin + git reset --hard HEAD HEAD is now at 80998ad HIVE-21493: BuddyAllocator - Metrics count for allocated arenas wrong if preallocation is done (Olli Draese via Slim Bouguerra) + git clean -f -d + git checkout master Already on 'master' Your branch is up-to-date with 'origin/master'. + git reset --hard origin/master HEAD is now at 80998ad HIVE-21493: BuddyAllocator - Metrics count for allocated arenas wrong if preallocation is done (Olli Draese via Slim Bouguerra) + git merge --ff-only origin/master Already up-to-date. + date '+%Y-%m-%d %T.%3N' 2019-03-26 14:01:14.589 + rm -rf ../yetus_PreCommit-HIVE-Build-16689 + mkdir ../yetus_PreCommit-HIVE-Build-16689 + git gc + cp -R . ../yetus_PreCommit-HIVE-Build-16689 + mkdir /data/hiveptest/logs/PreCommit-HIVE-Build-16689/yetus + patchCommandPath=/data/hiveptest/working/scratch/smart-apply-patch.sh + patchFilePath=/data/hiveptest/working/scratch/build.patch + [[ -f /data/hiveptest/working/scratch/build.patch ]] + chmod +x /data/hiveptest/working/scratch/smart-apply-patch.sh + /data/hiveptest/working/scratch/smart-apply-patch.sh /data/hiveptest/working/scratch/build.patch error: a/ql/src/java/org/apache/hadoop/hive/ql/optimizer/calcite/HiveCalciteUtil.java: does not exist in index error: a/ql/src/java/org/apache/hadoop/hive/ql/optimizer/calcite/rules/HiveJoinAddNotNullRule.java: does not exist in index error: a/ql/src/java/org/apache/hadoop/hive/ql/optimizer/calcite/rules/HiveRulesRegistry.java: does not exist in index error: a/ql/src/test/results/clientnegative/subquery_scalar_multi_rows.q.out: does not exist in index error: a/ql/src/test/results/clientpositive/interval_3.q.out: does not exist in index error: a/ql/src/test/results/clientpositive/join43.q.out: does not exist in index error: a/ql/src/test/results/clientpositive/join_merging.q.out: does not exist in index error: a/ql/src/test/results/clientpositive/llap/cross_prod_1.q.out: does not exist in index error: a/ql/src/test/results/clientpositive/llap/groupby_groupingset_bug.q.out: does not exist in index error: a/ql/src/test/results/clientpositive/llap/semijoin.q.out: does not exist in index error: a/ql/src/test/results/clientpositive/llap/subquery_corr.q.out: does not exist in index error: a/ql/src/test/results/clientpositive/llap/subquery_in.q.out: does not exist in index error: a/ql/src/test/results/clientpositive/llap/subquery_notin.q.out: does not exist in index error: a/ql/src/test/results/clientpositive/llap/subquery_scalar.q.out: does not exist in index error: a/ql/src/test/results/clientpositive/llap/subquery_select.q.out: does not exist in index error: a/ql/src/test/results/clientpositive/perf/spark/query1.q.out: does not exist in index error: a/ql/src/test/results/clientpositive/perf/spark/query23.q.out: does not exist in index error: a/ql/src/test/results/clientpositive/perf/spark/query24.q.out: does not exist in index error: a/ql/src/test/results/clientpositive/perf/spark/query30.q.out: does not exist in index error: a/ql/src/test/results/clientpositive/perf/spark/query32.q.out: does not exist in index error: a/ql/src/test/results/clientpositive/perf/spark/query44.q.out: does not exist in index error: a/ql/src/test/results/clientpositive/perf/spark/query54.q.out: does not exist in index error:
[jira] [Commented] (HIVE-21231) HiveJoinAddNotNullRule support for range predicates
[ https://issues.apache.org/jira/browse/HIVE-21231?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16781476#comment-16781476 ] Miklos Gergely commented on HIVE-21231: --- [~vgarg] sure, this is far from the final version just a first draft. Wanted to see which` q tests are failing :) > HiveJoinAddNotNullRule support for range predicates > --- > > Key: HIVE-21231 > URL: https://issues.apache.org/jira/browse/HIVE-21231 > Project: Hive > Issue Type: Improvement > Components: CBO >Reporter: Jesus Camacho Rodriguez >Assignee: Miklos Gergely >Priority: Major > Labels: newbie > Attachments: HIVE-21231.01.patch > > > For instance, given the following query: > {code:sql} > SELECT t0.col0, t0.col1 > FROM > ( > SELECT col0, col1 FROM tab > ) AS t0 > INNER JOIN > ( > SELECT col0, col1 FROM tab > ) AS t1 > ON t0.col0 < t1.col0 AND t0.col1 > t1.col1 > {code} > we could still infer that col0 and col1 cannot be null for any of the inputs. > Currently we do not. -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[jira] [Commented] (HIVE-21231) HiveJoinAddNotNullRule support for range predicates
[ https://issues.apache.org/jira/browse/HIVE-21231?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16781118#comment-16781118 ] Vineet Garg commented on HIVE-21231: [~mgergely] Can you also add a negative test case with OR? We should not generate IS NOT NULL in this case (TRUE OR NULL evaluates to TRUE). There is also NULL SAFE equality supported by HIVE. Will be good to add that test as well. > HiveJoinAddNotNullRule support for range predicates > --- > > Key: HIVE-21231 > URL: https://issues.apache.org/jira/browse/HIVE-21231 > Project: Hive > Issue Type: Improvement > Components: CBO >Reporter: Jesus Camacho Rodriguez >Assignee: Miklos Gergely >Priority: Major > Labels: newbie > Attachments: HIVE-21231.01.patch > > > For instance, given the following query: > {code:sql} > SELECT t0.col0, t0.col1 > FROM > ( > SELECT col0, col1 FROM tab > ) AS t0 > INNER JOIN > ( > SELECT col0, col1 FROM tab > ) AS t1 > ON t0.col0 < t1.col0 AND t0.col1 > t1.col1 > {code} > we could still infer that col0 and col1 cannot be null for any of the inputs. > Currently we do not. -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[jira] [Commented] (HIVE-21231) HiveJoinAddNotNullRule support for range predicates
[ https://issues.apache.org/jira/browse/HIVE-21231?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16780514#comment-16780514 ] Hive QA commented on HIVE-21231: Here are the results of testing the latest attachment: https://issues.apache.org/jira/secure/attachment/12960495/HIVE-21231.01.patch {color:green}SUCCESS:{color} +1 due to 1 test(s) being added or modified. {color:red}ERROR:{color} -1 due to 88 failed/errored test(s), 15821 tests executed *Failed tests:* {noformat} org.apache.hadoop.hive.cli.TestCliDriver.testCliDriver[interval_3] (batchId=70) org.apache.hadoop.hive.cli.TestCliDriver.testCliDriver[join43] (batchId=6) org.apache.hadoop.hive.cli.TestCliDriver.testCliDriver[join_merging] (batchId=87) org.apache.hadoop.hive.cli.TestMiniLlapLocalCliDriver.testCliDriver[cross_prod_1] (batchId=179) org.apache.hadoop.hive.cli.TestMiniLlapLocalCliDriver.testCliDriver[groupby_groupingset_bug] (batchId=182) org.apache.hadoop.hive.cli.TestMiniLlapLocalCliDriver.testCliDriver[semijoin] (batchId=164) org.apache.hadoop.hive.cli.TestMiniLlapLocalCliDriver.testCliDriver[subquery_corr] (batchId=174) org.apache.hadoop.hive.cli.TestMiniLlapLocalCliDriver.testCliDriver[subquery_in] (batchId=176) org.apache.hadoop.hive.cli.TestMiniLlapLocalCliDriver.testCliDriver[subquery_notin] (batchId=178) org.apache.hadoop.hive.cli.TestMiniLlapLocalCliDriver.testCliDriver[subquery_scalar] (batchId=170) org.apache.hadoop.hive.cli.TestMiniLlapLocalCliDriver.testCliDriver[subquery_select] (batchId=170) org.apache.hadoop.hive.cli.TestMiniTezCliDriver.testCliDriver[hybridgrace_hashjoin_2] (batchId=109) org.apache.hadoop.hive.cli.TestNegativeCliDriver.testCliDriver[subquery_scalar_multi_rows] (batchId=101) org.apache.hadoop.hive.cli.TestSparkCliDriver.testCliDriver[join_merging] (batchId=148) org.apache.hadoop.hive.cli.TestSparkCliDriver.testCliDriver[semijoin] (batchId=121) org.apache.hadoop.hive.cli.TestSparkCliDriver.testCliDriver[subquery_in] (batchId=140) org.apache.hadoop.hive.cli.TestSparkCliDriver.testCliDriver[subquery_notin] (batchId=143) org.apache.hadoop.hive.cli.TestSparkCliDriver.testCliDriver[subquery_scalar] (batchId=129) org.apache.hadoop.hive.cli.TestSparkCliDriver.testCliDriver[subquery_select] (batchId=129) org.apache.hadoop.hive.cli.TestSparkPerfCliDriver.testCliDriver[query1] (batchId=277) org.apache.hadoop.hive.cli.TestSparkPerfCliDriver.testCliDriver[query23] (batchId=277) org.apache.hadoop.hive.cli.TestSparkPerfCliDriver.testCliDriver[query24] (batchId=277) org.apache.hadoop.hive.cli.TestSparkPerfCliDriver.testCliDriver[query30] (batchId=277) org.apache.hadoop.hive.cli.TestSparkPerfCliDriver.testCliDriver[query32] (batchId=277) org.apache.hadoop.hive.cli.TestSparkPerfCliDriver.testCliDriver[query44] (batchId=277) org.apache.hadoop.hive.cli.TestSparkPerfCliDriver.testCliDriver[query54] (batchId=277) org.apache.hadoop.hive.cli.TestSparkPerfCliDriver.testCliDriver[query65] (batchId=277) org.apache.hadoop.hive.cli.TestSparkPerfCliDriver.testCliDriver[query6] (batchId=277) org.apache.hadoop.hive.cli.TestSparkPerfCliDriver.testCliDriver[query72] (batchId=277) org.apache.hadoop.hive.cli.TestSparkPerfCliDriver.testCliDriver[query81] (batchId=277) org.apache.hadoop.hive.cli.TestSparkPerfCliDriver.testCliDriver[query92] (batchId=277) org.apache.hadoop.hive.cli.TestTezPerfCliDriver.testCliDriver[cbo_ext_query1] (batchId=275) org.apache.hadoop.hive.cli.TestTezPerfCliDriver.testCliDriver[cbo_query14] (batchId=275) org.apache.hadoop.hive.cli.TestTezPerfCliDriver.testCliDriver[cbo_query1] (batchId=275) org.apache.hadoop.hive.cli.TestTezPerfCliDriver.testCliDriver[cbo_query23] (batchId=275) org.apache.hadoop.hive.cli.TestTezPerfCliDriver.testCliDriver[cbo_query24] (batchId=275) org.apache.hadoop.hive.cli.TestTezPerfCliDriver.testCliDriver[cbo_query30] (batchId=275) org.apache.hadoop.hive.cli.TestTezPerfCliDriver.testCliDriver[cbo_query32] (batchId=275) org.apache.hadoop.hive.cli.TestTezPerfCliDriver.testCliDriver[cbo_query54] (batchId=275) org.apache.hadoop.hive.cli.TestTezPerfCliDriver.testCliDriver[cbo_query64] (batchId=275) org.apache.hadoop.hive.cli.TestTezPerfCliDriver.testCliDriver[cbo_query65] (batchId=275) org.apache.hadoop.hive.cli.TestTezPerfCliDriver.testCliDriver[cbo_query6] (batchId=275) org.apache.hadoop.hive.cli.TestTezPerfCliDriver.testCliDriver[cbo_query72] (batchId=275) org.apache.hadoop.hive.cli.TestTezPerfCliDriver.testCliDriver[cbo_query81] (batchId=275) org.apache.hadoop.hive.cli.TestTezPerfCliDriver.testCliDriver[cbo_query92] (batchId=275) org.apache.hadoop.hive.cli.TestTezPerfCliDriver.testCliDriver[query14] (batchId=275) org.apache.hadoop.hive.cli.TestTezPerfCliDriver.testCliDriver[query1] (batchId=275) org.apache.hadoop.hive.cli.TestTezPerfCliDriver.testCliDriver[query23] (batchId=275) org.apache.hadoop.hive.cli.TestTezPerfCliDriver.testCliDriver[query24] (batchId=275)
[jira] [Commented] (HIVE-21231) HiveJoinAddNotNullRule support for range predicates
[ https://issues.apache.org/jira/browse/HIVE-21231?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16780462#comment-16780462 ] Hive QA commented on HIVE-21231: | (/) *{color:green}+1 overall{color}* | \\ \\ || Vote || Subsystem || Runtime || Comment || || || || || {color:brown} Prechecks {color} || | {color:green}+1{color} | {color:green} @author {color} | {color:green} 0m 0s{color} | {color:green} The patch does not contain any @author tags. {color} | || || || || {color:brown} master Compile Tests {color} || | {color:green}+1{color} | {color:green} mvninstall {color} | {color:green} 9m 33s{color} | {color:green} master passed {color} | | {color:green}+1{color} | {color:green} compile {color} | {color:green} 1m 22s{color} | {color:green} master passed {color} | | {color:green}+1{color} | {color:green} checkstyle {color} | {color:green} 0m 47s{color} | {color:green} master passed {color} | | {color:blue}0{color} | {color:blue} findbugs {color} | {color:blue} 4m 36s{color} | {color:blue} ql in master has 2251 extant Findbugs warnings. {color} | | {color:green}+1{color} | {color:green} javadoc {color} | {color:green} 1m 7s{color} | {color:green} master passed {color} | || || || || {color:brown} Patch Compile Tests {color} || | {color:green}+1{color} | {color:green} mvninstall {color} | {color:green} 1m 43s{color} | {color:green} the patch passed {color} | | {color:green}+1{color} | {color:green} compile {color} | {color:green} 1m 22s{color} | {color:green} the patch passed {color} | | {color:green}+1{color} | {color:green} javac {color} | {color:green} 1m 22s{color} | {color:green} the patch passed {color} | | {color:green}+1{color} | {color:green} checkstyle {color} | {color:green} 0m 46s{color} | {color:green} the patch passed {color} | | {color:green}+1{color} | {color:green} whitespace {color} | {color:green} 0m 0s{color} | {color:green} The patch has no whitespace issues. {color} | | {color:green}+1{color} | {color:green} findbugs {color} | {color:green} 4m 52s{color} | {color:green} the patch passed {color} | | {color:green}+1{color} | {color:green} javadoc {color} | {color:green} 1m 7s{color} | {color:green} the patch passed {color} | || || || || {color:brown} Other Tests {color} || | {color:green}+1{color} | {color:green} asflicense {color} | {color:green} 0m 15s{color} | {color:green} The patch does not generate ASF License warnings. {color} | | {color:black}{color} | {color:black} {color} | {color:black} 28m 0s{color} | {color:black} {color} | \\ \\ || Subsystem || Report/Notes || | Optional Tests | asflicense javac javadoc findbugs checkstyle compile | | uname | Linux hiveptest-server-upstream 3.16.0-4-amd64 #1 SMP Debian 3.16.36-1+deb8u1 (2016-09-03) x86_64 GNU/Linux | | Build tool | maven | | Personality | /data/hiveptest/working/yetus_PreCommit-HIVE-Build-16289/dev-support/hive-personality.sh | | git revision | master / 2655eac | | Default Java | 1.8.0_111 | | findbugs | v3.0.0 | | modules | C: ql U: ql | | Console output | http://104.198.109.242/logs//PreCommit-HIVE-Build-16289/yetus.txt | | Powered by | Apache Yetushttp://yetus.apache.org | This message was automatically generated. > HiveJoinAddNotNullRule support for range predicates > --- > > Key: HIVE-21231 > URL: https://issues.apache.org/jira/browse/HIVE-21231 > Project: Hive > Issue Type: Improvement > Components: CBO >Reporter: Jesus Camacho Rodriguez >Assignee: Miklos Gergely >Priority: Major > Labels: newbie > Attachments: HIVE-21231.01.patch > > > For instance, given the following query: > {code:sql} > SELECT t0.col0, t0.col1 > FROM > ( > SELECT col0, col1 FROM tab > ) AS t0 > INNER JOIN > ( > SELECT col0, col1 FROM tab > ) AS t1 > ON t0.col0 < t1.col0 AND t0.col1 > t1.col1 > {code} > we could still infer that col0 and col1 cannot be null for any of the inputs. > Currently we do not. -- This message was sent by Atlassian JIRA (v7.6.3#76005)