[jira] [Commented] (HIVE-18005) Improve size estimation for array() to be not 0
[ https://issues.apache.org/jira/browse/HIVE-18005?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16273324#comment-16273324 ] Vineet Garg commented on HIVE-18005: Looks good to me. +1 > Improve size estimation for array() to be not 0 > --- > > Key: HIVE-18005 > URL: https://issues.apache.org/jira/browse/HIVE-18005 > Project: Hive > Issue Type: Sub-task > Components: Statistics >Reporter: Zoltan Haindrich >Assignee: Zoltan Haindrich > Attachments: HIVE-18005.01.patch, HIVE-18005.01.patch, > HIVE-18005.02.patch > > > happens only in case the array is not from a column; and the array contains > no column references > {code} > EXPLAIN > SELECT sort_array(array("b", "d", "c", "a")),array("1","2") FROM t > ... > Statistics: Num rows: 1 Data size: 0 Basic stats: COMPLETE > Column stats: COMPLETE > ListSink > {code} -- This message was sent by Atlassian JIRA (v6.4.14#64029)
[jira] [Commented] (HIVE-18005) Improve size estimation for array() to be not 0
[ https://issues.apache.org/jira/browse/HIVE-18005?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16272561#comment-16272561 ] Zoltan Haindrich commented on HIVE-18005: - [~vgarg] could you please take a look? > Improve size estimation for array() to be not 0 > --- > > Key: HIVE-18005 > URL: https://issues.apache.org/jira/browse/HIVE-18005 > Project: Hive > Issue Type: Sub-task > Components: Statistics >Reporter: Zoltan Haindrich >Assignee: Zoltan Haindrich > Attachments: HIVE-18005.01.patch, HIVE-18005.01.patch, > HIVE-18005.02.patch > > > happens only in case the array is not from a column; and the array contains > no column references > {code} > EXPLAIN > SELECT sort_array(array("b", "d", "c", "a")),array("1","2") FROM t > ... > Statistics: Num rows: 1 Data size: 0 Basic stats: COMPLETE > Column stats: COMPLETE > ListSink > {code} -- This message was sent by Atlassian JIRA (v6.4.14#64029)
[jira] [Commented] (HIVE-18005) Improve size estimation for array() to be not 0
[ https://issues.apache.org/jira/browse/HIVE-18005?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16271516#comment-16271516 ] Zoltan Haindrich commented on HIVE-18005: - test failures are not related > Improve size estimation for array() to be not 0 > --- > > Key: HIVE-18005 > URL: https://issues.apache.org/jira/browse/HIVE-18005 > Project: Hive > Issue Type: Sub-task > Components: Statistics >Reporter: Zoltan Haindrich >Assignee: Zoltan Haindrich > Attachments: HIVE-18005.01.patch, HIVE-18005.01.patch, > HIVE-18005.02.patch > > > happens only in case the array is not from a column; and the array contains > no column references > {code} > EXPLAIN > SELECT sort_array(array("b", "d", "c", "a")),array("1","2") FROM t > ... > Statistics: Num rows: 1 Data size: 0 Basic stats: COMPLETE > Column stats: COMPLETE > ListSink > {code} -- This message was sent by Atlassian JIRA (v6.4.14#64029)
[jira] [Commented] (HIVE-18005) Improve size estimation for array() to be not 0
[ https://issues.apache.org/jira/browse/HIVE-18005?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16271322#comment-16271322 ] Hive QA commented on HIVE-18005: Here are the results of testing the latest attachment: https://issues.apache.org/jira/secure/attachment/12899840/HIVE-18005.02.patch {color:green}SUCCESS:{color} +1 due to 2 test(s) being added or modified. {color:red}ERROR:{color} -1 due to 10 failed/errored test(s), 11415 tests executed *Failed tests:* {noformat} org.apache.hadoop.hive.cli.TestCliDriver.testCliDriver[auto_sortmerge_join_2] (batchId=47) org.apache.hadoop.hive.cli.TestMiniLlapLocalCliDriver.testCliDriver[hybridgrace_hashjoin_2] (batchId=154) org.apache.hadoop.hive.cli.TestMiniLlapLocalCliDriver.testCliDriver[insert_values_orig_table_use_metadata] (batchId=162) org.apache.hadoop.hive.cli.TestMiniLlapLocalCliDriver.testCliDriver[llap_acid_fast] (batchId=157) org.apache.hadoop.hive.cli.TestMiniLlapLocalCliDriver.testCliDriver[resourceplan] (batchId=160) org.apache.hadoop.hive.cli.TestMiniLlapLocalCliDriver.testCliDriver[sysdb] (batchId=157) org.apache.hadoop.hive.ql.parse.TestReplicationScenarios.testConstraints (batchId=224) org.apache.hive.jdbc.TestSSL.testConnectionMismatch (batchId=230) org.apache.hive.jdbc.TestSSL.testConnectionWrongCertCN (batchId=230) org.apache.hive.jdbc.TestSSL.testMetastoreConnectionWrongCertCN (batchId=230) {noformat} Test results: https://builds.apache.org/job/PreCommit-HIVE-Build/8047/testReport Console output: https://builds.apache.org/job/PreCommit-HIVE-Build/8047/console Test logs: http://104.198.109.242/logs/PreCommit-HIVE-Build-8047/ Messages: {noformat} Executing org.apache.hive.ptest.execution.TestCheckPhase Executing org.apache.hive.ptest.execution.PrepPhase Executing org.apache.hive.ptest.execution.YetusPhase Executing org.apache.hive.ptest.execution.ExecutionPhase Executing org.apache.hive.ptest.execution.ReportingPhase Tests exited with: TestsFailedException: 10 tests failed {noformat} This message is automatically generated. ATTACHMENT ID: 12899840 - PreCommit-HIVE-Build > Improve size estimation for array() to be not 0 > --- > > Key: HIVE-18005 > URL: https://issues.apache.org/jira/browse/HIVE-18005 > Project: Hive > Issue Type: Sub-task > Components: Statistics >Reporter: Zoltan Haindrich >Assignee: Zoltan Haindrich > Attachments: HIVE-18005.01.patch, HIVE-18005.01.patch, > HIVE-18005.02.patch > > > happens only in case the array is not from a column; and the array contains > no column references > {code} > EXPLAIN > SELECT sort_array(array("b", "d", "c", "a")),array("1","2") FROM t > ... > Statistics: Num rows: 1 Data size: 0 Basic stats: COMPLETE > Column stats: COMPLETE > ListSink > {code} -- This message was sent by Atlassian JIRA (v6.4.14#64029)
[jira] [Commented] (HIVE-18005) Improve size estimation for array() to be not 0
[ https://issues.apache.org/jira/browse/HIVE-18005?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16271216#comment-16271216 ] Hive QA commented on HIVE-18005: | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem || Runtime || Comment || || || || || {color:brown} Prechecks {color} || | {color:blue}0{color} | {color:blue} findbugs {color} | {color:blue} 0m 0s{color} | {color:blue} Findbugs executables are not available. {color} | | {color:green}+1{color} | {color:green} @author {color} | {color:green} 0m 0s{color} | {color:green} The patch does not contain any @author tags. {color} | || || || || {color:brown} master Compile Tests {color} || | {color:blue}0{color} | {color:blue} mvndep {color} | {color:blue} 1m 13s{color} | {color:blue} Maven dependency ordering for branch {color} | | {color:green}+1{color} | {color:green} mvninstall {color} | {color:green} 4m 58s{color} | {color:green} master passed {color} | | {color:green}+1{color} | {color:green} compile {color} | {color:green} 1m 7s{color} | {color:green} master passed {color} | | {color:green}+1{color} | {color:green} checkstyle {color} | {color:green} 0m 43s{color} | {color:green} master passed {color} | | {color:green}+1{color} | {color:green} javadoc {color} | {color:green} 1m 2s{color} | {color:green} master passed {color} | || || || || {color:brown} Patch Compile Tests {color} || | {color:blue}0{color} | {color:blue} mvndep {color} | {color:blue} 0m 21s{color} | {color:blue} Maven dependency ordering for patch {color} | | {color:green}+1{color} | {color:green} mvninstall {color} | {color:green} 1m 35s{color} | {color:green} the patch passed {color} | | {color:green}+1{color} | {color:green} compile {color} | {color:green} 1m 10s{color} | {color:green} the patch passed {color} | | {color:green}+1{color} | {color:green} javac {color} | {color:green} 0m 9s{color} | {color:green} storage-api generated 0 new + 2 unchanged - 1 fixed = 2 total (was 3) {color} | | {color:green}+1{color} | {color:green} javac {color} | {color:green} 1m 1s{color} | {color:green} ql in the patch passed. {color} | | {color:green}+1{color} | {color:green} checkstyle {color} | {color:green} 0m 9s{color} | {color:green} storage-api: The patch generated 0 new + 35 unchanged - 4 fixed = 35 total (was 39) {color} | | {color:red}-1{color} | {color:red} checkstyle {color} | {color:red} 0m 34s{color} | {color:red} ql: The patch generated 1 new + 93 unchanged - 0 fixed = 94 total (was 93) {color} | | {color:green}+1{color} | {color:green} whitespace {color} | {color:green} 0m 0s{color} | {color:green} The patch has no whitespace issues. {color} | | {color:green}+1{color} | {color:green} javadoc {color} | {color:green} 1m 3s{color} | {color:green} the patch passed {color} | || || || || {color:brown} Other Tests {color} || | {color:green}+1{color} | {color:green} asflicense {color} | {color:green} 0m 12s{color} | {color:green} The patch does not generate ASF License warnings. {color} | | {color:black}{color} | {color:black} {color} | {color:black} 14m 32s{color} | {color:black} {color} | \\ \\ || Subsystem || Report/Notes || | Optional Tests | asflicense javac javadoc findbugs checkstyle compile | | uname | Linux hiveptest-server-upstream 3.16.0-4-amd64 #1 SMP Debian 3.16.36-1+deb8u1 (2016-09-03) x86_64 GNU/Linux | | Build tool | maven | | Personality | /data/hiveptest/working/yetus/dev-support/hive-personality.sh | | git revision | master / 65cd866 | | Default Java | 1.8.0_111 | | checkstyle | http://104.198.109.242/logs//PreCommit-HIVE-Build-8047/yetus/diff-checkstyle-ql.txt | | modules | C: storage-api ql U: . | | Console output | http://104.198.109.242/logs//PreCommit-HIVE-Build-8047/yetus.txt | | Powered by | Apache Yetushttp://yetus.apache.org | This message was automatically generated. > Improve size estimation for array() to be not 0 > --- > > Key: HIVE-18005 > URL: https://issues.apache.org/jira/browse/HIVE-18005 > Project: Hive > Issue Type: Sub-task > Components: Statistics >Reporter: Zoltan Haindrich >Assignee: Zoltan Haindrich > Attachments: HIVE-18005.01.patch, HIVE-18005.01.patch, > HIVE-18005.02.patch > > > happens only in case the array is not from a column; and the array contains > no column references > {code} > EXPLAIN > SELECT sort_array(array("b", "d", "c", "a")),array("1","2") FROM t > ... > Statistics: Num rows: 1 Data size: 0 Basic stats: COMPLETE > Column stats: COMPLETE > ListSink > {code} -- This message was sent by Atlassian JIRA (v6.4.14#64029)
[jira] [Commented] (HIVE-18005) Improve size estimation for array() to be not 0
[ https://issues.apache.org/jira/browse/HIVE-18005?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16269525#comment-16269525 ] Hive QA commented on HIVE-18005: Here are the results of testing the latest attachment: https://issues.apache.org/jira/secure/attachment/12899659/HIVE-18005.01.patch {color:green}SUCCESS:{color} +1 due to 2 test(s) being added or modified. {color:red}ERROR:{color} -1 due to 17 failed/errored test(s), 11415 tests executed *Failed tests:* {noformat} org.apache.hadoop.hive.cli.TestBeeLineDriver.testCliDriver[select_dummy_source] (batchId=244) org.apache.hadoop.hive.cli.TestCliDriver.testCliDriver[lateral_view_onview2] (batchId=21) org.apache.hadoop.hive.cli.TestCliDriver.testCliDriver[lateral_view_onview] (batchId=57) org.apache.hadoop.hive.cli.TestCliDriver.testCliDriver[select_dummy_source] (batchId=22) org.apache.hadoop.hive.cli.TestCliDriver.testCliDriver[udf_array] (batchId=64) org.apache.hadoop.hive.cli.TestCliDriver.testCliDriver[udf_sort_array] (batchId=64) org.apache.hadoop.hive.cli.TestCliDriver.testCliDriver[udf_split] (batchId=39) org.apache.hadoop.hive.cli.TestMiniLlapLocalCliDriver.testCliDriver[hybridgrace_hashjoin_2] (batchId=154) org.apache.hadoop.hive.cli.TestMiniLlapLocalCliDriver.testCliDriver[insert_values_orig_table_use_metadata] (batchId=162) org.apache.hadoop.hive.cli.TestMiniLlapLocalCliDriver.testCliDriver[llap_acid_fast] (batchId=157) org.apache.hadoop.hive.cli.TestMiniLlapLocalCliDriver.testCliDriver[resourceplan] (batchId=160) org.apache.hadoop.hive.cli.TestMiniLlapLocalCliDriver.testCliDriver[sysdb] (batchId=157) org.apache.hadoop.hive.ql.parse.TestReplicationScenarios.testConstraints (batchId=224) org.apache.hive.hcatalog.templeton.TestConcurrentJobRequestsThreadsAndTimeout.ConcurrentListJobsTimeOutException (batchId=186) org.apache.hive.jdbc.TestSSL.testConnectionMismatch (batchId=230) org.apache.hive.jdbc.TestSSL.testConnectionWrongCertCN (batchId=230) org.apache.hive.jdbc.TestSSL.testMetastoreConnectionWrongCertCN (batchId=230) {noformat} Test results: https://builds.apache.org/job/PreCommit-HIVE-Build/8028/testReport Console output: https://builds.apache.org/job/PreCommit-HIVE-Build/8028/console Test logs: http://104.198.109.242/logs/PreCommit-HIVE-Build-8028/ Messages: {noformat} Executing org.apache.hive.ptest.execution.TestCheckPhase Executing org.apache.hive.ptest.execution.PrepPhase Executing org.apache.hive.ptest.execution.YetusPhase Executing org.apache.hive.ptest.execution.ExecutionPhase Executing org.apache.hive.ptest.execution.ReportingPhase Tests exited with: TestsFailedException: 17 tests failed {noformat} This message is automatically generated. ATTACHMENT ID: 12899659 - PreCommit-HIVE-Build > Improve size estimation for array() to be not 0 > --- > > Key: HIVE-18005 > URL: https://issues.apache.org/jira/browse/HIVE-18005 > Project: Hive > Issue Type: Sub-task > Components: Statistics >Reporter: Zoltan Haindrich >Assignee: Zoltan Haindrich > Attachments: HIVE-18005.01.patch, HIVE-18005.01.patch > > > happens only in case the array is not from a column; and the array contains > no column references > {code} > EXPLAIN > SELECT sort_array(array("b", "d", "c", "a")),array("1","2") FROM t > ... > Statistics: Num rows: 1 Data size: 0 Basic stats: COMPLETE > Column stats: COMPLETE > ListSink > {code} -- This message was sent by Atlassian JIRA (v6.4.14#64029)
[jira] [Commented] (HIVE-18005) Improve size estimation for array() to be not 0
[ https://issues.apache.org/jira/browse/HIVE-18005?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16269461#comment-16269461 ] Hive QA commented on HIVE-18005: | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem || Runtime || Comment || || || || || {color:brown} Prechecks {color} || | {color:blue}0{color} | {color:blue} findbugs {color} | {color:blue} 0m 0s{color} | {color:blue} Findbugs executables are not available. {color} | | {color:green}+1{color} | {color:green} @author {color} | {color:green} 0m 1s{color} | {color:green} The patch does not contain any @author tags. {color} | || || || || {color:brown} master Compile Tests {color} || | {color:blue}0{color} | {color:blue} mvndep {color} | {color:blue} 1m 8s{color} | {color:blue} Maven dependency ordering for branch {color} | | {color:green}+1{color} | {color:green} mvninstall {color} | {color:green} 5m 8s{color} | {color:green} master passed {color} | | {color:green}+1{color} | {color:green} compile {color} | {color:green} 1m 11s{color} | {color:green} master passed {color} | | {color:green}+1{color} | {color:green} checkstyle {color} | {color:green} 0m 45s{color} | {color:green} master passed {color} | | {color:green}+1{color} | {color:green} javadoc {color} | {color:green} 1m 5s{color} | {color:green} master passed {color} | || || || || {color:brown} Patch Compile Tests {color} || | {color:blue}0{color} | {color:blue} mvndep {color} | {color:blue} 0m 22s{color} | {color:blue} Maven dependency ordering for patch {color} | | {color:green}+1{color} | {color:green} mvninstall {color} | {color:green} 1m 36s{color} | {color:green} the patch passed {color} | | {color:green}+1{color} | {color:green} compile {color} | {color:green} 1m 11s{color} | {color:green} the patch passed {color} | | {color:green}+1{color} | {color:green} javac {color} | {color:green} 0m 9s{color} | {color:green} storage-api generated 0 new + 2 unchanged - 1 fixed = 2 total (was 3) {color} | | {color:green}+1{color} | {color:green} javac {color} | {color:green} 1m 2s{color} | {color:green} ql in the patch passed. {color} | | {color:green}+1{color} | {color:green} checkstyle {color} | {color:green} 0m 9s{color} | {color:green} storage-api: The patch generated 0 new + 35 unchanged - 4 fixed = 35 total (was 39) {color} | | {color:red}-1{color} | {color:red} checkstyle {color} | {color:red} 0m 36s{color} | {color:red} ql: The patch generated 1 new + 93 unchanged - 0 fixed = 94 total (was 93) {color} | | {color:green}+1{color} | {color:green} whitespace {color} | {color:green} 0m 0s{color} | {color:green} The patch has no whitespace issues. {color} | | {color:green}+1{color} | {color:green} javadoc {color} | {color:green} 1m 7s{color} | {color:green} the patch passed {color} | || || || || {color:brown} Other Tests {color} || | {color:green}+1{color} | {color:green} asflicense {color} | {color:green} 0m 13s{color} | {color:green} The patch does not generate ASF License warnings. {color} | | {color:black}{color} | {color:black} {color} | {color:black} 14m 58s{color} | {color:black} {color} | \\ \\ || Subsystem || Report/Notes || | Optional Tests | asflicense javac javadoc findbugs checkstyle compile | | uname | Linux hiveptest-server-upstream 3.16.0-4-amd64 #1 SMP Debian 3.16.36-1+deb8u1 (2016-09-03) x86_64 GNU/Linux | | Build tool | maven | | Personality | /data/hiveptest/working/yetus/dev-support/hive-personality.sh | | git revision | master / 5add3a7 | | Default Java | 1.8.0_111 | | checkstyle | http://104.198.109.242/logs//PreCommit-HIVE-Build-8028/yetus/diff-checkstyle-ql.txt | | modules | C: storage-api ql U: . | | Console output | http://104.198.109.242/logs//PreCommit-HIVE-Build-8028/yetus.txt | | Powered by | Apache Yetushttp://yetus.apache.org | This message was automatically generated. > Improve size estimation for array() to be not 0 > --- > > Key: HIVE-18005 > URL: https://issues.apache.org/jira/browse/HIVE-18005 > Project: Hive > Issue Type: Sub-task > Components: Statistics >Reporter: Zoltan Haindrich >Assignee: Zoltan Haindrich > Attachments: HIVE-18005.01.patch, HIVE-18005.01.patch > > > happens only in case the array is not from a column; and the array contains > no column references > {code} > EXPLAIN > SELECT sort_array(array("b", "d", "c", "a")),array("1","2") FROM t > ... > Statistics: Num rows: 1 Data size: 0 Basic stats: COMPLETE > Column stats: COMPLETE > ListSink > {code} -- This message was sent by Atlassian JIRA (v6.4.14#64029)
[jira] [Commented] (HIVE-18005) Improve size estimation for array() to be not 0
[ https://issues.apache.org/jira/browse/HIVE-18005?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16267014#comment-16267014 ] Hive QA commented on HIVE-18005: Here are the results of testing the latest attachment: https://issues.apache.org/jira/secure/attachment/12899417/HIVE-18005.01.patch {color:red}ERROR:{color} -1 due to build exiting with an error Test results: https://builds.apache.org/job/PreCommit-HIVE-Build/8003/testReport Console output: https://builds.apache.org/job/PreCommit-HIVE-Build/8003/console Test logs: http://104.198.109.242/logs/PreCommit-HIVE-Build-8003/ Messages: {noformat} Executing org.apache.hive.ptest.execution.TestCheckPhase Executing org.apache.hive.ptest.execution.PrepPhase Executing org.apache.hive.ptest.execution.YetusPhase Executing org.apache.hive.ptest.execution.ExecutionPhase Tests exited with: ExecutionException: java.util.concurrent.ExecutionException: org.apache.hive.ptest.execution.ssh.SSHExecutionException: RSyncResult [localFile=/data/hiveptest/logs/PreCommit-HIVE-Build-8003/succeeded/202_UTBatch_service_8_tests, remoteFile=/home/hiveptest/35.192.234.250-hiveptest-0/logs/, getExitCode()=255, getException()=null, getUser()=hiveptest, getHost()=35.192.234.250, getInstance()=0]: 'Warning: Permanently added '35.192.234.250' (ECDSA) to the list of known hosts. receiving incremental file list ./ TEST-202_UTBatch_service_8_tests-TEST-org.apache.hive.service.auth.TestLdapAtnProviderWithMiniDS.xml 0 0%0.00kB/s0:00:00 92,069 100%1.29MB/s0:00:00 (xfr#1, to-chk=12/14) TEST-202_UTBatch_service_8_tests-TEST-org.apache.hive.service.auth.ldap.TestCustomQueryFilter.xml 0 0%0.00kB/s0:00:00 88,032 100% 842.83kB/s0:00:00 (xfr#2, to-chk=11/14) TEST-202_UTBatch_service_8_tests-TEST-org.apache.hive.service.auth.ldap.TestQuery.xml 0 0%0.00kB/s0:00:00 88,018 100% 834.52kB/s0:00:00 (xfr#3, to-chk=10/14) TEST-202_UTBatch_service_8_tests-TEST-org.apache.hive.service.auth.ldap.TestUserFilter.xml 0 0%0.00kB/s0:00:00 88,002 100% 834.36kB/s0:00:00 (xfr#4, to-chk=9/14) TEST-202_UTBatch_service_8_tests-TEST-org.apache.hive.service.auth.ldap.TestUserSearchFilter.xml 0 0%0.00kB/s0:00:00 88,441 100% 630.42kB/s0:00:00 (xfr#5, to-chk=8/14) TEST-202_UTBatch_service_8_tests-TEST-org.apache.hive.service.cli.TestCLIServiceConnectionLimits.xml 0 0%0.00kB/s0:00:00 89,312 100% 636.63kB/s0:00:00 (xfr#6, to-chk=7/14) TEST-202_UTBatch_service_8_tests-TEST-org.apache.hive.service.cli.TestCLIServiceRestore.xml 0 0%0.00kB/s0:00:00 87,779 100% 621.17kB/s0:00:00 (xfr#7, to-chk=6/14) TEST-202_UTBatch_service_8_tests-TEST-org.apache.hive.service.cli.TestHiveSQLException.xml 0 0%0.00kB/s0:00:00 88,523 100% 621.93kB/s0:00:00 (xfr#8, to-chk=5/14) maven-test.txt 0 0%0.00kB/s0:00:00 5,950 100% 41.80kB/s0:00:00 (xfr#9, to-chk=4/14) logs/ logs/derby.log 0 0%0.00kB/s0:00:00 989 100%6.95kB/s0:00:00 (xfr#10, to-chk=1/14) logs/hive.log 0 0%0.00kB/s0:00:00 35,127,296 0% 33.50MB/s0:02:02 91,193,344 2% 43.51MB/s0:01:32 148,045,824 3% 47.06MB/s0:01:24 205,291,520 4% 48.95MB/s0:01:20 262,668,288 6% 54.17MB/s0:01:11 320,143,360 7% 54.48MB/s0:01:10 377,585,664 8% 54.60MB/s0:01:08 434,470,912 10% 54.50MB/s0:01:08 491,978,752 11% 54.54MB/s0:01:06 549,322,752 12% 54.53MB/s0:01:05 606,535,680 14% 54.46MB/s0:01:04 663,715,840 15% 54.56MB/s0:01:03 721,551,360 17% 54.58MB/s0:01:02 779,321,344 18% 54.69MB/s0:01:01 836,501,504 19% 54.72MB/s0:01:00 873,431,040 20% 49.78MB/s0:01:05 917,798,912 21% 46.68MB/s0:01:09 966,066,176 22% 44.38MB/s0:01:11 1,017,806,848 24% 43.05MB/s0:01:12 1,071,906,816 25% 47.26MB/s0:01:05 1,127,317,504 26% 49.92MB/s0:01:00 1,183,547,392 27% 51.85MB/s0:00:57 1,239,875,584 29% 52.97MB/s0:00:55 1,296,859,136 30% 53.63MB/s0:00:53 1,343,520,768 31% 51.43MB/s0:00:54 1,401,126,912 33% 51.68MB/s0:00:53 1,458,765,824 34% 51.99MB/s0:00:52 1,516,175,360 35% 52.12MB/s0:00:50 1,573,748,736 37% 54.86MB/s0:00:47 1,621,327,872 38% 52.50MB/s0:00:48 1,666,121,728 39% 49.34MB/s0:00:50 1,717,272,576 40% 47.85MB/s0:00:51 1,764,950,016 41% 45.49MB/s0:00:52 1,819,017,216 42% 46.45MB/s0:00:50 1,867,776,000 44%
[jira] [Commented] (HIVE-18005) Improve size estimation for array() to be not 0
[ https://issues.apache.org/jira/browse/HIVE-18005?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16266958#comment-16266958 ] Hive QA commented on HIVE-18005: | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem || Runtime || Comment || || || || || {color:brown} Prechecks {color} || | {color:blue}0{color} | {color:blue} findbugs {color} | {color:blue} 0m 0s{color} | {color:blue} Findbugs executables are not available. {color} | | {color:green}+1{color} | {color:green} @author {color} | {color:green} 0m 0s{color} | {color:green} The patch does not contain any @author tags. {color} | || || || || {color:brown} master Compile Tests {color} || | {color:blue}0{color} | {color:blue} mvndep {color} | {color:blue} 0m 51s{color} | {color:blue} Maven dependency ordering for branch {color} | | {color:green}+1{color} | {color:green} mvninstall {color} | {color:green} 5m 58s{color} | {color:green} master passed {color} | | {color:green}+1{color} | {color:green} compile {color} | {color:green} 1m 10s{color} | {color:green} master passed {color} | | {color:green}+1{color} | {color:green} checkstyle {color} | {color:green} 0m 40s{color} | {color:green} master passed {color} | | {color:green}+1{color} | {color:green} javadoc {color} | {color:green} 1m 2s{color} | {color:green} master passed {color} | || || || || {color:brown} Patch Compile Tests {color} || | {color:blue}0{color} | {color:blue} mvndep {color} | {color:blue} 0m 22s{color} | {color:blue} Maven dependency ordering for patch {color} | | {color:green}+1{color} | {color:green} mvninstall {color} | {color:green} 1m 28s{color} | {color:green} the patch passed {color} | | {color:green}+1{color} | {color:green} compile {color} | {color:green} 1m 11s{color} | {color:green} the patch passed {color} | | {color:green}+1{color} | {color:green} javac {color} | {color:green} 0m 9s{color} | {color:green} storage-api generated 0 new + 2 unchanged - 1 fixed = 2 total (was 3) {color} | | {color:green}+1{color} | {color:green} javac {color} | {color:green} 1m 2s{color} | {color:green} ql in the patch passed. {color} | | {color:green}+1{color} | {color:green} checkstyle {color} | {color:green} 0m 10s{color} | {color:green} storage-api: The patch generated 0 new + 35 unchanged - 4 fixed = 35 total (was 39) {color} | | {color:red}-1{color} | {color:red} checkstyle {color} | {color:red} 0m 36s{color} | {color:red} ql: The patch generated 1 new + 93 unchanged - 0 fixed = 94 total (was 93) {color} | | {color:green}+1{color} | {color:green} whitespace {color} | {color:green} 0m 0s{color} | {color:green} The patch has no whitespace issues. {color} | | {color:green}+1{color} | {color:green} javadoc {color} | {color:green} 1m 4s{color} | {color:green} the patch passed {color} | || || || || {color:brown} Other Tests {color} || | {color:green}+1{color} | {color:green} asflicense {color} | {color:green} 0m 13s{color} | {color:green} The patch does not generate ASF License warnings. {color} | | {color:black}{color} | {color:black} {color} | {color:black} 15m 2s{color} | {color:black} {color} | \\ \\ || Subsystem || Report/Notes || | Optional Tests | asflicense javac javadoc findbugs checkstyle compile | | uname | Linux hiveptest-server-upstream 3.16.0-4-amd64 #1 SMP Debian 3.16.36-1+deb8u1 (2016-09-03) x86_64 GNU/Linux | | Build tool | maven | | Personality | /data/hiveptest/working/yetus/dev-support/hive-personality.sh | | git revision | master / be1f847 | | Default Java | 1.8.0_111 | | checkstyle | http://104.198.109.242/logs//PreCommit-HIVE-Build-8003/yetus/diff-checkstyle-ql.txt | | modules | C: storage-api ql U: . | | Console output | http://104.198.109.242/logs//PreCommit-HIVE-Build-8003/yetus.txt | | Powered by | Apache Yetushttp://yetus.apache.org | This message was automatically generated. > Improve size estimation for array() to be not 0 > --- > > Key: HIVE-18005 > URL: https://issues.apache.org/jira/browse/HIVE-18005 > Project: Hive > Issue Type: Sub-task > Components: Statistics >Reporter: Zoltan Haindrich >Assignee: Zoltan Haindrich > Attachments: HIVE-18005.01.patch > > > happens only in case the array is not from a column; and the array contains > no column references > {code} > EXPLAIN > SELECT sort_array(array("b", "d", "c", "a")),array("1","2") FROM t > ... > Statistics: Num rows: 1 Data size: 0 Basic stats: COMPLETE > Column stats: COMPLETE > ListSink > {code} -- This message was sent by Atlassian JIRA (v6.4.14#64029)
[jira] [Commented] (HIVE-18005) Improve size estimation for array() to be not 0
[ https://issues.apache.org/jira/browse/HIVE-18005?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16243833#comment-16243833 ] Zoltan Haindrich commented on HIVE-18005: - possible cause or related: {{StatsUtils.getDataSizeFromColumnStats}} sizeof shouldn't be 0 if a column is found > Improve size estimation for array() to be not 0 > --- > > Key: HIVE-18005 > URL: https://issues.apache.org/jira/browse/HIVE-18005 > Project: Hive > Issue Type: Bug > Components: Statistics >Reporter: Zoltan Haindrich > > happens only in case the array is not from a column; and the array contains > no column references > {code} > EXPLAIN > SELECT sort_array(array("b", "d", "c", "a")),array("1","2") FROM t > ... > Statistics: Num rows: 1 Data size: 0 Basic stats: COMPLETE > Column stats: COMPLETE > ListSink > {code} -- This message was sent by Atlassian JIRA (v6.4.14#64029)