[jira] [Commented] (HIVE-22248) Min value for column in stats is not set correctly for some data types
[
https://issues.apache.org/jira/browse/HIVE-22248?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16943344#comment-16943344
]
Hive QA commented on HIVE-22248:
| (/) *{color:green}+1 overall{color}* |
\\
\\
|| Vote || Subsystem || Runtime || Comment ||
|| || || || {color:brown} Prechecks {color} ||
| {color:green}+1{color} | {color:green} @author {color} | {color:green} 0m
0s{color} | {color:green} The patch does not contain any @author tags. {color} |
|| || || || {color:brown} master Compile Tests {color} ||
| {color:blue}0{color} | {color:blue} mvndep {color} | {color:blue} 1m
42s{color} | {color:blue} Maven dependency ordering for branch {color} |
| {color:green}+1{color} | {color:green} mvninstall {color} | {color:green} 7m
26s{color} | {color:green} master passed {color} |
| {color:green}+1{color} | {color:green} compile {color} | {color:green} 1m
36s{color} | {color:green} master passed {color} |
| {color:green}+1{color} | {color:green} checkstyle {color} | {color:green} 0m
54s{color} | {color:green} master passed {color} |
| {color:blue}0{color} | {color:blue} findbugs {color} | {color:blue} 1m
15s{color} | {color:blue} standalone-metastore/metastore-server in master has
170 extant Findbugs warnings. {color} |
| {color:blue}0{color} | {color:blue} findbugs {color} | {color:blue} 4m
8s{color} | {color:blue} ql in master has 1551 extant Findbugs warnings.
{color} |
| {color:green}+1{color} | {color:green} javadoc {color} | {color:green} 1m
19s{color} | {color:green} master passed {color} |
|| || || || {color:brown} Patch Compile Tests {color} ||
| {color:blue}0{color} | {color:blue} mvndep {color} | {color:blue} 0m
28s{color} | {color:blue} Maven dependency ordering for patch {color} |
| {color:green}+1{color} | {color:green} mvninstall {color} | {color:green} 2m
5s{color} | {color:green} the patch passed {color} |
| {color:green}+1{color} | {color:green} compile {color} | {color:green} 1m
34s{color} | {color:green} the patch passed {color} |
| {color:green}+1{color} | {color:green} javac {color} | {color:green} 1m
34s{color} | {color:green} the patch passed {color} |
| {color:green}+1{color} | {color:green} checkstyle {color} | {color:green} 0m
55s{color} | {color:green} the patch passed {color} |
| {color:green}+1{color} | {color:green} whitespace {color} | {color:green} 0m
0s{color} | {color:green} The patch has no whitespace issues. {color} |
| {color:green}+1{color} | {color:green} findbugs {color} | {color:green} 5m
53s{color} | {color:green} the patch passed {color} |
| {color:green}+1{color} | {color:green} javadoc {color} | {color:green} 1m
22s{color} | {color:green} the patch passed {color} |
|| || || || {color:brown} Other Tests {color} ||
| {color:green}+1{color} | {color:green} asflicense {color} | {color:green} 0m
15s{color} | {color:green} The patch does not generate ASF License warnings.
{color} |
| {color:black}{color} | {color:black} {color} | {color:black} 31m 41s{color} |
{color:black} {color} |
\\
\\
|| Subsystem || Report/Notes ||
| Optional Tests | asflicense javac javadoc findbugs checkstyle compile |
| uname | Linux hiveptest-server-upstream 3.16.0-4-amd64 #1 SMP Debian
3.16.43-2+deb8u5 (2017-09-19) x86_64 GNU/Linux |
| Build tool | maven |
| Personality |
/data/hiveptest/working/yetus_PreCommit-HIVE-Build-18839/dev-support/hive-personality.sh
|
| git revision | master / 155f829 |
| Default Java | 1.8.0_111 |
| findbugs | v3.0.0 |
| modules | C: standalone-metastore/metastore-server ql U: . |
| Console output |
http://104.198.109.242/logs//PreCommit-HIVE-Build-18839/yetus.txt |
| Powered by | Apache Yetushttp://yetus.apache.org |
This message was automatically generated.
> Min value for column in stats is not set correctly for some data types
> --
>
> Key: HIVE-22248
> URL: https://issues.apache.org/jira/browse/HIVE-22248
> Project: Hive
> Issue Type: Bug
> Components: Statistics
>Reporter: Jesus Camacho Rodriguez
>Assignee: Miklos Gergely
>Priority: Major
> Labels: pull-request-available
> Attachments: HIVE-22248.01.patch, HIVE-22248.02.patch
>
> Time Spent: 20m
> Remaining Estimate: 0h
>
> I am not sure whether the problem is printing the value or in the value
> stored in the metastore itself, but for some types (e.g. tinyint, smallint,
> int, bigint, double or float), the min value does not seem to be set
> correctly (set to 0).
> https://github.com/apache/hive/blob/master/ql/src/test/results/clientpositive/alter_table_update_status.q.out#L342
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
[jira] [Commented] (HIVE-22270) Upgrade commons-io to 2.6
[
https://issues.apache.org/jira/browse/HIVE-22270?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16943331#comment-16943331
]
Hive QA commented on HIVE-22270:
Here are the results of testing the latest attachment:
https://issues.apache.org/jira/secure/attachment/12982013/HIVE-22270.patch
{color:red}ERROR:{color} -1 due to no test(s) being added or modified.
{color:red}ERROR:{color} -1 due to 6 failed/errored test(s), 17168 tests
executed
*Failed tests:*
{noformat}
org.apache.hadoop.hive.cli.TestCliDriver.testCliDriver[infer_bucket_sort_num_buckets]
(batchId=67)
org.apache.hadoop.hive.cli.TestMiniLlapCliDriver.testCliDriver[rcfile_merge2]
(batchId=159)
org.apache.hadoop.hive.cli.TestMiniLlapLocalCliDriver.testCliDriver[materialized_view_partitioned]
(batchId=186)
org.apache.hadoop.hive.cli.TestMiniLlapLocalCliDriver.testCliDriver[partition_ctas]
(batchId=173)
org.apache.hadoop.hive.cli.TestMiniSparkOnYarnCliDriver.testCliDriver[infer_bucket_sort_num_buckets]
(batchId=194)
org.apache.hadoop.hive.cli.TestSparkCliDriver.testCliDriver[load_dyn_part2]
(batchId=140)
{noformat}
Test results:
https://builds.apache.org/job/PreCommit-HIVE-Build/18838/testReport
Console output: https://builds.apache.org/job/PreCommit-HIVE-Build/18838/console
Test logs: http://104.198.109.242/logs/PreCommit-HIVE-Build-18838/
Messages:
{noformat}
Executing org.apache.hive.ptest.execution.TestCheckPhase
Executing org.apache.hive.ptest.execution.PrepPhase
Executing org.apache.hive.ptest.execution.YetusPhase
Executing org.apache.hive.ptest.execution.ExecutionPhase
Executing org.apache.hive.ptest.execution.ReportingPhase
Tests exited with: TestsFailedException: 6 tests failed
{noformat}
This message is automatically generated.
ATTACHMENT ID: 12982013 - PreCommit-HIVE-Build
> Upgrade commons-io to 2.6
> -
>
> Key: HIVE-22270
> URL: https://issues.apache.org/jira/browse/HIVE-22270
> Project: Hive
> Issue Type: Improvement
>Reporter: David Lavati
>Assignee: David Lavati
>Priority: Major
> Labels: pull-request-available
> Attachments: HIVE-22270.patch, HIVE-22270.patch, HIVE-22270.patch,
> HIVE-22270.patch
>
> Time Spent: 10m
> Remaining Estimate: 0h
>
> Hive's currently using commons-io 2.4 and according to HIVE-21273, a number
> of issues are present in it, which can be resolved by upgrading to 2.6:
> IOUtils copyLarge() and skip() methods are performance hogs
> affectsVersions:2.3;2.4
>
> [https://issues.apache.org/jira/projects/IO/issues/IO-355?filter=allopenissues]
> CharSequenceInputStream#reset() behaves incorrectly in case when buffer size
> is not dividable by data size
> affectsVersions:2.4
>
> [https://issues.apache.org/jira/projects/IO/issues/IO-356?filter=allopenissues]
> [Tailer] InterruptedException while the thead is sleeping is silently ignored
> affectsVersions:2.4
>
> [https://issues.apache.org/jira/projects/IO/issues/IO-357?filter=allopenissues]
> IOUtils.contentEquals* methods returns false if input1 == input2; should
> return true
> affectsVersions:2.4
>
> [https://issues.apache.org/jira/projects/IO/issues/IO-362?filter=allopenissues]
> Apache Commons - standard links for documents are failing
> affectsVersions:2.4
>
> [https://issues.apache.org/jira/projects/IO/issues/IO-369?filter=allopenissues]
> FileUtils.sizeOfDirectoryAsBigInteger can overflow
> affectsVersions:2.4
>
> [https://issues.apache.org/jira/projects/IO/issues/IO-390?filter=allopenissues]
> Regression in FileUtils.readFileToString from 2.0.1
> affectsVersions:2.1;2.2;2.3;2.4
>
> [https://issues.apache.org/jira/projects/IO/issues/IO-453?filter=allopenissues]
> Correct exception message in FileUtils.getFile(File; String...)
> affectsVersions:2.4
>
> [https://issues.apache.org/jira/projects/IO/issues/IO-479?filter=allopenissues]
> org.apache.commons.io.FileUtils#waitFor waits too long
> affectsVersions:2.4
>
> [https://issues.apache.org/jira/projects/IO/issues/IO-481?filter=allopenissues]
> FilenameUtils should handle embedded null bytes
> affectsVersions:2.4
>
> [https://issues.apache.org/jira/projects/IO/issues/IO-484?filter=allopenissues]
> Exceptions are suppressed incorrectly when copying files.
> affectsVersions:2.4;2.5
>
> [https://issues.apache.org/jira/projects/IO/issues/IO-502?filter=allopenissues]
>
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
[jira] [Commented] (HIVE-22238) PK/FK selectivity estimation underscales estimations
[ https://issues.apache.org/jira/browse/HIVE-22238?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16943328#comment-16943328 ] Jesus Camacho Rodriguez commented on HIVE-22238: [~kgyrtkirk], reading the description of the issue, it seems this is expected since the FK input may be filtered, e.g., by a Filter condition in that input, while the FK-PK join may filter it again based on the condition in the PK side? > PK/FK selectivity estimation underscales estimations > > > Key: HIVE-22238 > URL: https://issues.apache.org/jira/browse/HIVE-22238 > Project: Hive > Issue Type: Bug > Components: Statistics >Reporter: Zoltan Haindrich >Assignee: Zoltan Haindrich >Priority: Major > Attachments: HIVE-22238.01.patch > > > at [this > point|https://github.com/apache/hive/blob/5098d155a1e6a164253f5fa98755273bc34085df/ql/src/java/org/apache/hadoop/hive/ql/optimizer/stats/annotation/StatsRulesProcFactory.java#L2182] > the parent operators rownum is scaled according to pkfkselectivity > however [pkfkselectivity is > computed|https://github.com/apache/hive/blob/5098d155a1e6a164253f5fa98755273bc34085df/ql/src/java/org/apache/hadoop/hive/ql/optimizer/stats/annotation/StatsRulesProcFactory.java#L2157] > on a whole subtree. > Scaling it by that amount will count in estimation already used when > parentstats was calculated...so depending on the number of upstream joins - > this may lead to severe underestimations -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Commented] (HIVE-22207) Tez: SplitGenerator throws NumberFormatException when "dfs.block.size" on cluster is "128m"
[
https://issues.apache.org/jira/browse/HIVE-22207?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16943321#comment-16943321
]
Sankar Hariappan commented on HIVE-22207:
-
Committed to master. Thanks [~nareshpr] for the patch!
> Tez: SplitGenerator throws NumberFormatException when "dfs.block.size" on
> cluster is "128m"
> ---
>
> Key: HIVE-22207
> URL: https://issues.apache.org/jira/browse/HIVE-22207
> Project: Hive
> Issue Type: Bug
> Components: Hive, Tez
>Affects Versions: 2.1.0, 3.1.0
>Reporter: Praneet Sharma
>Assignee: Naresh P R
>Priority: Major
> Fix For: 4.0.0
>
> Attachments: HIVE-22207.1.patch, HIVE-22207.2.patch, HIVE-22207.patch
>
>
> When the value of "dfs.block.size" on the cluster is "128m" in place of
> actual bytes as Long, then Tez job fails with NumberFormatException:
> {code:java}
> java.lang.NumberFormatException: For input string: "128m" at
> java.lang.NumberFormatException.forInputString(NumberFormatException.java:65)
> at java.lang.Long.parseLong(Long.java:589) at
> java.lang.Long.parseLong(Long.java:631) at
> org.apache.hadoop.conf.Configuration.getLong(Configuration.java:1539) at
> org.apache.hadoop.hive.ql.exec.tez.HiveSplitGenerator.initialize(HiveSplitGenerator.java:194)
> at
> org.apache.tez.dag.app.dag.RootInputInitializerManager$InputInitializerCallable$1.run(RootInputInitializerManager.java:278)
> at
> org.apache.tez.dag.app.dag.RootInputInitializerManager$InputInitializerCallable$1.run(RootInputInitializerManager.java:269)
> {code}
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
[jira] [Updated] (HIVE-22207) Tez: SplitGenerator throws NumberFormatException when "dfs.block.size" on cluster is "128m"
[
https://issues.apache.org/jira/browse/HIVE-22207?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Sankar Hariappan updated HIVE-22207:
Fix Version/s: 4.0.0
Resolution: Fixed
Status: Resolved (was: Patch Available)
+1
> Tez: SplitGenerator throws NumberFormatException when "dfs.block.size" on
> cluster is "128m"
> ---
>
> Key: HIVE-22207
> URL: https://issues.apache.org/jira/browse/HIVE-22207
> Project: Hive
> Issue Type: Bug
> Components: Hive, Tez
>Affects Versions: 2.1.0, 3.1.0
>Reporter: Praneet Sharma
>Assignee: Naresh P R
>Priority: Major
> Fix For: 4.0.0
>
> Attachments: HIVE-22207.1.patch, HIVE-22207.2.patch, HIVE-22207.patch
>
>
> When the value of "dfs.block.size" on the cluster is "128m" in place of
> actual bytes as Long, then Tez job fails with NumberFormatException:
> {code:java}
> java.lang.NumberFormatException: For input string: "128m" at
> java.lang.NumberFormatException.forInputString(NumberFormatException.java:65)
> at java.lang.Long.parseLong(Long.java:589) at
> java.lang.Long.parseLong(Long.java:631) at
> org.apache.hadoop.conf.Configuration.getLong(Configuration.java:1539) at
> org.apache.hadoop.hive.ql.exec.tez.HiveSplitGenerator.initialize(HiveSplitGenerator.java:194)
> at
> org.apache.tez.dag.app.dag.RootInputInitializerManager$InputInitializerCallable$1.run(RootInputInitializerManager.java:278)
> at
> org.apache.tez.dag.app.dag.RootInputInitializerManager$InputInitializerCallable$1.run(RootInputInitializerManager.java:269)
> {code}
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
[jira] [Commented] (HIVE-22270) Upgrade commons-io to 2.6
[
https://issues.apache.org/jira/browse/HIVE-22270?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16943314#comment-16943314
]
Hive QA commented on HIVE-22270:
| (x) *{color:red}-1 overall{color}* |
\\
\\
|| Vote || Subsystem || Runtime || Comment ||
|| || || || {color:brown} Prechecks {color} ||
| {color:green}+1{color} | {color:green} @author {color} | {color:green} 0m
0s{color} | {color:green} The patch does not contain any @author tags. {color} |
|| || || || {color:brown} master Compile Tests {color} ||
| {color:blue}0{color} | {color:blue} mvndep {color} | {color:blue} 1m
50s{color} | {color:blue} Maven dependency ordering for branch {color} |
| {color:green}+1{color} | {color:green} mvninstall {color} | {color:green} 7m
51s{color} | {color:green} master passed {color} |
| {color:green}+1{color} | {color:green} compile {color} | {color:green} 6m
43s{color} | {color:green} master passed {color} |
| {color:green}+1{color} | {color:green} javadoc {color} | {color:green} 6m
44s{color} | {color:green} master passed {color} |
|| || || || {color:brown} Patch Compile Tests {color} ||
| {color:blue}0{color} | {color:blue} mvndep {color} | {color:blue} 0m
26s{color} | {color:blue} Maven dependency ordering for patch {color} |
| {color:green}+1{color} | {color:green} mvninstall {color} | {color:green} 7m
33s{color} | {color:green} the patch passed {color} |
| {color:green}+1{color} | {color:green} compile {color} | {color:green} 6m
56s{color} | {color:green} the patch passed {color} |
| {color:green}+1{color} | {color:green} javac {color} | {color:green} 6m
56s{color} | {color:green} the patch passed {color} |
| {color:green}+1{color} | {color:green} whitespace {color} | {color:green} 0m
0s{color} | {color:green} The patch has no whitespace issues. {color} |
| {color:green}+1{color} | {color:green} xml {color} | {color:green} 0m
2s{color} | {color:green} The patch has no ill-formed XML file. {color} |
| {color:green}+1{color} | {color:green} javadoc {color} | {color:green} 7m
14s{color} | {color:green} the patch passed {color} |
|| || || || {color:brown} Other Tests {color} ||
| {color:red}-1{color} | {color:red} asflicense {color} | {color:red} 0m
13s{color} | {color:red} The patch generated 3 ASF License warnings. {color} |
| {color:black}{color} | {color:black} {color} | {color:black} 46m 2s{color} |
{color:black} {color} |
\\
\\
|| Subsystem || Report/Notes ||
| Optional Tests | asflicense javac javadoc xml compile |
| uname | Linux hiveptest-server-upstream 3.16.0-4-amd64 #1 SMP Debian
3.16.43-2+deb8u5 (2017-09-19) x86_64 GNU/Linux |
| Build tool | maven |
| Personality |
/data/hiveptest/working/yetus_PreCommit-HIVE-Build-18838/dev-support/hive-personality.sh
|
| git revision | master / e9b974a |
| Default Java | 1.8.0_111 |
| asflicense |
http://104.198.109.242/logs//PreCommit-HIVE-Build-18838/yetus/patch-asflicense-problems.txt
|
| modules | C: . testutils/ptest2 U: . |
| Console output |
http://104.198.109.242/logs//PreCommit-HIVE-Build-18838/yetus.txt |
| Powered by | Apache Yetushttp://yetus.apache.org |
This message was automatically generated.
> Upgrade commons-io to 2.6
> -
>
> Key: HIVE-22270
> URL: https://issues.apache.org/jira/browse/HIVE-22270
> Project: Hive
> Issue Type: Improvement
>Reporter: David Lavati
>Assignee: David Lavati
>Priority: Major
> Labels: pull-request-available
> Attachments: HIVE-22270.patch, HIVE-22270.patch, HIVE-22270.patch,
> HIVE-22270.patch
>
> Time Spent: 10m
> Remaining Estimate: 0h
>
> Hive's currently using commons-io 2.4 and according to HIVE-21273, a number
> of issues are present in it, which can be resolved by upgrading to 2.6:
> IOUtils copyLarge() and skip() methods are performance hogs
> affectsVersions:2.3;2.4
>
> [https://issues.apache.org/jira/projects/IO/issues/IO-355?filter=allopenissues]
> CharSequenceInputStream#reset() behaves incorrectly in case when buffer size
> is not dividable by data size
> affectsVersions:2.4
>
> [https://issues.apache.org/jira/projects/IO/issues/IO-356?filter=allopenissues]
> [Tailer] InterruptedException while the thead is sleeping is silently ignored
> affectsVersions:2.4
>
> [https://issues.apache.org/jira/projects/IO/issues/IO-357?filter=allopenissues]
> IOUtils.contentEquals* methods returns false if input1 == input2; should
> return true
> affectsVersions:2.4
>
> [https://issues.apache.org/jira/projects/IO/issues/IO-362?filter=allopenissues]
> Apache Commons - standard links for documents are failing
> affectsVersions:2.4
>
> [https://issues.apache.org/jira/projects/IO/issues/IO-369?filter=allopenissues]
> FileUtils.sizeOfDirectoryAsBigInteger can overflow
> affectsVersions:2.4
>
>
[jira] [Commented] (HIVE-22250) Describe function does not provide description for rank functions
[
https://issues.apache.org/jira/browse/HIVE-22250?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16943299#comment-16943299
]
Hive QA commented on HIVE-22250:
Here are the results of testing the latest attachment:
https://issues.apache.org/jira/secure/attachment/12981991/HIVE-22250.2.patch
{color:green}SUCCESS:{color} +1 due to 1 test(s) being added or modified.
{color:red}ERROR:{color} -1 due to 74 failed/errored test(s), 17158 tests
executed
*Failed tests:*
{noformat}
org.apache.hadoop.hive.cli.TestCliDriver.testCliDriver[authorization_admin_almighty2]
(batchId=58)
org.apache.hadoop.hive.cli.TestCliDriver.testCliDriver[authorization_cli_nonsql]
(batchId=87)
org.apache.hadoop.hive.cli.TestCliDriver.testCliDriver[compile_processor]
(batchId=99)
org.apache.hadoop.hive.cli.TestCliDriver.testCliDriver[infer_bucket_sort_num_buckets]
(batchId=67)
org.apache.hadoop.hive.cli.TestCliDriver.testCliDriver[reloadJar] (batchId=10)
org.apache.hadoop.hive.cli.TestCliDriver.testCliDriver[udaf_percentile_cont]
(batchId=56)
org.apache.hadoop.hive.cli.TestCliDriver.testCliDriver[udaf_percentile_disc]
(batchId=23)
org.apache.hadoop.hive.cli.TestCliDriver.testCliDriver[udf_bigint] (batchId=93)
org.apache.hadoop.hive.cli.TestCliDriver.testCliDriver[udf_boolean] (batchId=11)
org.apache.hadoop.hive.cli.TestCliDriver.testCliDriver[udf_classloader]
(batchId=7)
org.apache.hadoop.hive.cli.TestCliDriver.testCliDriver[udf_classloader_dynamic_dependency_resolution]
(batchId=100)
org.apache.hadoop.hive.cli.TestCliDriver.testCliDriver[udf_double] (batchId=48)
org.apache.hadoop.hive.cli.TestCliDriver.testCliDriver[udf_float] (batchId=44)
org.apache.hadoop.hive.cli.TestCliDriver.testCliDriver[udf_int] (batchId=52)
org.apache.hadoop.hive.cli.TestCliDriver.testCliDriver[udf_smallint]
(batchId=99)
org.apache.hadoop.hive.cli.TestCliDriver.testCliDriver[udf_tinyint] (batchId=17)
org.apache.hadoop.hive.cli.TestCliDriver.testCliDriver[vector_custom_udf_configure]
(batchId=73)
org.apache.hadoop.hive.cli.TestCliDriver.testCliDriver[vector_udf3] (batchId=71)
org.apache.hadoop.hive.cli.TestMiniLlapCliDriver.testCliDriver[rcfile_merge2]
(batchId=159)
org.apache.hadoop.hive.cli.TestMiniLlapLocalCliDriver.testCliDriver[materialized_view_partitioned]
(batchId=186)
org.apache.hadoop.hive.cli.TestMiniLlapLocalCliDriver.testCliDriver[partition_ctas]
(batchId=173)
org.apache.hadoop.hive.cli.TestMiniSparkOnYarnCliDriver.testCliDriver[infer_bucket_sort_num_buckets]
(batchId=194)
org.apache.hadoop.hive.cli.TestMiniTezCliDriver.testCliDriver[tez_union_with_udf]
(batchId=112)
org.apache.hadoop.hive.cli.TestSparkCliDriver.testCliDriver[load_dyn_part2]
(batchId=140)
org.apache.hadoop.hive.ql.TestAcidOnTez.testAcidInsertWithRemoveUnion
(batchId=245)
org.apache.hadoop.hive.ql.TestAcidOnTez.testBucketedAcidInsertWithRemoveUnion
(batchId=245)
org.apache.hadoop.hive.ql.TestAcidOnTez.testCrudMajorCompactionSplitGrouper
(batchId=245)
org.apache.hadoop.hive.ql.TestAcidOnTez.testGetSplitsLocks (batchId=245)
org.apache.hadoop.hive.ql.TestAcidOnTez.testInsertWithRemoveUnion (batchId=245)
org.apache.hadoop.hive.ql.TestAcidOnTez.testIsOriginal (batchId=245)
org.apache.hadoop.hive.ql.TestAcidOnTez.testMapJoinOnMR (batchId=245)
org.apache.hadoop.hive.ql.TestAcidOnTez.testMapJoinOnTez (batchId=245)
org.apache.hadoop.hive.ql.TestAcidOnTez.testMergeJoinOnMR (batchId=245)
org.apache.hadoop.hive.ql.TestAcidOnTez.testMergeJoinOnTez (batchId=245)
org.apache.hadoop.hive.ql.TestTxnCommandsWithSplitUpdateAndVectorization.testMergeOnTezEdges
(batchId=334)
org.apache.hadoop.hive.ql.parse.TestMacroSemanticAnalyzer.testDropMacro
(batchId=326)
org.apache.hadoop.hive.ql.parse.TestMacroSemanticAnalyzer.testDropMacroExistsDoNotIgnoreErrors
(batchId=326)
org.apache.hive.jdbc.TestJdbcDriver2.testQueryCancel (batchId=284)
org.apache.hive.jdbc.TestJdbcDriver2.testQueryCancelTwice (batchId=284)
org.apache.hive.jdbc.TestJdbcDriver2.testQueryTimeout (batchId=284)
org.apache.hive.jdbc.TestJdbcDriver2.testSerializedExecution (batchId=284)
org.apache.hive.jdbc.TestJdbcDriver2.testYarnATSGuid (batchId=284)
org.apache.hive.jdbc.TestJdbcWithMiniLlapArrow.org.apache.hive.jdbc.TestJdbcWithMiniLlapArrow
(batchId=283)
org.apache.hive.jdbc.TestJdbcWithMiniLlapRow.testKillQuery (batchId=283)
org.apache.hive.jdbc.TestJdbcWithMiniLlapVectorArrow.testKillQuery (batchId=286)
org.apache.hive.jdbc.TestNewGetSplitsFormat.testKillQuery (batchId=283)
org.apache.hive.jdbc.TestTriggersMoveWorkloadManager.testTriggerMoveAndKill
(batchId=283)
org.apache.hive.jdbc.TestTriggersMoveWorkloadManager.testTriggerMoveBackKill
(batchId=283)
org.apache.hive.jdbc.TestTriggersMoveWorkloadManager.testTriggerMoveConflictKill
(batchId=283)
org.apache.hive.jdbc.TestTriggersMoveWorkloadManager.testTriggerMoveEscapeKill
(batchId=283)
org.apache.hive.jdbc.TestTriggersNoTezSessionPool.testTriggerDAGTotalTasks
(batchId=281)
[jira] [Commented] (HIVE-22281) Create table statement fails with "not supported NULLS LAST for ORDER BY in ASC order"
[
https://issues.apache.org/jira/browse/HIVE-22281?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16943298#comment-16943298
]
Jesus Camacho Rodriguez commented on HIVE-22281:
+1 (pending tests)
> Create table statement fails with "not supported NULLS LAST for ORDER BY in
> ASC order"
> --
>
> Key: HIVE-22281
> URL: https://issues.apache.org/jira/browse/HIVE-22281
> Project: Hive
> Issue Type: Bug
> Components: Parser
>Reporter: Krisztian Kasa
>Assignee: Krisztian Kasa
>Priority: Major
> Fix For: 4.0.0
>
> Attachments: HIVE-22281.1.patch, HIVE-22281.1.patch
>
>
> {code}
> CREATE TABLE table_core2c4ywq7yjx ( k1 STRING, f1 STRING,
> sequence_num BIGINT, create_bsk BIGINT, change_bsk BIGINT,
> op_code STRING ) PARTITIONED BY (run_id BIGINT) CLUSTERED BY (k1) SORTED BY
> (k1, change_bsk, sequence_num) INTO 4 BUCKETS STORED AS ORC
> {code}
> {code}
> Error while compiling statement: FAILED: SemanticException create/alter
> table: not supported NULLS LAST for ORDER BY in ASC order
> {code}
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
[jira] [Commented] (HIVE-22250) Describe function does not provide description for rank functions
[
https://issues.apache.org/jira/browse/HIVE-22250?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16943290#comment-16943290
]
Hive QA commented on HIVE-22250:
| (x) *{color:red}-1 overall{color}* |
\\
\\
|| Vote || Subsystem || Runtime || Comment ||
|| || || || {color:brown} Prechecks {color} ||
| {color:green}+1{color} | {color:green} @author {color} | {color:green} 0m
1s{color} | {color:green} The patch does not contain any @author tags. {color} |
|| || || || {color:brown} master Compile Tests {color} ||
| {color:green}+1{color} | {color:green} mvninstall {color} | {color:green} 10m
11s{color} | {color:green} master passed {color} |
| {color:green}+1{color} | {color:green} compile {color} | {color:green} 1m
10s{color} | {color:green} master passed {color} |
| {color:green}+1{color} | {color:green} checkstyle {color} | {color:green} 0m
46s{color} | {color:green} master passed {color} |
| {color:blue}0{color} | {color:blue} findbugs {color} | {color:blue} 4m
4s{color} | {color:blue} ql in master has 1551 extant Findbugs warnings.
{color} |
| {color:green}+1{color} | {color:green} javadoc {color} | {color:green} 1m
1s{color} | {color:green} master passed {color} |
|| || || || {color:brown} Patch Compile Tests {color} ||
| {color:green}+1{color} | {color:green} mvninstall {color} | {color:green} 1m
29s{color} | {color:green} the patch passed {color} |
| {color:green}+1{color} | {color:green} compile {color} | {color:green} 1m
8s{color} | {color:green} the patch passed {color} |
| {color:green}+1{color} | {color:green} javac {color} | {color:green} 1m
8s{color} | {color:green} the patch passed {color} |
| {color:red}-1{color} | {color:red} checkstyle {color} | {color:red} 0m
44s{color} | {color:red} ql: The patch generated 26 new + 289 unchanged - 23
fixed = 315 total (was 312) {color} |
| {color:green}+1{color} | {color:green} whitespace {color} | {color:green} 0m
0s{color} | {color:green} The patch has no whitespace issues. {color} |
| {color:green}+1{color} | {color:green} findbugs {color} | {color:green} 4m
18s{color} | {color:green} the patch passed {color} |
| {color:green}+1{color} | {color:green} javadoc {color} | {color:green} 0m
59s{color} | {color:green} the patch passed {color} |
|| || || || {color:brown} Other Tests {color} ||
| {color:green}+1{color} | {color:green} asflicense {color} | {color:green} 0m
14s{color} | {color:green} The patch does not generate ASF License warnings.
{color} |
| {color:black}{color} | {color:black} {color} | {color:black} 26m 34s{color} |
{color:black} {color} |
\\
\\
|| Subsystem || Report/Notes ||
| Optional Tests | asflicense javac javadoc findbugs checkstyle compile |
| uname | Linux hiveptest-server-upstream 3.16.0-4-amd64 #1 SMP Debian
3.16.43-2+deb8u5 (2017-09-19) x86_64 GNU/Linux |
| Build tool | maven |
| Personality |
/data/hiveptest/working/yetus_PreCommit-HIVE-Build-18837/dev-support/hive-personality.sh
|
| git revision | master / e9b974a |
| Default Java | 1.8.0_111 |
| findbugs | v3.0.1 |
| checkstyle |
http://104.198.109.242/logs//PreCommit-HIVE-Build-18837/yetus/diff-checkstyle-ql.txt
|
| modules | C: ql U: ql |
| Console output |
http://104.198.109.242/logs//PreCommit-HIVE-Build-18837/yetus.txt |
| Powered by | Apache Yetushttp://yetus.apache.org |
This message was automatically generated.
> Describe function does not provide description for rank functions
> -
>
> Key: HIVE-22250
> URL: https://issues.apache.org/jira/browse/HIVE-22250
> Project: Hive
> Issue Type: Bug
>Reporter: Krisztian Kasa
>Assignee: Krisztian Kasa
>Priority: Minor
> Fix For: 4.0.0
>
> Attachments: HIVE-22250.1.patch, HIVE-22250.1.patch,
> HIVE-22250.1.patch, HIVE-22250.2.patch
>
>
> {code}
> @WindowFunctionDescription(
> description = @Description(
> name = "dense_rank",
> value = "_FUNC_(x) The difference between RANK and DENSE_RANK is that
> DENSE_RANK leaves no " +
> "gaps in ranking sequence when there are ties. That is, if you
> were " +
> "ranking a competition using DENSE_RANK and had three people tie
> for " +
> "second place, you would say that all three were in second place
> and " +
> "that the next person came in third."
> ),
> supportsWindow = false,
> pivotResult = true,
> rankingFunction = true,
> impliesOrder = true
> )
> {code}
> {code}
> DESC FUNCTION dense_rank;
> {code}
> {code}
> PREHOOK: query: DESC FUNCTION dense_rank
> PREHOOK: type: DESCFUNCTION
> POSTHOOK: query: DESC FUNCTION dense_rank
> POSTHOOK: type: DESCFUNCTION
> There is no documentation for function 'dense_rank'
> {code}
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
[jira] [Updated] (HIVE-22274) Upgrade Calcite version to 1.21.0
[ https://issues.apache.org/jira/browse/HIVE-22274?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Carlin updated HIVE-22274: Status: Open (was: Patch Available) > Upgrade Calcite version to 1.21.0 > - > > Key: HIVE-22274 > URL: https://issues.apache.org/jira/browse/HIVE-22274 > Project: Hive > Issue Type: Task >Affects Versions: 3.1.2 >Reporter: Steve Carlin >Assignee: Steve Carlin >Priority: Major > Attachments: HIVE-22274.patch > > -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Updated] (HIVE-22274) Upgrade Calcite version to 1.21.0
[ https://issues.apache.org/jira/browse/HIVE-22274?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Carlin updated HIVE-22274: Status: Patch Available (was: Open) > Upgrade Calcite version to 1.21.0 > - > > Key: HIVE-22274 > URL: https://issues.apache.org/jira/browse/HIVE-22274 > Project: Hive > Issue Type: Task >Affects Versions: 3.1.2 >Reporter: Steve Carlin >Assignee: Steve Carlin >Priority: Major > Attachments: HIVE-22274.patch > > -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Commented] (HIVE-22235) CommandProcessorResponse should not be an exception
[
https://issues.apache.org/jira/browse/HIVE-22235?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16943282#comment-16943282
]
Hive QA commented on HIVE-22235:
Here are the results of testing the latest attachment:
https://issues.apache.org/jira/secure/attachment/12981987/HIVE-22235.03.patch
{color:green}SUCCESS:{color} +1 due to 73 test(s) being added or modified.
{color:red}ERROR:{color} -1 due to 133 failed/errored test(s), 16941 tests
executed
*Failed tests:*
{noformat}
TestAuthzApiEmbedAuthorizerInRemote - did not produce a TEST-*.xml file (likely
timed out) (batchId=246)
TestCLIAuthzSessionContext - did not produce a TEST-*.xml file (likely timed
out) (batchId=286)
TestCreateUdfEntities - did not produce a TEST-*.xml file (likely timed out)
(batchId=246)
TestDDLWithRemoteMetastoreSecondNamenode - did not produce a TEST-*.xml file
(likely timed out) (batchId=246)
TestDFSErrorHandling - did not produce a TEST-*.xml file (likely timed out)
(batchId=281)
TestHiveMetaStoreAlterColumnPar - did not produce a TEST-*.xml file (likely
timed out) (batchId=246)
TestHiveProtoEventsCleanerTask - did not produce a TEST-*.xml file (likely
timed out) (batchId=246)
TestHs2Hooks - did not produce a TEST-*.xml file (likely timed out)
(batchId=246)
TestJdbcDriver2 - did not produce a TEST-*.xml file (likely timed out)
(batchId=284)
TestJdbcGenericUDTFGetSplits - did not produce a TEST-*.xml file (likely timed
out) (batchId=281)
TestJdbcGenericUDTFGetSplits2 - did not produce a TEST-*.xml file (likely timed
out) (batchId=281)
TestJdbcWithLocalClusterSpark - did not produce a TEST-*.xml file (likely timed
out) (batchId=286)
TestJdbcWithMiniHS2 - did not produce a TEST-*.xml file (likely timed out)
(batchId=286)
TestJdbcWithMiniHS2ErasureCoding - did not produce a TEST-*.xml file (likely
timed out) (batchId=286)
TestJdbcWithMiniLlapArrow - did not produce a TEST-*.xml file (likely timed
out) (batchId=283)
TestJdbcWithSQLAuthUDFBlacklist - did not produce a TEST-*.xml file (likely
timed out) (batchId=286)
TestJdbcWithSQLAuthorization - did not produce a TEST-*.xml file (likely timed
out) (batchId=286)
TestMetaStoreLimitPartitionRequest - did not produce a TEST-*.xml file (likely
timed out) (batchId=246)
TestMultiSessionsHS2WithLocalClusterSpark - did not produce a TEST-*.xml file
(likely timed out) (batchId=286)
TestNoSaslAuth - did not produce a TEST-*.xml file (likely timed out)
(batchId=286)
TestRestrictedList - did not produce a TEST-*.xml file (likely timed out)
(batchId=283)
TestServiceDiscovery - did not produce a TEST-*.xml file (likely timed out)
(batchId=283)
TestTriggersMoveWorkloadManager - did not produce a TEST-*.xml file (likely
timed out) (batchId=283)
TestTriggersNoTezSessionPool - did not produce a TEST-*.xml file (likely timed
out) (batchId=281)
TestTriggersTezSessionPoolManager - did not produce a TEST-*.xml file (likely
timed out) (batchId=283)
TestXSRFFilter - did not produce a TEST-*.xml file (likely timed out)
(batchId=281)
org.apache.hadoop.hive.cli.TestBlobstoreNegativeCliDriver.testCliDriver[select_dropped_table]
(batchId=301)
org.apache.hadoop.hive.cli.TestHBaseNegativeCliDriver.testCliDriver[cascade_dbdrop]
(batchId=296)
org.apache.hadoop.hive.cli.TestHBaseNegativeCliDriver.testCliDriver[generatehfiles_require_family_path]
(batchId=296)
org.apache.hadoop.hive.cli.TestHBaseNegativeCliDriver.testCliDriver[hbase_ddl]
(batchId=296)
org.apache.hadoop.hive.cli.TestMiniLlapLocalCliDriver.testCliDriver[retry_failure]
(batchId=174)
org.apache.hadoop.hive.cli.TestMiniLlapLocalCliDriver.testCliDriver[retry_failure_oom]
(batchId=166)
org.apache.hadoop.hive.cli.TestMiniLlapLocalCliDriver.testCliDriver[retry_failure_reorder]
(batchId=172)
org.apache.hadoop.hive.cli.TestMiniLlapLocalCliDriver.testCliDriver[retry_failure_stat_changes]
(batchId=166)
org.apache.hadoop.hive.cli.TestMiniLlapLocalCliDriver.testCliDriver[vector_retry_failure]
(batchId=179)
org.apache.hadoop.hive.cli.TestNegativeCliDriver.testCliDriver[authorization_addjar]
(batchId=101)
org.apache.hadoop.hive.cli.TestNegativeCliDriver.testCliDriver[authorization_compile]
(batchId=102)
org.apache.hadoop.hive.cli.TestNegativeCliDriver.testCliDriver[authorization_deletejar]
(batchId=101)
org.apache.hadoop.hive.cli.TestNegativeCliDriver.testCliDriver[authorization_dfs]
(batchId=101)
org.apache.hadoop.hive.cli.TestNegativeCliDriver.testCliDriver[authorization_set_invalidconf]
(batchId=101)
org.apache.hadoop.hive.cli.TestNegativeCliDriver.testCliDriver[authorization_set_nonexistent_conf]
(batchId=101)
org.apache.hadoop.hive.cli.TestNegativeCliDriver.testCliDriver[change_hive_hdfs_session_path]
(batchId=102)
org.apache.hadoop.hive.cli.TestNegativeCliDriver.testCliDriver[change_hive_local_session_path]
(batchId=101)
org.apache.hadoop.hive.cli.TestNegativeCliDriver.testCliDriver[change_hive_tmp_table_space]
(batchId=103)
[jira] [Updated] (HIVE-22225) add owner name for create database if missing
[ https://issues.apache.org/jira/browse/HIVE-5?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated HIVE-5: -- Labels: pull-request-available (was: ) > add owner name for create database if missing > - > > Key: HIVE-5 > URL: https://issues.apache.org/jira/browse/HIVE-5 > Project: Hive > Issue Type: Task > Components: Hive >Reporter: Sam An >Assignee: Sam An >Priority: Minor > Labels: pull-request-available > Attachments: HIVE-5.1.patch, HIVE-5.2.patch, > HIVE-5.4.patch, Hive-5.3.patch > > > When Spark connects to HMS, the database owner name is not filled. This could > happen to other clients as well. We shall fill this in HMS. Ownership info is > useful for authorizer component in Ranger, etc. -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Work logged] (HIVE-22225) add owner name for create database if missing
[ https://issues.apache.org/jira/browse/HIVE-5?focusedWorklogId=322397=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-322397 ] ASF GitHub Bot logged work on HIVE-5: - Author: ASF GitHub Bot Created on: 03/Oct/19 01:46 Start Date: 03/Oct/19 01:46 Worklog Time Spent: 10m Work Description: sam-an-cloudera commented on pull request #802: HIVE-5: add owner name for create database if missing (Sam An rev… URL: https://github.com/apache/hive/pull/802 …iewed by Naveen Gangam) This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org Issue Time Tracking --- Worklog Id: (was: 322397) Remaining Estimate: 0h Time Spent: 10m > add owner name for create database if missing > - > > Key: HIVE-5 > URL: https://issues.apache.org/jira/browse/HIVE-5 > Project: Hive > Issue Type: Task > Components: Hive >Reporter: Sam An >Assignee: Sam An >Priority: Minor > Labels: pull-request-available > Attachments: HIVE-5.1.patch, HIVE-5.2.patch, > HIVE-5.4.patch, Hive-5.3.patch > > Time Spent: 10m > Remaining Estimate: 0h > > When Spark connects to HMS, the database owner name is not filled. This could > happen to other clients as well. We shall fill this in HMS. Ownership info is > useful for authorizer component in Ranger, etc. -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Commented] (HIVE-22235) CommandProcessorResponse should not be an exception
[
https://issues.apache.org/jira/browse/HIVE-22235?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16943278#comment-16943278
]
Hive QA commented on HIVE-22235:
| (x) *{color:red}-1 overall{color}* |
\\
\\
|| Vote || Subsystem || Runtime || Comment ||
|| || || || {color:brown} Prechecks {color} ||
| {color:green}+1{color} | {color:green} @author {color} | {color:green} 0m
0s{color} | {color:green} The patch does not contain any @author tags. {color} |
|| || || || {color:brown} master Compile Tests {color} ||
| {color:blue}0{color} | {color:blue} mvndep {color} | {color:blue} 1m
44s{color} | {color:blue} Maven dependency ordering for branch {color} |
| {color:green}+1{color} | {color:green} mvninstall {color} | {color:green} 7m
19s{color} | {color:green} master passed {color} |
| {color:green}+1{color} | {color:green} compile {color} | {color:green} 5m
24s{color} | {color:green} master passed {color} |
| {color:green}+1{color} | {color:green} checkstyle {color} | {color:green} 3m
33s{color} | {color:green} master passed {color} |
| {color:blue}0{color} | {color:blue} findbugs {color} | {color:blue} 4m
17s{color} | {color:blue} ql in master has 1551 extant Findbugs warnings.
{color} |
| {color:blue}0{color} | {color:blue} findbugs {color} | {color:blue} 0m
39s{color} | {color:blue} service in master has 49 extant Findbugs warnings.
{color} |
| {color:blue}0{color} | {color:blue} findbugs {color} | {color:blue} 0m
29s{color} | {color:blue} cli in master has 9 extant Findbugs warnings. {color}
|
| {color:blue}0{color} | {color:blue} findbugs {color} | {color:blue} 0m
38s{color} | {color:blue} hcatalog/core in master has 36 extant Findbugs
warnings. {color} |
| {color:blue}0{color} | {color:blue} findbugs {color} | {color:blue} 0m
26s{color} | {color:blue} hcatalog/hcatalog-pig-adapter in master has 2 extant
Findbugs warnings. {color} |
| {color:blue}0{color} | {color:blue} findbugs {color} | {color:blue} 0m
27s{color} | {color:blue} hcatalog/server-extensions in master has 3 extant
Findbugs warnings. {color} |
| {color:blue}0{color} | {color:blue} findbugs {color} | {color:blue} 0m
26s{color} | {color:blue} hcatalog/webhcat/java-client in master has 3 extant
Findbugs warnings. {color} |
| {color:blue}0{color} | {color:blue} findbugs {color} | {color:blue} 0m
27s{color} | {color:blue} hcatalog/streaming in master has 11 extant Findbugs
warnings. {color} |
| {color:blue}0{color} | {color:blue} findbugs {color} | {color:blue} 0m
27s{color} | {color:blue} streaming in master has 2 extant Findbugs warnings.
{color} |
| {color:blue}0{color} | {color:blue} findbugs {color} | {color:blue} 0m
40s{color} | {color:blue} itests/hive-unit in master has 2 extant Findbugs
warnings. {color} |
| {color:blue}0{color} | {color:blue} findbugs {color} | {color:blue} 0m
48s{color} | {color:blue} itests/util in master has 53 extant Findbugs
warnings. {color} |
| {color:green}+1{color} | {color:green} javadoc {color} | {color:green} 3m
38s{color} | {color:green} master passed {color} |
|| || || || {color:brown} Patch Compile Tests {color} ||
| {color:blue}0{color} | {color:blue} mvndep {color} | {color:blue} 0m
27s{color} | {color:blue} Maven dependency ordering for patch {color} |
| {color:green}+1{color} | {color:green} mvninstall {color} | {color:green} 6m
3s{color} | {color:green} the patch passed {color} |
| {color:green}+1{color} | {color:green} compile {color} | {color:green} 5m
40s{color} | {color:green} the patch passed {color} |
| {color:green}+1{color} | {color:green} javac {color} | {color:green} 5m
40s{color} | {color:green} the patch passed {color} |
| {color:red}-1{color} | {color:red} checkstyle {color} | {color:red} 1m
5s{color} | {color:red} ql: The patch generated 83 new + 1750 unchanged - 149
fixed = 1833 total (was 1899) {color} |
| {color:red}-1{color} | {color:red} checkstyle {color} | {color:red} 0m
14s{color} | {color:red} service: The patch generated 2 new + 40 unchanged - 0
fixed = 42 total (was 40) {color} |
| {color:green}+1{color} | {color:green} checkstyle {color} | {color:green} 0m
12s{color} | {color:green} cli: The patch generated 0 new + 39 unchanged - 2
fixed = 39 total (was 41) {color} |
| {color:green}+1{color} | {color:green} checkstyle {color} | {color:green} 0m
14s{color} | {color:green} hcatalog/core: The patch generated 0 new + 78
unchanged - 13 fixed = 78 total (was 91) {color} |
| {color:red}-1{color} | {color:red} checkstyle {color} | {color:red} 0m
14s{color} | {color:red} hcatalog/hcatalog-pig-adapter: The patch generated 4
new + 186 unchanged - 8 fixed = 190 total (was 194) {color} |
| {color:green}+1{color} | {color:green} checkstyle {color} | {color:green} 0m
11s{color} | {color:green} The patch server-extensions passed checkstyle
{color} |
| {color:green}+1{color} | {color:green} checkstyle {color} | {color:green} 0m
13s{color} | {color:green}
[jira] [Work logged] (HIVE-22248) Min value for column in stats is not set correctly for some data types
[
https://issues.apache.org/jira/browse/HIVE-22248?focusedWorklogId=322390=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-322390
]
ASF GitHub Bot logged work on HIVE-22248:
-
Author: ASF GitHub Bot
Created on: 03/Oct/19 01:06
Start Date: 03/Oct/19 01:06
Worklog Time Spent: 10m
Work Description: jcamachor commented on pull request #801: HIVE-22248
Fix statistics persisting issues
URL: https://github.com/apache/hive/pull/801#discussion_r330829541
##
File path:
standalone-metastore/metastore-server/src/main/java/org/apache/hadoop/hive/metastore/columnstats/merge/DoubleColumnStatsMerger.java
##
@@ -50,5 +50,16 @@ public void merge(ColumnStatisticsObj aggregateColStats,
ColumnStatisticsObj new
+ aggregateData.getNumDVs() + " and " + newData.getNumDVs() + " to
be " + ndv);
aggregateData.setNumDVs(ndv);
}
+
+aggregateColStats.getStatsData().setDoubleStats(aggregateData);
+ }
+
+ private double getMinValue(DoubleColumnStatsDataInspector aggregateData,
DoubleColumnStatsDataInspector newData) {
+if (!aggregateData.isSetLowValue() && !newData.isSetLowValue()) {
+ return 0;
Review comment:
If they are both unset, why do we return `0` here instead of leaving it
unset? I am not sure whether this will ever happen, but it seems the right
behavior.
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
us...@infra.apache.org
Issue Time Tracking
---
Worklog Id: (was: 322390)
Time Spent: 20m (was: 10m)
> Min value for column in stats is not set correctly for some data types
> --
>
> Key: HIVE-22248
> URL: https://issues.apache.org/jira/browse/HIVE-22248
> Project: Hive
> Issue Type: Bug
> Components: Statistics
>Reporter: Jesus Camacho Rodriguez
>Assignee: Miklos Gergely
>Priority: Major
> Labels: pull-request-available
> Attachments: HIVE-22248.01.patch, HIVE-22248.02.patch
>
> Time Spent: 20m
> Remaining Estimate: 0h
>
> I am not sure whether the problem is printing the value or in the value
> stored in the metastore itself, but for some types (e.g. tinyint, smallint,
> int, bigint, double or float), the min value does not seem to be set
> correctly (set to 0).
> https://github.com/apache/hive/blob/master/ql/src/test/results/clientpositive/alter_table_update_status.q.out#L342
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
[jira] [Assigned] (HIVE-6911) Refactor HiveAlterHandler as per HIVE-2907
[ https://issues.apache.org/jira/browse/HIVE-6911?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bharath Vissapragada reassigned HIVE-6911: -- Assignee: (was: Bharath Vissapragada) > Refactor HiveAlterHandler as per HIVE-2907 > > > Key: HIVE-6911 > URL: https://issues.apache.org/jira/browse/HIVE-6911 > Project: Hive > Issue Type: Improvement > Components: Metastore >Affects Versions: 0.13.0 >Reporter: Bharath Vissapragada >Priority: Major > Labels: partitioning > Attachments: HIVE-6911.trunk.patch > > > HIVE-2907 introduced a cap on number of partitions to fetch per > getPartitions() call and HiveAlterHandler [1] also needs to be refactored as > per the new semantics. Otherwise this issue can lead to OOMs on client that > does "ALTER" on tables with huge number of partitions > [1] > https://github.com/apache/hive/blob/trunk/metastore/src/java/org/apache/hadoop/hive/metastore/HiveAlterHandler.java#L180 -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Assigned] (HIVE-1643) support range scans and non-key columns in HBase filter pushdown
[ https://issues.apache.org/jira/browse/HIVE-1643?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bharath Vissapragada reassigned HIVE-1643: -- Assignee: (was: Bharath Vissapragada) > support range scans and non-key columns in HBase filter pushdown > > > Key: HIVE-1643 > URL: https://issues.apache.org/jira/browse/HIVE-1643 > Project: Hive > Issue Type: Improvement > Components: HBase Handler >Affects Versions: 0.9.0 >Reporter: John Sichi >Priority: Major > Labels: patch > Attachments: HIVE-1643.patch, Hive-1643.2.patch, hbase_handler.patch > > > HIVE-1226 added support for WHERE rowkey=3. We would like to support WHERE > rowkey BETWEEN 10 and 20, as well as predicates on non-rowkeys (plus > conjunctions etc). Non-rowkey conditions can't be used to filter out entire > ranges, but they can be used to push the per-row filter processing as far > down as possible. -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Assigned] (HIVE-22246) Beeline reflector should handle map types
[
https://issues.apache.org/jira/browse/HIVE-22246?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Rajesh Balamohan reassigned HIVE-22246:
---
Assignee: Rajesh Balamohan
> Beeline reflector should handle map types
> -
>
> Key: HIVE-22246
> URL: https://issues.apache.org/jira/browse/HIVE-22246
> Project: Hive
> Issue Type: Bug
> Components: Beeline
>Reporter: Rajesh Balamohan
>Assignee: Rajesh Balamohan
>Priority: Trivial
> Fix For: 4.0.0
>
> Attachments: HIVE-22246.1.patch, HIVE-22246.2.patch
>
>
> Since beeline {{Reflector}} is not handling Map types, it ends up converting
> values from {{beeline.properties}} to "null" and throws NPE with {{"}}beeline
> --hivevar x=1 --hivevar y=1".
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
[jira] [Updated] (HIVE-22246) Beeline reflector should handle map types
[
https://issues.apache.org/jira/browse/HIVE-22246?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Rajesh Balamohan updated HIVE-22246:
Fix Version/s: 4.0.0
Resolution: Fixed
Status: Resolved (was: Patch Available)
> Beeline reflector should handle map types
> -
>
> Key: HIVE-22246
> URL: https://issues.apache.org/jira/browse/HIVE-22246
> Project: Hive
> Issue Type: Bug
> Components: Beeline
>Reporter: Rajesh Balamohan
>Priority: Trivial
> Fix For: 4.0.0
>
> Attachments: HIVE-22246.1.patch, HIVE-22246.2.patch
>
>
> Since beeline {{Reflector}} is not handling Map types, it ends up converting
> values from {{beeline.properties}} to "null" and throws NPE with {{"}}beeline
> --hivevar x=1 --hivevar y=1".
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
[jira] [Commented] (HIVE-22246) Beeline reflector should handle map types
[
https://issues.apache.org/jira/browse/HIVE-22246?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16943262#comment-16943262
]
Rajesh Balamohan commented on HIVE-22246:
-
Thanks [~gopalv] . Committed to master.
> Beeline reflector should handle map types
> -
>
> Key: HIVE-22246
> URL: https://issues.apache.org/jira/browse/HIVE-22246
> Project: Hive
> Issue Type: Bug
> Components: Beeline
>Reporter: Rajesh Balamohan
>Priority: Trivial
> Attachments: HIVE-22246.1.patch, HIVE-22246.2.patch
>
>
> Since beeline {{Reflector}} is not handling Map types, it ends up converting
> values from {{beeline.properties}} to "null" and throws NPE with {{"}}beeline
> --hivevar x=1 --hivevar y=1".
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
[jira] [Updated] (HIVE-22269) Stats miss with "hive.optimize.sort.dynamic.partition" (SortedDynPartitionOptimizer) leads to wrong reducer count
[
https://issues.apache.org/jira/browse/HIVE-22269?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Rajesh Balamohan updated HIVE-22269:
Fix Version/s: 4.0.0
Resolution: Fixed
Status: Resolved (was: Patch Available)
> Stats miss with "hive.optimize.sort.dynamic.partition"
> (SortedDynPartitionOptimizer) leads to wrong reducer count
> -
>
> Key: HIVE-22269
> URL: https://issues.apache.org/jira/browse/HIVE-22269
> Project: Hive
> Issue Type: Bug
> Components: Statistics
>Reporter: Rajesh Balamohan
>Assignee: Rajesh Balamohan
>Priority: Minor
> Fix For: 4.0.0
>
> Attachments: HIVE-22269.1.patch, HIVE-22269.2.patch
>
>
> {{hive.optimize.sort.dynamic.partition=true}} introduces new stage to reduce
> number of writes in dynamic partitioning usecase. Earlier
> {{SortedDynPartitionOptimizer}} added this new operator via
> {{Optimizer.java}} and the stats for the newly added operator was populated
> via {{StatsRulesProcFactory$ReduceSinkStatsRule}}.
> However, with "HIVE-20703" this got changed. This is moved to {{TezCompiler}}
> for cost based decision. Though the operator gets added correctly, the stats
> for this does not get added (as it runs after runStatsAnnotation()).
> This causes reducer count to be mis-estimated in the query.
> {noformat}
> e.g For the following query, reducer_2 would be estimated as "2" instead of
> "1009". This causes huge delay in the runtime.
> explain
> from tpcds_xtext_1000.store_sales ss
> insert overwrite table store_sales partition (ss_sold_date_sk)
> select
> ss.ss_sold_time_sk,
> ss.ss_item_sk,
> ss.ss_customer_sk,
> ss.ss_cdemo_sk,
> ss.ss_hdemo_sk,
> ss.ss_addr_sk,
> ss.ss_store_sk,
> ss.ss_promo_sk,
> ss.ss_ticket_number,
> ss.ss_quantity,
> ss.ss_wholesale_cost,
> ss.ss_list_price,
> ss.ss_sales_price,
> ss.ss_ext_discount_amt,
> ss.ss_ext_sales_price,
> ss.ss_ext_wholesale_cost,
> ss.ss_ext_list_price,
> ss.ss_ext_tax,
> ss.ss_coupon_amt,
> ss.ss_net_paid,
> ss.ss_net_paid_inc_tax,
> ss.ss_net_profit,
> ss.ss_sold_date_sk
> where ss.ss_sold_date_sk is not null
> insert overwrite table store_sales partition (ss_sold_date_sk)
> select
> ss.ss_sold_time_sk,
> ss.ss_item_sk,
> ss.ss_customer_sk,
> ss.ss_cdemo_sk,
> ss.ss_hdemo_sk,
> ss.ss_addr_sk,
> ss.ss_store_sk,
> ss.ss_promo_sk,
> ss.ss_ticket_number,
> ss.ss_quantity,
> ss.ss_wholesale_cost,
> ss.ss_list_price,
> ss.ss_sales_price,
> ss.ss_ext_discount_amt,
> ss.ss_ext_sales_price,
> ss.ss_ext_wholesale_cost,
> ss.ss_ext_list_price,
> ss.ss_ext_tax,
> ss.ss_coupon_amt,
> ss.ss_net_paid,
> ss.ss_net_paid_inc_tax,
> ss.ss_net_profit,
> ss.ss_sold_date_sk
> where ss.ss_sold_date_sk is null
> distribute by ss.ss_item_sk
> ;
> {noformat}
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
[jira] [Commented] (HIVE-22269) Stats miss with "hive.optimize.sort.dynamic.partition" (SortedDynPartitionOptimizer) leads to wrong reducer count
[
https://issues.apache.org/jira/browse/HIVE-22269?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16943260#comment-16943260
]
Rajesh Balamohan commented on HIVE-22269:
-
Thanks [~vgarg] , [~gopalv] . Committed to master.
> Stats miss with "hive.optimize.sort.dynamic.partition"
> (SortedDynPartitionOptimizer) leads to wrong reducer count
> -
>
> Key: HIVE-22269
> URL: https://issues.apache.org/jira/browse/HIVE-22269
> Project: Hive
> Issue Type: Bug
> Components: Statistics
>Reporter: Rajesh Balamohan
>Assignee: Rajesh Balamohan
>Priority: Minor
> Attachments: HIVE-22269.1.patch, HIVE-22269.2.patch
>
>
> {{hive.optimize.sort.dynamic.partition=true}} introduces new stage to reduce
> number of writes in dynamic partitioning usecase. Earlier
> {{SortedDynPartitionOptimizer}} added this new operator via
> {{Optimizer.java}} and the stats for the newly added operator was populated
> via {{StatsRulesProcFactory$ReduceSinkStatsRule}}.
> However, with "HIVE-20703" this got changed. This is moved to {{TezCompiler}}
> for cost based decision. Though the operator gets added correctly, the stats
> for this does not get added (as it runs after runStatsAnnotation()).
> This causes reducer count to be mis-estimated in the query.
> {noformat}
> e.g For the following query, reducer_2 would be estimated as "2" instead of
> "1009". This causes huge delay in the runtime.
> explain
> from tpcds_xtext_1000.store_sales ss
> insert overwrite table store_sales partition (ss_sold_date_sk)
> select
> ss.ss_sold_time_sk,
> ss.ss_item_sk,
> ss.ss_customer_sk,
> ss.ss_cdemo_sk,
> ss.ss_hdemo_sk,
> ss.ss_addr_sk,
> ss.ss_store_sk,
> ss.ss_promo_sk,
> ss.ss_ticket_number,
> ss.ss_quantity,
> ss.ss_wholesale_cost,
> ss.ss_list_price,
> ss.ss_sales_price,
> ss.ss_ext_discount_amt,
> ss.ss_ext_sales_price,
> ss.ss_ext_wholesale_cost,
> ss.ss_ext_list_price,
> ss.ss_ext_tax,
> ss.ss_coupon_amt,
> ss.ss_net_paid,
> ss.ss_net_paid_inc_tax,
> ss.ss_net_profit,
> ss.ss_sold_date_sk
> where ss.ss_sold_date_sk is not null
> insert overwrite table store_sales partition (ss_sold_date_sk)
> select
> ss.ss_sold_time_sk,
> ss.ss_item_sk,
> ss.ss_customer_sk,
> ss.ss_cdemo_sk,
> ss.ss_hdemo_sk,
> ss.ss_addr_sk,
> ss.ss_store_sk,
> ss.ss_promo_sk,
> ss.ss_ticket_number,
> ss.ss_quantity,
> ss.ss_wholesale_cost,
> ss.ss_list_price,
> ss.ss_sales_price,
> ss.ss_ext_discount_amt,
> ss.ss_ext_sales_price,
> ss.ss_ext_wholesale_cost,
> ss.ss_ext_list_price,
> ss.ss_ext_tax,
> ss.ss_coupon_amt,
> ss.ss_net_paid,
> ss.ss_net_paid_inc_tax,
> ss.ss_net_profit,
> ss.ss_sold_date_sk
> where ss.ss_sold_date_sk is null
> distribute by ss.ss_item_sk
> ;
> {noformat}
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
[jira] [Commented] (HIVE-22282) Obtain LLAP delegation token only when LLAP is configured for Kerberos authentication
[
https://issues.apache.org/jira/browse/HIVE-22282?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16943256#comment-16943256
]
Hive QA commented on HIVE-22282:
Here are the results of testing the latest attachment:
https://issues.apache.org/jira/secure/attachment/12981979/HIVE-22282.1.patch
{color:green}SUCCESS:{color} +1 due to 1 test(s) being added or modified.
{color:green}SUCCESS:{color} +1 due to 17168 tests passed
Test results:
https://builds.apache.org/job/PreCommit-HIVE-Build/18835/testReport
Console output: https://builds.apache.org/job/PreCommit-HIVE-Build/18835/console
Test logs: http://104.198.109.242/logs/PreCommit-HIVE-Build-18835/
Messages:
{noformat}
Executing org.apache.hive.ptest.execution.TestCheckPhase
Executing org.apache.hive.ptest.execution.PrepPhase
Executing org.apache.hive.ptest.execution.YetusPhase
Executing org.apache.hive.ptest.execution.ExecutionPhase
Executing org.apache.hive.ptest.execution.ReportingPhase
{noformat}
This message is automatically generated.
ATTACHMENT ID: 12981979 - PreCommit-HIVE-Build
> Obtain LLAP delegation token only when LLAP is configured for Kerberos
> authentication
> -
>
> Key: HIVE-22282
> URL: https://issues.apache.org/jira/browse/HIVE-22282
> Project: Hive
> Issue Type: Improvement
>Reporter: Denys Kuzmenko
>Assignee: Denys Kuzmenko
>Priority: Major
> Attachments: HIVE-22282.1.patch
>
>
> Contains also Kerberos related Zookeeper configuration changes after refactor.
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
[jira] [Assigned] (HIVE-22288) Add tests for grouping sets for correlated subqueries
[ https://issues.apache.org/jira/browse/HIVE-22288?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Carlin reassigned HIVE-22288: --- > Add tests for grouping sets for correlated subqueries > - > > Key: HIVE-22288 > URL: https://issues.apache.org/jira/browse/HIVE-22288 > Project: Hive > Issue Type: Sub-task >Affects Versions: 3.1.2 >Reporter: Steve Carlin >Assignee: Vineet Garg >Priority: Minor > > After the upgrade to Calcite 1.21, the CALCITE_461_FIXED patch was removed. > The related Jira is CALCITE-574. > Grouping sets for correlated queries should now work and we need to add tests > for them. -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Updated] (HIVE-22274) Upgrade Calcite version to 1.21.0
[ https://issues.apache.org/jira/browse/HIVE-22274?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Carlin updated HIVE-22274: Status: Patch Available (was: Open) > Upgrade Calcite version to 1.21.0 > - > > Key: HIVE-22274 > URL: https://issues.apache.org/jira/browse/HIVE-22274 > Project: Hive > Issue Type: Task >Affects Versions: 3.1.2 >Reporter: Steve Carlin >Assignee: Steve Carlin >Priority: Major > Attachments: HIVE-22274.patch > > -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Commented] (HIVE-22282) Obtain LLAP delegation token only when LLAP is configured for Kerberos authentication
[
https://issues.apache.org/jira/browse/HIVE-22282?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16943244#comment-16943244
]
Hive QA commented on HIVE-22282:
| (/) *{color:green}+1 overall{color}* |
\\
\\
|| Vote || Subsystem || Runtime || Comment ||
|| || || || {color:brown} Prechecks {color} ||
| {color:green}+1{color} | {color:green} @author {color} | {color:green} 0m
0s{color} | {color:green} The patch does not contain any @author tags. {color} |
|| || || || {color:brown} master Compile Tests {color} ||
| {color:blue}0{color} | {color:blue} mvndep {color} | {color:blue} 1m
53s{color} | {color:blue} Maven dependency ordering for branch {color} |
| {color:green}+1{color} | {color:green} mvninstall {color} | {color:green} 7m
27s{color} | {color:green} master passed {color} |
| {color:green}+1{color} | {color:green} compile {color} | {color:green} 2m
35s{color} | {color:green} master passed {color} |
| {color:green}+1{color} | {color:green} checkstyle {color} | {color:green} 1m
36s{color} | {color:green} master passed {color} |
| {color:blue}0{color} | {color:blue} findbugs {color} | {color:blue} 2m
36s{color} | {color:blue} standalone-metastore/metastore-common in master has
32 extant Findbugs warnings. {color} |
| {color:blue}0{color} | {color:blue} findbugs {color} | {color:blue} 0m
35s{color} | {color:blue} common in master has 65 extant Findbugs warnings.
{color} |
| {color:blue}0{color} | {color:blue} findbugs {color} | {color:blue} 0m
24s{color} | {color:blue} llap-client in master has 27 extant Findbugs
warnings. {color} |
| {color:blue}0{color} | {color:blue} findbugs {color} | {color:blue} 1m
12s{color} | {color:blue} standalone-metastore/metastore-server in master has
170 extant Findbugs warnings. {color} |
| {color:blue}0{color} | {color:blue} findbugs {color} | {color:blue} 4m
8s{color} | {color:blue} ql in master has 1551 extant Findbugs warnings.
{color} |
| {color:green}+1{color} | {color:green} javadoc {color} | {color:green} 2m
46s{color} | {color:green} master passed {color} |
|| || || || {color:brown} Patch Compile Tests {color} ||
| {color:blue}0{color} | {color:blue} mvndep {color} | {color:blue} 0m
28s{color} | {color:blue} Maven dependency ordering for patch {color} |
| {color:green}+1{color} | {color:green} mvninstall {color} | {color:green} 3m
5s{color} | {color:green} the patch passed {color} |
| {color:green}+1{color} | {color:green} compile {color} | {color:green} 2m
37s{color} | {color:green} the patch passed {color} |
| {color:green}+1{color} | {color:green} javac {color} | {color:green} 2m
37s{color} | {color:green} the patch passed {color} |
| {color:green}+1{color} | {color:green} checkstyle {color} | {color:green} 1m
30s{color} | {color:green} the patch passed {color} |
| {color:green}+1{color} | {color:green} whitespace {color} | {color:green} 0m
0s{color} | {color:green} The patch has no whitespace issues. {color} |
| {color:green}+1{color} | {color:green} findbugs {color} | {color:green} 9m
34s{color} | {color:green} the patch passed {color} |
| {color:green}+1{color} | {color:green} javadoc {color} | {color:green} 2m
41s{color} | {color:green} the patch passed {color} |
|| || || || {color:brown} Other Tests {color} ||
| {color:green}+1{color} | {color:green} asflicense {color} | {color:green} 0m
14s{color} | {color:green} The patch does not generate ASF License warnings.
{color} |
| {color:black}{color} | {color:black} {color} | {color:black} 46m 48s{color} |
{color:black} {color} |
\\
\\
|| Subsystem || Report/Notes ||
| Optional Tests | asflicense javac javadoc findbugs checkstyle compile |
| uname | Linux hiveptest-server-upstream 3.16.0-4-amd64 #1 SMP Debian
3.16.43-2+deb8u5 (2017-09-19) x86_64 GNU/Linux |
| Build tool | maven |
| Personality |
/data/hiveptest/working/yetus_PreCommit-HIVE-Build-18835/dev-support/hive-personality.sh
|
| git revision | master / 3e2c8be |
| Default Java | 1.8.0_111 |
| findbugs | v3.0.0 |
| modules | C: standalone-metastore/metastore-common common llap-client
standalone-metastore/metastore-server ql U: . |
| Console output |
http://104.198.109.242/logs//PreCommit-HIVE-Build-18835/yetus.txt |
| Powered by | Apache Yetushttp://yetus.apache.org |
This message was automatically generated.
> Obtain LLAP delegation token only when LLAP is configured for Kerberos
> authentication
> -
>
> Key: HIVE-22282
> URL: https://issues.apache.org/jira/browse/HIVE-22282
> Project: Hive
> Issue Type: Improvement
>Reporter: Denys Kuzmenko
>Assignee: Denys Kuzmenko
>Priority: Major
> Attachments: HIVE-22282.1.patch
>
>
> Contains also Kerberos related Zookeeper configuration changes after refactor.
--
This message was sent by Atlassian
[jira] [Commented] (HIVE-22212) Implement append partition related methods on temporary tables
[
https://issues.apache.org/jira/browse/HIVE-22212?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16943215#comment-16943215
]
Hive QA commented on HIVE-22212:
Here are the results of testing the latest attachment:
https://issues.apache.org/jira/secure/attachment/12981976/HIVE-22212.01.patch
{color:green}SUCCESS:{color} +1 due to 2 test(s) being added or modified.
{color:green}SUCCESS:{color} +1 due to 17232 tests passed
Test results:
https://builds.apache.org/job/PreCommit-HIVE-Build/18834/testReport
Console output: https://builds.apache.org/job/PreCommit-HIVE-Build/18834/console
Test logs: http://104.198.109.242/logs/PreCommit-HIVE-Build-18834/
Messages:
{noformat}
Executing org.apache.hive.ptest.execution.TestCheckPhase
Executing org.apache.hive.ptest.execution.PrepPhase
Executing org.apache.hive.ptest.execution.YetusPhase
Executing org.apache.hive.ptest.execution.ExecutionPhase
Executing org.apache.hive.ptest.execution.ReportingPhase
{noformat}
This message is automatically generated.
ATTACHMENT ID: 12981976 - PreCommit-HIVE-Build
> Implement append partition related methods on temporary tables
> --
>
> Key: HIVE-22212
> URL: https://issues.apache.org/jira/browse/HIVE-22212
> Project: Hive
> Issue Type: Sub-task
> Components: Hive
>Reporter: Laszlo Pinter
>Assignee: Laszlo Pinter
>Priority: Major
> Attachments: HIVE-22212.01.patch
>
>
> The following methods must be implemented in SessionHiveMetastoreClient, in
> order to support partition append on temporary tables:
> {code:java}
> Partition appendPartition(String dbName, String tableName, List
> partVals)
> throws InvalidObjectException, AlreadyExistsException, MetaException,
> TException;
> Partition appendPartition(String catName, String dbName, String tableName,
> List partVals)
> throws InvalidObjectException, AlreadyExistsException, MetaException,
> TException;
> Partition appendPartition(String dbName, String tableName, String name)
> throws InvalidObjectException, AlreadyExistsException, MetaException,
> TException;
> Partition appendPartition(String catName, String dbName, String tableName,
> String name)
> throws InvalidObjectException, AlreadyExistsException, MetaException,
> TException;
> {code}
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
[jira] [Commented] (HIVE-22217) Better Logging for Hive JAR Reload
[ https://issues.apache.org/jira/browse/HIVE-22217?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16943194#comment-16943194 ] David Mollitor commented on HIVE-22217: --- [~abstractdog] can you also push this into Hive 3.x branch? Thanks! > Better Logging for Hive JAR Reload > -- > > Key: HIVE-22217 > URL: https://issues.apache.org/jira/browse/HIVE-22217 > Project: Hive > Issue Type: Improvement > Components: HiveServer2 >Affects Versions: 3.2.0, 2.3.6 >Reporter: David Mollitor >Assignee: David Mollitor >Priority: Minor > Fix For: 4.0.0 > > Attachments: HIVE-22217.1.patch > > > Troubleshooting Hive Reloadable Auxiliary JARs has always been difficult. > Add logging to at least confirm which JAR files are being loaded. -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Commented] (HIVE-22212) Implement append partition related methods on temporary tables
[
https://issues.apache.org/jira/browse/HIVE-22212?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16943188#comment-16943188
]
Hive QA commented on HIVE-22212:
| (x) *{color:red}-1 overall{color}* |
\\
\\
|| Vote || Subsystem || Runtime || Comment ||
|| || || || {color:brown} Prechecks {color} ||
| {color:green}+1{color} | {color:green} @author {color} | {color:green} 0m
0s{color} | {color:green} The patch does not contain any @author tags. {color} |
|| || || || {color:brown} master Compile Tests {color} ||
| {color:blue}0{color} | {color:blue} mvndep {color} | {color:blue} 1m
53s{color} | {color:blue} Maven dependency ordering for branch {color} |
| {color:green}+1{color} | {color:green} mvninstall {color} | {color:green} 7m
38s{color} | {color:green} master passed {color} |
| {color:green}+1{color} | {color:green} compile {color} | {color:green} 1m
35s{color} | {color:green} master passed {color} |
| {color:green}+1{color} | {color:green} checkstyle {color} | {color:green} 0m
59s{color} | {color:green} master passed {color} |
| {color:blue}0{color} | {color:blue} findbugs {color} | {color:blue} 1m
14s{color} | {color:blue} standalone-metastore/metastore-server in master has
170 extant Findbugs warnings. {color} |
| {color:blue}0{color} | {color:blue} findbugs {color} | {color:blue} 4m
14s{color} | {color:blue} ql in master has 1551 extant Findbugs warnings.
{color} |
| {color:green}+1{color} | {color:green} javadoc {color} | {color:green} 1m
20s{color} | {color:green} master passed {color} |
|| || || || {color:brown} Patch Compile Tests {color} ||
| {color:blue}0{color} | {color:blue} mvndep {color} | {color:blue} 0m
28s{color} | {color:blue} Maven dependency ordering for patch {color} |
| {color:green}+1{color} | {color:green} mvninstall {color} | {color:green} 1m
58s{color} | {color:green} the patch passed {color} |
| {color:green}+1{color} | {color:green} compile {color} | {color:green} 1m
33s{color} | {color:green} the patch passed {color} |
| {color:green}+1{color} | {color:green} javac {color} | {color:green} 1m
33s{color} | {color:green} the patch passed {color} |
| {color:green}+1{color} | {color:green} checkstyle {color} | {color:green} 0m
18s{color} | {color:green} standalone-metastore/metastore-server: The patch
generated 0 new + 0 unchanged - 1 fixed = 0 total (was 1) {color} |
| {color:red}-1{color} | {color:red} checkstyle {color} | {color:red} 0m
39s{color} | {color:red} ql: The patch generated 1 new + 17 unchanged - 0 fixed
= 18 total (was 17) {color} |
| {color:green}+1{color} | {color:green} whitespace {color} | {color:green} 0m
0s{color} | {color:green} The patch has no whitespace issues. {color} |
| {color:green}+1{color} | {color:green} findbugs {color} | {color:green} 5m
36s{color} | {color:green} the patch passed {color} |
| {color:green}+1{color} | {color:green} javadoc {color} | {color:green} 1m
21s{color} | {color:green} the patch passed {color} |
|| || || || {color:brown} Other Tests {color} ||
| {color:red}-1{color} | {color:red} asflicense {color} | {color:red} 0m
14s{color} | {color:red} The patch generated 1 ASF License warnings. {color} |
| {color:black}{color} | {color:black} {color} | {color:black} 31m 49s{color} |
{color:black} {color} |
\\
\\
|| Subsystem || Report/Notes ||
| Optional Tests | asflicense javac javadoc findbugs checkstyle compile |
| uname | Linux hiveptest-server-upstream 3.16.0-4-amd64 #1 SMP Debian
3.16.43-2+deb8u5 (2017-09-19) x86_64 GNU/Linux |
| Build tool | maven |
| Personality |
/data/hiveptest/working/yetus_PreCommit-HIVE-Build-18834/dev-support/hive-personality.sh
|
| git revision | master / 3e2c8be |
| Default Java | 1.8.0_111 |
| findbugs | v3.0.0 |
| checkstyle |
http://104.198.109.242/logs//PreCommit-HIVE-Build-18834/yetus/diff-checkstyle-ql.txt
|
| asflicense |
http://104.198.109.242/logs//PreCommit-HIVE-Build-18834/yetus/patch-asflicense-problems.txt
|
| modules | C: standalone-metastore/metastore-server ql U: . |
| Console output |
http://104.198.109.242/logs//PreCommit-HIVE-Build-18834/yetus.txt |
| Powered by | Apache Yetushttp://yetus.apache.org |
This message was automatically generated.
> Implement append partition related methods on temporary tables
> --
>
> Key: HIVE-22212
> URL: https://issues.apache.org/jira/browse/HIVE-22212
> Project: Hive
> Issue Type: Sub-task
> Components: Hive
>Reporter: Laszlo Pinter
>Assignee: Laszlo Pinter
>Priority: Major
> Attachments: HIVE-22212.01.patch
>
>
> The following methods must be implemented in SessionHiveMetastoreClient, in
> order to support partition append on temporary tables:
> {code:java}
> Partition appendPartition(String dbName, String tableName, List
> partVals)
> throws
[jira] [Work logged] (HIVE-22248) Min value for column in stats is not set correctly for some data types
[ https://issues.apache.org/jira/browse/HIVE-22248?focusedWorklogId=322299=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-322299 ] ASF GitHub Bot logged work on HIVE-22248: - Author: ASF GitHub Bot Created on: 02/Oct/19 21:57 Start Date: 02/Oct/19 21:57 Worklog Time Spent: 10m Work Description: miklosgergely commented on pull request #801: HIVE-22248 Fix statistics persisting issues URL: https://github.com/apache/hive/pull/801 - During the thrift call the ColumnStatsDataInspector was transformed into a ColumnStatsData object, which then was converted back, by calling the InspectorFromStats functions. The new object was never put back though to the aggregateStats, so all the modifications made by the ColumnStatsMerger was made on an object that was never used again. Added aggregateColStats.getStatsData().setStats(aggregateData); calls to put them there, so the changes made by the merger are actually in effect. - The min value was miscalculated for Long and Double types, as the null value was treated as 0. It was fixed by calculating the min values by also using the isSetLowValue() function. - In case of vector_coalesce_3.q the bad statistics made the engine "think" that the column is a primary key following some heuristics based on statistics, and made it guess the statistics in a different way, thus is the output change. This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org Issue Time Tracking --- Worklog Id: (was: 322299) Remaining Estimate: 0h Time Spent: 10m > Min value for column in stats is not set correctly for some data types > -- > > Key: HIVE-22248 > URL: https://issues.apache.org/jira/browse/HIVE-22248 > Project: Hive > Issue Type: Bug > Components: Statistics >Reporter: Jesus Camacho Rodriguez >Assignee: Miklos Gergely >Priority: Major > Labels: pull-request-available > Attachments: HIVE-22248.01.patch, HIVE-22248.02.patch > > Time Spent: 10m > Remaining Estimate: 0h > > I am not sure whether the problem is printing the value or in the value > stored in the metastore itself, but for some types (e.g. tinyint, smallint, > int, bigint, double or float), the min value does not seem to be set > correctly (set to 0). > https://github.com/apache/hive/blob/master/ql/src/test/results/clientpositive/alter_table_update_status.q.out#L342 -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Updated] (HIVE-22248) Min value for column in stats is not set correctly for some data types
[ https://issues.apache.org/jira/browse/HIVE-22248?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated HIVE-22248: -- Labels: pull-request-available (was: ) > Min value for column in stats is not set correctly for some data types > -- > > Key: HIVE-22248 > URL: https://issues.apache.org/jira/browse/HIVE-22248 > Project: Hive > Issue Type: Bug > Components: Statistics >Reporter: Jesus Camacho Rodriguez >Assignee: Miklos Gergely >Priority: Major > Labels: pull-request-available > Attachments: HIVE-22248.01.patch, HIVE-22248.02.patch > > > I am not sure whether the problem is printing the value or in the value > stored in the metastore itself, but for some types (e.g. tinyint, smallint, > int, bigint, double or float), the min value does not seem to be set > correctly (set to 0). > https://github.com/apache/hive/blob/master/ql/src/test/results/clientpositive/alter_table_update_status.q.out#L342 -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Updated] (HIVE-22274) Upgrade Calcite version to 1.21.0
[ https://issues.apache.org/jira/browse/HIVE-22274?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Carlin updated HIVE-22274: Attachment: HIVE-22274.patch > Upgrade Calcite version to 1.21.0 > - > > Key: HIVE-22274 > URL: https://issues.apache.org/jira/browse/HIVE-22274 > Project: Hive > Issue Type: Task >Affects Versions: 3.1.2 >Reporter: Steve Carlin >Assignee: Steve Carlin >Priority: Major > Attachments: HIVE-22274.patch > > -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Commented] (HIVE-22267) Support password based authentication in HMS
[
https://issues.apache.org/jira/browse/HIVE-22267?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16943168#comment-16943168
]
Hive QA commented on HIVE-22267:
Here are the results of testing the latest attachment:
https://issues.apache.org/jira/secure/attachment/12981975/HIVE-22267.07.patch
{color:green}SUCCESS:{color} +1 due to 23 test(s) being added or modified.
{color:green}SUCCESS:{color} +1 due to 17451 tests passed
Test results:
https://builds.apache.org/job/PreCommit-HIVE-Build/18833/testReport
Console output: https://builds.apache.org/job/PreCommit-HIVE-Build/18833/console
Test logs: http://104.198.109.242/logs/PreCommit-HIVE-Build-18833/
Messages:
{noformat}
Executing org.apache.hive.ptest.execution.TestCheckPhase
Executing org.apache.hive.ptest.execution.PrepPhase
Executing org.apache.hive.ptest.execution.YetusPhase
Executing org.apache.hive.ptest.execution.ExecutionPhase
Executing org.apache.hive.ptest.execution.ReportingPhase
{noformat}
This message is automatically generated.
ATTACHMENT ID: 12981975 - PreCommit-HIVE-Build
> Support password based authentication in HMS
>
>
> Key: HIVE-22267
> URL: https://issues.apache.org/jira/browse/HIVE-22267
> Project: Hive
> Issue Type: New Feature
>Reporter: Ashutosh Bapat
>Assignee: Ashutosh Bapat
>Priority: Major
> Labels: pull-request-available
> Attachments: HIVE-22267.00.patch, HIVE-22267.01.patch,
> HIVE-22267.02.patch, HIVE-22267.03.patch, HIVE-22267.04.patch,
> HIVE-22267.05.patch, HIVE-22267.06.patch, HIVE-22267.07.patch
>
> Time Spent: 10m
> Remaining Estimate: 0h
>
> Similar to HS2, support password based authentication in HMS.
> Right now we provide LDAP and CONFIG based options. The later allows to set
> user and password in config and is used only for testing.
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
[jira] [Updated] (HIVE-22287) Metastore logging needs to add the partition info
[
https://issues.apache.org/jira/browse/HIVE-22287?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Gopal Vijayaraghavan updated HIVE-22287:
Labels: newbie (was: )
> Metastore logging needs to add the partition info
> -
>
> Key: HIVE-22287
> URL: https://issues.apache.org/jira/browse/HIVE-22287
> Project: Hive
> Issue Type: Bug
> Components: Standalone Metastore
>Affects Versions: 4.0.0
>Reporter: Gopal Vijayaraghavan
>Priority: Minor
> Labels: newbie
>
> {code}
> [mdc@18060 class="utils.MetaStoreUtils" level="WARN" thread="HMSHandler #4"]
> Updating partition stats fast for: web_returns
> [mdc@18060 class="utils.MetaStoreUtils" level="WARN" thread="HMSHandler #9"]
> Updated size to 21890
> {code}
> The HMS logs are at WARN level, but are missing the partition name in both
> log lines.
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
[jira] [Resolved] (HIVE-22103) Yarn-Service is not launched with higher priority by HS2
[ https://issues.apache.org/jira/browse/HIVE-22103?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Richard Zhang resolved HIVE-22103. -- Resolution: Not A Bug > Yarn-Service is not launched with higher priority by HS2 > > > Key: HIVE-22103 > URL: https://issues.apache.org/jira/browse/HIVE-22103 > Project: Hive > Issue Type: Task > Components: HiveServer2, llap >Affects Versions: 3.1.0 >Reporter: Sampada Dehankar >Assignee: Richard Zhang >Priority: Major > > In Hive 3.x, Yarn-Service is used to launch llap-daemons. If a container > (llap-daemon) is killed and there are pending Tez AMs, the llap-daemon > container might not get launched as the available resources can be utilized > by Tez AMs. > This happens as Yarn-Service and Tez AMs both are launched with the same Yarn > Application priority (0). Due to this, which of the two would get the > resource is uncertain. > In the previous versions on Hive, this issue was not present as Slider was > launched with priority 1. And Tez AMs are launched with priority 0. -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Commented] (HIVE-22103) Yarn-Service is not launched with higher priority by HS2
[ https://issues.apache.org/jira/browse/HIVE-22103?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16943156#comment-16943156 ] Richard Zhang commented on HIVE-22103: -- This is not a bug, but it is about how to use the priority configure feature. YARN provides the facility to configure the priority of applications, for example, users can configure the priority of the application by yarn application -appId -updatePriority By default, YARN does not specify priority and the default is 0. But users can use the above facility to assign priority. When YARN launches the applications. It will first launch the SERVICE AM, next is TEZ AM. TEZ AM cannot acquire the resources from SERVICE AM in the normal situation, because they are separate containers. The corner case will only happen in a single node cluster, where the user’s cluster lacks resource, where the cluster can not launch more containers when both SERVICE AM and TEZ AM are demanding for containers. But because YARN SERVICE AM and the TEZ AM has the same priority, killing YARN service AM does enable TEZ AM container to launch. Moreover, the use can use the following configure command to explicitly set the priority. yarn application -appId -updatePriority The users can setup this in their default config. So this is not a bug, but it is about how to use the priority configure feature. > Yarn-Service is not launched with higher priority by HS2 > > > Key: HIVE-22103 > URL: https://issues.apache.org/jira/browse/HIVE-22103 > Project: Hive > Issue Type: Task > Components: HiveServer2, llap >Affects Versions: 3.1.0 >Reporter: Sampada Dehankar >Assignee: Richard Zhang >Priority: Major > > In Hive 3.x, Yarn-Service is used to launch llap-daemons. If a container > (llap-daemon) is killed and there are pending Tez AMs, the llap-daemon > container might not get launched as the available resources can be utilized > by Tez AMs. > This happens as Yarn-Service and Tez AMs both are launched with the same Yarn > Application priority (0). Due to this, which of the two would get the > resource is uncertain. > In the previous versions on Hive, this issue was not present as Slider was > launched with priority 1. And Tez AMs are launched with priority 0. -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Assigned] (HIVE-22281) Create table statement fails with "not supported NULLS LAST for ORDER BY in ASC order"
[
https://issues.apache.org/jira/browse/HIVE-22281?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Jesus Camacho Rodriguez reassigned HIVE-22281:
--
Assignee: Krisztian Kasa (was: Jesus Camacho Rodriguez)
> Create table statement fails with "not supported NULLS LAST for ORDER BY in
> ASC order"
> --
>
> Key: HIVE-22281
> URL: https://issues.apache.org/jira/browse/HIVE-22281
> Project: Hive
> Issue Type: Bug
> Components: Parser
>Reporter: Krisztian Kasa
>Assignee: Krisztian Kasa
>Priority: Major
> Fix For: 4.0.0
>
> Attachments: HIVE-22281.1.patch, HIVE-22281.1.patch
>
>
> {code}
> CREATE TABLE table_core2c4ywq7yjx ( k1 STRING, f1 STRING,
> sequence_num BIGINT, create_bsk BIGINT, change_bsk BIGINT,
> op_code STRING ) PARTITIONED BY (run_id BIGINT) CLUSTERED BY (k1) SORTED BY
> (k1, change_bsk, sequence_num) INTO 4 BUCKETS STORED AS ORC
> {code}
> {code}
> Error while compiling statement: FAILED: SemanticException create/alter
> table: not supported NULLS LAST for ORDER BY in ASC order
> {code}
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
[jira] [Updated] (HIVE-22281) Create table statement fails with "not supported NULLS LAST for ORDER BY in ASC order"
[
https://issues.apache.org/jira/browse/HIVE-22281?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Jesus Camacho Rodriguez updated HIVE-22281:
---
Attachment: HIVE-22281.1.patch
> Create table statement fails with "not supported NULLS LAST for ORDER BY in
> ASC order"
> --
>
> Key: HIVE-22281
> URL: https://issues.apache.org/jira/browse/HIVE-22281
> Project: Hive
> Issue Type: Bug
> Components: Parser
>Reporter: Krisztian Kasa
>Assignee: Jesus Camacho Rodriguez
>Priority: Major
> Fix For: 4.0.0
>
> Attachments: HIVE-22281.1.patch, HIVE-22281.1.patch
>
>
> {code}
> CREATE TABLE table_core2c4ywq7yjx ( k1 STRING, f1 STRING,
> sequence_num BIGINT, create_bsk BIGINT, change_bsk BIGINT,
> op_code STRING ) PARTITIONED BY (run_id BIGINT) CLUSTERED BY (k1) SORTED BY
> (k1, change_bsk, sequence_num) INTO 4 BUCKETS STORED AS ORC
> {code}
> {code}
> Error while compiling statement: FAILED: SemanticException create/alter
> table: not supported NULLS LAST for ORDER BY in ASC order
> {code}
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
[jira] [Assigned] (HIVE-22103) Yarn-Service is not launched with higher priority by HS2
[ https://issues.apache.org/jira/browse/HIVE-22103?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Richard Zhang reassigned HIVE-22103: Assignee: Richard Zhang (was: Sampada Dehankar) > Yarn-Service is not launched with higher priority by HS2 > > > Key: HIVE-22103 > URL: https://issues.apache.org/jira/browse/HIVE-22103 > Project: Hive > Issue Type: Task > Components: HiveServer2, llap >Affects Versions: 3.1.0 >Reporter: Sampada Dehankar >Assignee: Richard Zhang >Priority: Major > > In Hive 3.x, Yarn-Service is used to launch llap-daemons. If a container > (llap-daemon) is killed and there are pending Tez AMs, the llap-daemon > container might not get launched as the available resources can be utilized > by Tez AMs. > This happens as Yarn-Service and Tez AMs both are launched with the same Yarn > Application priority (0). Due to this, which of the two would get the > resource is uncertain. > In the previous versions on Hive, this issue was not present as Slider was > launched with priority 1. And Tez AMs are launched with priority 0. -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Assigned] (HIVE-22281) Create table statement fails with "not supported NULLS LAST for ORDER BY in ASC order"
[
https://issues.apache.org/jira/browse/HIVE-22281?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Jesus Camacho Rodriguez reassigned HIVE-22281:
--
Assignee: Jesus Camacho Rodriguez (was: Krisztian Kasa)
> Create table statement fails with "not supported NULLS LAST for ORDER BY in
> ASC order"
> --
>
> Key: HIVE-22281
> URL: https://issues.apache.org/jira/browse/HIVE-22281
> Project: Hive
> Issue Type: Bug
> Components: Parser
>Reporter: Krisztian Kasa
>Assignee: Jesus Camacho Rodriguez
>Priority: Major
> Fix For: 4.0.0
>
> Attachments: HIVE-22281.1.patch
>
>
> {code}
> CREATE TABLE table_core2c4ywq7yjx ( k1 STRING, f1 STRING,
> sequence_num BIGINT, create_bsk BIGINT, change_bsk BIGINT,
> op_code STRING ) PARTITIONED BY (run_id BIGINT) CLUSTERED BY (k1) SORTED BY
> (k1, change_bsk, sequence_num) INTO 4 BUCKETS STORED AS ORC
> {code}
> {code}
> Error while compiling statement: FAILED: SemanticException create/alter
> table: not supported NULLS LAST for ORDER BY in ASC order
> {code}
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
[jira] [Commented] (HIVE-22267) Support password based authentication in HMS
[
https://issues.apache.org/jira/browse/HIVE-22267?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16943148#comment-16943148
]
Hive QA commented on HIVE-22267:
| (x) *{color:red}-1 overall{color}* |
\\
\\
|| Vote || Subsystem || Runtime || Comment ||
|| || || || {color:brown} Prechecks {color} ||
| {color:green}+1{color} | {color:green} @author {color} | {color:green} 0m
0s{color} | {color:green} The patch does not contain any @author tags. {color} |
|| || || || {color:brown} master Compile Tests {color} ||
| {color:blue}0{color} | {color:blue} mvndep {color} | {color:blue} 1m
32s{color} | {color:blue} Maven dependency ordering for branch {color} |
| {color:green}+1{color} | {color:green} mvninstall {color} | {color:green} 7m
11s{color} | {color:green} master passed {color} |
| {color:green}+1{color} | {color:green} compile {color} | {color:green} 2m
55s{color} | {color:green} master passed {color} |
| {color:green}+1{color} | {color:green} checkstyle {color} | {color:green} 1m
34s{color} | {color:green} master passed {color} |
| {color:blue}0{color} | {color:blue} findbugs {color} | {color:blue} 2m
29s{color} | {color:blue} standalone-metastore/metastore-common in master has
32 extant Findbugs warnings. {color} |
| {color:blue}0{color} | {color:blue} findbugs {color} | {color:blue} 1m
14s{color} | {color:blue} standalone-metastore/metastore-server in master has
170 extant Findbugs warnings. {color} |
| {color:green}+1{color} | {color:green} javadoc {color} | {color:green} 3m
2s{color} | {color:green} master passed {color} |
|| || || || {color:brown} Patch Compile Tests {color} ||
| {color:blue}0{color} | {color:blue} mvndep {color} | {color:blue} 0m
26s{color} | {color:blue} Maven dependency ordering for patch {color} |
| {color:green}+1{color} | {color:green} mvninstall {color} | {color:green} 3m
20s{color} | {color:green} the patch passed {color} |
| {color:green}+1{color} | {color:green} compile {color} | {color:green} 3m
1s{color} | {color:green} the patch passed {color} |
| {color:green}+1{color} | {color:green} javac {color} | {color:green} 3m
1s{color} | {color:green} the patch passed {color} |
| {color:red}-1{color} | {color:red} checkstyle {color} | {color:red} 0m
32s{color} | {color:red} standalone-metastore: The patch generated 138 new +
949 unchanged - 3 fixed = 1087 total (was 952) {color} |
| {color:red}-1{color} | {color:red} checkstyle {color} | {color:red} 0m
15s{color} | {color:red} standalone-metastore/metastore-common: The patch
generated 30 new + 324 unchanged - 0 fixed = 354 total (was 324) {color} |
| {color:red}-1{color} | {color:red} checkstyle {color} | {color:red} 0m
25s{color} | {color:red} standalone-metastore/metastore-server: The patch
generated 108 new + 625 unchanged - 3 fixed = 733 total (was 628) {color} |
| {color:red}-1{color} | {color:red} checkstyle {color} | {color:red} 0m
13s{color} | {color:red} itests/hive-minikdc: The patch generated 23 new + 19
unchanged - 0 fixed = 42 total (was 19) {color} |
| {color:red}-1{color} | {color:red} checkstyle {color} | {color:red} 0m
14s{color} | {color:red} itests/hive-unit-hadoop2: The patch generated 1 new +
17 unchanged - 0 fixed = 18 total (was 17) {color} |
| {color:green}+1{color} | {color:green} whitespace {color} | {color:green} 0m
0s{color} | {color:green} The patch has no whitespace issues. {color} |
| {color:green}+1{color} | {color:green} xml {color} | {color:green} 0m
3s{color} | {color:green} The patch has no ill-formed XML file. {color} |
| {color:red}-1{color} | {color:red} findbugs {color} | {color:red} 2m
57s{color} | {color:red} standalone-metastore/metastore-common generated 5 new
+ 32 unchanged - 0 fixed = 37 total (was 32) {color} |
| {color:red}-1{color} | {color:red} javadoc {color} | {color:red} 1m
22s{color} | {color:red} standalone-metastore generated 15 new + 77 unchanged -
0 fixed = 92 total (was 77) {color} |
| {color:red}-1{color} | {color:red} javadoc {color} | {color:red} 0m
58s{color} | {color:red} standalone-metastore_metastore-common generated 15 new
+ 51 unchanged - 0 fixed = 66 total (was 51) {color} |
|| || || || {color:brown} Other Tests {color} ||
| {color:red}-1{color} | {color:red} asflicense {color} | {color:red} 0m
14s{color} | {color:red} The patch generated 3 ASF License warnings. {color} |
| {color:black}{color} | {color:black} {color} | {color:black} 37m 35s{color} |
{color:black} {color} |
\\
\\
|| Reason || Tests ||
| FindBugs | module:standalone-metastore/metastore-common |
| | The method name
org.apache.hadoop.hive.metastore.MetaStoreAnonymousAuthenticationProviderImpl.Authenticate(String,
String) doesn't start with a lower case letter At
MetaStoreAnonymousAuthenticationProviderImpl.java:doesn't start with a lower
case letter At MetaStoreAnonymousAuthenticationProviderImpl.java:[line 31] |
| | The method name
[jira] [Updated] (HIVE-22252) Fix caught NullPointerExceptions generated during EXPLAIN
[ https://issues.apache.org/jira/browse/HIVE-22252?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] John Sherman updated HIVE-22252: Attachment: HIVE-22252.3.patch > Fix caught NullPointerExceptions generated during EXPLAIN > - > > Key: HIVE-22252 > URL: https://issues.apache.org/jira/browse/HIVE-22252 > Project: Hive > Issue Type: Bug >Reporter: John Sherman >Assignee: John Sherman >Priority: Minor > Labels: pull-request-available > Attachments: HIVE-22252.1.patch, HIVE-22252.2.patch, > HIVE-22252.3.patch > > Time Spent: 10m > Remaining Estimate: 0h > > While debugging an issue I noticed that during EXPLAIN the following methods > throw a NullPointerException: > VectorColumnOutputMapping#finalize > AbstractOperatorDesc#getUserLevelStatistics > AbstractOperatorDesc#getColumnExprMapForExplain > The exceptions do end up getting caught but we should add null checks and > gracefully to be less wasteful and to aid future debugging. > -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Commented] (HIVE-22286) Disable flaky TestBuddyAllocator#testMTT test
[ https://issues.apache.org/jira/browse/HIVE-22286?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16943143#comment-16943143 ] Jesus Camacho Rodriguez commented on HIVE-22286: Pushed to master, thanks [~jfs]! > Disable flaky TestBuddyAllocator#testMTT test > - > > Key: HIVE-22286 > URL: https://issues.apache.org/jira/browse/HIVE-22286 > Project: Hive > Issue Type: Task >Affects Versions: 4.0.0 >Reporter: John Sherman >Assignee: John Sherman >Priority: Major > Fix For: 4.0.0 > > Attachments: HIVE-22286.1.patch > > > TestBuddyAllocator#TestMTT has been flaky for awhile, failing 20-30% of the > time. Disabling the test until HIVE-22175 is reviewed and committed. -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Updated] (HIVE-22286) Disable flaky TestBuddyAllocator#testMTT test
[ https://issues.apache.org/jira/browse/HIVE-22286?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jesus Camacho Rodriguez updated HIVE-22286: --- Resolution: Fixed Status: Resolved (was: Patch Available) > Disable flaky TestBuddyAllocator#testMTT test > - > > Key: HIVE-22286 > URL: https://issues.apache.org/jira/browse/HIVE-22286 > Project: Hive > Issue Type: Task >Affects Versions: 4.0.0 >Reporter: John Sherman >Assignee: John Sherman >Priority: Major > Fix For: 4.0.0 > > Attachments: HIVE-22286.1.patch > > > TestBuddyAllocator#TestMTT has been flaky for awhile, failing 20-30% of the > time. Disabling the test until HIVE-22175 is reviewed and committed. -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Commented] (HIVE-22286) Disable flaky TestBuddyAllocator#testMTT test
[ https://issues.apache.org/jira/browse/HIVE-22286?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16943142#comment-16943142 ] Jesus Camacho Rodriguez commented on HIVE-22286: +1 > Disable flaky TestBuddyAllocator#testMTT test > - > > Key: HIVE-22286 > URL: https://issues.apache.org/jira/browse/HIVE-22286 > Project: Hive > Issue Type: Task >Affects Versions: 4.0.0 >Reporter: John Sherman >Assignee: John Sherman >Priority: Major > Fix For: 4.0.0 > > Attachments: HIVE-22286.1.patch > > > TestBuddyAllocator#TestMTT has been flaky for awhile, failing 20-30% of the > time. Disabling the test until HIVE-22175 is reviewed and committed. -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Updated] (HIVE-22286) Disable flaky TestBuddyAllocator#testMTT test
[ https://issues.apache.org/jira/browse/HIVE-22286?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] John Sherman updated HIVE-22286: Status: Patch Available (was: Open) > Disable flaky TestBuddyAllocator#testMTT test > - > > Key: HIVE-22286 > URL: https://issues.apache.org/jira/browse/HIVE-22286 > Project: Hive > Issue Type: Task >Affects Versions: 4.0.0 >Reporter: John Sherman >Assignee: John Sherman >Priority: Major > Fix For: 4.0.0 > > Attachments: HIVE-22286.1.patch > > > TestBuddyAllocator#TestMTT has been flaky for awhile, failing 20-30% of the > time. Disabling the test until HIVE-22175 is reviewed and committed. -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Updated] (HIVE-22286) Disable flaky TestBuddyAllocator#testMTT test
[ https://issues.apache.org/jira/browse/HIVE-22286?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] John Sherman updated HIVE-22286: Attachment: HIVE-22286.1.patch > Disable flaky TestBuddyAllocator#testMTT test > - > > Key: HIVE-22286 > URL: https://issues.apache.org/jira/browse/HIVE-22286 > Project: Hive > Issue Type: Task >Affects Versions: 4.0.0 >Reporter: John Sherman >Assignee: John Sherman >Priority: Major > Fix For: 4.0.0 > > Attachments: HIVE-22286.1.patch > > > TestBuddyAllocator#TestMTT has been flaky for awhile, failing 20-30% of the > time. Disabling the test until HIVE-22175 is reviewed and committed. -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Commented] (HIVE-22284) Improve LLAP CacheContentsTracker to collect and display correct statistics
[ https://issues.apache.org/jira/browse/HIVE-22284?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16943128#comment-16943128 ] Ádám Szita commented on HIVE-22284: --- [^HIVE-22284.0.patch] is WIP (test and final touches will come later). The approach is as: * Make use of Map parts available during record reader creation ** this way information of Hive constructs (DB name, table name, partitions and properties) will be available on the LLAP side of the world * Replace String cacheTag with proper object that holds the aforementioned information and therefore also replace the logic that took Path as information source. * Fix CacheContentsTracker's parent tag generation ** aggregation should happen on web UI request time, not when the actual caching happens *** this will offload some work from LLAP IO thread pool *** and will produce the correct result (as opposed to the buggy way now mentioned in this Jira description) ** I'm not only generating 1 parent, but all parents up to DB level [~odraese], [~pvary], [~bslim] can you please share your thoughts? > Improve LLAP CacheContentsTracker to collect and display correct statistics > --- > > Key: HIVE-22284 > URL: https://issues.apache.org/jira/browse/HIVE-22284 > Project: Hive > Issue Type: Improvement > Components: llap >Reporter: Ádám Szita >Assignee: Ádám Szita >Priority: Major > Attachments: HIVE-22284.0.patch > > > When keeping track of which buffers correspond to what Hive objects, > CacheContentsTracker relies on cache tags. > Currently a tag is a simple String that ideally holds DB and table name, and > a partition spec concatenated by . and / . The information here is derived > from the Path of the file that is getting cached. Needless to say sometimes > this produces a wrong tag especially for external tables. > Also there's a bug when calculating aggregated stats for a 'parent' tag > (corresponding to the table of the partition) because the overall maxCount > and maxSize do not add up to the sum of those in the partitions. This happens > when buffers get removed from the cache. > -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Assigned] (HIVE-22286) Disable flaky TestBuddyAllocator#testMTT test
[ https://issues.apache.org/jira/browse/HIVE-22286?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] John Sherman reassigned HIVE-22286: --- > Disable flaky TestBuddyAllocator#testMTT test > - > > Key: HIVE-22286 > URL: https://issues.apache.org/jira/browse/HIVE-22286 > Project: Hive > Issue Type: Task >Affects Versions: 4.0.0 >Reporter: John Sherman >Assignee: John Sherman >Priority: Major > Fix For: 4.0.0 > > > TestBuddyAllocator#TestMTT has been flaky for awhile, failing 20-30% of the > time. Disabling the test until HIVE-22175 is reviewed and committed. -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Updated] (HIVE-22284) Improve LLAP CacheContentsTracker to collect and display correct statistics
[ https://issues.apache.org/jira/browse/HIVE-22284?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ádám Szita updated HIVE-22284: -- Status: Patch Available (was: In Progress) > Improve LLAP CacheContentsTracker to collect and display correct statistics > --- > > Key: HIVE-22284 > URL: https://issues.apache.org/jira/browse/HIVE-22284 > Project: Hive > Issue Type: Improvement > Components: llap >Reporter: Ádám Szita >Assignee: Ádám Szita >Priority: Major > Attachments: HIVE-22284.0.patch > > > When keeping track of which buffers correspond to what Hive objects, > CacheContentsTracker relies on cache tags. > Currently a tag is a simple String that ideally holds DB and table name, and > a partition spec concatenated by . and / . The information here is derived > from the Path of the file that is getting cached. Needless to say sometimes > this produces a wrong tag especially for external tables. > Also there's a bug when calculating aggregated stats for a 'parent' tag > (corresponding to the table of the partition) because the overall maxCount > and maxSize do not add up to the sum of those in the partitions. This happens > when buffers get removed from the cache. > -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Work started] (HIVE-22284) Improve LLAP CacheContentsTracker to collect and display correct statistics
[ https://issues.apache.org/jira/browse/HIVE-22284?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Work on HIVE-22284 started by Ádám Szita. - > Improve LLAP CacheContentsTracker to collect and display correct statistics > --- > > Key: HIVE-22284 > URL: https://issues.apache.org/jira/browse/HIVE-22284 > Project: Hive > Issue Type: Improvement > Components: llap >Reporter: Ádám Szita >Assignee: Ádám Szita >Priority: Major > Attachments: HIVE-22284.0.patch > > > When keeping track of which buffers correspond to what Hive objects, > CacheContentsTracker relies on cache tags. > Currently a tag is a simple String that ideally holds DB and table name, and > a partition spec concatenated by . and / . The information here is derived > from the Path of the file that is getting cached. Needless to say sometimes > this produces a wrong tag especially for external tables. > Also there's a bug when calculating aggregated stats for a 'parent' tag > (corresponding to the table of the partition) because the overall maxCount > and maxSize do not add up to the sum of those in the partitions. This happens > when buffers get removed from the cache. > -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Updated] (HIVE-22284) Improve LLAP CacheContentsTracker to collect and display correct statistics
[ https://issues.apache.org/jira/browse/HIVE-22284?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ádám Szita updated HIVE-22284: -- Attachment: HIVE-22284.0.patch > Improve LLAP CacheContentsTracker to collect and display correct statistics > --- > > Key: HIVE-22284 > URL: https://issues.apache.org/jira/browse/HIVE-22284 > Project: Hive > Issue Type: Improvement > Components: llap >Reporter: Ádám Szita >Assignee: Ádám Szita >Priority: Major > Attachments: HIVE-22284.0.patch > > > When keeping track of which buffers correspond to what Hive objects, > CacheContentsTracker relies on cache tags. > Currently a tag is a simple String that ideally holds DB and table name, and > a partition spec concatenated by . and / . The information here is derived > from the Path of the file that is getting cached. Needless to say sometimes > this produces a wrong tag especially for external tables. > Also there's a bug when calculating aggregated stats for a 'parent' tag > (corresponding to the table of the partition) because the overall maxCount > and maxSize do not add up to the sum of those in the partitions. This happens > when buffers get removed from the cache. > -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Commented] (HIVE-22285) CAST function does not immediately return null if conversion does not succeed
[
https://issues.apache.org/jira/browse/HIVE-22285?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16943119#comment-16943119
]
Eric Richardson commented on HIVE-22285:
Same behavior with casting from string to int.
{code:sql}
CREATE TABLE IF NOT EXISTS castTestInt (rowId BIGINT, intString STRING,
expectedResult BOOLEAN) STORED AS ORC;
TRUNCATE TABLE castTestInt;
INSERT INTO TABLE castTestInt VALUES(0,'2019',true);
INSERT INTO TABLE castTestInt VALUES(1,null,false);
INSERT INTO TABLE castTestInt VALUES(2,' ',false);
INSERT INTO TABLE castTestInt VALUES(3,'',false);
INSERT INTO TABLE castTestInt VALUES(4,'not an int',false);
SELECT
rowId,
intString,
CAST(intString AS INT) as intInt,
CAST(intString AS INT) IS NOT NULL AS actualResult,
expectedResult,
nullIf(CAST(intString AS INT),null) IS NOT NULL AS workAroundResult
FROM castTestInt;
DROP TABLE IF EXISTS castTestInt;
{code}
{code:sql}
++-+-+---+-+---+
| rowid | intstring | intint | actualresult | expectedresult |
workaroundresult |
++-+-+---+-+---+
| 0 | 2019| 2019| true | true| true
|
| 1 | NULL| NULL| false | false | false
|
| 2 | | NULL| true | false | false
|
| 3 | | NULL| true | false | false
|
| 4 | not an int | NULL| true | false | false
|
++-+-+---+-+---+
5 rows selected (1.768 seconds)
{code}
> CAST function does not immediately return null if conversion does not succeed
> -
>
> Key: HIVE-22285
> URL: https://issues.apache.org/jira/browse/HIVE-22285
> Project: Hive
> Issue Type: Bug
> Components: Hive
>Affects Versions: 3.1.0
> Environment: HDP 3.1.0
> Hive 3.1.0.3.1.0.0-78
> Query via DAS 1.3.0 or beeline 3.1.0.3.1.0.0-78
>Reporter: Eric Richardson
>Priority: Major
>
> When cast is called on a column (or derived column) and the cast does not
> succeed it is supposed to return null. Which is what it returns at the end
> of the query, but some evaluations within the query do not evaluate to null,
> unless the predicate of the cast is null.
> ex:
> {code:sql}
> cast('something that is not a date' as date){code}
> will return null
>
> {code:sql}
> cast('something that is not a date' as date) is NOT null{code}
> will return true (which is wrong)
>
> {code:sql}
> cast(null as date) is NOT null
> {code}
> will return false (which is correct)
>
> full example to demonstrate problem
> {code:sql}
> CREATE TABLE IF NOT EXISTS castTest (rowId BIGINT, dateString STRING,
> expectedResult BOOLEAN) STORED AS ORC;
> TRUNCATE TABLE castTest;
> INSERT INTO TABLE castTest VALUES(0,'2019-10-02',true);
> INSERT INTO TABLE castTest VALUES(1,null,false);
> INSERT INTO TABLE castTest VALUES(2,' ',false);
> INSERT INTO TABLE castTest VALUES(3,'',false);
> INSERT INTO TABLE castTest VALUES(4,'not a date',false);
> SELECT
> rowId,
> dateString,
> CAST(dateString AS DATE) as dateDate,
> CAST(dateString AS DATE) IS NOT NULL AS actualResult,
> expectedResult,
> nullIf(CAST(dateString AS DATE),null) IS NOT NULL AS workAroundResult
> FROM castTest;
> DROP TABLE IF EXISTS castTest;
> {code}
> returns
> {code:sql}
> ROWID DATESTRING DATEDATEACTUALRESULT EXPECTEDRESULT WORKAROUNDRESULT
> 0 2019-10-02 2019-10-02 true truetrue
> 1 nullnullfalse false false
> 2 nulltrue false false
> 3 "" nulltrue false false
> 4 not a date nulltrue false false
> {code}
> Expected result is true if the date string was a valid convertible date
> string, false otherwise.
> Query (incorrectly) returns true for actual result when dateString is empty,
> whitespace, or characters.
> Query only returns correct result when dateString is convertible or null.
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
[jira] [Commented] (HIVE-22281) Create table statement fails with "not supported NULLS LAST for ORDER BY in ASC order"
[
https://issues.apache.org/jira/browse/HIVE-22281?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16943114#comment-16943114
]
Hive QA commented on HIVE-22281:
Here are the results of testing the latest attachment:
https://issues.apache.org/jira/secure/attachment/12981974/HIVE-22281.1.patch
{color:red}ERROR:{color} -1 due to no test(s) being added or modified.
{color:red}ERROR:{color} -1 due to 1 failed/errored test(s), 17169 tests
executed
*Failed tests:*
{noformat}
org.apache.hadoop.hive.llap.cache.TestBuddyAllocator.testMTT[2] (batchId=363)
{noformat}
Test results:
https://builds.apache.org/job/PreCommit-HIVE-Build/18832/testReport
Console output: https://builds.apache.org/job/PreCommit-HIVE-Build/18832/console
Test logs: http://104.198.109.242/logs/PreCommit-HIVE-Build-18832/
Messages:
{noformat}
Executing org.apache.hive.ptest.execution.TestCheckPhase
Executing org.apache.hive.ptest.execution.PrepPhase
Executing org.apache.hive.ptest.execution.YetusPhase
Executing org.apache.hive.ptest.execution.ExecutionPhase
Executing org.apache.hive.ptest.execution.ReportingPhase
Tests exited with: TestsFailedException: 1 tests failed
{noformat}
This message is automatically generated.
ATTACHMENT ID: 12981974 - PreCommit-HIVE-Build
> Create table statement fails with "not supported NULLS LAST for ORDER BY in
> ASC order"
> --
>
> Key: HIVE-22281
> URL: https://issues.apache.org/jira/browse/HIVE-22281
> Project: Hive
> Issue Type: Bug
> Components: Parser
>Reporter: Krisztian Kasa
>Assignee: Krisztian Kasa
>Priority: Major
> Fix For: 4.0.0
>
> Attachments: HIVE-22281.1.patch
>
>
> {code}
> CREATE TABLE table_core2c4ywq7yjx ( k1 STRING, f1 STRING,
> sequence_num BIGINT, create_bsk BIGINT, change_bsk BIGINT,
> op_code STRING ) PARTITIONED BY (run_id BIGINT) CLUSTERED BY (k1) SORTED BY
> (k1, change_bsk, sequence_num) INTO 4 BUCKETS STORED AS ORC
> {code}
> {code}
> Error while compiling statement: FAILED: SemanticException create/alter
> table: not supported NULLS LAST for ORDER BY in ASC order
> {code}
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
[jira] [Work logged] (HIVE-22042) Set hive.exec.dynamic.partition.mode=nonstrict by default
[ https://issues.apache.org/jira/browse/HIVE-22042?focusedWorklogId=322192=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-322192 ] ASF GitHub Bot logged work on HIVE-22042: - Author: ASF GitHub Bot Created on: 02/Oct/19 19:47 Start Date: 02/Oct/19 19:47 Worklog Time Spent: 10m Work Description: asfgit commented on pull request #792: HIVE-22042: Set hive.exec.dynamic.partition.mode=nonstrict by default URL: https://github.com/apache/hive/pull/792 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org Issue Time Tracking --- Worklog Id: (was: 322192) Time Spent: 1h 20m (was: 1h 10m) > Set hive.exec.dynamic.partition.mode=nonstrict by default > - > > Key: HIVE-22042 > URL: https://issues.apache.org/jira/browse/HIVE-22042 > Project: Hive > Issue Type: Bug >Reporter: Jesus Camacho Rodriguez >Assignee: John Sherman >Priority: Minor > Labels: pull-request-available > Fix For: 4.0.0 > > Attachments: HIVE-22042.1.patch, HIVE-22042.2.patch, > HIVE-22042.3.patch, HIVE-22042.4.patch > > Time Spent: 1h 20m > Remaining Estimate: 0h > -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Updated] (HIVE-22042) Set hive.exec.dynamic.partition.mode=nonstrict by default
[ https://issues.apache.org/jira/browse/HIVE-22042?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jesus Camacho Rodriguez updated HIVE-22042: --- Fix Version/s: 4.0.0 Resolution: Fixed Status: Resolved (was: Patch Available) Pushed to master, thanks [~jfs]! > Set hive.exec.dynamic.partition.mode=nonstrict by default > - > > Key: HIVE-22042 > URL: https://issues.apache.org/jira/browse/HIVE-22042 > Project: Hive > Issue Type: Bug >Reporter: Jesus Camacho Rodriguez >Assignee: John Sherman >Priority: Minor > Labels: pull-request-available > Fix For: 4.0.0 > > Attachments: HIVE-22042.1.patch, HIVE-22042.2.patch, > HIVE-22042.3.patch, HIVE-22042.4.patch > > Time Spent: 1h 20m > Remaining Estimate: 0h > -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Assigned] (HIVE-22284) Improve LLAP CacheContentsTracker to collect and display correct statistics
[ https://issues.apache.org/jira/browse/HIVE-22284?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ádám Szita reassigned HIVE-22284: - > Improve LLAP CacheContentsTracker to collect and display correct statistics > --- > > Key: HIVE-22284 > URL: https://issues.apache.org/jira/browse/HIVE-22284 > Project: Hive > Issue Type: Improvement > Components: llap >Reporter: Ádám Szita >Assignee: Ádám Szita >Priority: Major > > When keeping track of which buffers correspond to what Hive objects, > CacheContentsTracker relies on cache tags. > Currently a tag is a simple String that ideally holds DB and table name, and > a partition spec concatenated by . and / . The information here is derived > from the Path of the file that is getting cached. Needless to say sometimes > this produces a wrong tag especially for external tables. > Also there's a bug when calculating aggregated stats for a 'parent' tag > (corresponding to the table of the partition) because the overall maxCount > and maxSize do not add up to the sum of those in the partitions. This happens > when buffers get removed from the cache. > -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Commented] (HIVE-22281) Create table statement fails with "not supported NULLS LAST for ORDER BY in ASC order"
[
https://issues.apache.org/jira/browse/HIVE-22281?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16943081#comment-16943081
]
Hive QA commented on HIVE-22281:
| (/) *{color:green}+1 overall{color}* |
\\
\\
|| Vote || Subsystem || Runtime || Comment ||
|| || || || {color:brown} Prechecks {color} ||
| {color:green}+1{color} | {color:green} @author {color} | {color:green} 0m
0s{color} | {color:green} The patch does not contain any @author tags. {color} |
|| || || || {color:brown} master Compile Tests {color} ||
| {color:green}+1{color} | {color:green} mvninstall {color} | {color:green} 8m
57s{color} | {color:green} master passed {color} |
| {color:green}+1{color} | {color:green} compile {color} | {color:green} 1m
7s{color} | {color:green} master passed {color} |
| {color:green}+1{color} | {color:green} checkstyle {color} | {color:green} 0m
40s{color} | {color:green} master passed {color} |
| {color:blue}0{color} | {color:blue} findbugs {color} | {color:blue} 4m
9s{color} | {color:blue} ql in master has 1551 extant Findbugs warnings.
{color} |
| {color:green}+1{color} | {color:green} javadoc {color} | {color:green} 1m
1s{color} | {color:green} master passed {color} |
|| || || || {color:brown} Patch Compile Tests {color} ||
| {color:green}+1{color} | {color:green} mvninstall {color} | {color:green} 1m
27s{color} | {color:green} the patch passed {color} |
| {color:green}+1{color} | {color:green} compile {color} | {color:green} 1m
6s{color} | {color:green} the patch passed {color} |
| {color:green}+1{color} | {color:green} javac {color} | {color:green} 1m
6s{color} | {color:green} the patch passed {color} |
| {color:green}+1{color} | {color:green} checkstyle {color} | {color:green} 0m
40s{color} | {color:green} the patch passed {color} |
| {color:green}+1{color} | {color:green} whitespace {color} | {color:green} 0m
0s{color} | {color:green} The patch has no whitespace issues. {color} |
| {color:green}+1{color} | {color:green} findbugs {color} | {color:green} 4m
23s{color} | {color:green} the patch passed {color} |
| {color:green}+1{color} | {color:green} javadoc {color} | {color:green} 1m
0s{color} | {color:green} the patch passed {color} |
|| || || || {color:brown} Other Tests {color} ||
| {color:green}+1{color} | {color:green} asflicense {color} | {color:green} 0m
15s{color} | {color:green} The patch does not generate ASF License warnings.
{color} |
| {color:black}{color} | {color:black} {color} | {color:black} 25m 14s{color} |
{color:black} {color} |
\\
\\
|| Subsystem || Report/Notes ||
| Optional Tests | asflicense javac javadoc findbugs checkstyle compile |
| uname | Linux hiveptest-server-upstream 3.16.0-4-amd64 #1 SMP Debian
3.16.43-2+deb8u5 (2017-09-19) x86_64 GNU/Linux |
| Build tool | maven |
| Personality |
/data/hiveptest/working/yetus_PreCommit-HIVE-Build-18832/dev-support/hive-personality.sh
|
| git revision | master / 5a03a60 |
| Default Java | 1.8.0_111 |
| findbugs | v3.0.1 |
| modules | C: ql U: ql |
| Console output |
http://104.198.109.242/logs//PreCommit-HIVE-Build-18832/yetus.txt |
| Powered by | Apache Yetushttp://yetus.apache.org |
This message was automatically generated.
> Create table statement fails with "not supported NULLS LAST for ORDER BY in
> ASC order"
> --
>
> Key: HIVE-22281
> URL: https://issues.apache.org/jira/browse/HIVE-22281
> Project: Hive
> Issue Type: Bug
> Components: Parser
>Reporter: Krisztian Kasa
>Assignee: Krisztian Kasa
>Priority: Major
> Fix For: 4.0.0
>
> Attachments: HIVE-22281.1.patch
>
>
> {code}
> CREATE TABLE table_core2c4ywq7yjx ( k1 STRING, f1 STRING,
> sequence_num BIGINT, create_bsk BIGINT, change_bsk BIGINT,
> op_code STRING ) PARTITIONED BY (run_id BIGINT) CLUSTERED BY (k1) SORTED BY
> (k1, change_bsk, sequence_num) INTO 4 BUCKETS STORED AS ORC
> {code}
> {code}
> Error while compiling statement: FAILED: SemanticException create/alter
> table: not supported NULLS LAST for ORDER BY in ASC order
> {code}
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
[jira] [Updated] (HIVE-22270) Upgrade commons-io to 2.6
[ https://issues.apache.org/jira/browse/HIVE-22270?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] David Lavati updated HIVE-22270: Attachment: HIVE-22270.patch > Upgrade commons-io to 2.6 > - > > Key: HIVE-22270 > URL: https://issues.apache.org/jira/browse/HIVE-22270 > Project: Hive > Issue Type: Improvement >Reporter: David Lavati >Assignee: David Lavati >Priority: Major > Labels: pull-request-available > Attachments: HIVE-22270.patch, HIVE-22270.patch, HIVE-22270.patch, > HIVE-22270.patch > > Time Spent: 10m > Remaining Estimate: 0h > > Hive's currently using commons-io 2.4 and according to HIVE-21273, a number > of issues are present in it, which can be resolved by upgrading to 2.6: > IOUtils copyLarge() and skip() methods are performance hogs > affectsVersions:2.3;2.4 > > [https://issues.apache.org/jira/projects/IO/issues/IO-355?filter=allopenissues] > CharSequenceInputStream#reset() behaves incorrectly in case when buffer size > is not dividable by data size > affectsVersions:2.4 > > [https://issues.apache.org/jira/projects/IO/issues/IO-356?filter=allopenissues] > [Tailer] InterruptedException while the thead is sleeping is silently ignored > affectsVersions:2.4 > > [https://issues.apache.org/jira/projects/IO/issues/IO-357?filter=allopenissues] > IOUtils.contentEquals* methods returns false if input1 == input2; should > return true > affectsVersions:2.4 > > [https://issues.apache.org/jira/projects/IO/issues/IO-362?filter=allopenissues] > Apache Commons - standard links for documents are failing > affectsVersions:2.4 > > [https://issues.apache.org/jira/projects/IO/issues/IO-369?filter=allopenissues] > FileUtils.sizeOfDirectoryAsBigInteger can overflow > affectsVersions:2.4 > > [https://issues.apache.org/jira/projects/IO/issues/IO-390?filter=allopenissues] > Regression in FileUtils.readFileToString from 2.0.1 > affectsVersions:2.1;2.2;2.3;2.4 > > [https://issues.apache.org/jira/projects/IO/issues/IO-453?filter=allopenissues] > Correct exception message in FileUtils.getFile(File; String...) > affectsVersions:2.4 > > [https://issues.apache.org/jira/projects/IO/issues/IO-479?filter=allopenissues] > org.apache.commons.io.FileUtils#waitFor waits too long > affectsVersions:2.4 > > [https://issues.apache.org/jira/projects/IO/issues/IO-481?filter=allopenissues] > FilenameUtils should handle embedded null bytes > affectsVersions:2.4 > > [https://issues.apache.org/jira/projects/IO/issues/IO-484?filter=allopenissues] > Exceptions are suppressed incorrectly when copying files. > affectsVersions:2.4;2.5 > > [https://issues.apache.org/jira/projects/IO/issues/IO-502?filter=allopenissues] > -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Commented] (HIVE-22225) add owner name for create database if missing
[ https://issues.apache.org/jira/browse/HIVE-5?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16943075#comment-16943075 ] Naveen Gangam commented on HIVE-5: -- Makes sense. The fix looks good to me. So +1. > add owner name for create database if missing > - > > Key: HIVE-5 > URL: https://issues.apache.org/jira/browse/HIVE-5 > Project: Hive > Issue Type: Task > Components: Hive >Reporter: Sam An >Assignee: Sam An >Priority: Minor > Attachments: HIVE-5.1.patch, HIVE-5.2.patch, > HIVE-5.4.patch, Hive-5.3.patch > > > When Spark connects to HMS, the database owner name is not filled. This could > happen to other clients as well. We shall fill this in HMS. Ownership info is > useful for authorizer component in Ranger, etc. -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Work logged] (HIVE-22276) Break up DDLSemanticAnalyzer - extract View related analyzers
[ https://issues.apache.org/jira/browse/HIVE-22276?focusedWorklogId=322122=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-322122 ] ASF GitHub Bot logged work on HIVE-22276: - Author: ASF GitHub Bot Created on: 02/Oct/19 18:27 Start Date: 02/Oct/19 18:27 Worklog Time Spent: 10m Work Description: miklosgergely commented on pull request #800: HIVE-22276 Break up DDLSemanticAnalyzer - extract View related analyzers URL: https://github.com/apache/hive/pull/800 DDLSemanticAnalyzer is a huge class, more than 4000 lines long. The goal is to refactor it in order to have everything cut into more handleable classes under the package org.apache.hadoop.hive.ql.exec.ddl: - have a separate class for each analyzers - have a package for each operation, containing an analyzer, a description, and an operation, so the amount of classes under a package is more manageable Step #6: extract all the vire related analyzers from DDLSemanticAnalyzer, and move them under the new package. This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org Issue Time Tracking --- Worklog Id: (was: 322122) Remaining Estimate: 0h Time Spent: 10m > Break up DDLSemanticAnalyzer - extract View related analyzers > - > > Key: HIVE-22276 > URL: https://issues.apache.org/jira/browse/HIVE-22276 > Project: Hive > Issue Type: Sub-task >Reporter: Miklos Gergely >Assignee: Miklos Gergely >Priority: Major > Labels: pull-request-available, refactor-ddl > Attachments: HIVE-22276.01.patch, HIVE-22276.02.patch > > Time Spent: 10m > Remaining Estimate: 0h > > DDLSemanticAnalyzer is a huge class, more than 4000 lines long. The goal is > to refactor it in order to have everything cut into more handleable classes > under the package org.apache.hadoop.hive.ql.exec.ddl: > * have a separate class for each analyzers > * have a package for each operation, containing an analyzer, a description, > and an operation, so the amount of classes under a package is more manageable > Step #6: extract all the vire related analyzers from DDLSemanticAnalyzer, and > move them under the new package. -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Updated] (HIVE-22248) Min value for column in stats is not set correctly for some data types
[ https://issues.apache.org/jira/browse/HIVE-22248?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Miklos Gergely updated HIVE-22248: -- Attachment: HIVE-22248.02.patch > Min value for column in stats is not set correctly for some data types > -- > > Key: HIVE-22248 > URL: https://issues.apache.org/jira/browse/HIVE-22248 > Project: Hive > Issue Type: Bug > Components: Statistics >Reporter: Jesus Camacho Rodriguez >Assignee: Miklos Gergely >Priority: Major > Attachments: HIVE-22248.01.patch, HIVE-22248.02.patch > > > I am not sure whether the problem is printing the value or in the value > stored in the metastore itself, but for some types (e.g. tinyint, smallint, > int, bigint, double or float), the min value does not seem to be set > correctly (set to 0). > https://github.com/apache/hive/blob/master/ql/src/test/results/clientpositive/alter_table_update_status.q.out#L342 -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Commented] (HIVE-22276) Break up DDLSemanticAnalyzer - extract View related analyzers
[
https://issues.apache.org/jira/browse/HIVE-22276?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16943058#comment-16943058
]
Hive QA commented on HIVE-22276:
Here are the results of testing the latest attachment:
https://issues.apache.org/jira/secure/attachment/12981972/HIVE-22276.02.patch
{color:red}ERROR:{color} -1 due to no test(s) being added or modified.
{color:green}SUCCESS:{color} +1 due to 17169 tests passed
Test results:
https://builds.apache.org/job/PreCommit-HIVE-Build/18831/testReport
Console output: https://builds.apache.org/job/PreCommit-HIVE-Build/18831/console
Test logs: http://104.198.109.242/logs/PreCommit-HIVE-Build-18831/
Messages:
{noformat}
Executing org.apache.hive.ptest.execution.TestCheckPhase
Executing org.apache.hive.ptest.execution.PrepPhase
Executing org.apache.hive.ptest.execution.YetusPhase
Executing org.apache.hive.ptest.execution.ExecutionPhase
Executing org.apache.hive.ptest.execution.ReportingPhase
{noformat}
This message is automatically generated.
ATTACHMENT ID: 12981972 - PreCommit-HIVE-Build
> Break up DDLSemanticAnalyzer - extract View related analyzers
> -
>
> Key: HIVE-22276
> URL: https://issues.apache.org/jira/browse/HIVE-22276
> Project: Hive
> Issue Type: Sub-task
>Reporter: Miklos Gergely
>Assignee: Miklos Gergely
>Priority: Major
> Labels: pull-request-available, refactor-ddl
> Attachments: HIVE-22276.01.patch, HIVE-22276.02.patch
>
>
> DDLSemanticAnalyzer is a huge class, more than 4000 lines long. The goal is
> to refactor it in order to have everything cut into more handleable classes
> under the package org.apache.hadoop.hive.ql.exec.ddl:
> * have a separate class for each analyzers
> * have a package for each operation, containing an analyzer, a description,
> and an operation, so the amount of classes under a package is more manageable
> Step #6: extract all the vire related analyzers from DDLSemanticAnalyzer, and
> move them under the new package.
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
[jira] [Assigned] (HIVE-19535) Hive error reporting for not setting “Utilities.INPUT_NAME”
[ https://issues.apache.org/jira/browse/HIVE-19535?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Richard Zhang reassigned HIVE-19535: Assignee: Richard Zhang > Hive error reporting for not setting “Utilities.INPUT_NAME” > --- > > Key: HIVE-19535 > URL: https://issues.apache.org/jira/browse/HIVE-19535 > Project: Hive > Issue Type: Bug >Reporter: zhaoyang >Assignee: Richard Zhang >Priority: Blocker > > I set the parameter "hive.exec.mode.local.auto" to true. Then I used JDBC > mode to submit sql to hiveserver2 in a multithreaded manner. Sometimes > exceptions are thrown when several tasks run in parallel in the local mode. > "Invalid input path xxx" > But this path is not the input path of the current SQL, it is another SQL > input path. > So I suspect that one of the SQL covers some information about another SQL. > So I looked up the source code and found a parameter, and when I set the > "iocontext.input.name" to the unique value, I didn't get it wrong. -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Assigned] (HIVE-22082) SQL 错误 [2] [08S01]: Error while processing statement: FAILED: Execution Error
[
https://issues.apache.org/jira/browse/HIVE-22082?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Richard Zhang reassigned HIVE-22082:
Assignee: Richard Zhang
> SQL 错误 [2] [08S01]: Error while processing statement: FAILED: Execution Error
> -
>
> Key: HIVE-22082
> URL: https://issues.apache.org/jira/browse/HIVE-22082
> Project: Hive
> Issue Type: Bug
> Components: Hive, hpl/sql, SQL, Tez
>Affects Versions: 3.1.0
> Environment: 报错环境为hive的3.1.0.3.1.0.0-78，可以运行的环境是 Hive 1.2.1000
>Reporter: 冯伟
>Assignee: Richard Zhang
>Priority: Blocker
> Fix For: 1.2.1
>
>
> hive 1.2.1旧版本SQL语句运行没问题，3.1版本运行报错：
> 查询使用的是TEZ。
> SQL语句：
> {code:java}
> // SQL语句：
> select id ,triggered from ti_ins.instinct_result_info lateral view
> explode(split( concat_ws(',',rule_triggered_1,rule_triggered_2),','))num as
> triggered LIMIT 1{code}
> {code:java}
> //代码占位符SQL 错误 [2] [08S01]: Error while processing statement: FAILED:
> Execution Error, return code 2 from
> org.apache.hadoop.hive.ql.exec.tez.TezTask. Vertex failed, vertexName=Map 1,
> vertexId=vertex_1563265369069_0167_15_00, diagnostics=[Task failed,
> taskId=task_1563265369069_0167_15_00_03, diagnostics=[TaskAttempt 0
> failed, info=[Error: Error while running task ( failure ) :
> attempt_1563265369069_0167_15_00_03_0:java.lang.RuntimeException:
> java.lang.RuntimeException: java.io.IOException:
> java.lang.IllegalArgumentException: bucketId out of range: -1
> at
> org.apache.hadoop.hive.ql.exec.tez.TezProcessor.initializeAndRunProcessor(TezProcessor.java:296)
> at org.apache.hadoop.hive.ql.exec.tez.TezProcessor.run(TezProcessor.java:250)
> at
> org.apache.tez.runtime.LogicalIOProcessorRuntimeTask.run(LogicalIOProcessorRuntimeTask.java:374)
> at
> org.apache.tez.runtime.task.TaskRunner2Callable$1.run(TaskRunner2Callable.java:73)
> at
> org.apache.tez.runtime.task.TaskRunner2Callable$1.run(TaskRunner2Callable.java:61)
> at java.security.AccessController.doPrivileged(Native Method)
> at javax.security.auth.Subject.doAs(Subject.java:422)
> at
> org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1730)
> at
> org.apache.tez.runtime.task.TaskRunner2Callable.callInternal(TaskRunner2Callable.java:61)
> at
> org.apache.tez.runtime.task.TaskRunner2Callable.callInternal(TaskRunner2Callable.java:37)
> at org.apache.tez.common.CallableWithNdc.call(CallableWithNdc.java:36)
> at
> com.google.common.util.concurrent.TrustedListenableFutureTask$TrustedFutureInterruptibleTask.runInterruptibly(TrustedListenableFutureTask.java:108)
> at
> com.google.common.util.concurrent.InterruptibleTask.run(InterruptibleTask.java:41)
> at
> com.google.common.util.concurrent.TrustedListenableFutureTask.run(TrustedListenableFutureTask.java:77)
> at
> java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
> at
> java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
> at java.lang.Thread.run(Thread.java:748)
> Caused by: java.lang.RuntimeException: java.io.IOException:
> java.lang.IllegalArgumentException: bucketId out of range: -1
> at
> org.apache.hadoop.mapred.split.TezGroupedSplitsInputFormat$TezGroupedSplitsRecordReader.initNextRecordReader(TezGroupedSplitsInputFormat.java:206)
> at
> org.apache.hadoop.mapred.split.TezGroupedSplitsInputFormat$TezGroupedSplitsRecordReader.(TezGroupedSplitsInputFormat.java:145)
> at
> org.apache.hadoop.mapred.split.TezGroupedSplitsInputFormat.getRecordReader(TezGroupedSplitsInputFormat.java:111)
> at
> org.apache.tez.mapreduce.lib.MRReaderMapred.setupOldRecordReader(MRReaderMapred.java:157)
> at
> org.apache.tez.mapreduce.lib.MRReaderMapred.setSplit(MRReaderMapred.java:83)
> at
> org.apache.tez.mapreduce.input.MRInput.initFromEventInternal(MRInput.java:703)
> at org.apache.tez.mapreduce.input.MRInput.initFromEvent(MRInput.java:662)
> at
> org.apache.tez.mapreduce.input.MRInputLegacy.checkAndAwaitRecordReaderInitialization(MRInputLegacy.java:150)
> at org.apache.tez.mapreduce.input.MRInputLegacy.init(MRInputLegacy.java:114)
> at
> org.apache.hadoop.hive.ql.exec.tez.MapRecordProcessor.getMRInput(MapRecordProcessor.java:532)
> at
> org.apache.hadoop.hive.ql.exec.tez.MapRecordProcessor.init(MapRecordProcessor.java:178)
> at
> org.apache.hadoop.hive.ql.exec.tez.TezProcessor.initializeAndRunProcessor(TezProcessor.java:266)
> ... 16 more
> Caused by: java.io.IOException: java.lang.IllegalArgumentException: bucketId
> out of range: -1
> at
> org.apache.hadoop.hive.io.HiveIOExceptionHandlerChain.handleRecordReaderCreationException(HiveIOExceptionHandlerChain.java:97)
> at
> org.apache.hadoop.hive.io.HiveIOExceptionHandlerUtil.handleRecordReaderCreationException(HiveIOExceptionHandlerUtil.java:57)
> at
[jira] [Commented] (HIVE-22225) add owner name for create database if missing
[ https://issues.apache.org/jira/browse/HIVE-5?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16943045#comment-16943045 ] Sam An commented on HIVE-5: --- Thanks, Naveen. As communicated offline. I believe we should be OK in not automatically filling in the ownership for null owner DBs. The reasons are First, it might not be always possible to figure who owns the DB. Second, if ownership is needed, the user can ask admin to assign a new owner. Once 5 goes in, most likely null ownership won’t happen much. > add owner name for create database if missing > - > > Key: HIVE-5 > URL: https://issues.apache.org/jira/browse/HIVE-5 > Project: Hive > Issue Type: Task > Components: Hive >Reporter: Sam An >Assignee: Sam An >Priority: Minor > Attachments: HIVE-5.1.patch, HIVE-5.2.patch, > HIVE-5.4.patch, Hive-5.3.patch > > > When Spark connects to HMS, the database owner name is not filled. This could > happen to other clients as well. We shall fill this in HMS. Ownership info is > useful for authorizer component in Ranger, etc. -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Commented] (HIVE-22225) add owner name for create database if missing
[ https://issues.apache.org/jira/browse/HIVE-5?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16943021#comment-16943021 ] Naveen Gangam commented on HIVE-5: -- [~samuelan] Quick question, for existing databases that do not have ownership info, would it make sense to also automatically update the database with ownership info when a user executed "alter database" on the table, only when the current database and the new database (coming from the AlterDatabaseRequest) both have no ownership info. I am guessing no, because executing alter table on a table should not make that user the owner. They may or may not be the original owners. But just wanted to make sure that you had given it some thought as well. Thank you > add owner name for create database if missing > - > > Key: HIVE-5 > URL: https://issues.apache.org/jira/browse/HIVE-5 > Project: Hive > Issue Type: Task > Components: Hive >Reporter: Sam An >Assignee: Sam An >Priority: Minor > Attachments: HIVE-5.1.patch, HIVE-5.2.patch, > HIVE-5.4.patch, Hive-5.3.patch > > > When Spark connects to HMS, the database owner name is not filled. This could > happen to other clients as well. We shall fill this in HMS. Ownership info is > useful for authorizer component in Ranger, etc. -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Commented] (HIVE-22276) Break up DDLSemanticAnalyzer - extract View related analyzers
[
https://issues.apache.org/jira/browse/HIVE-22276?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16943018#comment-16943018
]
Hive QA commented on HIVE-22276:
| (/) *{color:green}+1 overall{color}* |
\\
\\
|| Vote || Subsystem || Runtime || Comment ||
|| || || || {color:brown} Prechecks {color} ||
| {color:green}+1{color} | {color:green} @author {color} | {color:green} 0m
1s{color} | {color:green} The patch does not contain any @author tags. {color} |
|| || || || {color:brown} master Compile Tests {color} ||
| {color:green}+1{color} | {color:green} mvninstall {color} | {color:green} 11m
28s{color} | {color:green} master passed {color} |
| {color:green}+1{color} | {color:green} compile {color} | {color:green} 1m
11s{color} | {color:green} master passed {color} |
| {color:green}+1{color} | {color:green} checkstyle {color} | {color:green} 0m
49s{color} | {color:green} master passed {color} |
| {color:blue}0{color} | {color:blue} findbugs {color} | {color:blue} 4m
1s{color} | {color:blue} ql in master has 1551 extant Findbugs warnings.
{color} |
| {color:green}+1{color} | {color:green} javadoc {color} | {color:green} 0m
59s{color} | {color:green} master passed {color} |
|| || || || {color:brown} Patch Compile Tests {color} ||
| {color:green}+1{color} | {color:green} mvninstall {color} | {color:green} 1m
29s{color} | {color:green} the patch passed {color} |
| {color:green}+1{color} | {color:green} compile {color} | {color:green} 1m
6s{color} | {color:green} the patch passed {color} |
| {color:green}+1{color} | {color:green} javac {color} | {color:green} 1m
6s{color} | {color:green} the patch passed {color} |
| {color:green}+1{color} | {color:green} checkstyle {color} | {color:green} 0m
47s{color} | {color:green} ql: The patch generated 0 new + 727 unchanged - 13
fixed = 727 total (was 740) {color} |
| {color:green}+1{color} | {color:green} whitespace {color} | {color:green} 0m
0s{color} | {color:green} The patch has no whitespace issues. {color} |
| {color:green}+1{color} | {color:green} findbugs {color} | {color:green} 4m
21s{color} | {color:green} the patch passed {color} |
| {color:green}+1{color} | {color:green} javadoc {color} | {color:green} 0m
59s{color} | {color:green} the patch passed {color} |
|| || || || {color:brown} Other Tests {color} ||
| {color:green}+1{color} | {color:green} asflicense {color} | {color:green} 0m
14s{color} | {color:green} The patch does not generate ASF License warnings.
{color} |
| {color:black}{color} | {color:black} {color} | {color:black} 28m 17s{color} |
{color:black} {color} |
\\
\\
|| Subsystem || Report/Notes ||
| Optional Tests | asflicense javac javadoc findbugs checkstyle compile |
| uname | Linux hiveptest-server-upstream 3.16.0-4-amd64 #1 SMP Debian
3.16.43-2+deb8u5 (2017-09-19) x86_64 GNU/Linux |
| Build tool | maven |
| Personality |
/data/hiveptest/working/yetus_PreCommit-HIVE-Build-18831/dev-support/hive-personality.sh
|
| git revision | master / 5a03a60 |
| Default Java | 1.8.0_111 |
| findbugs | v3.0.1 |
| modules | C: ql U: ql |
| Console output |
http://104.198.109.242/logs//PreCommit-HIVE-Build-18831/yetus.txt |
| Powered by | Apache Yetushttp://yetus.apache.org |
This message was automatically generated.
> Break up DDLSemanticAnalyzer - extract View related analyzers
> -
>
> Key: HIVE-22276
> URL: https://issues.apache.org/jira/browse/HIVE-22276
> Project: Hive
> Issue Type: Sub-task
>Reporter: Miklos Gergely
>Assignee: Miklos Gergely
>Priority: Major
> Labels: pull-request-available, refactor-ddl
> Attachments: HIVE-22276.01.patch, HIVE-22276.02.patch
>
>
> DDLSemanticAnalyzer is a huge class, more than 4000 lines long. The goal is
> to refactor it in order to have everything cut into more handleable classes
> under the package org.apache.hadoop.hive.ql.exec.ddl:
> * have a separate class for each analyzers
> * have a package for each operation, containing an analyzer, a description,
> and an operation, so the amount of classes under a package is more manageable
> Step #6: extract all the vire related analyzers from DDLSemanticAnalyzer, and
> move them under the new package.
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
[jira] [Commented] (HIVE-22278) Upgrade log4j to 2.12.1
[
https://issues.apache.org/jira/browse/HIVE-22278?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16942992#comment-16942992
]
Hive QA commented on HIVE-22278:
| (x) *{color:red}-1 overall{color}* |
\\
\\
|| Vote || Subsystem || Runtime || Comment ||
|| || || || {color:brown} Prechecks {color} ||
| {color:green}+1{color} | {color:green} @author {color} | {color:green} 0m
0s{color} | {color:green} The patch does not contain any @author tags. {color} |
|| || || || {color:brown} master Compile Tests {color} ||
| {color:blue}0{color} | {color:blue} mvndep {color} | {color:blue} 1m
49s{color} | {color:blue} Maven dependency ordering for branch {color} |
| {color:green}+1{color} | {color:green} mvninstall {color} | {color:green} 7m
23s{color} | {color:green} master passed {color} |
| {color:green}+1{color} | {color:green} compile {color} | {color:green} 10m
7s{color} | {color:green} master passed {color} |
| {color:green}+1{color} | {color:green} checkstyle {color} | {color:green} 3m
36s{color} | {color:green} master passed {color} |
| {color:blue}0{color} | {color:blue} findbugs {color} | {color:blue} 2m
38s{color} | {color:blue} standalone-metastore/metastore-common in master has
32 extant Findbugs warnings. {color} |
| {color:blue}0{color} | {color:blue} findbugs {color} | {color:blue} 4m
14s{color} | {color:blue} ql in master has 1551 extant Findbugs warnings.
{color} |
| {color:blue}0{color} | {color:blue} findbugs {color} | {color:blue} 0m
40s{color} | {color:blue} itests/hive-unit in master has 2 extant Findbugs
warnings. {color} |
| {color:blue}0{color} | {color:blue} findbugs {color} | {color:blue} 0m
22s{color} | {color:blue} testutils/ptest2 in master has 24 extant Findbugs
warnings. {color} |
| {color:green}+1{color} | {color:green} javadoc {color} | {color:green} 10m
31s{color} | {color:green} master passed {color} |
|| || || || {color:brown} Patch Compile Tests {color} ||
| {color:blue}0{color} | {color:blue} mvndep {color} | {color:blue} 0m
26s{color} | {color:blue} Maven dependency ordering for patch {color} |
| {color:green}+1{color} | {color:green} mvninstall {color} | {color:green} 11m
10s{color} | {color:green} the patch passed {color} |
| {color:green}+1{color} | {color:green} compile {color} | {color:green} 10m
27s{color} | {color:green} the patch passed {color} |
| {color:green}+1{color} | {color:green} javac {color} | {color:green} 10m
27s{color} | {color:green} the patch passed {color} |
| {color:green}+1{color} | {color:green} checkstyle {color} | {color:green} 3m
40s{color} | {color:green} the patch passed {color} |
| {color:green}+1{color} | {color:green} whitespace {color} | {color:green} 0m
0s{color} | {color:green} The patch has no whitespace issues. {color} |
| {color:green}+1{color} | {color:green} xml {color} | {color:green} 0m
4s{color} | {color:green} The patch has no ill-formed XML file. {color} |
| {color:green}+1{color} | {color:green} findbugs {color} | {color:green} 8m
57s{color} | {color:green} the patch passed {color} |
| {color:green}+1{color} | {color:green} javadoc {color} | {color:green} 21m
22s{color} | {color:green} the patch passed {color} |
|| || || || {color:brown} Other Tests {color} ||
| {color:red}-1{color} | {color:red} asflicense {color} | {color:red} 0m
18s{color} | {color:red} The patch generated 3 ASF License warnings. {color} |
| {color:black}{color} | {color:black} {color} | {color:black} 99m 3s{color} |
{color:black} {color} |
\\
\\
|| Subsystem || Report/Notes ||
| Optional Tests | asflicense javac javadoc findbugs checkstyle compile
xml |
| uname | Linux hiveptest-server-upstream 3.16.0-4-amd64 #1 SMP Debian
3.16.43-2+deb8u5 (2017-09-19) x86_64 GNU/Linux |
| Build tool | maven |
| Personality |
/data/hiveptest/working/yetus_PreCommit-HIVE-Build-18830/dev-support/hive-personality.sh
|
| git revision | master / 5a03a60 |
| Default Java | 1.8.0_111 |
| findbugs | v3.0.0 |
| asflicense |
http://104.198.109.242/logs//PreCommit-HIVE-Build-18830/yetus/patch-asflicense-problems.txt
|
| modules | C: standalone-metastore standalone-metastore/metastore-common ql .
itests/hive-unit testutils/ptest2 U: . |
| Console output |
http://104.198.109.242/logs//PreCommit-HIVE-Build-18830/yetus.txt |
| Powered by | Apache Yetushttp://yetus.apache.org |
This message was automatically generated.
> Upgrade log4j to 2.12.1
> ---
>
> Key: HIVE-22278
> URL: https://issues.apache.org/jira/browse/HIVE-22278
> Project: Hive
> Issue Type: Improvement
>Reporter: David Lavati
>Assignee: David Lavati
>Priority: Major
> Labels: pull-request-available
> Attachments: HIVE-22278.02.patch, HIVE-22278.patch
>
> Time Spent: 10m
> Remaining Estimate: 0h
>
> Hive's currently using log4j 2.10.0 and according to
[jira] [Commented] (HIVE-22278) Upgrade log4j to 2.12.1
[
https://issues.apache.org/jira/browse/HIVE-22278?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16942963#comment-16942963
]
Hive QA commented on HIVE-22278:
Here are the results of testing the latest attachment:
https://issues.apache.org/jira/secure/attachment/12981962/HIVE-22278.02.patch
{color:green}SUCCESS:{color} +1 due to 1 test(s) being added or modified.
{color:red}ERROR:{color} -1 due to 1 failed/errored test(s), 17169 tests
executed
*Failed tests:*
{noformat}
org.apache.hadoop.hive.llap.security.TestLlapSignerImpl.testSigning
(batchId=363)
{noformat}
Test results:
https://builds.apache.org/job/PreCommit-HIVE-Build/18830/testReport
Console output: https://builds.apache.org/job/PreCommit-HIVE-Build/18830/console
Test logs: http://104.198.109.242/logs/PreCommit-HIVE-Build-18830/
Messages:
{noformat}
Executing org.apache.hive.ptest.execution.TestCheckPhase
Executing org.apache.hive.ptest.execution.PrepPhase
Executing org.apache.hive.ptest.execution.YetusPhase
Executing org.apache.hive.ptest.execution.ExecutionPhase
Executing org.apache.hive.ptest.execution.ReportingPhase
Tests exited with: TestsFailedException: 1 tests failed
{noformat}
This message is automatically generated.
ATTACHMENT ID: 12981962 - PreCommit-HIVE-Build
> Upgrade log4j to 2.12.1
> ---
>
> Key: HIVE-22278
> URL: https://issues.apache.org/jira/browse/HIVE-22278
> Project: Hive
> Issue Type: Improvement
>Reporter: David Lavati
>Assignee: David Lavati
>Priority: Major
> Labels: pull-request-available
> Attachments: HIVE-22278.02.patch, HIVE-22278.patch
>
> Time Spent: 10m
> Remaining Estimate: 0h
>
> Hive's currently using log4j 2.10.0 and according to HIVE-21273, a number of
> issues are present in it, which can be resolved by upgrading to 2.12.1:
> Curly braces in parameters are treated as placeholders
> affectsVersions:2.8.2;2.9.0;2.10.0
>
> [https://issues.apache.org/jira/projects/LOG4J2/issues/LOG4J2-2032?filter=allopenissues]
> Remove Log4J API dependency on Management APIs
> affectsVersions:2.9.1;2.10.0
>
> [https://issues.apache.org/jira/projects/LOG4J2/issues/LOG4J2-2126?filter=allopenissues]
> Log4j2 throws NoClassDefFoundError in Java 9
> affectsVersions:2.10.0;2.11.0
>
> [https://issues.apache.org/jira/projects/LOG4J2/issues/LOG4J2-2129?filter=allopenissues]
> ThreadContext map is cleared => entries are only available for one log event
> affectsVersions:2.10.0
>
> [https://issues.apache.org/jira/projects/LOG4J2/issues/LOG4J2-2158?filter=allopenissues]
> Objects held in SortedArrayStringMap cannot be filtered during serialization
> affectsVersions:2.10.0
>
> [https://issues.apache.org/jira/projects/LOG4J2/issues/LOG4J2-2163?filter=allopenissues]
> NullPointerException at
> org.apache.logging.log4j.util.Activator.loadProvider(Activator.java:81) in
> log4j 2.10.0
> affectsVersions:2.10.0
>
> [https://issues.apache.org/jira/projects/LOG4J2/issues/LOG4J2-2182?filter=allopenissues]
> MarkerFilter onMismatch invalid attribute in .properties
> affectsVersions:2.10.0
>
> [https://issues.apache.org/jira/projects/LOG4J2/issues/LOG4J2-2202?filter=allopenissues]
> Configuration builder classes should look for "onMismatch"; not "onMisMatch".
>
> affectsVersions:2.4;2.4.1;2.5;2.6;2.6.1;2.6.2;2.7;2.8;2.8.1;2.8.2;2.9.0;2.10.0
>
> [https://issues.apache.org/jira/projects/LOG4J2/issues/LOG4J2-2219?filter=allopenissues]
> Empty Automatic-Module-Name Header
> affectsVersions:2.10.0;2.11.0;3.0.0
>
> [https://issues.apache.org/jira/projects/LOG4J2/issues/LOG4J2-2254?filter=allopenissues]
> ConcurrentModificationException from
> org.apache.logging.log4j.status.StatusLogger.(StatusLogger.java:71)
> affectsVersions:2.10.0
>
> [https://issues.apache.org/jira/projects/LOG4J2/issues/LOG4J2-2276?filter=allopenissues]
> Allow SystemPropertiesPropertySource to run with a SecurityManager that
> rejects system property access
> affectsVersions:2.10.0
>
> [https://issues.apache.org/jira/projects/LOG4J2/issues/LOG4J2-2279?filter=allopenissues]
> ParserConfigurationException when using Log4j with
> oracle.xml.jaxp.JXDocumentBuilderFactory
> affectsVersions:2.10.0
>
> [https://issues.apache.org/jira/projects/LOG4J2/issues/LOG4J2-2283?filter=allopenissues]
> Log4j 2.10+not working with SLF4J 1.8 in OSGI environment
> affectsVersions:2.10.0;2.11.0
>
> [https://issues.apache.org/jira/projects/LOG4J2/issues/LOG4J2-2305?filter=allopenissues]
> fix the CacheEntry map in ThrowableProxy#toExtendedStackTrace to be put and
> gotten with same key
> affectsVersions:2.6.2;2.7;2.8;2.8.1;2.8.2;2.9.0;2.9.1;2.10.0;2.11.0
>
> [https://issues.apache.org/jira/projects/LOG4J2/issues/LOG4J2-2389?filter=allopenissues]
> NullPointerException when closing never used RollingRandomAccessFileAppender
>
[jira] [Commented] (HIVE-10234) Problems using custom inputformat
[ https://issues.apache.org/jira/browse/HIVE-10234?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16942946#comment-16942946 ] Joshua Martell commented on HIVE-10234: --- Has there been any traction on this? Seems like mapred was many years ago. > Problems using custom inputformat > - > > Key: HIVE-10234 > URL: https://issues.apache.org/jira/browse/HIVE-10234 > Project: Hive > Issue Type: Bug > Components: File Formats >Affects Versions: 0.13.1 > Environment: CentOS release 6.3 > CDH-5.3.1-1.cdh5.3.1.p0.5 > hive-0.13.1-cdh5.3.1 > Inputformat: > https://github.com/twitter/elephant-bird/blob/master/rcfile/src/main/java/com/twitter/elephantbird/mapreduce/input/RCFileProtobufInputFormat.java >Reporter: xuhuan >Priority: Critical > Labels: inputformat > > I apply the RCFileProtobufInputFormat from twitter's elephantbird project > into hive to handle Protobuf records which are written in a RCFile file > format. What I have done is belowing: > 1. compile the soure code of RCFileProtobufInputFormat and make a jar > 2. add the jar to hive_aux_jar_path and update the config of server and client > 3. create table using inputformat > "com.twitter.elephantbird.mapreduce.input.RCFileProtobufInputFormat" > Creating table is ok.but when I excute a query like "select * from table > test"(there is no data in table test),I got these mistake: FAILED: > SemanticException 1:14 Input format must implement InputFormat. Error > encountered near token test. > I found some cases in stackoverflow,someones said that's because the custom > inputformat class implement the new API(org.apache.hadoop.marpreduce) and > RCFileProtobufInputFormat class indeed extends the new API. I'm wondering if > a custom inputformat must extend the old API(org.apache.hadoop.marpred)? > Could this be the reason of my problem? -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Updated] (HIVE-22270) Upgrade commons-io to 2.6
[ https://issues.apache.org/jira/browse/HIVE-22270?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] David Lavati updated HIVE-22270: Attachment: HIVE-22270.patch > Upgrade commons-io to 2.6 > - > > Key: HIVE-22270 > URL: https://issues.apache.org/jira/browse/HIVE-22270 > Project: Hive > Issue Type: Improvement >Reporter: David Lavati >Assignee: David Lavati >Priority: Major > Labels: pull-request-available > Attachments: HIVE-22270.patch, HIVE-22270.patch, HIVE-22270.patch > > Time Spent: 10m > Remaining Estimate: 0h > > Hive's currently using commons-io 2.4 and according to HIVE-21273, a number > of issues are present in it, which can be resolved by upgrading to 2.6: > IOUtils copyLarge() and skip() methods are performance hogs > affectsVersions:2.3;2.4 > > [https://issues.apache.org/jira/projects/IO/issues/IO-355?filter=allopenissues] > CharSequenceInputStream#reset() behaves incorrectly in case when buffer size > is not dividable by data size > affectsVersions:2.4 > > [https://issues.apache.org/jira/projects/IO/issues/IO-356?filter=allopenissues] > [Tailer] InterruptedException while the thead is sleeping is silently ignored > affectsVersions:2.4 > > [https://issues.apache.org/jira/projects/IO/issues/IO-357?filter=allopenissues] > IOUtils.contentEquals* methods returns false if input1 == input2; should > return true > affectsVersions:2.4 > > [https://issues.apache.org/jira/projects/IO/issues/IO-362?filter=allopenissues] > Apache Commons - standard links for documents are failing > affectsVersions:2.4 > > [https://issues.apache.org/jira/projects/IO/issues/IO-369?filter=allopenissues] > FileUtils.sizeOfDirectoryAsBigInteger can overflow > affectsVersions:2.4 > > [https://issues.apache.org/jira/projects/IO/issues/IO-390?filter=allopenissues] > Regression in FileUtils.readFileToString from 2.0.1 > affectsVersions:2.1;2.2;2.3;2.4 > > [https://issues.apache.org/jira/projects/IO/issues/IO-453?filter=allopenissues] > Correct exception message in FileUtils.getFile(File; String...) > affectsVersions:2.4 > > [https://issues.apache.org/jira/projects/IO/issues/IO-479?filter=allopenissues] > org.apache.commons.io.FileUtils#waitFor waits too long > affectsVersions:2.4 > > [https://issues.apache.org/jira/projects/IO/issues/IO-481?filter=allopenissues] > FilenameUtils should handle embedded null bytes > affectsVersions:2.4 > > [https://issues.apache.org/jira/projects/IO/issues/IO-484?filter=allopenissues] > Exceptions are suppressed incorrectly when copying files. > affectsVersions:2.4;2.5 > > [https://issues.apache.org/jira/projects/IO/issues/IO-502?filter=allopenissues] > -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Commented] (HIVE-22270) Upgrade commons-io to 2.6
[
https://issues.apache.org/jira/browse/HIVE-22270?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16942905#comment-16942905
]
Hive QA commented on HIVE-22270:
Here are the results of testing the latest attachment:
https://issues.apache.org/jira/secure/attachment/12981963/HIVE-22270.patch
{color:red}ERROR:{color} -1 due to no test(s) being added or modified.
{color:red}ERROR:{color} -1 due to 1 failed/errored test(s), 17165 tests
executed
*Failed tests:*
{noformat}
TestStatsReplicationScenariosACIDNoAutogather - did not produce a TEST-*.xml
file (likely timed out) (batchId=254)
{noformat}
Test results:
https://builds.apache.org/job/PreCommit-HIVE-Build/18829/testReport
Console output: https://builds.apache.org/job/PreCommit-HIVE-Build/18829/console
Test logs: http://104.198.109.242/logs/PreCommit-HIVE-Build-18829/
Messages:
{noformat}
Executing org.apache.hive.ptest.execution.TestCheckPhase
Executing org.apache.hive.ptest.execution.PrepPhase
Executing org.apache.hive.ptest.execution.YetusPhase
Executing org.apache.hive.ptest.execution.ExecutionPhase
Executing org.apache.hive.ptest.execution.ReportingPhase
Tests exited with: TestsFailedException: 1 tests failed
{noformat}
This message is automatically generated.
ATTACHMENT ID: 12981963 - PreCommit-HIVE-Build
> Upgrade commons-io to 2.6
> -
>
> Key: HIVE-22270
> URL: https://issues.apache.org/jira/browse/HIVE-22270
> Project: Hive
> Issue Type: Improvement
>Reporter: David Lavati
>Assignee: David Lavati
>Priority: Major
> Labels: pull-request-available
> Attachments: HIVE-22270.patch, HIVE-22270.patch
>
> Time Spent: 10m
> Remaining Estimate: 0h
>
> Hive's currently using commons-io 2.4 and according to HIVE-21273, a number
> of issues are present in it, which can be resolved by upgrading to 2.6:
> IOUtils copyLarge() and skip() methods are performance hogs
> affectsVersions:2.3;2.4
>
> [https://issues.apache.org/jira/projects/IO/issues/IO-355?filter=allopenissues]
> CharSequenceInputStream#reset() behaves incorrectly in case when buffer size
> is not dividable by data size
> affectsVersions:2.4
>
> [https://issues.apache.org/jira/projects/IO/issues/IO-356?filter=allopenissues]
> [Tailer] InterruptedException while the thead is sleeping is silently ignored
> affectsVersions:2.4
>
> [https://issues.apache.org/jira/projects/IO/issues/IO-357?filter=allopenissues]
> IOUtils.contentEquals* methods returns false if input1 == input2; should
> return true
> affectsVersions:2.4
>
> [https://issues.apache.org/jira/projects/IO/issues/IO-362?filter=allopenissues]
> Apache Commons - standard links for documents are failing
> affectsVersions:2.4
>
> [https://issues.apache.org/jira/projects/IO/issues/IO-369?filter=allopenissues]
> FileUtils.sizeOfDirectoryAsBigInteger can overflow
> affectsVersions:2.4
>
> [https://issues.apache.org/jira/projects/IO/issues/IO-390?filter=allopenissues]
> Regression in FileUtils.readFileToString from 2.0.1
> affectsVersions:2.1;2.2;2.3;2.4
>
> [https://issues.apache.org/jira/projects/IO/issues/IO-453?filter=allopenissues]
> Correct exception message in FileUtils.getFile(File; String...)
> affectsVersions:2.4
>
> [https://issues.apache.org/jira/projects/IO/issues/IO-479?filter=allopenissues]
> org.apache.commons.io.FileUtils#waitFor waits too long
> affectsVersions:2.4
>
> [https://issues.apache.org/jira/projects/IO/issues/IO-481?filter=allopenissues]
> FilenameUtils should handle embedded null bytes
> affectsVersions:2.4
>
> [https://issues.apache.org/jira/projects/IO/issues/IO-484?filter=allopenissues]
> Exceptions are suppressed incorrectly when copying files.
> affectsVersions:2.4;2.5
>
> [https://issues.apache.org/jira/projects/IO/issues/IO-502?filter=allopenissues]
>
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
[jira] [Assigned] (HIVE-21025) LLAP IO fails on read if partition column is included in the table and the query has a predicate on the partition column
[
https://issues.apache.org/jira/browse/HIVE-21025?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Richard Zhang reassigned HIVE-21025:
Assignee: Mustafa Iman
> LLAP IO fails on read if partition column is included in the table and the
> query has a predicate on the partition column
>
>
> Key: HIVE-21025
> URL: https://issues.apache.org/jira/browse/HIVE-21025
> Project: Hive
> Issue Type: Bug
> Components: llap
>Affects Versions: 2.3.4
>Reporter: Eugene Koifman
>Assignee: Mustafa Iman
>Priority: Major
>
> Hive doesn't officially support the case when a partitioning column is also
> included in the data itself, though it works in some cases. Hive would never
> write a data file with partition column in it but this can happen for
> external tables where data is added by the end user.
> Consider improving validation (at least for schema-aware files) on read to
> produce a better error than {{ArrayIndexOutOfBoundsException}}
> {code:java}
> Caused by: java.lang.ArrayIndexOutOfBoundsException
> ], TaskAttempt 3 failed, info=[Error: Error while running task ( failure ) :
> attempt_1539023000868_24675_3_01_07_3:java.lang.RuntimeException:
> org.apache.hadoop.hive.ql.metadata.HiveException: java.io.IOException:
> java.io.IOException: java.lang.ArrayIndexOutOfBoundsException
> at
> org.apache.hadoop.hive.ql.exec.tez.TezProcessor.initializeAndRunProcessor(TezProcessor.java:218)
>
> at org.apache.hadoop.hive.ql.exec.tez.TezProcessor.run(TezProcessor.java:172)
> at
> org.apache.tez.runtime.LogicalIOProcessorRuntimeTask.run(LogicalIOProcessorRuntimeTask.java:370)
>
> at
> org.apache.tez.runtime.task.TaskRunner2Callable$1.run(TaskRunner2Callable.java:73)
>
> at
> org.apache.tez.runtime.task.TaskRunner2Callable$1.run(TaskRunner2Callable.java:61)
>
> at java.security.AccessController.doPrivileged(Native Method)
> at javax.security.auth.Subject.doAs(Subject.java:422)
> at
> org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1869)
>
> at
> org.apache.tez.runtime.task.TaskRunner2Callable.callInternal(TaskRunner2Callable.java:61)
>
> at
> org.apache.tez.runtime.task.TaskRunner2Callable.callInternal(TaskRunner2Callable.java:37)
>
> at org.apache.tez.common.CallableWithNdc.call(CallableWithNdc.java:36)
> at
> org.apache.hadoop.hive.llap.daemon.impl.StatsRecordingThreadPool$WrappedCallable.call(StatsRecordingThreadPool.java:110)
>
> at java.util.concurrent.FutureTask.run(FutureTask.java:266)
> at
> java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)
>
> at
> java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
>
> at java.lang.Thread.run(Thread.java:745)
> Caused by: org.apache.hadoop.hive.ql.metadata.HiveException:
> java.io.IOException: java.io.IOException:
> java.lang.ArrayIndexOutOfBoundsException
> at
> org.apache.hadoop.hive.ql.exec.tez.MapRecordSource.pushRecord(MapRecordSource.java:80)
>
> at
> org.apache.hadoop.hive.ql.exec.tez.MapRecordProcessor.run(MapRecordProcessor.java:419)
>
> at
> org.apache.hadoop.hive.ql.exec.tez.TezProcessor.initializeAndRunProcessor(TezProcessor.java:189)
>
> ... 15 more
> Caused by: java.io.IOException: java.io.IOException:
> java.lang.ArrayIndexOutOfBoundsException
> at
> org.apache.hadoop.hive.io.HiveIOExceptionHandlerChain.handleRecordReaderNextException(HiveIOExceptionHandlerChain.java:121)
>
> at
> org.apache.hadoop.hive.io.HiveIOExceptionHandlerUtil.handleRecordReaderNextException(HiveIOExceptionHandlerUtil.java:77)
>
> at
> org.apache.hadoop.hive.ql.io.HiveContextAwareRecordReader.doNext(HiveContextAwareRecordReader.java:355)
>
> at
> org.apache.hadoop.hive.ql.io.HiveRecordReader.doNext(HiveRecordReader.java:79)
>
> at
> org.apache.hadoop.hive.ql.io.HiveRecordReader.doNext(HiveRecordReader.java:33)
>
> at
> org.apache.hadoop.hive.ql.io.HiveContextAwareRecordReader.next(HiveContextAwareRecordReader.java:116)
>
> at
> org.apache.hadoop.mapred.split.TezGroupedSplitsInputFormat$TezGroupedSplitsRecordReader.next(TezGroupedSplitsInputFormat.java:151)
>
> at org.apache.tez.mapreduce.lib.MRReaderMapred.next(MRReaderMapred.java:116)
> at
> org.apache.hadoop.hive.ql.exec.tez.MapRecordSource.pushRecord(MapRecordSource.java:68)
>
> ... 17 more
> Caused by: java.io.IOException: java.lang.ArrayIndexOutOfBoundsException
> at
> org.apache.hadoop.hive.llap.io.api.impl.LlapRecordReader.rethrowErrorIfAny(LlapRecordReader.java:355)
>
> at
> org.apache.hadoop.hive.llap.io.api.impl.LlapRecordReader.nextCvb(LlapRecordReader.java:310)
>
> at
> org.apache.hadoop.hive.llap.io.api.impl.LlapRecordReader.next(LlapRecordReader.java:250)
>
>
[jira] [Updated] (HIVE-22250) Describe function does not provide description for rank functions
[
https://issues.apache.org/jira/browse/HIVE-22250?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Krisztian Kasa updated HIVE-22250:
--
Status: Patch Available (was: Open)
> Describe function does not provide description for rank functions
> -
>
> Key: HIVE-22250
> URL: https://issues.apache.org/jira/browse/HIVE-22250
> Project: Hive
> Issue Type: Bug
>Reporter: Krisztian Kasa
>Assignee: Krisztian Kasa
>Priority: Minor
> Fix For: 4.0.0
>
> Attachments: HIVE-22250.1.patch, HIVE-22250.1.patch,
> HIVE-22250.1.patch, HIVE-22250.2.patch
>
>
> {code}
> @WindowFunctionDescription(
> description = @Description(
> name = "dense_rank",
> value = "_FUNC_(x) The difference between RANK and DENSE_RANK is that
> DENSE_RANK leaves no " +
> "gaps in ranking sequence when there are ties. That is, if you
> were " +
> "ranking a competition using DENSE_RANK and had three people tie
> for " +
> "second place, you would say that all three were in second place
> and " +
> "that the next person came in third."
> ),
> supportsWindow = false,
> pivotResult = true,
> rankingFunction = true,
> impliesOrder = true
> )
> {code}
> {code}
> DESC FUNCTION dense_rank;
> {code}
> {code}
> PREHOOK: query: DESC FUNCTION dense_rank
> PREHOOK: type: DESCFUNCTION
> POSTHOOK: query: DESC FUNCTION dense_rank
> POSTHOOK: type: DESCFUNCTION
> There is no documentation for function 'dense_rank'
> {code}
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
[jira] [Updated] (HIVE-22250) Describe function does not provide description for rank functions
[
https://issues.apache.org/jira/browse/HIVE-22250?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Krisztian Kasa updated HIVE-22250:
--
Attachment: HIVE-22250.2.patch
> Describe function does not provide description for rank functions
> -
>
> Key: HIVE-22250
> URL: https://issues.apache.org/jira/browse/HIVE-22250
> Project: Hive
> Issue Type: Bug
>Reporter: Krisztian Kasa
>Assignee: Krisztian Kasa
>Priority: Minor
> Fix For: 4.0.0
>
> Attachments: HIVE-22250.1.patch, HIVE-22250.1.patch,
> HIVE-22250.1.patch, HIVE-22250.2.patch
>
>
> {code}
> @WindowFunctionDescription(
> description = @Description(
> name = "dense_rank",
> value = "_FUNC_(x) The difference between RANK and DENSE_RANK is that
> DENSE_RANK leaves no " +
> "gaps in ranking sequence when there are ties. That is, if you
> were " +
> "ranking a competition using DENSE_RANK and had three people tie
> for " +
> "second place, you would say that all three were in second place
> and " +
> "that the next person came in third."
> ),
> supportsWindow = false,
> pivotResult = true,
> rankingFunction = true,
> impliesOrder = true
> )
> {code}
> {code}
> DESC FUNCTION dense_rank;
> {code}
> {code}
> PREHOOK: query: DESC FUNCTION dense_rank
> PREHOOK: type: DESCFUNCTION
> POSTHOOK: query: DESC FUNCTION dense_rank
> POSTHOOK: type: DESCFUNCTION
> There is no documentation for function 'dense_rank'
> {code}
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
[jira] [Commented] (HIVE-22270) Upgrade commons-io to 2.6
[
https://issues.apache.org/jira/browse/HIVE-22270?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16942880#comment-16942880
]
Hive QA commented on HIVE-22270:
| (x) *{color:red}-1 overall{color}* |
\\
\\
|| Vote || Subsystem || Runtime || Comment ||
|| || || || {color:brown} Prechecks {color} ||
| {color:green}+1{color} | {color:green} @author {color} | {color:green} 0m
0s{color} | {color:green} The patch does not contain any @author tags. {color} |
|| || || || {color:brown} master Compile Tests {color} ||
| {color:blue}0{color} | {color:blue} mvndep {color} | {color:blue} 1m
49s{color} | {color:blue} Maven dependency ordering for branch {color} |
| {color:green}+1{color} | {color:green} mvninstall {color} | {color:green} 7m
38s{color} | {color:green} master passed {color} |
| {color:green}+1{color} | {color:green} compile {color} | {color:green} 6m
31s{color} | {color:green} master passed {color} |
| {color:green}+1{color} | {color:green} javadoc {color} | {color:green} 6m
52s{color} | {color:green} master passed {color} |
|| || || || {color:brown} Patch Compile Tests {color} ||
| {color:blue}0{color} | {color:blue} mvndep {color} | {color:blue} 0m
24s{color} | {color:blue} Maven dependency ordering for patch {color} |
| {color:green}+1{color} | {color:green} mvninstall {color} | {color:green} 7m
4s{color} | {color:green} the patch passed {color} |
| {color:green}+1{color} | {color:green} compile {color} | {color:green} 6m
21s{color} | {color:green} the patch passed {color} |
| {color:green}+1{color} | {color:green} javac {color} | {color:green} 6m
21s{color} | {color:green} the patch passed {color} |
| {color:green}+1{color} | {color:green} whitespace {color} | {color:green} 0m
0s{color} | {color:green} The patch has no whitespace issues. {color} |
| {color:green}+1{color} | {color:green} xml {color} | {color:green} 0m
2s{color} | {color:green} The patch has no ill-formed XML file. {color} |
| {color:green}+1{color} | {color:green} javadoc {color} | {color:green} 7m
1s{color} | {color:green} the patch passed {color} |
|| || || || {color:brown} Other Tests {color} ||
| {color:red}-1{color} | {color:red} asflicense {color} | {color:red} 0m
13s{color} | {color:red} The patch generated 3 ASF License warnings. {color} |
| {color:black}{color} | {color:black} {color} | {color:black} 44m 26s{color} |
{color:black} {color} |
\\
\\
|| Subsystem || Report/Notes ||
| Optional Tests | asflicense javac javadoc xml compile |
| uname | Linux hiveptest-server-upstream 3.16.0-4-amd64 #1 SMP Debian
3.16.43-2+deb8u5 (2017-09-19) x86_64 GNU/Linux |
| Build tool | maven |
| Personality |
/data/hiveptest/working/yetus_PreCommit-HIVE-Build-18829/dev-support/hive-personality.sh
|
| git revision | master / 5a03a60 |
| Default Java | 1.8.0_111 |
| asflicense |
http://104.198.109.242/logs//PreCommit-HIVE-Build-18829/yetus/patch-asflicense-problems.txt
|
| modules | C: . testutils/ptest2 U: . |
| Console output |
http://104.198.109.242/logs//PreCommit-HIVE-Build-18829/yetus.txt |
| Powered by | Apache Yetushttp://yetus.apache.org |
This message was automatically generated.
> Upgrade commons-io to 2.6
> -
>
> Key: HIVE-22270
> URL: https://issues.apache.org/jira/browse/HIVE-22270
> Project: Hive
> Issue Type: Improvement
>Reporter: David Lavati
>Assignee: David Lavati
>Priority: Major
> Labels: pull-request-available
> Attachments: HIVE-22270.patch, HIVE-22270.patch
>
> Time Spent: 10m
> Remaining Estimate: 0h
>
> Hive's currently using commons-io 2.4 and according to HIVE-21273, a number
> of issues are present in it, which can be resolved by upgrading to 2.6:
> IOUtils copyLarge() and skip() methods are performance hogs
> affectsVersions:2.3;2.4
>
> [https://issues.apache.org/jira/projects/IO/issues/IO-355?filter=allopenissues]
> CharSequenceInputStream#reset() behaves incorrectly in case when buffer size
> is not dividable by data size
> affectsVersions:2.4
>
> [https://issues.apache.org/jira/projects/IO/issues/IO-356?filter=allopenissues]
> [Tailer] InterruptedException while the thead is sleeping is silently ignored
> affectsVersions:2.4
>
> [https://issues.apache.org/jira/projects/IO/issues/IO-357?filter=allopenissues]
> IOUtils.contentEquals* methods returns false if input1 == input2; should
> return true
> affectsVersions:2.4
>
> [https://issues.apache.org/jira/projects/IO/issues/IO-362?filter=allopenissues]
> Apache Commons - standard links for documents are failing
> affectsVersions:2.4
>
> [https://issues.apache.org/jira/projects/IO/issues/IO-369?filter=allopenissues]
> FileUtils.sizeOfDirectoryAsBigInteger can overflow
> affectsVersions:2.4
>
> [https://issues.apache.org/jira/projects/IO/issues/IO-390?filter=allopenissues]
>
[jira] [Commented] (HIVE-22248) Min value for column in stats is not set correctly for some data types
[
https://issues.apache.org/jira/browse/HIVE-22248?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16942842#comment-16942842
]
Hive QA commented on HIVE-22248:
Here are the results of testing the latest attachment:
https://issues.apache.org/jira/secure/attachment/12981964/HIVE-22248.01.patch
{color:red}ERROR:{color} -1 due to no test(s) being added or modified.
{color:red}ERROR:{color} -1 due to 5 failed/errored test(s), 17137 tests
executed
*Failed tests:*
{noformat}
TestDataSourceProviderFactory - did not produce a TEST-*.xml file (likely timed
out) (batchId=233)
TestObjectStore - did not produce a TEST-*.xml file (likely timed out)
(batchId=233)
org.apache.hadoop.hive.cli.TestCliDriver.testCliDriver[alter_table_update_status_disable_bitvector]
(batchId=87)
org.apache.hadoop.hive.cli.TestCliDriver.testCliDriver[vector_coalesce_3]
(batchId=64)
org.apache.hadoop.hive.cli.TestMiniLlapLocalCliDriver.testCliDriver[vector_coalesce_3]
(batchId=177)
{noformat}
Test results:
https://builds.apache.org/job/PreCommit-HIVE-Build/18828/testReport
Console output: https://builds.apache.org/job/PreCommit-HIVE-Build/18828/console
Test logs: http://104.198.109.242/logs/PreCommit-HIVE-Build-18828/
Messages:
{noformat}
Executing org.apache.hive.ptest.execution.TestCheckPhase
Executing org.apache.hive.ptest.execution.PrepPhase
Executing org.apache.hive.ptest.execution.YetusPhase
Executing org.apache.hive.ptest.execution.ExecutionPhase
Executing org.apache.hive.ptest.execution.ReportingPhase
Tests exited with: TestsFailedException: 5 tests failed
{noformat}
This message is automatically generated.
ATTACHMENT ID: 12981964 - PreCommit-HIVE-Build
> Min value for column in stats is not set correctly for some data types
> --
>
> Key: HIVE-22248
> URL: https://issues.apache.org/jira/browse/HIVE-22248
> Project: Hive
> Issue Type: Bug
> Components: Statistics
>Reporter: Jesus Camacho Rodriguez
>Assignee: Miklos Gergely
>Priority: Major
> Attachments: HIVE-22248.01.patch
>
>
> I am not sure whether the problem is printing the value or in the value
> stored in the metastore itself, but for some types (e.g. tinyint, smallint,
> int, bigint, double or float), the min value does not seem to be set
> correctly (set to 0).
> https://github.com/apache/hive/blob/master/ql/src/test/results/clientpositive/alter_table_update_status.q.out#L342
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
[jira] [Updated] (HIVE-22235) CommandProcessorResponse should not be an exception
[ https://issues.apache.org/jira/browse/HIVE-22235?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Miklos Gergely updated HIVE-22235: -- Attachment: HIVE-22235.03.patch > CommandProcessorResponse should not be an exception > --- > > Key: HIVE-22235 > URL: https://issues.apache.org/jira/browse/HIVE-22235 > Project: Hive > Issue Type: Sub-task > Components: Hive >Reporter: Miklos Gergely >Assignee: Miklos Gergely >Priority: Major > Labels: pull-request-available > Fix For: 4.0.0 > > Attachments: HIVE-22235.01.patch, HIVE-22235.02.patch, > HIVE-22235.03.patch > > Time Spent: 10m > Remaining Estimate: 0h > > The CommandProcessorResponse class extends Exception. This may be convenient, > but it is wrong, as a response is not an exception. -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Commented] (HIVE-22248) Min value for column in stats is not set correctly for some data types
[
https://issues.apache.org/jira/browse/HIVE-22248?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16942800#comment-16942800
]
Hive QA commented on HIVE-22248:
| (/) *{color:green}+1 overall{color}* |
\\
\\
|| Vote || Subsystem || Runtime || Comment ||
|| || || || {color:brown} Prechecks {color} ||
| {color:green}+1{color} | {color:green} @author {color} | {color:green} 0m
0s{color} | {color:green} The patch does not contain any @author tags. {color} |
|| || || || {color:brown} master Compile Tests {color} ||
| {color:blue}0{color} | {color:blue} mvndep {color} | {color:blue} 1m
46s{color} | {color:blue} Maven dependency ordering for branch {color} |
| {color:green}+1{color} | {color:green} mvninstall {color} | {color:green} 7m
31s{color} | {color:green} master passed {color} |
| {color:green}+1{color} | {color:green} compile {color} | {color:green} 1m
38s{color} | {color:green} master passed {color} |
| {color:green}+1{color} | {color:green} checkstyle {color} | {color:green} 0m
55s{color} | {color:green} master passed {color} |
| {color:blue}0{color} | {color:blue} findbugs {color} | {color:blue} 1m
11s{color} | {color:blue} standalone-metastore/metastore-server in master has
170 extant Findbugs warnings. {color} |
| {color:blue}0{color} | {color:blue} findbugs {color} | {color:blue} 4m
13s{color} | {color:blue} ql in master has 1551 extant Findbugs warnings.
{color} |
| {color:green}+1{color} | {color:green} javadoc {color} | {color:green} 1m
22s{color} | {color:green} master passed {color} |
|| || || || {color:brown} Patch Compile Tests {color} ||
| {color:blue}0{color} | {color:blue} mvndep {color} | {color:blue} 0m
26s{color} | {color:blue} Maven dependency ordering for patch {color} |
| {color:green}+1{color} | {color:green} mvninstall {color} | {color:green} 2m
2s{color} | {color:green} the patch passed {color} |
| {color:green}+1{color} | {color:green} compile {color} | {color:green} 1m
40s{color} | {color:green} the patch passed {color} |
| {color:green}+1{color} | {color:green} javac {color} | {color:green} 1m
40s{color} | {color:green} the patch passed {color} |
| {color:green}+1{color} | {color:green} checkstyle {color} | {color:green} 0m
54s{color} | {color:green} the patch passed {color} |
| {color:green}+1{color} | {color:green} whitespace {color} | {color:green} 0m
0s{color} | {color:green} The patch has no whitespace issues. {color} |
| {color:green}+1{color} | {color:green} findbugs {color} | {color:green} 5m
30s{color} | {color:green} the patch passed {color} |
| {color:green}+1{color} | {color:green} javadoc {color} | {color:green} 1m
20s{color} | {color:green} the patch passed {color} |
|| || || || {color:brown} Other Tests {color} ||
| {color:green}+1{color} | {color:green} asflicense {color} | {color:green} 0m
15s{color} | {color:green} The patch does not generate ASF License warnings.
{color} |
| {color:black}{color} | {color:black} {color} | {color:black} 31m 32s{color} |
{color:black} {color} |
\\
\\
|| Subsystem || Report/Notes ||
| Optional Tests | asflicense javac javadoc findbugs checkstyle compile |
| uname | Linux hiveptest-server-upstream 3.16.0-4-amd64 #1 SMP Debian
3.16.43-2+deb8u5 (2017-09-19) x86_64 GNU/Linux |
| Build tool | maven |
| Personality |
/data/hiveptest/working/yetus_PreCommit-HIVE-Build-18828/dev-support/hive-personality.sh
|
| git revision | master / 5a03a60 |
| Default Java | 1.8.0_111 |
| findbugs | v3.0.0 |
| modules | C: standalone-metastore/metastore-server ql U: . |
| Console output |
http://104.198.109.242/logs//PreCommit-HIVE-Build-18828/yetus.txt |
| Powered by | Apache Yetushttp://yetus.apache.org |
This message was automatically generated.
> Min value for column in stats is not set correctly for some data types
> --
>
> Key: HIVE-22248
> URL: https://issues.apache.org/jira/browse/HIVE-22248
> Project: Hive
> Issue Type: Bug
> Components: Statistics
>Reporter: Jesus Camacho Rodriguez
>Assignee: Miklos Gergely
>Priority: Major
> Attachments: HIVE-22248.01.patch
>
>
> I am not sure whether the problem is printing the value or in the value
> stored in the metastore itself, but for some types (e.g. tinyint, smallint,
> int, bigint, double or float), the min value does not seem to be set
> correctly (set to 0).
> https://github.com/apache/hive/blob/master/ql/src/test/results/clientpositive/alter_table_update_status.q.out#L342
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
[jira] [Commented] (HIVE-7145) Remove dependence on apache commons-lang
[ https://issues.apache.org/jira/browse/HIVE-7145?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16942776#comment-16942776 ] László Bodor commented on HIVE-7145: +1 > Remove dependence on apache commons-lang > > > Key: HIVE-7145 > URL: https://issues.apache.org/jira/browse/HIVE-7145 > Project: Hive > Issue Type: Bug >Reporter: Owen O'Malley >Assignee: David Lavati >Priority: Major > Labels: pull-request-available > Attachments: HIVE-7145.patch > > Time Spent: 10m > Remaining Estimate: 0h > > We currently depend on both Apache commons-lang and commons-lang3. They are > the same project, just at version 2.x vs 3.x. I propose that we move all of > the references in Hive to commons-lang3 and remove the v2 usage. -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Commented] (HIVE-22240) Function percentile_cont fails when array parameter passed
[
https://issues.apache.org/jira/browse/HIVE-22240?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16942769#comment-16942769
]
Hive QA commented on HIVE-22240:
Here are the results of testing the latest attachment:
https://issues.apache.org/jira/secure/attachment/12981958/HIVE-22240.2.patch
{color:green}SUCCESS:{color} +1 due to 2 test(s) being added or modified.
{color:green}SUCCESS:{color} +1 due to 17169 tests passed
Test results:
https://builds.apache.org/job/PreCommit-HIVE-Build/18827/testReport
Console output: https://builds.apache.org/job/PreCommit-HIVE-Build/18827/console
Test logs: http://104.198.109.242/logs/PreCommit-HIVE-Build-18827/
Messages:
{noformat}
Executing org.apache.hive.ptest.execution.TestCheckPhase
Executing org.apache.hive.ptest.execution.PrepPhase
Executing org.apache.hive.ptest.execution.YetusPhase
Executing org.apache.hive.ptest.execution.ExecutionPhase
Executing org.apache.hive.ptest.execution.ReportingPhase
{noformat}
This message is automatically generated.
ATTACHMENT ID: 12981958 - PreCommit-HIVE-Build
> Function percentile_cont fails when array parameter passed
> --
>
> Key: HIVE-22240
> URL: https://issues.apache.org/jira/browse/HIVE-22240
> Project: Hive
> Issue Type: Bug
> Components: UDF
>Reporter: Krisztian Kasa
>Assignee: Krisztian Kasa
>Priority: Major
> Fix For: 4.0.0
>
> Attachments: HIVE-22240.1.patch, HIVE-22240.2.patch
>
>
> {code}
> SELECT
> percentile_cont(array(0.2, 0.5, 0.9)) WITHIN GROUP (ORDER BY value)
> FROM t_test;
> {code}
> hive.log:
> {code}
> 2019-09-24T21:00:43,203 ERROR [LocalJobRunner Map Task Executor #0]
> mr.ExecMapper: org.apache.hadoop.hive.ql.metadata.HiveException: Hive Runtime
> Error while processing row
> at
> org.apache.hadoop.hive.ql.exec.MapOperator.process(MapOperator.java:573)
> at org.apache.hadoop.hive.ql.exec.mr.ExecMapper.map(ExecMapper.java:148)
> at org.apache.hadoop.mapred.MapRunner.run(MapRunner.java:54)
> at
> org.apache.hadoop.hive.ql.exec.mr.ExecMapRunner.run(ExecMapRunner.java:37)
> at org.apache.hadoop.mapred.MapTask.runOldMapper(MapTask.java:465)
> at org.apache.hadoop.mapred.MapTask.run(MapTask.java:349)
> at
> org.apache.hadoop.mapred.LocalJobRunner$Job$MapTaskRunnable.run(LocalJobRunner.java:271)
> at
> java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)
> at java.util.concurrent.FutureTask.run(FutureTask.java:266)
> at
> java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
> at
> java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
> at java.lang.Thread.run(Thread.java:748)
> Caused by: org.apache.hadoop.hive.ql.metadata.HiveException:
> java.lang.ClassCastException: java.util.ArrayList cannot be cast to
> org.apache.hadoop.hive.serde2.io.HiveDecimalWritable
> at
> org.apache.hadoop.hive.ql.exec.GroupByOperator.process(GroupByOperator.java:793)
> at org.apache.hadoop.hive.ql.exec.Operator.forward(Operator.java:888)
> at
> org.apache.hadoop.hive.ql.exec.SelectOperator.process(SelectOperator.java:95)
> at org.apache.hadoop.hive.ql.exec.Operator.forward(Operator.java:888)
> at
> org.apache.hadoop.hive.ql.exec.TableScanOperator.process(TableScanOperator.java:128)
> at
> org.apache.hadoop.hive.ql.exec.MapOperator$MapOpCtx.forward(MapOperator.java:152)
> at
> org.apache.hadoop.hive.ql.exec.MapOperator.process(MapOperator.java:552)
> ... 11 more
> Caused by: java.lang.ClassCastException: java.util.ArrayList cannot be cast
> to org.apache.hadoop.hive.serde2.io.HiveDecimalWritable
> at
> org.apache.hadoop.hive.ql.udf.generic.GenericUDAFPercentileCont$PercentileContEvaluator.iterate(GenericUDAFPercentileCont.java:259)
> at
> org.apache.hadoop.hive.ql.udf.generic.GenericUDAFEvaluator.aggregate(GenericUDAFEvaluator.java:214)
> at
> org.apache.hadoop.hive.ql.exec.GroupByOperator.updateAggregations(GroupByOperator.java:639)
> at
> org.apache.hadoop.hive.ql.exec.GroupByOperator.processHashAggr(GroupByOperator.java:814)
> at
> org.apache.hadoop.hive.ql.exec.GroupByOperator.processKey(GroupByOperator.java:720)
> at
> org.apache.hadoop.hive.ql.exec.GroupByOperator.process(GroupByOperator.java:788)
> ... 17 more
> {code}
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
[jira] [Updated] (HIVE-22282) Obtain LLAP delegation token only when LLAP is configured for Kerberos authentication
[ https://issues.apache.org/jira/browse/HIVE-22282?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Denys Kuzmenko updated HIVE-22282: -- Description: Contains also Kerberos related Zookeeper configuration changes after refactor. (was: Contains also ) > Obtain LLAP delegation token only when LLAP is configured for Kerberos > authentication > - > > Key: HIVE-22282 > URL: https://issues.apache.org/jira/browse/HIVE-22282 > Project: Hive > Issue Type: Improvement >Reporter: Denys Kuzmenko >Assignee: Denys Kuzmenko >Priority: Major > Attachments: HIVE-22282.1.patch > > > Contains also Kerberos related Zookeeper configuration changes after refactor. -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Updated] (HIVE-22282) Obtain LLAP delegation token only when LLAP is configured for Kerberos authentication
[ https://issues.apache.org/jira/browse/HIVE-22282?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Denys Kuzmenko updated HIVE-22282: -- Status: Patch Available (was: Open) > Obtain LLAP delegation token only when LLAP is configured for Kerberos > authentication > - > > Key: HIVE-22282 > URL: https://issues.apache.org/jira/browse/HIVE-22282 > Project: Hive > Issue Type: Improvement >Reporter: Denys Kuzmenko >Assignee: Denys Kuzmenko >Priority: Major > Attachments: HIVE-22282.1.patch > > > Contains also Kerberos related Zookeeper configuration changes after refactor. -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Updated] (HIVE-22282) Obtain LLAP delegation token only when LLAP is configured for Kerberos authentication
[ https://issues.apache.org/jira/browse/HIVE-22282?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Denys Kuzmenko updated HIVE-22282: -- Attachment: HIVE-22282.1.patch > Obtain LLAP delegation token only when LLAP is configured for Kerberos > authentication > - > > Key: HIVE-22282 > URL: https://issues.apache.org/jira/browse/HIVE-22282 > Project: Hive > Issue Type: Improvement >Reporter: Denys Kuzmenko >Assignee: Denys Kuzmenko >Priority: Major > Attachments: HIVE-22282.1.patch > > > Contains also -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Updated] (HIVE-22282) Obtain LLAP delegation token only when LLAP is configured for Kerberos authentication
[ https://issues.apache.org/jira/browse/HIVE-22282?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Denys Kuzmenko updated HIVE-22282: -- Attachment: (was: HIVE-22282.1.patch) > Obtain LLAP delegation token only when LLAP is configured for Kerberos > authentication > - > > Key: HIVE-22282 > URL: https://issues.apache.org/jira/browse/HIVE-22282 > Project: Hive > Issue Type: Improvement >Reporter: Denys Kuzmenko >Assignee: Denys Kuzmenko >Priority: Major > Attachments: HIVE-22282.1.patch > > > Contains also -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Updated] (HIVE-22282) Obtain LLAP delegation token only when LLAP is configured for Kerberos authentication
[ https://issues.apache.org/jira/browse/HIVE-22282?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Denys Kuzmenko updated HIVE-22282: -- Attachment: HIVE-22282.1.patch > Obtain LLAP delegation token only when LLAP is configured for Kerberos > authentication > - > > Key: HIVE-22282 > URL: https://issues.apache.org/jira/browse/HIVE-22282 > Project: Hive > Issue Type: Improvement >Reporter: Denys Kuzmenko >Assignee: Denys Kuzmenko >Priority: Major > Attachments: HIVE-22282.1.patch > > > Contains also -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Updated] (HIVE-22282) Obtain LLAP delegation token only when LLAP is configured for Kerberos authentication
[ https://issues.apache.org/jira/browse/HIVE-22282?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Denys Kuzmenko updated HIVE-22282: -- Attachment: (was: HIVE-22282.1.patch) > Obtain LLAP delegation token only when LLAP is configured for Kerberos > authentication > - > > Key: HIVE-22282 > URL: https://issues.apache.org/jira/browse/HIVE-22282 > Project: Hive > Issue Type: Improvement >Reporter: Denys Kuzmenko >Assignee: Denys Kuzmenko >Priority: Major > Attachments: HIVE-22282.1.patch > > > Contains also -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Updated] (HIVE-22282) Obtain LLAP delegation token only when LLAP is configured for Kerberos authentication
[ https://issues.apache.org/jira/browse/HIVE-22282?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Denys Kuzmenko updated HIVE-22282: -- Description: Contains also > Obtain LLAP delegation token only when LLAP is configured for Kerberos > authentication > - > > Key: HIVE-22282 > URL: https://issues.apache.org/jira/browse/HIVE-22282 > Project: Hive > Issue Type: Improvement >Reporter: Denys Kuzmenko >Assignee: Denys Kuzmenko >Priority: Major > Attachments: HIVE-22282.1.patch > > > Contains also -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Updated] (HIVE-22282) Obtain LLAP delegation token only when LLAP is configured for Kerberos authentication
[ https://issues.apache.org/jira/browse/HIVE-22282?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Denys Kuzmenko updated HIVE-22282: -- Attachment: HIVE-22282.1.patch > Obtain LLAP delegation token only when LLAP is configured for Kerberos > authentication > - > > Key: HIVE-22282 > URL: https://issues.apache.org/jira/browse/HIVE-22282 > Project: Hive > Issue Type: Improvement >Reporter: Denys Kuzmenko >Assignee: Denys Kuzmenko >Priority: Major > Attachments: HIVE-22282.1.patch > > -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Assigned] (HIVE-22282) Obtain LLAP delegation token only when LLAP is configured for Kerberos authentication
[ https://issues.apache.org/jira/browse/HIVE-22282?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Denys Kuzmenko reassigned HIVE-22282: - Assignee: Denys Kuzmenko > Obtain LLAP delegation token only when LLAP is configured for Kerberos > authentication > - > > Key: HIVE-22282 > URL: https://issues.apache.org/jira/browse/HIVE-22282 > Project: Hive > Issue Type: Improvement >Reporter: Denys Kuzmenko >Assignee: Denys Kuzmenko >Priority: Major > -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Updated] (HIVE-22282) Obtain LLAP delegation token only when LLAP is configured for Kerberos authentication
[ https://issues.apache.org/jira/browse/HIVE-22282?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Denys Kuzmenko updated HIVE-22282: -- Issue Type: Improvement (was: Bug) > Obtain LLAP delegation token only when LLAP is configured for Kerberos > authentication > - > > Key: HIVE-22282 > URL: https://issues.apache.org/jira/browse/HIVE-22282 > Project: Hive > Issue Type: Improvement >Reporter: Denys Kuzmenko >Priority: Major > -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Updated] (HIVE-22212) Implement append partition related methods on temporary tables
[
https://issues.apache.org/jira/browse/HIVE-22212?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Laszlo Pinter updated HIVE-22212:
-
Attachment: HIVE-22212.01.patch
> Implement append partition related methods on temporary tables
> --
>
> Key: HIVE-22212
> URL: https://issues.apache.org/jira/browse/HIVE-22212
> Project: Hive
> Issue Type: Sub-task
> Components: Hive
>Reporter: Laszlo Pinter
>Assignee: Laszlo Pinter
>Priority: Major
> Attachments: HIVE-22212.01.patch
>
>
> The following methods must be implemented in SessionHiveMetastoreClient, in
> order to support partition append on temporary tables:
> {code:java}
> Partition appendPartition(String dbName, String tableName, List
> partVals)
> throws InvalidObjectException, AlreadyExistsException, MetaException,
> TException;
> Partition appendPartition(String catName, String dbName, String tableName,
> List partVals)
> throws InvalidObjectException, AlreadyExistsException, MetaException,
> TException;
> Partition appendPartition(String dbName, String tableName, String name)
> throws InvalidObjectException, AlreadyExistsException, MetaException,
> TException;
> Partition appendPartition(String catName, String dbName, String tableName,
> String name)
> throws InvalidObjectException, AlreadyExistsException, MetaException,
> TException;
> {code}
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
[jira] [Updated] (HIVE-22212) Implement append partition related methods on temporary tables
[
https://issues.apache.org/jira/browse/HIVE-22212?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Laszlo Pinter updated HIVE-22212:
-
Status: Patch Available (was: Open)
> Implement append partition related methods on temporary tables
> --
>
> Key: HIVE-22212
> URL: https://issues.apache.org/jira/browse/HIVE-22212
> Project: Hive
> Issue Type: Sub-task
> Components: Hive
>Reporter: Laszlo Pinter
>Assignee: Laszlo Pinter
>Priority: Major
> Attachments: HIVE-22212.01.patch
>
>
> The following methods must be implemented in SessionHiveMetastoreClient, in
> order to support partition append on temporary tables:
> {code:java}
> Partition appendPartition(String dbName, String tableName, List
> partVals)
> throws InvalidObjectException, AlreadyExistsException, MetaException,
> TException;
> Partition appendPartition(String catName, String dbName, String tableName,
> List partVals)
> throws InvalidObjectException, AlreadyExistsException, MetaException,
> TException;
> Partition appendPartition(String dbName, String tableName, String name)
> throws InvalidObjectException, AlreadyExistsException, MetaException,
> TException;
> Partition appendPartition(String catName, String dbName, String tableName,
> String name)
> throws InvalidObjectException, AlreadyExistsException, MetaException,
> TException;
> {code}
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
[jira] [Updated] (HIVE-22267) Support password based authentication in HMS
[ https://issues.apache.org/jira/browse/HIVE-22267?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ashutosh Bapat updated HIVE-22267: -- Attachment: HIVE-22267.07.patch Status: Patch Available (was: Open) > Support password based authentication in HMS > > > Key: HIVE-22267 > URL: https://issues.apache.org/jira/browse/HIVE-22267 > Project: Hive > Issue Type: New Feature >Reporter: Ashutosh Bapat >Assignee: Ashutosh Bapat >Priority: Major > Labels: pull-request-available > Attachments: HIVE-22267.00.patch, HIVE-22267.01.patch, > HIVE-22267.02.patch, HIVE-22267.03.patch, HIVE-22267.04.patch, > HIVE-22267.05.patch, HIVE-22267.06.patch, HIVE-22267.07.patch > > Time Spent: 10m > Remaining Estimate: 0h > > Similar to HS2, support password based authentication in HMS. > Right now we provide LDAP and CONFIG based options. The later allows to set > user and password in config and is used only for testing. -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Updated] (HIVE-22267) Support password based authentication in HMS
[ https://issues.apache.org/jira/browse/HIVE-22267?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ashutosh Bapat updated HIVE-22267: -- Status: Open (was: Patch Available) > Support password based authentication in HMS > > > Key: HIVE-22267 > URL: https://issues.apache.org/jira/browse/HIVE-22267 > Project: Hive > Issue Type: New Feature >Reporter: Ashutosh Bapat >Assignee: Ashutosh Bapat >Priority: Major > Labels: pull-request-available > Attachments: HIVE-22267.00.patch, HIVE-22267.01.patch, > HIVE-22267.02.patch, HIVE-22267.03.patch, HIVE-22267.04.patch, > HIVE-22267.05.patch, HIVE-22267.06.patch, HIVE-22267.07.patch > > Time Spent: 10m > Remaining Estimate: 0h > > Similar to HS2, support password based authentication in HMS. > Right now we provide LDAP and CONFIG based options. The later allows to set > user and password in config and is used only for testing. -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Commented] (HIVE-22240) Function percentile_cont fails when array parameter passed
[
https://issues.apache.org/jira/browse/HIVE-22240?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16942727#comment-16942727
]
Hive QA commented on HIVE-22240:
| (/) *{color:green}+1 overall{color}* |
\\
\\
|| Vote || Subsystem || Runtime || Comment ||
|| || || || {color:brown} Prechecks {color} ||
| {color:green}+1{color} | {color:green} @author {color} | {color:green} 0m
1s{color} | {color:green} The patch does not contain any @author tags. {color} |
|| || || || {color:brown} master Compile Tests {color} ||
| {color:green}+1{color} | {color:green} mvninstall {color} | {color:green} 9m
45s{color} | {color:green} master passed {color} |
| {color:green}+1{color} | {color:green} compile {color} | {color:green} 1m
10s{color} | {color:green} master passed {color} |
| {color:green}+1{color} | {color:green} checkstyle {color} | {color:green} 0m
40s{color} | {color:green} master passed {color} |
| {color:blue}0{color} | {color:blue} findbugs {color} | {color:blue} 4m
25s{color} | {color:blue} ql in master has 1551 extant Findbugs warnings.
{color} |
| {color:green}+1{color} | {color:green} javadoc {color} | {color:green} 1m
3s{color} | {color:green} master passed {color} |
|| || || || {color:brown} Patch Compile Tests {color} ||
| {color:green}+1{color} | {color:green} mvninstall {color} | {color:green} 1m
27s{color} | {color:green} the patch passed {color} |
| {color:green}+1{color} | {color:green} compile {color} | {color:green} 1m
12s{color} | {color:green} the patch passed {color} |
| {color:green}+1{color} | {color:green} javac {color} | {color:green} 1m
12s{color} | {color:green} the patch passed {color} |
| {color:green}+1{color} | {color:green} checkstyle {color} | {color:green} 0m
42s{color} | {color:green} the patch passed {color} |
| {color:green}+1{color} | {color:green} whitespace {color} | {color:green} 0m
0s{color} | {color:green} The patch has no whitespace issues. {color} |
| {color:green}+1{color} | {color:green} findbugs {color} | {color:green} 4m
37s{color} | {color:green} ql generated 0 new + 1550 unchanged - 1 fixed = 1550
total (was 1551) {color} |
| {color:green}+1{color} | {color:green} javadoc {color} | {color:green} 1m
6s{color} | {color:green} the patch passed {color} |
|| || || || {color:brown} Other Tests {color} ||
| {color:green}+1{color} | {color:green} asflicense {color} | {color:green} 0m
15s{color} | {color:green} The patch does not generate ASF License warnings.
{color} |
| {color:black}{color} | {color:black} {color} | {color:black} 26m 54s{color} |
{color:black} {color} |
\\
\\
|| Subsystem || Report/Notes ||
| Optional Tests | asflicense javac javadoc findbugs checkstyle compile |
| uname | Linux hiveptest-server-upstream 3.16.0-4-amd64 #1 SMP Debian
3.16.43-2+deb8u5 (2017-09-19) x86_64 GNU/Linux |
| Build tool | maven |
| Personality |
/data/hiveptest/working/yetus_PreCommit-HIVE-Build-18827/dev-support/hive-personality.sh
|
| git revision | master / 1ed457c |
| Default Java | 1.8.0_111 |
| findbugs | v3.0.1 |
| modules | C: ql U: ql |
| Console output |
http://104.198.109.242/logs//PreCommit-HIVE-Build-18827/yetus.txt |
| Powered by | Apache Yetushttp://yetus.apache.org |
This message was automatically generated.
> Function percentile_cont fails when array parameter passed
> --
>
> Key: HIVE-22240
> URL: https://issues.apache.org/jira/browse/HIVE-22240
> Project: Hive
> Issue Type: Bug
> Components: UDF
>Reporter: Krisztian Kasa
>Assignee: Krisztian Kasa
>Priority: Major
> Fix For: 4.0.0
>
> Attachments: HIVE-22240.1.patch, HIVE-22240.2.patch
>
>
> {code}
> SELECT
> percentile_cont(array(0.2, 0.5, 0.9)) WITHIN GROUP (ORDER BY value)
> FROM t_test;
> {code}
> hive.log:
> {code}
> 2019-09-24T21:00:43,203 ERROR [LocalJobRunner Map Task Executor #0]
> mr.ExecMapper: org.apache.hadoop.hive.ql.metadata.HiveException: Hive Runtime
> Error while processing row
> at
> org.apache.hadoop.hive.ql.exec.MapOperator.process(MapOperator.java:573)
> at org.apache.hadoop.hive.ql.exec.mr.ExecMapper.map(ExecMapper.java:148)
> at org.apache.hadoop.mapred.MapRunner.run(MapRunner.java:54)
> at
> org.apache.hadoop.hive.ql.exec.mr.ExecMapRunner.run(ExecMapRunner.java:37)
> at org.apache.hadoop.mapred.MapTask.runOldMapper(MapTask.java:465)
> at org.apache.hadoop.mapred.MapTask.run(MapTask.java:349)
> at
> org.apache.hadoop.mapred.LocalJobRunner$Job$MapTaskRunnable.run(LocalJobRunner.java:271)
> at
> java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)
> at java.util.concurrent.FutureTask.run(FutureTask.java:266)
> at
> java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
> at
>
[jira] [Updated] (HIVE-22281) Create table statement fails with "not supported NULLS LAST for ORDER BY in ASC order"
[
https://issues.apache.org/jira/browse/HIVE-22281?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Krisztian Kasa updated HIVE-22281:
--
Status: Patch Available (was: Open)
> Create table statement fails with "not supported NULLS LAST for ORDER BY in
> ASC order"
> --
>
> Key: HIVE-22281
> URL: https://issues.apache.org/jira/browse/HIVE-22281
> Project: Hive
> Issue Type: Bug
> Components: Parser
>Reporter: Krisztian Kasa
>Assignee: Krisztian Kasa
>Priority: Major
> Fix For: 4.0.0
>
> Attachments: HIVE-22281.1.patch
>
>
> {code}
> CREATE TABLE table_core2c4ywq7yjx ( k1 STRING, f1 STRING,
> sequence_num BIGINT, create_bsk BIGINT, change_bsk BIGINT,
> op_code STRING ) PARTITIONED BY (run_id BIGINT) CLUSTERED BY (k1) SORTED BY
> (k1, change_bsk, sequence_num) INTO 4 BUCKETS STORED AS ORC
> {code}
> {code}
> Error while compiling statement: FAILED: SemanticException create/alter
> table: not supported NULLS LAST for ORDER BY in ASC order
> {code}
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
[jira] [Updated] (HIVE-22281) Create table statement fails with "not supported NULLS LAST for ORDER BY in ASC order"
[
https://issues.apache.org/jira/browse/HIVE-22281?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Krisztian Kasa updated HIVE-22281:
--
Attachment: HIVE-22281.1.patch
> Create table statement fails with "not supported NULLS LAST for ORDER BY in
> ASC order"
> --
>
> Key: HIVE-22281
> URL: https://issues.apache.org/jira/browse/HIVE-22281
> Project: Hive
> Issue Type: Bug
> Components: Parser
>Reporter: Krisztian Kasa
>Assignee: Krisztian Kasa
>Priority: Major
> Fix For: 4.0.0
>
> Attachments: HIVE-22281.1.patch
>
>
> {code}
> CREATE TABLE table_core2c4ywq7yjx ( k1 STRING, f1 STRING,
> sequence_num BIGINT, create_bsk BIGINT, change_bsk BIGINT,
> op_code STRING ) PARTITIONED BY (run_id BIGINT) CLUSTERED BY (k1) SORTED BY
> (k1, change_bsk, sequence_num) INTO 4 BUCKETS STORED AS ORC
> {code}
> {code}
> Error while compiling statement: FAILED: SemanticException create/alter
> table: not supported NULLS LAST for ORDER BY in ASC order
> {code}
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
