[jira] [Commented] (HIVE-18811) Fix desc table, column comments are not displayed
[
https://issues.apache.org/jira/browse/HIVE-18811?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16378173#comment-16378173
]
merrily01 commented on HIVE-18811:
--
very useful
> Fix desc table, column comments are not displayed
> -
>
> Key: HIVE-18811
> URL: https://issues.apache.org/jira/browse/HIVE-18811
> Project: Hive
> Issue Type: Bug
> Components: CLI
>Affects Versions: 1.2.1, 2.3.2
> Environment: CentOS 6.5
> Hive-1.2.1
> Hive-3.0.0
>Reporter: tartarus
>Assignee: tartarus
>Priority: Major
> Labels: patch
> Fix For: 3.0.0
>
> Attachments: HIVE_18811.patch
>
>
> when column comment contain \t
> eg: CREATE TABLE `zhangmang_test`(`name` string COMMENT
> 'name{color:#FF}\t{color}zm');
> then execute : {color:#FF}desc zhangmang_test {color}
> {color:#FF}{color:#33}return : name string
> name{color}
> {color}
> because \t is the separator, so we should translate it
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
[jira] [Resolved] (HIVE-18694) Fix TestHiveCli test
[ https://issues.apache.org/jira/browse/HIVE-18694?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zoltan Haindrich resolved HIVE-18694. - Resolution: Duplicate > Fix TestHiveCli test > > > Key: HIVE-18694 > URL: https://issues.apache.org/jira/browse/HIVE-18694 > Project: Hive > Issue Type: Improvement >Reporter: Zoltan Haindrich >Priority: Major > > seems to be broken by HIVE-18493 -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[jira] [Commented] (HIVE-18797) ExprConstNodeDesc's getExprString should put appropriate qualifier with literals
[
https://issues.apache.org/jira/browse/HIVE-18797?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16378153#comment-16378153
]
Hive QA commented on HIVE-18797:
| (x) *{color:red}-1 overall{color}* |
\\
\\
|| Vote || Subsystem || Runtime || Comment ||
|| || || || {color:brown} Prechecks {color} ||
| {color:blue}0{color} | {color:blue} findbugs {color} | {color:blue} 0m
0s{color} | {color:blue} Findbugs executables are not available. {color} |
| {color:green}+1{color} | {color:green} @author {color} | {color:green} 0m
0s{color} | {color:green} The patch does not contain any @author tags. {color} |
|| || || || {color:brown} master Compile Tests {color} ||
| {color:blue}0{color} | {color:blue} mvndep {color} | {color:blue} 0m
41s{color} | {color:blue} Maven dependency ordering for branch {color} |
| {color:green}+1{color} | {color:green} mvninstall {color} | {color:green} 6m
2s{color} | {color:green} master passed {color} |
| {color:green}+1{color} | {color:green} compile {color} | {color:green} 1m
14s{color} | {color:green} master passed {color} |
| {color:green}+1{color} | {color:green} checkstyle {color} | {color:green} 0m
47s{color} | {color:green} master passed {color} |
| {color:green}+1{color} | {color:green} javadoc {color} | {color:green} 1m
1s{color} | {color:green} master passed {color} |
|| || || || {color:brown} Patch Compile Tests {color} ||
| {color:blue}0{color} | {color:blue} mvndep {color} | {color:blue} 0m
7s{color} | {color:blue} Maven dependency ordering for patch {color} |
| {color:green}+1{color} | {color:green} mvninstall {color} | {color:green} 1m
34s{color} | {color:green} the patch passed {color} |
| {color:green}+1{color} | {color:green} compile {color} | {color:green} 1m
19s{color} | {color:green} the patch passed {color} |
| {color:green}+1{color} | {color:green} javac {color} | {color:green} 1m
19s{color} | {color:green} the patch passed {color} |
| {color:green}+1{color} | {color:green} checkstyle {color} | {color:green} 0m
47s{color} | {color:green} the patch passed {color} |
| {color:green}+1{color} | {color:green} whitespace {color} | {color:green} 0m
0s{color} | {color:green} The patch has no whitespace issues. {color} |
| {color:green}+1{color} | {color:green} javadoc {color} | {color:green} 1m
3s{color} | {color:green} the patch passed {color} |
|| || || || {color:brown} Other Tests {color} ||
| {color:red}-1{color} | {color:red} asflicense {color} | {color:red} 0m
13s{color} | {color:red} The patch generated 49 ASF License warnings. {color} |
| {color:black}{color} | {color:black} {color} | {color:black} 15m 42s{color} |
{color:black} {color} |
\\
\\
|| Subsystem || Report/Notes ||
| Optional Tests | asflicense javac javadoc findbugs checkstyle compile |
| uname | Linux hiveptest-server-upstream 3.16.0-4-amd64 #1 SMP Debian
3.16.36-1+deb8u1 (2016-09-03) x86_64 GNU/Linux |
| Build tool | maven |
| Personality |
/data/hiveptest/working/yetus_PreCommit-HIVE-Build-9381/dev-support/hive-personality.sh
|
| git revision | master / 987d5ff |
| Default Java | 1.8.0_111 |
| asflicense |
http://104.198.109.242/logs//PreCommit-HIVE-Build-9381/yetus/patch-asflicense-problems.txt
|
| modules | C: hbase-handler ql U: . |
| Console output |
http://104.198.109.242/logs//PreCommit-HIVE-Build-9381/yetus.txt |
| Powered by | Apache Yetushttp://yetus.apache.org |
This message was automatically generated.
> ExprConstNodeDesc's getExprString should put appropriate qualifier with
> literals
>
>
> Key: HIVE-18797
> URL: https://issues.apache.org/jira/browse/HIVE-18797
> Project: Hive
> Issue Type: Improvement
>Reporter: Vineet Garg
>Assignee: Vineet Garg
>Priority: Major
> Attachments: HIVE-18797.1.patch, HIVE-18797.2.patch,
> HIVE-18797.3.patch
>
>
> e.g. instead of just {{2016-01-23 00:00:00.0)}} it should be
> {{TIMESTAMP'2016-01-23 00:00:00.0)'}}.
> This method is used by explain task and also HIVE-18726 needs it to reparse
> the string for default value.
> I am creating a separate ticket for this instead of lumping it with
> HIVE-18726 because this will need quite a few golden files update.
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
[jira] [Updated] (HIVE-18733) Missing break in CommonFastHashTable
[ https://issues.apache.org/jira/browse/HIVE-18733?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zoltan Haindrich updated HIVE-18733: Resolution: Fixed Fix Version/s: 3.0.0 Status: Resolved (was: Patch Available) pushed to master. Thank you [~ghajos] for fixing this! > Missing break in CommonFastHashTable > > > Key: HIVE-18733 > URL: https://issues.apache.org/jira/browse/HIVE-18733 > Project: Hive > Issue Type: Bug > Components: HiveServer2 >Reporter: Gergely Hajós >Assignee: Gergely Hajós >Priority: Trivial > Fix For: 3.0.0 > > Attachments: HIVE-18733.1.patch > > > In CommonFastHashTable there is a missing break in a switch case. -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[jira] [Resolved] (HIVE-18759) Remove unconnected q.out-s
[ https://issues.apache.org/jira/browse/HIVE-18759?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zoltan Haindrich resolved HIVE-18759. - Resolution: Fixed Fix Version/s: 3.0.0 pushed to master. Thank you Ashutosh for reviewing the changes! > Remove unconnected q.out-s > -- > > Key: HIVE-18759 > URL: https://issues.apache.org/jira/browse/HIVE-18759 > Project: Hive > Issue Type: Bug > Components: Tests >Reporter: Zoltan Haindrich >Assignee: Zoltan Haindrich >Priority: Major > Fix For: 3.0.0 > > Attachments: HIVE-18759.01.patch > > > org.apache.hadoop.hive.cli.control.TestDanglingQOuts -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[jira] [Updated] (HIVE-18805) Add ConstantPropagate before stats annotation
[ https://issues.apache.org/jira/browse/HIVE-18805?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zoltan Haindrich updated HIVE-18805: Resolution: Fixed Fix Version/s: 3.0.0 Status: Resolved (was: Patch Available) pushed to master. Thank you Ashutosh for reviewing the changes! > Add ConstantPropagate before stats annotation > - > > Key: HIVE-18805 > URL: https://issues.apache.org/jira/browse/HIVE-18805 > Project: Hive > Issue Type: Sub-task > Components: Query Planning >Reporter: Zoltan Haindrich >Assignee: Zoltan Haindrich >Priority: Major > Fix For: 3.0.0 > > Attachments: HIVE-18805.01.patch > > > this seems to also make a few more optimizations identify more cases -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[jira] [Commented] (HIVE-18811) Fix desc table, column comments are not displayed
[
https://issues.apache.org/jira/browse/HIVE-18811?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16378133#comment-16378133
]
maobaolong commented on HIVE-18811:
---
LGTM. Thank you for your contribution.
> Fix desc table, column comments are not displayed
> -
>
> Key: HIVE-18811
> URL: https://issues.apache.org/jira/browse/HIVE-18811
> Project: Hive
> Issue Type: Bug
> Components: CLI
>Affects Versions: 1.2.1, 2.3.2
> Environment: CentOS 6.5
> Hive-1.2.1
> Hive-3.0.0
>Reporter: tartarus
>Assignee: tartarus
>Priority: Major
> Labels: patch
> Fix For: 3.0.0
>
> Attachments: HIVE_18811.patch
>
>
> when column comment contain \t
> eg: CREATE TABLE `zhangmang_test`(`name` string COMMENT
> 'name{color:#FF}\t{color}zm');
> then execute : {color:#FF}desc zhangmang_test {color}
> {color:#FF}{color:#33}return : name string
> name{color}
> {color}
> because \t is the separator, so we should translate it
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
[jira] [Commented] (HIVE-18158) Remove OrcRawRecordMerger.ReaderPairAcid.statementId
[
https://issues.apache.org/jira/browse/HIVE-18158?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16378127#comment-16378127
]
Hive QA commented on HIVE-18158:
Here are the results of testing the latest attachment:
https://issues.apache.org/jira/secure/attachment/12912152/HIVE-18158.03.patch
{color:green}SUCCESS:{color} +1 due to 4 test(s) being added or modified.
{color:red}ERROR:{color} -1 due to 30 failed/errored test(s), 13051 tests
executed
*Failed tests:*
{noformat}
TestNegativeCliDriver - did not produce a TEST-*.xml file (likely timed out)
(batchId=93)
[jira] [Commented] (HIVE-18811) Fix desc table, column comments are not displayed
[
https://issues.apache.org/jira/browse/HIVE-18811?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16378114#comment-16378114
]
leiqiang commented on HIVE-18811:
-
It's useful
> Fix desc table, column comments are not displayed
> -
>
> Key: HIVE-18811
> URL: https://issues.apache.org/jira/browse/HIVE-18811
> Project: Hive
> Issue Type: Bug
> Components: CLI
>Affects Versions: 1.2.1, 2.3.2
> Environment: CentOS 6.5
> Hive-1.2.1
> Hive-3.0.0
>Reporter: tartarus
>Assignee: tartarus
>Priority: Major
> Labels: patch
> Fix For: 3.0.0
>
> Attachments: HIVE_18811.patch
>
>
> when column comment contain \t
> eg: CREATE TABLE `zhangmang_test`(`name` string COMMENT
> 'name{color:#FF}\t{color}zm');
> then execute : {color:#FF}desc zhangmang_test {color}
> {color:#FF}{color:#33}return : name string
> name{color}
> {color}
> because \t is the separator, so we should translate it
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
[jira] [Comment Edited] (HIVE-18792) Allow standard compliant syntax for insert on partitioned tables
[
https://issues.apache.org/jira/browse/HIVE-18792?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16378101#comment-16378101
]
Vineet Garg edited comment on HIVE-18792 at 2/27/18 6:17 AM:
-
First patch provides support for insert statements without column references
such as:
{code:sql}
insert into t2 values (1,2,3,4);
{code}
Basically during metadata gathering phase if partition specification isn't
provided in query but target table has one it is auto-generated. For now I am
trying to run ptests to get an idea if I am on right path with this solution.
was (Author: vgarg):
First patch provides support for statements such as:
{code:sql}
insert into t2 values (1,2,3,4);
{code}
Basically during metadata gathering phase if partition specification isn't
provided in query but target table has one it is auto-generated. For now I am
trying to run ptests to get an idea if I am on right path with this solution.
> Allow standard compliant syntax for insert on partitioned tables
>
>
> Key: HIVE-18792
> URL: https://issues.apache.org/jira/browse/HIVE-18792
> Project: Hive
> Issue Type: Improvement
> Components: SQL
>Reporter: Ashutosh Chauhan
>Assignee: Vineet Garg
>Priority: Major
> Attachments: HIVE-18792.1.patch
>
>
> Following works:
> {code}
> create table t1 (a int, b int, c int);
> create table t2 (a int, b int, c int) partitioned by (d int);
> insert into t1 values (1,2,3);
> insert into t1 (c, b, a) values (1,2,3);
> insert into t1 (a,b) values (1,2);
> {code}
> For partitioned tables it should work similarly but doesn't. All of
> following fails:
> {code}
> insert into t2 values (1,2,3,4);
> insert into t2 (a, b, c, d) values (1,2,3,4);
> insert into t2 (c,d) values (1,2);
> insert into t2 (a,b) values (1,2);
> {code}
> All of above should work. Also note following works:
> {code}
> insert into t2 partition(d) values (1,2,3,4);
> insert into t2 partition(d=4) values (1,2,3);
> {code}
>
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
[jira] [Updated] (HIVE-18792) Allow standard compliant syntax for insert on partitioned tables
[
https://issues.apache.org/jira/browse/HIVE-18792?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Vineet Garg updated HIVE-18792:
---
Status: Patch Available (was: Open)
> Allow standard compliant syntax for insert on partitioned tables
>
>
> Key: HIVE-18792
> URL: https://issues.apache.org/jira/browse/HIVE-18792
> Project: Hive
> Issue Type: Improvement
> Components: SQL
>Reporter: Ashutosh Chauhan
>Assignee: Vineet Garg
>Priority: Major
> Attachments: HIVE-18792.1.patch
>
>
> Following works:
> {code}
> create table t1 (a int, b int, c int);
> create table t2 (a int, b int, c int) partitioned by (d int);
> insert into t1 values (1,2,3);
> insert into t1 (c, b, a) values (1,2,3);
> insert into t1 (a,b) values (1,2);
> {code}
> For partitioned tables it should work similarly but doesn't. All of
> following fails:
> {code}
> insert into t2 values (1,2,3,4);
> insert into t2 (a, b, c, d) values (1,2,3,4);
> insert into t2 (c,d) values (1,2);
> insert into t2 (a,b) values (1,2);
> {code}
> All of above should work. Also note following works:
> {code}
> insert into t2 partition(d) values (1,2,3,4);
> insert into t2 partition(d=4) values (1,2,3);
> {code}
>
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
[jira] [Commented] (HIVE-18792) Allow standard compliant syntax for insert on partitioned tables
[
https://issues.apache.org/jira/browse/HIVE-18792?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16378101#comment-16378101
]
Vineet Garg commented on HIVE-18792:
First patch provides support for statements such as:
{code:sql}
insert into t2 values (1,2,3,4);
{code}
Basically during metadata gathering phase if partition specification isn't
provided in query but target table has one it is auto-generated. For now I am
trying to run ptests to get an idea if I am on right path with this solution.
> Allow standard compliant syntax for insert on partitioned tables
>
>
> Key: HIVE-18792
> URL: https://issues.apache.org/jira/browse/HIVE-18792
> Project: Hive
> Issue Type: Improvement
> Components: SQL
>Reporter: Ashutosh Chauhan
>Assignee: Vineet Garg
>Priority: Major
> Attachments: HIVE-18792.1.patch
>
>
> Following works:
> {code}
> create table t1 (a int, b int, c int);
> create table t2 (a int, b int, c int) partitioned by (d int);
> insert into t1 values (1,2,3);
> insert into t1 (c, b, a) values (1,2,3);
> insert into t1 (a,b) values (1,2);
> {code}
> For partitioned tables it should work similarly but doesn't. All of
> following fails:
> {code}
> insert into t2 values (1,2,3,4);
> insert into t2 (a, b, c, d) values (1,2,3,4);
> insert into t2 (c,d) values (1,2);
> insert into t2 (a,b) values (1,2);
> {code}
> All of above should work. Also note following works:
> {code}
> insert into t2 partition(d) values (1,2,3,4);
> insert into t2 partition(d=4) values (1,2,3);
> {code}
>
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
[jira] [Assigned] (HIVE-18792) Allow standard compliant syntax for insert on partitioned tables
[
https://issues.apache.org/jira/browse/HIVE-18792?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Vineet Garg reassigned HIVE-18792:
--
Assignee: Vineet Garg
> Allow standard compliant syntax for insert on partitioned tables
>
>
> Key: HIVE-18792
> URL: https://issues.apache.org/jira/browse/HIVE-18792
> Project: Hive
> Issue Type: Improvement
> Components: SQL
>Reporter: Ashutosh Chauhan
>Assignee: Vineet Garg
>Priority: Major
> Attachments: HIVE-18792.1.patch
>
>
> Following works:
> {code}
> create table t1 (a int, b int, c int);
> create table t2 (a int, b int, c int) partitioned by (d int);
> insert into t1 values (1,2,3);
> insert into t1 (c, b, a) values (1,2,3);
> insert into t1 (a,b) values (1,2);
> {code}
> For partitioned tables it should work similarly but doesn't. All of
> following fails:
> {code}
> insert into t2 values (1,2,3,4);
> insert into t2 (a, b, c, d) values (1,2,3,4);
> insert into t2 (c,d) values (1,2);
> insert into t2 (a,b) values (1,2);
> {code}
> All of above should work. Also note following works:
> {code}
> insert into t2 partition(d) values (1,2,3,4);
> insert into t2 partition(d=4) values (1,2,3);
> {code}
>
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
[jira] [Updated] (HIVE-18792) Allow standard compliant syntax for insert on partitioned tables
[
https://issues.apache.org/jira/browse/HIVE-18792?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Vineet Garg updated HIVE-18792:
---
Attachment: HIVE-18792.1.patch
> Allow standard compliant syntax for insert on partitioned tables
>
>
> Key: HIVE-18792
> URL: https://issues.apache.org/jira/browse/HIVE-18792
> Project: Hive
> Issue Type: Improvement
> Components: SQL
>Reporter: Ashutosh Chauhan
>Assignee: Vineet Garg
>Priority: Major
> Attachments: HIVE-18792.1.patch
>
>
> Following works:
> {code}
> create table t1 (a int, b int, c int);
> create table t2 (a int, b int, c int) partitioned by (d int);
> insert into t1 values (1,2,3);
> insert into t1 (c, b, a) values (1,2,3);
> insert into t1 (a,b) values (1,2);
> {code}
> For partitioned tables it should work similarly but doesn't. All of
> following fails:
> {code}
> insert into t2 values (1,2,3,4);
> insert into t2 (a, b, c, d) values (1,2,3,4);
> insert into t2 (c,d) values (1,2);
> insert into t2 (a,b) values (1,2);
> {code}
> All of above should work. Also note following works:
> {code}
> insert into t2 partition(d) values (1,2,3,4);
> insert into t2 partition(d=4) values (1,2,3);
> {code}
>
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
[jira] [Commented] (HIVE-18192) Introduce WriteID per table rather than using global transaction ID
[
https://issues.apache.org/jira/browse/HIVE-18192?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16378087#comment-16378087
]
Sankar Hariappan commented on HIVE-18192:
-
{quote}do you have an estimate on how long that "Only mm_exchangepartition test
failure is relevant to this patch" will be the guest on the regularry failing
test's list? :)
{quote}
[~kgyrtkirk]
I'm targeting to close this issue HIVE-18750 within a week... :)
> Introduce WriteID per table rather than using global transaction ID
> ---
>
> Key: HIVE-18192
> URL: https://issues.apache.org/jira/browse/HIVE-18192
> Project: Hive
> Issue Type: Sub-task
> Components: HiveServer2, Transactions
>Affects Versions: 3.0.0
>Reporter: anishek
>Assignee: Sankar Hariappan
>Priority: Major
> Labels: ACID, DR, pull-request-available
> Fix For: 3.0.0
>
> Attachments: HIVE-18192.01.patch, HIVE-18192.02.patch,
> HIVE-18192.03.patch, HIVE-18192.04.patch, HIVE-18192.05.patch,
> HIVE-18192.06.patch, HIVE-18192.07.patch, HIVE-18192.08.patch,
> HIVE-18192.09.patch, HIVE-18192.10.patch, HIVE-18192.11.patch,
> HIVE-18192.12.patch, HIVE-18192.13.patch, HIVE-18192.14.patch,
> HIVE-18192.15.patch, HIVE-18192.16.patch, HIVE-18192.17.patch
>
>
> To support ACID replication, we will be introducing a per table write Id
> which will replace the transaction id in the primary key for each row in a
> ACID table.
> The current primary key is determined via
>
> which will move to
>
> For each table modified by the given transaction will have a table level
> write ID allocated and a persisted map of global txn id -> to table -> write
> id for that table has to be maintained to allow Snapshot isolation.
> Readers should use the combination of ValidTxnList and
> ValidWriteIdList(Table) for snapshot isolation.
>
> [Hive Replication - ACID
> Tables.pdf|https://issues.apache.org/jira/secure/attachment/12903157/Hive%20Replication-%20ACID%20Tables.pdf]
> has a section "Per Table Sequences (Write-Id)" with more detials
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
[jira] [Comment Edited] (HIVE-18192) Introduce WriteID per table rather than using global transaction ID
[ https://issues.apache.org/jira/browse/HIVE-18192?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16378082#comment-16378082 ] Sankar Hariappan edited comment on HIVE-18192 at 2/27/18 5:57 AM: -- [~sershe] If you see "4" for "hive.txn.tables.valid.writeids" means the current txn_id is 4. We build the ValidWriteIdList only for tables in Read Entities. As it is insert operation, there is only WriteEntity and we assume no body reads the table and hence didn't bother to build ValidWriteIdList. Now, I see, you read this table for stats update and so ValidWriteIdList must be built for this table. This is a bug. I will raise a ticket to include tables from WriteEntities as well while building ValidWriteIdList. cc [~ekoifman] was (Author: sankarh): [~sershe] If you see "4" for "hive.txn.tables.valid.writeids" means the current txn_id is 4. Also, we build the ValidWriteIdList only for tables in Read Entities. As it is insert operation, there is only WriteEntity and we assume no body reads the table and hence didn't bother to build ValidWriteIdList. Now, I see, you will read this table for stats update which looks like a bug. I will raise a ticket to include tables from WriteEntities as well while building ValidWriteIdList. cc [~ekoifman] > Introduce WriteID per table rather than using global transaction ID > --- > > Key: HIVE-18192 > URL: https://issues.apache.org/jira/browse/HIVE-18192 > Project: Hive > Issue Type: Sub-task > Components: HiveServer2, Transactions >Affects Versions: 3.0.0 >Reporter: anishek >Assignee: Sankar Hariappan >Priority: Major > Labels: ACID, DR, pull-request-available > Fix For: 3.0.0 > > Attachments: HIVE-18192.01.patch, HIVE-18192.02.patch, > HIVE-18192.03.patch, HIVE-18192.04.patch, HIVE-18192.05.patch, > HIVE-18192.06.patch, HIVE-18192.07.patch, HIVE-18192.08.patch, > HIVE-18192.09.patch, HIVE-18192.10.patch, HIVE-18192.11.patch, > HIVE-18192.12.patch, HIVE-18192.13.patch, HIVE-18192.14.patch, > HIVE-18192.15.patch, HIVE-18192.16.patch, HIVE-18192.17.patch > > > To support ACID replication, we will be introducing a per table write Id > which will replace the transaction id in the primary key for each row in a > ACID table. > The current primary key is determined via > > which will move to > > For each table modified by the given transaction will have a table level > write ID allocated and a persisted map of global txn id -> to table -> write > id for that table has to be maintained to allow Snapshot isolation. > Readers should use the combination of ValidTxnList and > ValidWriteIdList(Table) for snapshot isolation. > > [Hive Replication - ACID > Tables.pdf|https://issues.apache.org/jira/secure/attachment/12903157/Hive%20Replication-%20ACID%20Tables.pdf] > has a section "Per Table Sequences (Write-Id)" with more detials -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[jira] [Commented] (HIVE-18192) Introduce WriteID per table rather than using global transaction ID
[ https://issues.apache.org/jira/browse/HIVE-18192?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16378082#comment-16378082 ] Sankar Hariappan commented on HIVE-18192: - [~sershe] If you see "4" for "hive.txn.tables.valid.writeids" means the current txn_id is 4. Also, we build the ValidWriteIdList only for tables in Read Entities. As it is insert operation, there is only WriteEntity and we assume no body reads the table and hence didn't bother to build ValidWriteIdList. Now, I see, you will read this table for stats update which looks like a bug. I will raise a ticket to include tables from WriteEntities as well while building ValidWriteIdList. cc [~ekoifman] > Introduce WriteID per table rather than using global transaction ID > --- > > Key: HIVE-18192 > URL: https://issues.apache.org/jira/browse/HIVE-18192 > Project: Hive > Issue Type: Sub-task > Components: HiveServer2, Transactions >Affects Versions: 3.0.0 >Reporter: anishek >Assignee: Sankar Hariappan >Priority: Major > Labels: ACID, DR, pull-request-available > Fix For: 3.0.0 > > Attachments: HIVE-18192.01.patch, HIVE-18192.02.patch, > HIVE-18192.03.patch, HIVE-18192.04.patch, HIVE-18192.05.patch, > HIVE-18192.06.patch, HIVE-18192.07.patch, HIVE-18192.08.patch, > HIVE-18192.09.patch, HIVE-18192.10.patch, HIVE-18192.11.patch, > HIVE-18192.12.patch, HIVE-18192.13.patch, HIVE-18192.14.patch, > HIVE-18192.15.patch, HIVE-18192.16.patch, HIVE-18192.17.patch > > > To support ACID replication, we will be introducing a per table write Id > which will replace the transaction id in the primary key for each row in a > ACID table. > The current primary key is determined via > > which will move to > > For each table modified by the given transaction will have a table level > write ID allocated and a persisted map of global txn id -> to table -> write > id for that table has to be maintained to allow Snapshot isolation. > Readers should use the combination of ValidTxnList and > ValidWriteIdList(Table) for snapshot isolation. > > [Hive Replication - ACID > Tables.pdf|https://issues.apache.org/jira/secure/attachment/12903157/Hive%20Replication-%20ACID%20Tables.pdf] > has a section "Per Table Sequences (Write-Id)" with more detials -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[jira] [Commented] (HIVE-18158) Remove OrcRawRecordMerger.ReaderPairAcid.statementId
[
https://issues.apache.org/jira/browse/HIVE-18158?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16378074#comment-16378074
]
Hive QA commented on HIVE-18158:
| (x) *{color:red}-1 overall{color}* |
\\
\\
|| Vote || Subsystem || Runtime || Comment ||
|| || || || {color:brown} Prechecks {color} ||
| {color:blue}0{color} | {color:blue} findbugs {color} | {color:blue} 0m
0s{color} | {color:blue} Findbugs executables are not available. {color} |
| {color:green}+1{color} | {color:green} @author {color} | {color:green} 0m
0s{color} | {color:green} The patch does not contain any @author tags. {color} |
|| || || || {color:brown} master Compile Tests {color} ||
| {color:green}+1{color} | {color:green} mvninstall {color} | {color:green} 6m
56s{color} | {color:green} master passed {color} |
| {color:green}+1{color} | {color:green} compile {color} | {color:green} 0m
58s{color} | {color:green} master passed {color} |
| {color:green}+1{color} | {color:green} checkstyle {color} | {color:green} 0m
37s{color} | {color:green} master passed {color} |
| {color:green}+1{color} | {color:green} javadoc {color} | {color:green} 0m
52s{color} | {color:green} master passed {color} |
|| || || || {color:brown} Patch Compile Tests {color} ||
| {color:green}+1{color} | {color:green} mvninstall {color} | {color:green} 1m
17s{color} | {color:green} the patch passed {color} |
| {color:green}+1{color} | {color:green} compile {color} | {color:green} 0m
56s{color} | {color:green} the patch passed {color} |
| {color:green}+1{color} | {color:green} javac {color} | {color:green} 0m
56s{color} | {color:green} the patch passed {color} |
| {color:green}+1{color} | {color:green} checkstyle {color} | {color:green} 0m
36s{color} | {color:green} ql: The patch generated 0 new + 248 unchanged - 10
fixed = 248 total (was 258) {color} |
| {color:green}+1{color} | {color:green} whitespace {color} | {color:green} 0m
0s{color} | {color:green} The patch has no whitespace issues. {color} |
| {color:green}+1{color} | {color:green} javadoc {color} | {color:green} 0m
55s{color} | {color:green} the patch passed {color} |
|| || || || {color:brown} Other Tests {color} ||
| {color:red}-1{color} | {color:red} asflicense {color} | {color:red} 0m
19s{color} | {color:red} The patch generated 49 ASF License warnings. {color} |
| {color:black}{color} | {color:black} {color} | {color:black} 13m 44s{color} |
{color:black} {color} |
\\
\\
|| Subsystem || Report/Notes ||
| Optional Tests | asflicense javac javadoc findbugs checkstyle compile |
| uname | Linux hiveptest-server-upstream 3.16.0-4-amd64 #1 SMP Debian
3.16.36-1+deb8u1 (2016-09-03) x86_64 GNU/Linux |
| Build tool | maven |
| Personality |
/data/hiveptest/working/yetus_PreCommit-HIVE-Build-9380/dev-support/hive-personality.sh
|
| git revision | master / 4b22fcb |
| Default Java | 1.8.0_111 |
| asflicense |
http://104.198.109.242/logs//PreCommit-HIVE-Build-9380/yetus/patch-asflicense-problems.txt
|
| modules | C: ql U: ql |
| Console output |
http://104.198.109.242/logs//PreCommit-HIVE-Build-9380/yetus.txt |
| Powered by | Apache Yetushttp://yetus.apache.org |
This message was automatically generated.
> Remove OrcRawRecordMerger.ReaderPairAcid.statementId
>
>
> Key: HIVE-18158
> URL: https://issues.apache.org/jira/browse/HIVE-18158
> Project: Hive
> Issue Type: Improvement
> Components: Transactions
>Affects Versions: 3.0.0
>Reporter: Eugene Koifman
>Assignee: Eugene Koifman
>Priority: Minor
> Attachments: HIVE-18158.01.patch, HIVE-18158.02.patch,
> HIVE-18158.03.patch
>
>
> * Need to get rid of this since we can always get this from the row
> itself in Acid 2.0.
> * For Acid 1.0, statementId == 0 in all deltas because both
> multi-statement txns and
> * Split Upate are only available in test mode so there is nothing can
> create a
> * deltas_x_x_M with M > 0.
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
[jira] [Commented] (HIVE-18493) Add display escape for CR/LF to Hive CLI and Beeline
[ https://issues.apache.org/jira/browse/HIVE-18493?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16378070#comment-16378070 ] Matt McCline commented on HIVE-18493: - HIVE-18806 add test @Ignore annotations for now. > Add display escape for CR/LF to Hive CLI and Beeline > > > Key: HIVE-18493 > URL: https://issues.apache.org/jira/browse/HIVE-18493 > Project: Hive > Issue Type: Bug > Components: Beeline, Hive >Affects Versions: 3.0.0 >Reporter: Matt McCline >Assignee: Matt McCline >Priority: Critical > Attachments: HIVE-18493.01.patch, HIVE-18493.02.patch, > HIVE-18493.03.patch, HIVE-18493.04.patch, HIVE-18493.05.patch, > HIVE-18493.06.patch > > > Add optional display escaping of carriage return and line feed so row output > remains one line. -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[jira] [Commented] (HIVE-18806) Add @Ignore for broken test caused by HIVE-18493
[ https://issues.apache.org/jira/browse/HIVE-18806?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16378068#comment-16378068 ] Matt McCline commented on HIVE-18806: - Temporary cure. Committed to master. [~djaiswal] thank you for your review. > Add @Ignore for broken test caused by HIVE-18493 > > > Key: HIVE-18806 > URL: https://issues.apache.org/jira/browse/HIVE-18806 > Project: Hive > Issue Type: Bug > Components: Hive >Affects Versions: 3.0.0 >Reporter: Matt McCline >Assignee: Matt McCline >Priority: Major > Attachments: HIVE-18806.01.patch, HIVE-18806.02.patch > > > HIVE-18807 is the follow on fix JIRA. > Broken test = org.apache.hive.beeline.cli.TestHiveCli.testNoErrorDB -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[jira] [Updated] (HIVE-18806) Add @Ignore for broken test caused by HIVE-18493
[ https://issues.apache.org/jira/browse/HIVE-18806?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Matt McCline updated HIVE-18806: Resolution: Fixed Status: Resolved (was: Patch Available) > Add @Ignore for broken test caused by HIVE-18493 > > > Key: HIVE-18806 > URL: https://issues.apache.org/jira/browse/HIVE-18806 > Project: Hive > Issue Type: Bug > Components: Hive >Affects Versions: 3.0.0 >Reporter: Matt McCline >Assignee: Matt McCline >Priority: Major > Attachments: HIVE-18806.01.patch, HIVE-18806.02.patch > > > HIVE-18807 is the follow on fix JIRA. > Broken test = org.apache.hive.beeline.cli.TestHiveCli.testNoErrorDB -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[jira] [Commented] (HIVE-18806) Add @Ignore for broken test caused by HIVE-18493
[
https://issues.apache.org/jira/browse/HIVE-18806?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16378061#comment-16378061
]
Hive QA commented on HIVE-18806:
Here are the results of testing the latest attachment:
https://issues.apache.org/jira/secure/attachment/12912153/HIVE-18806.02.patch
{color:green}SUCCESS:{color} +1 due to 2 test(s) being added or modified.
{color:red}ERROR:{color} -1 due to 89 failed/errored test(s), 13413 tests
executed
*Failed tests:*
{noformat}
TestNegativeCliDriver - did not produce a TEST-*.xml file (likely timed out)
(batchId=94)
[jira] [Commented] (HIVE-18806) Add @Ignore for broken test caused by HIVE-18493
[
https://issues.apache.org/jira/browse/HIVE-18806?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16378012#comment-16378012
]
Hive QA commented on HIVE-18806:
| (x) *{color:red}-1 overall{color}* |
\\
\\
|| Vote || Subsystem || Runtime || Comment ||
|| || || || {color:brown} Prechecks {color} ||
| {color:blue}0{color} | {color:blue} findbugs {color} | {color:blue} 0m
1s{color} | {color:blue} Findbugs executables are not available. {color} |
| {color:green}+1{color} | {color:green} @author {color} | {color:green} 0m
0s{color} | {color:green} The patch does not contain any @author tags. {color} |
|| || || || {color:brown} master Compile Tests {color} ||
| {color:blue}0{color} | {color:blue} mvndep {color} | {color:blue} 0m
38s{color} | {color:blue} Maven dependency ordering for branch {color} |
| {color:green}+1{color} | {color:green} mvninstall {color} | {color:green} 6m
24s{color} | {color:green} master passed {color} |
| {color:green}+1{color} | {color:green} compile {color} | {color:green} 0m
51s{color} | {color:green} master passed {color} |
| {color:green}+1{color} | {color:green} checkstyle {color} | {color:green} 0m
26s{color} | {color:green} master passed {color} |
| {color:green}+1{color} | {color:green} javadoc {color} | {color:green} 0m
30s{color} | {color:green} master passed {color} |
|| || || || {color:brown} Patch Compile Tests {color} ||
| {color:blue}0{color} | {color:blue} mvndep {color} | {color:blue} 0m
8s{color} | {color:blue} Maven dependency ordering for patch {color} |
| {color:green}+1{color} | {color:green} mvninstall {color} | {color:green} 0m
54s{color} | {color:green} the patch passed {color} |
| {color:green}+1{color} | {color:green} compile {color} | {color:green} 0m
47s{color} | {color:green} the patch passed {color} |
| {color:green}+1{color} | {color:green} javac {color} | {color:green} 0m
47s{color} | {color:green} the patch passed {color} |
| {color:green}+1{color} | {color:green} checkstyle {color} | {color:green} 0m
25s{color} | {color:green} the patch passed {color} |
| {color:green}+1{color} | {color:green} whitespace {color} | {color:green} 0m
0s{color} | {color:green} The patch has no whitespace issues. {color} |
| {color:green}+1{color} | {color:green} javadoc {color} | {color:green} 0m
30s{color} | {color:green} the patch passed {color} |
|| || || || {color:brown} Other Tests {color} ||
| {color:red}-1{color} | {color:red} asflicense {color} | {color:red} 0m
12s{color} | {color:red} The patch generated 49 ASF License warnings. {color} |
| {color:black}{color} | {color:black} {color} | {color:black} 12m 7s{color} |
{color:black} {color} |
\\
\\
|| Subsystem || Report/Notes ||
| Optional Tests | asflicense javac javadoc findbugs checkstyle compile |
| uname | Linux hiveptest-server-upstream 3.16.0-4-amd64 #1 SMP Debian
3.16.36-1+deb8u1 (2016-09-03) x86_64 GNU/Linux |
| Build tool | maven |
| Personality |
/data/hiveptest/working/yetus_PreCommit-HIVE-Build-9379/dev-support/hive-personality.sh
|
| git revision | master / 4b22fcb |
| Default Java | 1.8.0_111 |
| asflicense |
http://104.198.109.242/logs//PreCommit-HIVE-Build-9379/yetus/patch-asflicense-problems.txt
|
| modules | C: beeline itests/hive-unit U: . |
| Console output |
http://104.198.109.242/logs//PreCommit-HIVE-Build-9379/yetus.txt |
| Powered by | Apache Yetushttp://yetus.apache.org |
This message was automatically generated.
> Add @Ignore for broken test caused by HIVE-18493
>
>
> Key: HIVE-18806
> URL: https://issues.apache.org/jira/browse/HIVE-18806
> Project: Hive
> Issue Type: Bug
> Components: Hive
>Affects Versions: 3.0.0
>Reporter: Matt McCline
>Assignee: Matt McCline
>Priority: Major
> Attachments: HIVE-18806.01.patch, HIVE-18806.02.patch
>
>
> HIVE-18807 is the follow on fix JIRA.
> Broken test = org.apache.hive.beeline.cli.TestHiveCli.testNoErrorDB
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
[jira] [Commented] (HIVE-18796) fix TestSSL
[
https://issues.apache.org/jira/browse/HIVE-18796?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16377998#comment-16377998
]
Hive QA commented on HIVE-18796:
Here are the results of testing the latest attachment:
https://issues.apache.org/jira/secure/attachment/12912151/HIVE-18796.patch
{color:green}SUCCESS:{color} +1 due to 1 test(s) being added or modified.
{color:red}ERROR:{color} -1 due to 28 failed/errored test(s), 13019 tests
executed
*Failed tests:*
{noformat}
TestNegativeCliDriver - did not produce a TEST-*.xml file (likely timed out)
(batchId=93)
[jira] [Issue Comment Deleted] (HIVE-18789) Disallow embedded element in UDFXPathUtil
[ https://issues.apache.org/jira/browse/HIVE-18789?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Thejas M Nair updated HIVE-18789: - Comment: was deleted (was: This article is great and interesting, I am very satisfied with the content provided. [gogoanime|https://gogo-anime.io/]) > Disallow embedded element in UDFXPathUtil > - > > Key: HIVE-18789 > URL: https://issues.apache.org/jira/browse/HIVE-18789 > Project: Hive > Issue Type: Bug >Reporter: Daniel Dai >Assignee: Daniel Dai >Priority: Major > Fix For: 3.0.0 > > Attachments: HIVE-18789.1.patch, HIVE-18789.2.patch > > -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[jira] [Commented] (HIVE-18192) Introduce WriteID per table rather than using global transaction ID
[ https://issues.apache.org/jira/browse/HIVE-18192?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16377989#comment-16377989 ] Sergey Shelukhin commented on HIVE-18192: - Write IDs. I'm just calling the standard method to get ValidWriteIds object; it didn't have the table I need so I logged the string it uses, which was "4". The query is insert into table acid_dtt select cint, cast(cstring1 as varchar(128)) from alltypesorc where cint is not null order by cint limit 10; > Introduce WriteID per table rather than using global transaction ID > --- > > Key: HIVE-18192 > URL: https://issues.apache.org/jira/browse/HIVE-18192 > Project: Hive > Issue Type: Sub-task > Components: HiveServer2, Transactions >Affects Versions: 3.0.0 >Reporter: anishek >Assignee: Sankar Hariappan >Priority: Major > Labels: ACID, DR, pull-request-available > Fix For: 3.0.0 > > Attachments: HIVE-18192.01.patch, HIVE-18192.02.patch, > HIVE-18192.03.patch, HIVE-18192.04.patch, HIVE-18192.05.patch, > HIVE-18192.06.patch, HIVE-18192.07.patch, HIVE-18192.08.patch, > HIVE-18192.09.patch, HIVE-18192.10.patch, HIVE-18192.11.patch, > HIVE-18192.12.patch, HIVE-18192.13.patch, HIVE-18192.14.patch, > HIVE-18192.15.patch, HIVE-18192.16.patch, HIVE-18192.17.patch > > > To support ACID replication, we will be introducing a per table write Id > which will replace the transaction id in the primary key for each row in a > ACID table. > The current primary key is determined via > > which will move to > > For each table modified by the given transaction will have a table level > write ID allocated and a persisted map of global txn id -> to table -> write > id for that table has to be maintained to allow Snapshot isolation. > Readers should use the combination of ValidTxnList and > ValidWriteIdList(Table) for snapshot isolation. > > [Hive Replication - ACID > Tables.pdf|https://issues.apache.org/jira/secure/attachment/12903157/Hive%20Replication-%20ACID%20Tables.pdf] > has a section "Per Table Sequences (Write-Id)" with more detials -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[jira] [Updated] (HIVE-18659) add acid version marker to acid files/directories
[ https://issues.apache.org/jira/browse/HIVE-18659?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eugene Koifman updated HIVE-18659: -- Attachment: HIVE-18659.13.patch > add acid version marker to acid files/directories > - > > Key: HIVE-18659 > URL: https://issues.apache.org/jira/browse/HIVE-18659 > Project: Hive > Issue Type: Bug > Components: Transactions >Reporter: Eugene Koifman >Assignee: Eugene Koifman >Priority: Major > Attachments: HIVE-18659.01.patch, HIVE-18659.04.patch, > HIVE-18659.05.patch, HIVE-18659.06.patch, HIVE-18659.07.patch, > HIVE-18659.09.patch, HIVE-18659.09.patch, HIVE-18659.10.patch, > HIVE-18659.11.patch, HIVE-18659.12.patch, HIVE-18659.13.patch > > > add acid version marker to acid files so that we know which version of acid > wrote the file -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[jira] [Commented] (HIVE-18808) Make compaction more robust when stats update fails
[ https://issues.apache.org/jira/browse/HIVE-18808?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16377981#comment-16377981 ] Eugene Koifman commented on HIVE-18808: --- no related failures [~alangates] could you review please > Make compaction more robust when stats update fails > --- > > Key: HIVE-18808 > URL: https://issues.apache.org/jira/browse/HIVE-18808 > Project: Hive > Issue Type: Improvement > Components: Transactions >Affects Versions: 1.0.0 >Reporter: Eugene Koifman >Assignee: Eugene Koifman >Priority: Major > Attachments: HIVE-18808.01.patch > > > > Worker.gatherStats() runs a "analyze table..." command to update stats which > requires SessionState. SessionState objects are cached in ThreadLocal. If > for some reason Session init fails, it may still get attached to the thread > which then causes a subsequent request that uses the same tread to gather > stats fail because it has a bad session object. HIVE-15658 describes the > same issue in a different context. > There is currently no way to recycle a session from outside HMS. > Failure to gather stats should not kill a compaction job which then prevents > Cleaner from running. -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[jira] [Commented] (HIVE-18192) Introduce WriteID per table rather than using global transaction ID
[ https://issues.apache.org/jira/browse/HIVE-18192?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16377977#comment-16377977 ] Eugene Koifman commented on HIVE-18192: --- what property are you looking up? There is hive.txn.valid.txns and hive.txn.tables.valid.writeids > Introduce WriteID per table rather than using global transaction ID > --- > > Key: HIVE-18192 > URL: https://issues.apache.org/jira/browse/HIVE-18192 > Project: Hive > Issue Type: Sub-task > Components: HiveServer2, Transactions >Affects Versions: 3.0.0 >Reporter: anishek >Assignee: Sankar Hariappan >Priority: Major > Labels: ACID, DR, pull-request-available > Fix For: 3.0.0 > > Attachments: HIVE-18192.01.patch, HIVE-18192.02.patch, > HIVE-18192.03.patch, HIVE-18192.04.patch, HIVE-18192.05.patch, > HIVE-18192.06.patch, HIVE-18192.07.patch, HIVE-18192.08.patch, > HIVE-18192.09.patch, HIVE-18192.10.patch, HIVE-18192.11.patch, > HIVE-18192.12.patch, HIVE-18192.13.patch, HIVE-18192.14.patch, > HIVE-18192.15.patch, HIVE-18192.16.patch, HIVE-18192.17.patch > > > To support ACID replication, we will be introducing a per table write Id > which will replace the transaction id in the primary key for each row in a > ACID table. > The current primary key is determined via > > which will move to > > For each table modified by the given transaction will have a table level > write ID allocated and a persisted map of global txn id -> to table -> write > id for that table has to be maintained to allow Snapshot isolation. > Readers should use the combination of ValidTxnList and > ValidWriteIdList(Table) for snapshot isolation. > > [Hive Replication - ACID > Tables.pdf|https://issues.apache.org/jira/secure/attachment/12903157/Hive%20Replication-%20ACID%20Tables.pdf] > has a section "Per Table Sequences (Write-Id)" with more detials -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[jira] [Commented] (HIVE-18789) Disallow embedded element in UDFXPathUtil
[ https://issues.apache.org/jira/browse/HIVE-18789?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16377965#comment-16377965 ] Chalchiuhticue Naabah commented on HIVE-18789: -- This article is great and interesting, I am very satisfied with the content provided. [gogoanime|https://gogo-anime.io/] > Disallow embedded element in UDFXPathUtil > - > > Key: HIVE-18789 > URL: https://issues.apache.org/jira/browse/HIVE-18789 > Project: Hive > Issue Type: Bug >Reporter: Daniel Dai >Assignee: Daniel Dai >Priority: Major > Fix For: 3.0.0 > > Attachments: HIVE-18789.1.patch, HIVE-18789.2.patch > > -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[jira] [Commented] (HIVE-18738) LLAP IO ACID - includes handling is broken
[ https://issues.apache.org/jira/browse/HIVE-18738?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16377942#comment-16377942 ] Sergey Shelukhin commented on HIVE-18738: - [~prasanth_j] ping? > LLAP IO ACID - includes handling is broken > -- > > Key: HIVE-18738 > URL: https://issues.apache.org/jira/browse/HIVE-18738 > Project: Hive > Issue Type: Bug >Reporter: Deepesh Khandelwal >Assignee: Sergey Shelukhin >Priority: Major > Attachments: HIVE-18738.patch > > -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[jira] [Commented] (HIVE-18571) stats issues for MM tables
[ https://issues.apache.org/jira/browse/HIVE-18571?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16377941#comment-16377941 ] Sergey Shelukhin commented on HIVE-18571: - Update again to try and use ACID state in more locations when updating stats. Unfortunately it looks like write ID for the target table of an insert is missing during the insert; I left a comment in HIVE-18192: "When I get the config setting where txn state is stored as string for an insert query in autoColumnStats_4 (insert into acid table from non-acid table), the setting is "4" - basically it has txn ID, but no write Id for any table. Is that by design? How does it write into the table without having a write ID for that table?" Need to clarify that and update the patch either with/after the write ID fix, or based on the next test run, update the ACID table stats to be cleared in more tests when ACID state cannot be obtained. [~ekoifman] can you please review this patch? I think write ID and/or some out files aside it is ready. > stats issues for MM tables > -- > > Key: HIVE-18571 > URL: https://issues.apache.org/jira/browse/HIVE-18571 > Project: Hive > Issue Type: Bug >Reporter: Sergey Shelukhin >Assignee: Sergey Shelukhin >Priority: Major > Attachments: HIVE-18571.01.patch, HIVE-18571.02.patch, > HIVE-18571.03.patch, HIVE-18571.patch > > > There are multiple stats aggregation issues with MM tables. > Some simple stats are double counted and some stats (simple stats) are > invalid for ACID table dirs altogether. > I have a patch almost ready, need to fix some more stuff and clean up. -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[jira] [Updated] (HIVE-18571) stats issues for MM tables
[ https://issues.apache.org/jira/browse/HIVE-18571?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sergey Shelukhin updated HIVE-18571: Attachment: HIVE-18571.03.patch > stats issues for MM tables > -- > > Key: HIVE-18571 > URL: https://issues.apache.org/jira/browse/HIVE-18571 > Project: Hive > Issue Type: Bug >Reporter: Sergey Shelukhin >Assignee: Sergey Shelukhin >Priority: Major > Attachments: HIVE-18571.01.patch, HIVE-18571.02.patch, > HIVE-18571.03.patch, HIVE-18571.patch > > > There are multiple stats aggregation issues with MM tables. > Some simple stats are double counted and some stats (simple stats) are > invalid for ACID table dirs altogether. > I have a patch almost ready, need to fix some more stuff and clean up. -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[jira] [Commented] (HIVE-18796) fix TestSSL
[
https://issues.apache.org/jira/browse/HIVE-18796?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16377935#comment-16377935
]
Hive QA commented on HIVE-18796:
| (x) *{color:red}-1 overall{color}* |
\\
\\
|| Vote || Subsystem || Runtime || Comment ||
|| || || || {color:brown} Prechecks {color} ||
| {color:blue}0{color} | {color:blue} findbugs {color} | {color:blue} 0m
0s{color} | {color:blue} Findbugs executables are not available. {color} |
| {color:green}+1{color} | {color:green} @author {color} | {color:green} 0m
0s{color} | {color:green} The patch does not contain any @author tags. {color} |
|| || || || {color:brown} master Compile Tests {color} ||
| {color:blue}0{color} | {color:blue} mvndep {color} | {color:blue} 0m
36s{color} | {color:blue} Maven dependency ordering for branch {color} |
| {color:green}+1{color} | {color:green} mvninstall {color} | {color:green} 6m
33s{color} | {color:green} master passed {color} |
| {color:green}+1{color} | {color:green} compile {color} | {color:green} 1m
8s{color} | {color:green} master passed {color} |
| {color:green}+1{color} | {color:green} checkstyle {color} | {color:green} 0m
40s{color} | {color:green} master passed {color} |
| {color:green}+1{color} | {color:green} javadoc {color} | {color:green} 0m
46s{color} | {color:green} master passed {color} |
|| || || || {color:brown} Patch Compile Tests {color} ||
| {color:blue}0{color} | {color:blue} mvndep {color} | {color:blue} 0m
8s{color} | {color:blue} Maven dependency ordering for patch {color} |
| {color:red}-1{color} | {color:red} mvninstall {color} | {color:red} 0m
18s{color} | {color:red} service in the patch failed. {color} |
| {color:red}-1{color} | {color:red} compile {color} | {color:red} 0m
18s{color} | {color:red} service in the patch failed. {color} |
| {color:red}-1{color} | {color:red} javac {color} | {color:red} 0m 18s{color}
| {color:red} service in the patch failed. {color} |
| {color:green}+1{color} | {color:green} checkstyle {color} | {color:green} 0m
38s{color} | {color:green} the patch passed {color} |
| {color:green}+1{color} | {color:green} whitespace {color} | {color:green} 0m
0s{color} | {color:green} The patch has no whitespace issues. {color} |
| {color:green}+1{color} | {color:green} javadoc {color} | {color:green} 0m
51s{color} | {color:green} the patch passed {color} |
|| || || || {color:brown} Other Tests {color} ||
| {color:red}-1{color} | {color:red} asflicense {color} | {color:red} 0m
13s{color} | {color:red} The patch generated 49 ASF License warnings. {color} |
| {color:black}{color} | {color:black} {color} | {color:black} 14m 12s{color} |
{color:black} {color} |
\\
\\
|| Subsystem || Report/Notes ||
| Optional Tests | asflicense javac javadoc findbugs checkstyle compile |
| uname | Linux hiveptest-server-upstream 3.16.0-4-amd64 #1 SMP Debian
3.16.36-1+deb8u1 (2016-09-03) x86_64 GNU/Linux |
| Build tool | maven |
| Personality |
/data/hiveptest/working/yetus_PreCommit-HIVE-Build-9378/dev-support/hive-personality.sh
|
| git revision | master / 4b22fcb |
| Default Java | 1.8.0_111 |
| mvninstall |
http://104.198.109.242/logs//PreCommit-HIVE-Build-9378/yetus/patch-mvninstall-service.txt
|
| compile |
http://104.198.109.242/logs//PreCommit-HIVE-Build-9378/yetus/patch-compile-service.txt
|
| javac |
http://104.198.109.242/logs//PreCommit-HIVE-Build-9378/yetus/patch-compile-service.txt
|
| asflicense |
http://104.198.109.242/logs//PreCommit-HIVE-Build-9378/yetus/patch-asflicense-problems.txt
|
| modules | C: common itests/hive-unit service U: . |
| Console output |
http://104.198.109.242/logs//PreCommit-HIVE-Build-9378/yetus.txt |
| Powered by | Apache Yetushttp://yetus.apache.org |
This message was automatically generated.
> fix TestSSL
> ---
>
> Key: HIVE-18796
> URL: https://issues.apache.org/jira/browse/HIVE-18796
> Project: Hive
> Issue Type: Bug
> Components: Test
>Reporter: Zoltan Haindrich
>Assignee: Sergey Shelukhin
>Priority: Major
> Attachments: HIVE-18796.patch
>
>
> broken by HIVE-18203
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
[jira] [Commented] (HIVE-18192) Introduce WriteID per table rather than using global transaction ID
[ https://issues.apache.org/jira/browse/HIVE-18192?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16377934#comment-16377934 ] Sergey Shelukhin commented on HIVE-18192: - [~sankarh] [~ekoifman] I'm looking at some ACID stats improvements, and trying to get ACID state during an insert query. When I get the config setting where txn state is stored as string for an insert query in autoColumnStats_4 (insert into acid table from non-acid table), the setting is "4" - basically it has txn ID, but no write Id for any table. Is that by design? How does it write into the table without having a write ID for that table? > Introduce WriteID per table rather than using global transaction ID > --- > > Key: HIVE-18192 > URL: https://issues.apache.org/jira/browse/HIVE-18192 > Project: Hive > Issue Type: Sub-task > Components: HiveServer2, Transactions >Affects Versions: 3.0.0 >Reporter: anishek >Assignee: Sankar Hariappan >Priority: Major > Labels: ACID, DR, pull-request-available > Fix For: 3.0.0 > > Attachments: HIVE-18192.01.patch, HIVE-18192.02.patch, > HIVE-18192.03.patch, HIVE-18192.04.patch, HIVE-18192.05.patch, > HIVE-18192.06.patch, HIVE-18192.07.patch, HIVE-18192.08.patch, > HIVE-18192.09.patch, HIVE-18192.10.patch, HIVE-18192.11.patch, > HIVE-18192.12.patch, HIVE-18192.13.patch, HIVE-18192.14.patch, > HIVE-18192.15.patch, HIVE-18192.16.patch, HIVE-18192.17.patch > > > To support ACID replication, we will be introducing a per table write Id > which will replace the transaction id in the primary key for each row in a > ACID table. > The current primary key is determined via > > which will move to > > For each table modified by the given transaction will have a table level > write ID allocated and a persisted map of global txn id -> to table -> write > id for that table has to be maintained to allow Snapshot isolation. > Readers should use the combination of ValidTxnList and > ValidWriteIdList(Table) for snapshot isolation. > > [Hive Replication - ACID > Tables.pdf|https://issues.apache.org/jira/secure/attachment/12903157/Hive%20Replication-%20ACID%20Tables.pdf] > has a section "Per Table Sequences (Write-Id)" with more detials -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[jira] [Commented] (HIVE-18811) Fix desc table, column comments are not displayed
[
https://issues.apache.org/jira/browse/HIVE-18811?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16377921#comment-16377921
]
tartarus commented on HIVE-18811:
-
[~prasanth_j] hello , please review
> Fix desc table, column comments are not displayed
> -
>
> Key: HIVE-18811
> URL: https://issues.apache.org/jira/browse/HIVE-18811
> Project: Hive
> Issue Type: Bug
> Components: CLI
>Affects Versions: 1.2.1, 2.3.2
> Environment: CentOS 6.5
> Hive-1.2.1
> Hive-3.0.0
>Reporter: tartarus
>Assignee: tartarus
>Priority: Major
> Labels: patch
> Fix For: 3.0.0
>
> Attachments: HIVE_18811.patch
>
>
> when column comment contain \t
> eg: CREATE TABLE `zhangmang_test`(`name` string COMMENT
> 'name{color:#FF}\t{color}zm');
> then execute : {color:#FF}desc zhangmang_test {color}
> {color:#FF}{color:#33}return : name string
> name{color}
> {color}
> because \t is the separator, so we should translate it
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
[jira] [Commented] (HIVE-18808) Make compaction more robust when stats update fails
[
https://issues.apache.org/jira/browse/HIVE-18808?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16377922#comment-16377922
]
Hive QA commented on HIVE-18808:
Here are the results of testing the latest attachment:
https://issues.apache.org/jira/secure/attachment/12912149/HIVE-18808.01.patch
{color:red}ERROR:{color} -1 due to no test(s) being added or modified.
{color:red}ERROR:{color} -1 due to 34 failed/errored test(s), 13014 tests
executed
*Failed tests:*
{noformat}
TestNegativeCliDriver - did not produce a TEST-*.xml file (likely timed out)
(batchId=93)
[jira] [Updated] (HIVE-18811) Fix desc table, column comments are not displayed
[
https://issues.apache.org/jira/browse/HIVE-18811?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
tartarus updated HIVE-18811:
Attachment: HIVE_18811.patch
> Fix desc table, column comments are not displayed
> -
>
> Key: HIVE-18811
> URL: https://issues.apache.org/jira/browse/HIVE-18811
> Project: Hive
> Issue Type: Bug
> Components: CLI
>Affects Versions: 1.2.1, 2.3.2
> Environment: CentOS 6.5
> Hive-1.2.1
> Hive-3.0.0
>Reporter: tartarus
>Assignee: tartarus
>Priority: Major
> Labels: patch
> Fix For: 3.0.0
>
> Attachments: HIVE_18811.patch
>
>
> when column comment contain \t
> eg: CREATE TABLE `zhangmang_test`(`name` string COMMENT
> 'name{color:#FF}\t{color}zm');
> then execute : {color:#FF}desc zhangmang_test {color}
> {color:#FF}{color:#33}return : name string
> name{color}
> {color}
> because \t is the separator, so we should translate it
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
[jira] [Updated] (HIVE-18811) Fix desc table, column comments are not displayed
[
https://issues.apache.org/jira/browse/HIVE-18811?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
tartarus updated HIVE-18811:
Status: Patch Available (was: Open)
translate '\t' to '\ t'
> Fix desc table, column comments are not displayed
> -
>
> Key: HIVE-18811
> URL: https://issues.apache.org/jira/browse/HIVE-18811
> Project: Hive
> Issue Type: Bug
> Components: CLI
>Affects Versions: 2.3.2, 1.2.1
> Environment: CentOS 6.5
> Hive-1.2.1
> Hive-3.0.0
>Reporter: tartarus
>Assignee: tartarus
>Priority: Major
> Labels: patch
> Fix For: 3.0.0
>
>
> when column comment contain \t
> eg: CREATE TABLE `zhangmang_test`(`name` string COMMENT
> 'name{color:#FF}\t{color}zm');
> then execute : {color:#FF}desc zhangmang_test {color}
> {color:#FF}{color:#33}return : name string
> name{color}
> {color}
> because \t is the separator, so we should translate it
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
[jira] [Assigned] (HIVE-18811) Fix desc table, column comments are not displayed
[
https://issues.apache.org/jira/browse/HIVE-18811?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
tartarus reassigned HIVE-18811:
---
> Fix desc table, column comments are not displayed
> -
>
> Key: HIVE-18811
> URL: https://issues.apache.org/jira/browse/HIVE-18811
> Project: Hive
> Issue Type: Bug
> Components: CLI
>Affects Versions: 2.3.2, 1.2.1
> Environment: CentOS 6.5
> Hive-1.2.1
> Hive-3.0.0
>Reporter: tartarus
>Assignee: tartarus
>Priority: Major
> Labels: patch
> Fix For: 3.0.0
>
>
> when column comment contain \t
> eg: CREATE TABLE `zhangmang_test`(`name` string COMMENT
> 'name{color:#FF}\t{color}zm');
> then execute : {color:#FF}desc zhangmang_test {color}
> {color:#FF}{color:#33}return : name string
> name{color}
> {color}
> because \t is the separator, so we should translate it
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
[jira] [Commented] (HIVE-18775) HIVE-17983 missed deleting metastore/scripts/upgrade/derby/hive-schema-3.0.0.derby.sql
[
https://issues.apache.org/jira/browse/HIVE-18775?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16377907#comment-16377907
]
Vineet Garg commented on HIVE-18775:
Thanks for responding [~alangates]. I'll see if I could figure out the pom code.
> HIVE-17983 missed deleting
> metastore/scripts/upgrade/derby/hive-schema-3.0.0.derby.sql
> --
>
> Key: HIVE-18775
> URL: https://issues.apache.org/jira/browse/HIVE-18775
> Project: Hive
> Issue Type: Bug
>Reporter: Vineet Garg
>Assignee: Vineet Garg
>Priority: Major
> Attachments: HIVE-18775.1.patch, HIVE-18775.2.patch
>
>
> HIVE-17983 moved hive metastore schema sql files for all databases but derby
> to standalone-metastore. As a result there are not two copies of
> {{hive-schema-3.0.0.derby.sql}}.
> {{metastore/scripts/upgrade/derby/hive-schema-3.0.0.derby.sql}} needs to be
> removed.
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
[jira] [Commented] (HIVE-18808) Make compaction more robust when stats update fails
[
https://issues.apache.org/jira/browse/HIVE-18808?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16377892#comment-16377892
]
Hive QA commented on HIVE-18808:
| (x) *{color:red}-1 overall{color}* |
\\
\\
|| Vote || Subsystem || Runtime || Comment ||
|| || || || {color:brown} Prechecks {color} ||
| {color:blue}0{color} | {color:blue} findbugs {color} | {color:blue} 0m
1s{color} | {color:blue} Findbugs executables are not available. {color} |
| {color:green}+1{color} | {color:green} @author {color} | {color:green} 0m
0s{color} | {color:green} The patch does not contain any @author tags. {color} |
|| || || || {color:brown} master Compile Tests {color} ||
| {color:green}+1{color} | {color:green} mvninstall {color} | {color:green} 7m
5s{color} | {color:green} master passed {color} |
| {color:green}+1{color} | {color:green} compile {color} | {color:green} 0m
59s{color} | {color:green} master passed {color} |
| {color:green}+1{color} | {color:green} checkstyle {color} | {color:green} 0m
35s{color} | {color:green} master passed {color} |
| {color:green}+1{color} | {color:green} javadoc {color} | {color:green} 0m
51s{color} | {color:green} master passed {color} |
|| || || || {color:brown} Patch Compile Tests {color} ||
| {color:green}+1{color} | {color:green} mvninstall {color} | {color:green} 1m
17s{color} | {color:green} the patch passed {color} |
| {color:green}+1{color} | {color:green} compile {color} | {color:green} 0m
55s{color} | {color:green} the patch passed {color} |
| {color:green}+1{color} | {color:green} javac {color} | {color:green} 0m
55s{color} | {color:green} the patch passed {color} |
| {color:red}-1{color} | {color:red} checkstyle {color} | {color:red} 0m
34s{color} | {color:red} ql: The patch generated 2 new + 9 unchanged - 4 fixed
= 11 total (was 13) {color} |
| {color:green}+1{color} | {color:green} whitespace {color} | {color:green} 0m
0s{color} | {color:green} The patch has no whitespace issues. {color} |
| {color:green}+1{color} | {color:green} javadoc {color} | {color:green} 0m
51s{color} | {color:green} the patch passed {color} |
|| || || || {color:brown} Other Tests {color} ||
| {color:red}-1{color} | {color:red} asflicense {color} | {color:red} 0m
25s{color} | {color:red} The patch generated 49 ASF License warnings. {color} |
| {color:black}{color} | {color:black} {color} | {color:black} 13m 53s{color} |
{color:black} {color} |
\\
\\
|| Subsystem || Report/Notes ||
| Optional Tests | asflicense javac javadoc findbugs checkstyle compile |
| uname | Linux hiveptest-server-upstream 3.16.0-4-amd64 #1 SMP Debian
3.16.36-1+deb8u1 (2016-09-03) x86_64 GNU/Linux |
| Build tool | maven |
| Personality |
/data/hiveptest/working/yetus_PreCommit-HIVE-Build-9377/dev-support/hive-personality.sh
|
| git revision | master / 4b22fcb |
| Default Java | 1.8.0_111 |
| checkstyle |
http://104.198.109.242/logs//PreCommit-HIVE-Build-9377/yetus/diff-checkstyle-ql.txt
|
| asflicense |
http://104.198.109.242/logs//PreCommit-HIVE-Build-9377/yetus/patch-asflicense-problems.txt
|
| modules | C: ql U: ql |
| Console output |
http://104.198.109.242/logs//PreCommit-HIVE-Build-9377/yetus.txt |
| Powered by | Apache Yetushttp://yetus.apache.org |
This message was automatically generated.
> Make compaction more robust when stats update fails
> ---
>
> Key: HIVE-18808
> URL: https://issues.apache.org/jira/browse/HIVE-18808
> Project: Hive
> Issue Type: Improvement
> Components: Transactions
>Affects Versions: 1.0.0
>Reporter: Eugene Koifman
>Assignee: Eugene Koifman
>Priority: Major
> Attachments: HIVE-18808.01.patch
>
>
>
> Worker.gatherStats() runs a "analyze table..." command to update stats which
> requires SessionState. SessionState objects are cached in ThreadLocal. If
> for some reason Session init fails, it may still get attached to the thread
> which then causes a subsequent request that uses the same tread to gather
> stats fail because it has a bad session object. HIVE-15658 describes the
> same issue in a different context.
> There is currently no way to recycle a session from outside HMS.
> Failure to gather stats should not kill a compaction job which then prevents
> Cleaner from running.
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
[jira] [Commented] (HIVE-18715) Remove index support from metastore
[
https://issues.apache.org/jira/browse/HIVE-18715?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16377881#comment-16377881
]
Hive QA commented on HIVE-18715:
Here are the results of testing the latest attachment:
https://issues.apache.org/jira/secure/attachment/12912124/HIVE-18715.01.patch
{color:green}SUCCESS:{color} +1 due to 8 test(s) being added or modified.
{color:red}ERROR:{color} -1 due to 145 failed/errored test(s), 13263 tests
executed
*Failed tests:*
{noformat}
TestNegativeCliDriver - did not produce a TEST-*.xml file (likely timed out)
(batchId=93)
[jira] [Commented] (HIVE-18715) Remove index support from metastore
[
https://issues.apache.org/jira/browse/HIVE-18715?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16377852#comment-16377852
]
Hive QA commented on HIVE-18715:
| (x) *{color:red}-1 overall{color}* |
\\
\\
|| Vote || Subsystem || Runtime || Comment ||
|| || || || {color:brown} Prechecks {color} ||
| {color:blue}0{color} | {color:blue} findbugs {color} | {color:blue} 0m
0s{color} | {color:blue} Findbugs executables are not available. {color} |
| {color:green}+1{color} | {color:green} @author {color} | {color:green} 0m
0s{color} | {color:green} The patch does not contain any @author tags. {color} |
|| || || || {color:brown} master Compile Tests {color} ||
| {color:blue}0{color} | {color:blue} mvndep {color} | {color:blue} 0m
49s{color} | {color:blue} Maven dependency ordering for branch {color} |
| {color:green}+1{color} | {color:green} mvninstall {color} | {color:green} 6m
23s{color} | {color:green} master passed {color} |
| {color:green}+1{color} | {color:green} compile {color} | {color:green} 2m
55s{color} | {color:green} master passed {color} |
| {color:green}+1{color} | {color:green} checkstyle {color} | {color:green} 1m
57s{color} | {color:green} master passed {color} |
| {color:green}+1{color} | {color:green} javadoc {color} | {color:green} 2m
37s{color} | {color:green} master passed {color} |
|| || || || {color:brown} Patch Compile Tests {color} ||
| {color:blue}0{color} | {color:blue} mvndep {color} | {color:blue} 0m
8s{color} | {color:blue} Maven dependency ordering for patch {color} |
| {color:red}-1{color} | {color:red} mvninstall {color} | {color:red} 0m
17s{color} | {color:red} hcatalog-unit in the patch failed. {color} |
| {color:green}+1{color} | {color:green} compile {color} | {color:green} 2m
52s{color} | {color:green} the patch passed {color} |
| {color:green}+1{color} | {color:green} javac {color} | {color:green} 2m
52s{color} | {color:green} the patch passed {color} |
| {color:green}+1{color} | {color:green} checkstyle {color} | {color:green} 0m
11s{color} | {color:green} hcatalog/core: The patch generated 0 new + 16
unchanged - 2 fixed = 16 total (was 18) {color} |
| {color:green}+1{color} | {color:green} checkstyle {color} | {color:green} 0m
10s{color} | {color:green} hcatalog/server-extensions: The patch generated 0
new + 42 unchanged - 37 fixed = 42 total (was 79) {color} |
| {color:green}+1{color} | {color:green} checkstyle {color} | {color:green} 0m
10s{color} | {color:green} itests/hcatalog-unit: The patch generated 0 new + 36
unchanged - 4 fixed = 36 total (was 40) {color} |
| {color:green}+1{color} | {color:green} checkstyle {color} | {color:green} 0m
13s{color} | {color:green} The patch util passed checkstyle {color} |
| {color:red}-1{color} | {color:red} checkstyle {color} | {color:red} 0m
42s{color} | {color:red} ql: The patch generated 2 new + 829 unchanged - 10
fixed = 831 total (was 839) {color} |
| {color:red}-1{color} | {color:red} checkstyle {color} | {color:red} 0m
29s{color} | {color:red} standalone-metastore: The patch generated 5 new + 1326
unchanged - 219 fixed = 1331 total (was 1545) {color} |
| {color:red}-1{color} | {color:red} whitespace {color} | {color:red} 0m
1s{color} | {color:red} The patch has 5 line(s) that end in whitespace. Use git
apply --whitespace=fix <>. Refer https://git-scm.com/docs/git-apply
{color} |
| {color:green}+1{color} | {color:green} javadoc {color} | {color:green} 0m
12s{color} | {color:green} core in the patch passed. {color} |
| {color:green}+1{color} | {color:green} javadoc {color} | {color:green} 0m
12s{color} | {color:green} server-extensions in the patch passed. {color} |
| {color:green}+1{color} | {color:green} javadoc {color} | {color:green} 0m
9s{color} | {color:green} hcatalog-unit in the patch passed. {color} |
| {color:green}+1{color} | {color:green} javadoc {color} | {color:green} 0m
17s{color} | {color:green} util in the patch passed. {color} |
| {color:green}+1{color} | {color:green} javadoc {color} | {color:green} 0m
51s{color} | {color:green} ql in the patch passed. {color} |
| {color:green}+1{color} | {color:green} javadoc {color} | {color:green} 0m
43s{color} | {color:green} standalone-metastore generated 0 new + 59 unchanged
- 2 fixed = 59 total (was 61) {color} |
|| || || || {color:brown} Other Tests {color} ||
| {color:red}-1{color} | {color:red} asflicense {color} | {color:red} 0m
13s{color} | {color:red} The patch generated 49 ASF License warnings. {color} |
| {color:black}{color} | {color:black} {color} | {color:black} 27m 38s{color} |
{color:black} {color} |
\\
\\
|| Subsystem || Report/Notes ||
| Optional Tests | asflicense javac javadoc findbugs checkstyle compile |
| uname | Linux hiveptest-server-upstream 3.16.0-4-amd64 #1 SMP Debian
3.16.36-1+deb8u1 (2016-09-03) x86_64 GNU/Linux |
| Build tool | maven |
| Personality |
[jira] [Commented] (HIVE-18797) ExprConstNodeDesc's getExprString should put appropriate qualifier with literals
[
https://issues.apache.org/jira/browse/HIVE-18797?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16377851#comment-16377851
]
Ashutosh Chauhan commented on HIVE-18797:
-
+1 pending tests.
> ExprConstNodeDesc's getExprString should put appropriate qualifier with
> literals
>
>
> Key: HIVE-18797
> URL: https://issues.apache.org/jira/browse/HIVE-18797
> Project: Hive
> Issue Type: Improvement
>Reporter: Vineet Garg
>Assignee: Vineet Garg
>Priority: Major
> Attachments: HIVE-18797.1.patch, HIVE-18797.2.patch,
> HIVE-18797.3.patch
>
>
> e.g. instead of just {{2016-01-23 00:00:00.0)}} it should be
> {{TIMESTAMP'2016-01-23 00:00:00.0)'}}.
> This method is used by explain task and also HIVE-18726 needs it to reparse
> the string for default value.
> I am creating a separate ticket for this instead of lumping it with
> HIVE-18726 because this will need quite a few golden files update.
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
[jira] [Updated] (HIVE-18797) ExprConstNodeDesc's getExprString should put appropriate qualifier with literals
[
https://issues.apache.org/jira/browse/HIVE-18797?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Vineet Garg updated HIVE-18797:
---
Status: Patch Available (was: Open)
> ExprConstNodeDesc's getExprString should put appropriate qualifier with
> literals
>
>
> Key: HIVE-18797
> URL: https://issues.apache.org/jira/browse/HIVE-18797
> Project: Hive
> Issue Type: Improvement
>Reporter: Vineet Garg
>Assignee: Vineet Garg
>Priority: Major
> Attachments: HIVE-18797.1.patch, HIVE-18797.2.patch,
> HIVE-18797.3.patch
>
>
> e.g. instead of just {{2016-01-23 00:00:00.0)}} it should be
> {{TIMESTAMP'2016-01-23 00:00:00.0)'}}.
> This method is used by explain task and also HIVE-18726 needs it to reparse
> the string for default value.
> I am creating a separate ticket for this instead of lumping it with
> HIVE-18726 because this will need quite a few golden files update.
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
[jira] [Updated] (HIVE-18797) ExprConstNodeDesc's getExprString should put appropriate qualifier with literals
[
https://issues.apache.org/jira/browse/HIVE-18797?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Vineet Garg updated HIVE-18797:
---
Status: Open (was: Patch Available)
> ExprConstNodeDesc's getExprString should put appropriate qualifier with
> literals
>
>
> Key: HIVE-18797
> URL: https://issues.apache.org/jira/browse/HIVE-18797
> Project: Hive
> Issue Type: Improvement
>Reporter: Vineet Garg
>Assignee: Vineet Garg
>Priority: Major
> Attachments: HIVE-18797.1.patch, HIVE-18797.2.patch,
> HIVE-18797.3.patch
>
>
> e.g. instead of just {{2016-01-23 00:00:00.0)}} it should be
> {{TIMESTAMP'2016-01-23 00:00:00.0)'}}.
> This method is used by explain task and also HIVE-18726 needs it to reparse
> the string for default value.
> I am creating a separate ticket for this instead of lumping it with
> HIVE-18726 because this will need quite a few golden files update.
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
[jira] [Updated] (HIVE-18797) ExprConstNodeDesc's getExprString should put appropriate qualifier with literals
[
https://issues.apache.org/jira/browse/HIVE-18797?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Vineet Garg updated HIVE-18797:
---
Attachment: HIVE-18797.3.patch
> ExprConstNodeDesc's getExprString should put appropriate qualifier with
> literals
>
>
> Key: HIVE-18797
> URL: https://issues.apache.org/jira/browse/HIVE-18797
> Project: Hive
> Issue Type: Improvement
>Reporter: Vineet Garg
>Assignee: Vineet Garg
>Priority: Major
> Attachments: HIVE-18797.1.patch, HIVE-18797.2.patch,
> HIVE-18797.3.patch
>
>
> e.g. instead of just {{2016-01-23 00:00:00.0)}} it should be
> {{TIMESTAMP'2016-01-23 00:00:00.0)'}}.
> This method is used by explain task and also HIVE-18726 needs it to reparse
> the string for default value.
> I am creating a separate ticket for this instead of lumping it with
> HIVE-18726 because this will need quite a few golden files update.
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
[jira] [Commented] (HIVE-18776) MaterializationsInvalidationCache loading causes race condition in the metastore
[ https://issues.apache.org/jira/browse/HIVE-18776?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16377821#comment-16377821 ] Alan Gates commented on HIVE-18776: --- +1. I ran the test that I used to find this successfully 15 times with the new patch. Previously it failed at least once every 5 runs. > MaterializationsInvalidationCache loading causes race condition in the > metastore > > > Key: HIVE-18776 > URL: https://issues.apache.org/jira/browse/HIVE-18776 > Project: Hive > Issue Type: Bug > Components: Materialized views, Metastore >Affects Versions: 3.0.0 >Reporter: Alan Gates >Assignee: Jesus Camacho Rodriguez >Priority: Major > Attachments: HIVE-18776.01.patch, HIVE-18776.patch > > > I am seeing occasional failures running metastore tests where operations are > failing saying that there is no open transaction. I have traced this to a > race condition in loading the materialized view invalidation cache. When it > is initialized (either in HiveMetaStoreClient in embedded mode or in > HiveMetaStore in remote mode) it grabs a copy of the current RawStore > instance and then loads the cache in a separate thread. But ObjectStore > keeps state regarding JDO transactions with the underlying RDBMS. So with > the loader thread and the initial thread both doing operations against the > RawStore they sometimes mess up each others transaction stack. In a quick > test I used HMSHandler.newRawStoreForConf() to fix this, which seemed to work. > A reference to the TxnHandler is also called. I suspect this will run into a > similar issue. -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[jira] [Commented] (HIVE-18695) fix TestAccumuloCliDriver.testCliDriver[accumulo_queries]
[
https://issues.apache.org/jira/browse/HIVE-18695?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16377819#comment-16377819
]
Hive QA commented on HIVE-18695:
Here are the results of testing the latest attachment:
https://issues.apache.org/jira/secure/attachment/12912123/HIVE-18695.01.patch
{color:green}SUCCESS:{color} +1 due to 1 test(s) being added or modified.
{color:red}ERROR:{color} -1 due to 31 failed/errored test(s), 13414 tests
executed
*Failed tests:*
{noformat}
TestNegativeCliDriver - did not produce a TEST-*.xml file (likely timed out)
(batchId=94)
[jira] [Updated] (HIVE-18789) Disallow embedded element in UDFXPathUtil
[ https://issues.apache.org/jira/browse/HIVE-18789?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Dai updated HIVE-18789: -- Resolution: Fixed Hadoop Flags: Reviewed Fix Version/s: 3.0.0 Status: Resolved (was: Patch Available) Test failures are not related. Patch pushed to master. > Disallow embedded element in UDFXPathUtil > - > > Key: HIVE-18789 > URL: https://issues.apache.org/jira/browse/HIVE-18789 > Project: Hive > Issue Type: Bug >Reporter: Daniel Dai >Assignee: Daniel Dai >Priority: Major > Fix For: 3.0.0 > > Attachments: HIVE-18789.1.patch, HIVE-18789.2.patch > > -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[jira] [Updated] (HIVE-18794) Repl load "with" clause does not pass config to tasks for non-partition tables
[ https://issues.apache.org/jira/browse/HIVE-18794?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Dai updated HIVE-18794: -- Resolution: Fixed Hadoop Flags: Reviewed Fix Version/s: 3.0.0 Status: Resolved (was: Patch Available) Test failures are not related. Patch pushed to master. > Repl load "with" clause does not pass config to tasks for non-partition tables > -- > > Key: HIVE-18794 > URL: https://issues.apache.org/jira/browse/HIVE-18794 > Project: Hive > Issue Type: Bug >Reporter: Daniel Dai >Assignee: Daniel Dai >Priority: Major > Fix For: 3.0.0 > > Attachments: HIVE-18794.1.patch > > > Miss one scenario in HIVE-18626. -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[jira] [Comment Edited] (HIVE-18794) Repl load "with" clause does not pass config to tasks for non-partition tables
[ https://issues.apache.org/jira/browse/HIVE-18794?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16377787#comment-16377787 ] Thejas M Nair edited comment on HIVE-18794 at 2/26/18 11:34 PM: +1 (pending test verification) was (Author: thejas): +1 > Repl load "with" clause does not pass config to tasks for non-partition tables > -- > > Key: HIVE-18794 > URL: https://issues.apache.org/jira/browse/HIVE-18794 > Project: Hive > Issue Type: Bug >Reporter: Daniel Dai >Assignee: Daniel Dai >Priority: Major > Attachments: HIVE-18794.1.patch > > > Miss one scenario in HIVE-18626. -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[jira] [Commented] (HIVE-18794) Repl load "with" clause does not pass config to tasks for non-partition tables
[ https://issues.apache.org/jira/browse/HIVE-18794?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16377787#comment-16377787 ] Thejas M Nair commented on HIVE-18794: -- +1 > Repl load "with" clause does not pass config to tasks for non-partition tables > -- > > Key: HIVE-18794 > URL: https://issues.apache.org/jira/browse/HIVE-18794 > Project: Hive > Issue Type: Bug >Reporter: Daniel Dai >Assignee: Daniel Dai >Priority: Major > Attachments: HIVE-18794.1.patch > > > Miss one scenario in HIVE-18626. -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[jira] [Commented] (HIVE-18778) Needs to capture input/output entities in explain
[ https://issues.apache.org/jira/browse/HIVE-18778?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=1633#comment-1633 ] Daniel Dai commented on HIVE-18778: --- Here is the UT result: [https://builds.apache.org/job/PreCommit-HIVE-Build/9357/] Need to update quite a few golden files. > Needs to capture input/output entities in explain > - > > Key: HIVE-18778 > URL: https://issues.apache.org/jira/browse/HIVE-18778 > Project: Hive > Issue Type: Bug >Reporter: Daniel Dai >Assignee: Daniel Dai >Priority: Major > Attachments: HIVE-18778.1.patch, HIVE-18778.2.patch > > -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[jira] [Updated] (HIVE-18807) Fix broken tests caused by HIVE-18493
[ https://issues.apache.org/jira/browse/HIVE-18807?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Matt McCline updated HIVE-18807: Summary: Fix broken tests caused by HIVE-18493 (was: Fix broken test caused by HIVE-18493) > Fix broken tests caused by HIVE-18493 > - > > Key: HIVE-18807 > URL: https://issues.apache.org/jira/browse/HIVE-18807 > Project: Hive > Issue Type: Bug > Components: Hive >Affects Versions: 3.0.0 >Reporter: Matt McCline >Assignee: Matt McCline >Priority: Major > > Broken tests = > org.apache.hive.beeline.cli.TestHiveCli.testNoErrorDB > org.apache.hive.beeline.TestBeeLineWithArgs.testQueryProgress > org.apache.hive.beeline.TestBeeLineWithArgs.testQueryProgressParallel -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[jira] [Updated] (HIVE-18807) Fix broken test caused by HIVE-18493
[ https://issues.apache.org/jira/browse/HIVE-18807?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Matt McCline updated HIVE-18807: Description: Broken tests = org.apache.hive.beeline.cli.TestHiveCli.testNoErrorDB org.apache.hive.beeline.TestBeeLineWithArgs.testQueryProgress org.apache.hive.beeline.TestBeeLineWithArgs.testQueryProgressParallel was:Broken test = org.apache.hive.beeline.cli.TestHiveCli.testNoErrorDB > Fix broken test caused by HIVE-18493 > > > Key: HIVE-18807 > URL: https://issues.apache.org/jira/browse/HIVE-18807 > Project: Hive > Issue Type: Bug > Components: Hive >Affects Versions: 3.0.0 >Reporter: Matt McCline >Assignee: Matt McCline >Priority: Major > > Broken tests = > org.apache.hive.beeline.cli.TestHiveCli.testNoErrorDB > org.apache.hive.beeline.TestBeeLineWithArgs.testQueryProgress > org.apache.hive.beeline.TestBeeLineWithArgs.testQueryProgressParallel -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[jira] [Commented] (HIVE-18806) Add @Ignore for broken test caused by HIVE-18493
[ https://issues.apache.org/jira/browse/HIVE-18806?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16377768#comment-16377768 ] Deepak Jaiswal commented on HIVE-18806: --- [~mmccline] can you please update https://issues.apache.org/jira/browse/HIVE-18807 as you include more tests in disabled list? > Add @Ignore for broken test caused by HIVE-18493 > > > Key: HIVE-18806 > URL: https://issues.apache.org/jira/browse/HIVE-18806 > Project: Hive > Issue Type: Bug > Components: Hive >Affects Versions: 3.0.0 >Reporter: Matt McCline >Assignee: Matt McCline >Priority: Major > Attachments: HIVE-18806.01.patch, HIVE-18806.02.patch > > > HIVE-18807 is the follow on fix JIRA. > Broken test = org.apache.hive.beeline.cli.TestHiveCli.testNoErrorDB -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[jira] [Commented] (HIVE-18777) Add Authorization interface to support information_schema integration with external authorization
[ https://issues.apache.org/jira/browse/HIVE-18777?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16377766#comment-16377766 ] Daniel Dai commented on HIVE-18777: --- The comment of AbstractHiveAuthorizer.getHivePolicyProvider should refer to HiveAuthorizer.getHivePolicyProvider not HiveAuthorizer.createHivePolicyProvider, right? > Add Authorization interface to support information_schema integration with > external authorization > - > > Key: HIVE-18777 > URL: https://issues.apache.org/jira/browse/HIVE-18777 > Project: Hive > Issue Type: Bug >Reporter: Thejas M Nair >Assignee: Thejas M Nair >Priority: Major > Labels: pull-request-available > Attachments: HIVE-18777.1.patch > > > HIVE-1010 added support for information_schema. However, the authorization > information is not integrated when another project such as Ranger is used to > do the authorization. > We need to add API which Ranger/Sentry can implement, so that it is possible > to retrieve authorization policy information from them. > The existing API only supports checking if user has a permission on an object > and can't be used to retrieve policy details. -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[jira] [Updated] (HIVE-18806) Add @Ignore for broken test caused by HIVE-18493
[ https://issues.apache.org/jira/browse/HIVE-18806?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Matt McCline updated HIVE-18806: Status: Patch Available (was: In Progress) > Add @Ignore for broken test caused by HIVE-18493 > > > Key: HIVE-18806 > URL: https://issues.apache.org/jira/browse/HIVE-18806 > Project: Hive > Issue Type: Bug > Components: Hive >Affects Versions: 3.0.0 >Reporter: Matt McCline >Assignee: Matt McCline >Priority: Major > Attachments: HIVE-18806.01.patch, HIVE-18806.02.patch > > > HIVE-18807 is the follow on fix JIRA. > Broken test = org.apache.hive.beeline.cli.TestHiveCli.testNoErrorDB -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[jira] [Updated] (HIVE-18806) Add @Ignore for broken test caused by HIVE-18493
[ https://issues.apache.org/jira/browse/HIVE-18806?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Matt McCline updated HIVE-18806: Attachment: HIVE-18806.02.patch > Add @Ignore for broken test caused by HIVE-18493 > > > Key: HIVE-18806 > URL: https://issues.apache.org/jira/browse/HIVE-18806 > Project: Hive > Issue Type: Bug > Components: Hive >Affects Versions: 3.0.0 >Reporter: Matt McCline >Assignee: Matt McCline >Priority: Major > Attachments: HIVE-18806.01.patch, HIVE-18806.02.patch > > > HIVE-18807 is the follow on fix JIRA. > Broken test = org.apache.hive.beeline.cli.TestHiveCli.testNoErrorDB -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[jira] [Updated] (HIVE-18806) Add @Ignore for broken test caused by HIVE-18493
[ https://issues.apache.org/jira/browse/HIVE-18806?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Matt McCline updated HIVE-18806: Status: In Progress (was: Patch Available) > Add @Ignore for broken test caused by HIVE-18493 > > > Key: HIVE-18806 > URL: https://issues.apache.org/jira/browse/HIVE-18806 > Project: Hive > Issue Type: Bug > Components: Hive >Affects Versions: 3.0.0 >Reporter: Matt McCline >Assignee: Matt McCline >Priority: Major > Attachments: HIVE-18806.01.patch, HIVE-18806.02.patch > > > HIVE-18807 is the follow on fix JIRA. > Broken test = org.apache.hive.beeline.cli.TestHiveCli.testNoErrorDB -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[jira] [Commented] (HIVE-18695) fix TestAccumuloCliDriver.testCliDriver[accumulo_queries]
[
https://issues.apache.org/jira/browse/HIVE-18695?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16377757#comment-16377757
]
Hive QA commented on HIVE-18695:
| (x) *{color:red}-1 overall{color}* |
\\
\\
|| Vote || Subsystem || Runtime || Comment ||
|| || || || {color:brown} Prechecks {color} ||
| {color:green}+1{color} | {color:green} @author {color} | {color:green} 0m
0s{color} | {color:green} The patch does not contain any @author tags. {color} |
|| || || || {color:brown} master Compile Tests {color} ||
|| || || || {color:brown} Patch Compile Tests {color} ||
| {color:green}+1{color} | {color:green} whitespace {color} | {color:green} 0m
1s{color} | {color:green} The patch has no whitespace issues. {color} |
|| || || || {color:brown} Other Tests {color} ||
| {color:red}-1{color} | {color:red} asflicense {color} | {color:red} 0m
36s{color} | {color:red} The patch generated 49 ASF License warnings. {color} |
| {color:black}{color} | {color:black} {color} | {color:black} 1m 12s{color} |
{color:black} {color} |
\\
\\
|| Subsystem || Report/Notes ||
| Optional Tests | asflicense |
| uname | Linux hiveptest-server-upstream 3.16.0-4-amd64 #1 SMP Debian
3.16.36-1+deb8u1 (2016-09-03) x86_64 GNU/Linux |
| Build tool | maven |
| Personality |
/data/hiveptest/working/yetus_PreCommit-HIVE-Build-9375/dev-support/hive-personality.sh
|
| git revision | master / 99b2f3c |
| asflicense |
http://104.198.109.242/logs//PreCommit-HIVE-Build-9375/yetus/patch-asflicense-problems.txt
|
| modules | C: accumulo-handler U: accumulo-handler |
| Console output |
http://104.198.109.242/logs//PreCommit-HIVE-Build-9375/yetus.txt |
| Powered by | Apache Yetushttp://yetus.apache.org |
This message was automatically generated.
> fix TestAccumuloCliDriver.testCliDriver[accumulo_queries]
> -
>
> Key: HIVE-18695
> URL: https://issues.apache.org/jira/browse/HIVE-18695
> Project: Hive
> Issue Type: Bug
>Reporter: Zoltan Haindrich
>Priority: Major
> Attachments: HIVE-18695.01.patch
>
>
> seems to be broken by HIVE-15680
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
[jira] [Updated] (HIVE-18158) Remove OrcRawRecordMerger.ReaderPairAcid.statementId
[ https://issues.apache.org/jira/browse/HIVE-18158?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eugene Koifman updated HIVE-18158: -- Attachment: HIVE-18158.03.patch > Remove OrcRawRecordMerger.ReaderPairAcid.statementId > > > Key: HIVE-18158 > URL: https://issues.apache.org/jira/browse/HIVE-18158 > Project: Hive > Issue Type: Improvement > Components: Transactions >Affects Versions: 3.0.0 >Reporter: Eugene Koifman >Assignee: Eugene Koifman >Priority: Minor > Attachments: HIVE-18158.01.patch, HIVE-18158.02.patch, > HIVE-18158.03.patch > > > * Need to get rid of this since we can always get this from the row > itself in Acid 2.0. > * For Acid 1.0, statementId == 0 in all deltas because both > multi-statement txns and > * Split Upate are only available in test mode so there is nothing can > create a > * deltas_x_x_M with M > 0. -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[jira] [Updated] (HIVE-18796) fix TestSSL
[ https://issues.apache.org/jira/browse/HIVE-18796?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sergey Shelukhin updated HIVE-18796: Attachment: HIVE-18796.patch > fix TestSSL > --- > > Key: HIVE-18796 > URL: https://issues.apache.org/jira/browse/HIVE-18796 > Project: Hive > Issue Type: Bug > Components: Test >Reporter: Zoltan Haindrich >Assignee: Sergey Shelukhin >Priority: Major > Attachments: HIVE-18796.patch > > > broken by HIVE-18203 -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[jira] [Updated] (HIVE-18796) fix TestSSL
[ https://issues.apache.org/jira/browse/HIVE-18796?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sergey Shelukhin updated HIVE-18796: Status: Patch Available (was: Open) The patch > fix TestSSL > --- > > Key: HIVE-18796 > URL: https://issues.apache.org/jira/browse/HIVE-18796 > Project: Hive > Issue Type: Bug > Components: Test >Reporter: Zoltan Haindrich >Assignee: Sergey Shelukhin >Priority: Major > Attachments: HIVE-18796.patch > > > broken by HIVE-18203 -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[jira] [Commented] (HIVE-18806) Add @Ignore for broken test caused by HIVE-18493
[
https://issues.apache.org/jira/browse/HIVE-18806?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16377740#comment-16377740
]
Hive QA commented on HIVE-18806:
Here are the results of testing the latest attachment:
https://issues.apache.org/jira/secure/attachment/12912106/HIVE-18806.01.patch
{color:green}SUCCESS:{color} +1 due to 1 test(s) being added or modified.
{color:red}ERROR:{color} -1 due to 38 failed/errored test(s), 13017 tests
executed
*Failed tests:*
{noformat}
TestNegativeCliDriver - did not produce a TEST-*.xml file (likely timed out)
(batchId=93)
[jira] [Updated] (HIVE-18808) Make compaction more robust when stats update fails
[ https://issues.apache.org/jira/browse/HIVE-18808?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eugene Koifman updated HIVE-18808: -- Status: Patch Available (was: Open) > Make compaction more robust when stats update fails > --- > > Key: HIVE-18808 > URL: https://issues.apache.org/jira/browse/HIVE-18808 > Project: Hive > Issue Type: Improvement > Components: Transactions >Affects Versions: 1.0.0 >Reporter: Eugene Koifman >Assignee: Eugene Koifman >Priority: Major > Attachments: HIVE-18808.01.patch > > > > Worker.gatherStats() runs a "analyze table..." command to update stats which > requires SessionState. SessionState objects are cached in ThreadLocal. If > for some reason Session init fails, it may still get attached to the thread > which then causes a subsequent request that uses the same tread to gather > stats fail because it has a bad session object. HIVE-15658 describes the > same issue in a different context. > There is currently no way to recycle a session from outside HMS. > Failure to gather stats should not kill a compaction job which then prevents > Cleaner from running. -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[jira] [Updated] (HIVE-18808) Make compaction more robust when stats update fails
[ https://issues.apache.org/jira/browse/HIVE-18808?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eugene Koifman updated HIVE-18808: -- Attachment: HIVE-18808.01.patch > Make compaction more robust when stats update fails > --- > > Key: HIVE-18808 > URL: https://issues.apache.org/jira/browse/HIVE-18808 > Project: Hive > Issue Type: Improvement > Components: Transactions >Affects Versions: 1.0.0 >Reporter: Eugene Koifman >Assignee: Eugene Koifman >Priority: Major > Attachments: HIVE-18808.01.patch > > > > Worker.gatherStats() runs a "analyze table..." command to update stats which > requires SessionState. SessionState objects are cached in ThreadLocal. If > for some reason Session init fails, it may still get attached to the thread > which then causes a subsequent request that uses the same tread to gather > stats fail because it has a bad session object. HIVE-15658 describes the > same issue in a different context. > There is currently no way to recycle a session from outside HMS. > Failure to gather stats should not kill a compaction job which then prevents > Cleaner from running. -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[jira] [Commented] (HIVE-18796) fix TestSSL
[
https://issues.apache.org/jira/browse/HIVE-18796?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16377720#comment-16377720
]
Sergey Shelukhin commented on HIVE-18796:
-
It looks like a test setup issue to me that the change exposed.
It tries to open connection to metastore that fails:
{noformat}
2018-02-25T16:05:43,903 INFO [main] metastore.HiveMetaStoreClient: Trying to
connect to metastore with URI thrift://localhost:59057
org.apache.thrift.transport.TTransportException:
javax.net.ssl.SSLHandshakeException: java.security.cert.CertificateException:
No name matching localhost found
at
org.apache.thrift.transport.TIOStreamTransport.flush(TIOStreamTransport.java:161)
~[libthrift-0.9.3.jar:0.9.3]
at org.apache.thrift.TServiceClient.sendBase(TServiceClient.java:73)
~[libthrift-0.9.3.jar:0.9.3]
at org.apache.thrift.TServiceClient.sendBase(TServiceClient.java:62)
~[libthrift-0.9.3.jar:0.9.3]
at
org.apache.hadoop.hive.metastore.api.ThriftHiveMetastore$Client.send_set_ugi(ThriftHiveMetastore.java:4591)
~[hive-standalone-metastore-3.0.0-SNAPSHOT.jar:3.0.0-SNAPSHOT]
{noformat}
Let me see if it's easy to fix... otherwise I might just add a bypass for the
test.
> fix TestSSL
> ---
>
> Key: HIVE-18796
> URL: https://issues.apache.org/jira/browse/HIVE-18796
> Project: Hive
> Issue Type: Bug
> Components: Test
>Reporter: Zoltan Haindrich
>Assignee: Sergey Shelukhin
>Priority: Major
>
> broken by HIVE-18203
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
[jira] [Assigned] (HIVE-18796) fix TestSSL
[ https://issues.apache.org/jira/browse/HIVE-18796?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sergey Shelukhin reassigned HIVE-18796: --- Assignee: Sergey Shelukhin > fix TestSSL > --- > > Key: HIVE-18796 > URL: https://issues.apache.org/jira/browse/HIVE-18796 > Project: Hive > Issue Type: Bug > Components: Test >Reporter: Zoltan Haindrich >Assignee: Sergey Shelukhin >Priority: Major > > broken by HIVE-18203 -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[jira] [Updated] (HIVE-18264) CachedStore: Store cached partitions/col stats within the table cache
[ https://issues.apache.org/jira/browse/HIVE-18264?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vaibhav Gumashta updated HIVE-18264: Attachment: HIVE-18264.4.patch > CachedStore: Store cached partitions/col stats within the table cache > --- > > Key: HIVE-18264 > URL: https://issues.apache.org/jira/browse/HIVE-18264 > Project: Hive > Issue Type: Bug >Reporter: Vaibhav Gumashta >Assignee: Vaibhav Gumashta >Priority: Major > Attachments: HIVE-18264.1.patch, HIVE-18264.2.patch, > HIVE-18264.3.patch, HIVE-18264.4.patch > > > Currently we have a separate cache for partitions and partition col stats > which results in some calls iterating through each of these for > retrieving/updating. We can get better performance by organizing > hierarchically. -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[jira] [Commented] (HIVE-18806) Add @Ignore for broken test caused by HIVE-18493
[
https://issues.apache.org/jira/browse/HIVE-18806?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16377627#comment-16377627
]
Hive QA commented on HIVE-18806:
| (x) *{color:red}-1 overall{color}* |
\\
\\
|| Vote || Subsystem || Runtime || Comment ||
|| || || || {color:brown} Prechecks {color} ||
| {color:blue}0{color} | {color:blue} findbugs {color} | {color:blue} 0m
0s{color} | {color:blue} Findbugs executables are not available. {color} |
| {color:green}+1{color} | {color:green} @author {color} | {color:green} 0m
0s{color} | {color:green} The patch does not contain any @author tags. {color} |
|| || || || {color:brown} master Compile Tests {color} ||
| {color:green}+1{color} | {color:green} mvninstall {color} | {color:green} 6m
48s{color} | {color:green} master passed {color} |
| {color:green}+1{color} | {color:green} compile {color} | {color:green} 0m
18s{color} | {color:green} master passed {color} |
| {color:green}+1{color} | {color:green} checkstyle {color} | {color:green} 0m
11s{color} | {color:green} master passed {color} |
| {color:green}+1{color} | {color:green} javadoc {color} | {color:green} 0m
10s{color} | {color:green} master passed {color} |
|| || || || {color:brown} Patch Compile Tests {color} ||
| {color:green}+1{color} | {color:green} mvninstall {color} | {color:green} 0m
18s{color} | {color:green} the patch passed {color} |
| {color:green}+1{color} | {color:green} compile {color} | {color:green} 0m
17s{color} | {color:green} the patch passed {color} |
| {color:green}+1{color} | {color:green} javac {color} | {color:green} 0m
17s{color} | {color:green} the patch passed {color} |
| {color:green}+1{color} | {color:green} checkstyle {color} | {color:green} 0m
10s{color} | {color:green} the patch passed {color} |
| {color:green}+1{color} | {color:green} whitespace {color} | {color:green} 0m
0s{color} | {color:green} The patch has no whitespace issues. {color} |
| {color:green}+1{color} | {color:green} javadoc {color} | {color:green} 0m
11s{color} | {color:green} the patch passed {color} |
|| || || || {color:brown} Other Tests {color} ||
| {color:red}-1{color} | {color:red} asflicense {color} | {color:red} 0m
11s{color} | {color:red} The patch generated 49 ASF License warnings. {color} |
| {color:black}{color} | {color:black} {color} | {color:black} 8m 50s{color} |
{color:black} {color} |
\\
\\
|| Subsystem || Report/Notes ||
| Optional Tests | asflicense javac javadoc findbugs checkstyle compile |
| uname | Linux hiveptest-server-upstream 3.16.0-4-amd64 #1 SMP Debian
3.16.36-1+deb8u1 (2016-09-03) x86_64 GNU/Linux |
| Build tool | maven |
| Personality |
/data/hiveptest/working/yetus_PreCommit-HIVE-Build-9374/dev-support/hive-personality.sh
|
| git revision | master / 99b2f3c |
| Default Java | 1.8.0_111 |
| asflicense |
http://104.198.109.242/logs//PreCommit-HIVE-Build-9374/yetus/patch-asflicense-problems.txt
|
| modules | C: beeline U: beeline |
| Console output |
http://104.198.109.242/logs//PreCommit-HIVE-Build-9374/yetus.txt |
| Powered by | Apache Yetushttp://yetus.apache.org |
This message was automatically generated.
> Add @Ignore for broken test caused by HIVE-18493
>
>
> Key: HIVE-18806
> URL: https://issues.apache.org/jira/browse/HIVE-18806
> Project: Hive
> Issue Type: Bug
> Components: Hive
>Affects Versions: 3.0.0
>Reporter: Matt McCline
>Assignee: Matt McCline
>Priority: Major
> Attachments: HIVE-18806.01.patch
>
>
> HIVE-18807 is the follow on fix JIRA.
> Broken test = org.apache.hive.beeline.cli.TestHiveCli.testNoErrorDB
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
[jira] [Assigned] (HIVE-18809) Fix dynpart_hashjoin tests
[ https://issues.apache.org/jira/browse/HIVE-18809?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jason Dere reassigned HIVE-18809: - > Fix dynpart_hashjoin tests > -- > > Key: HIVE-18809 > URL: https://issues.apache.org/jira/browse/HIVE-18809 > Project: Hive > Issue Type: Bug > Components: Tests >Reporter: Jason Dere >Assignee: Jason Dere >Priority: Major > > [~djaiswal] pointed out that tez_dynpart_hashjoin_2.q is not actually > producing query plans with dynamically partitioned hash joins in the golden > files. This test (and perhaps others) may need to be fixed. -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[jira] [Commented] (HIVE-17478) Move filesystem stats collection from metastore to ql
[
https://issues.apache.org/jira/browse/HIVE-17478?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16377606#comment-16377606
]
Hive QA commented on HIVE-17478:
Here are the results of testing the latest attachment:
https://issues.apache.org/jira/secure/attachment/12912080/HIVE-17478.01wip01.patch
{color:red}ERROR:{color} -1 due to no test(s) being added or modified.
{color:red}ERROR:{color} -1 due to 82 failed/errored test(s), 13018 tests
executed
*Failed tests:*
{noformat}
TestNegativeCliDriver - did not produce a TEST-*.xml file (likely timed out)
(batchId=93)
[jira] [Commented] (HIVE-18806) Add @Ignore for broken test caused by HIVE-18493
[ https://issues.apache.org/jira/browse/HIVE-18806?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16377604#comment-16377604 ] Deepak Jaiswal commented on HIVE-18806: --- +1 pending tests. > Add @Ignore for broken test caused by HIVE-18493 > > > Key: HIVE-18806 > URL: https://issues.apache.org/jira/browse/HIVE-18806 > Project: Hive > Issue Type: Bug > Components: Hive >Affects Versions: 3.0.0 >Reporter: Matt McCline >Assignee: Matt McCline >Priority: Major > Attachments: HIVE-18806.01.patch > > > HIVE-18807 is the follow on fix JIRA. > Broken test = org.apache.hive.beeline.cli.TestHiveCli.testNoErrorDB -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[jira] [Updated] (HIVE-18715) Remove index support from metastore
[ https://issues.apache.org/jira/browse/HIVE-18715?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zoltan Haindrich updated HIVE-18715: Attachment: HIVE-18715.01.patch > Remove index support from metastore > --- > > Key: HIVE-18715 > URL: https://issues.apache.org/jira/browse/HIVE-18715 > Project: Hive > Issue Type: Sub-task > Components: Metastore, Standalone Metastore >Reporter: Zoltan Haindrich >Assignee: Zoltan Haindrich >Priority: Major > Attachments: HIVE-18715.01.patch > > > Hive will not use this feature anymore; so if there are no other uses of it > we might remove it from the metastore as well. -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[jira] [Assigned] (HIVE-18715) Remove index support from metastore
[ https://issues.apache.org/jira/browse/HIVE-18715?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zoltan Haindrich reassigned HIVE-18715: --- Assignee: Zoltan Haindrich > Remove index support from metastore > --- > > Key: HIVE-18715 > URL: https://issues.apache.org/jira/browse/HIVE-18715 > Project: Hive > Issue Type: Sub-task > Components: Metastore, Standalone Metastore >Reporter: Zoltan Haindrich >Assignee: Zoltan Haindrich >Priority: Major > Attachments: HIVE-18715.01.patch > > > Hive will not use this feature anymore; so if there are no other uses of it > we might remove it from the metastore as well. -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[jira] [Updated] (HIVE-18715) Remove index support from metastore
[ https://issues.apache.org/jira/browse/HIVE-18715?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zoltan Haindrich updated HIVE-18715: Status: Patch Available (was: Open) > Remove index support from metastore > --- > > Key: HIVE-18715 > URL: https://issues.apache.org/jira/browse/HIVE-18715 > Project: Hive > Issue Type: Sub-task > Components: Metastore, Standalone Metastore >Reporter: Zoltan Haindrich >Assignee: Zoltan Haindrich >Priority: Major > Attachments: HIVE-18715.01.patch > > > Hive will not use this feature anymore; so if there are no other uses of it > we might remove it from the metastore as well. -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[jira] [Updated] (HIVE-18695) fix TestAccumuloCliDriver.testCliDriver[accumulo_queries]
[ https://issues.apache.org/jira/browse/HIVE-18695?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zoltan Haindrich updated HIVE-18695: Status: Patch Available (was: Open) > fix TestAccumuloCliDriver.testCliDriver[accumulo_queries] > - > > Key: HIVE-18695 > URL: https://issues.apache.org/jira/browse/HIVE-18695 > Project: Hive > Issue Type: Bug >Reporter: Zoltan Haindrich >Priority: Major > Attachments: HIVE-18695.01.patch > > > seems to be broken by HIVE-15680 -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[jira] [Commented] (HIVE-18695) fix TestAccumuloCliDriver.testCliDriver[accumulo_queries]
[ https://issues.apache.org/jira/browse/HIVE-18695?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16377596#comment-16377596 ] Zoltan Haindrich commented on HIVE-18695: - I've attached a patch which disables ppd in that test > fix TestAccumuloCliDriver.testCliDriver[accumulo_queries] > - > > Key: HIVE-18695 > URL: https://issues.apache.org/jira/browse/HIVE-18695 > Project: Hive > Issue Type: Bug >Reporter: Zoltan Haindrich >Priority: Major > Attachments: HIVE-18695.01.patch > > > seems to be broken by HIVE-15680 -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[jira] [Updated] (HIVE-18695) fix TestAccumuloCliDriver.testCliDriver[accumulo_queries]
[ https://issues.apache.org/jira/browse/HIVE-18695?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zoltan Haindrich updated HIVE-18695: Attachment: HIVE-18695.01.patch > fix TestAccumuloCliDriver.testCliDriver[accumulo_queries] > - > > Key: HIVE-18695 > URL: https://issues.apache.org/jira/browse/HIVE-18695 > Project: Hive > Issue Type: Bug >Reporter: Zoltan Haindrich >Priority: Major > Attachments: HIVE-18695.01.patch > > > seems to be broken by HIVE-15680 -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[jira] [Commented] (HIVE-18695) fix TestAccumuloCliDriver.testCliDriver[accumulo_queries]
[
https://issues.apache.org/jira/browse/HIVE-18695?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16377592#comment-16377592
]
Zoltan Haindrich commented on HIVE-18695:
-
I've tried the magic ppd disabling combo of
{code}
set hive.optimize.index.filter=false;
set hive.optimize.ppd=false;
{code}
and it also caused a result difference ; but it seems like it just fixed an
existing incorrect result already present in the golden file (12 may not be in
that resultset)...
https://github.com/apache/hive/blob/99b2f3c7b890fd68dab6ca315988a77ade435984/accumulo-handler/src/test/results/positive/accumulo_queries.q.out#L386
> fix TestAccumuloCliDriver.testCliDriver[accumulo_queries]
> -
>
> Key: HIVE-18695
> URL: https://issues.apache.org/jira/browse/HIVE-18695
> Project: Hive
> Issue Type: Bug
>Reporter: Zoltan Haindrich
>Priority: Major
> Attachments: HIVE-18695.01.patch
>
>
> seems to be broken by HIVE-15680
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
[jira] [Commented] (HIVE-18447) JDBC: Provide a way for JDBC users to pass cookie info via connection string
[
https://issues.apache.org/jira/browse/HIVE-18447?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16377578#comment-16377578
]
Thejas M Nair commented on HIVE-18447:
--
Adding fix version (3.0.0).
Thanks for the catch [~leftylev]!
> JDBC: Provide a way for JDBC users to pass cookie info via connection string
>
>
> Key: HIVE-18447
> URL: https://issues.apache.org/jira/browse/HIVE-18447
> Project: Hive
> Issue Type: Bug
> Components: JDBC
>Reporter: Vaibhav Gumashta
>Assignee: Vaibhav Gumashta
>Priority: Major
> Fix For: 3.0.0
>
> Attachments: HIVE-18447.1.patch, HIVE-18447.2.patch
>
>
> Some authentication mechanisms like Single Sign On, need the ability to pass
> a cookie to some intermediate authentication service like Knox via the JDBC
> driver. We need to add the mechanism in Hive's JDBC driver (when used in HTTP
> transport mode).
> Cookies can now be passed like:
> {code}
> jdbc:hive2://:/;transportMode=http;httpPath=;http.cookie.=;http.cookie.=
> {code}
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
[jira] [Assigned] (HIVE-18808) Make compaction more robust when stats update fails
[ https://issues.apache.org/jira/browse/HIVE-18808?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eugene Koifman reassigned HIVE-18808: - > Make compaction more robust when stats update fails > --- > > Key: HIVE-18808 > URL: https://issues.apache.org/jira/browse/HIVE-18808 > Project: Hive > Issue Type: Improvement > Components: Transactions >Affects Versions: 1.0.0 >Reporter: Eugene Koifman >Assignee: Eugene Koifman >Priority: Major > > > Worker.gatherStats() runs a "analyze table..." command to update stats which > requires SessionState. SessionState objects are cached in ThreadLocal. If > for some reason Session init fails, it may still get attached to the thread > which then causes a subsequent request that uses the same tread to gather > stats fail because it has a bad session object. HIVE-15658 describes the > same issue in a different context. > There is currently no way to recycle a session from outside HMS. > Failure to gather stats should not kill a compaction job which then prevents > Cleaner from running. -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[jira] [Updated] (HIVE-18447) JDBC: Provide a way for JDBC users to pass cookie info via connection string
[
https://issues.apache.org/jira/browse/HIVE-18447?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Thejas M Nair updated HIVE-18447:
-
Fix Version/s: 3.0.0
> JDBC: Provide a way for JDBC users to pass cookie info via connection string
>
>
> Key: HIVE-18447
> URL: https://issues.apache.org/jira/browse/HIVE-18447
> Project: Hive
> Issue Type: Bug
> Components: JDBC
>Reporter: Vaibhav Gumashta
>Assignee: Vaibhav Gumashta
>Priority: Major
> Fix For: 3.0.0
>
> Attachments: HIVE-18447.1.patch, HIVE-18447.2.patch
>
>
> Some authentication mechanisms like Single Sign On, need the ability to pass
> a cookie to some intermediate authentication service like Knox via the JDBC
> driver. We need to add the mechanism in Hive's JDBC driver (when used in HTTP
> transport mode).
> Cookies can now be passed like:
> {code}
> jdbc:hive2://:/;transportMode=http;httpPath=;http.cookie.=;http.cookie.=
> {code}
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
[jira] [Commented] (HIVE-17478) Move filesystem stats collection from metastore to ql
[
https://issues.apache.org/jira/browse/HIVE-17478?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16377546#comment-16377546
]
Hive QA commented on HIVE-17478:
| (x) *{color:red}-1 overall{color}* |
\\
\\
|| Vote || Subsystem || Runtime || Comment ||
|| || || || {color:brown} Prechecks {color} ||
| {color:blue}0{color} | {color:blue} findbugs {color} | {color:blue} 0m
1s{color} | {color:blue} Findbugs executables are not available. {color} |
| {color:green}+1{color} | {color:green} @author {color} | {color:green} 0m
0s{color} | {color:green} The patch does not contain any @author tags. {color} |
|| || || || {color:brown} master Compile Tests {color} ||
| {color:blue}0{color} | {color:blue} mvndep {color} | {color:blue} 0m
40s{color} | {color:blue} Maven dependency ordering for branch {color} |
| {color:green}+1{color} | {color:green} mvninstall {color} | {color:green} 6m
10s{color} | {color:green} master passed {color} |
| {color:green}+1{color} | {color:green} compile {color} | {color:green} 1m
33s{color} | {color:green} master passed {color} |
| {color:green}+1{color} | {color:green} checkstyle {color} | {color:green} 0m
57s{color} | {color:green} master passed {color} |
| {color:green}+1{color} | {color:green} javadoc {color} | {color:green} 1m
35s{color} | {color:green} master passed {color} |
|| || || || {color:brown} Patch Compile Tests {color} ||
| {color:blue}0{color} | {color:blue} mvndep {color} | {color:blue} 0m
8s{color} | {color:blue} Maven dependency ordering for patch {color} |
| {color:green}+1{color} | {color:green} mvninstall {color} | {color:green} 1m
57s{color} | {color:green} the patch passed {color} |
| {color:green}+1{color} | {color:green} compile {color} | {color:green} 1m
36s{color} | {color:green} the patch passed {color} |
| {color:green}+1{color} | {color:green} javac {color} | {color:green} 1m
36s{color} | {color:green} the patch passed {color} |
| {color:green}+1{color} | {color:green} checkstyle {color} | {color:green} 0m
38s{color} | {color:green} ql: The patch generated 0 new + 378 unchanged - 2
fixed = 378 total (was 380) {color} |
| {color:red}-1{color} | {color:red} checkstyle {color} | {color:red} 0m
20s{color} | {color:red} standalone-metastore: The patch generated 2 new + 554
unchanged - 26 fixed = 556 total (was 580) {color} |
| {color:green}+1{color} | {color:green} whitespace {color} | {color:green} 0m
0s{color} | {color:green} The patch has no whitespace issues. {color} |
| {color:green}+1{color} | {color:green} javadoc {color} | {color:green} 1m
35s{color} | {color:green} the patch passed {color} |
|| || || || {color:brown} Other Tests {color} ||
| {color:red}-1{color} | {color:red} asflicense {color} | {color:red} 0m
12s{color} | {color:red} The patch generated 49 ASF License warnings. {color} |
| {color:black}{color} | {color:black} {color} | {color:black} 17m 41s{color} |
{color:black} {color} |
\\
\\
|| Subsystem || Report/Notes ||
| Optional Tests | asflicense javac javadoc findbugs checkstyle compile |
| uname | Linux hiveptest-server-upstream 3.16.0-4-amd64 #1 SMP Debian
3.16.36-1+deb8u1 (2016-09-03) x86_64 GNU/Linux |
| Build tool | maven |
| Personality |
/data/hiveptest/working/yetus_PreCommit-HIVE-Build-9373/dev-support/hive-personality.sh
|
| git revision | master / 99b2f3c |
| Default Java | 1.8.0_111 |
| checkstyle |
http://104.198.109.242/logs//PreCommit-HIVE-Build-9373/yetus/diff-checkstyle-standalone-metastore.txt
|
| asflicense |
http://104.198.109.242/logs//PreCommit-HIVE-Build-9373/yetus/patch-asflicense-problems.txt
|
| modules | C: ql standalone-metastore U: . |
| Console output |
http://104.198.109.242/logs//PreCommit-HIVE-Build-9373/yetus.txt |
| Powered by | Apache Yetushttp://yetus.apache.org |
This message was automatically generated.
> Move filesystem stats collection from metastore to ql
> -
>
> Key: HIVE-17478
> URL: https://issues.apache.org/jira/browse/HIVE-17478
> Project: Hive
> Issue Type: Sub-task
> Components: Metastore
>Reporter: Zoltan Haindrich
>Assignee: Zoltan Haindrich
>Priority: Major
> Attachments: HIVE-17478.01wip01.patch
>
>
> filesystem level stats are collected automatically at metastore server
> side...however computing these stats earlier during planning or query
> execution may enable to launch stat collection on a newly added partition
> only if needed.
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
[jira] [Commented] (HIVE-18759) Remove unconnected q.out-s
[ https://issues.apache.org/jira/browse/HIVE-18759?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16377519#comment-16377519 ] Ashutosh Chauhan commented on HIVE-18759: - +1 > Remove unconnected q.out-s > -- > > Key: HIVE-18759 > URL: https://issues.apache.org/jira/browse/HIVE-18759 > Project: Hive > Issue Type: Bug > Components: Tests >Reporter: Zoltan Haindrich >Assignee: Zoltan Haindrich >Priority: Major > Attachments: HIVE-18759.01.patch > > > org.apache.hadoop.hive.cli.control.TestDanglingQOuts -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[jira] [Updated] (HIVE-18327) Remove the unnecessary HiveConf dependency for MiniHiveKdc
[ https://issues.apache.org/jira/browse/HIVE-18327?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ashutosh Chauhan updated HIVE-18327: Resolution: Fixed Fix Version/s: 3.0.0 Status: Resolved (was: Patch Available) Pushed to master. Thanks, Daniel! > Remove the unnecessary HiveConf dependency for MiniHiveKdc > -- > > Key: HIVE-18327 > URL: https://issues.apache.org/jira/browse/HIVE-18327 > Project: Hive > Issue Type: Test > Components: Test >Affects Versions: 3.0.0 >Reporter: Aihua Xu >Assignee: Daniel Voros >Priority: Major > Fix For: 3.0.0 > > Attachments: HIVE-18327.1.patch, HIVE-18327.2.patch > > > MiniHiveKdc takes HiveConf as input parameter while it's not needed. Remove > the unnecessary HiveConf. -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[jira] [Commented] (HIVE-18805) Add ConstantPropagate before stats annotation
[ https://issues.apache.org/jira/browse/HIVE-18805?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16377514#comment-16377514 ] Ashutosh Chauhan commented on HIVE-18805: - +1 > Add ConstantPropagate before stats annotation > - > > Key: HIVE-18805 > URL: https://issues.apache.org/jira/browse/HIVE-18805 > Project: Hive > Issue Type: Sub-task > Components: Query Planning >Reporter: Zoltan Haindrich >Assignee: Zoltan Haindrich >Priority: Major > Attachments: HIVE-18805.01.patch > > > this seems to also make a few more optimizations identify more cases -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[jira] [Commented] (HIVE-17626) Query reoptimization using cached runtime statistics
[
https://issues.apache.org/jira/browse/HIVE-17626?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16377513#comment-16377513
]
Hive QA commented on HIVE-17626:
Here are the results of testing the latest attachment:
https://issues.apache.org/jira/secure/attachment/12912079/HIVE-17626.02.patch
{color:green}SUCCESS:{color} +1 due to 8 test(s) being added or modified.
{color:red}ERROR:{color} -1 due to 80 failed/errored test(s), 13426 tests
executed
*Failed tests:*
{noformat}
TestNegativeCliDriver - did not produce a TEST-*.xml file (likely timed out)
(batchId=93)
[jira] [Commented] (HIVE-18695) fix TestAccumuloCliDriver.testCliDriver[accumulo_queries]
[
https://issues.apache.org/jira/browse/HIVE-18695?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16377497#comment-16377497
]
Josh Elser commented on HIVE-18695:
---
bq. From the comments above, it seems like a AccumuloStorageHandler bug where
it seems to depend on PPD having been done ( I haven't done a deeper
investigation, which would be necessary to confirm).
If memory serves me, yes, the storage handler is expecting that PPD (which I'm
reading as predicate pushdown, but am honestly not positive that's what the
acronym is ;)) happens. Accumulo has a server-side computation layer in which
we take some operands from the Hive query and can push them into Accumulo for
efficiency's sake. Nothing more than filters is happening now (e.g. {{key ==
1}} and {{key == 2}} in the above query), again, if memory serves. Is there
some new kind of API which the storage handlers can look at to figure out when
PPD is going to happen (or not)? That would have serious correctness issues if
not..
[~erwaman], I'm confused on the phrasing: does HIVE-18802 apply both before and
after HIVE-15680? I think you're saying that it was an existing problem, but it
would also fix the test failures that HIVE-15680 caused?
> fix TestAccumuloCliDriver.testCliDriver[accumulo_queries]
> -
>
> Key: HIVE-18695
> URL: https://issues.apache.org/jira/browse/HIVE-18695
> Project: Hive
> Issue Type: Bug
>Reporter: Zoltan Haindrich
>Priority: Major
>
> seems to be broken by HIVE-15680
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
[jira] [Commented] (HIVE-18695) fix TestAccumuloCliDriver.testCliDriver[accumulo_queries]
[ https://issues.apache.org/jira/browse/HIVE-18695?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16377487#comment-16377487 ] Thejas M Nair commented on HIVE-18695: -- Reverting HIVE-15680 can cause correctness issues with PPD + MR. [~erwaman] Is this caused by underlying bug in PPD or AccumuloStorageHandler or elsewhere ? >From the comments above, it seems like a AccumuloStorageHandler bug where it >seems to depend on PPD having been done ( I haven't done a deeper >investigation, which would be necessary to confirm). I think we should disable TestAccumuloCliDriver.testCliDriver[accumulo_queries] and track the issue via HIVE-18802 cc [~elserj] > fix TestAccumuloCliDriver.testCliDriver[accumulo_queries] > - > > Key: HIVE-18695 > URL: https://issues.apache.org/jira/browse/HIVE-18695 > Project: Hive > Issue Type: Bug >Reporter: Zoltan Haindrich >Priority: Major > > seems to be broken by HIVE-15680 -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[jira] [Updated] (HIVE-18806) Add @Ignore for broken test caused by HIVE-18493
[ https://issues.apache.org/jira/browse/HIVE-18806?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Matt McCline updated HIVE-18806: Status: Patch Available (was: Open) > Add @Ignore for broken test caused by HIVE-18493 > > > Key: HIVE-18806 > URL: https://issues.apache.org/jira/browse/HIVE-18806 > Project: Hive > Issue Type: Bug > Components: Hive >Affects Versions: 3.0.0 >Reporter: Matt McCline >Assignee: Matt McCline >Priority: Major > Attachments: HIVE-18806.01.patch > > > HIVE-18807 is the follow on fix JIRA. > Broken test = org.apache.hive.beeline.cli.TestHiveCli.testNoErrorDB -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[jira] [Updated] (HIVE-18806) Add @Ignore for broken test caused by HIVE-18493
[ https://issues.apache.org/jira/browse/HIVE-18806?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Matt McCline updated HIVE-18806: Attachment: HIVE-18806.01.patch > Add @Ignore for broken test caused by HIVE-18493 > > > Key: HIVE-18806 > URL: https://issues.apache.org/jira/browse/HIVE-18806 > Project: Hive > Issue Type: Bug > Components: Hive >Affects Versions: 3.0.0 >Reporter: Matt McCline >Assignee: Matt McCline >Priority: Major > Attachments: HIVE-18806.01.patch > > > HIVE-18807 is the follow on fix JIRA. > Broken test = org.apache.hive.beeline.cli.TestHiveCli.testNoErrorDB -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[jira] [Commented] (HIVE-17626) Query reoptimization using cached runtime statistics
[
https://issues.apache.org/jira/browse/HIVE-17626?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16377481#comment-16377481
]
Hive QA commented on HIVE-17626:
| (x) *{color:red}-1 overall{color}* |
\\
\\
|| Vote || Subsystem || Runtime || Comment ||
|| || || || {color:brown} Prechecks {color} ||
| {color:blue}0{color} | {color:blue} findbugs {color} | {color:blue} 0m
0s{color} | {color:blue} Findbugs executables are not available. {color} |
| {color:green}+1{color} | {color:green} @author {color} | {color:green} 0m
1s{color} | {color:green} The patch does not contain any @author tags. {color} |
|| || || || {color:brown} master Compile Tests {color} ||
| {color:blue}0{color} | {color:blue} mvndep {color} | {color:blue} 0m
31s{color} | {color:blue} Maven dependency ordering for branch {color} |
| {color:green}+1{color} | {color:green} mvninstall {color} | {color:green} 6m
10s{color} | {color:green} master passed {color} |
| {color:green}+1{color} | {color:green} compile {color} | {color:green} 6m
7s{color} | {color:green} master passed {color} |
| {color:green}+1{color} | {color:green} checkstyle {color} | {color:green} 3m
9s{color} | {color:green} master passed {color} |
| {color:green}+1{color} | {color:green} javadoc {color} | {color:green} 6m
11s{color} | {color:green} master passed {color} |
|| || || || {color:brown} Patch Compile Tests {color} ||
| {color:blue}0{color} | {color:blue} mvndep {color} | {color:blue} 0m
6s{color} | {color:blue} Maven dependency ordering for patch {color} |
| {color:green}+1{color} | {color:green} mvninstall {color} | {color:green} 7m
16s{color} | {color:green} the patch passed {color} |
| {color:green}+1{color} | {color:green} compile {color} | {color:green} 5m
57s{color} | {color:green} the patch passed {color} |
| {color:green}+1{color} | {color:green} javac {color} | {color:green} 5m
57s{color} | {color:green} the patch passed {color} |
| {color:red}-1{color} | {color:red} checkstyle {color} | {color:red} 0m
15s{color} | {color:red} common: The patch generated 1 new + 425 unchanged - 0
fixed = 426 total (was 425) {color} |
| {color:red}-1{color} | {color:red} checkstyle {color} | {color:red} 2m
4s{color} | {color:red} root: The patch generated 80 new + 1804 unchanged - 148
fixed = 1884 total (was 1952) {color} |
| {color:red}-1{color} | {color:red} checkstyle {color} | {color:red} 0m
45s{color} | {color:red} ql: The patch generated 79 new + 1280 unchanged - 148
fixed = 1359 total (was 1428) {color} |
| {color:red}-1{color} | {color:red} whitespace {color} | {color:red} 0m
0s{color} | {color:red} The patch has 1 line(s) that end in whitespace. Use git
apply --whitespace=fix <>. Refer https://git-scm.com/docs/git-apply
{color} |
| {color:green}+1{color} | {color:green} xml {color} | {color:green} 0m
1s{color} | {color:green} The patch has no ill-formed XML file. {color} |
| {color:green}+1{color} | {color:green} javadoc {color} | {color:green} 6m
27s{color} | {color:green} the patch passed {color} |
|| || || || {color:brown} Other Tests {color} ||
| {color:red}-1{color} | {color:red} asflicense {color} | {color:red} 0m
12s{color} | {color:red} The patch generated 49 ASF License warnings. {color} |
| {color:black}{color} | {color:black} {color} | {color:black} 46m 7s{color} |
{color:black} {color} |
\\
\\
|| Subsystem || Report/Notes ||
| Optional Tests | asflicense javac javadoc findbugs checkstyle compile
xml |
| uname | Linux hiveptest-server-upstream 3.16.0-4-amd64 #1 SMP Debian
3.16.36-1+deb8u1 (2016-09-03) x86_64 GNU/Linux |
| Build tool | maven |
| Personality |
/data/hiveptest/working/yetus_PreCommit-HIVE-Build-9372/dev-support/hive-personality.sh
|
| git revision | master / 8d2a23a |
| Default Java | 1.8.0_111 |
| checkstyle |
http://104.198.109.242/logs//PreCommit-HIVE-Build-9372/yetus/diff-checkstyle-common.txt
|
| checkstyle |
http://104.198.109.242/logs//PreCommit-HIVE-Build-9372/yetus/diff-checkstyle-root.txt
|
| checkstyle |
http://104.198.109.242/logs//PreCommit-HIVE-Build-9372/yetus/diff-checkstyle-ql.txt
|
| whitespace |
http://104.198.109.242/logs//PreCommit-HIVE-Build-9372/yetus/whitespace-eol.txt
|
| asflicense |
http://104.198.109.242/logs//PreCommit-HIVE-Build-9372/yetus/patch-asflicense-problems.txt
|
| modules | C: common . itests itests/util ql U: . |
| Console output |
http://104.198.109.242/logs//PreCommit-HIVE-Build-9372/yetus.txt |
| Powered by | Apache Yetushttp://yetus.apache.org |
This message was automatically generated.
> Query reoptimization using cached runtime statistics
>
>
> Key: HIVE-17626
> URL: https://issues.apache.org/jira/browse/HIVE-17626
> Project: Hive
> Issue Type: New Feature
> Components: Logical Optimizer
>Affects Versions: 3.0.0
>Reporter:
[jira] [Commented] (HIVE-16494) udaf percentile_approx() may fail on CBO
[ https://issues.apache.org/jira/browse/HIVE-16494?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16377449#comment-16377449 ] Ashutosh Chauhan commented on HIVE-16494: - Patch looks good. Can you check TestNegativeCliDriver to see if they are because of the patch? If so, it will be good to address them since instead of compile time they are failing at run time now. > udaf percentile_approx() may fail on CBO > > > Key: HIVE-16494 > URL: https://issues.apache.org/jira/browse/HIVE-16494 > Project: Hive > Issue Type: Bug > Components: CBO, Logical Optimizer, UDF >Reporter: Ashutosh Chauhan >Assignee: Miklos Gergely >Priority: Major > Attachments: HIVE-16494.patch > > > select percentile_approx(key, array(0.50, 0.70, 0.90, 0.95, 0.99)) from t; > fails with error : The second argument must be a constant. -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[jira] [Updated] (HIVE-18807) Fix broken test caused by HIVE-18493
[ https://issues.apache.org/jira/browse/HIVE-18807?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Matt McCline updated HIVE-18807: Description: Broken test = org.apache.hive.beeline.cli.TestHiveCli.testNoErrorDB > Fix broken test caused by HIVE-18493 > > > Key: HIVE-18807 > URL: https://issues.apache.org/jira/browse/HIVE-18807 > Project: Hive > Issue Type: Bug > Components: Hive >Affects Versions: 3.0.0 >Reporter: Matt McCline >Assignee: Matt McCline >Priority: Major > > Broken test = org.apache.hive.beeline.cli.TestHiveCli.testNoErrorDB -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[jira] [Updated] (HIVE-18806) Add @Ignore for broken test caused by HIVE-18493
[ https://issues.apache.org/jira/browse/HIVE-18806?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Matt McCline updated HIVE-18806: Description: HIVE-18807 is the follow on fix JIRA. Broken test = org.apache.hive.beeline.cli.TestHiveCli.testNoErrorDB was:HIVE-18807 is the follow on fix JIRA. > Add @Ignore for broken test caused by HIVE-18493 > > > Key: HIVE-18806 > URL: https://issues.apache.org/jira/browse/HIVE-18806 > Project: Hive > Issue Type: Bug > Components: Hive >Affects Versions: 3.0.0 >Reporter: Matt McCline >Assignee: Matt McCline >Priority: Major > > HIVE-18807 is the follow on fix JIRA. > Broken test = org.apache.hive.beeline.cli.TestHiveCli.testNoErrorDB -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[jira] [Updated] (HIVE-18806) Add @Ignore for broken test caused by HIVE-18493
[ https://issues.apache.org/jira/browse/HIVE-18806?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Matt McCline updated HIVE-18806: Description: HIVE-18807 is the follow on fix JIRA. > Add @Ignore for broken test caused by HIVE-18493 > > > Key: HIVE-18806 > URL: https://issues.apache.org/jira/browse/HIVE-18806 > Project: Hive > Issue Type: Bug > Components: Hive >Affects Versions: 3.0.0 >Reporter: Matt McCline >Assignee: Matt McCline >Priority: Major > > HIVE-18807 is the follow on fix JIRA. -- This message was sent by Atlassian JIRA (v7.6.3#76005)
