[jira] [Updated] (HIVE-22396) CMV creating a Full ACID partitioned table fails because of no writeId
[
https://issues.apache.org/jira/browse/HIVE-22396?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Ashutosh Chauhan updated HIVE-22396:
Fix Version/s: 4.0.0
Resolution: Fixed
Status: Resolved (was: Patch Available)
Pushed to master.
> CMV creating a Full ACID partitioned table fails because of no writeId
> --
>
> Key: HIVE-22396
> URL: https://issues.apache.org/jira/browse/HIVE-22396
> Project: Hive
> Issue Type: Sub-task
> Components: HiveServer2, repl
>Affects Versions: 4.0.0
>Reporter: Jesus Camacho Rodriguez
>Assignee: Jesus Camacho Rodriguez
>Priority: Major
> Labels: pull-request-available
> Fix For: 4.0.0
>
> Attachments: HIVE-22396.patch
>
> Time Spent: 10m
> Remaining Estimate: 0h
>
> create materialized view acid_cmv_part disable rewrite partitioned on (k)
> stored as orc TBLPROPERTIES ('transactional'='true')
> as select key k, value from src order by k limit 5;
> ERROR : FAILED: Execution Error, return code 1 from
> org.apache.hadoop.hive.ql.exec.MoveTask. MoveTask : Write id is not set in
> the config by open txn task for migration
> Error: Error while processing statement: FAILED: Execution Error, return code
> 1 from org.apache.hadoop.hive.ql.exec.MoveTask. MoveTask : Write id is not
> set in the config by open txn task for migration (state=08S01,code=1)
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
[jira] [Commented] (HIVE-22396) CMV creating a Full ACID partitioned table fails because of no writeId
[
https://issues.apache.org/jira/browse/HIVE-22396?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16958549#comment-16958549
]
Ashutosh Chauhan commented on HIVE-22396:
-
+1
> CMV creating a Full ACID partitioned table fails because of no writeId
> --
>
> Key: HIVE-22396
> URL: https://issues.apache.org/jira/browse/HIVE-22396
> Project: Hive
> Issue Type: Sub-task
> Components: HiveServer2, repl
>Affects Versions: 4.0.0
>Reporter: Jesus Camacho Rodriguez
>Assignee: Jesus Camacho Rodriguez
>Priority: Major
> Labels: pull-request-available
> Attachments: HIVE-22396.patch
>
> Time Spent: 10m
> Remaining Estimate: 0h
>
> create materialized view acid_cmv_part disable rewrite partitioned on (k)
> stored as orc TBLPROPERTIES ('transactional'='true')
> as select key k, value from src order by k limit 5;
> ERROR : FAILED: Execution Error, return code 1 from
> org.apache.hadoop.hive.ql.exec.MoveTask. MoveTask : Write id is not set in
> the config by open txn task for migration
> Error: Error while processing statement: FAILED: Execution Error, return code
> 1 from org.apache.hadoop.hive.ql.exec.MoveTask. MoveTask : Write id is not
> set in the config by open txn task for migration (state=08S01,code=1)
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
[jira] [Commented] (HIVE-22398) Remove Yarn queue management via ShimLoader.
[ https://issues.apache.org/jira/browse/HIVE-22398?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16958544#comment-16958544 ] Ashutosh Chauhan commented on HIVE-22398: - +1 pending tests. > Remove Yarn queue management via ShimLoader. > > > Key: HIVE-22398 > URL: https://issues.apache.org/jira/browse/HIVE-22398 > Project: Hive > Issue Type: Task >Reporter: Slim Bouguerra >Assignee: Slim Bouguerra >Priority: Major > Attachments: HIVE-22398.patch > > > Legacy MR Hive used this shim loader to do fair scheduling using Yarn Queues > non public APIs. > This patch will remove this code since it is not used anymore and new > [YARN-8967|https://issues.apache.org/jira/browse/YARN-8967] changes will > break future version upgrade -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Updated] (HIVE-22292) Implement Hypothetical-Set Aggregate Functions
[
https://issues.apache.org/jira/browse/HIVE-22292?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Krisztian Kasa updated HIVE-22292:
--
Attachment: HIVE-22292.5.patch
> Implement Hypothetical-Set Aggregate Functions
> --
>
> Key: HIVE-22292
> URL: https://issues.apache.org/jira/browse/HIVE-22292
> Project: Hive
> Issue Type: Improvement
> Components: UDF
>Reporter: Krisztian Kasa
>Assignee: Krisztian Kasa
>Priority: Major
> Fix For: 4.0.0
>
> Attachments: HIVE-22292.1.patch, HIVE-22292.2.patch,
> HIVE-22292.3.patch, HIVE-22292.4.patch, HIVE-22292.5.patch
>
>
> {code}
> ::=
>
>
>
> ::=
> RANK
> | DENSE_RANK
> | PERCENT_RANK
> | CUME_DIST
> {code}
> Example:
> {code}
> CREATE TABLE table1 (column1 int);
> INSERT INTO table1 VALUES (NULL), (3), (8), (13), (7), (6), (20), (NULL),
> (NULL), (10), (7), (15), (16), (8), (7), (8), (NULL);
> {code}
> {code}
> SELECT rank(6) WITHIN GROUP (ORDER BY column1) FROM table1;
> {code}
> {code}
> 2
> {code}
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
[jira] [Updated] (HIVE-22292) Implement Hypothetical-Set Aggregate Functions
[
https://issues.apache.org/jira/browse/HIVE-22292?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Krisztian Kasa updated HIVE-22292:
--
Status: Open (was: Patch Available)
> Implement Hypothetical-Set Aggregate Functions
> --
>
> Key: HIVE-22292
> URL: https://issues.apache.org/jira/browse/HIVE-22292
> Project: Hive
> Issue Type: Improvement
> Components: UDF
>Reporter: Krisztian Kasa
>Assignee: Krisztian Kasa
>Priority: Major
> Fix For: 4.0.0
>
> Attachments: HIVE-22292.1.patch, HIVE-22292.2.patch,
> HIVE-22292.3.patch, HIVE-22292.4.patch, HIVE-22292.5.patch
>
>
> {code}
> ::=
>
>
>
> ::=
> RANK
> | DENSE_RANK
> | PERCENT_RANK
> | CUME_DIST
> {code}
> Example:
> {code}
> CREATE TABLE table1 (column1 int);
> INSERT INTO table1 VALUES (NULL), (3), (8), (13), (7), (6), (20), (NULL),
> (NULL), (10), (7), (15), (16), (8), (7), (8), (NULL);
> {code}
> {code}
> SELECT rank(6) WITHIN GROUP (ORDER BY column1) FROM table1;
> {code}
> {code}
> 2
> {code}
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
[jira] [Updated] (HIVE-22292) Implement Hypothetical-Set Aggregate Functions
[
https://issues.apache.org/jira/browse/HIVE-22292?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Krisztian Kasa updated HIVE-22292:
--
Status: Patch Available (was: Open)
> Implement Hypothetical-Set Aggregate Functions
> --
>
> Key: HIVE-22292
> URL: https://issues.apache.org/jira/browse/HIVE-22292
> Project: Hive
> Issue Type: Improvement
> Components: UDF
>Reporter: Krisztian Kasa
>Assignee: Krisztian Kasa
>Priority: Major
> Fix For: 4.0.0
>
> Attachments: HIVE-22292.1.patch, HIVE-22292.2.patch,
> HIVE-22292.3.patch, HIVE-22292.4.patch, HIVE-22292.5.patch
>
>
> {code}
> ::=
>
>
>
> ::=
> RANK
> | DENSE_RANK
> | PERCENT_RANK
> | CUME_DIST
> {code}
> Example:
> {code}
> CREATE TABLE table1 (column1 int);
> INSERT INTO table1 VALUES (NULL), (3), (8), (13), (7), (6), (20), (NULL),
> (NULL), (10), (7), (15), (16), (8), (7), (8), (NULL);
> {code}
> {code}
> SELECT rank(6) WITHIN GROUP (ORDER BY column1) FROM table1;
> {code}
> {code}
> 2
> {code}
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
[jira] [Commented] (HIVE-22384) Hive MetaStore Cache Stored funcion Cache
[
https://issues.apache.org/jira/browse/HIVE-22384?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16958532#comment-16958532
]
Hive QA commented on HIVE-22384:
| (/) *{color:green}+1 overall{color}* |
\\
\\
|| Vote || Subsystem || Runtime || Comment ||
|| || || || {color:brown} Prechecks {color} ||
| {color:green}+1{color} | {color:green} @author {color} | {color:green} 0m
0s{color} | {color:green} The patch does not contain any @author tags. {color} |
|| || || || {color:brown} master Compile Tests {color} ||
| {color:green}+1{color} | {color:green} mvninstall {color} | {color:green} 8m
25s{color} | {color:green} master passed {color} |
| {color:green}+1{color} | {color:green} compile {color} | {color:green} 0m
26s{color} | {color:green} master passed {color} |
| {color:green}+1{color} | {color:green} checkstyle {color} | {color:green} 0m
17s{color} | {color:green} master passed {color} |
| {color:blue}0{color} | {color:blue} findbugs {color} | {color:blue} 1m
9s{color} | {color:blue} standalone-metastore/metastore-server in master has
171 extant Findbugs warnings. {color} |
| {color:green}+1{color} | {color:green} javadoc {color} | {color:green} 0m
20s{color} | {color:green} master passed {color} |
|| || || || {color:brown} Patch Compile Tests {color} ||
| {color:green}+1{color} | {color:green} mvninstall {color} | {color:green} 0m
31s{color} | {color:green} the patch passed {color} |
| {color:green}+1{color} | {color:green} compile {color} | {color:green} 0m
27s{color} | {color:green} the patch passed {color} |
| {color:green}+1{color} | {color:green} javac {color} | {color:green} 0m
27s{color} | {color:green} the patch passed {color} |
| {color:green}+1{color} | {color:green} checkstyle {color} | {color:green} 0m
19s{color} | {color:green} the patch passed {color} |
| {color:green}+1{color} | {color:green} whitespace {color} | {color:green} 0m
0s{color} | {color:green} The patch has no whitespace issues. {color} |
| {color:green}+1{color} | {color:green} findbugs {color} | {color:green} 1m
18s{color} | {color:green} the patch passed {color} |
| {color:green}+1{color} | {color:green} javadoc {color} | {color:green} 0m
20s{color} | {color:green} the patch passed {color} |
|| || || || {color:brown} Other Tests {color} ||
| {color:green}+1{color} | {color:green} asflicense {color} | {color:green} 0m
14s{color} | {color:green} The patch does not generate ASF License warnings.
{color} |
| {color:black}{color} | {color:black} {color} | {color:black} 14m 18s{color} |
{color:black} {color} |
\\
\\
|| Subsystem || Report/Notes ||
| Optional Tests | asflicense javac javadoc findbugs checkstyle compile |
| uname | Linux hiveptest-server-upstream 3.16.0-4-amd64 #1 SMP Debian
3.16.43-2+deb8u5 (2017-09-19) x86_64 GNU/Linux |
| Build tool | maven |
| Personality |
/data/hiveptest/working/yetus_PreCommit-HIVE-Build-19137/dev-support/hive-personality.sh
|
| git revision | master / 843cfd9 |
| Default Java | 1.8.0_111 |
| findbugs | v3.0.0 |
| modules | C: standalone-metastore/metastore-server U:
standalone-metastore/metastore-server |
| Console output |
http://104.198.109.242/logs//PreCommit-HIVE-Build-19137/yetus.txt |
| Powered by | Apache Yetushttp://yetus.apache.org |
This message was automatically generated.
> Hive MetaStore Cache Stored funcion Cache
> -
>
> Key: HIVE-22384
> URL: https://issues.apache.org/jira/browse/HIVE-22384
> Project: Hive
> Issue Type: Improvement
> Components: Standalone Metastore
>Affects Versions: 2.3.7
>Reporter: fanshilun
>Assignee: fanshilun
>Priority: Major
> Labels: cachedstore
> Fix For: 2.3.7
>
> Attachments: HIVE-22384.1.patch, HIVE-22384.2.patch,
> HIVE-22384.3.patch, HIVE-22384.4.patch, HIVE-22384.5.patch, HIVE-22384.6.patch
>
>
> CacheStored Function Cache have not been developed, this patch completes
> related functions
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
[jira] [Commented] (HIVE-22367) Transaction type not retrieved from OpenTxnRequest
[
https://issues.apache.org/jira/browse/HIVE-22367?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16958519#comment-16958519
]
Hive QA commented on HIVE-22367:
Here are the results of testing the latest attachment:
https://issues.apache.org/jira/secure/attachment/12983870/HIVE-22367.5.patch
{color:green}SUCCESS:{color} +1 due to 1 test(s) being added or modified.
{color:green}SUCCESS:{color} +1 due to 17546 tests passed
Test results:
https://builds.apache.org/job/PreCommit-HIVE-Build/19136/testReport
Console output: https://builds.apache.org/job/PreCommit-HIVE-Build/19136/console
Test logs: http://104.198.109.242/logs/PreCommit-HIVE-Build-19136/
Messages:
{noformat}
Executing org.apache.hive.ptest.execution.TestCheckPhase
Executing org.apache.hive.ptest.execution.PrepPhase
Executing org.apache.hive.ptest.execution.YetusPhase
Executing org.apache.hive.ptest.execution.ExecutionPhase
Executing org.apache.hive.ptest.execution.ReportingPhase
{noformat}
This message is automatically generated.
ATTACHMENT ID: 12983870 - PreCommit-HIVE-Build
> Transaction type not retrieved from OpenTxnRequest
> --
>
> Key: HIVE-22367
> URL: https://issues.apache.org/jira/browse/HIVE-22367
> Project: Hive
> Issue Type: Bug
> Components: Transactions
>Reporter: Denys Kuzmenko
>Assignee: Denys Kuzmenko
>Priority: Major
> Attachments: HIVE-22367.1.patch, HIVE-22367.2.patch,
> HIVE-22367.3.patch, HIVE-22367.4.patch, HIVE-22367.5.patch
>
>
> When opening a transaction, its type should be extracted from OpenTxnRequest
> object. Currently it's hardcoded with TxnType.DEFAULT.
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
[jira] [Updated] (HIVE-22360) MultiDelimitSerDe returns wrong results in last column when the loaded file has more columns than those in table schema
[
https://issues.apache.org/jira/browse/HIVE-22360?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Sankar Hariappan updated HIVE-22360:
Fix Version/s: 4.0.0
Resolution: Fixed
Status: Resolved (was: Patch Available)
Committed to master.
Thanks [~ShubhamChaurasia] for the contribution!
> MultiDelimitSerDe returns wrong results in last column when the loaded file
> has more columns than those in table schema
> ---
>
> Key: HIVE-22360
> URL: https://issues.apache.org/jira/browse/HIVE-22360
> Project: Hive
> Issue Type: Bug
> Components: Serializers/Deserializers
>Affects Versions: 4.0.0
>Reporter: Shubham Chaurasia
>Assignee: Shubham Chaurasia
>Priority: Major
> Labels: pull-request-available
> Fix For: 4.0.0
>
> Attachments: HIVE-22360.1.patch, HIVE-22360.2.patch,
> HIVE-22360.3.patch
>
> Time Spent: 10m
> Remaining Estimate: 0h
>
> Repro steps:
> Input file:
> {code}
> 1^,1^,^,0^,0^,0
> 2^,1^,^,0^,1^,0
> 3^,1^,^,0^,0^,0
> 4^,1^,^,0^,1^,0
> {code}
> Queries:
> {code}
> CREATE TABLE n2(colA int, colB tinyint, colC timestamp, colD smallint, colE
> smallint) ROW FORMAT SERDE 'org.apache.hadoop.hive.serde2.MultiDelimitSerDe'
> WITH SERDEPROPERTIES ("field.delim"="^,")STORED AS TEXTFILE;
> LOAD DATA LOCAL INPATH '/Users/schaurasia/Documents/input_6_cols.csv'
> OVERWRITE INTO TABLE n2;
> select * from n2;
> // wrong last column results here.
> +--+--+--+--+--+
> | n2.cola | n2.colb | n2.colc | n2.cold | n2.cole |
> +--+--+--+--+--+
> | 1| 1| NULL | 0| NULL |
> | 2| 1| NULL | 0| NULL |
> | 3| 1| NULL | 0| NULL |
> | 4| 1| NULL | 0| NULL |
> +--+--+--+--+--+
> {code}
> Cause:
> In multi-serde parsing, the total length calculation here:
> https://github.com/apache/hive/blob/rel/release-3.1.2/serde/src/java/org/apache/hadoop/hive/serde2/lazy/LazyStruct.java#L308
> does not take extra fields into account.
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
[jira] [Updated] (HIVE-22360) MultiDelimitSerDe returns wrong results in last column when the loaded file has more columns than those in table schema
[
https://issues.apache.org/jira/browse/HIVE-22360?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Sankar Hariappan updated HIVE-22360:
Summary: MultiDelimitSerDe returns wrong results in last column when the
loaded file has more columns than those in table schema (was: MultiSerDe
returns wrong results in last column when the loaded file has more columns than
those in table schema)
> MultiDelimitSerDe returns wrong results in last column when the loaded file
> has more columns than those in table schema
> ---
>
> Key: HIVE-22360
> URL: https://issues.apache.org/jira/browse/HIVE-22360
> Project: Hive
> Issue Type: Bug
> Components: Serializers/Deserializers
>Affects Versions: 4.0.0
>Reporter: Shubham Chaurasia
>Assignee: Shubham Chaurasia
>Priority: Major
> Labels: pull-request-available
> Attachments: HIVE-22360.1.patch, HIVE-22360.2.patch,
> HIVE-22360.3.patch
>
> Time Spent: 10m
> Remaining Estimate: 0h
>
> Repro steps:
> Input file:
> {code}
> 1^,1^,^,0^,0^,0
> 2^,1^,^,0^,1^,0
> 3^,1^,^,0^,0^,0
> 4^,1^,^,0^,1^,0
> {code}
> Queries:
> {code}
> CREATE TABLE n2(colA int, colB tinyint, colC timestamp, colD smallint, colE
> smallint) ROW FORMAT SERDE 'org.apache.hadoop.hive.serde2.MultiDelimitSerDe'
> WITH SERDEPROPERTIES ("field.delim"="^,")STORED AS TEXTFILE;
> LOAD DATA LOCAL INPATH '/Users/schaurasia/Documents/input_6_cols.csv'
> OVERWRITE INTO TABLE n2;
> select * from n2;
> // wrong last column results here.
> +--+--+--+--+--+
> | n2.cola | n2.colb | n2.colc | n2.cold | n2.cole |
> +--+--+--+--+--+
> | 1| 1| NULL | 0| NULL |
> | 2| 1| NULL | 0| NULL |
> | 3| 1| NULL | 0| NULL |
> | 4| 1| NULL | 0| NULL |
> +--+--+--+--+--+
> {code}
> Cause:
> In multi-serde parsing, the total length calculation here:
> https://github.com/apache/hive/blob/rel/release-3.1.2/serde/src/java/org/apache/hadoop/hive/serde2/lazy/LazyStruct.java#L308
> does not take extra fields into account.
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
[jira] [Commented] (HIVE-22360) MultiSerDe returns wrong results in last column when the loaded file has more columns than those in table schema
[
https://issues.apache.org/jira/browse/HIVE-22360?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16958504#comment-16958504
]
Sankar Hariappan commented on HIVE-22360:
-
+1, LGTM
> MultiSerDe returns wrong results in last column when the loaded file has more
> columns than those in table schema
>
>
> Key: HIVE-22360
> URL: https://issues.apache.org/jira/browse/HIVE-22360
> Project: Hive
> Issue Type: Bug
> Components: Serializers/Deserializers
>Affects Versions: 4.0.0
>Reporter: Shubham Chaurasia
>Assignee: Shubham Chaurasia
>Priority: Major
> Labels: pull-request-available
> Attachments: HIVE-22360.1.patch, HIVE-22360.2.patch,
> HIVE-22360.3.patch
>
> Time Spent: 10m
> Remaining Estimate: 0h
>
> Repro steps:
> Input file:
> {code}
> 1^,1^,^,0^,0^,0
> 2^,1^,^,0^,1^,0
> 3^,1^,^,0^,0^,0
> 4^,1^,^,0^,1^,0
> {code}
> Queries:
> {code}
> CREATE TABLE n2(colA int, colB tinyint, colC timestamp, colD smallint, colE
> smallint) ROW FORMAT SERDE 'org.apache.hadoop.hive.serde2.MultiDelimitSerDe'
> WITH SERDEPROPERTIES ("field.delim"="^,")STORED AS TEXTFILE;
> LOAD DATA LOCAL INPATH '/Users/schaurasia/Documents/input_6_cols.csv'
> OVERWRITE INTO TABLE n2;
> select * from n2;
> // wrong last column results here.
> +--+--+--+--+--+
> | n2.cola | n2.colb | n2.colc | n2.cold | n2.cole |
> +--+--+--+--+--+
> | 1| 1| NULL | 0| NULL |
> | 2| 1| NULL | 0| NULL |
> | 3| 1| NULL | 0| NULL |
> | 4| 1| NULL | 0| NULL |
> +--+--+--+--+--+
> {code}
> Cause:
> In multi-serde parsing, the total length calculation here:
> https://github.com/apache/hive/blob/rel/release-3.1.2/serde/src/java/org/apache/hadoop/hive/serde2/lazy/LazyStruct.java#L308
> does not take extra fields into account.
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
[jira] [Comment Edited] (HIVE-22392) Hive JDBC Storage Handler: Support For Writing Data to JDBC Data Source
[ https://issues.apache.org/jira/browse/HIVE-22392?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16957839#comment-16957839 ] Syed Shameerur Rahman edited comment on HIVE-22392 at 10/24/19 3:55 AM: [~ashutoshc] [~jcamachorodriguez] [~thejas] Please Review was (Author: srahman): [~jcamachorodriguez] [~thejas] Please Review > Hive JDBC Storage Handler: Support For Writing Data to JDBC Data Source > --- > > Key: HIVE-22392 > URL: https://issues.apache.org/jira/browse/HIVE-22392 > Project: Hive > Issue Type: New Feature > Components: StorageHandler >Reporter: Syed Shameerur Rahman >Assignee: Syed Shameerur Rahman >Priority: Major > Attachments: HIVE-22392.01.patch, HIVE-22392.02.patch > > > JDBC Storage Handler supports reading from JDBC data source in Hive. > Currently writing to a JDBC data source is not supported. Hence adding > support for simple insert query so that the data can be written back to JDBC > data source. -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Updated] (HIVE-22382) Support Decimal64 column division with decimal64 Column
[ https://issues.apache.org/jira/browse/HIVE-22382?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ramesh Kumar Thangarajan updated HIVE-22382: Attachment: HIVE-22382.2.patch Status: Patch Available (was: Open) > Support Decimal64 column division with decimal64 Column > --- > > Key: HIVE-22382 > URL: https://issues.apache.org/jira/browse/HIVE-22382 > Project: Hive > Issue Type: Bug >Reporter: Ramesh Kumar Thangarajan >Assignee: Ramesh Kumar Thangarajan >Priority: Major > Attachments: HIVE-22382.2.patch > > > Support Decimal64 column division with decimal64 Column -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Updated] (HIVE-22382) Support Decimal64 column division with decimal64 Column
[ https://issues.apache.org/jira/browse/HIVE-22382?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ramesh Kumar Thangarajan updated HIVE-22382: Attachment: (was: HIVE-22382.1.patch) > Support Decimal64 column division with decimal64 Column > --- > > Key: HIVE-22382 > URL: https://issues.apache.org/jira/browse/HIVE-22382 > Project: Hive > Issue Type: Bug >Reporter: Ramesh Kumar Thangarajan >Assignee: Ramesh Kumar Thangarajan >Priority: Major > > Support Decimal64 column division with decimal64 Column -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Updated] (HIVE-22382) Support Decimal64 column division with decimal64 Column
[ https://issues.apache.org/jira/browse/HIVE-22382?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ramesh Kumar Thangarajan updated HIVE-22382: Status: Open (was: Patch Available) > Support Decimal64 column division with decimal64 Column > --- > > Key: HIVE-22382 > URL: https://issues.apache.org/jira/browse/HIVE-22382 > Project: Hive > Issue Type: Bug >Reporter: Ramesh Kumar Thangarajan >Assignee: Ramesh Kumar Thangarajan >Priority: Major > Attachments: HIVE-22382.1.patch > > > Support Decimal64 column division with decimal64 Column -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Commented] (HIVE-22367) Transaction type not retrieved from OpenTxnRequest
[
https://issues.apache.org/jira/browse/HIVE-22367?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16958491#comment-16958491
]
Hive QA commented on HIVE-22367:
| (/) *{color:green}+1 overall{color}* |
\\
\\
|| Vote || Subsystem || Runtime || Comment ||
|| || || || {color:brown} Prechecks {color} ||
| {color:green}+1{color} | {color:green} @author {color} | {color:green} 0m
0s{color} | {color:green} The patch does not contain any @author tags. {color} |
|| || || || {color:brown} master Compile Tests {color} ||
| {color:green}+1{color} | {color:green} mvninstall {color} | {color:green} 8m
25s{color} | {color:green} master passed {color} |
| {color:green}+1{color} | {color:green} compile {color} | {color:green} 0m
27s{color} | {color:green} master passed {color} |
| {color:green}+1{color} | {color:green} checkstyle {color} | {color:green} 0m
22s{color} | {color:green} master passed {color} |
| {color:blue}0{color} | {color:blue} findbugs {color} | {color:blue} 1m
10s{color} | {color:blue} standalone-metastore/metastore-server in master has
171 extant Findbugs warnings. {color} |
| {color:green}+1{color} | {color:green} javadoc {color} | {color:green} 0m
21s{color} | {color:green} master passed {color} |
|| || || || {color:brown} Patch Compile Tests {color} ||
| {color:green}+1{color} | {color:green} mvninstall {color} | {color:green} 0m
30s{color} | {color:green} the patch passed {color} |
| {color:green}+1{color} | {color:green} compile {color} | {color:green} 0m
27s{color} | {color:green} the patch passed {color} |
| {color:green}+1{color} | {color:green} javac {color} | {color:green} 0m
27s{color} | {color:green} the patch passed {color} |
| {color:green}+1{color} | {color:green} checkstyle {color} | {color:green} 0m
24s{color} | {color:green} the patch passed {color} |
| {color:green}+1{color} | {color:green} whitespace {color} | {color:green} 0m
0s{color} | {color:green} The patch has no whitespace issues. {color} |
| {color:green}+1{color} | {color:green} findbugs {color} | {color:green} 1m
21s{color} | {color:green} the patch passed {color} |
| {color:green}+1{color} | {color:green} javadoc {color} | {color:green} 0m
19s{color} | {color:green} the patch passed {color} |
|| || || || {color:brown} Other Tests {color} ||
| {color:green}+1{color} | {color:green} asflicense {color} | {color:green} 0m
14s{color} | {color:green} The patch does not generate ASF License warnings.
{color} |
| {color:black}{color} | {color:black} {color} | {color:black} 14m 27s{color} |
{color:black} {color} |
\\
\\
|| Subsystem || Report/Notes ||
| Optional Tests | asflicense javac javadoc findbugs checkstyle compile |
| uname | Linux hiveptest-server-upstream 3.16.0-4-amd64 #1 SMP Debian
3.16.43-2+deb8u5 (2017-09-19) x86_64 GNU/Linux |
| Build tool | maven |
| Personality |
/data/hiveptest/working/yetus_PreCommit-HIVE-Build-19136/dev-support/hive-personality.sh
|
| git revision | master / 463dae9 |
| Default Java | 1.8.0_111 |
| findbugs | v3.0.0 |
| modules | C: standalone-metastore/metastore-server U:
standalone-metastore/metastore-server |
| Console output |
http://104.198.109.242/logs//PreCommit-HIVE-Build-19136/yetus.txt |
| Powered by | Apache Yetushttp://yetus.apache.org |
This message was automatically generated.
> Transaction type not retrieved from OpenTxnRequest
> --
>
> Key: HIVE-22367
> URL: https://issues.apache.org/jira/browse/HIVE-22367
> Project: Hive
> Issue Type: Bug
> Components: Transactions
>Reporter: Denys Kuzmenko
>Assignee: Denys Kuzmenko
>Priority: Major
> Attachments: HIVE-22367.1.patch, HIVE-22367.2.patch,
> HIVE-22367.3.patch, HIVE-22367.4.patch, HIVE-22367.5.patch
>
>
> When opening a transaction, its type should be extracted from OpenTxnRequest
> object. Currently it's hardcoded with TxnType.DEFAULT.
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
[jira] [Updated] (HIVE-22382) Support Decimal64 column division with decimal64 Column
[ https://issues.apache.org/jira/browse/HIVE-22382?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ramesh Kumar Thangarajan updated HIVE-22382: Attachment: HIVE-22382.1.patch Status: Patch Available (was: Open) > Support Decimal64 column division with decimal64 Column > --- > > Key: HIVE-22382 > URL: https://issues.apache.org/jira/browse/HIVE-22382 > Project: Hive > Issue Type: Bug >Reporter: Ramesh Kumar Thangarajan >Assignee: Ramesh Kumar Thangarajan >Priority: Major > Attachments: HIVE-22382.1.patch > > > Support Decimal64 column division with decimal64 Column -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Commented] (HIVE-22342) HMS Translation: HIVE-22189 too strict with location for EXTERNAL tables
[ https://issues.apache.org/jira/browse/HIVE-22342?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16958489#comment-16958489 ] Naveen Gangam commented on HIVE-22342: -- [~vgarg] This is by-design. MANAGED_TABLE are meant to ACID only tables going forward. If a non-ACID managed table is created, it will be converted as an external table with "external.table.purge=true" so it behaves as the current managed table where the table data is deleted when the table is dropped. What failures is this causing for you? Thank you > HMS Translation: HIVE-22189 too strict with location for EXTERNAL tables > > > Key: HIVE-22342 > URL: https://issues.apache.org/jira/browse/HIVE-22342 > Project: Hive > Issue Type: Sub-task > Components: Hive >Affects Versions: 4.0.0 >Reporter: Naveen Gangam >Assignee: Naveen Gangam >Priority: Major > Fix For: 4.0.0 > > Attachments: HIVE-22342.2.patch, HIVE-22342.3.patch, HIVE-22342.patch > > > HIVE-22189 restricts EXTERNAL tables being created to be restricted to the > EXTERNAL_WAREHOUSE_DIR. This might be too strict as any other location should > be allowed as long as the location is outside the MANAGED warehouse directory. -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Commented] (HIVE-22342) HMS Translation: HIVE-22189 too strict with location for EXTERNAL tables
[
https://issues.apache.org/jira/browse/HIVE-22342?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16958488#comment-16958488
]
Vineet Garg commented on HIVE-22342:
Also I am not sure why is this code path skipped for tests?
{code:java}
if (transformer != null && !isInTest) {
tbl = transformer.transformCreateTable(tbl, processorCapabilities,
processorId);
}
{code}
> HMS Translation: HIVE-22189 too strict with location for EXTERNAL tables
>
>
> Key: HIVE-22342
> URL: https://issues.apache.org/jira/browse/HIVE-22342
> Project: Hive
> Issue Type: Sub-task
> Components: Hive
>Affects Versions: 4.0.0
>Reporter: Naveen Gangam
>Assignee: Naveen Gangam
>Priority: Major
> Fix For: 4.0.0
>
> Attachments: HIVE-22342.2.patch, HIVE-22342.3.patch, HIVE-22342.patch
>
>
> HIVE-22189 restricts EXTERNAL tables being created to be restricted to the
> EXTERNAL_WAREHOUSE_DIR. This might be too strict as any other location should
> be allowed as long as the location is outside the MANAGED warehouse directory.
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
[jira] [Commented] (HIVE-22342) HMS Translation: HIVE-22189 too strict with location for EXTERNAL tables
[
https://issues.apache.org/jira/browse/HIVE-22342?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16958487#comment-16958487
]
Vineet Garg commented on HIVE-22342:
[~ngangam] I believe this has broken the CREATE TABLE. Even simple CREATE TABLE
is creating EXTERNAL TABLE instead of default MANAGED type.
{code:sql}
hive> create table testext(i int, j int);
hive> desc formatted testext;
# col_name data_type comment
i int
j int
# Detailed Table Information
Database: default
OwnerType: USER
Owner: vgarg
CreateTime: Wed Oct 23 20:03:13 PDT 2019
LastAccessTime: UNKNOWN
Retention: 0
Location: file:/Users/vgarg/hive_temp/vgarg/hive/warehouse/testext
Table Type: EXTERNAL_TABLE
Table Parameters:
COLUMN_STATS_ACCURATE
{\"BASIC_STATS\":\"true\",\"COLUMN_STATS\":{\"i\":\"true\",\"j\":\"true\"}}
EXTERNALTRUE
TRANSLATED_TO_EXTERNAL TRUE
bucketing_version 2
external.table.purgeTRUE
numFiles0
numRows 0
rawDataSize 0
totalSize 0
transient_lastDdlTime 1571886193
# Storage Information
SerDe Library: org.apache.hadoop.hive.serde2.lazy.LazySimpleSerDe
InputFormat:org.apache.hadoop.mapred.TextInputFormat
OutputFormat:
org.apache.hadoop.hive.ql.io.HiveIgnoreKeyTextOutputFormat
Compressed: No
Num Buckets:-1
Bucket Columns: []
Sort Columns: []
Storage Desc Params:
serialization.format1
{code}
{code}
2019-10-23T20:03:13,662 INFO [caf84128-72fe-4e57-81cd-cbd3860c56d0 main]
metastore.MetastoreDefaultTransformer: Converting testext to EXTERNAL tableType
for Hiveserver2#4.0.0-SNAPSHOT@10.0.1.11
2019-10-23T20:03:13,662 INFO [caf84128-72fe-4e57-81cd-cbd3860c56d0 main]
metastore.MetastoreDefaultTransformer: Modified table params
are:{external.table.purge=TRUE, totalSize=0, numRows=0, rawDataSize=0,
EXTERNAL=TRUE,
COLUMN_STATS_ACCURATE={"BASIC_STATS":"true","COLUMN_STATS":{"i":"true","j":"true"}},
numFiles=0, TRANSLATED_TO_EXTERNAL=TRUE, bucketing_version=2,
numFilesErasureCoded=0}
2019-10-23T20:03:13,662 INFO [caf84128-72fe-4e57-81cd-cbd3860c56d0 main]
metastore.MetastoreDefaultTransformer: Transformer returning
table:Table(tableName:testext, dbName:default, owner:vgarg,
createTime:1571886193, lastAccessTime:0, retention:0,
sd:StorageDescriptor(cols:[FieldSchema(name:i, type:int, comment:null),
FieldSchema(name:j, type:int, comment:null)],
location:file:/Users/vgarg/hive_temp/vgarg/hive/warehouse/testext,
inputFormat:org.apache.hadoop.mapred.TextInputFormat,
outputFormat:org.apache.hadoop.hive.ql.io.HiveIgnoreKeyTextOutputFormat,
compressed:false, numBuckets:-1, serdeInfo:SerDeInfo(name:null,
serializationLib:org.apache.hadoop.hive.serde2.lazy.LazySimpleSerDe,
parameters:{serialization.format=1}), bucketCols:[], sortCols:[],
parameters:{}, skewedInfo:SkewedInfo(skewedColNames:[], skewedColValues:[],
skewedColValueLocationMaps:{}), storedAsSubDirectories:false),
partitionKeys:[], parameters:{external.table.purge=TRUE, totalSize=0,
numRows=0, rawDataSize=0, EXTERNAL=TRUE,
COLUMN_STATS_ACCURATE={"BASIC_STATS":"true","COLUMN_STATS":{"i":"true","j":"true"}},
numFiles=0, TRANSLATED_TO_EXTERNAL=TRUE, bucketing_version=2,
numFilesErasureCoded=0}, viewOriginalText:null, viewExpandedText:null,
tableType:EXTERNAL_TABLE,
privileges:PrincipalPrivilegeSet(userPrivileges:{vgarg=[PrivilegeGrantInfo(privilege:INSERT,
createTime:-1, grantor:vgarg, grantorType:USER, grantOption:true),
PrivilegeGrantInfo(privilege:SELECT, createTime:-1, grantor:vgarg,
grantorType:USER, grantOption:true), PrivilegeGrantInfo(privilege:UPDATE,
createTime:-1, grantor:vgarg, grantorType:USER, grantOption:true),
PrivilegeGrantInfo(privilege:DELETE, createTime:-1, grantor:vgarg,
grantorType:USER, grantOption:true)]}, groupPrivileges:null,
rolePrivileges:null), temporary:false, catName:hive, ownerType:USER)
{code}
> HMS Translation: HIVE-22189 too strict with location for EXTERNAL tables
>
>
> Key: HIVE-22342
> URL: https://issues.apache.org/jira/browse/HIVE-22342
> Project: Hive
> Issue Type: Sub-task
> Components: Hive
>Affects Versions: 4.0.0
>Reporter: Naveen Gangam
>Assignee: Naveen Gangam
>Priority: Major
> Fix For: 4.0.0
>
> Attachments: HIVE-22342.2.patch, HIVE-22342.3.patch, HIVE-22342.patch
>
>
> HIVE-22189 restricts EXTERNAL tables being created to be restricted to the
> EXTERNAL_WAREHOUSE_DIR. This might be too strict as any other location
[jira] [Commented] (HIVE-22378) Remove code duplicatoins from return path handling
[
https://issues.apache.org/jira/browse/HIVE-22378?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16958484#comment-16958484
]
Hive QA commented on HIVE-22378:
Here are the results of testing the latest attachment:
https://issues.apache.org/jira/secure/attachment/12983869/HIVE-22378.01.patch
{color:red}ERROR:{color} -1 due to no test(s) being added or modified.
{color:green}SUCCESS:{color} +1 due to 17545 tests passed
Test results:
https://builds.apache.org/job/PreCommit-HIVE-Build/19135/testReport
Console output: https://builds.apache.org/job/PreCommit-HIVE-Build/19135/console
Test logs: http://104.198.109.242/logs/PreCommit-HIVE-Build-19135/
Messages:
{noformat}
Executing org.apache.hive.ptest.execution.TestCheckPhase
Executing org.apache.hive.ptest.execution.PrepPhase
Executing org.apache.hive.ptest.execution.YetusPhase
Executing org.apache.hive.ptest.execution.ExecutionPhase
Executing org.apache.hive.ptest.execution.ReportingPhase
{noformat}
This message is automatically generated.
ATTACHMENT ID: 12983869 - PreCommit-HIVE-Build
> Remove code duplicatoins from return path handling
> --
>
> Key: HIVE-22378
> URL: https://issues.apache.org/jira/browse/HIVE-22378
> Project: Hive
> Issue Type: Sub-task
> Components: Hive
>Reporter: Miklos Gergely
>Assignee: Miklos Gergely
>Priority: Major
> Fix For: 4.0.0
>
> Attachments: HIVE-22378.01.patch
>
>
> Return path handling have some code duplications, they should be removed.
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
[jira] [Updated] (HIVE-22315) Support Decimal64 column division with decimal64 scalar
[ https://issues.apache.org/jira/browse/HIVE-22315?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ramesh Kumar Thangarajan updated HIVE-22315: Attachment: HIVE-22315.9.patch Status: Patch Available (was: Open) > Support Decimal64 column division with decimal64 scalar > --- > > Key: HIVE-22315 > URL: https://issues.apache.org/jira/browse/HIVE-22315 > Project: Hive > Issue Type: Bug >Reporter: Ramesh Kumar Thangarajan >Assignee: Ramesh Kumar Thangarajan >Priority: Major > Attachments: HIVE-22315.1.patch, HIVE-22315.2.patch, > HIVE-22315.3.patch, HIVE-22315.4.patch, HIVE-22315.6.patch, > HIVE-22315.7.patch, HIVE-22315.8.patch, HIVE-22315.9.patch > > > Currently division operation is not supported for Decimal64 column. This Jira > will take care of supporting decimal64 column division with a decimal64 > scalar. -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Updated] (HIVE-22315) Support Decimal64 column division with decimal64 scalar
[ https://issues.apache.org/jira/browse/HIVE-22315?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ramesh Kumar Thangarajan updated HIVE-22315: Status: Open (was: Patch Available) > Support Decimal64 column division with decimal64 scalar > --- > > Key: HIVE-22315 > URL: https://issues.apache.org/jira/browse/HIVE-22315 > Project: Hive > Issue Type: Bug >Reporter: Ramesh Kumar Thangarajan >Assignee: Ramesh Kumar Thangarajan >Priority: Major > Attachments: HIVE-22315.1.patch, HIVE-22315.2.patch, > HIVE-22315.3.patch, HIVE-22315.4.patch, HIVE-22315.6.patch, > HIVE-22315.7.patch, HIVE-22315.8.patch, HIVE-22315.9.patch > > > Currently division operation is not supported for Decimal64 column. This Jira > will take care of supporting decimal64 column division with a decimal64 > scalar. -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Commented] (HIVE-22378) Remove code duplicatoins from return path handling
[
https://issues.apache.org/jira/browse/HIVE-22378?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16958470#comment-16958470
]
Hive QA commented on HIVE-22378:
| (/) *{color:green}+1 overall{color}* |
\\
\\
|| Vote || Subsystem || Runtime || Comment ||
|| || || || {color:brown} Prechecks {color} ||
| {color:green}+1{color} | {color:green} @author {color} | {color:green} 0m
0s{color} | {color:green} The patch does not contain any @author tags. {color} |
|| || || || {color:brown} master Compile Tests {color} ||
| {color:green}+1{color} | {color:green} mvninstall {color} | {color:green} 8m
28s{color} | {color:green} master passed {color} |
| {color:green}+1{color} | {color:green} compile {color} | {color:green} 1m
4s{color} | {color:green} master passed {color} |
| {color:green}+1{color} | {color:green} checkstyle {color} | {color:green} 0m
40s{color} | {color:green} master passed {color} |
| {color:blue}0{color} | {color:blue} findbugs {color} | {color:blue} 3m
56s{color} | {color:blue} ql in master has 1545 extant Findbugs warnings.
{color} |
| {color:green}+1{color} | {color:green} javadoc {color} | {color:green} 1m
1s{color} | {color:green} master passed {color} |
|| || || || {color:brown} Patch Compile Tests {color} ||
| {color:green}+1{color} | {color:green} mvninstall {color} | {color:green} 1m
30s{color} | {color:green} the patch passed {color} |
| {color:green}+1{color} | {color:green} compile {color} | {color:green} 1m
7s{color} | {color:green} the patch passed {color} |
| {color:green}+1{color} | {color:green} javac {color} | {color:green} 1m
7s{color} | {color:green} the patch passed {color} |
| {color:green}+1{color} | {color:green} checkstyle {color} | {color:green} 0m
41s{color} | {color:green} ql: The patch generated 0 new + 153 unchanged - 1
fixed = 153 total (was 154) {color} |
| {color:green}+1{color} | {color:green} whitespace {color} | {color:green} 0m
0s{color} | {color:green} The patch has no whitespace issues. {color} |
| {color:green}+1{color} | {color:green} findbugs {color} | {color:green} 4m
12s{color} | {color:green} the patch passed {color} |
| {color:green}+1{color} | {color:green} javadoc {color} | {color:green} 1m
2s{color} | {color:green} the patch passed {color} |
|| || || || {color:brown} Other Tests {color} ||
| {color:green}+1{color} | {color:green} asflicense {color} | {color:green} 0m
15s{color} | {color:green} The patch does not generate ASF License warnings.
{color} |
| {color:black}{color} | {color:black} {color} | {color:black} 24m 28s{color} |
{color:black} {color} |
\\
\\
|| Subsystem || Report/Notes ||
| Optional Tests | asflicense javac javadoc findbugs checkstyle compile |
| uname | Linux hiveptest-server-upstream 3.16.0-4-amd64 #1 SMP Debian
3.16.43-2+deb8u5 (2017-09-19) x86_64 GNU/Linux |
| Build tool | maven |
| Personality |
/data/hiveptest/working/yetus_PreCommit-HIVE-Build-19135/dev-support/hive-personality.sh
|
| git revision | master / 463dae9 |
| Default Java | 1.8.0_111 |
| findbugs | v3.0.1 |
| modules | C: ql U: ql |
| Console output |
http://104.198.109.242/logs//PreCommit-HIVE-Build-19135/yetus.txt |
| Powered by | Apache Yetushttp://yetus.apache.org |
This message was automatically generated.
> Remove code duplicatoins from return path handling
> --
>
> Key: HIVE-22378
> URL: https://issues.apache.org/jira/browse/HIVE-22378
> Project: Hive
> Issue Type: Sub-task
> Components: Hive
>Reporter: Miklos Gergely
>Assignee: Miklos Gergely
>Priority: Major
> Fix For: 4.0.0
>
> Attachments: HIVE-22378.01.patch
>
>
> Return path handling have some code duplications, they should be removed.
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
[jira] [Commented] (HIVE-22396) CMV creating a Full ACID partitioned table fails because of no writeId
[
https://issues.apache.org/jira/browse/HIVE-22396?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16958456#comment-16958456
]
Hive QA commented on HIVE-22396:
Here are the results of testing the latest attachment:
https://issues.apache.org/jira/secure/attachment/12983865/HIVE-22396.patch
{color:green}SUCCESS:{color} +1 due to 1 test(s) being added or modified.
{color:green}SUCCESS:{color} +1 due to 17545 tests passed
Test results:
https://builds.apache.org/job/PreCommit-HIVE-Build/19134/testReport
Console output: https://builds.apache.org/job/PreCommit-HIVE-Build/19134/console
Test logs: http://104.198.109.242/logs/PreCommit-HIVE-Build-19134/
Messages:
{noformat}
Executing org.apache.hive.ptest.execution.TestCheckPhase
Executing org.apache.hive.ptest.execution.PrepPhase
Executing org.apache.hive.ptest.execution.YetusPhase
Executing org.apache.hive.ptest.execution.ExecutionPhase
Executing org.apache.hive.ptest.execution.ReportingPhase
{noformat}
This message is automatically generated.
ATTACHMENT ID: 12983865 - PreCommit-HIVE-Build
> CMV creating a Full ACID partitioned table fails because of no writeId
> --
>
> Key: HIVE-22396
> URL: https://issues.apache.org/jira/browse/HIVE-22396
> Project: Hive
> Issue Type: Sub-task
> Components: HiveServer2, repl
>Affects Versions: 4.0.0
>Reporter: Jesus Camacho Rodriguez
>Assignee: Jesus Camacho Rodriguez
>Priority: Major
> Labels: pull-request-available
> Attachments: HIVE-22396.patch
>
> Time Spent: 10m
> Remaining Estimate: 0h
>
> create materialized view acid_cmv_part disable rewrite partitioned on (k)
> stored as orc TBLPROPERTIES ('transactional'='true')
> as select key k, value from src order by k limit 5;
> ERROR : FAILED: Execution Error, return code 1 from
> org.apache.hadoop.hive.ql.exec.MoveTask. MoveTask : Write id is not set in
> the config by open txn task for migration
> Error: Error while processing statement: FAILED: Execution Error, return code
> 1 from org.apache.hadoop.hive.ql.exec.MoveTask. MoveTask : Write id is not
> set in the config by open txn task for migration (state=08S01,code=1)
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
[jira] [Commented] (HIVE-22396) CMV creating a Full ACID partitioned table fails because of no writeId
[
https://issues.apache.org/jira/browse/HIVE-22396?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16958445#comment-16958445
]
Hive QA commented on HIVE-22396:
| (x) *{color:red}-1 overall{color}* |
\\
\\
|| Vote || Subsystem || Runtime || Comment ||
|| || || || {color:brown} Prechecks {color} ||
| {color:green}+1{color} | {color:green} @author {color} | {color:green} 0m
0s{color} | {color:green} The patch does not contain any @author tags. {color} |
|| || || || {color:brown} master Compile Tests {color} ||
| {color:green}+1{color} | {color:green} mvninstall {color} | {color:green} 8m
46s{color} | {color:green} master passed {color} |
| {color:green}+1{color} | {color:green} compile {color} | {color:green} 1m
7s{color} | {color:green} master passed {color} |
| {color:green}+1{color} | {color:green} checkstyle {color} | {color:green} 0m
42s{color} | {color:green} master passed {color} |
| {color:blue}0{color} | {color:blue} findbugs {color} | {color:blue} 3m
58s{color} | {color:blue} ql in master has 1545 extant Findbugs warnings.
{color} |
| {color:green}+1{color} | {color:green} javadoc {color} | {color:green} 1m
1s{color} | {color:green} master passed {color} |
|| || || || {color:brown} Patch Compile Tests {color} ||
| {color:green}+1{color} | {color:green} mvninstall {color} | {color:green} 1m
22s{color} | {color:green} the patch passed {color} |
| {color:green}+1{color} | {color:green} compile {color} | {color:green} 1m
5s{color} | {color:green} the patch passed {color} |
| {color:green}+1{color} | {color:green} javac {color} | {color:green} 1m
5s{color} | {color:green} the patch passed {color} |
| {color:red}-1{color} | {color:red} checkstyle {color} | {color:red} 0m
43s{color} | {color:red} ql: The patch generated 1 new + 396 unchanged - 1
fixed = 397 total (was 397) {color} |
| {color:green}+1{color} | {color:green} whitespace {color} | {color:green} 0m
0s{color} | {color:green} The patch has no whitespace issues. {color} |
| {color:green}+1{color} | {color:green} findbugs {color} | {color:green} 4m
7s{color} | {color:green} the patch passed {color} |
| {color:green}+1{color} | {color:green} javadoc {color} | {color:green} 1m
0s{color} | {color:green} the patch passed {color} |
|| || || || {color:brown} Other Tests {color} ||
| {color:green}+1{color} | {color:green} asflicense {color} | {color:green} 0m
15s{color} | {color:green} The patch does not generate ASF License warnings.
{color} |
| {color:black}{color} | {color:black} {color} | {color:black} 24m 42s{color} |
{color:black} {color} |
\\
\\
|| Subsystem || Report/Notes ||
| Optional Tests | asflicense javac javadoc findbugs checkstyle compile |
| uname | Linux hiveptest-server-upstream 3.16.0-4-amd64 #1 SMP Debian
3.16.43-2+deb8u5 (2017-09-19) x86_64 GNU/Linux |
| Build tool | maven |
| Personality |
/data/hiveptest/working/yetus_PreCommit-HIVE-Build-19134/dev-support/hive-personality.sh
|
| git revision | master / 463dae9 |
| Default Java | 1.8.0_111 |
| findbugs | v3.0.1 |
| checkstyle |
http://104.198.109.242/logs//PreCommit-HIVE-Build-19134/yetus/diff-checkstyle-ql.txt
|
| modules | C: ql U: ql |
| Console output |
http://104.198.109.242/logs//PreCommit-HIVE-Build-19134/yetus.txt |
| Powered by | Apache Yetushttp://yetus.apache.org |
This message was automatically generated.
> CMV creating a Full ACID partitioned table fails because of no writeId
> --
>
> Key: HIVE-22396
> URL: https://issues.apache.org/jira/browse/HIVE-22396
> Project: Hive
> Issue Type: Sub-task
> Components: HiveServer2, repl
>Affects Versions: 4.0.0
>Reporter: Jesus Camacho Rodriguez
>Assignee: Jesus Camacho Rodriguez
>Priority: Major
> Labels: pull-request-available
> Attachments: HIVE-22396.patch
>
> Time Spent: 10m
> Remaining Estimate: 0h
>
> create materialized view acid_cmv_part disable rewrite partitioned on (k)
> stored as orc TBLPROPERTIES ('transactional'='true')
> as select key k, value from src order by k limit 5;
> ERROR : FAILED: Execution Error, return code 1 from
> org.apache.hadoop.hive.ql.exec.MoveTask. MoveTask : Write id is not set in
> the config by open txn task for migration
> Error: Error while processing statement: FAILED: Execution Error, return code
> 1 from org.apache.hadoop.hive.ql.exec.MoveTask. MoveTask : Write id is not
> set in the config by open txn task for migration (state=08S01,code=1)
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
[jira] [Issue Comment Deleted] (HIVE-21018) Grouping/distinct on more than 64 columns should be possible
[ https://issues.apache.org/jira/browse/HIVE-21018?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Su updated HIVE-21018: -- Comment: was deleted (was: Thanks for the Update, will get the latest! Best, Su!) > Grouping/distinct on more than 64 columns should be possible > > > Key: HIVE-21018 > URL: https://issues.apache.org/jira/browse/HIVE-21018 > Project: Hive > Issue Type: Bug >Reporter: Zoltan Haindrich >Assignee: Zoltan Haindrich >Priority: Major > Fix For: 4.0.0 > > Attachments: HIVE-21018.01.patch, HIVE-21018.02.patch > > > Earlier when more than 64 columns were in a group by or distinct an error was > given -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Commented] (HIVE-22395) Add ability to read Druid metastore password from jceks
[
https://issues.apache.org/jira/browse/HIVE-22395?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16958429#comment-16958429
]
Hive QA commented on HIVE-22395:
Here are the results of testing the latest attachment:
https://issues.apache.org/jira/secure/attachment/12983862/HIVE-22395.patch
{color:red}ERROR:{color} -1 due to no test(s) being added or modified.
{color:red}ERROR:{color} -1 due to 18 failed/errored test(s), 17545 tests
executed
*Failed tests:*
{noformat}
org.apache.hadoop.hive.cli.TestMiniDruidCliDriver.testCliDriver[druid_materialized_view_rewrite_ssb]
(batchId=198)
org.apache.hadoop.hive.cli.TestMiniDruidCliDriver.testCliDriver[druid_timeseries]
(batchId=198)
org.apache.hadoop.hive.cli.TestMiniDruidCliDriver.testCliDriver[druid_timestamptz2]
(batchId=198)
org.apache.hadoop.hive.cli.TestMiniDruidCliDriver.testCliDriver[druid_topn]
(batchId=198)
org.apache.hadoop.hive.cli.TestMiniDruidCliDriver.testCliDriver[druidmini_dynamic_partition]
(batchId=198)
org.apache.hadoop.hive.cli.TestMiniDruidCliDriver.testCliDriver[druidmini_expressions]
(batchId=198)
org.apache.hadoop.hive.cli.TestMiniDruidCliDriver.testCliDriver[druidmini_extractTime]
(batchId=198)
org.apache.hadoop.hive.cli.TestMiniDruidCliDriver.testCliDriver[druidmini_floorTime]
(batchId=198)
org.apache.hadoop.hive.cli.TestMiniDruidCliDriver.testCliDriver[druidmini_mv]
(batchId=198)
org.apache.hadoop.hive.cli.TestMiniDruidCliDriver.testCliDriver[druidmini_semijoin_reduction_all_types]
(batchId=198)
org.apache.hadoop.hive.cli.TestMiniDruidCliDriver.testCliDriver[druidmini_test1]
(batchId=198)
org.apache.hadoop.hive.cli.TestMiniDruidCliDriver.testCliDriver[druidmini_test_alter]
(batchId=198)
org.apache.hadoop.hive.cli.TestMiniDruidCliDriver.testCliDriver[druidmini_test_insert]
(batchId=198)
org.apache.hadoop.hive.cli.TestMiniDruidCliDriver.testCliDriver[druidmini_test_ts]
(batchId=198)
org.apache.hadoop.hive.cli.TestMiniDruidKafkaCliDriver.testCliDriver[druidkafkamini_avro]
(batchId=299)
org.apache.hadoop.hive.cli.TestMiniDruidKafkaCliDriver.testCliDriver[druidkafkamini_basic]
(batchId=299)
org.apache.hadoop.hive.cli.TestMiniDruidKafkaCliDriver.testCliDriver[druidkafkamini_csv]
(batchId=299)
org.apache.hadoop.hive.cli.TestMiniDruidKafkaCliDriver.testCliDriver[druidkafkamini_delimited]
(batchId=299)
{noformat}
Test results:
https://builds.apache.org/job/PreCommit-HIVE-Build/19133/testReport
Console output: https://builds.apache.org/job/PreCommit-HIVE-Build/19133/console
Test logs: http://104.198.109.242/logs/PreCommit-HIVE-Build-19133/
Messages:
{noformat}
Executing org.apache.hive.ptest.execution.TestCheckPhase
Executing org.apache.hive.ptest.execution.PrepPhase
Executing org.apache.hive.ptest.execution.YetusPhase
Executing org.apache.hive.ptest.execution.ExecutionPhase
Executing org.apache.hive.ptest.execution.ReportingPhase
Tests exited with: TestsFailedException: 18 tests failed
{noformat}
This message is automatically generated.
ATTACHMENT ID: 12983862 - PreCommit-HIVE-Build
> Add ability to read Druid metastore password from jceks
> ---
>
> Key: HIVE-22395
> URL: https://issues.apache.org/jira/browse/HIVE-22395
> Project: Hive
> Issue Type: Bug
>Reporter: Nishant Bangarwa
>Assignee: Nishant Bangarwa
>Priority: Major
> Labels: pull-request-available
> Attachments: HIVE-22395.patch
>
> Time Spent: 10m
> Remaining Estimate: 0h
>
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
[jira] [Commented] (HIVE-21018) Grouping/distinct on more than 64 columns should be possible
[ https://issues.apache.org/jira/browse/HIVE-21018?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16958423#comment-16958423 ] Su commented on HIVE-21018: --- Thanks for the Update, will get the latest! Best, Su! > Grouping/distinct on more than 64 columns should be possible > > > Key: HIVE-21018 > URL: https://issues.apache.org/jira/browse/HIVE-21018 > Project: Hive > Issue Type: Bug >Reporter: Zoltan Haindrich >Assignee: Zoltan Haindrich >Priority: Major > Fix For: 4.0.0 > > Attachments: HIVE-21018.01.patch, HIVE-21018.02.patch > > > Earlier when more than 64 columns were in a group by or distinct an error was > given -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Updated] (HIVE-22398) Remove Yarn queue management via ShimLoader.
[ https://issues.apache.org/jira/browse/HIVE-22398?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Slim Bouguerra updated HIVE-22398: -- Attachment: HIVE-22398.patch > Remove Yarn queue management via ShimLoader. > > > Key: HIVE-22398 > URL: https://issues.apache.org/jira/browse/HIVE-22398 > Project: Hive > Issue Type: Task >Reporter: Slim Bouguerra >Assignee: Slim Bouguerra >Priority: Major > Attachments: HIVE-22398.patch > > > Legacy MR Hive used this shim loader to do fair scheduling using Yarn Queues > non public APIs. > This patch will remove this code since it is not used anymore and new > [YARN-8967|https://issues.apache.org/jira/browse/YARN-8967] changes will > break future version upgrade -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Updated] (HIVE-22398) Remove Yarn queue management via ShimLoader.
[ https://issues.apache.org/jira/browse/HIVE-22398?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Slim Bouguerra updated HIVE-22398: -- Status: Patch Available (was: Open) > Remove Yarn queue management via ShimLoader. > > > Key: HIVE-22398 > URL: https://issues.apache.org/jira/browse/HIVE-22398 > Project: Hive > Issue Type: Task >Reporter: Slim Bouguerra >Assignee: Slim Bouguerra >Priority: Major > > Legacy MR Hive used this shim loader to do fair scheduling using Yarn Queues > non public APIs. > This patch will remove this code since it is not used anymore and new > [YARN-8967|https://issues.apache.org/jira/browse/YARN-8967] changes will > break future version upgrade -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Updated] (HIVE-22398) Remove Yarn queue management via ShimLoader.
[ https://issues.apache.org/jira/browse/HIVE-22398?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Slim Bouguerra updated HIVE-22398: -- Description: Legacy MR Hive used this shim loader to do fair scheduling using Yarn Queues non public APIs. This patch will remove this code since it is not used anymore and new [YARN-8967|https://issues.apache.org/jira/browse/YARN-8967] changes will break future version upgrade was: Legacy MR Hive used this shim loader to do fair scheduling using Yarn Queues non public APIs. This patch will remove this code since it is not used anymore and new [Yarn-YARN-8967|https://issues.apache.org/jira/browse/YARN-8967] changes will break future version upgrade > Remove Yarn queue management via ShimLoader. > > > Key: HIVE-22398 > URL: https://issues.apache.org/jira/browse/HIVE-22398 > Project: Hive > Issue Type: Task >Reporter: Slim Bouguerra >Assignee: Slim Bouguerra >Priority: Major > > Legacy MR Hive used this shim loader to do fair scheduling using Yarn Queues > non public APIs. > This patch will remove this code since it is not used anymore and new > [YARN-8967|https://issues.apache.org/jira/browse/YARN-8967] changes will > break future version upgrade -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Assigned] (HIVE-22398) Remove Yarn queue management via ShimLoader.
[ https://issues.apache.org/jira/browse/HIVE-22398?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Slim Bouguerra reassigned HIVE-22398: - > Remove Yarn queue management via ShimLoader. > > > Key: HIVE-22398 > URL: https://issues.apache.org/jira/browse/HIVE-22398 > Project: Hive > Issue Type: Task >Reporter: Slim Bouguerra >Assignee: Slim Bouguerra >Priority: Major > > Legacy MR Hive used this shim loader to do fair scheduling using Yarn Queues > non public APIs. > This patch will remove this code since it is not used anymore and new > [Yarn-YARN-8967|https://issues.apache.org/jira/browse/YARN-8967] changes will > break future version upgrade -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Commented] (HIVE-22395) Add ability to read Druid metastore password from jceks
[
https://issues.apache.org/jira/browse/HIVE-22395?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16958371#comment-16958371
]
Hive QA commented on HIVE-22395:
| (/) *{color:green}+1 overall{color}* |
\\
\\
|| Vote || Subsystem || Runtime || Comment ||
|| || || || {color:brown} Prechecks {color} ||
| {color:green}+1{color} | {color:green} @author {color} | {color:green} 0m
0s{color} | {color:green} The patch does not contain any @author tags. {color} |
|| || || || {color:brown} master Compile Tests {color} ||
| {color:green}+1{color} | {color:green} mvninstall {color} | {color:green} 9m
24s{color} | {color:green} master passed {color} |
| {color:green}+1{color} | {color:green} compile {color} | {color:green} 0m
18s{color} | {color:green} master passed {color} |
| {color:green}+1{color} | {color:green} checkstyle {color} | {color:green} 0m
11s{color} | {color:green} master passed {color} |
| {color:blue}0{color} | {color:blue} findbugs {color} | {color:blue} 0m
29s{color} | {color:blue} druid-handler in master has 3 extant Findbugs
warnings. {color} |
| {color:green}+1{color} | {color:green} javadoc {color} | {color:green} 0m
13s{color} | {color:green} master passed {color} |
|| || || || {color:brown} Patch Compile Tests {color} ||
| {color:green}+1{color} | {color:green} mvninstall {color} | {color:green} 0m
34s{color} | {color:green} the patch passed {color} |
| {color:green}+1{color} | {color:green} compile {color} | {color:green} 0m
19s{color} | {color:green} the patch passed {color} |
| {color:green}+1{color} | {color:green} javac {color} | {color:green} 0m
19s{color} | {color:green} the patch passed {color} |
| {color:green}+1{color} | {color:green} checkstyle {color} | {color:green} 0m
10s{color} | {color:green} the patch passed {color} |
| {color:green}+1{color} | {color:green} whitespace {color} | {color:green} 0m
0s{color} | {color:green} The patch has no whitespace issues. {color} |
| {color:green}+1{color} | {color:green} findbugs {color} | {color:green} 0m
38s{color} | {color:green} the patch passed {color} |
| {color:green}+1{color} | {color:green} javadoc {color} | {color:green} 0m
12s{color} | {color:green} the patch passed {color} |
|| || || || {color:brown} Other Tests {color} ||
| {color:green}+1{color} | {color:green} asflicense {color} | {color:green} 0m
14s{color} | {color:green} The patch does not generate ASF License warnings.
{color} |
| {color:black}{color} | {color:black} {color} | {color:black} 13m 14s{color} |
{color:black} {color} |
\\
\\
|| Subsystem || Report/Notes ||
| Optional Tests | asflicense javac javadoc findbugs checkstyle compile |
| uname | Linux hiveptest-server-upstream 3.16.0-4-amd64 #1 SMP Debian
3.16.43-2+deb8u5 (2017-09-19) x86_64 GNU/Linux |
| Build tool | maven |
| Personality |
/data/hiveptest/working/yetus_PreCommit-HIVE-Build-19133/dev-support/hive-personality.sh
|
| git revision | master / 463dae9 |
| Default Java | 1.8.0_111 |
| findbugs | v3.0.1 |
| modules | C: druid-handler U: druid-handler |
| Console output |
http://104.198.109.242/logs//PreCommit-HIVE-Build-19133/yetus.txt |
| Powered by | Apache Yetushttp://yetus.apache.org |
This message was automatically generated.
> Add ability to read Druid metastore password from jceks
> ---
>
> Key: HIVE-22395
> URL: https://issues.apache.org/jira/browse/HIVE-22395
> Project: Hive
> Issue Type: Bug
>Reporter: Nishant Bangarwa
>Assignee: Nishant Bangarwa
>Priority: Major
> Labels: pull-request-available
> Attachments: HIVE-22395.patch
>
> Time Spent: 10m
> Remaining Estimate: 0h
>
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
[jira] [Updated] (HIVE-22384) Hive MetaStore Cache Stored funcion Cache
[ https://issues.apache.org/jira/browse/HIVE-22384?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] fanshilun updated HIVE-22384: - Attachment: HIVE-22384.6.patch > Hive MetaStore Cache Stored funcion Cache > - > > Key: HIVE-22384 > URL: https://issues.apache.org/jira/browse/HIVE-22384 > Project: Hive > Issue Type: Improvement > Components: Standalone Metastore >Affects Versions: 2.3.7 >Reporter: fanshilun >Assignee: fanshilun >Priority: Major > Labels: cachedstore > Fix For: 2.3.7 > > Attachments: HIVE-22384.1.patch, HIVE-22384.2.patch, > HIVE-22384.3.patch, HIVE-22384.4.patch, HIVE-22384.5.patch, HIVE-22384.6.patch > > > CacheStored Function Cache have not been developed, this patch completes > related functions -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Commented] (HIVE-22384) Hive MetaStore Cache Stored funcion Cache
[ https://issues.apache.org/jira/browse/HIVE-22384?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16958358#comment-16958358 ] fanshilun commented on HIVE-22384: -- add TestGetFunctionCache and change some style code > Hive MetaStore Cache Stored funcion Cache > - > > Key: HIVE-22384 > URL: https://issues.apache.org/jira/browse/HIVE-22384 > Project: Hive > Issue Type: Improvement > Components: Standalone Metastore >Affects Versions: 2.3.7 >Reporter: fanshilun >Assignee: fanshilun >Priority: Major > Labels: cachedstore > Fix For: 2.3.7 > > Attachments: HIVE-22384.1.patch, HIVE-22384.2.patch, > HIVE-22384.3.patch, HIVE-22384.4.patch, HIVE-22384.5.patch, HIVE-22384.6.patch > > > CacheStored Function Cache have not been developed, this patch completes > related functions -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Commented] (HIVE-22394) Duplicate Jars in druid classpath causing issues
[
https://issues.apache.org/jira/browse/HIVE-22394?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16958323#comment-16958323
]
Hive QA commented on HIVE-22394:
Here are the results of testing the latest attachment:
https://issues.apache.org/jira/secure/attachment/12983853/HIVE-22394.patch
{color:red}ERROR:{color} -1 due to no test(s) being added or modified.
{color:green}SUCCESS:{color} +1 due to 17545 tests passed
Test results:
https://builds.apache.org/job/PreCommit-HIVE-Build/19132/testReport
Console output: https://builds.apache.org/job/PreCommit-HIVE-Build/19132/console
Test logs: http://104.198.109.242/logs/PreCommit-HIVE-Build-19132/
Messages:
{noformat}
Executing org.apache.hive.ptest.execution.TestCheckPhase
Executing org.apache.hive.ptest.execution.PrepPhase
Executing org.apache.hive.ptest.execution.YetusPhase
Executing org.apache.hive.ptest.execution.ExecutionPhase
Executing org.apache.hive.ptest.execution.ReportingPhase
{noformat}
This message is automatically generated.
ATTACHMENT ID: 12983853 - PreCommit-HIVE-Build
> Duplicate Jars in druid classpath causing issues
>
>
> Key: HIVE-22394
> URL: https://issues.apache.org/jira/browse/HIVE-22394
> Project: Hive
> Issue Type: Bug
>Reporter: Nishant Bangarwa
>Assignee: Nishant Bangarwa
>Priority: Major
> Labels: pull-request-available
> Attachments: HIVE-22394.patch
>
> Time Spent: 10m
> Remaining Estimate: 0h
>
> hive-druid-handler jar has shaded version of druid classes,
> druid-hdfs-storage also has non-shaded classes.
> {code}
> [hive@hiveserver2-1 lib]$ ls |grep druid
> calcite-druid-1.19.0.7.0.2.0-163.jar
> druid-bloom-filter-0.15.1.7.0.2.0-163.jar
> druid-hdfs-storage-0.15.1.7.0.2.0-163.jar
> hive-druid-handler-3.1.2000.7.0.2.0-163.jar
> hive-druid-handler.jar
> {code}
> Exception below -
> {code}
> Caused by: java.util.concurrent.ExecutionException:
> java.lang.RuntimeException: java.lang.RuntimeException:
> java.lang.NoClassDefFoundError: Could not initialize class
> org.apache.hadoop.fs.HadoopFsWrapper
> at
> org.apache.hive.druid.com.google.common.util.concurrent.AbstractFuture$Sync.getValue(AbstractFuture.java:299)
> at
> org.apache.hive.druid.com.google.common.util.concurrent.AbstractFuture$Sync.get(AbstractFuture.java:286)
> at
> org.apache.hive.druid.com.google.common.util.concurrent.AbstractFuture.get(AbstractFuture.java:116)
> at
> org.apache.hadoop.hive.druid.io.DruidRecordWriter.pushSegments(DruidRecordWriter.java:177)
> ... 22 more
> Caused by: java.lang.RuntimeException: java.lang.RuntimeException:
> java.lang.NoClassDefFoundError: Could not initialize class
> org.apache.hadoop.fs.HadoopFsWrapper
> at
> org.apache.hive.druid.org.apache.druid.segment.realtime.appenderator.AppenderatorImpl.mergeAndPush(AppenderatorImpl.java:765)
> at
> org.apache.hive.druid.org.apache.druid.segment.realtime.appenderator.AppenderatorImpl.lambda$push$1(AppenderatorImpl.java:630)
> at
> org.apache.hive.druid.com.google.common.util.concurrent.Futures$1.apply(Futures.java:713)
> at
> org.apache.hive.druid.com.google.common.util.concurrent.Futures$ChainingListenableFuture.run(Futures.java:861)
> ... 3 more
> Caused by: java.lang.RuntimeException: java.lang.NoClassDefFoundError: Could
> not initialize class org.apache.hadoop.fs.HadoopFsWrapper
> at
> org.apache.hive.druid.org.apache.druid.java.util.common.RetryUtils.retry(RetryUtils.java:96)
> at
> org.apache.hive.druid.org.apache.druid.java.util.common.RetryUtils.retry(RetryUtils.java:114)
> at
> org.apache.hive.druid.org.apache.druid.java.util.common.RetryUtils.retry(RetryUtils.java:104)
> at
> org.apache.hive.druid.org.apache.druid.segment.realtime.appenderator.AppenderatorImpl.mergeAndPush(AppenderatorImpl.java:743)
> ... 6 more
> Caused by: java.lang.NoClassDefFoundError: Could not initialize class
> org.apache.hadoop.fs.HadoopFsWrapper
> at
> org.apache.hive.druid.org.apache.druid.storage.hdfs.HdfsDataSegmentPusher.copyFilesWithChecks(HdfsDataSegmentPusher.java:163)
> at
> org.apache.hive.druid.org.apache.druid.storage.hdfs.HdfsDataSegmentPusher.push(HdfsDataSegmentPusher.java:145)
> at
> org.apache.hive.druid.org.apache.druid.segment.realtime.appenderator.AppenderatorImpl.lambda$mergeAndPush$4(AppenderatorImpl.java:747)
> at
> org.apache.hive.druid.org.apache.druid.java.util.common.RetryUtils.retry(RetryUtils.java:86)
> {code}
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
[jira] [Updated] (HIVE-22397) "describe table" statement for the table backed by custom storage handler fail with CNF
[
https://issues.apache.org/jira/browse/HIVE-22397?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Rajkumar Singh updated HIVE-22397:
--
Attachment: HIVE-22397.patch
Status: Patch Available (was: In Progress)
> "describe table" statement for the table backed by custom storage handler
> fail with CNF
>
>
> Key: HIVE-22397
> URL: https://issues.apache.org/jira/browse/HIVE-22397
> Project: Hive
> Issue Type: Bug
> Components: Hive
>Affects Versions: 3.1.2
>Reporter: Rajkumar Singh
>Assignee: Rajkumar Singh
>Priority: Major
> Attachments: HIVE-22397.patch
>
>
> Steps to Repro:
> {code:java}
> 1) describe customsdtable;
> 2) ADD JAR hdfs:///user/hive/customsdtable.jar;
> 3) describe customsdtable;
> CNF is expected for #1 but even adding the custome serde, hive fail with
> following exception for statement #3
> Error: Error while processing statement: FAILED: Execution Error, return code
> 1 from org.apache.hadoop.hive.ql.exec.DDLTask.
> java.lang.ClassNotFoundException
> {code}
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
[jira] [Work started] (HIVE-22397) "describe table" statement for the table backed by custom storage handler fail with CNF
[
https://issues.apache.org/jira/browse/HIVE-22397?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Work on HIVE-22397 started by Rajkumar Singh.
-
> "describe table" statement for the table backed by custom storage handler
> fail with CNF
>
>
> Key: HIVE-22397
> URL: https://issues.apache.org/jira/browse/HIVE-22397
> Project: Hive
> Issue Type: Bug
> Components: Hive
>Affects Versions: 3.1.2
>Reporter: Rajkumar Singh
>Assignee: Rajkumar Singh
>Priority: Major
> Attachments: HIVE-22397.patch
>
>
> Steps to Repro:
> {code:java}
> 1) describe customsdtable;
> 2) ADD JAR hdfs:///user/hive/customsdtable.jar;
> 3) describe customsdtable;
> CNF is expected for #1 but even adding the custome serde, hive fail with
> following exception for statement #3
> Error: Error while processing statement: FAILED: Execution Error, return code
> 1 from org.apache.hadoop.hive.ql.exec.DDLTask.
> java.lang.ClassNotFoundException
> {code}
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
[jira] [Assigned] (HIVE-22397) "describe table" statement for the table backed by custom storage handler fail with CNF
[
https://issues.apache.org/jira/browse/HIVE-22397?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Rajkumar Singh reassigned HIVE-22397:
-
> "describe table" statement for the table backed by custom storage handler
> fail with CNF
>
>
> Key: HIVE-22397
> URL: https://issues.apache.org/jira/browse/HIVE-22397
> Project: Hive
> Issue Type: Bug
> Components: Hive
>Affects Versions: 3.1.2
>Reporter: Rajkumar Singh
>Assignee: Rajkumar Singh
>Priority: Major
>
> Steps to Repro:
> {code:java}
> 1) describe customsdtable;
> 2) ADD JAR hdfs:///user/hive/customsdtable.jar;
> 3) describe customsdtable;
> CNF is expected for #1 but even adding the custome serde, hive fail with
> following exception for statement #3
> Error: Error while processing statement: FAILED: Execution Error, return code
> 1 from org.apache.hadoop.hive.ql.exec.DDLTask.
> java.lang.ClassNotFoundException
> {code}
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
[jira] [Updated] (HIVE-22391) NPE while checking Hive query results cache
[
https://issues.apache.org/jira/browse/HIVE-22391?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Jason Dere updated HIVE-22391:
--
Fix Version/s: 4.0.0
Resolution: Fixed
Status: Resolved (was: Patch Available)
Committed to master
> NPE while checking Hive query results cache
> ---
>
> Key: HIVE-22391
> URL: https://issues.apache.org/jira/browse/HIVE-22391
> Project: Hive
> Issue Type: Bug
> Components: Query Planning
>Reporter: Jason Dere
>Assignee: Jason Dere
>Priority: Major
> Fix For: 4.0.0
>
> Attachments: HIVE-22391.1.patch
>
>
> NPE when results cache was enabled:
> {noformat}
> 2019-10-21T14:51:55,718 ERROR [b7d7bea8-eef0-4ea4-ae12-951cb5dc96e3
> HiveServer2-Handler-Pool: Thread-210]: ql.Driver (:()) - FAILED:
> NullPointerException null
> java.lang.NullPointerException
> at
> org.apache.hadoop.hive.ql.parse.SemanticAnalyzer.checkResultsCache(SemanticAnalyzer.java:15061)
> at
> org.apache.hadoop.hive.ql.parse.SemanticAnalyzer.analyzeInternal(SemanticAnalyzer.java:12320)
> at
> org.apache.hadoop.hive.ql.parse.CalcitePlanner.analyzeInternal(CalcitePlanner.java:360)
> at
> org.apache.hadoop.hive.ql.parse.BaseSemanticAnalyzer.analyze(BaseSemanticAnalyzer.java:289)
> at org.apache.hadoop.hive.ql.Driver.compile(Driver.java:664)
> at org.apache.hadoop.hive.ql.Driver.compileInternal(Driver.java:1869)
> at
> org.apache.hadoop.hive.ql.Driver.compileAndRespond(Driver.java:1816)
> at
> org.apache.hadoop.hive.ql.Driver.compileAndRespond(Driver.java:1811)
> at
> org.apache.hadoop.hive.ql.reexec.ReExecDriver.compileAndRespond(ReExecDriver.java:126)
> at
> org.apache.hive.service.cli.operation.SQLOperation.prepare(SQLOperation.java:197)
> at
> org.apache.hive.service.cli.operation.SQLOperation.runInternal(SQLOperation.java:262)
> at
> org.apache.hive.service.cli.operation.Operation.run(Operation.java:247)
> at
> org.apache.hive.service.cli.session.HiveSessionImpl.executeStatementInternal(HiveSessionImpl.java:575)
> at
> org.apache.hive.service.cli.session.HiveSessionImpl.executeStatementAsync(HiveSessionImpl.java:561)
> at
> org.apache.hive.service.cli.CLIService.executeStatementAsync(CLIService.java:315)
> at
> org.apache.hive.service.cli.thrift.ThriftCLIService.ExecuteStatement(ThriftCLIService.java:566)
> at
> org.apache.hive.service.rpc.thrift.TCLIService$Processor$ExecuteStatement.getResult(TCLIService.java:1557)
> at
> org.apache.hive.service.rpc.thrift.TCLIService$Processor$ExecuteStatement.getResult(TCLIService.java:1542)
> at org.apache.thrift.ProcessFunction.process(ProcessFunction.java:39)
> at org.apache.thrift.TBaseProcessor.process(TBaseProcessor.java:39)
> at
> org.apache.hadoop.hive.metastore.security.HadoopThriftAuthBridge$Server$TUGIAssumingProcessor.process(HadoopThriftAuthBridge.java:647)
> at
> org.apache.thrift.server.TThreadPoolServer$WorkerProcess.run(TThreadPoolServer.java:286)
> at
> java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
> at
> java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
> at java.lang.Thread.run(Thread.java:748)
> {noformat}
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
[jira] [Commented] (HIVE-22394) Duplicate Jars in druid classpath causing issues
[
https://issues.apache.org/jira/browse/HIVE-22394?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16958276#comment-16958276
]
Hive QA commented on HIVE-22394:
| (/) *{color:green}+1 overall{color}* |
\\
\\
|| Vote || Subsystem || Runtime || Comment ||
|| || || || {color:brown} Prechecks {color} ||
| {color:green}+1{color} | {color:green} @author {color} | {color:green} 0m
0s{color} | {color:green} The patch does not contain any @author tags. {color} |
|| || || || {color:brown} master Compile Tests {color} ||
| {color:green}+1{color} | {color:green} mvninstall {color} | {color:green} 9m
5s{color} | {color:green} master passed {color} |
| {color:green}+1{color} | {color:green} compile {color} | {color:green} 0m
19s{color} | {color:green} master passed {color} |
| {color:green}+1{color} | {color:green} javadoc {color} | {color:green} 0m
14s{color} | {color:green} master passed {color} |
|| || || || {color:brown} Patch Compile Tests {color} ||
| {color:green}+1{color} | {color:green} mvninstall {color} | {color:green} 0m
35s{color} | {color:green} the patch passed {color} |
| {color:green}+1{color} | {color:green} compile {color} | {color:green} 0m
19s{color} | {color:green} the patch passed {color} |
| {color:green}+1{color} | {color:green} javac {color} | {color:green} 0m
19s{color} | {color:green} the patch passed {color} |
| {color:green}+1{color} | {color:green} whitespace {color} | {color:green} 0m
0s{color} | {color:green} The patch has no whitespace issues. {color} |
| {color:green}+1{color} | {color:green} xml {color} | {color:green} 0m
2s{color} | {color:green} The patch has no ill-formed XML file. {color} |
| {color:green}+1{color} | {color:green} javadoc {color} | {color:green} 0m
13s{color} | {color:green} the patch passed {color} |
|| || || || {color:brown} Other Tests {color} ||
| {color:green}+1{color} | {color:green} asflicense {color} | {color:green} 0m
14s{color} | {color:green} The patch does not generate ASF License warnings.
{color} |
| {color:black}{color} | {color:black} {color} | {color:black} 11m 22s{color} |
{color:black} {color} |
\\
\\
|| Subsystem || Report/Notes ||
| Optional Tests | asflicense javac javadoc xml compile |
| uname | Linux hiveptest-server-upstream 3.16.0-4-amd64 #1 SMP Debian
3.16.43-2+deb8u5 (2017-09-19) x86_64 GNU/Linux |
| Build tool | maven |
| Personality |
/data/hiveptest/working/yetus_PreCommit-HIVE-Build-19132/dev-support/hive-personality.sh
|
| git revision | master / d5ca6f6 |
| Default Java | 1.8.0_111 |
| modules | C: druid-handler U: druid-handler |
| Console output |
http://104.198.109.242/logs//PreCommit-HIVE-Build-19132/yetus.txt |
| Powered by | Apache Yetushttp://yetus.apache.org |
This message was automatically generated.
> Duplicate Jars in druid classpath causing issues
>
>
> Key: HIVE-22394
> URL: https://issues.apache.org/jira/browse/HIVE-22394
> Project: Hive
> Issue Type: Bug
>Reporter: Nishant Bangarwa
>Assignee: Nishant Bangarwa
>Priority: Major
> Labels: pull-request-available
> Attachments: HIVE-22394.patch
>
> Time Spent: 10m
> Remaining Estimate: 0h
>
> hive-druid-handler jar has shaded version of druid classes,
> druid-hdfs-storage also has non-shaded classes.
> {code}
> [hive@hiveserver2-1 lib]$ ls |grep druid
> calcite-druid-1.19.0.7.0.2.0-163.jar
> druid-bloom-filter-0.15.1.7.0.2.0-163.jar
> druid-hdfs-storage-0.15.1.7.0.2.0-163.jar
> hive-druid-handler-3.1.2000.7.0.2.0-163.jar
> hive-druid-handler.jar
> {code}
> Exception below -
> {code}
> Caused by: java.util.concurrent.ExecutionException:
> java.lang.RuntimeException: java.lang.RuntimeException:
> java.lang.NoClassDefFoundError: Could not initialize class
> org.apache.hadoop.fs.HadoopFsWrapper
> at
> org.apache.hive.druid.com.google.common.util.concurrent.AbstractFuture$Sync.getValue(AbstractFuture.java:299)
> at
> org.apache.hive.druid.com.google.common.util.concurrent.AbstractFuture$Sync.get(AbstractFuture.java:286)
> at
> org.apache.hive.druid.com.google.common.util.concurrent.AbstractFuture.get(AbstractFuture.java:116)
> at
> org.apache.hadoop.hive.druid.io.DruidRecordWriter.pushSegments(DruidRecordWriter.java:177)
> ... 22 more
> Caused by: java.lang.RuntimeException: java.lang.RuntimeException:
> java.lang.NoClassDefFoundError: Could not initialize class
> org.apache.hadoop.fs.HadoopFsWrapper
> at
> org.apache.hive.druid.org.apache.druid.segment.realtime.appenderator.AppenderatorImpl.mergeAndPush(AppenderatorImpl.java:765)
> at
> org.apache.hive.druid.org.apache.druid.segment.realtime.appenderator.AppenderatorImpl.lambda$push$1(AppenderatorImpl.java:630)
> at
> org.apache.hive.druid.com.google.common.util.concurrent.Futures$1.apply(Futures.java:713)
> at
>
[jira] [Updated] (HIVE-22367) Transaction type not retrieved from OpenTxnRequest
[ https://issues.apache.org/jira/browse/HIVE-22367?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Denys Kuzmenko updated HIVE-22367: -- Attachment: HIVE-22367.5.patch > Transaction type not retrieved from OpenTxnRequest > -- > > Key: HIVE-22367 > URL: https://issues.apache.org/jira/browse/HIVE-22367 > Project: Hive > Issue Type: Bug > Components: Transactions >Reporter: Denys Kuzmenko >Assignee: Denys Kuzmenko >Priority: Major > Attachments: HIVE-22367.1.patch, HIVE-22367.2.patch, > HIVE-22367.3.patch, HIVE-22367.4.patch, HIVE-22367.5.patch > > > When opening a transaction, its type should be extracted from OpenTxnRequest > object. Currently it's hardcoded with TxnType.DEFAULT. -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Commented] (HIVE-22392) Hive JDBC Storage Handler: Support For Writing Data to JDBC Data Source
[
https://issues.apache.org/jira/browse/HIVE-22392?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16958267#comment-16958267
]
Hive QA commented on HIVE-22392:
Here are the results of testing the latest attachment:
https://issues.apache.org/jira/secure/attachment/12983852/HIVE-22392.02.patch
{color:green}SUCCESS:{color} +1 due to 1 test(s) being added or modified.
{color:green}SUCCESS:{color} +1 due to 17545 tests passed
Test results:
https://builds.apache.org/job/PreCommit-HIVE-Build/19131/testReport
Console output: https://builds.apache.org/job/PreCommit-HIVE-Build/19131/console
Test logs: http://104.198.109.242/logs/PreCommit-HIVE-Build-19131/
Messages:
{noformat}
Executing org.apache.hive.ptest.execution.TestCheckPhase
Executing org.apache.hive.ptest.execution.PrepPhase
Executing org.apache.hive.ptest.execution.YetusPhase
Executing org.apache.hive.ptest.execution.ExecutionPhase
Executing org.apache.hive.ptest.execution.ReportingPhase
{noformat}
This message is automatically generated.
ATTACHMENT ID: 12983852 - PreCommit-HIVE-Build
> Hive JDBC Storage Handler: Support For Writing Data to JDBC Data Source
> ---
>
> Key: HIVE-22392
> URL: https://issues.apache.org/jira/browse/HIVE-22392
> Project: Hive
> Issue Type: New Feature
> Components: StorageHandler
>Reporter: Syed Shameerur Rahman
>Assignee: Syed Shameerur Rahman
>Priority: Major
> Attachments: HIVE-22392.01.patch, HIVE-22392.02.patch
>
>
> JDBC Storage Handler supports reading from JDBC data source in Hive.
> Currently writing to a JDBC data source is not supported. Hence adding
> support for simple insert query so that the data can be written back to JDBC
> data source.
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
[jira] [Updated] (HIVE-22378) Remove code duplicatoins from return path handling
[ https://issues.apache.org/jira/browse/HIVE-22378?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Miklos Gergely updated HIVE-22378: -- Attachment: HIVE-22378.01.patch > Remove code duplicatoins from return path handling > -- > > Key: HIVE-22378 > URL: https://issues.apache.org/jira/browse/HIVE-22378 > Project: Hive > Issue Type: Sub-task > Components: Hive >Reporter: Miklos Gergely >Assignee: Miklos Gergely >Priority: Major > Fix For: 4.0.0 > > Attachments: HIVE-22378.01.patch > > > Return path handling have some code duplications, they should be removed. -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Updated] (HIVE-22378) Remove code duplicatoins from return path handling
[ https://issues.apache.org/jira/browse/HIVE-22378?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Miklos Gergely updated HIVE-22378: -- Attachment: (was: HIVE-22378.01.patch) > Remove code duplicatoins from return path handling > -- > > Key: HIVE-22378 > URL: https://issues.apache.org/jira/browse/HIVE-22378 > Project: Hive > Issue Type: Sub-task > Components: Hive >Reporter: Miklos Gergely >Assignee: Miklos Gergely >Priority: Major > Fix For: 4.0.0 > > Attachments: HIVE-22378.01.patch > > > Return path handling have some code duplications, they should be removed. -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Commented] (HIVE-22392) Hive JDBC Storage Handler: Support For Writing Data to JDBC Data Source
[
https://issues.apache.org/jira/browse/HIVE-22392?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16958232#comment-16958232
]
Hive QA commented on HIVE-22392:
| (/) *{color:green}+1 overall{color}* |
\\
\\
|| Vote || Subsystem || Runtime || Comment ||
|| || || || {color:brown} Prechecks {color} ||
| {color:green}+1{color} | {color:green} @author {color} | {color:green} 0m
0s{color} | {color:green} The patch does not contain any @author tags. {color} |
|| || || || {color:brown} master Compile Tests {color} ||
| {color:blue}0{color} | {color:blue} mvndep {color} | {color:blue} 1m
44s{color} | {color:blue} Maven dependency ordering for branch {color} |
| {color:green}+1{color} | {color:green} mvninstall {color} | {color:green} 7m
22s{color} | {color:green} master passed {color} |
| {color:green}+1{color} | {color:green} compile {color} | {color:green} 1m
24s{color} | {color:green} master passed {color} |
| {color:green}+1{color} | {color:green} checkstyle {color} | {color:green} 0m
50s{color} | {color:green} master passed {color} |
| {color:blue}0{color} | {color:blue} findbugs {color} | {color:blue} 4m
5s{color} | {color:blue} ql in master has 1545 extant Findbugs warnings.
{color} |
| {color:blue}0{color} | {color:blue} findbugs {color} | {color:blue} 0m
25s{color} | {color:blue} jdbc-handler in master has 11 extant Findbugs
warnings. {color} |
| {color:green}+1{color} | {color:green} javadoc {color} | {color:green} 1m
11s{color} | {color:green} master passed {color} |
|| || || || {color:brown} Patch Compile Tests {color} ||
| {color:blue}0{color} | {color:blue} mvndep {color} | {color:blue} 0m
27s{color} | {color:blue} Maven dependency ordering for patch {color} |
| {color:green}+1{color} | {color:green} mvninstall {color} | {color:green} 1m
44s{color} | {color:green} the patch passed {color} |
| {color:green}+1{color} | {color:green} compile {color} | {color:green} 1m
22s{color} | {color:green} the patch passed {color} |
| {color:green}+1{color} | {color:green} javac {color} | {color:green} 1m
22s{color} | {color:green} the patch passed {color} |
| {color:green}+1{color} | {color:green} checkstyle {color} | {color:green} 0m
51s{color} | {color:green} the patch passed {color} |
| {color:green}+1{color} | {color:green} whitespace {color} | {color:green} 0m
0s{color} | {color:green} The patch has no whitespace issues. {color} |
| {color:green}+1{color} | {color:green} findbugs {color} | {color:green} 4m
59s{color} | {color:green} the patch passed {color} |
| {color:green}+1{color} | {color:green} javadoc {color} | {color:green} 1m
14s{color} | {color:green} the patch passed {color} |
|| || || || {color:brown} Other Tests {color} ||
| {color:green}+1{color} | {color:green} asflicense {color} | {color:green} 0m
15s{color} | {color:green} The patch does not generate ASF License warnings.
{color} |
| {color:black}{color} | {color:black} {color} | {color:black} 28m 39s{color} |
{color:black} {color} |
\\
\\
|| Subsystem || Report/Notes ||
| Optional Tests | asflicense javac javadoc findbugs checkstyle compile |
| uname | Linux hiveptest-server-upstream 3.16.0-4-amd64 #1 SMP Debian
3.16.43-2+deb8u5 (2017-09-19) x86_64 GNU/Linux |
| Build tool | maven |
| Personality |
/data/hiveptest/working/yetus_PreCommit-HIVE-Build-19131/dev-support/hive-personality.sh
|
| git revision | master / d5ca6f6 |
| Default Java | 1.8.0_111 |
| findbugs | v3.0.1 |
| modules | C: ql jdbc-handler U: . |
| Console output |
http://104.198.109.242/logs//PreCommit-HIVE-Build-19131/yetus.txt |
| Powered by | Apache Yetushttp://yetus.apache.org |
This message was automatically generated.
> Hive JDBC Storage Handler: Support For Writing Data to JDBC Data Source
> ---
>
> Key: HIVE-22392
> URL: https://issues.apache.org/jira/browse/HIVE-22392
> Project: Hive
> Issue Type: New Feature
> Components: StorageHandler
>Reporter: Syed Shameerur Rahman
>Assignee: Syed Shameerur Rahman
>Priority: Major
> Attachments: HIVE-22392.01.patch, HIVE-22392.02.patch
>
>
> JDBC Storage Handler supports reading from JDBC data source in Hive.
> Currently writing to a JDBC data source is not supported. Hence adding
> support for simple insert query so that the data can be written back to JDBC
> data source.
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
[jira] [Work logged] (HIVE-22396) CMV creating a Full ACID partitioned table fails because of no writeId
[
https://issues.apache.org/jira/browse/HIVE-22396?focusedWorklogId=332845=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-332845
]
ASF GitHub Bot logged work on HIVE-22396:
-
Author: ASF GitHub Bot
Created on: 23/Oct/19 20:19
Start Date: 23/Oct/19 20:19
Worklog Time Spent: 10m
Work Description: jcamachor commented on pull request #826: HIVE-22396
URL: https://github.com/apache/hive/pull/826
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
us...@infra.apache.org
Issue Time Tracking
---
Worklog Id: (was: 332845)
Remaining Estimate: 0h
Time Spent: 10m
> CMV creating a Full ACID partitioned table fails because of no writeId
> --
>
> Key: HIVE-22396
> URL: https://issues.apache.org/jira/browse/HIVE-22396
> Project: Hive
> Issue Type: Sub-task
> Components: HiveServer2, repl
>Affects Versions: 4.0.0
>Reporter: Jesus Camacho Rodriguez
>Assignee: Jesus Camacho Rodriguez
>Priority: Major
> Labels: pull-request-available
> Attachments: HIVE-22396.patch
>
> Time Spent: 10m
> Remaining Estimate: 0h
>
> create materialized view acid_cmv_part disable rewrite partitioned on (k)
> stored as orc TBLPROPERTIES ('transactional'='true')
> as select key k, value from src order by k limit 5;
> ERROR : FAILED: Execution Error, return code 1 from
> org.apache.hadoop.hive.ql.exec.MoveTask. MoveTask : Write id is not set in
> the config by open txn task for migration
> Error: Error while processing statement: FAILED: Execution Error, return code
> 1 from org.apache.hadoop.hive.ql.exec.MoveTask. MoveTask : Write id is not
> set in the config by open txn task for migration (state=08S01,code=1)
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
[jira] [Updated] (HIVE-22396) CMV creating a Full ACID partitioned table fails because of no writeId
[
https://issues.apache.org/jira/browse/HIVE-22396?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Jesus Camacho Rodriguez updated HIVE-22396:
---
Attachment: HIVE-22396.patch
> CMV creating a Full ACID partitioned table fails because of no writeId
> --
>
> Key: HIVE-22396
> URL: https://issues.apache.org/jira/browse/HIVE-22396
> Project: Hive
> Issue Type: Sub-task
> Components: HiveServer2, repl
>Affects Versions: 4.0.0
>Reporter: Jesus Camacho Rodriguez
>Assignee: Jesus Camacho Rodriguez
>Priority: Major
> Labels: pull-request-available
> Attachments: HIVE-22396.patch
>
>
> create materialized view acid_cmv_part disable rewrite partitioned on (k)
> stored as orc TBLPROPERTIES ('transactional'='true')
> as select key k, value from src order by k limit 5;
> ERROR : FAILED: Execution Error, return code 1 from
> org.apache.hadoop.hive.ql.exec.MoveTask. MoveTask : Write id is not set in
> the config by open txn task for migration
> Error: Error while processing statement: FAILED: Execution Error, return code
> 1 from org.apache.hadoop.hive.ql.exec.MoveTask. MoveTask : Write id is not
> set in the config by open txn task for migration (state=08S01,code=1)
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
[jira] [Work started] (HIVE-22396) CMV creating a Full ACID partitioned table fails because of no writeId
[
https://issues.apache.org/jira/browse/HIVE-22396?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Work on HIVE-22396 started by Jesus Camacho Rodriguez.
--
> CMV creating a Full ACID partitioned table fails because of no writeId
> --
>
> Key: HIVE-22396
> URL: https://issues.apache.org/jira/browse/HIVE-22396
> Project: Hive
> Issue Type: Sub-task
> Components: HiveServer2, repl
>Affects Versions: 4.0.0
>Reporter: Jesus Camacho Rodriguez
>Assignee: Jesus Camacho Rodriguez
>Priority: Major
> Labels: pull-request-available
>
> create materialized view acid_cmv_part disable rewrite partitioned on (k)
> stored as orc TBLPROPERTIES ('transactional'='true')
> as select key k, value from src order by k limit 5;
> ERROR : FAILED: Execution Error, return code 1 from
> org.apache.hadoop.hive.ql.exec.MoveTask. MoveTask : Write id is not set in
> the config by open txn task for migration
> Error: Error while processing statement: FAILED: Execution Error, return code
> 1 from org.apache.hadoop.hive.ql.exec.MoveTask. MoveTask : Write id is not
> set in the config by open txn task for migration (state=08S01,code=1)
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
[jira] [Updated] (HIVE-22396) CMV creating a Full ACID partitioned table fails because of no writeId
[
https://issues.apache.org/jira/browse/HIVE-22396?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Jesus Camacho Rodriguez updated HIVE-22396:
---
Status: Patch Available (was: In Progress)
> CMV creating a Full ACID partitioned table fails because of no writeId
> --
>
> Key: HIVE-22396
> URL: https://issues.apache.org/jira/browse/HIVE-22396
> Project: Hive
> Issue Type: Sub-task
> Components: HiveServer2, repl
>Affects Versions: 4.0.0
>Reporter: Jesus Camacho Rodriguez
>Assignee: Jesus Camacho Rodriguez
>Priority: Major
> Labels: pull-request-available
>
> create materialized view acid_cmv_part disable rewrite partitioned on (k)
> stored as orc TBLPROPERTIES ('transactional'='true')
> as select key k, value from src order by k limit 5;
> ERROR : FAILED: Execution Error, return code 1 from
> org.apache.hadoop.hive.ql.exec.MoveTask. MoveTask : Write id is not set in
> the config by open txn task for migration
> Error: Error while processing statement: FAILED: Execution Error, return code
> 1 from org.apache.hadoop.hive.ql.exec.MoveTask. MoveTask : Write id is not
> set in the config by open txn task for migration (state=08S01,code=1)
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
[jira] [Assigned] (HIVE-22396) CMV creating a Full ACID partitioned table fails because of no writeId
[
https://issues.apache.org/jira/browse/HIVE-22396?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Jesus Camacho Rodriguez reassigned HIVE-22396:
--
Assignee: Jesus Camacho Rodriguez (was: Ashutosh Bapat)
> CMV creating a Full ACID partitioned table fails because of no writeId
> --
>
> Key: HIVE-22396
> URL: https://issues.apache.org/jira/browse/HIVE-22396
> Project: Hive
> Issue Type: Sub-task
> Components: HiveServer2, repl
>Affects Versions: 4.0.0
>Reporter: Ashutosh Bapat
>Assignee: Jesus Camacho Rodriguez
>Priority: Major
> Labels: pull-request-available
>
> create materialized view acid_cmv_part disable rewrite partitioned on (k)
> stored as orc TBLPROPERTIES ('transactional'='true')
> as select key k, value from src order by k limit 5;
> ERROR : FAILED: Execution Error, return code 1 from
> org.apache.hadoop.hive.ql.exec.MoveTask. MoveTask : Write id is not set in
> the config by open txn task for migration
> Error: Error while processing statement: FAILED: Execution Error, return code
> 1 from org.apache.hadoop.hive.ql.exec.MoveTask. MoveTask : Write id is not
> set in the config by open txn task for migration (state=08S01,code=1)
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
[jira] [Updated] (HIVE-22396) CMV creating a Full ACID partitioned table fails because of no writeId
[
https://issues.apache.org/jira/browse/HIVE-22396?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Jesus Camacho Rodriguez updated HIVE-22396:
---
Description:
create materialized view acid_cmv_part disable rewrite partitioned on (k)
stored as orc TBLPROPERTIES ('transactional'='true')
as select key k, value from src order by k limit 5;
ERROR : FAILED: Execution Error, return code 1 from
org.apache.hadoop.hive.ql.exec.MoveTask. MoveTask : Write id is not set in the
config by open txn task for migration
Error: Error while processing statement: FAILED: Execution Error, return code 1
from org.apache.hadoop.hive.ql.exec.MoveTask. MoveTask : Write id is not set in
the config by open txn task for migration (state=08S01,code=1)
was:
create table t1(a int, b int);
insert into t1 values (1, 2), (3, 4);
create table t6_part partitioned by (a) stored as orc tblproperties
("transactional"="true") as select * from t1;
ERROR : FAILED: Execution Error, return code 1 from
org.apache.hadoop.hive.ql.exec.MoveTask. MoveTask : Write id is not set in the
config by open txn task for migration
Error: Error while processing statement: FAILED: Execution Error, return code 1
from org.apache.hadoop.hive.ql.exec.MoveTask. MoveTask : Write id is not set in
the config by open txn task for migration (state=08S01,code=1)
> CMV creating a Full ACID partitioned table fails because of no writeId
> --
>
> Key: HIVE-22396
> URL: https://issues.apache.org/jira/browse/HIVE-22396
> Project: Hive
> Issue Type: Sub-task
> Components: HiveServer2, repl
>Affects Versions: 4.0.0
>Reporter: Ashutosh Bapat
>Assignee: Ashutosh Bapat
>Priority: Major
> Labels: pull-request-available
>
> create materialized view acid_cmv_part disable rewrite partitioned on (k)
> stored as orc TBLPROPERTIES ('transactional'='true')
> as select key k, value from src order by k limit 5;
> ERROR : FAILED: Execution Error, return code 1 from
> org.apache.hadoop.hive.ql.exec.MoveTask. MoveTask : Write id is not set in
> the config by open txn task for migration
> Error: Error while processing statement: FAILED: Execution Error, return code
> 1 from org.apache.hadoop.hive.ql.exec.MoveTask. MoveTask : Write id is not
> set in the config by open txn task for migration (state=08S01,code=1)
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
[jira] [Updated] (HIVE-22396) CMV creating a Full ACID partitioned table fails because of no writeId
[
https://issues.apache.org/jira/browse/HIVE-22396?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Jesus Camacho Rodriguez updated HIVE-22396:
---
Reporter: Jesus Camacho Rodriguez (was: Ashutosh Bapat)
> CMV creating a Full ACID partitioned table fails because of no writeId
> --
>
> Key: HIVE-22396
> URL: https://issues.apache.org/jira/browse/HIVE-22396
> Project: Hive
> Issue Type: Sub-task
> Components: HiveServer2, repl
>Affects Versions: 4.0.0
>Reporter: Jesus Camacho Rodriguez
>Assignee: Jesus Camacho Rodriguez
>Priority: Major
> Labels: pull-request-available
>
> create materialized view acid_cmv_part disable rewrite partitioned on (k)
> stored as orc TBLPROPERTIES ('transactional'='true')
> as select key k, value from src order by k limit 5;
> ERROR : FAILED: Execution Error, return code 1 from
> org.apache.hadoop.hive.ql.exec.MoveTask. MoveTask : Write id is not set in
> the config by open txn task for migration
> Error: Error while processing statement: FAILED: Execution Error, return code
> 1 from org.apache.hadoop.hive.ql.exec.MoveTask. MoveTask : Write id is not
> set in the config by open txn task for migration (state=08S01,code=1)
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
[jira] [Assigned] (HIVE-22396) CMV creating a Full ACID partitioned table fails because of no writeId
[
https://issues.apache.org/jira/browse/HIVE-22396?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Jesus Camacho Rodriguez reassigned HIVE-22396:
--
> CMV creating a Full ACID partitioned table fails because of no writeId
> --
>
> Key: HIVE-22396
> URL: https://issues.apache.org/jira/browse/HIVE-22396
> Project: Hive
> Issue Type: Sub-task
> Components: HiveServer2, repl
>Affects Versions: 4.0.0
>Reporter: Ashutosh Bapat
>Assignee: Ashutosh Bapat
>Priority: Major
> Labels: pull-request-available
>
> create table t1(a int, b int);
> insert into t1 values (1, 2), (3, 4);
> create table t6_part partitioned by (a) stored as orc tblproperties
> ("transactional"="true") as select * from t1;
> ERROR : FAILED: Execution Error, return code 1 from
> org.apache.hadoop.hive.ql.exec.MoveTask. MoveTask : Write id is not set in
> the config by open txn task for migration
> Error: Error while processing statement: FAILED: Execution Error, return code
> 1 from org.apache.hadoop.hive.ql.exec.MoveTask. MoveTask : Write id is not
> set in the config by open txn task for migration (state=08S01,code=1)
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
[jira] [Commented] (HIVE-22384) Hive MetaStore Cache Stored funcion Cache
[
https://issues.apache.org/jira/browse/HIVE-22384?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16958208#comment-16958208
]
Hive QA commented on HIVE-22384:
Here are the results of testing the latest attachment:
https://issues.apache.org/jira/secure/attachment/12983840/HIVE-22384.5.patch
{color:red}ERROR:{color} -1 due to build exiting with an error
Test results:
https://builds.apache.org/job/PreCommit-HIVE-Build/19130/testReport
Console output: https://builds.apache.org/job/PreCommit-HIVE-Build/19130/console
Test logs: http://104.198.109.242/logs/PreCommit-HIVE-Build-19130/
Messages:
{noformat}
Executing org.apache.hive.ptest.execution.TestCheckPhase
Tests exited with: Exception: Patch URL
https://issues.apache.org/jira/secure/attachment/12983840/HIVE-22384.5.patch
was found in seen patch url's cache and a test was probably run already on it.
Aborting...
{noformat}
This message is automatically generated.
ATTACHMENT ID: 12983840 - PreCommit-HIVE-Build
> Hive MetaStore Cache Stored funcion Cache
> -
>
> Key: HIVE-22384
> URL: https://issues.apache.org/jira/browse/HIVE-22384
> Project: Hive
> Issue Type: Improvement
> Components: Standalone Metastore
>Affects Versions: 2.3.7
>Reporter: fanshilun
>Assignee: fanshilun
>Priority: Major
> Labels: cachedstore
> Fix For: 2.3.7
>
> Attachments: HIVE-22384.1.patch, HIVE-22384.2.patch,
> HIVE-22384.3.patch, HIVE-22384.4.patch, HIVE-22384.5.patch
>
>
> CacheStored Function Cache have not been developed, this patch completes
> related functions
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
[jira] [Commented] (HIVE-21581) Remove Lock in GetInputSummary
[
https://issues.apache.org/jira/browse/HIVE-21581?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16958204#comment-16958204
]
Hive QA commented on HIVE-21581:
Here are the results of testing the latest attachment:
https://issues.apache.org/jira/secure/attachment/12983838/HIVE-21581.3.patch
{color:red}ERROR:{color} -1 due to no test(s) being added or modified.
{color:green}SUCCESS:{color} +1 due to 17545 tests passed
Test results:
https://builds.apache.org/job/PreCommit-HIVE-Build/19129/testReport
Console output: https://builds.apache.org/job/PreCommit-HIVE-Build/19129/console
Test logs: http://104.198.109.242/logs/PreCommit-HIVE-Build-19129/
Messages:
{noformat}
Executing org.apache.hive.ptest.execution.TestCheckPhase
Executing org.apache.hive.ptest.execution.PrepPhase
Executing org.apache.hive.ptest.execution.YetusPhase
Executing org.apache.hive.ptest.execution.ExecutionPhase
Executing org.apache.hive.ptest.execution.ReportingPhase
{noformat}
This message is automatically generated.
ATTACHMENT ID: 12983838 - PreCommit-HIVE-Build
> Remove Lock in GetInputSummary
> --
>
> Key: HIVE-21581
> URL: https://issues.apache.org/jira/browse/HIVE-21581
> Project: Hive
> Issue Type: Improvement
> Components: HiveServer2
>Affects Versions: 4.0.0, 3.2.0
>Reporter: David Mollitor
>Assignee: David Mollitor
>Priority: Major
> Fix For: 4.0.0
>
> Attachments: HIVE-21581.1.patch, HIVE-21581.2.patch,
> HIVE-21581.3.patch
>
>
> Now that Hive compile lock has been relaxed in [HIVE-20535], remove the
> {{getInputSummary}} lock:
> [https://github.com/apache/hive/blob/master/ql/src/java/org/apache/hadoop/hive/ql/exec/Utilities.java#L2459]
>
>
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
[jira] [Work logged] (HIVE-22395) Add ability to read Druid metastore password from jceks
[ https://issues.apache.org/jira/browse/HIVE-22395?focusedWorklogId=332809=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-332809 ] ASF GitHub Bot logged work on HIVE-22395: - Author: ASF GitHub Bot Created on: 23/Oct/19 19:09 Start Date: 23/Oct/19 19:09 Worklog Time Spent: 10m Work Description: nishantmonu51 commented on pull request #825: [HIVE-22395] ability to read druid metastore password from jceks store URL: https://github.com/apache/hive/pull/825 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org Issue Time Tracking --- Worklog Id: (was: 332809) Remaining Estimate: 0h Time Spent: 10m > Add ability to read Druid metastore password from jceks > --- > > Key: HIVE-22395 > URL: https://issues.apache.org/jira/browse/HIVE-22395 > Project: Hive > Issue Type: Bug >Reporter: Nishant Bangarwa >Assignee: Nishant Bangarwa >Priority: Major > Labels: pull-request-available > Attachments: HIVE-22395.patch > > Time Spent: 10m > Remaining Estimate: 0h > -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Updated] (HIVE-22395) Add ability to read Druid metastore password from jceks
[ https://issues.apache.org/jira/browse/HIVE-22395?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Nishant Bangarwa updated HIVE-22395: Status: Patch Available (was: Open) > Add ability to read Druid metastore password from jceks > --- > > Key: HIVE-22395 > URL: https://issues.apache.org/jira/browse/HIVE-22395 > Project: Hive > Issue Type: Bug >Reporter: Nishant Bangarwa >Assignee: Nishant Bangarwa >Priority: Major > Attachments: HIVE-22395.patch > > -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Updated] (HIVE-22395) Add ability to read Druid metastore password from jceks
[ https://issues.apache.org/jira/browse/HIVE-22395?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated HIVE-22395: -- Labels: pull-request-available (was: ) > Add ability to read Druid metastore password from jceks > --- > > Key: HIVE-22395 > URL: https://issues.apache.org/jira/browse/HIVE-22395 > Project: Hive > Issue Type: Bug >Reporter: Nishant Bangarwa >Assignee: Nishant Bangarwa >Priority: Major > Labels: pull-request-available > Attachments: HIVE-22395.patch > > -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Updated] (HIVE-22395) Add ability to read Druid metastore password from jceks
[ https://issues.apache.org/jira/browse/HIVE-22395?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Nishant Bangarwa updated HIVE-22395: Attachment: HIVE-22395.patch > Add ability to read Druid metastore password from jceks > --- > > Key: HIVE-22395 > URL: https://issues.apache.org/jira/browse/HIVE-22395 > Project: Hive > Issue Type: Bug >Reporter: Nishant Bangarwa >Assignee: Nishant Bangarwa >Priority: Major > Attachments: HIVE-22395.patch > > -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Commented] (HIVE-21581) Remove Lock in GetInputSummary
[
https://issues.apache.org/jira/browse/HIVE-21581?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16958173#comment-16958173
]
Hive QA commented on HIVE-21581:
| (x) *{color:red}-1 overall{color}* |
\\
\\
|| Vote || Subsystem || Runtime || Comment ||
|| || || || {color:brown} Prechecks {color} ||
| {color:green}+1{color} | {color:green} @author {color} | {color:green} 0m
0s{color} | {color:green} The patch does not contain any @author tags. {color} |
|| || || || {color:brown} master Compile Tests {color} ||
| {color:green}+1{color} | {color:green} mvninstall {color} | {color:green} 9m
27s{color} | {color:green} master passed {color} |
| {color:green}+1{color} | {color:green} compile {color} | {color:green} 1m
8s{color} | {color:green} master passed {color} |
| {color:green}+1{color} | {color:green} checkstyle {color} | {color:green} 0m
43s{color} | {color:green} master passed {color} |
| {color:blue}0{color} | {color:blue} findbugs {color} | {color:blue} 4m
14s{color} | {color:blue} ql in master has 1545 extant Findbugs warnings.
{color} |
| {color:green}+1{color} | {color:green} javadoc {color} | {color:green} 1m
1s{color} | {color:green} master passed {color} |
|| || || || {color:brown} Patch Compile Tests {color} ||
| {color:green}+1{color} | {color:green} mvninstall {color} | {color:green} 1m
28s{color} | {color:green} the patch passed {color} |
| {color:green}+1{color} | {color:green} compile {color} | {color:green} 1m
10s{color} | {color:green} the patch passed {color} |
| {color:green}+1{color} | {color:green} javac {color} | {color:green} 1m
10s{color} | {color:green} the patch passed {color} |
| {color:red}-1{color} | {color:red} checkstyle {color} | {color:red} 0m
43s{color} | {color:red} ql: The patch generated 1 new + 108 unchanged - 0
fixed = 109 total (was 108) {color} |
| {color:green}+1{color} | {color:green} whitespace {color} | {color:green} 0m
0s{color} | {color:green} The patch has no whitespace issues. {color} |
| {color:green}+1{color} | {color:green} findbugs {color} | {color:green} 4m
23s{color} | {color:green} the patch passed {color} |
| {color:green}+1{color} | {color:green} javadoc {color} | {color:green} 1m
3s{color} | {color:green} the patch passed {color} |
|| || || || {color:brown} Other Tests {color} ||
| {color:green}+1{color} | {color:green} asflicense {color} | {color:green} 0m
15s{color} | {color:green} The patch does not generate ASF License warnings.
{color} |
| {color:black}{color} | {color:black} {color} | {color:black} 26m 8s{color} |
{color:black} {color} |
\\
\\
|| Subsystem || Report/Notes ||
| Optional Tests | asflicense javac javadoc findbugs checkstyle compile |
| uname | Linux hiveptest-server-upstream 3.16.0-4-amd64 #1 SMP Debian
3.16.43-2+deb8u5 (2017-09-19) x86_64 GNU/Linux |
| Build tool | maven |
| Personality |
/data/hiveptest/working/yetus_PreCommit-HIVE-Build-19129/dev-support/hive-personality.sh
|
| git revision | master / d5ca6f6 |
| Default Java | 1.8.0_111 |
| findbugs | v3.0.1 |
| checkstyle |
http://104.198.109.242/logs//PreCommit-HIVE-Build-19129/yetus/diff-checkstyle-ql.txt
|
| modules | C: ql U: ql |
| Console output |
http://104.198.109.242/logs//PreCommit-HIVE-Build-19129/yetus.txt |
| Powered by | Apache Yetushttp://yetus.apache.org |
This message was automatically generated.
> Remove Lock in GetInputSummary
> --
>
> Key: HIVE-21581
> URL: https://issues.apache.org/jira/browse/HIVE-21581
> Project: Hive
> Issue Type: Improvement
> Components: HiveServer2
>Affects Versions: 4.0.0, 3.2.0
>Reporter: David Mollitor
>Assignee: David Mollitor
>Priority: Major
> Fix For: 4.0.0
>
> Attachments: HIVE-21581.1.patch, HIVE-21581.2.patch,
> HIVE-21581.3.patch
>
>
> Now that Hive compile lock has been relaxed in [HIVE-20535], remove the
> {{getInputSummary}} lock:
> [https://github.com/apache/hive/blob/master/ql/src/java/org/apache/hadoop/hive/ql/exec/Utilities.java#L2459]
>
>
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
[jira] [Commented] (HIVE-18415) Lower "Updating Partition Stats" Logging Level
[
https://issues.apache.org/jira/browse/HIVE-18415?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16958149#comment-16958149
]
Hive QA commented on HIVE-18415:
Here are the results of testing the latest attachment:
https://issues.apache.org/jira/secure/attachment/12983836/HIVE-18415.6.patch
{color:red}ERROR:{color} -1 due to no test(s) being added or modified.
{color:green}SUCCESS:{color} +1 due to 17545 tests passed
Test results:
https://builds.apache.org/job/PreCommit-HIVE-Build/19128/testReport
Console output: https://builds.apache.org/job/PreCommit-HIVE-Build/19128/console
Test logs: http://104.198.109.242/logs/PreCommit-HIVE-Build-19128/
Messages:
{noformat}
Executing org.apache.hive.ptest.execution.TestCheckPhase
Executing org.apache.hive.ptest.execution.PrepPhase
Executing org.apache.hive.ptest.execution.YetusPhase
Executing org.apache.hive.ptest.execution.ExecutionPhase
Executing org.apache.hive.ptest.execution.ReportingPhase
{noformat}
This message is automatically generated.
ATTACHMENT ID: 12983836 - PreCommit-HIVE-Build
> Lower "Updating Partition Stats" Logging Level
> --
>
> Key: HIVE-18415
> URL: https://issues.apache.org/jira/browse/HIVE-18415
> Project: Hive
> Issue Type: Improvement
> Components: Metastore
>Affects Versions: 1.2.2, 2.2.0, 3.0.0, 2.3.2
>Reporter: David Mollitor
>Assignee: David Mollitor
>Priority: Trivial
> Attachments: HIVE-18415.1.patch, HIVE-18415.2.patch,
> HIVE-18415.3.patch, HIVE-18415.4.patch, HIVE-18415.5.patch,
> HIVE-18415.6.patch, HIVE-18415.6.patch, HIVE-18415.6.patch
>
>
> {code:title=org.apache.hadoop.hive.metastore.utils.MetaStoreUtils}
> LOG.warn("Updating partition stats fast for: " + part.getTableName());
> ...
> LOG.warn("Updated size to " + params.get(StatsSetupConst.TOTAL_SIZE));
> {code}
> This logging produces many lines of WARN log messages in my log file and it's
> not clear to me what the issue is here. Why is this a warning and how should
> I respond to address this warning?
> DEBUG is probably more appropriate for a utility class. Please lower.
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
[jira] [Commented] (HIVE-22394) Duplicate Jars in druid classpath causing issues
[
https://issues.apache.org/jira/browse/HIVE-22394?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16958137#comment-16958137
]
Slim Bouguerra commented on HIVE-22394:
---
+1
> Duplicate Jars in druid classpath causing issues
>
>
> Key: HIVE-22394
> URL: https://issues.apache.org/jira/browse/HIVE-22394
> Project: Hive
> Issue Type: Bug
>Reporter: Nishant Bangarwa
>Assignee: Nishant Bangarwa
>Priority: Major
> Labels: pull-request-available
> Attachments: HIVE-22394.patch
>
> Time Spent: 10m
> Remaining Estimate: 0h
>
> hive-druid-handler jar has shaded version of druid classes,
> druid-hdfs-storage also has non-shaded classes.
> {code}
> [hive@hiveserver2-1 lib]$ ls |grep druid
> calcite-druid-1.19.0.7.0.2.0-163.jar
> druid-bloom-filter-0.15.1.7.0.2.0-163.jar
> druid-hdfs-storage-0.15.1.7.0.2.0-163.jar
> hive-druid-handler-3.1.2000.7.0.2.0-163.jar
> hive-druid-handler.jar
> {code}
> Exception below -
> {code}
> Caused by: java.util.concurrent.ExecutionException:
> java.lang.RuntimeException: java.lang.RuntimeException:
> java.lang.NoClassDefFoundError: Could not initialize class
> org.apache.hadoop.fs.HadoopFsWrapper
> at
> org.apache.hive.druid.com.google.common.util.concurrent.AbstractFuture$Sync.getValue(AbstractFuture.java:299)
> at
> org.apache.hive.druid.com.google.common.util.concurrent.AbstractFuture$Sync.get(AbstractFuture.java:286)
> at
> org.apache.hive.druid.com.google.common.util.concurrent.AbstractFuture.get(AbstractFuture.java:116)
> at
> org.apache.hadoop.hive.druid.io.DruidRecordWriter.pushSegments(DruidRecordWriter.java:177)
> ... 22 more
> Caused by: java.lang.RuntimeException: java.lang.RuntimeException:
> java.lang.NoClassDefFoundError: Could not initialize class
> org.apache.hadoop.fs.HadoopFsWrapper
> at
> org.apache.hive.druid.org.apache.druid.segment.realtime.appenderator.AppenderatorImpl.mergeAndPush(AppenderatorImpl.java:765)
> at
> org.apache.hive.druid.org.apache.druid.segment.realtime.appenderator.AppenderatorImpl.lambda$push$1(AppenderatorImpl.java:630)
> at
> org.apache.hive.druid.com.google.common.util.concurrent.Futures$1.apply(Futures.java:713)
> at
> org.apache.hive.druid.com.google.common.util.concurrent.Futures$ChainingListenableFuture.run(Futures.java:861)
> ... 3 more
> Caused by: java.lang.RuntimeException: java.lang.NoClassDefFoundError: Could
> not initialize class org.apache.hadoop.fs.HadoopFsWrapper
> at
> org.apache.hive.druid.org.apache.druid.java.util.common.RetryUtils.retry(RetryUtils.java:96)
> at
> org.apache.hive.druid.org.apache.druid.java.util.common.RetryUtils.retry(RetryUtils.java:114)
> at
> org.apache.hive.druid.org.apache.druid.java.util.common.RetryUtils.retry(RetryUtils.java:104)
> at
> org.apache.hive.druid.org.apache.druid.segment.realtime.appenderator.AppenderatorImpl.mergeAndPush(AppenderatorImpl.java:743)
> ... 6 more
> Caused by: java.lang.NoClassDefFoundError: Could not initialize class
> org.apache.hadoop.fs.HadoopFsWrapper
> at
> org.apache.hive.druid.org.apache.druid.storage.hdfs.HdfsDataSegmentPusher.copyFilesWithChecks(HdfsDataSegmentPusher.java:163)
> at
> org.apache.hive.druid.org.apache.druid.storage.hdfs.HdfsDataSegmentPusher.push(HdfsDataSegmentPusher.java:145)
> at
> org.apache.hive.druid.org.apache.druid.segment.realtime.appenderator.AppenderatorImpl.lambda$mergeAndPush$4(AppenderatorImpl.java:747)
> at
> org.apache.hive.druid.org.apache.druid.java.util.common.RetryUtils.retry(RetryUtils.java:86)
> {code}
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
[jira] [Assigned] (HIVE-22395) Add ability to read Druid metastore password from jceks
[ https://issues.apache.org/jira/browse/HIVE-22395?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Nishant Bangarwa reassigned HIVE-22395: --- > Add ability to read Druid metastore password from jceks > --- > > Key: HIVE-22395 > URL: https://issues.apache.org/jira/browse/HIVE-22395 > Project: Hive > Issue Type: Bug >Reporter: Nishant Bangarwa >Assignee: Nishant Bangarwa >Priority: Major > -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Commented] (HIVE-18415) Lower "Updating Partition Stats" Logging Level
[
https://issues.apache.org/jira/browse/HIVE-18415?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16958049#comment-16958049
]
Hive QA commented on HIVE-18415:
| (/) *{color:green}+1 overall{color}* |
\\
\\
|| Vote || Subsystem || Runtime || Comment ||
|| || || || {color:brown} Prechecks {color} ||
| {color:green}+1{color} | {color:green} @author {color} | {color:green} 0m
0s{color} | {color:green} The patch does not contain any @author tags. {color} |
|| || || || {color:brown} master Compile Tests {color} ||
| {color:green}+1{color} | {color:green} mvninstall {color} | {color:green} 8m
10s{color} | {color:green} master passed {color} |
| {color:green}+1{color} | {color:green} compile {color} | {color:green} 0m
26s{color} | {color:green} master passed {color} |
| {color:green}+1{color} | {color:green} checkstyle {color} | {color:green} 0m
17s{color} | {color:green} master passed {color} |
| {color:blue}0{color} | {color:blue} findbugs {color} | {color:blue} 1m
9s{color} | {color:blue} standalone-metastore/metastore-server in master has
171 extant Findbugs warnings. {color} |
| {color:green}+1{color} | {color:green} javadoc {color} | {color:green} 0m
19s{color} | {color:green} master passed {color} |
|| || || || {color:brown} Patch Compile Tests {color} ||
| {color:green}+1{color} | {color:green} mvninstall {color} | {color:green} 0m
33s{color} | {color:green} the patch passed {color} |
| {color:green}+1{color} | {color:green} compile {color} | {color:green} 0m
26s{color} | {color:green} the patch passed {color} |
| {color:green}+1{color} | {color:green} javac {color} | {color:green} 0m
26s{color} | {color:green} the patch passed {color} |
| {color:green}+1{color} | {color:green} checkstyle {color} | {color:green} 0m
18s{color} | {color:green} the patch passed {color} |
| {color:green}+1{color} | {color:green} whitespace {color} | {color:green} 0m
1s{color} | {color:green} The patch has no whitespace issues. {color} |
| {color:green}+1{color} | {color:green} findbugs {color} | {color:green} 1m
16s{color} | {color:green} the patch passed {color} |
| {color:green}+1{color} | {color:green} javadoc {color} | {color:green} 0m
19s{color} | {color:green} the patch passed {color} |
|| || || || {color:brown} Other Tests {color} ||
| {color:green}+1{color} | {color:green} asflicense {color} | {color:green} 0m
14s{color} | {color:green} The patch does not generate ASF License warnings.
{color} |
| {color:black}{color} | {color:black} {color} | {color:black} 13m 56s{color} |
{color:black} {color} |
\\
\\
|| Subsystem || Report/Notes ||
| Optional Tests | asflicense javac javadoc findbugs checkstyle compile |
| uname | Linux hiveptest-server-upstream 3.16.0-4-amd64 #1 SMP Debian
3.16.43-2+deb8u5 (2017-09-19) x86_64 GNU/Linux |
| Build tool | maven |
| Personality |
/data/hiveptest/working/yetus_PreCommit-HIVE-Build-19128/dev-support/hive-personality.sh
|
| git revision | master / d5ca6f6 |
| Default Java | 1.8.0_111 |
| findbugs | v3.0.0 |
| modules | C: standalone-metastore/metastore-server U:
standalone-metastore/metastore-server |
| Console output |
http://104.198.109.242/logs//PreCommit-HIVE-Build-19128/yetus.txt |
| Powered by | Apache Yetushttp://yetus.apache.org |
This message was automatically generated.
> Lower "Updating Partition Stats" Logging Level
> --
>
> Key: HIVE-18415
> URL: https://issues.apache.org/jira/browse/HIVE-18415
> Project: Hive
> Issue Type: Improvement
> Components: Metastore
>Affects Versions: 1.2.2, 2.2.0, 3.0.0, 2.3.2
>Reporter: David Mollitor
>Assignee: David Mollitor
>Priority: Trivial
> Attachments: HIVE-18415.1.patch, HIVE-18415.2.patch,
> HIVE-18415.3.patch, HIVE-18415.4.patch, HIVE-18415.5.patch,
> HIVE-18415.6.patch, HIVE-18415.6.patch, HIVE-18415.6.patch
>
>
> {code:title=org.apache.hadoop.hive.metastore.utils.MetaStoreUtils}
> LOG.warn("Updating partition stats fast for: " + part.getTableName());
> ...
> LOG.warn("Updated size to " + params.get(StatsSetupConst.TOTAL_SIZE));
> {code}
> This logging produces many lines of WARN log messages in my log file and it's
> not clear to me what the issue is here. Why is this a warning and how should
> I respond to address this warning?
> DEBUG is probably more appropriate for a utility class. Please lower.
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
[jira] [Resolved] (HIVE-22048) Document the kudu-handler integration.
[ https://issues.apache.org/jira/browse/HIVE-22048?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Grant Henke resolved HIVE-22048. Fix Version/s: 4.0.0 Resolution: Fixed > Document the kudu-handler integration. > -- > > Key: HIVE-22048 > URL: https://issues.apache.org/jira/browse/HIVE-22048 > Project: Hive > Issue Type: Sub-task >Reporter: Grant Henke >Assignee: Grant Henke >Priority: Major > Fix For: 4.0.0 > > > Similar to other integrations, we should document the Kudu integration. Here > are some examples: > [https://cwiki.apache.org/confluence/display/Hive/HBaseIntegration] > [https://cwiki.apache.org/confluence/display/Hive/AccumuloIntegration] > [https://cwiki.apache.org/confluence/display/Hive/Druid+Integration] > -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Updated] (HIVE-22048) Document the kudu-handler integration.
[ https://issues.apache.org/jira/browse/HIVE-22048?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Grant Henke updated HIVE-22048: --- Environment: (was: A first draft of documentation was added on the wiki here: https://cwiki.apache.org/confluence/display/Hive/Kudu+Integration This documentation will continue to improve and evolve, but I think this is good enough to close this jira. ) > Document the kudu-handler integration. > -- > > Key: HIVE-22048 > URL: https://issues.apache.org/jira/browse/HIVE-22048 > Project: Hive > Issue Type: Sub-task >Reporter: Grant Henke >Assignee: Grant Henke >Priority: Major > > Similar to other integrations, we should document the Kudu integration. Here > are some examples: > [https://cwiki.apache.org/confluence/display/Hive/HBaseIntegration] > [https://cwiki.apache.org/confluence/display/Hive/AccumuloIntegration] > [https://cwiki.apache.org/confluence/display/Hive/Druid+Integration] > -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Commented] (HIVE-22048) Document the kudu-handler integration.
[ https://issues.apache.org/jira/browse/HIVE-22048?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16958042#comment-16958042 ] Grant Henke commented on HIVE-22048: A first draft of documentation was added on the wiki here: https://cwiki.apache.org/confluence/display/Hive/Kudu+Integration This documentation will continue to improve and evolve, but I think this is good enough to close this jira. > Document the kudu-handler integration. > -- > > Key: HIVE-22048 > URL: https://issues.apache.org/jira/browse/HIVE-22048 > Project: Hive > Issue Type: Sub-task >Reporter: Grant Henke >Assignee: Grant Henke >Priority: Major > > Similar to other integrations, we should document the Kudu integration. Here > are some examples: > [https://cwiki.apache.org/confluence/display/Hive/HBaseIntegration] > [https://cwiki.apache.org/confluence/display/Hive/AccumuloIntegration] > [https://cwiki.apache.org/confluence/display/Hive/Druid+Integration] > -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Updated] (HIVE-22048) Document the kudu-handler integration.
[ https://issues.apache.org/jira/browse/HIVE-22048?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Grant Henke updated HIVE-22048: --- Environment: A first draft of documentation was added on the wiki here: https://cwiki.apache.org/confluence/display/Hive/Kudu+Integration This documentation will continue to improve and evolve, but I think this is good enough to close this jira. > Document the kudu-handler integration. > -- > > Key: HIVE-22048 > URL: https://issues.apache.org/jira/browse/HIVE-22048 > Project: Hive > Issue Type: Sub-task > Environment: A first draft of documentation was added on the wiki > here: > https://cwiki.apache.org/confluence/display/Hive/Kudu+Integration > This documentation will continue to improve and evolve, but I think this is > good enough to close this jira. >Reporter: Grant Henke >Assignee: Grant Henke >Priority: Major > > Similar to other integrations, we should document the Kudu integration. Here > are some examples: > [https://cwiki.apache.org/confluence/display/Hive/HBaseIntegration] > [https://cwiki.apache.org/confluence/display/Hive/AccumuloIntegration] > [https://cwiki.apache.org/confluence/display/Hive/Druid+Integration] > -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Commented] (HIVE-22384) Hive MetaStore Cache Stored funcion Cache
[
https://issues.apache.org/jira/browse/HIVE-22384?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16958031#comment-16958031
]
Hive QA commented on HIVE-22384:
Here are the results of testing the latest attachment:
https://issues.apache.org/jira/secure/attachment/12983840/HIVE-22384.5.patch
{color:green}SUCCESS:{color} +1 due to 1 test(s) being added or modified.
{color:green}SUCCESS:{color} +1 due to 17546 tests passed
Test results:
https://builds.apache.org/job/PreCommit-HIVE-Build/19127/testReport
Console output: https://builds.apache.org/job/PreCommit-HIVE-Build/19127/console
Test logs: http://104.198.109.242/logs/PreCommit-HIVE-Build-19127/
Messages:
{noformat}
Executing org.apache.hive.ptest.execution.TestCheckPhase
Executing org.apache.hive.ptest.execution.PrepPhase
Executing org.apache.hive.ptest.execution.YetusPhase
Executing org.apache.hive.ptest.execution.ExecutionPhase
Executing org.apache.hive.ptest.execution.ReportingPhase
{noformat}
This message is automatically generated.
ATTACHMENT ID: 12983840 - PreCommit-HIVE-Build
> Hive MetaStore Cache Stored funcion Cache
> -
>
> Key: HIVE-22384
> URL: https://issues.apache.org/jira/browse/HIVE-22384
> Project: Hive
> Issue Type: Improvement
> Components: Standalone Metastore
>Affects Versions: 2.3.7
>Reporter: fanshilun
>Assignee: fanshilun
>Priority: Major
> Labels: cachedstore
> Fix For: 2.3.7
>
> Attachments: HIVE-22384.1.patch, HIVE-22384.2.patch,
> HIVE-22384.3.patch, HIVE-22384.4.patch, HIVE-22384.5.patch
>
>
> CacheStored Function Cache have not been developed, this patch completes
> related functions
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
[jira] [Updated] (HIVE-22394) Duplicate Jars in druid classpath causing issues
[
https://issues.apache.org/jira/browse/HIVE-22394?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
ASF GitHub Bot updated HIVE-22394:
--
Labels: pull-request-available (was: )
> Duplicate Jars in druid classpath causing issues
>
>
> Key: HIVE-22394
> URL: https://issues.apache.org/jira/browse/HIVE-22394
> Project: Hive
> Issue Type: Bug
>Reporter: Nishant Bangarwa
>Assignee: Nishant Bangarwa
>Priority: Major
> Labels: pull-request-available
> Attachments: HIVE-22394.patch
>
>
> hive-druid-handler jar has shaded version of druid classes,
> druid-hdfs-storage also has non-shaded classes.
> {code}
> [hive@hiveserver2-1 lib]$ ls |grep druid
> calcite-druid-1.19.0.7.0.2.0-163.jar
> druid-bloom-filter-0.15.1.7.0.2.0-163.jar
> druid-hdfs-storage-0.15.1.7.0.2.0-163.jar
> hive-druid-handler-3.1.2000.7.0.2.0-163.jar
> hive-druid-handler.jar
> {code}
> Exception below -
> {code}
> Caused by: java.util.concurrent.ExecutionException:
> java.lang.RuntimeException: java.lang.RuntimeException:
> java.lang.NoClassDefFoundError: Could not initialize class
> org.apache.hadoop.fs.HadoopFsWrapper
> at
> org.apache.hive.druid.com.google.common.util.concurrent.AbstractFuture$Sync.getValue(AbstractFuture.java:299)
> at
> org.apache.hive.druid.com.google.common.util.concurrent.AbstractFuture$Sync.get(AbstractFuture.java:286)
> at
> org.apache.hive.druid.com.google.common.util.concurrent.AbstractFuture.get(AbstractFuture.java:116)
> at
> org.apache.hadoop.hive.druid.io.DruidRecordWriter.pushSegments(DruidRecordWriter.java:177)
> ... 22 more
> Caused by: java.lang.RuntimeException: java.lang.RuntimeException:
> java.lang.NoClassDefFoundError: Could not initialize class
> org.apache.hadoop.fs.HadoopFsWrapper
> at
> org.apache.hive.druid.org.apache.druid.segment.realtime.appenderator.AppenderatorImpl.mergeAndPush(AppenderatorImpl.java:765)
> at
> org.apache.hive.druid.org.apache.druid.segment.realtime.appenderator.AppenderatorImpl.lambda$push$1(AppenderatorImpl.java:630)
> at
> org.apache.hive.druid.com.google.common.util.concurrent.Futures$1.apply(Futures.java:713)
> at
> org.apache.hive.druid.com.google.common.util.concurrent.Futures$ChainingListenableFuture.run(Futures.java:861)
> ... 3 more
> Caused by: java.lang.RuntimeException: java.lang.NoClassDefFoundError: Could
> not initialize class org.apache.hadoop.fs.HadoopFsWrapper
> at
> org.apache.hive.druid.org.apache.druid.java.util.common.RetryUtils.retry(RetryUtils.java:96)
> at
> org.apache.hive.druid.org.apache.druid.java.util.common.RetryUtils.retry(RetryUtils.java:114)
> at
> org.apache.hive.druid.org.apache.druid.java.util.common.RetryUtils.retry(RetryUtils.java:104)
> at
> org.apache.hive.druid.org.apache.druid.segment.realtime.appenderator.AppenderatorImpl.mergeAndPush(AppenderatorImpl.java:743)
> ... 6 more
> Caused by: java.lang.NoClassDefFoundError: Could not initialize class
> org.apache.hadoop.fs.HadoopFsWrapper
> at
> org.apache.hive.druid.org.apache.druid.storage.hdfs.HdfsDataSegmentPusher.copyFilesWithChecks(HdfsDataSegmentPusher.java:163)
> at
> org.apache.hive.druid.org.apache.druid.storage.hdfs.HdfsDataSegmentPusher.push(HdfsDataSegmentPusher.java:145)
> at
> org.apache.hive.druid.org.apache.druid.segment.realtime.appenderator.AppenderatorImpl.lambda$mergeAndPush$4(AppenderatorImpl.java:747)
> at
> org.apache.hive.druid.org.apache.druid.java.util.common.RetryUtils.retry(RetryUtils.java:86)
> {code}
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
[jira] [Work logged] (HIVE-22394) Duplicate Jars in druid classpath causing issues
[
https://issues.apache.org/jira/browse/HIVE-22394?focusedWorklogId=332668=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-332668
]
ASF GitHub Bot logged work on HIVE-22394:
-
Author: ASF GitHub Bot
Created on: 23/Oct/19 16:46
Start Date: 23/Oct/19 16:46
Worklog Time Spent: 10m
Work Description: nishantmonu51 commented on pull request #824:
[HIVE-22394] Remove duplicate druid jars
URL: https://github.com/apache/hive/pull/824
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
us...@infra.apache.org
Issue Time Tracking
---
Worklog Id: (was: 332668)
Remaining Estimate: 0h
Time Spent: 10m
> Duplicate Jars in druid classpath causing issues
>
>
> Key: HIVE-22394
> URL: https://issues.apache.org/jira/browse/HIVE-22394
> Project: Hive
> Issue Type: Bug
>Reporter: Nishant Bangarwa
>Assignee: Nishant Bangarwa
>Priority: Major
> Labels: pull-request-available
> Attachments: HIVE-22394.patch
>
> Time Spent: 10m
> Remaining Estimate: 0h
>
> hive-druid-handler jar has shaded version of druid classes,
> druid-hdfs-storage also has non-shaded classes.
> {code}
> [hive@hiveserver2-1 lib]$ ls |grep druid
> calcite-druid-1.19.0.7.0.2.0-163.jar
> druid-bloom-filter-0.15.1.7.0.2.0-163.jar
> druid-hdfs-storage-0.15.1.7.0.2.0-163.jar
> hive-druid-handler-3.1.2000.7.0.2.0-163.jar
> hive-druid-handler.jar
> {code}
> Exception below -
> {code}
> Caused by: java.util.concurrent.ExecutionException:
> java.lang.RuntimeException: java.lang.RuntimeException:
> java.lang.NoClassDefFoundError: Could not initialize class
> org.apache.hadoop.fs.HadoopFsWrapper
> at
> org.apache.hive.druid.com.google.common.util.concurrent.AbstractFuture$Sync.getValue(AbstractFuture.java:299)
> at
> org.apache.hive.druid.com.google.common.util.concurrent.AbstractFuture$Sync.get(AbstractFuture.java:286)
> at
> org.apache.hive.druid.com.google.common.util.concurrent.AbstractFuture.get(AbstractFuture.java:116)
> at
> org.apache.hadoop.hive.druid.io.DruidRecordWriter.pushSegments(DruidRecordWriter.java:177)
> ... 22 more
> Caused by: java.lang.RuntimeException: java.lang.RuntimeException:
> java.lang.NoClassDefFoundError: Could not initialize class
> org.apache.hadoop.fs.HadoopFsWrapper
> at
> org.apache.hive.druid.org.apache.druid.segment.realtime.appenderator.AppenderatorImpl.mergeAndPush(AppenderatorImpl.java:765)
> at
> org.apache.hive.druid.org.apache.druid.segment.realtime.appenderator.AppenderatorImpl.lambda$push$1(AppenderatorImpl.java:630)
> at
> org.apache.hive.druid.com.google.common.util.concurrent.Futures$1.apply(Futures.java:713)
> at
> org.apache.hive.druid.com.google.common.util.concurrent.Futures$ChainingListenableFuture.run(Futures.java:861)
> ... 3 more
> Caused by: java.lang.RuntimeException: java.lang.NoClassDefFoundError: Could
> not initialize class org.apache.hadoop.fs.HadoopFsWrapper
> at
> org.apache.hive.druid.org.apache.druid.java.util.common.RetryUtils.retry(RetryUtils.java:96)
> at
> org.apache.hive.druid.org.apache.druid.java.util.common.RetryUtils.retry(RetryUtils.java:114)
> at
> org.apache.hive.druid.org.apache.druid.java.util.common.RetryUtils.retry(RetryUtils.java:104)
> at
> org.apache.hive.druid.org.apache.druid.segment.realtime.appenderator.AppenderatorImpl.mergeAndPush(AppenderatorImpl.java:743)
> ... 6 more
> Caused by: java.lang.NoClassDefFoundError: Could not initialize class
> org.apache.hadoop.fs.HadoopFsWrapper
> at
> org.apache.hive.druid.org.apache.druid.storage.hdfs.HdfsDataSegmentPusher.copyFilesWithChecks(HdfsDataSegmentPusher.java:163)
> at
> org.apache.hive.druid.org.apache.druid.storage.hdfs.HdfsDataSegmentPusher.push(HdfsDataSegmentPusher.java:145)
> at
> org.apache.hive.druid.org.apache.druid.segment.realtime.appenderator.AppenderatorImpl.lambda$mergeAndPush$4(AppenderatorImpl.java:747)
> at
> org.apache.hive.druid.org.apache.druid.java.util.common.RetryUtils.retry(RetryUtils.java:86)
> {code}
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
[jira] [Updated] (HIVE-22394) Duplicate Jars in druid classpath causing issues
[
https://issues.apache.org/jira/browse/HIVE-22394?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Nishant Bangarwa updated HIVE-22394:
Status: Patch Available (was: Open)
> Duplicate Jars in druid classpath causing issues
>
>
> Key: HIVE-22394
> URL: https://issues.apache.org/jira/browse/HIVE-22394
> Project: Hive
> Issue Type: Bug
>Reporter: Nishant Bangarwa
>Assignee: Nishant Bangarwa
>Priority: Major
> Attachments: HIVE-22394.patch
>
>
> hive-druid-handler jar has shaded version of druid classes,
> druid-hdfs-storage also has non-shaded classes.
> {code}
> [hive@hiveserver2-1 lib]$ ls |grep druid
> calcite-druid-1.19.0.7.0.2.0-163.jar
> druid-bloom-filter-0.15.1.7.0.2.0-163.jar
> druid-hdfs-storage-0.15.1.7.0.2.0-163.jar
> hive-druid-handler-3.1.2000.7.0.2.0-163.jar
> hive-druid-handler.jar
> {code}
> Exception below -
> {code}
> Caused by: java.util.concurrent.ExecutionException:
> java.lang.RuntimeException: java.lang.RuntimeException:
> java.lang.NoClassDefFoundError: Could not initialize class
> org.apache.hadoop.fs.HadoopFsWrapper
> at
> org.apache.hive.druid.com.google.common.util.concurrent.AbstractFuture$Sync.getValue(AbstractFuture.java:299)
> at
> org.apache.hive.druid.com.google.common.util.concurrent.AbstractFuture$Sync.get(AbstractFuture.java:286)
> at
> org.apache.hive.druid.com.google.common.util.concurrent.AbstractFuture.get(AbstractFuture.java:116)
> at
> org.apache.hadoop.hive.druid.io.DruidRecordWriter.pushSegments(DruidRecordWriter.java:177)
> ... 22 more
> Caused by: java.lang.RuntimeException: java.lang.RuntimeException:
> java.lang.NoClassDefFoundError: Could not initialize class
> org.apache.hadoop.fs.HadoopFsWrapper
> at
> org.apache.hive.druid.org.apache.druid.segment.realtime.appenderator.AppenderatorImpl.mergeAndPush(AppenderatorImpl.java:765)
> at
> org.apache.hive.druid.org.apache.druid.segment.realtime.appenderator.AppenderatorImpl.lambda$push$1(AppenderatorImpl.java:630)
> at
> org.apache.hive.druid.com.google.common.util.concurrent.Futures$1.apply(Futures.java:713)
> at
> org.apache.hive.druid.com.google.common.util.concurrent.Futures$ChainingListenableFuture.run(Futures.java:861)
> ... 3 more
> Caused by: java.lang.RuntimeException: java.lang.NoClassDefFoundError: Could
> not initialize class org.apache.hadoop.fs.HadoopFsWrapper
> at
> org.apache.hive.druid.org.apache.druid.java.util.common.RetryUtils.retry(RetryUtils.java:96)
> at
> org.apache.hive.druid.org.apache.druid.java.util.common.RetryUtils.retry(RetryUtils.java:114)
> at
> org.apache.hive.druid.org.apache.druid.java.util.common.RetryUtils.retry(RetryUtils.java:104)
> at
> org.apache.hive.druid.org.apache.druid.segment.realtime.appenderator.AppenderatorImpl.mergeAndPush(AppenderatorImpl.java:743)
> ... 6 more
> Caused by: java.lang.NoClassDefFoundError: Could not initialize class
> org.apache.hadoop.fs.HadoopFsWrapper
> at
> org.apache.hive.druid.org.apache.druid.storage.hdfs.HdfsDataSegmentPusher.copyFilesWithChecks(HdfsDataSegmentPusher.java:163)
> at
> org.apache.hive.druid.org.apache.druid.storage.hdfs.HdfsDataSegmentPusher.push(HdfsDataSegmentPusher.java:145)
> at
> org.apache.hive.druid.org.apache.druid.segment.realtime.appenderator.AppenderatorImpl.lambda$mergeAndPush$4(AppenderatorImpl.java:747)
> at
> org.apache.hive.druid.org.apache.druid.java.util.common.RetryUtils.retry(RetryUtils.java:86)
> {code}
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
[jira] [Updated] (HIVE-22394) Duplicate Jars in druid classpath causing issues
[
https://issues.apache.org/jira/browse/HIVE-22394?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Nishant Bangarwa updated HIVE-22394:
Attachment: HIVE-22394.patch
> Duplicate Jars in druid classpath causing issues
>
>
> Key: HIVE-22394
> URL: https://issues.apache.org/jira/browse/HIVE-22394
> Project: Hive
> Issue Type: Bug
>Reporter: Nishant Bangarwa
>Assignee: Nishant Bangarwa
>Priority: Major
> Attachments: HIVE-22394.patch
>
>
> hive-druid-handler jar has shaded version of druid classes,
> druid-hdfs-storage also has non-shaded classes.
> {code}
> [hive@hiveserver2-1 lib]$ ls |grep druid
> calcite-druid-1.19.0.7.0.2.0-163.jar
> druid-bloom-filter-0.15.1.7.0.2.0-163.jar
> druid-hdfs-storage-0.15.1.7.0.2.0-163.jar
> hive-druid-handler-3.1.2000.7.0.2.0-163.jar
> hive-druid-handler.jar
> {code}
> Exception below -
> {code}
> Caused by: java.util.concurrent.ExecutionException:
> java.lang.RuntimeException: java.lang.RuntimeException:
> java.lang.NoClassDefFoundError: Could not initialize class
> org.apache.hadoop.fs.HadoopFsWrapper
> at
> org.apache.hive.druid.com.google.common.util.concurrent.AbstractFuture$Sync.getValue(AbstractFuture.java:299)
> at
> org.apache.hive.druid.com.google.common.util.concurrent.AbstractFuture$Sync.get(AbstractFuture.java:286)
> at
> org.apache.hive.druid.com.google.common.util.concurrent.AbstractFuture.get(AbstractFuture.java:116)
> at
> org.apache.hadoop.hive.druid.io.DruidRecordWriter.pushSegments(DruidRecordWriter.java:177)
> ... 22 more
> Caused by: java.lang.RuntimeException: java.lang.RuntimeException:
> java.lang.NoClassDefFoundError: Could not initialize class
> org.apache.hadoop.fs.HadoopFsWrapper
> at
> org.apache.hive.druid.org.apache.druid.segment.realtime.appenderator.AppenderatorImpl.mergeAndPush(AppenderatorImpl.java:765)
> at
> org.apache.hive.druid.org.apache.druid.segment.realtime.appenderator.AppenderatorImpl.lambda$push$1(AppenderatorImpl.java:630)
> at
> org.apache.hive.druid.com.google.common.util.concurrent.Futures$1.apply(Futures.java:713)
> at
> org.apache.hive.druid.com.google.common.util.concurrent.Futures$ChainingListenableFuture.run(Futures.java:861)
> ... 3 more
> Caused by: java.lang.RuntimeException: java.lang.NoClassDefFoundError: Could
> not initialize class org.apache.hadoop.fs.HadoopFsWrapper
> at
> org.apache.hive.druid.org.apache.druid.java.util.common.RetryUtils.retry(RetryUtils.java:96)
> at
> org.apache.hive.druid.org.apache.druid.java.util.common.RetryUtils.retry(RetryUtils.java:114)
> at
> org.apache.hive.druid.org.apache.druid.java.util.common.RetryUtils.retry(RetryUtils.java:104)
> at
> org.apache.hive.druid.org.apache.druid.segment.realtime.appenderator.AppenderatorImpl.mergeAndPush(AppenderatorImpl.java:743)
> ... 6 more
> Caused by: java.lang.NoClassDefFoundError: Could not initialize class
> org.apache.hadoop.fs.HadoopFsWrapper
> at
> org.apache.hive.druid.org.apache.druid.storage.hdfs.HdfsDataSegmentPusher.copyFilesWithChecks(HdfsDataSegmentPusher.java:163)
> at
> org.apache.hive.druid.org.apache.druid.storage.hdfs.HdfsDataSegmentPusher.push(HdfsDataSegmentPusher.java:145)
> at
> org.apache.hive.druid.org.apache.druid.segment.realtime.appenderator.AppenderatorImpl.lambda$mergeAndPush$4(AppenderatorImpl.java:747)
> at
> org.apache.hive.druid.org.apache.druid.java.util.common.RetryUtils.retry(RetryUtils.java:86)
> {code}
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
[jira] [Assigned] (HIVE-22394) Duplicate Jars in druid classpath causing issues
[
https://issues.apache.org/jira/browse/HIVE-22394?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Nishant Bangarwa reassigned HIVE-22394:
---
> Duplicate Jars in druid classpath causing issues
>
>
> Key: HIVE-22394
> URL: https://issues.apache.org/jira/browse/HIVE-22394
> Project: Hive
> Issue Type: Bug
>Reporter: Nishant Bangarwa
>Assignee: Nishant Bangarwa
>Priority: Major
>
> hive-druid-handler jar has shaded version of druid classes,
> druid-hdfs-storage also has non-shaded classes.
> {code}
> [hive@hiveserver2-1 lib]$ ls |grep druid
> calcite-druid-1.19.0.7.0.2.0-163.jar
> druid-bloom-filter-0.15.1.7.0.2.0-163.jar
> druid-hdfs-storage-0.15.1.7.0.2.0-163.jar
> hive-druid-handler-3.1.2000.7.0.2.0-163.jar
> hive-druid-handler.jar
> {code}
> Exception below -
> {code}
> Caused by: java.util.concurrent.ExecutionException:
> java.lang.RuntimeException: java.lang.RuntimeException:
> java.lang.NoClassDefFoundError: Could not initialize class
> org.apache.hadoop.fs.HadoopFsWrapper
> at
> org.apache.hive.druid.com.google.common.util.concurrent.AbstractFuture$Sync.getValue(AbstractFuture.java:299)
> at
> org.apache.hive.druid.com.google.common.util.concurrent.AbstractFuture$Sync.get(AbstractFuture.java:286)
> at
> org.apache.hive.druid.com.google.common.util.concurrent.AbstractFuture.get(AbstractFuture.java:116)
> at
> org.apache.hadoop.hive.druid.io.DruidRecordWriter.pushSegments(DruidRecordWriter.java:177)
> ... 22 more
> Caused by: java.lang.RuntimeException: java.lang.RuntimeException:
> java.lang.NoClassDefFoundError: Could not initialize class
> org.apache.hadoop.fs.HadoopFsWrapper
> at
> org.apache.hive.druid.org.apache.druid.segment.realtime.appenderator.AppenderatorImpl.mergeAndPush(AppenderatorImpl.java:765)
> at
> org.apache.hive.druid.org.apache.druid.segment.realtime.appenderator.AppenderatorImpl.lambda$push$1(AppenderatorImpl.java:630)
> at
> org.apache.hive.druid.com.google.common.util.concurrent.Futures$1.apply(Futures.java:713)
> at
> org.apache.hive.druid.com.google.common.util.concurrent.Futures$ChainingListenableFuture.run(Futures.java:861)
> ... 3 more
> Caused by: java.lang.RuntimeException: java.lang.NoClassDefFoundError: Could
> not initialize class org.apache.hadoop.fs.HadoopFsWrapper
> at
> org.apache.hive.druid.org.apache.druid.java.util.common.RetryUtils.retry(RetryUtils.java:96)
> at
> org.apache.hive.druid.org.apache.druid.java.util.common.RetryUtils.retry(RetryUtils.java:114)
> at
> org.apache.hive.druid.org.apache.druid.java.util.common.RetryUtils.retry(RetryUtils.java:104)
> at
> org.apache.hive.druid.org.apache.druid.segment.realtime.appenderator.AppenderatorImpl.mergeAndPush(AppenderatorImpl.java:743)
> ... 6 more
> Caused by: java.lang.NoClassDefFoundError: Could not initialize class
> org.apache.hadoop.fs.HadoopFsWrapper
> at
> org.apache.hive.druid.org.apache.druid.storage.hdfs.HdfsDataSegmentPusher.copyFilesWithChecks(HdfsDataSegmentPusher.java:163)
> at
> org.apache.hive.druid.org.apache.druid.storage.hdfs.HdfsDataSegmentPusher.push(HdfsDataSegmentPusher.java:145)
> at
> org.apache.hive.druid.org.apache.druid.segment.realtime.appenderator.AppenderatorImpl.lambda$mergeAndPush$4(AppenderatorImpl.java:747)
> at
> org.apache.hive.druid.org.apache.druid.java.util.common.RetryUtils.retry(RetryUtils.java:86)
> {code}
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
[jira] [Updated] (HIVE-22373) File Merge tasks fail when containers are reused
[
https://issues.apache.org/jira/browse/HIVE-22373?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Ashutosh Chauhan updated HIVE-22373:
Fix Version/s: 4.0.0
Resolution: Fixed
Status: Resolved (was: Patch Available)
Pushed to master. Thanks, Toshihiko!
> File Merge tasks fail when containers are reused
>
>
> Key: HIVE-22373
> URL: https://issues.apache.org/jira/browse/HIVE-22373
> Project: Hive
> Issue Type: Bug
>Affects Versions: 3.1.2
>Reporter: Toshihiko Uchida
>Assignee: Toshihiko Uchida
>Priority: Major
> Fix For: 4.0.0
>
> Attachments: HIVE-22373.patch
>
>
> h1. Problems
> Setting tez.am.container.reuse.enabled=true allows for containers to be
> reused across multiple tasks.
> When two File Merge tasks run on the same container, the last task fails in
> renaming the output path.
> Below is an error log of the task 01_0 on the container
> container_e87_1570604853053_11564_01_03, where the task 04_0 ran
> before the task 01_0.
> It shows that the task 01_0's output file name is taken from the previous
> task id 04_0 mistakenly.
> {code}
> 2019-10-15 13:00:31,438 [ERROR] [TezChild] |tez.TezProcessor|:
> java.lang.RuntimeException: Hive Runtime Error while closing operators
> at
> org.apache.hadoop.hive.ql.exec.tez.MergeFileRecordProcessor.close(MergeFileRecordProcessor.java:188)
> at
> org.apache.hadoop.hive.ql.exec.tez.TezProcessor.initializeAndRunProcessor(TezProcessor.java:284)
> at
> org.apache.hadoop.hive.ql.exec.tez.MergeFileTezProcessor.run(MergeFileTezProcessor.java:42)
> at
> org.apache.tez.runtime.LogicalIOProcessorRuntimeTask.run(LogicalIOProcessorRuntimeTask.java:374)
> at
> org.apache.tez.runtime.task.TaskRunner2Callable$1.run(TaskRunner2Callable.java:73)
> at
> org.apache.tez.runtime.task.TaskRunner2Callable$1.run(TaskRunner2Callable.java:61)
> at java.security.AccessController.doPrivileged(Native Method)
> at javax.security.auth.Subject.doAs(Subject.java:422)
> at
> org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1729)
> at
> org.apache.tez.runtime.task.TaskRunner2Callable.callInternal(TaskRunner2Callable.java:61)
> at
> org.apache.tez.runtime.task.TaskRunner2Callable.callInternal(TaskRunner2Callable.java:37)
> at org.apache.tez.common.CallableWithNdc.call(CallableWithNdc.java:36)
> at
> com.google.common.util.concurrent.TrustedListenableFutureTask$TrustedFutureInterruptibleTask.runInterruptibly(TrustedListenableFutureTask.java:108)
> at
> com.google.common.util.concurrent.InterruptibleTask.run(InterruptibleTask.java:41)
> at
> com.google.common.util.concurrent.TrustedListenableFutureTask.run(TrustedListenableFutureTask.java:77)
> at
> java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
> at
> java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
> at java.lang.Thread.run(Thread.java:748)
> Caused by: org.apache.hadoop.hive.ql.metadata.HiveException: Failed to close
> AbstractFileMergeOperator
> at
> org.apache.hadoop.hive.ql.exec.AbstractFileMergeOperator.closeOp(AbstractFileMergeOperator.java:315)
> at
> org.apache.hadoop.hive.ql.exec.OrcFileMergeOperator.closeOp(OrcFileMergeOperator.java:265)
> at org.apache.hadoop.hive.ql.exec.Operator.close(Operator.java:733)
> at
> org.apache.hadoop.hive.ql.exec.tez.MergeFileRecordProcessor.close(MergeFileRecordProcessor.java:180)
> ... 17 more
> Caused by: java.io.IOException: Unable to rename
> viewfs:///user//.hive-staging_hive_2019-10-15_12-59-32_916_2461818728035733124-15476/_task_tmp.-ext-1/_tmp.04_0
> to
> viewfs:///user//.hive-staging_hive_2019-10-15_12-59-32_916_2461818728035733124-15476/_tmp.-ext-1/04_0
> at
> org.apache.hadoop.hive.ql.exec.AbstractFileMergeOperator.closeOp(AbstractFileMergeOperator.java:254)
> ... 20 more
> {code}
> h1. Causes
> When AbstractFileMergeOperator is initialized, taskId is updated only for the
> first time.
> - AbstractFileMergeOperator.java
> {code}
> private void updatePaths(Path tp, Path ttp) {
> if (taskId == null) {
> taskId = Utilities.getTaskId(jc);
> }
> {code}
> It leads to the above conflict of the output file names.
> h1. Solutions
> Remove the null-checking conditional, which was introduced in HIVE-14640, and
> update taskId from JobConf whenever the operator is initialized.
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
[jira] [Commented] (HIVE-22373) File Merge tasks fail when containers are reused
[
https://issues.apache.org/jira/browse/HIVE-22373?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16958011#comment-16958011
]
Ashutosh Chauhan commented on HIVE-22373:
-
+1
> File Merge tasks fail when containers are reused
>
>
> Key: HIVE-22373
> URL: https://issues.apache.org/jira/browse/HIVE-22373
> Project: Hive
> Issue Type: Bug
>Affects Versions: 3.1.2
>Reporter: Toshihiko Uchida
>Assignee: Toshihiko Uchida
>Priority: Major
> Attachments: HIVE-22373.patch
>
>
> h1. Problems
> Setting tez.am.container.reuse.enabled=true allows for containers to be
> reused across multiple tasks.
> When two File Merge tasks run on the same container, the last task fails in
> renaming the output path.
> Below is an error log of the task 01_0 on the container
> container_e87_1570604853053_11564_01_03, where the task 04_0 ran
> before the task 01_0.
> It shows that the task 01_0's output file name is taken from the previous
> task id 04_0 mistakenly.
> {code}
> 2019-10-15 13:00:31,438 [ERROR] [TezChild] |tez.TezProcessor|:
> java.lang.RuntimeException: Hive Runtime Error while closing operators
> at
> org.apache.hadoop.hive.ql.exec.tez.MergeFileRecordProcessor.close(MergeFileRecordProcessor.java:188)
> at
> org.apache.hadoop.hive.ql.exec.tez.TezProcessor.initializeAndRunProcessor(TezProcessor.java:284)
> at
> org.apache.hadoop.hive.ql.exec.tez.MergeFileTezProcessor.run(MergeFileTezProcessor.java:42)
> at
> org.apache.tez.runtime.LogicalIOProcessorRuntimeTask.run(LogicalIOProcessorRuntimeTask.java:374)
> at
> org.apache.tez.runtime.task.TaskRunner2Callable$1.run(TaskRunner2Callable.java:73)
> at
> org.apache.tez.runtime.task.TaskRunner2Callable$1.run(TaskRunner2Callable.java:61)
> at java.security.AccessController.doPrivileged(Native Method)
> at javax.security.auth.Subject.doAs(Subject.java:422)
> at
> org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1729)
> at
> org.apache.tez.runtime.task.TaskRunner2Callable.callInternal(TaskRunner2Callable.java:61)
> at
> org.apache.tez.runtime.task.TaskRunner2Callable.callInternal(TaskRunner2Callable.java:37)
> at org.apache.tez.common.CallableWithNdc.call(CallableWithNdc.java:36)
> at
> com.google.common.util.concurrent.TrustedListenableFutureTask$TrustedFutureInterruptibleTask.runInterruptibly(TrustedListenableFutureTask.java:108)
> at
> com.google.common.util.concurrent.InterruptibleTask.run(InterruptibleTask.java:41)
> at
> com.google.common.util.concurrent.TrustedListenableFutureTask.run(TrustedListenableFutureTask.java:77)
> at
> java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
> at
> java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
> at java.lang.Thread.run(Thread.java:748)
> Caused by: org.apache.hadoop.hive.ql.metadata.HiveException: Failed to close
> AbstractFileMergeOperator
> at
> org.apache.hadoop.hive.ql.exec.AbstractFileMergeOperator.closeOp(AbstractFileMergeOperator.java:315)
> at
> org.apache.hadoop.hive.ql.exec.OrcFileMergeOperator.closeOp(OrcFileMergeOperator.java:265)
> at org.apache.hadoop.hive.ql.exec.Operator.close(Operator.java:733)
> at
> org.apache.hadoop.hive.ql.exec.tez.MergeFileRecordProcessor.close(MergeFileRecordProcessor.java:180)
> ... 17 more
> Caused by: java.io.IOException: Unable to rename
> viewfs:///user//.hive-staging_hive_2019-10-15_12-59-32_916_2461818728035733124-15476/_task_tmp.-ext-1/_tmp.04_0
> to
> viewfs:///user//.hive-staging_hive_2019-10-15_12-59-32_916_2461818728035733124-15476/_tmp.-ext-1/04_0
> at
> org.apache.hadoop.hive.ql.exec.AbstractFileMergeOperator.closeOp(AbstractFileMergeOperator.java:254)
> ... 20 more
> {code}
> h1. Causes
> When AbstractFileMergeOperator is initialized, taskId is updated only for the
> first time.
> - AbstractFileMergeOperator.java
> {code}
> private void updatePaths(Path tp, Path ttp) {
> if (taskId == null) {
> taskId = Utilities.getTaskId(jc);
> }
> {code}
> It leads to the above conflict of the output file names.
> h1. Solutions
> Remove the null-checking conditional, which was introduced in HIVE-14640, and
> update taskId from JobConf whenever the operator is initialized.
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
[jira] [Updated] (HIVE-22392) Hive JDBC Storage Handler: Support For Writing Data to JDBC Data Source
[ https://issues.apache.org/jira/browse/HIVE-22392?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Syed Shameerur Rahman updated HIVE-22392: - Attachment: HIVE-22392.02.patch > Hive JDBC Storage Handler: Support For Writing Data to JDBC Data Source > --- > > Key: HIVE-22392 > URL: https://issues.apache.org/jira/browse/HIVE-22392 > Project: Hive > Issue Type: New Feature > Components: StorageHandler >Reporter: Syed Shameerur Rahman >Assignee: Syed Shameerur Rahman >Priority: Major > Attachments: HIVE-22392.01.patch, HIVE-22392.02.patch > > > JDBC Storage Handler supports reading from JDBC data source in Hive. > Currently writing to a JDBC data source is not supported. Hence adding > support for simple insert query so that the data can be written back to JDBC > data source. -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Commented] (HIVE-22384) Hive MetaStore Cache Stored funcion Cache
[
https://issues.apache.org/jira/browse/HIVE-22384?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16957990#comment-16957990
]
Hive QA commented on HIVE-22384:
| (x) *{color:red}-1 overall{color}* |
\\
\\
|| Vote || Subsystem || Runtime || Comment ||
|| || || || {color:brown} Prechecks {color} ||
| {color:green}+1{color} | {color:green} @author {color} | {color:green} 0m
0s{color} | {color:green} The patch does not contain any @author tags. {color} |
|| || || || {color:brown} master Compile Tests {color} ||
| {color:green}+1{color} | {color:green} mvninstall {color} | {color:green} 8m
23s{color} | {color:green} master passed {color} |
| {color:green}+1{color} | {color:green} compile {color} | {color:green} 0m
26s{color} | {color:green} master passed {color} |
| {color:green}+1{color} | {color:green} checkstyle {color} | {color:green} 0m
18s{color} | {color:green} master passed {color} |
| {color:blue}0{color} | {color:blue} findbugs {color} | {color:blue} 1m
12s{color} | {color:blue} standalone-metastore/metastore-server in master has
171 extant Findbugs warnings. {color} |
| {color:green}+1{color} | {color:green} javadoc {color} | {color:green} 0m
20s{color} | {color:green} master passed {color} |
|| || || || {color:brown} Patch Compile Tests {color} ||
| {color:green}+1{color} | {color:green} mvninstall {color} | {color:green} 0m
31s{color} | {color:green} the patch passed {color} |
| {color:green}+1{color} | {color:green} compile {color} | {color:green} 0m
26s{color} | {color:green} the patch passed {color} |
| {color:green}+1{color} | {color:green} javac {color} | {color:green} 0m
26s{color} | {color:green} the patch passed {color} |
| {color:red}-1{color} | {color:red} checkstyle {color} | {color:red} 0m
17s{color} | {color:red} standalone-metastore/metastore-server: The patch
generated 2 new + 69 unchanged - 0 fixed = 71 total (was 69) {color} |
| {color:green}+1{color} | {color:green} whitespace {color} | {color:green} 0m
0s{color} | {color:green} The patch has no whitespace issues. {color} |
| {color:green}+1{color} | {color:green} findbugs {color} | {color:green} 1m
17s{color} | {color:green} the patch passed {color} |
| {color:green}+1{color} | {color:green} javadoc {color} | {color:green} 0m
19s{color} | {color:green} the patch passed {color} |
|| || || || {color:brown} Other Tests {color} ||
| {color:green}+1{color} | {color:green} asflicense {color} | {color:green} 0m
14s{color} | {color:green} The patch does not generate ASF License warnings.
{color} |
| {color:black}{color} | {color:black} {color} | {color:black} 14m 16s{color} |
{color:black} {color} |
\\
\\
|| Subsystem || Report/Notes ||
| Optional Tests | asflicense javac javadoc findbugs checkstyle compile |
| uname | Linux hiveptest-server-upstream 3.16.0-4-amd64 #1 SMP Debian
3.16.43-2+deb8u5 (2017-09-19) x86_64 GNU/Linux |
| Build tool | maven |
| Personality |
/data/hiveptest/working/yetus_PreCommit-HIVE-Build-19127/dev-support/hive-personality.sh
|
| git revision | master / f1e59e9 |
| Default Java | 1.8.0_111 |
| findbugs | v3.0.0 |
| checkstyle |
http://104.198.109.242/logs//PreCommit-HIVE-Build-19127/yetus/diff-checkstyle-standalone-metastore_metastore-server.txt
|
| modules | C: standalone-metastore/metastore-server U:
standalone-metastore/metastore-server |
| Console output |
http://104.198.109.242/logs//PreCommit-HIVE-Build-19127/yetus.txt |
| Powered by | Apache Yetushttp://yetus.apache.org |
This message was automatically generated.
> Hive MetaStore Cache Stored funcion Cache
> -
>
> Key: HIVE-22384
> URL: https://issues.apache.org/jira/browse/HIVE-22384
> Project: Hive
> Issue Type: Improvement
> Components: Standalone Metastore
>Affects Versions: 2.3.7
>Reporter: fanshilun
>Assignee: fanshilun
>Priority: Major
> Labels: cachedstore
> Fix For: 2.3.7
>
> Attachments: HIVE-22384.1.patch, HIVE-22384.2.patch,
> HIVE-22384.3.patch, HIVE-22384.4.patch, HIVE-22384.5.patch
>
>
> CacheStored Function Cache have not been developed, this patch completes
> related functions
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
[jira] [Commented] (HIVE-22367) Transaction type not retrieved from OpenTxnRequest
[
https://issues.apache.org/jira/browse/HIVE-22367?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16957970#comment-16957970
]
Hive QA commented on HIVE-22367:
Here are the results of testing the latest attachment:
https://issues.apache.org/jira/secure/attachment/12983825/HIVE-22367.4.patch
{color:green}SUCCESS:{color} +1 due to 1 test(s) being added or modified.
{color:red}ERROR:{color} -1 due to 2 failed/errored test(s), 17517 tests
executed
*Failed tests:*
{noformat}
TestMiniLlapLocalCliDriver - did not produce a TEST-*.xml file (likely timed
out) (batchId=179)
[auto_sortmerge_join_13.q,vector_left_outer_join2.q,schema_evol_text_vecrow_part_all_primitive.q,constprog_semijoin.q,update_where_partitioned.q,vectorized_multi_output_select.q,vector_retry_failure.q,schema_evol_orc_vec_part_llap_io.q,smb_mapjoin_14.q,skiphf_aggr.q,vectorized_ptf.q,materialized_view_partitioned_3.q,vector_char_cast.q,join_reordering_no_stats.q,insert_orig_table.q,join_filters.q,subquery_in.q,auto_sortmerge_join_4.q,bucket_many.q,vectorization_15.q,union7.q,materialized_view_rewrite_9.q,vectorization_nested_udf.q,vector_list_constant.q,vector_groupby_3.q,insert_values_orig_table_use_metadata.q,vector_mr_diff_schema_alias.q,vector_mapjoin_complex_values.q,materialized_view_distribute_sort.q,reduce_deduplicate_extended.q]
org.apache.hadoop.hive.metastore.TestPartitionManagement.testPartitionDiscoveryTransactionalTable
(batchId=223)
{noformat}
Test results:
https://builds.apache.org/job/PreCommit-HIVE-Build/19126/testReport
Console output: https://builds.apache.org/job/PreCommit-HIVE-Build/19126/console
Test logs: http://104.198.109.242/logs/PreCommit-HIVE-Build-19126/
Messages:
{noformat}
Executing org.apache.hive.ptest.execution.TestCheckPhase
Executing org.apache.hive.ptest.execution.PrepPhase
Executing org.apache.hive.ptest.execution.YetusPhase
Executing org.apache.hive.ptest.execution.ExecutionPhase
Executing org.apache.hive.ptest.execution.ReportingPhase
Tests exited with: TestsFailedException: 2 tests failed
{noformat}
This message is automatically generated.
ATTACHMENT ID: 12983825 - PreCommit-HIVE-Build
> Transaction type not retrieved from OpenTxnRequest
> --
>
> Key: HIVE-22367
> URL: https://issues.apache.org/jira/browse/HIVE-22367
> Project: Hive
> Issue Type: Bug
> Components: Transactions
>Reporter: Denys Kuzmenko
>Assignee: Denys Kuzmenko
>Priority: Major
> Attachments: HIVE-22367.1.patch, HIVE-22367.2.patch,
> HIVE-22367.3.patch, HIVE-22367.4.patch
>
>
> When opening a transaction, its type should be extracted from OpenTxnRequest
> object. Currently it's hardcoded with TxnType.DEFAULT.
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
[jira] [Commented] (HIVE-22367) Transaction type not retrieved from OpenTxnRequest
[
https://issues.apache.org/jira/browse/HIVE-22367?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16957899#comment-16957899
]
Hive QA commented on HIVE-22367:
| (/) *{color:green}+1 overall{color}* |
\\
\\
|| Vote || Subsystem || Runtime || Comment ||
|| || || || {color:brown} Prechecks {color} ||
| {color:green}+1{color} | {color:green} @author {color} | {color:green} 0m
0s{color} | {color:green} The patch does not contain any @author tags. {color} |
|| || || || {color:brown} master Compile Tests {color} ||
| {color:green}+1{color} | {color:green} mvninstall {color} | {color:green} 8m
32s{color} | {color:green} master passed {color} |
| {color:green}+1{color} | {color:green} compile {color} | {color:green} 0m
26s{color} | {color:green} master passed {color} |
| {color:green}+1{color} | {color:green} checkstyle {color} | {color:green} 0m
24s{color} | {color:green} master passed {color} |
| {color:blue}0{color} | {color:blue} findbugs {color} | {color:blue} 1m
16s{color} | {color:blue} standalone-metastore/metastore-server in master has
171 extant Findbugs warnings. {color} |
| {color:green}+1{color} | {color:green} javadoc {color} | {color:green} 0m
20s{color} | {color:green} master passed {color} |
|| || || || {color:brown} Patch Compile Tests {color} ||
| {color:green}+1{color} | {color:green} mvninstall {color} | {color:green} 0m
30s{color} | {color:green} the patch passed {color} |
| {color:green}+1{color} | {color:green} compile {color} | {color:green} 0m
27s{color} | {color:green} the patch passed {color} |
| {color:green}+1{color} | {color:green} javac {color} | {color:green} 0m
27s{color} | {color:green} the patch passed {color} |
| {color:green}+1{color} | {color:green} checkstyle {color} | {color:green} 0m
24s{color} | {color:green} the patch passed {color} |
| {color:green}+1{color} | {color:green} whitespace {color} | {color:green} 0m
0s{color} | {color:green} The patch has no whitespace issues. {color} |
| {color:green}+1{color} | {color:green} findbugs {color} | {color:green} 1m
17s{color} | {color:green} the patch passed {color} |
| {color:green}+1{color} | {color:green} javadoc {color} | {color:green} 0m
20s{color} | {color:green} the patch passed {color} |
|| || || || {color:brown} Other Tests {color} ||
| {color:green}+1{color} | {color:green} asflicense {color} | {color:green} 0m
14s{color} | {color:green} The patch does not generate ASF License warnings.
{color} |
| {color:black}{color} | {color:black} {color} | {color:black} 14m 36s{color} |
{color:black} {color} |
\\
\\
|| Subsystem || Report/Notes ||
| Optional Tests | asflicense javac javadoc findbugs checkstyle compile |
| uname | Linux hiveptest-server-upstream 3.16.0-4-amd64 #1 SMP Debian
3.16.43-2+deb8u5 (2017-09-19) x86_64 GNU/Linux |
| Build tool | maven |
| Personality |
/data/hiveptest/working/yetus_PreCommit-HIVE-Build-19126/dev-support/hive-personality.sh
|
| git revision | master / f1e59e9 |
| Default Java | 1.8.0_111 |
| findbugs | v3.0.0 |
| modules | C: standalone-metastore/metastore-server U:
standalone-metastore/metastore-server |
| Console output |
http://104.198.109.242/logs//PreCommit-HIVE-Build-19126/yetus.txt |
| Powered by | Apache Yetushttp://yetus.apache.org |
This message was automatically generated.
> Transaction type not retrieved from OpenTxnRequest
> --
>
> Key: HIVE-22367
> URL: https://issues.apache.org/jira/browse/HIVE-22367
> Project: Hive
> Issue Type: Bug
> Components: Transactions
>Reporter: Denys Kuzmenko
>Assignee: Denys Kuzmenko
>Priority: Major
> Attachments: HIVE-22367.1.patch, HIVE-22367.2.patch,
> HIVE-22367.3.patch, HIVE-22367.4.patch
>
>
> When opening a transaction, its type should be extracted from OpenTxnRequest
> object. Currently it's hardcoded with TxnType.DEFAULT.
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
[jira] [Commented] (HIVE-22378) Remove code duplicatoins from return path handling
[
https://issues.apache.org/jira/browse/HIVE-22378?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16957887#comment-16957887
]
Hive QA commented on HIVE-22378:
Here are the results of testing the latest attachment:
https://issues.apache.org/jira/secure/attachment/12983814/HIVE-22378.01.patch
{color:red}ERROR:{color} -1 due to no test(s) being added or modified.
{color:red}ERROR:{color} -1 due to 2 failed/errored test(s), 17545 tests
executed
*Failed tests:*
{noformat}
org.apache.hive.jdbc.TestJdbcWithMiniLlapArrow.testNonAsciiStrings (batchId=284)
org.apache.hive.jdbc.TestJdbcWithMiniLlapVectorArrow.testNonAsciiStrings
(batchId=287)
{noformat}
Test results:
https://builds.apache.org/job/PreCommit-HIVE-Build/19125/testReport
Console output: https://builds.apache.org/job/PreCommit-HIVE-Build/19125/console
Test logs: http://104.198.109.242/logs/PreCommit-HIVE-Build-19125/
Messages:
{noformat}
Executing org.apache.hive.ptest.execution.TestCheckPhase
Executing org.apache.hive.ptest.execution.PrepPhase
Executing org.apache.hive.ptest.execution.YetusPhase
Executing org.apache.hive.ptest.execution.ExecutionPhase
Executing org.apache.hive.ptest.execution.ReportingPhase
Tests exited with: TestsFailedException: 2 tests failed
{noformat}
This message is automatically generated.
ATTACHMENT ID: 12983814 - PreCommit-HIVE-Build
> Remove code duplicatoins from return path handling
> --
>
> Key: HIVE-22378
> URL: https://issues.apache.org/jira/browse/HIVE-22378
> Project: Hive
> Issue Type: Sub-task
> Components: Hive
>Reporter: Miklos Gergely
>Assignee: Miklos Gergely
>Priority: Major
> Fix For: 4.0.0
>
> Attachments: HIVE-22378.01.patch
>
>
> Return path handling have some code duplications, they should be removed.
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
[jira] [Updated] (HIVE-22384) Hive MetaStore Cache Stored funcion Cache
[ https://issues.apache.org/jira/browse/HIVE-22384?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] fanshilun updated HIVE-22384: - Attachment: HIVE-22384.5.patch > Hive MetaStore Cache Stored funcion Cache > - > > Key: HIVE-22384 > URL: https://issues.apache.org/jira/browse/HIVE-22384 > Project: Hive > Issue Type: Improvement > Components: Standalone Metastore >Affects Versions: 2.3.7 >Reporter: fanshilun >Assignee: fanshilun >Priority: Major > Labels: cachedstore > Fix For: 2.3.7 > > Attachments: HIVE-22384.1.patch, HIVE-22384.2.patch, > HIVE-22384.3.patch, HIVE-22384.4.patch, HIVE-22384.5.patch > > > CacheStored Function Cache have not been developed, this patch completes > related functions -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Commented] (HIVE-22378) Remove code duplicatoins from return path handling
[
https://issues.apache.org/jira/browse/HIVE-22378?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16957860#comment-16957860
]
Hive QA commented on HIVE-22378:
| (/) *{color:green}+1 overall{color}* |
\\
\\
|| Vote || Subsystem || Runtime || Comment ||
|| || || || {color:brown} Prechecks {color} ||
| {color:green}+1{color} | {color:green} @author {color} | {color:green} 0m
0s{color} | {color:green} The patch does not contain any @author tags. {color} |
|| || || || {color:brown} master Compile Tests {color} ||
| {color:blue}0{color} | {color:blue} mvndep {color} | {color:blue} 1m
35s{color} | {color:blue} Maven dependency ordering for branch {color} |
| {color:green}+1{color} | {color:green} mvninstall {color} | {color:green} 7m
12s{color} | {color:green} master passed {color} |
| {color:green}+1{color} | {color:green} compile {color} | {color:green} 1m
44s{color} | {color:green} master passed {color} |
| {color:green}+1{color} | {color:green} checkstyle {color} | {color:green} 0m
56s{color} | {color:green} master passed {color} |
| {color:blue}0{color} | {color:blue} findbugs {color} | {color:blue} 3m
56s{color} | {color:blue} ql in master has 1545 extant Findbugs warnings.
{color} |
| {color:blue}0{color} | {color:blue} findbugs {color} | {color:blue} 0m
40s{color} | {color:blue} itests/hive-unit in master has 2 extant Findbugs
warnings. {color} |
| {color:green}+1{color} | {color:green} javadoc {color} | {color:green} 1m
28s{color} | {color:green} master passed {color} |
|| || || || {color:brown} Patch Compile Tests {color} ||
| {color:blue}0{color} | {color:blue} mvndep {color} | {color:blue} 0m
26s{color} | {color:blue} Maven dependency ordering for patch {color} |
| {color:green}+1{color} | {color:green} mvninstall {color} | {color:green} 2m
5s{color} | {color:green} the patch passed {color} |
| {color:green}+1{color} | {color:green} compile {color} | {color:green} 1m
45s{color} | {color:green} the patch passed {color} |
| {color:green}+1{color} | {color:green} javac {color} | {color:green} 1m
45s{color} | {color:green} the patch passed {color} |
| {color:green}+1{color} | {color:green} checkstyle {color} | {color:green} 0m
56s{color} | {color:green} the patch passed {color} |
| {color:green}+1{color} | {color:green} whitespace {color} | {color:green} 0m
0s{color} | {color:green} The patch has no whitespace issues. {color} |
| {color:green}+1{color} | {color:green} findbugs {color} | {color:green} 4m
47s{color} | {color:green} the patch passed {color} |
| {color:green}+1{color} | {color:green} javadoc {color} | {color:green} 1m
24s{color} | {color:green} the patch passed {color} |
|| || || || {color:brown} Other Tests {color} ||
| {color:green}+1{color} | {color:green} asflicense {color} | {color:green} 0m
14s{color} | {color:green} The patch does not generate ASF License warnings.
{color} |
| {color:black}{color} | {color:black} {color} | {color:black} 29m 53s{color} |
{color:black} {color} |
\\
\\
|| Subsystem || Report/Notes ||
| Optional Tests | asflicense javac javadoc findbugs checkstyle compile |
| uname | Linux hiveptest-server-upstream 3.16.0-4-amd64 #1 SMP Debian
3.16.43-2+deb8u5 (2017-09-19) x86_64 GNU/Linux |
| Build tool | maven |
| Personality |
/data/hiveptest/working/yetus_PreCommit-HIVE-Build-19125/dev-support/hive-personality.sh
|
| git revision | master / f1e59e9 |
| Default Java | 1.8.0_111 |
| findbugs | v3.0.1 |
| modules | C: ql itests/hive-unit U: . |
| Console output |
http://104.198.109.242/logs//PreCommit-HIVE-Build-19125/yetus.txt |
| Powered by | Apache Yetushttp://yetus.apache.org |
This message was automatically generated.
> Remove code duplicatoins from return path handling
> --
>
> Key: HIVE-22378
> URL: https://issues.apache.org/jira/browse/HIVE-22378
> Project: Hive
> Issue Type: Sub-task
> Components: Hive
>Reporter: Miklos Gergely
>Assignee: Miklos Gergely
>Priority: Major
> Fix For: 4.0.0
>
> Attachments: HIVE-22378.01.patch
>
>
> Return path handling have some code duplications, they should be removed.
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
[jira] [Commented] (HIVE-22392) Hive JDBC Storage Handler: Support For Writing Data to JDBC Data Source
[ https://issues.apache.org/jira/browse/HIVE-22392?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16957839#comment-16957839 ] Syed Shameerur Rahman commented on HIVE-22392: -- [~jcamachorodriguez] [~thejas] Please Review > Hive JDBC Storage Handler: Support For Writing Data to JDBC Data Source > --- > > Key: HIVE-22392 > URL: https://issues.apache.org/jira/browse/HIVE-22392 > Project: Hive > Issue Type: New Feature > Components: StorageHandler >Reporter: Syed Shameerur Rahman >Assignee: Syed Shameerur Rahman >Priority: Major > Attachments: HIVE-22392.01.patch > > > JDBC Storage Handler supports reading from JDBC data source in Hive. > Currently writing to a JDBC data source is not supported. Hence adding > support for simple insert query so that the data can be written back to JDBC > data source. -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Commented] (HIVE-22360) MultiSerDe returns wrong results in last column when the loaded file has more columns than those in table schema
[
https://issues.apache.org/jira/browse/HIVE-22360?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16957837#comment-16957837
]
Hive QA commented on HIVE-22360:
Here are the results of testing the latest attachment:
https://issues.apache.org/jira/secure/attachment/12983799/HIVE-22360.3.patch
{color:green}SUCCESS:{color} +1 due to 1 test(s) being added or modified.
{color:green}SUCCESS:{color} +1 due to 17546 tests passed
Test results:
https://builds.apache.org/job/PreCommit-HIVE-Build/19124/testReport
Console output: https://builds.apache.org/job/PreCommit-HIVE-Build/19124/console
Test logs: http://104.198.109.242/logs/PreCommit-HIVE-Build-19124/
Messages:
{noformat}
Executing org.apache.hive.ptest.execution.TestCheckPhase
Executing org.apache.hive.ptest.execution.PrepPhase
Executing org.apache.hive.ptest.execution.YetusPhase
Executing org.apache.hive.ptest.execution.ExecutionPhase
Executing org.apache.hive.ptest.execution.ReportingPhase
{noformat}
This message is automatically generated.
ATTACHMENT ID: 12983799 - PreCommit-HIVE-Build
> MultiSerDe returns wrong results in last column when the loaded file has more
> columns than those in table schema
>
>
> Key: HIVE-22360
> URL: https://issues.apache.org/jira/browse/HIVE-22360
> Project: Hive
> Issue Type: Bug
> Components: Serializers/Deserializers
>Affects Versions: 4.0.0
>Reporter: Shubham Chaurasia
>Assignee: Shubham Chaurasia
>Priority: Major
> Labels: pull-request-available
> Attachments: HIVE-22360.1.patch, HIVE-22360.2.patch,
> HIVE-22360.3.patch
>
> Time Spent: 10m
> Remaining Estimate: 0h
>
> Repro steps:
> Input file:
> {code}
> 1^,1^,^,0^,0^,0
> 2^,1^,^,0^,1^,0
> 3^,1^,^,0^,0^,0
> 4^,1^,^,0^,1^,0
> {code}
> Queries:
> {code}
> CREATE TABLE n2(colA int, colB tinyint, colC timestamp, colD smallint, colE
> smallint) ROW FORMAT SERDE 'org.apache.hadoop.hive.serde2.MultiDelimitSerDe'
> WITH SERDEPROPERTIES ("field.delim"="^,")STORED AS TEXTFILE;
> LOAD DATA LOCAL INPATH '/Users/schaurasia/Documents/input_6_cols.csv'
> OVERWRITE INTO TABLE n2;
> select * from n2;
> // wrong last column results here.
> +--+--+--+--+--+
> | n2.cola | n2.colb | n2.colc | n2.cold | n2.cole |
> +--+--+--+--+--+
> | 1| 1| NULL | 0| NULL |
> | 2| 1| NULL | 0| NULL |
> | 3| 1| NULL | 0| NULL |
> | 4| 1| NULL | 0| NULL |
> +--+--+--+--+--+
> {code}
> Cause:
> In multi-serde parsing, the total length calculation here:
> https://github.com/apache/hive/blob/rel/release-3.1.2/serde/src/java/org/apache/hadoop/hive/serde2/lazy/LazyStruct.java#L308
> does not take extra fields into account.
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
[jira] [Updated] (HIVE-21581) Remove Lock in GetInputSummary
[
https://issues.apache.org/jira/browse/HIVE-21581?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
David Mollitor updated HIVE-21581:
--
Attachment: (was: HIVE-21581.3.patch)
> Remove Lock in GetInputSummary
> --
>
> Key: HIVE-21581
> URL: https://issues.apache.org/jira/browse/HIVE-21581
> Project: Hive
> Issue Type: Improvement
> Components: HiveServer2
>Affects Versions: 4.0.0, 3.2.0
>Reporter: David Mollitor
>Assignee: David Mollitor
>Priority: Major
> Fix For: 4.0.0
>
> Attachments: HIVE-21581.1.patch, HIVE-21581.2.patch,
> HIVE-21581.3.patch
>
>
> Now that Hive compile lock has been relaxed in [HIVE-20535], remove the
> {{getInputSummary}} lock:
> [https://github.com/apache/hive/blob/master/ql/src/java/org/apache/hadoop/hive/ql/exec/Utilities.java#L2459]
>
>
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
[jira] [Updated] (HIVE-21581) Remove Lock in GetInputSummary
[
https://issues.apache.org/jira/browse/HIVE-21581?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
David Mollitor updated HIVE-21581:
--
Status: Patch Available (was: Open)
> Remove Lock in GetInputSummary
> --
>
> Key: HIVE-21581
> URL: https://issues.apache.org/jira/browse/HIVE-21581
> Project: Hive
> Issue Type: Improvement
> Components: HiveServer2
>Affects Versions: 4.0.0, 3.2.0
>Reporter: David Mollitor
>Assignee: David Mollitor
>Priority: Major
> Fix For: 4.0.0
>
> Attachments: HIVE-21581.1.patch, HIVE-21581.2.patch,
> HIVE-21581.3.patch
>
>
> Now that Hive compile lock has been relaxed in [HIVE-20535], remove the
> {{getInputSummary}} lock:
> [https://github.com/apache/hive/blob/master/ql/src/java/org/apache/hadoop/hive/ql/exec/Utilities.java#L2459]
>
>
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
[jira] [Updated] (HIVE-21581) Remove Lock in GetInputSummary
[
https://issues.apache.org/jira/browse/HIVE-21581?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
David Mollitor updated HIVE-21581:
--
Attachment: HIVE-21581.3.patch
> Remove Lock in GetInputSummary
> --
>
> Key: HIVE-21581
> URL: https://issues.apache.org/jira/browse/HIVE-21581
> Project: Hive
> Issue Type: Improvement
> Components: HiveServer2
>Affects Versions: 4.0.0, 3.2.0
>Reporter: David Mollitor
>Assignee: David Mollitor
>Priority: Major
> Fix For: 4.0.0
>
> Attachments: HIVE-21581.1.patch, HIVE-21581.2.patch,
> HIVE-21581.3.patch
>
>
> Now that Hive compile lock has been relaxed in [HIVE-20535], remove the
> {{getInputSummary}} lock:
> [https://github.com/apache/hive/blob/master/ql/src/java/org/apache/hadoop/hive/ql/exec/Utilities.java#L2459]
>
>
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
[jira] [Updated] (HIVE-21581) Remove Lock in GetInputSummary
[
https://issues.apache.org/jira/browse/HIVE-21581?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
David Mollitor updated HIVE-21581:
--
Status: Open (was: Patch Available)
> Remove Lock in GetInputSummary
> --
>
> Key: HIVE-21581
> URL: https://issues.apache.org/jira/browse/HIVE-21581
> Project: Hive
> Issue Type: Improvement
> Components: HiveServer2
>Affects Versions: 4.0.0, 3.2.0
>Reporter: David Mollitor
>Assignee: David Mollitor
>Priority: Major
> Fix For: 4.0.0
>
> Attachments: HIVE-21581.1.patch, HIVE-21581.2.patch,
> HIVE-21581.3.patch
>
>
> Now that Hive compile lock has been relaxed in [HIVE-20535], remove the
> {{getInputSummary}} lock:
> [https://github.com/apache/hive/blob/master/ql/src/java/org/apache/hadoop/hive/ql/exec/Utilities.java#L2459]
>
>
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
[jira] [Updated] (HIVE-21581) Remove Lock in GetInputSummary
[
https://issues.apache.org/jira/browse/HIVE-21581?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
David Mollitor updated HIVE-21581:
--
Attachment: (was: HIVE-21581.2.patch)
> Remove Lock in GetInputSummary
> --
>
> Key: HIVE-21581
> URL: https://issues.apache.org/jira/browse/HIVE-21581
> Project: Hive
> Issue Type: Improvement
> Components: HiveServer2
>Affects Versions: 4.0.0, 3.2.0
>Reporter: David Mollitor
>Assignee: David Mollitor
>Priority: Major
> Fix For: 4.0.0
>
> Attachments: HIVE-21581.1.patch, HIVE-21581.2.patch,
> HIVE-21581.3.patch
>
>
> Now that Hive compile lock has been relaxed in [HIVE-20535], remove the
> {{getInputSummary}} lock:
> [https://github.com/apache/hive/blob/master/ql/src/java/org/apache/hadoop/hive/ql/exec/Utilities.java#L2459]
>
>
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
[jira] [Updated] (HIVE-21581) Remove Lock in GetInputSummary
[
https://issues.apache.org/jira/browse/HIVE-21581?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
David Mollitor updated HIVE-21581:
--
Status: Open (was: Patch Available)
> Remove Lock in GetInputSummary
> --
>
> Key: HIVE-21581
> URL: https://issues.apache.org/jira/browse/HIVE-21581
> Project: Hive
> Issue Type: Improvement
> Components: HiveServer2
>Affects Versions: 4.0.0, 3.2.0
>Reporter: David Mollitor
>Assignee: David Mollitor
>Priority: Major
> Fix For: 4.0.0
>
> Attachments: HIVE-21581.1.patch, HIVE-21581.2.patch,
> HIVE-21581.3.patch
>
>
> Now that Hive compile lock has been relaxed in [HIVE-20535], remove the
> {{getInputSummary}} lock:
> [https://github.com/apache/hive/blob/master/ql/src/java/org/apache/hadoop/hive/ql/exec/Utilities.java#L2459]
>
>
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
[jira] [Updated] (HIVE-21581) Remove Lock in GetInputSummary
[
https://issues.apache.org/jira/browse/HIVE-21581?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
David Mollitor updated HIVE-21581:
--
Attachment: HIVE-21581.3.patch
> Remove Lock in GetInputSummary
> --
>
> Key: HIVE-21581
> URL: https://issues.apache.org/jira/browse/HIVE-21581
> Project: Hive
> Issue Type: Improvement
> Components: HiveServer2
>Affects Versions: 4.0.0, 3.2.0
>Reporter: David Mollitor
>Assignee: David Mollitor
>Priority: Major
> Fix For: 4.0.0
>
> Attachments: HIVE-21581.1.patch, HIVE-21581.2.patch,
> HIVE-21581.3.patch
>
>
> Now that Hive compile lock has been relaxed in [HIVE-20535], remove the
> {{getInputSummary}} lock:
> [https://github.com/apache/hive/blob/master/ql/src/java/org/apache/hadoop/hive/ql/exec/Utilities.java#L2459]
>
>
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
[jira] [Updated] (HIVE-21581) Remove Lock in GetInputSummary
[
https://issues.apache.org/jira/browse/HIVE-21581?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
David Mollitor updated HIVE-21581:
--
Status: Patch Available (was: Open)
> Remove Lock in GetInputSummary
> --
>
> Key: HIVE-21581
> URL: https://issues.apache.org/jira/browse/HIVE-21581
> Project: Hive
> Issue Type: Improvement
> Components: HiveServer2
>Affects Versions: 4.0.0, 3.2.0
>Reporter: David Mollitor
>Assignee: David Mollitor
>Priority: Major
> Fix For: 4.0.0
>
> Attachments: HIVE-21581.1.patch, HIVE-21581.2.patch,
> HIVE-21581.3.patch
>
>
> Now that Hive compile lock has been relaxed in [HIVE-20535], remove the
> {{getInputSummary}} lock:
> [https://github.com/apache/hive/blob/master/ql/src/java/org/apache/hadoop/hive/ql/exec/Utilities.java#L2459]
>
>
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
[jira] [Updated] (HIVE-18415) Lower "Updating Partition Stats" Logging Level
[
https://issues.apache.org/jira/browse/HIVE-18415?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
David Mollitor updated HIVE-18415:
--
Status: Open (was: Patch Available)
> Lower "Updating Partition Stats" Logging Level
> --
>
> Key: HIVE-18415
> URL: https://issues.apache.org/jira/browse/HIVE-18415
> Project: Hive
> Issue Type: Improvement
> Components: Metastore
>Affects Versions: 2.3.2, 3.0.0, 2.2.0, 1.2.2
>Reporter: David Mollitor
>Assignee: David Mollitor
>Priority: Trivial
> Attachments: HIVE-18415.1.patch, HIVE-18415.2.patch,
> HIVE-18415.3.patch, HIVE-18415.4.patch, HIVE-18415.5.patch,
> HIVE-18415.6.patch, HIVE-18415.6.patch, HIVE-18415.6.patch
>
>
> {code:title=org.apache.hadoop.hive.metastore.utils.MetaStoreUtils}
> LOG.warn("Updating partition stats fast for: " + part.getTableName());
> ...
> LOG.warn("Updated size to " + params.get(StatsSetupConst.TOTAL_SIZE));
> {code}
> This logging produces many lines of WARN log messages in my log file and it's
> not clear to me what the issue is here. Why is this a warning and how should
> I respond to address this warning?
> DEBUG is probably more appropriate for a utility class. Please lower.
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
[jira] [Updated] (HIVE-18415) Lower "Updating Partition Stats" Logging Level
[
https://issues.apache.org/jira/browse/HIVE-18415?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
David Mollitor updated HIVE-18415:
--
Status: Patch Available (was: Open)
> Lower "Updating Partition Stats" Logging Level
> --
>
> Key: HIVE-18415
> URL: https://issues.apache.org/jira/browse/HIVE-18415
> Project: Hive
> Issue Type: Improvement
> Components: Metastore
>Affects Versions: 2.3.2, 3.0.0, 2.2.0, 1.2.2
>Reporter: David Mollitor
>Assignee: David Mollitor
>Priority: Trivial
> Attachments: HIVE-18415.1.patch, HIVE-18415.2.patch,
> HIVE-18415.3.patch, HIVE-18415.4.patch, HIVE-18415.5.patch,
> HIVE-18415.6.patch, HIVE-18415.6.patch, HIVE-18415.6.patch
>
>
> {code:title=org.apache.hadoop.hive.metastore.utils.MetaStoreUtils}
> LOG.warn("Updating partition stats fast for: " + part.getTableName());
> ...
> LOG.warn("Updated size to " + params.get(StatsSetupConst.TOTAL_SIZE));
> {code}
> This logging produces many lines of WARN log messages in my log file and it's
> not clear to me what the issue is here. Why is this a warning and how should
> I respond to address this warning?
> DEBUG is probably more appropriate for a utility class. Please lower.
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
[jira] [Updated] (HIVE-18415) Lower "Updating Partition Stats" Logging Level
[
https://issues.apache.org/jira/browse/HIVE-18415?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
David Mollitor updated HIVE-18415:
--
Attachment: HIVE-18415.6.patch
> Lower "Updating Partition Stats" Logging Level
> --
>
> Key: HIVE-18415
> URL: https://issues.apache.org/jira/browse/HIVE-18415
> Project: Hive
> Issue Type: Improvement
> Components: Metastore
>Affects Versions: 1.2.2, 2.2.0, 3.0.0, 2.3.2
>Reporter: David Mollitor
>Assignee: David Mollitor
>Priority: Trivial
> Attachments: HIVE-18415.1.patch, HIVE-18415.2.patch,
> HIVE-18415.3.patch, HIVE-18415.4.patch, HIVE-18415.5.patch,
> HIVE-18415.6.patch, HIVE-18415.6.patch, HIVE-18415.6.patch
>
>
> {code:title=org.apache.hadoop.hive.metastore.utils.MetaStoreUtils}
> LOG.warn("Updating partition stats fast for: " + part.getTableName());
> ...
> LOG.warn("Updated size to " + params.get(StatsSetupConst.TOTAL_SIZE));
> {code}
> This logging produces many lines of WARN log messages in my log file and it's
> not clear to me what the issue is here. Why is this a warning and how should
> I respond to address this warning?
> DEBUG is probably more appropriate for a utility class. Please lower.
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
[jira] [Commented] (HIVE-21258) Streamline and Add Warning to PrimitiveObjectInspectorFactory.java
[
https://issues.apache.org/jira/browse/HIVE-21258?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16957829#comment-16957829
]
David Mollitor commented on HIVE-21258:
---
[~pvary] Please let me know if you have a few minutes to review.
> Streamline and Add Warning to PrimitiveObjectInspectorFactory.java
> --
>
> Key: HIVE-21258
> URL: https://issues.apache.org/jira/browse/HIVE-21258
> Project: Hive
> Issue Type: Improvement
>Affects Versions: 4.0.0, 3.2.0
>Reporter: David Mollitor
>Assignee: David Mollitor
>Priority: Minor
> Attachments: HIVE-21258.1.patch, HIVE-21258.2.patch
>
>
> I just got bit by something pretty good, so I would like to propose adding a
> developer-facing warning into the logs to avoid this situation again.
> Also, this code contains a cache and the cache is pre-populated. Can remove
> a bunch of code, and maybe a little bit of memory, if the cache is populated
> on demand. Also, use new Map {{computeIfAbsent}} API.
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
[jira] [Commented] (HIVE-22360) MultiSerDe returns wrong results in last column when the loaded file has more columns than those in table schema
[
https://issues.apache.org/jira/browse/HIVE-22360?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16957827#comment-16957827
]
Hive QA commented on HIVE-22360:
| (/) *{color:green}+1 overall{color}* |
\\
\\
|| Vote || Subsystem || Runtime || Comment ||
|| || || || {color:brown} Prechecks {color} ||
| {color:green}+1{color} | {color:green} @author {color} | {color:green} 0m
0s{color} | {color:green} The patch does not contain any @author tags. {color} |
|| || || || {color:brown} master Compile Tests {color} ||
| {color:blue}0{color} | {color:blue} mvndep {color} | {color:blue} 1m
39s{color} | {color:blue} Maven dependency ordering for branch {color} |
| {color:green}+1{color} | {color:green} mvninstall {color} | {color:green} 7m
5s{color} | {color:green} master passed {color} |
| {color:green}+1{color} | {color:green} compile {color} | {color:green} 7m
26s{color} | {color:green} master passed {color} |
| {color:green}+1{color} | {color:green} checkstyle {color} | {color:green} 2m
47s{color} | {color:green} master passed {color} |
| {color:blue}0{color} | {color:blue} findbugs {color} | {color:blue} 0m
40s{color} | {color:blue} serde in master has 199 extant Findbugs warnings.
{color} |
| {color:blue}0{color} | {color:blue} findbugs {color} | {color:blue} 3m
54s{color} | {color:blue} ql in master has 1545 extant Findbugs warnings.
{color} |
| {color:green}+1{color} | {color:green} javadoc {color} | {color:green} 7m
39s{color} | {color:green} master passed {color} |
|| || || || {color:brown} Patch Compile Tests {color} ||
| {color:blue}0{color} | {color:blue} mvndep {color} | {color:blue} 0m
24s{color} | {color:blue} Maven dependency ordering for patch {color} |
| {color:green}+1{color} | {color:green} mvninstall {color} | {color:green} 8m
28s{color} | {color:green} the patch passed {color} |
| {color:green}+1{color} | {color:green} compile {color} | {color:green} 7m
30s{color} | {color:green} the patch passed {color} |
| {color:green}+1{color} | {color:green} javac {color} | {color:green} 7m
30s{color} | {color:green} the patch passed {color} |
| {color:green}+1{color} | {color:green} checkstyle {color} | {color:green} 2m
47s{color} | {color:green} the patch passed {color} |
| {color:green}+1{color} | {color:green} whitespace {color} | {color:green} 0m
0s{color} | {color:green} The patch has no whitespace issues. {color} |
| {color:green}+1{color} | {color:green} findbugs {color} | {color:green} 4m
56s{color} | {color:green} the patch passed {color} |
| {color:green}+1{color} | {color:green} javadoc {color} | {color:green} 7m
36s{color} | {color:green} the patch passed {color} |
|| || || || {color:brown} Other Tests {color} ||
| {color:green}+1{color} | {color:green} asflicense {color} | {color:green} 0m
12s{color} | {color:green} The patch does not generate ASF License warnings.
{color} |
| {color:black}{color} | {color:black} {color} | {color:black} 63m 51s{color} |
{color:black} {color} |
\\
\\
|| Subsystem || Report/Notes ||
| Optional Tests | asflicense javac javadoc findbugs checkstyle compile |
| uname | Linux hiveptest-server-upstream 3.16.0-4-amd64 #1 SMP Debian
3.16.43-2+deb8u5 (2017-09-19) x86_64 GNU/Linux |
| Build tool | maven |
| Personality |
/data/hiveptest/working/yetus_PreCommit-HIVE-Build-19124/dev-support/hive-personality.sh
|
| git revision | master / f1e59e9 |
| Default Java | 1.8.0_111 |
| findbugs | v3.0.1 |
| modules | C: serde ql . U: . |
| Console output |
http://104.198.109.242/logs//PreCommit-HIVE-Build-19124/yetus.txt |
| Powered by | Apache Yetushttp://yetus.apache.org |
This message was automatically generated.
> MultiSerDe returns wrong results in last column when the loaded file has more
> columns than those in table schema
>
>
> Key: HIVE-22360
> URL: https://issues.apache.org/jira/browse/HIVE-22360
> Project: Hive
> Issue Type: Bug
> Components: Serializers/Deserializers
>Affects Versions: 4.0.0
>Reporter: Shubham Chaurasia
>Assignee: Shubham Chaurasia
>Priority: Major
> Labels: pull-request-available
> Attachments: HIVE-22360.1.patch, HIVE-22360.2.patch,
> HIVE-22360.3.patch
>
> Time Spent: 10m
> Remaining Estimate: 0h
>
> Repro steps:
> Input file:
> {code}
> 1^,1^,^,0^,0^,0
> 2^,1^,^,0^,1^,0
> 3^,1^,^,0^,0^,0
> 4^,1^,^,0^,1^,0
> {code}
> Queries:
> {code}
> CREATE TABLE n2(colA int, colB tinyint, colC timestamp, colD smallint, colE
> smallint) ROW FORMAT SERDE 'org.apache.hadoop.hive.serde2.MultiDelimitSerDe'
> WITH SERDEPROPERTIES ("field.delim"="^,")STORED AS TEXTFILE;
> LOAD DATA LOCAL INPATH '/Users/schaurasia/Documents/input_6_cols.csv'
> OVERWRITE INTO TABLE n2;
> select * from n2;
> //
