[jira] [Commented] (HIVE-18192) Introduce WriteID per table rather than using global transaction ID

2018-02-20 Thread Sankar Hariappan (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-18192?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16370340#comment-16370340 ] Sankar Hariappan commented on HIVE-18192: - Yes [~ekoifman]. We have follow-up Jira

[jira] [Updated] (HIVE-18749) Need to replace transactionId with writeId in RecordIdentifier.Field.transactionId

2018-02-20 Thread Sankar Hariappan (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-18749?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sankar Hariappan updated HIVE-18749: Summary: Need to replace transactionId with writeId in RecordIdentifier.Field.transactionId

[jira] [Commented] (HIVE-18192) Introduce WriteID per table rather than using global transaction ID

2018-02-20 Thread Eugene Koifman (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-18192?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16370291#comment-16370291 ] Eugene Koifman commented on HIVE-18192: --- is {{org.apache.hadoop.hive.cli.TestCliDri

[jira] [Commented] (HIVE-18751) ACID table scan through get_splits UDF doesn't receive ValidWriteIdList configuration.

2018-02-20 Thread Eugene Koifman (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-18751?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16370279#comment-16370279 ] Eugene Koifman commented on HIVE-18751: --- [~jdere] do you have any input here? [~san

[jira] [Updated] (HIVE-18696) The partition folders might not get cleaned up properly in the HiveMetaStore.add_partitions_core method if an exception occurs

2018-02-20 Thread Marta Kuczora (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-18696?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Marta Kuczora updated HIVE-18696: - Status: Patch Available (was: Open) > The partition folders might not get cleaned up properly in

[jira] [Commented] (HIVE-18743) CREATE TABLE on S3 data can be extremely slow. DO_NOT_UPDATE_STATS workaround is buggy.

2018-02-20 Thread Alexander Behm (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-18743?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16370276#comment-16370276 ] Alexander Behm commented on HIVE-18743: --- Thanks you, [~kgyrtkirk]. I agree completel

[jira] [Commented] (HIVE-18696) The partition folders might not get cleaned up properly in the HiveMetaStore.add_partitions_core method if an exception occurs

2018-02-20 Thread Marta Kuczora (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-18696?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16370275#comment-16370275 ] Marta Kuczora commented on HIVE-18696: -- The idea behind the first patch is 1) Separa

[jira] [Comment Edited] (HIVE-18743) CREATE TABLE on S3 data can be extremely slow. DO_NOT_UPDATE_STATS workaround is buggy.

2018-02-20 Thread Alexander Behm (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-18743?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16370276#comment-16370276 ] Alexander Behm edited comment on HIVE-18743 at 2/20/18 5:06 PM:

[jira] [Updated] (HIVE-18696) The partition folders might not get cleaned up properly in the HiveMetaStore.add_partitions_core method if an exception occurs

2018-02-20 Thread Marta Kuczora (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-18696?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Marta Kuczora updated HIVE-18696: - Attachment: HIVE-18696.1.patch > The partition folders might not get cleaned up properly in the >

[jira] [Commented] (HIVE-18750) Exchange partition should not be supported with per table write ID.

2018-02-20 Thread Eugene Koifman (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-18750?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16370272#comment-16370272 ] Eugene Koifman commented on HIVE-18750: --- Also, Load Data is supported for Acid table

[jira] [Commented] (HIVE-18748) Rename table should update the table names in NEXT_WRITE_ID and TXN_TO_WRITE_ID tables. 

2018-02-20 Thread Eugene Koifman (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-18748?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16370268#comment-16370268 ] Eugene Koifman commented on HIVE-18748: --- How does "rename" get surfaced to the end u

[jira] [Commented] (HIVE-18744) Vectorization: VectorHashKeyWrapperBatch doesn't check repeated NULLs correctly

2018-02-20 Thread Matt McCline (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-18744?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16370146#comment-16370146 ] Matt McCline commented on HIVE-18744: - I'm not convinced this change fixes the problem

[jira] [Commented] (HIVE-18706) Ensure each Yetus execution has its own separate working dir

2018-02-20 Thread Hive QA (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-18706?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16370069#comment-16370069 ] Hive QA commented on HIVE-18706: Here are the results of testing the latest attachment:

[jira] [Commented] (HIVE-18696) The partition folders might not get cleaned up properly in the HiveMetaStore.add_partitions_core method if an exception occurs

2018-02-20 Thread Marta Kuczora (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-18696?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16370047#comment-16370047 ] Marta Kuczora commented on HIVE-18696: -- Sometimes also a ConcurrentModificationExcept

[jira] [Commented] (HIVE-18706) Ensure each Yetus execution has its own separate working dir

2018-02-20 Thread Peter Vary (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-18706?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16370038#comment-16370038 ] Peter Vary commented on HIVE-18706: --- +1 > Ensure each Yetus execution has its own separ

[jira] [Commented] (HIVE-18706) Ensure each Yetus execution has its own separate working dir

2018-02-20 Thread Hive QA (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-18706?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16370025#comment-16370025 ] Hive QA commented on HIVE-18706: | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || S

[jira] [Commented] (HIVE-17626) Query reoptimization using cached runtime statistics

2018-02-20 Thread Hive QA (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-17626?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16370014#comment-16370014 ] Hive QA commented on HIVE-17626: Here are the results of testing the latest attachment:

[jira] [Commented] (HIVE-18706) Ensure each Yetus execution has its own separate working dir

2018-02-20 Thread Adam Szita (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-18706?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16370009#comment-16370009 ] Adam Szita commented on HIVE-18706: --- [~pvary] can you take a look on this please? > Ens

[jira] [Updated] (HIVE-18706) Ensure each Yetus execution has its own separate working dir

2018-02-20 Thread Adam Szita (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-18706?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Adam Szita updated HIVE-18706: -- Status: Patch Available (was: Open) > Ensure each Yetus execution has its own separate working dir > --

[jira] [Updated] (HIVE-18706) Ensure each Yetus execution has its own separate working dir

2018-02-20 Thread Adam Szita (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-18706?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Adam Szita updated HIVE-18706: -- Attachment: HIVE-18706.0.patch > Ensure each Yetus execution has its own separate working dir >

[jira] [Work started] (HIVE-16494) udaf percentile_approx() may fail on CBO

2018-02-20 Thread Miklos Gergely (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-16494?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Work on HIVE-16494 started by Miklos Gergely. - > udaf percentile_approx() may fail on CBO > --

[jira] [Assigned] (HIVE-16494) udaf percentile_approx() may fail on CBO

2018-02-20 Thread Miklos Gergely (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-16494?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Miklos Gergely reassigned HIVE-16494: - Assignee: Miklos Gergely > udaf percentile_approx() may fail on CBO > ---

[jira] [Commented] (HIVE-17626) Query reoptimization using cached runtime statistics

2018-02-20 Thread Hive QA (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-17626?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16369980#comment-16369980 ] Hive QA commented on HIVE-17626: | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || S

[jira] [Commented] (HIVE-18744) Vectorization: VectorHashKeyWrapperBatch doesn't check repeated NULLs correctly

2018-02-20 Thread Teddy Choi (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-18744?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16369961#comment-16369961 ] Teddy Choi commented on HIVE-18744: --- +1 Looks good to me. By the way, I got some unit t

[jira] [Commented] (HIVE-18754) REPL STATUS should support 'with' clause

2018-02-20 Thread Hive QA (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-18754?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16369958#comment-16369958 ] Hive QA commented on HIVE-18754: Here are the results of testing the latest attachment:

[jira] [Updated] (HIVE-17626) Query reoptimization using cached runtime statistics

2018-02-20 Thread Zoltan Haindrich (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-17626?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zoltan Haindrich updated HIVE-17626: Status: Patch Available (was: Open) > Query reoptimization using cached runtime statistics

[jira] [Updated] (HIVE-17626) Query reoptimization using cached runtime statistics

2018-02-20 Thread Zoltan Haindrich (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-17626?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zoltan Haindrich updated HIVE-17626: Attachment: HIVE-17626.01wip01.patch > Query reoptimization using cached runtime statistics

[jira] [Commented] (HIVE-18754) REPL STATUS should support 'with' clause

2018-02-20 Thread Hive QA (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-18754?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16369899#comment-16369899 ] Hive QA commented on HIVE-18754: | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || S

[jira] [Comment Edited] (HIVE-18728) Secure webHCat with SSL

2018-02-20 Thread Lefty Leverenz (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-18728?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16369866#comment-16369866 ] Lefty Leverenz edited comment on HIVE-18728 at 2/20/18 9:50 AM:

[jira] [Commented] (HIVE-18728) Secure webHCat with SSL

2018-02-20 Thread Lefty Leverenz (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-18728?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16369866#comment-16369866 ] Lefty Leverenz commented on HIVE-18728: --- I left a comment on RB pointing to the docu

[jira] [Updated] (HIVE-18754) REPL STATUS should support 'with' clause

2018-02-20 Thread mahesh kumar behera (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-18754?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] mahesh kumar behera updated HIVE-18754: --- Status: Patch Available (was: Open) added support for with clause same as repl load c

[jira] [Updated] (HIVE-18754) REPL STATUS should support 'with' clause

2018-02-20 Thread mahesh kumar behera (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-18754?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] mahesh kumar behera updated HIVE-18754: --- Attachment: HIVE-18754.01.patch > REPL STATUS should support 'with' clause > -

[jira] [Assigned] (HIVE-18754) REPL STATUS should support 'with' clause

2018-02-20 Thread mahesh kumar behera (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-18754?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] mahesh kumar behera reassigned HIVE-18754: -- Assignee: mahesh kumar behera > REPL STATUS should support 'with' clause >

[jira] [Assigned] (HIVE-18753) Correct methods and variables names which uses writeId instead of transactionId.

2018-02-20 Thread Sankar Hariappan (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-18753?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sankar Hariappan reassigned HIVE-18753: --- > Correct methods and variables names which uses writeId instead of > transactionId. > -

[jira] [Commented] (HIVE-18341) Add repl load support for adding "raw" namespace for TDE with same encryption keys

2018-02-20 Thread Lefty Leverenz (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-18341?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16369835#comment-16369835 ] Lefty Leverenz commented on HIVE-18341: --- Doc note: This adds the configuration para

[jira] [Updated] (HIVE-18752) HiveEndPoint: Optimise metastore calls to open transactions batch and allocate write Ids.

2018-02-20 Thread Sankar Hariappan (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-18752?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sankar Hariappan updated HIVE-18752: Summary: HiveEndPoint: Optimise metastore calls to open transactions batch and allocate writ

[jira] [Assigned] (HIVE-18752) HiveEndPoint: Optimise opening batch transactions and getting write Ids for each transaction in the batch into single metastore api.

2018-02-20 Thread Sankar Hariappan (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-18752?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sankar Hariappan reassigned HIVE-18752: --- > HiveEndPoint: Optimise opening batch transactions and getting write Ids for > each tra

[jira] [Updated] (HIVE-18750) Exchange partition should not be supported with per table write ID.

2018-02-20 Thread Sankar Hariappan (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-18750?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sankar Hariappan updated HIVE-18750: Description: Per table write id implementation (HIVE-18192) have introduced write ID per ta

[jira] [Updated] (HIVE-18751) ACID table scan through get_splits UDF doesn't receive ValidWriteIdList configuration.

2018-02-20 Thread Sankar Hariappan (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-18751?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sankar Hariappan updated HIVE-18751: Description: Per table write ID (HIVE-18192) have replaced global transaction ID with write

[jira] [Assigned] (HIVE-18751) get_splits UDF on ACID table scan doesn't receive ValidWriteIdList configuration.

2018-02-20 Thread Sankar Hariappan (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-18751?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sankar Hariappan reassigned HIVE-18751: --- > get_splits UDF on ACID table scan doesn't receive ValidWriteIdList > configuration. >

[jira] [Updated] (HIVE-18751) ACID table scan through get_splits UDF doesn't receive ValidWriteIdList configuration.

2018-02-20 Thread Sankar Hariappan (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-18751?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sankar Hariappan updated HIVE-18751: Summary: ACID table scan through get_splits UDF doesn't receive ValidWriteIdList configurati

[jira] [Assigned] (HIVE-18750) Exchange partition should not be supported with per table write ID.

2018-02-20 Thread Sankar Hariappan (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-18750?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sankar Hariappan reassigned HIVE-18750: --- > Exchange partition should not be supported with per table write ID. > -

[jira] [Updated] (HIVE-18750) Exchange partition should not be supported with per table write ID.

2018-02-20 Thread Sankar Hariappan (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-18750?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sankar Hariappan updated HIVE-18750: Labels: ACID DDL (was: ) > Exchange partition should not be supported with per table write

[jira] [Updated] (HIVE-18749) Need to replace transactionId with per table writeId in RecordIdentifier.Field.transactionId

2018-02-20 Thread Sankar Hariappan (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-18749?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sankar Hariappan updated HIVE-18749: Labels: ACID (was: ) > Need to replace transactionId with per table writeId in > RecordIde

[jira] [Updated] (HIVE-18749) Need to replace transactionId with per table writeId in RecordIdentifier.Field.transactionId

2018-02-20 Thread Sankar Hariappan (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-18749?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sankar Hariappan updated HIVE-18749: Summary: Need to replace transactionId with per table writeId in RecordIdentifier.Field.tran

[jira] [Assigned] (HIVE-18749) Need to replace transactionId to per table writeId in RecordIdentifier.Field.transactionId

2018-02-20 Thread Sankar Hariappan (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-18749?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sankar Hariappan reassigned HIVE-18749: --- > Need to replace transactionId to per table writeId in > RecordIdentifier.Field.transac

[jira] [Updated] (HIVE-18748) Rename table should update the table names in NEXT_WRITE_ID and TXN_TO_WRITE_ID tables. 

2018-02-20 Thread Sankar Hariappan (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-18748?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sankar Hariappan updated HIVE-18748: Summary: Rename table should update the table names in NEXT_WRITE_ID and TXN_TO_WRITE_ID tab

[jira] [Assigned] (HIVE-18748) Rename tables should update the table names in NEXT_WRITE_ID and TXN_TO_WRITE_ID tables. 

2018-02-20 Thread Sankar Hariappan (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-18748?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sankar Hariappan reassigned HIVE-18748: --- > Rename tables should update the table names in NEXT_WRITE_ID and > TXN_TO_WRITE_ID tab

[jira] [Updated] (HIVE-18747) Cleaner for TXN_TO_WRITE_ID table entries.

2018-02-20 Thread Sankar Hariappan (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-18747?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sankar Hariappan updated HIVE-18747: Labels: ACID (was: ACID replication) > Cleaner for TXN_TO_WRITE_ID table entries. > ---

[jira] [Updated] (HIVE-18747) Cleaner for TXN_TO_WRITE_ID table entries.

2018-02-20 Thread Sankar Hariappan (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-18747?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sankar Hariappan updated HIVE-18747: Component/s: (was: repl) > Cleaner for TXN_TO_WRITE_ID table entries. >

[jira] [Updated] (HIVE-18747) Cleaner for TXN_TO_WRITE_ID table entries.

2018-02-20 Thread Sankar Hariappan (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-18747?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sankar Hariappan updated HIVE-18747: Summary: Cleaner for TXN_TO_WRITE_ID table entries. (was: Cleaner for TXNS_TO_WRITE_ID tabl

[jira] [Assigned] (HIVE-18747) Cleaner for TXNS_TO_WRITE_ID table entries.

2018-02-20 Thread Sankar Hariappan (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-18747?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sankar Hariappan reassigned HIVE-18747: --- > Cleaner for TXNS_TO_WRITE_ID table entries. > -

<    1   2