[jira] [Comment Edited] (HIVE-19124) implement a basic major compactor for MM tables

2018-04-06 Thread Eugene Koifman (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-19124?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16428599#comment-16428599 ] Eugene Koifman edited comment on HIVE-19124 at 4/6/18 5:27 PM: -

[jira] [Commented] (HIVE-19124) implement a basic major compactor for MM tables

2018-04-06 Thread Eugene Koifman (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-19124?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16428599#comment-16428599 ] Eugene Koifman commented on HIVE-19124: --- The flow for Acid compaction is 1. Initiat

[jira] [Updated] (HIVE-19124) implement a basic major compactor for MM tables

2018-04-06 Thread Eugene Koifman (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-19124?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eugene Koifman updated HIVE-19124: -- Component/s: Transactions > implement a basic major compactor for MM tables > --

[jira] [Commented] (HIVE-18739) Add support for Export from Acid table

2018-04-05 Thread Eugene Koifman (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-18739?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16427813#comment-16427813 ] Eugene Koifman commented on HIVE-18739: --- patch 13 for test - includes support (mostl

[jira] [Updated] (HIVE-18739) Add support for Export from Acid table

2018-04-05 Thread Eugene Koifman (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-18739?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eugene Koifman updated HIVE-18739: -- Attachment: HIVE-18739.13.patch > Add support for Export from Acid table > -

[jira] [Commented] (HIVE-17647) DDLTask.generateAddMmTasks(Table tbl) and other random code should not start transactions

2018-04-05 Thread Eugene Koifman (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-17647?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16427721#comment-16427721 ] Eugene Koifman commented on HIVE-17647: --- yes, that would be useful > DDLTask.genera

[jira] [Comment Edited] (HIVE-17647) DDLTask.generateAddMmTasks(Table tbl) and other random code should not start transactions

2018-04-05 Thread Eugene Koifman (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-17647?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16427700#comment-16427700 ] Eugene Koifman edited comment on HIVE-17647 at 4/5/18 10:41 PM:

[jira] [Commented] (HIVE-17647) DDLTask.generateAddMmTasks(Table tbl) and other random code should not start transactions

2018-04-05 Thread Eugene Koifman (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-17647?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16427700#comment-16427700 ] Eugene Koifman commented on HIVE-17647: --- if you look at acid_vectorization_original_

[jira] [Comment Edited] (HIVE-17647) DDLTask.generateAddMmTasks(Table tbl) and other random code should not start transactions

2018-04-05 Thread Eugene Koifman (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-17647?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16427541#comment-16427541 ] Eugene Koifman edited comment on HIVE-17647 at 4/5/18 8:29 PM: -

[jira] [Commented] (HIVE-17647) DDLTask.generateAddMmTasks(Table tbl) and other random code should not start transactions

2018-04-05 Thread Eugene Koifman (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-17647?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16427541#comment-16427541 ] Eugene Koifman commented on HIVE-17647: --- hmm. I use this in all Acid UTs (though not

[jira] [Commented] (HIVE-17647) DDLTask.generateAddMmTasks(Table tbl) and other random code should not start transactions

2018-04-05 Thread Eugene Koifman (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-17647?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16427463#comment-16427463 ] Eugene Koifman commented on HIVE-17647: --- select *, INPUT__FILE__NAME from T > DDLT

[jira] [Comment Edited] (HIVE-17647) DDLTask.generateAddMmTasks(Table tbl) and other random code should not start transactions

2018-04-05 Thread Eugene Koifman (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-17647?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16427398#comment-16427398 ] Eugene Koifman edited comment on HIVE-17647 at 4/5/18 6:29 PM: -

[jira] [Commented] (HIVE-17647) DDLTask.generateAddMmTasks(Table tbl) and other random code should not start transactions

2018-04-05 Thread Eugene Koifman (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-17647?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16427398#comment-16427398 ] Eugene Koifman commented on HIVE-17647: --- In DDLTask {noformat} if (writeId == null)

[jira] [Commented] (HIVE-19083) Make partition clause optional for INSERT

2018-04-05 Thread Eugene Koifman (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-19083?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16427262#comment-16427262 ] Eugene Koifman commented on HIVE-19083: --- [~vgarg] could you update the wiki on this?

[jira] [Updated] (HIVE-19115) Merge: Semijoin hints are dropped by the merge

2018-04-05 Thread Eugene Koifman (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-19115?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eugene Koifman updated HIVE-19115: -- Component/s: Transactions Query Planning > Merge: Semijoin hints are dropped by

[jira] [Updated] (HIVE-18741) Add support for Import into Acid table

2018-04-04 Thread Eugene Koifman (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-18741?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eugene Koifman updated HIVE-18741: -- Status: Patch Available (was: Open) > Add support for Import into Acid table >

[jira] [Updated] (HIVE-18741) Add support for Import into Acid table

2018-04-04 Thread Eugene Koifman (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-18741?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eugene Koifman updated HIVE-18741: -- Attachment: HIVE-18741.01.patch > Add support for Import into Acid table > -

[jira] [Updated] (HIVE-19100) investigate TestStreaming failures

2018-04-04 Thread Eugene Koifman (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-19100?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eugene Koifman updated HIVE-19100: -- Resolution: Fixed Fix Version/s: 3.0.0 Release Note: n/a Status: Resolved

[jira] [Commented] (HIVE-19100) investigate TestStreaming failures

2018-04-04 Thread Eugene Koifman (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-19100?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16426084#comment-16426084 ] Eugene Koifman commented on HIVE-19100: --- there is a bunch of TestTezPerfCliDriver fa

[jira] [Commented] (HIVE-17687) CompactorMR.run() should update compaction_queue table for MM

2018-04-04 Thread Eugene Koifman (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-17687?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16425999#comment-16425999 ] Eugene Koifman commented on HIVE-17687: --- currently, compactor for MM will delete Abo

[jira] [Updated] (HIVE-18570) ACID IOW implemented using base may delete too much data

2018-04-03 Thread Eugene Koifman (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-18570?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eugene Koifman updated HIVE-18570: -- Target Version/s: 3.0.0 Fix Version/s: (was: 3.0.0) > ACID IOW implemented using base

[jira] [Commented] (HIVE-18570) ACID IOW implemented using base may delete too much data

2018-04-03 Thread Eugene Koifman (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-18570?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16424696#comment-16424696 ] Eugene Koifman commented on HIVE-18570: --- Given the current state of things the only

[jira] [Updated] (HIVE-19100) investigate TestStreaming failures

2018-04-03 Thread Eugene Koifman (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-19100?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eugene Koifman updated HIVE-19100: -- Attachment: HIVE-19100.03.patch > investigate TestStreaming failures > -

[jira] [Commented] (HIVE-19100) investigate TestStreaming failures

2018-04-03 Thread Eugene Koifman (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-19100?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16424477#comment-16424477 ] Eugene Koifman commented on HIVE-19100: --- This turned out entirely self inflicted - c

[jira] [Updated] (HIVE-19100) investigate TestStreaming failures

2018-04-03 Thread Eugene Koifman (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-19100?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eugene Koifman updated HIVE-19100: -- Attachment: HIVE-19100.02.patch > investigate TestStreaming failures > -

[jira] [Updated] (HIVE-19100) investigate TestStreaming failures

2018-04-03 Thread Eugene Koifman (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-19100?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eugene Koifman updated HIVE-19100: -- Status: Patch Available (was: Open) > investigate TestStreaming failures >

[jira] [Updated] (HIVE-19100) investigate TestStreaming failures

2018-04-03 Thread Eugene Koifman (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-19100?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eugene Koifman updated HIVE-19100: -- Status: Open (was: Patch Available) > investigate TestStreaming failures >

[jira] [Commented] (HIVE-19100) investigate TestStreaming failures

2018-04-03 Thread Eugene Koifman (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-19100?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16424435#comment-16424435 ] Eugene Koifman commented on HIVE-19100: --- I looked at 2 of the tests: testMultipleTra

[jira] [Commented] (HIVE-18814) Support Add Partition For Acid tables

2018-04-03 Thread Eugene Koifman (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-18814?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16424427#comment-16424427 ] Eugene Koifman commented on HIVE-18814: --- I filed HIVE-19100 to follow up on tests >

[jira] [Updated] (HIVE-19100) investigate TestStreaming failures

2018-04-03 Thread Eugene Koifman (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-19100?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eugene Koifman updated HIVE-19100: -- Attachment: HIVE-19100.01.patch > investigate TestStreaming failures > -

[jira] [Updated] (HIVE-19100) investigate TestStreaming failures

2018-04-03 Thread Eugene Koifman (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-19100?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eugene Koifman updated HIVE-19100: -- Status: Patch Available (was: Open) > investigate TestStreaming failures >

[jira] [Updated] (HIVE-19100) investigate TestStreaming failures

2018-04-03 Thread Eugene Koifman (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-19100?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eugene Koifman updated HIVE-19100: -- Description: {noformat} [ERROR] Failures: [ERROR] TestStreaming.testInterleavedTransactionBa

[jira] [Assigned] (HIVE-19100) investigate TestStreaming failures

2018-04-03 Thread Eugene Koifman (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-19100?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eugene Koifman reassigned HIVE-19100: - > investigate TestStreaming failures > -- > >

[jira] [Updated] (HIVE-18814) Support Add Partition For Acid tables

2018-04-03 Thread Eugene Koifman (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-18814?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eugene Koifman updated HIVE-18814: -- Resolution: Fixed Fix Version/s: 3.0.0 Status: Resolved (was: Patch Available)

[jira] [Commented] (HIVE-18814) Support Add Partition For Acid tables

2018-04-03 Thread Eugene Koifman (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-18814?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16424331#comment-16424331 ] Eugene Koifman commented on HIVE-18814: --- thanks for the review Virtual columns like

[jira] [Commented] (HIVE-19084) Test case in Hive Query Language fails with a java.lang.AssertionError.

2018-04-02 Thread Eugene Koifman (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-19084?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16422963#comment-16422963 ] Eugene Koifman commented on HIVE-19084: --- FYI, [~steveyeom2017] > Test case in Hive

[jira] [Updated] (HIVE-19084) Test case in Hive Query Language fails with a java.lang.AssertionError.

2018-04-02 Thread Eugene Koifman (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-19084?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eugene Koifman updated HIVE-19084: -- Component/s: (was: Hive) Transactions Test > Test case in

[jira] [Updated] (HIVE-19058) add object owner to HivePrivilegeObject

2018-04-02 Thread Eugene Koifman (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-19058?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eugene Koifman updated HIVE-19058: -- Attachment: HIVE-19058.03.patch > add object owner to HivePrivilegeObject >

[jira] [Commented] (HIVE-18747) Cleaner for TXN_TO_WRITE_ID table entries using MIN_HISTORY_LEVEL.

2018-04-02 Thread Eugene Koifman (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-18747?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16422949#comment-16422949 ] Eugene Koifman commented on HIVE-18747: --- +1 patch 6 > Cleaner for TXN_TO_WRITE_ID t

[jira] [Commented] (HIVE-18814) Support Add Partition For Acid tables

2018-04-02 Thread Eugene Koifman (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-18814?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16422916#comment-16422916 ] Eugene Koifman commented on HIVE-18814: --- it works just like Load Data - open a trans

[jira] [Updated] (HIVE-18814) Support Add Partition For Acid tables

2018-04-01 Thread Eugene Koifman (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-18814?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eugene Koifman updated HIVE-18814: -- Attachment: HIVE-18814.04.patch > Support Add Partition For Acid tables > --

[jira] [Commented] (HIVE-18814) Support Add Partition For Acid tables

2018-04-01 Thread Eugene Koifman (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-18814?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16421721#comment-16421721 ] Eugene Koifman commented on HIVE-18814: --- Failures are not related. There is a numbe

[jira] [Updated] (HIVE-18814) Support Add Partition For Acid tables

2018-03-31 Thread Eugene Koifman (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-18814?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eugene Koifman updated HIVE-18814: -- Attachment: HIVE-18814.03.patch > Support Add Partition For Acid tables > --

[jira] [Updated] (HIVE-19058) add object owner to HivePrivilegeObject

2018-03-29 Thread Eugene Koifman (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-19058?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eugene Koifman updated HIVE-19058: -- Attachment: HIVE-19058.02.patch > add object owner to HivePrivilegeObject >

[jira] [Updated] (HIVE-18814) Support Add Partition For Acid tables

2018-03-29 Thread Eugene Koifman (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-18814?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eugene Koifman updated HIVE-18814: -- Attachment: HIVE-18814.02.patch > Support Add Partition For Acid tables > --

[jira] [Commented] (HIVE-18021) Insert overwrite on acid table with Union All optimizations

2018-03-29 Thread Eugene Koifman (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-18021?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16419951#comment-16419951 ] Eugene Koifman commented on HIVE-18021: --- I think it may generate the same ROW__IDs i

[jira] [Commented] (HIVE-17661) DBTxnManager.acquireLocks() - MM tables should use shared lock for Insert

2018-03-29 Thread Eugene Koifman (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-17661?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16419949#comment-16419949 ] Eugene Koifman commented on HIVE-17661: --- +1 > DBTxnManager.acquireLocks() - MM t

[jira] [Comment Edited] (HIVE-18747) Cleaner for TXN_TO_WRITE_ID table entries using MIN_HISTORY_LEVEL.

2018-03-29 Thread Eugene Koifman (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-18747?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16419947#comment-16419947 ] Eugene Koifman edited comment on HIVE-18747 at 3/29/18 11:46 PM: ---

[jira] [Commented] (HIVE-18747) Cleaner for TXN_TO_WRITE_ID table entries using MIN_HISTORY_LEVEL.

2018-03-29 Thread Eugene Koifman (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-18747?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16419947#comment-16419947 ] Eugene Koifman commented on HIVE-18747: --- +1 patch 3 is the change in TxnHandler.get

[jira] [Updated] (HIVE-18741) Add support for Import into Acid table

2018-03-29 Thread Eugene Koifman (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-18741?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eugene Koifman updated HIVE-18741: -- Description: This should follow Load Data approach (or use load data directly) Note that import

[jira] [Assigned] (HIVE-19081) Add partition should prevent loading acid files

2018-03-29 Thread Eugene Koifman (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-19081?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eugene Koifman reassigned HIVE-19081: - > Add partition should prevent loading acid files > -

[jira] [Updated] (HIVE-19029) Load Data should prevent loading acid files

2018-03-29 Thread Eugene Koifman (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-19029?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eugene Koifman updated HIVE-19029: -- Resolution: Fixed Status: Resolved (was: Patch Available) > Load Data should prevent lo

[jira] [Commented] (HIVE-19029) Load Data should prevent loading acid files

2018-03-29 Thread Eugene Koifman (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-19029?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16419871#comment-16419871 ] Eugene Koifman commented on HIVE-19029: --- tried various failed tests locally - they e

[jira] [Updated] (HIVE-18814) Support Add Partition For Acid tables

2018-03-29 Thread Eugene Koifman (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-18814?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eugene Koifman updated HIVE-18814: -- Status: Patch Available (was: Open) > Support Add Partition For Acid tables > -

[jira] [Updated] (HIVE-18814) Support Add Partition For Acid tables

2018-03-29 Thread Eugene Koifman (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-18814?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eugene Koifman updated HIVE-18814: -- Attachment: HIVE-18814.01.patch > Support Add Partition For Acid tables > --

[jira] [Updated] (HIVE-18814) Support Add Partition For Acid tables

2018-03-29 Thread Eugene Koifman (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-18814?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eugene Koifman updated HIVE-18814: -- Attachment: (was: HIVE-18814.wip.patch) > Support Add Partition For Acid tables > --

[jira] [Updated] (HIVE-18814) Support Add Partition For Acid tables

2018-03-29 Thread Eugene Koifman (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-18814?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eugene Koifman updated HIVE-18814: -- Docs Text: todo: update https://cwiki.apache.org/confluence/display/Hive/LanguageManual%2BDDL#L

[jira] [Commented] (HIVE-19029) Load Data should prevent loading acid files

2018-03-29 Thread Eugene Koifman (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-19029?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16419418#comment-16419418 ] Eugene Koifman commented on HIVE-19029: --- todo: make sure Add partition(HIVE-18814) I

[jira] [Commented] (HIVE-18774) ACID: Use the _copy_N files copyNumber as the implicit statement-id

2018-03-27 Thread Eugene Koifman (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-18774?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16416236#comment-16416236 ] Eugene Koifman commented on HIVE-18774: --- This is not as simple: Union All may creat

[jira] [Updated] (HIVE-19029) Load Data should prevent loading acid files

2018-03-27 Thread Eugene Koifman (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-19029?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eugene Koifman updated HIVE-19029: -- Attachment: HIVE-19029.04.patch > Load Data should prevent loading acid files >

[jira] [Commented] (HIVE-18739) Add support for Export from Acid table

2018-03-26 Thread Eugene Koifman (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-18739?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16414837#comment-16414837 ] Eugene Koifman commented on HIVE-18739: --- I think relying on the user to create the r

[jira] [Updated] (HIVE-19058) add object owner to HivePrivilegeObject

2018-03-26 Thread Eugene Koifman (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-19058?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eugene Koifman updated HIVE-19058: -- Status: Patch Available (was: Open) > add object owner to HivePrivilegeObject > ---

[jira] [Updated] (HIVE-19058) add object owner to HivePrivilegeObject

2018-03-26 Thread Eugene Koifman (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-19058?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eugene Koifman updated HIVE-19058: -- Attachment: HIVE-19058.01.patch > add object owner to HivePrivilegeObject >

[jira] [Assigned] (HIVE-19058) add object owner to HivePrivilegeObject

2018-03-26 Thread Eugene Koifman (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-19058?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eugene Koifman reassigned HIVE-19058: - > add object owner to HivePrivilegeObject > --- > >

[jira] [Commented] (HIVE-19056) IllegalArgumentException in FixAcidKeyIndex when ORC file has 0 rows

2018-03-26 Thread Eugene Koifman (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-19056?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16414810#comment-16414810 ] Eugene Koifman commented on HIVE-19056: --- +1 > IllegalArgumentException in FixAcidKe

[jira] [Commented] (HIVE-18739) Add support for Export from Acid table

2018-03-26 Thread Eugene Koifman (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-18739?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16414430#comment-16414430 ] Eugene Koifman commented on HIVE-18739: --- That is precisely the model for SQL Standar

[jira] [Commented] (HIVE-18739) Add support for Export from Acid table

2018-03-26 Thread Eugene Koifman (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-18739?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16414419#comment-16414419 ] Eugene Koifman commented on HIVE-18739: --- I didn't mean temp in the "CREATE TEMPORAR

[jira] [Commented] (HIVE-18739) Add support for Export from Acid table

2018-03-26 Thread Eugene Koifman (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-18739?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16414349#comment-16414349 ] Eugene Koifman commented on HIVE-18739: --- The temp table is created and populated by

[jira] [Commented] (HIVE-19029) Load Data should prevent loading acid files

2018-03-26 Thread Eugene Koifman (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-19029?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16414301#comment-16414301 ] Eugene Koifman commented on HIVE-19029: --- {{//Te is just a simple way to generate tes

[jira] [Commented] (HIVE-19029) Load Data should prevent loading acid files

2018-03-26 Thread Eugene Koifman (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-19029?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16414107#comment-16414107 ] Eugene Koifman commented on HIVE-19029: --- [~jdere] could you review please > Load Da

[jira] [Updated] (HIVE-19029) Load Data should prevent loading acid files

2018-03-26 Thread Eugene Koifman (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-19029?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eugene Koifman updated HIVE-19029: -- Attachment: HIVE-19029.02.patch > Load Data should prevent loading acid files >

[jira] [Commented] (HIVE-18739) Add support for Export from Acid table

2018-03-22 Thread Eugene Koifman (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-18739?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16410648#comment-16410648 ] Eugene Koifman commented on HIVE-18739: --- you can't use a temp table for this - it do

[jira] [Updated] (HIVE-19029) Load Data should prevent loading acid files

2018-03-22 Thread Eugene Koifman (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-19029?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eugene Koifman updated HIVE-19029: -- Attachment: HIVE-19029.01.patch > Load Data should prevent loading acid files >

[jira] [Updated] (HIVE-19029) Load Data should prevent loading acid files

2018-03-22 Thread Eugene Koifman (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-19029?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eugene Koifman updated HIVE-19029: -- Status: Patch Available (was: Open) > Load Data should prevent loading acid files > ---

[jira] [Assigned] (HIVE-19030) Update Wiki with new rules for Load Data

2018-03-22 Thread Eugene Koifman (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-19030?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eugene Koifman reassigned HIVE-19030: - > Update Wiki with new rules for Load Data > > >

[jira] [Updated] (HIVE-19029) Load Data should prevent loading acid files

2018-03-22 Thread Eugene Koifman (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-19029?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eugene Koifman updated HIVE-19029: -- Issue Type: Sub-task (was: Bug) Parent: HIVE-17361 > Load Data should prevent loading a

[jira] [Assigned] (HIVE-19029) Load Data should prevent loading acid files

2018-03-22 Thread Eugene Koifman (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-19029?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eugene Koifman reassigned HIVE-19029: - > Load Data should prevent loading acid files > --- >

[jira] [Assigned] (HIVE-18774) ACID: Use the _copy_N files copyNumber as the implicit statement-id

2018-03-22 Thread Eugene Koifman (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-18774?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eugene Koifman reassigned HIVE-18774: - Assignee: Eugene Koifman > ACID: Use the _copy_N files copyNumber as the implicit stateme

[jira] [Commented] (HIVE-18825) Define ValidTxnList before starting query optimization

2018-03-21 Thread Eugene Koifman (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-18825?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16408730#comment-16408730 ] Eugene Koifman commented on HIVE-18825: --- +1 patch 6 pending tests > Define ValidTxn

[jira] [Commented] (HIVE-18751) ACID table scan through get_splits UDF doesn't receive ValidWriteIdList configuration.

2018-03-21 Thread Eugene Koifman (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-18751?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16408726#comment-16408726 ] Eugene Koifman commented on HIVE-18751: --- [~sankarh], should {noformat} // Pass

[jira] [Comment Edited] (HIVE-18825) Define ValidTxnList before starting query optimization

2018-03-21 Thread Eugene Koifman (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-18825?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16408489#comment-16408489 ] Eugene Koifman edited comment on HIVE-18825 at 3/21/18 8:00 PM:

[jira] [Commented] (HIVE-18825) Define ValidTxnList before starting query optimization

2018-03-21 Thread Eugene Koifman (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-18825?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16408489#comment-16408489 ] Eugene Koifman commented on HIVE-18825: --- GenericUDTFGetSplits.createPlanFragment() n

[jira] [Commented] (HIVE-18948) Acquire locks before generating the valid transaction list

2018-03-21 Thread Eugene Koifman (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-18948?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16408437#comment-16408437 ] Eugene Koifman commented on HIVE-18948: --- WriteEntity also has a WriteType which dete

[jira] [Commented] (HIVE-16669) Fine tune Compaction to take advantage of Acid 2.0

2018-03-19 Thread Eugene Koifman (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-16669?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16405648#comment-16405648 ] Eugene Koifman commented on HIVE-16669: --- if compactor runs in a txn, it must write t

[jira] [Commented] (HIVE-18739) Add support for Export from Acid table

2018-03-19 Thread Eugene Koifman (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-18739?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16405285#comment-16405285 ] Eugene Koifman commented on HIVE-18739: --- https://reviews.apache.org/r/66148/ > Add

[jira] [Updated] (HIVE-18739) Add support for Export from Acid table

2018-03-19 Thread Eugene Koifman (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-18739?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eugene Koifman updated HIVE-18739: -- Summary: Add support for Export from Acid table (was: Add support for Export from unpartitioned

[jira] [Resolved] (HIVE-18740) Add support for Export from partitioned Acid table

2018-03-19 Thread Eugene Koifman (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-18740?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eugene Koifman resolved HIVE-18740. --- Resolution: Won't Fix was done as part of HIVE-18739 > Add support for Export from partitione

[jira] [Updated] (HIVE-18739) Add support for Export from unpartitioned Acid table

2018-03-19 Thread Eugene Koifman (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-18739?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eugene Koifman updated HIVE-18739: -- Attachment: HIVE-18739.12.patch > Add support for Export from unpartitioned Acid table > ---

[jira] [Commented] (HIVE-18739) Add support for Export from unpartitioned Acid table

2018-03-19 Thread Eugene Koifman (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-18739?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16405273#comment-16405273 ] Eugene Koifman commented on HIVE-18739: --- TestCommands.testNoopReplEximCommands failu

[jira] [Updated] (HIVE-18739) Add support for Export from unpartitioned Acid table

2018-03-19 Thread Eugene Koifman (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-18739?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eugene Koifman updated HIVE-18739: -- Attachment: HIVE-18739.11.patch > Add support for Export from unpartitioned Acid table > ---

[jira] [Updated] (HIVE-18739) Add support for Export from unpartitioned Acid table

2018-03-18 Thread Eugene Koifman (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-18739?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eugene Koifman updated HIVE-18739: -- Attachment: HIVE-18739.10.patch > Add support for Export from unpartitioned Acid table > ---

[jira] [Updated] (HIVE-18978) ConditionalTask.addDependentTask(Task t) adds t in the wrong place

2018-03-16 Thread Eugene Koifman (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-18978?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eugene Koifman updated HIVE-18978: -- Description: {\{ConditionalTask.addDependentTask(Task t) }} is implemented like this: {noformat}

[jira] [Updated] (HIVE-18739) Add support for Export from unpartitioned Acid table

2018-03-16 Thread Eugene Koifman (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-18739?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eugene Koifman updated HIVE-18739: -- Attachment: HIVE-18739.09.patch > Add support for Export from unpartitioned Acid table > ---

[jira] [Updated] (HIVE-18978) ConditionalTask.addDependentTask(Task t) adds t in the wrong place

2018-03-16 Thread Eugene Koifman (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-18978?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eugene Koifman updated HIVE-18978: -- Description: {\{ConditionalTask.addDependentTask(Task t) }} is implemented like this: {noformat}

[jira] [Assigned] (HIVE-18978) ConditionalTask.addDependentTask(Task t) adds t in the wrong place

2018-03-16 Thread Eugene Koifman (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-18978?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eugene Koifman reassigned HIVE-18978: - Assignee: Eugene Koifman > ConditionalTask.addDependentTask(Task t) adds t in the wrong p

[jira] [Updated] (HIVE-18739) Add support for Export from unpartitioned Acid table

2018-03-15 Thread Eugene Koifman (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-18739?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eugene Koifman updated HIVE-18739: -- Attachment: HIVE-18739.08.patch > Add support for Export from unpartitioned Acid table > ---

[jira] [Updated] (HIVE-18693) Snapshot Isolation does not work for Micromanaged table when a insert transaction is aborted

2018-03-15 Thread Eugene Koifman (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-18693?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eugene Koifman updated HIVE-18693: -- Resolution: Fixed Fix Version/s: 3.0.0 Release Note: n/a Status: Resolved

[jira] [Updated] (HIVE-18693) Snapshot Isolation does not work for Micromanaged table when a insert transaction is aborted

2018-03-15 Thread Eugene Koifman (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-18693?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eugene Koifman updated HIVE-18693: -- Description: TestTxnCommands2#writeBetweenWorkerAndCleaner with minor changes (changing delete

[jira] [Commented] (HIVE-18693) Snapshot Isolation does not work for Micromanaged table when a insert transaction is aborted

2018-03-15 Thread Eugene Koifman (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-18693?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16400748#comment-16400748 ] Eugene Koifman commented on HIVE-18693: --- +1 > Snapshot Isolation does not work for

[jira] [Commented] (HIVE-18864) ValidWriteIdList snapshot seems incorrect if obtained after allocating writeId by current transaction.

2018-03-13 Thread Eugene Koifman (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-18864?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16397472#comment-16397472 ] Eugene Koifman commented on HIVE-18864: --- +1 > ValidWriteIdList snapshot seems incor

<    7   8   9   10   11   12   13   14   15   16   >