[jira] [Updated] (HIVE-18675) make HIVE_LOCKS.HL_TXNID NOT NULL

2018-03-12 Thread Eugene Koifman (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-18675?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eugene Koifman updated HIVE-18675: -- Component/s: Metastore > make HIVE_LOCKS.HL_TXNID NOT NULL > -

[jira] [Updated] (HIVE-18675) make HIVE_LOCKS.HL_TXNID NOT NULL

2018-03-12 Thread Eugene Koifman (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-18675?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eugene Koifman updated HIVE-18675: -- Resolution: Fixed Fix Version/s: 3.0.0 Status: Resolved (was: Patch

[jira] [Commented] (HIVE-18675) make HIVE_LOCKS.HL_TXNID NOT NULL

2018-03-12 Thread Eugene Koifman (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-18675?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16395669#comment-16395669 ] Eugene Koifman commented on HIVE-18675: --- [~vbeshka], makes sense. +1 > make HIVE_LOCKS.HL_TXNID

[jira] [Commented] (HIVE-18675) make HIVE_LOCKS.HL_TXNID NOT NULL

2018-03-12 Thread Eugene Koifman (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-18675?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16395256#comment-16395256 ] Eugene Koifman commented on HIVE-18675: --- why are there both

[jira] [Resolved] (HIVE-18662) hive.acid.key.index is missing entries

2018-03-09 Thread Eugene Koifman (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-18662?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eugene Koifman resolved HIVE-18662. --- Resolution: Fixed Assignee: Eugene Koifman Fix Version/s: 3.0.0 fixed in

[jira] [Updated] (HIVE-18739) Add support for Export from unpartitioned Acid table

2018-03-09 Thread Eugene Koifman (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-18739?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eugene Koifman updated HIVE-18739: -- Attachment: HIVE-18739.06.patch > Add support for Export from unpartitioned Acid table >

[jira] [Updated] (HIVE-17206) make a version of Compactor specific to unbucketed tables

2018-03-09 Thread Eugene Koifman (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-17206?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eugene Koifman updated HIVE-17206: -- Description: current Compactor will work but is not optimized/flexible enough The current

[jira] [Assigned] (HIVE-18773) Support multiple instances of Cleaner

2018-03-09 Thread Eugene Koifman (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-18773?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eugene Koifman reassigned HIVE-18773: - Assignee: Eugene Koifman > Support multiple instances of Cleaner >

[jira] [Commented] (HIVE-18693) Snapshot Isolation does not work for Micromanaged table when a insert transaction is aborted

2018-03-09 Thread Eugene Koifman (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-18693?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16393381#comment-16393381 ] Eugene Koifman commented on HIVE-18693: --- [~steveyeom2017], I think the code changes are fine in

[jira] [Commented] (HIVE-18693) Snapshot Isolation does not work for Micromanaged table when a insert transaction is aborted

2018-03-09 Thread Eugene Koifman (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-18693?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16393189#comment-16393189 ] Eugene Koifman commented on HIVE-18693: --- [~steveyeom2017] could you update RB with latest patch >

[jira] [Updated] (HIVE-18918) Bad error message in CompactorMR.lanuchCompactionJob()

2018-03-09 Thread Eugene Koifman (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-18918?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eugene Koifman updated HIVE-18918: -- Resolution: Fixed Fix Version/s: 3.0.0 Target Version/s: 3.0.0

[jira] [Commented] (HIVE-18723) CompactorOutputCommitter.commitJob() - check rename() ret val

2018-03-09 Thread Eugene Koifman (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-18723?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16393134#comment-16393134 ] Eugene Koifman commented on HIVE-18723: --- [~vbeshka], I don't understand the logic. If B exists,

[jira] [Updated] (HIVE-18571) stats issues for MM tables; ACID doesn't check state for CTAS

2018-03-08 Thread Eugene Koifman (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-18571?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eugene Koifman updated HIVE-18571: -- Component/s: Transactions > stats issues for MM tables; ACID doesn't check state for CTAS >

[jira] [Updated] (HIVE-18911) LOAD.. code for MM has some suspect/dead code

2018-03-08 Thread Eugene Koifman (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-18911?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eugene Koifman updated HIVE-18911: -- Component/s: Transactions > LOAD.. code for MM has some suspect/dead code >

[jira] [Commented] (HIVE-18918) Bad error message in CompactorMR.lanuchCompactionJob()

2018-03-08 Thread Eugene Koifman (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-18918?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16392219#comment-16392219 ] Eugene Koifman commented on HIVE-18918: --- [~jdere] could you review please > Bad error message in

[jira] [Updated] (HIVE-18918) Bad error message in CompactorMR.lanuchCompactionJob()

2018-03-08 Thread Eugene Koifman (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-18918?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eugene Koifman updated HIVE-18918: -- Description: {noformat} rj.waitForCompletion(); if (!rj.isSuccessful()) {

[jira] [Updated] (HIVE-18918) Bad error message in CompactorMR.lanuchCompactionJob()

2018-03-08 Thread Eugene Koifman (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-18918?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eugene Koifman updated HIVE-18918: -- Status: Patch Available (was: Open) > Bad error message in CompactorMR.lanuchCompactionJob() >

[jira] [Updated] (HIVE-18918) Bad error message in CompactorMR.lanuchCompactionJob()

2018-03-08 Thread Eugene Koifman (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-18918?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eugene Koifman updated HIVE-18918: -- Attachment: HIVE-18918.01.patch > Bad error message in CompactorMR.lanuchCompactionJob() >

[jira] [Assigned] (HIVE-18918) Bad error message in CompactorMR.lanuchCompactionJob()

2018-03-08 Thread Eugene Koifman (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-18918?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eugene Koifman reassigned HIVE-18918: - > Bad error message in CompactorMR.lanuchCompactionJob() >

[jira] [Commented] (HIVE-18825) Define ValidTxnList before starting query optimization

2018-03-08 Thread Eugene Koifman (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-18825?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16391880#comment-16391880 ] Eugene Koifman commented on HIVE-18825: --- The Lock manger is entirely based on Read/WriteEntities

[jira] [Updated] (HIVE-18739) Add support for Export from unpartitioned Acid table

2018-03-08 Thread Eugene Koifman (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-18739?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eugene Koifman updated HIVE-18739: -- Status: Patch Available (was: Open) > Add support for Export from unpartitioned Acid table >

[jira] [Updated] (HIVE-18739) Add support for Export from unpartitioned Acid table

2018-03-07 Thread Eugene Koifman (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-18739?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eugene Koifman updated HIVE-18739: -- Attachment: HIVE-18739.04.patch > Add support for Export from unpartitioned Acid table >

[jira] [Updated] (HIVE-18739) Add support for Export from unpartitioned Acid table

2018-03-07 Thread Eugene Koifman (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-18739?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eugene Koifman updated HIVE-18739: -- Attachment: HIVE-18739.04.patch > Add support for Export from unpartitioned Acid table >

[jira] [Updated] (HIVE-18814) Support Add Partition For Acid tables

2018-03-07 Thread Eugene Koifman (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-18814?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eugene Koifman updated HIVE-18814: -- Description:

[jira] [Updated] (HIVE-18814) Support Add Partition For Acid tables

2018-03-07 Thread Eugene Koifman (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-18814?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eugene Koifman updated HIVE-18814: -- Description:

[jira] [Commented] (HIVE-18825) Define ValidTxnList before starting query optimization

2018-03-07 Thread Eugene Koifman (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-18825?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16389911#comment-16389911 ] Eugene Koifman commented on HIVE-18825: --- Just because some feature doesn't exist yet, it doesn't

[jira] [Commented] (HIVE-18571) stats issues for MM tables; ACID doesn't check state for CTAS

2018-03-06 Thread Eugene Koifman (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-18571?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16388930#comment-16388930 ] Eugene Koifman commented on HIVE-18571: --- +1 pending tests > stats issues for MM tables; ACID

[jira] [Commented] (HIVE-18825) Define ValidTxnList before starting query optimization

2018-03-06 Thread Eugene Koifman (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-18825?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16388925#comment-16388925 ] Eugene Koifman commented on HIVE-18825: --- I'm strongly against this. > Define ValidTxnList before

[jira] [Commented] (HIVE-18886) ACID: NPE on unexplained mysql exceptions

2018-03-06 Thread Eugene Koifman (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-18886?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16388770#comment-16388770 ] Eugene Koifman commented on HIVE-18886: --- +1 > ACID: NPE on unexplained mysql exceptions >

[jira] [Commented] (HIVE-18825) Define ValidTxnList before starting query optimization

2018-03-06 Thread Eugene Koifman (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-18825?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16388481#comment-16388481 ] Eugene Koifman commented on HIVE-18825: --- The lock manger uses Read/WriteEnity in the QueryPlan to

[jira] [Commented] (HIVE-18864) WriteId high water mark (HWM) is incorrect if ValidWriteIdList is obtained after allocating writeId by current transaction.

2018-03-06 Thread Eugene Koifman (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-18864?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16388106#comment-16388106 ] Eugene Koifman commented on HIVE-18864: --- Yes, you are right. If you "fix" writeID_HWM=5 as I was

[jira] [Comment Edited] (HIVE-18825) Define ValidTxnList before starting query optimization

2018-03-05 Thread Eugene Koifman (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-18825?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16387145#comment-16387145 ] Eugene Koifman edited comment on HIVE-18825 at 3/6/18 2:02 AM: --- I think

[jira] [Commented] (HIVE-18825) Define ValidTxnList before starting query optimization

2018-03-05 Thread Eugene Koifman (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-18825?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16387145#comment-16387145 ] Eugene Koifman commented on HIVE-18825: --- I think there is a problem here that I should've thought of

[jira] [Commented] (HIVE-18864) WriteId high water mark (HWM) is incorrect if ValidWriteIdList is obtained after allocating writeId by current transaction.

2018-03-05 Thread Eugene Koifman (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-18864?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16387081#comment-16387081 ] Eugene Koifman commented on HIVE-18864: --- Alternatively, write_HWM should always be set to that which

[jira] [Commented] (HIVE-18749) Need to replace transactionId with writeId in RecordIdentifier and other relevant contexts.

2018-03-05 Thread Eugene Koifman (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-18749?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16387067#comment-16387067 ] Eugene Koifman commented on HIVE-18749: --- +1 > Need to replace transactionId with writeId in

[jira] [Commented] (HIVE-18860) fix TestAcidOnTez#testGetSplitsLocks

2018-03-05 Thread Eugene Koifman (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-18860?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16386630#comment-16386630 ] Eugene Koifman commented on HIVE-18860: --- cc [~sankarh] > fix TestAcidOnTez#testGetSplitsLocks >

[jira] [Updated] (HIVE-18860) fix TestAcidOnTez#testGetSplitsLocks

2018-03-05 Thread Eugene Koifman (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-18860?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eugene Koifman updated HIVE-18860: -- Component/s: Transactions > fix TestAcidOnTez#testGetSplitsLocks >

[jira] [Assigned] (HIVE-18712) Design HMS Api v2

2018-03-02 Thread Eugene Koifman (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-18712?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eugene Koifman reassigned HIVE-18712: - Assignee: Eugene Koifman > Design HMS Api v2 > - > >

[jira] [Assigned] (HIVE-18712) Design HMS Api v2

2018-03-02 Thread Eugene Koifman (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-18712?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eugene Koifman reassigned HIVE-18712: - Assignee: Alexander Kolbasov (was: Eugene Koifman) > Design HMS Api v2 >

[jira] [Updated] (HIVE-18851) make Hive basic stats valid for ACID; clean up and refactor the code

2018-03-02 Thread Eugene Koifman (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-18851?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eugene Koifman updated HIVE-18851: -- Component/s: Transactions > make Hive basic stats valid for ACID; clean up and refactor the

[jira] [Updated] (HIVE-18851) make Hive basic stats valid for ACID; clean up and refactor the code

2018-03-02 Thread Eugene Koifman (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-18851?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eugene Koifman updated HIVE-18851: -- Component/s: Statistics > make Hive basic stats valid for ACID; clean up and refactor the code

[jira] [Commented] (HIVE-18723) CompactorOutputCommitter.commitJob() - check rename() ret val

2018-03-02 Thread Eugene Koifman (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-18723?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16384118#comment-16384118 ] Eugene Koifman commented on HIVE-18723: --- unfortunately Jenkins output is gone. Are you sure

[jira] [Updated] (HIVE-18817) ArrayIndexOutOfBounds exception during read of ACID table.

2018-03-02 Thread Eugene Koifman (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-18817?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eugene Koifman updated HIVE-18817: -- Resolution: Fixed Fix Version/s: 3.0.0 Status: Resolved (was: Patch

[jira] [Assigned] (HIVE-18845) SHOW COMAPCTIONS should show host name

2018-03-01 Thread Eugene Koifman (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-18845?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eugene Koifman reassigned HIVE-18845: - > SHOW COMAPCTIONS should show host name > -- > >

[jira] [Updated] (HIVE-18814) Support Add Partition For Acid tables

2018-03-01 Thread Eugene Koifman (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-18814?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eugene Koifman updated HIVE-18814: -- Attachment: HIVE-18814.wip.patch > Support Add Partition For Acid tables >

[jira] [Updated] (HIVE-18814) Support Add Partition For Acid tables

2018-03-01 Thread Eugene Koifman (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-18814?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eugene Koifman updated HIVE-18814: -- Description:

[jira] [Commented] (HIVE-18825) Define ValidTxnList before starting query optimization

2018-03-01 Thread Eugene Koifman (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-18825?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16382614#comment-16382614 ] Eugene Koifman commented on HIVE-18825: --- I think so - if we have no txn, we should not need

[jira] [Commented] (HIVE-18825) Define ValidTxnList before starting query optimization

2018-03-01 Thread Eugene Koifman (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-18825?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16382548#comment-16382548 ] Eugene Koifman commented on HIVE-18825: --- this assumption is not valid. For one thing if you open the

[jira] [Updated] (HIVE-18817) ArrayIndexOutOfBounds exception during read of ACID table.

2018-03-01 Thread Eugene Koifman (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-18817?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eugene Koifman updated HIVE-18817: -- Attachment: HIVE-18817.04.patch > ArrayIndexOutOfBounds exception during read of ACID table. >

[jira] [Commented] (HIVE-18824) ValidWriteIdList config should be defined on tables which has to collect stats after insert.

2018-02-28 Thread Eugene Koifman (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-18824?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16381384#comment-16381384 ] Eugene Koifman commented on HIVE-18824: --- seem reasonable. [~sankarh]? > ValidWriteIdList config

[jira] [Updated] (HIVE-18817) ArrayIndexOutOfBounds exception during read of ACID table.

2018-02-28 Thread Eugene Koifman (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-18817?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eugene Koifman updated HIVE-18817: -- Attachment: HIVE-18817.03.patch > ArrayIndexOutOfBounds exception during read of ACID table. >

[jira] [Commented] (HIVE-18817) ArrayIndexOutOfBounds exception during read of ACID table.

2018-02-28 Thread Eugene Koifman (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-18817?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16381383#comment-16381383 ] Eugene Koifman commented on HIVE-18817: --- yes, you are right, we now write an index with 1 entry in a

[jira] [Commented] (HIVE-18824) ValidWriteIdList config should be defined on tables which has to collect stats after insert.

2018-02-28 Thread Eugene Koifman (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-18824?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16381330#comment-16381330 ] Eugene Koifman commented on HIVE-18824: --- yes, that is basically the problem. > ValidWriteIdList

[jira] [Commented] (HIVE-18571) stats issues for MM tables

2018-02-28 Thread Eugene Koifman (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-18571?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16381315#comment-16381315 ] Eugene Koifman commented on HIVE-18571: --- I left some comments on RB. I think makes sense to wait

[jira] [Commented] (HIVE-18750) Exchange partition should be disabled on ACID/Insert-only tables with per table write ID.

2018-02-28 Thread Eugene Koifman (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-18750?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16381107#comment-16381107 ] Eugene Koifman commented on HIVE-18750: --- +1 assuming tests are good > Exchange partition should be

[jira] [Updated] (HIVE-18158) Remove OrcRawRecordMerger.ReaderPairAcid.statementId

2018-02-28 Thread Eugene Koifman (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-18158?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eugene Koifman updated HIVE-18158: -- Resolution: Fixed Fix Version/s: 3.0.0 Status: Resolved (was: Patch

[jira] [Commented] (HIVE-18817) ArrayIndexOutOfBounds exception during read of ACID table.

2018-02-28 Thread Eugene Koifman (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-18817?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16380842#comment-16380842 ] Eugene Koifman commented on HIVE-18817: --- I don't think any of the failures are related but attaching

[jira] [Updated] (HIVE-18817) ArrayIndexOutOfBounds exception during read of ACID table.

2018-02-28 Thread Eugene Koifman (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-18817?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eugene Koifman updated HIVE-18817: -- Attachment: HIVE-18817.02.patch > ArrayIndexOutOfBounds exception during read of ACID table. >

[jira] [Comment Edited] (HIVE-18817) ArrayIndexOutOfBounds exception during read of ACID table.

2018-02-27 Thread Eugene Koifman (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-18817?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16379801#comment-16379801 ] Eugene Koifman edited comment on HIVE-18817 at 2/28/18 5:24 AM: patch1

[jira] [Updated] (HIVE-18817) ArrayIndexOutOfBounds exception during read of ACID table.

2018-02-27 Thread Eugene Koifman (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-18817?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eugene Koifman updated HIVE-18817: -- Status: Patch Available (was: Open) patch1 fixes the issue todo: file an ORC ticket to fix

[jira] [Updated] (HIVE-18817) ArrayIndexOutOfBounds exception during read of ACID table.

2018-02-27 Thread Eugene Koifman (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-18817?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eugene Koifman updated HIVE-18817: -- Attachment: HIVE-18817.01.patch > ArrayIndexOutOfBounds exception during read of ACID table. >

[jira] [Updated] (HIVE-18816) CREATE TABLE (ACID) doesn't work with TIMESTAMPLOCALTZ column type

2018-02-27 Thread Eugene Koifman (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-18816?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eugene Koifman updated HIVE-18816: -- Component/s: Transactions > CREATE TABLE (ACID) doesn't work with TIMESTAMPLOCALTZ column type

[jira] [Updated] (HIVE-18659) add acid version marker to acid files/directories

2018-02-27 Thread Eugene Koifman (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-18659?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eugene Koifman updated HIVE-18659: -- Resolution: Fixed Fix Version/s: 3.0.0 Status: Resolved (was: Patch

[jira] [Assigned] (HIVE-18814) Support Add Partition For Acid tables

2018-02-27 Thread Eugene Koifman (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-18814?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eugene Koifman reassigned HIVE-18814: - > Support Add Partition For Acid tables > - > >

[jira] [Updated] (HIVE-18808) Make compaction more robust when stats update fails

2018-02-27 Thread Eugene Koifman (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-18808?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eugene Koifman updated HIVE-18808: -- Resolution: Fixed Fix Version/s: 3.0.0 Status: Resolved (was: Patch

[jira] [Updated] (HIVE-18808) Make compaction more robust when stats update fails

2018-02-27 Thread Eugene Koifman (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-18808?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eugene Koifman updated HIVE-18808: -- Description:   {\{Worker.gatherStats()}} runs a "analyze table..." command to update stats

[jira] [Commented] (HIVE-18158) Remove OrcRawRecordMerger.ReaderPairAcid.statementId

2018-02-27 Thread Eugene Koifman (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-18158?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16379033#comment-16379033 ] Eugene Koifman commented on HIVE-18158: --- no related failures [~gopalv] could you review please >

[jira] [Updated] (HIVE-18659) add acid version marker to acid files/directories

2018-02-27 Thread Eugene Koifman (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-18659?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eugene Koifman updated HIVE-18659: -- Attachment: HIVE-18659.14.patch > add acid version marker to acid files/directories >

[jira] [Commented] (HIVE-18750) Exchange partition should be disabled on ACID/Insert-only tables with per table write ID.

2018-02-27 Thread Eugene Koifman (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-18750?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16378983#comment-16378983 ] Eugene Koifman commented on HIVE-18750: --- I would make the error message tell the user to what to do

[jira] [Updated] (HIVE-18659) add acid version marker to acid files/directories

2018-02-26 Thread Eugene Koifman (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-18659?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eugene Koifman updated HIVE-18659: -- Attachment: HIVE-18659.13.patch > add acid version marker to acid files/directories >

[jira] [Commented] (HIVE-18808) Make compaction more robust when stats update fails

2018-02-26 Thread Eugene Koifman (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-18808?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16377981#comment-16377981 ] Eugene Koifman commented on HIVE-18808: --- no related failures [~alangates] could you review please

[jira] [Commented] (HIVE-18192) Introduce WriteID per table rather than using global transaction ID

2018-02-26 Thread Eugene Koifman (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-18192?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16377977#comment-16377977 ] Eugene Koifman commented on HIVE-18192: --- what property are you looking up?  There is 

[jira] [Updated] (HIVE-18158) Remove OrcRawRecordMerger.ReaderPairAcid.statementId

2018-02-26 Thread Eugene Koifman (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-18158?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eugene Koifman updated HIVE-18158: -- Attachment: HIVE-18158.03.patch > Remove OrcRawRecordMerger.ReaderPairAcid.statementId >

[jira] [Updated] (HIVE-18808) Make compaction more robust when stats update fails

2018-02-26 Thread Eugene Koifman (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-18808?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eugene Koifman updated HIVE-18808: -- Status: Patch Available (was: Open) > Make compaction more robust when stats update fails >

[jira] [Updated] (HIVE-18808) Make compaction more robust when stats update fails

2018-02-26 Thread Eugene Koifman (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-18808?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eugene Koifman updated HIVE-18808: -- Attachment: HIVE-18808.01.patch > Make compaction more robust when stats update fails >

[jira] [Assigned] (HIVE-18808) Make compaction more robust when stats update fails

2018-02-26 Thread Eugene Koifman (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-18808?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eugene Koifman reassigned HIVE-18808: - > Make compaction more robust when stats update fails >

[jira] [Commented] (HIVE-18773) Support multiple instances of Cleaner

2018-02-26 Thread Eugene Koifman (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-18773?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16377278#comment-16377278 ] Eugene Koifman commented on HIVE-18773: --- once HIVE-18772  is in place, whey not have the Worker

[jira] [Updated] (HIVE-18659) add acid version marker to acid files/directories

2018-02-23 Thread Eugene Koifman (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-18659?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eugene Koifman updated HIVE-18659: -- Attachment: HIVE-18659.12.patch > add acid version marker to acid files/directories >

[jira] [Updated] (HIVE-15077) Acid LockManager is unfair

2018-02-23 Thread Eugene Koifman (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-15077?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eugene Koifman updated HIVE-15077: -- Resolution: Fixed Fix Version/s: 3.0.0 Status: Resolved (was: Patch

[jira] [Updated] (HIVE-18158) Remove OrcRawRecordMerger.ReaderPairAcid.statementId

2018-02-23 Thread Eugene Koifman (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-18158?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eugene Koifman updated HIVE-18158: -- Attachment: HIVE-18158.02.patch > Remove OrcRawRecordMerger.ReaderPairAcid.statementId >

[jira] [Updated] (HIVE-18659) add acid version marker to acid files/directories

2018-02-23 Thread Eugene Koifman (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-18659?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eugene Koifman updated HIVE-18659: -- Attachment: HIVE-18659.11.patch > add acid version marker to acid files/directories >

[jira] [Updated] (HIVE-18659) add acid version marker to acid files/directories

2018-02-22 Thread Eugene Koifman (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-18659?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eugene Koifman updated HIVE-18659: -- Attachment: HIVE-18659.10.patch > add acid version marker to acid files/directories >

[jira] [Updated] (HIVE-18158) Remove OrcRawRecordMerger.ReaderPairAcid.statementId

2018-02-22 Thread Eugene Koifman (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-18158?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eugene Koifman updated HIVE-18158: -- Status: Patch Available (was: Open) > Remove OrcRawRecordMerger.ReaderPairAcid.statementId >

[jira] [Updated] (HIVE-18158) Remove OrcRawRecordMerger.ReaderPairAcid.statementId

2018-02-22 Thread Eugene Koifman (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-18158?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eugene Koifman updated HIVE-18158: -- Attachment: HIVE-18158.01.patch > Remove OrcRawRecordMerger.ReaderPairAcid.statementId >

[jira] [Commented] (HIVE-18192) Introduce WriteID per table rather than using global transaction ID

2018-02-22 Thread Eugene Koifman (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-18192?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16373704#comment-16373704 ] Eugene Koifman commented on HIVE-18192: --- I added a couple of nits on pull request for patch 16 - can

[jira] [Commented] (HIVE-15077) Acid LockManager is unfair

2018-02-22 Thread Eugene Koifman (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-15077?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16373307#comment-16373307 ] Eugene Koifman commented on HIVE-15077: --- I did make it unfair in HIVE-10242 but that was not

[jira] [Assigned] (HIVE-18772) Make Acid Cleaner use MIN_HISTORY_LEVEL

2018-02-22 Thread Eugene Koifman (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-18772?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eugene Koifman reassigned HIVE-18772: - > Make Acid Cleaner use MIN_HISTORY_LEVEL > --- > >

[jira] [Updated] (HIVE-18747) Cleaner for TXN_TO_WRITE_ID table entries/MIN_HISTORY_LEVEL.

2018-02-22 Thread Eugene Koifman (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-18747?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eugene Koifman updated HIVE-18747: -- Summary: Cleaner for TXN_TO_WRITE_ID table entries/MIN_HISTORY_LEVEL. (was: Cleaner for

[jira] [Updated] (HIVE-18659) add acid version marker to acid files/directories

2018-02-21 Thread Eugene Koifman (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-18659?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eugene Koifman updated HIVE-18659: -- Attachment: HIVE-18659.09.patch > add acid version marker to acid files/directories >

[jira] [Commented] (HIVE-18659) add acid version marker to acid files/directories

2018-02-21 Thread Eugene Koifman (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-18659?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16372145#comment-16372145 ] Eugene Koifman commented on HIVE-18659: --- patch 9 fixes tests output and checkstyle > add acid

[jira] [Updated] (HIVE-18659) add acid version marker to acid files/directories

2018-02-21 Thread Eugene Koifman (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-18659?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eugene Koifman updated HIVE-18659: -- Attachment: HIVE-18659.09.patch > add acid version marker to acid files/directories >

[jira] [Commented] (HIVE-18659) add acid version marker to acid files/directories

2018-02-20 Thread Eugene Koifman (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-18659?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16370826#comment-16370826 ] Eugene Koifman commented on HIVE-18659: --- {\{createdDeltaDirs.add(deltaDest)}}  is how it was before

[jira] [Updated] (HIVE-18659) add acid version marker to acid files/directories

2018-02-20 Thread Eugene Koifman (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-18659?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eugene Koifman updated HIVE-18659: -- Attachment: HIVE-18659.07.patch > add acid version marker to acid files/directories >

[jira] [Updated] (HIVE-18742) Vectorization acid/inputformat check should allow NullRowsInputFormat/OneNullRowInputFormat

2018-02-20 Thread Eugene Koifman (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-18742?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eugene Koifman updated HIVE-18742: -- Affects Version/s: 2.0.0 > Vectorization acid/inputformat check should allow >

[jira] [Commented] (HIVE-18192) Introduce WriteID per table rather than using global transaction ID

2018-02-20 Thread Eugene Koifman (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-18192?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16370291#comment-16370291 ] Eugene Koifman commented on HIVE-18192: --- is

[jira] [Commented] (HIVE-18751) ACID table scan through get_splits UDF doesn't receive ValidWriteIdList configuration.

2018-02-20 Thread Eugene Koifman (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-18751?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16370279#comment-16370279 ] Eugene Koifman commented on HIVE-18751: --- [~jdere] do you have any input here? [~sankarh] should

[jira] [Commented] (HIVE-18750) Exchange partition should not be supported with per table write ID.

2018-02-20 Thread Eugene Koifman (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-18750?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16370272#comment-16370272 ] Eugene Koifman commented on HIVE-18750: --- Also, Load Data is supported for Acid tables - this can be

[jira] [Commented] (HIVE-18748) Rename table should update the table names in NEXT_WRITE_ID and TXN_TO_WRITE_ID tables. 

2018-02-20 Thread Eugene Koifman (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-18748?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16370268#comment-16370268 ] Eugene Koifman commented on HIVE-18748: --- How does "rename" get surfaced to the end user?  Via Alter

[jira] [Updated] (HIVE-18742) Vectorization acid/inputformat check should allow NullRowsInputFormat/OneNullRowInputFormat

2018-02-16 Thread Eugene Koifman (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-18742?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eugene Koifman updated HIVE-18742: -- Component/s: Transactions > Vectorization acid/inputformat check should allow >

[jira] [Updated] (HIVE-18739) Add support for Export from unpartitioned Acid table

2018-02-16 Thread Eugene Koifman (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-18739?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eugene Koifman updated HIVE-18739: -- Attachment: HIVE-18739.01.patch > Add support for Export from unpartitioned Acid table >

<    8   9   10   11   12   13   14   15   16   17   >