[jira] [Updated] (HIVE-20919) Break up UpdateDeleteSemanticAnalyzer

2018-11-14 Thread Eugene Koifman (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-20919?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eugene Koifman updated HIVE-20919: -- Component/s: (was: Hive) Transactions > Break up

[jira] [Updated] (HIVE-20730) Do delete event filtering even if hive.acid.index is not there

2018-11-14 Thread Eugene Koifman (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-20730?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eugene Koifman updated HIVE-20730: -- Resolution: Fixed Fix Version/s: 4.0.0 Release Note: n/a Status:

[jira] [Updated] (HIVE-20888) TxnHandler: sort() called on immutable lists

2018-11-14 Thread Eugene Koifman (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-20888?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eugene Koifman updated HIVE-20888: -- Resolution: Fixed Fix Version/s: 4.0.0 Release Note: n/a Status:

[jira] [Updated] (HIVE-20823) Make Compactor run in a transaction

2018-11-14 Thread Eugene Koifman (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-20823?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eugene Koifman updated HIVE-20823: -- Attachment: HIVE-20823.12.patch > Make Compactor run in a transaction >

[jira] [Commented] (HIVE-20730) Do delete event filtering even if hive.acid.index is not there

2018-11-14 Thread Eugene Koifman (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-20730?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16687023#comment-16687023 ] Eugene Koifman commented on HIVE-20730: --- +1 > Do delete event filtering even if hive.acid.index is

[jira] [Commented] (HIVE-20888) TxnHandler: sort() called on immutable lists

2018-11-14 Thread Eugene Koifman (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-20888?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16687019#comment-16687019 ] Eugene Koifman commented on HIVE-20888: --- +1 > TxnHandler: sort() called on immutable lists >

[jira] [Updated] (HIVE-20823) Make Compactor run in a transaction

2018-11-12 Thread Eugene Koifman (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-20823?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eugene Koifman updated HIVE-20823: -- Attachment: HIVE-20823.11.patch > Make Compactor run in a transaction >

[jira] [Updated] (HIVE-20823) Make Compactor run in a transaction

2018-11-12 Thread Eugene Koifman (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-20823?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eugene Koifman updated HIVE-20823: -- Attachment: HIVE-20823.11.patch > Make Compactor run in a transaction >

[jira] [Updated] (HIVE-20823) Make Compactor run in a transaction

2018-11-12 Thread Eugene Koifman (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-20823?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eugene Koifman updated HIVE-20823: -- Attachment: HIVE-20823.10.patch > Make Compactor run in a transaction >

[jira] [Commented] (HIVE-20905) querying streaming table fails with out of memory exception

2018-11-12 Thread Eugene Koifman (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-20905?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16684189#comment-16684189 ] Eugene Koifman commented on HIVE-20905: --- Is modifying "conf"  issue?  This is likely shared with

[jira] [Updated] (HIVE-20905) querying streaming table fails with out of memory exception

2018-11-12 Thread Eugene Koifman (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-20905?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eugene Koifman updated HIVE-20905: -- Component/s: (was: Hive) Transactions Metastore >

[jira] [Updated] (HIVE-20823) Make Compactor run in a transaction

2018-11-10 Thread Eugene Koifman (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-20823?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eugene Koifman updated HIVE-20823: -- Attachment: HIVE-20823.09.patch > Make Compactor run in a transaction >

[jira] [Updated] (HIVE-20823) Make Compactor run in a transaction

2018-11-10 Thread Eugene Koifman (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-20823?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eugene Koifman updated HIVE-20823: -- Attachment: HIVE-20823.08.patch > Make Compactor run in a transaction >

[jira] [Assigned] (HIVE-20901) running compactor when there is nothing to do produces duplicate data

2018-11-09 Thread Eugene Koifman (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-20901?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eugene Koifman reassigned HIVE-20901: - > running compactor when there is nothing to do produces duplicate data >

[jira] [Resolved] (HIVE-20392) make compaction atomic on S3

2018-11-09 Thread Eugene Koifman (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-20392?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eugene Koifman resolved HIVE-20392. --- Resolution: Won't Fix will be handled in HIVE-20823 > make compaction atomic on S3 >

[jira] [Commented] (HIVE-20888) TxnHandler: sort() called on immutable lists

2018-11-08 Thread Eugene Koifman (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-20888?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16680581#comment-16680581 ] Eugene Koifman commented on HIVE-20888: --- cc [~ikryvenko] > TxnHandler: sort() called on immutable

[jira] [Updated] (HIVE-20888) TxnHandler: sort() called on immutable lists

2018-11-08 Thread Eugene Koifman (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-20888?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eugene Koifman updated HIVE-20888: -- Component/s: Transactions > TxnHandler: sort() called on immutable lists >

[jira] [Resolved] (HIVE-18772) Make Acid Cleaner use MIN_HISTORY_LEVEL

2018-11-08 Thread Eugene Koifman (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-18772?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eugene Koifman resolved HIVE-18772. --- Resolution: Duplicate Fix Version/s: 4.0.0 Release Note: n/a this is addressed

[jira] [Commented] (HIVE-20823) Make Compactor run in a transaction

2018-11-08 Thread Eugene Koifman (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-20823?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16679133#comment-16679133 ] Eugene Koifman commented on HIVE-20823: --- patch 5 bunch more test fixes and some real (Replication)

[jira] [Updated] (HIVE-20823) Make Compactor run in a transaction

2018-11-08 Thread Eugene Koifman (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-20823?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eugene Koifman updated HIVE-20823: -- Attachment: HIVE-20823.07.patch > Make Compactor run in a transaction >

[jira] [Commented] (HIVE-20730) Do delete event filtering even if hive.acid.index is not there

2018-11-08 Thread Eugene Koifman (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-20730?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16679147#comment-16679147 ] Eugene Koifman commented on HIVE-20730: --- [~saurabhseth] is this ready to be committed? > Do delete

[jira] [Updated] (HIVE-20823) Make Compactor run in a transaction

2018-11-08 Thread Eugene Koifman (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-20823?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eugene Koifman updated HIVE-20823: -- Attachment: HIVE-20823.05.patch > Make Compactor run in a transaction >

[jira] [Updated] (HIVE-20862) QueryId no longer shows up in the logs

2018-11-08 Thread Eugene Koifman (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-20862?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eugene Koifman updated HIVE-20862: -- Resolution: Fixed Fix Version/s: 4.0.0 Release Note: n/a Status:

[jira] [Commented] (HIVE-20887) Tests: openjdk 8 has a bug that prevents surefire from working

2018-11-08 Thread Eugene Koifman (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-20887?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16680188#comment-16680188 ] Eugene Koifman commented on HIVE-20887: --- Switching to a lower version of surefire also works, like

[jira] [Updated] (HIVE-20823) Make Compactor run in a transaction

2018-11-06 Thread Eugene Koifman (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-20823?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eugene Koifman updated HIVE-20823: -- Attachment: HIVE-20823.04.patch > Make Compactor run in a transaction >

[jira] [Commented] (HIVE-20581) Eliminate rename() from full CRUD transactional tables

2018-11-06 Thread Eugene Koifman (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-20581?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16677349#comment-16677349 ] Eugene Koifman commented on HIVE-20581: --- Like Sergey said, this is to make full CRUD behave like

[jira] [Commented] (HIVE-20730) Do delete event filtering even if hive.acid.index is not there

2018-11-06 Thread Eugene Koifman (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-20730?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16677240#comment-16677240 ] Eugene Koifman commented on HIVE-20730: --- I think {{OrcRecordUpdater.parseKeyIndex(reader);}} will

[jira] [Updated] (HIVE-20874) Add ability to to run high priority compaction

2018-11-06 Thread Eugene Koifman (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-20874?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eugene Koifman updated HIVE-20874: -- Description: currently all compaction requests (via Alter Table command or auto initiated

[jira] [Updated] (HIVE-20863) remove dead code

2018-11-05 Thread Eugene Koifman (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-20863?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eugene Koifman updated HIVE-20863: -- Status: Open (was: Patch Available) > remove dead code > > >

[jira] [Commented] (HIVE-20862) QueryId no longer shows up in the logs

2018-11-05 Thread Eugene Koifman (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-20862?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16675580#comment-16675580 ] Eugene Koifman commented on HIVE-20862: --- no related failures   > QueryId no longer shows up in

[jira] [Commented] (HIVE-20863) remove dead code

2018-11-02 Thread Eugene Koifman (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-20863?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16673874#comment-16673874 ] Eugene Koifman commented on HIVE-20863: --- [~vgumashta] could you review please > remove dead code >

[jira] [Commented] (HIVE-20862) QueryId no longer shows up in the logs

2018-11-02 Thread Eugene Koifman (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-20862?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16673875#comment-16673875 ] Eugene Koifman commented on HIVE-20862: --- [~vgumashta] could you review please > QueryId no longer

[jira] [Updated] (HIVE-20823) Make Compactor run in a transaction

2018-11-02 Thread Eugene Koifman (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-20823?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eugene Koifman updated HIVE-20823: -- Attachment: HIVE-20823.03.patch > Make Compactor run in a transaction >

[jira] [Updated] (HIVE-20863) remove dead code

2018-11-02 Thread Eugene Koifman (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-20863?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eugene Koifman updated HIVE-20863: -- Attachment: HIVE-20863.01.patch > remove dead code > > > Key:

[jira] [Updated] (HIVE-20863) remove dead code

2018-11-02 Thread Eugene Koifman (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-20863?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eugene Koifman updated HIVE-20863: -- Status: Patch Available (was: Open) > remove dead code > > >

[jira] [Updated] (HIVE-20862) QueryId no longer shows up in the logs

2018-11-02 Thread Eugene Koifman (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-20862?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eugene Koifman updated HIVE-20862: -- Status: Patch Available (was: Open) > QueryId no longer shows up in the logs >

[jira] [Updated] (HIVE-20862) QueryId no longer shows up in the logs

2018-11-02 Thread Eugene Koifman (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-20862?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eugene Koifman updated HIVE-20862: -- Attachment: HIVE-20862.01.patch > QueryId no longer shows up in the logs >

[jira] [Assigned] (HIVE-20862) QueryId no longer shows up in the logs

2018-11-02 Thread Eugene Koifman (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-20862?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eugene Koifman reassigned HIVE-20862: - > QueryId no longer shows up in the logs > -- > >

[jira] [Assigned] (HIVE-20863) remove dead code

2018-11-02 Thread Eugene Koifman (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-20863?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eugene Koifman reassigned HIVE-20863: - > remove dead code > > > Key: HIVE-20863 >

[jira] [Commented] (HIVE-18772) Make Acid Cleaner use MIN_HISTORY_LEVEL

2018-11-01 Thread Eugene Koifman (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-18772?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16672392#comment-16672392 ] Eugene Koifman commented on HIVE-18772: --- patch 4 is a rebase of 3 > Make Acid Cleaner use

[jira] [Updated] (HIVE-18772) Make Acid Cleaner use MIN_HISTORY_LEVEL

2018-11-01 Thread Eugene Koifman (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-18772?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eugene Koifman updated HIVE-18772: -- Attachment: HIVE-18772.04.patch > Make Acid Cleaner use MIN_HISTORY_LEVEL >

[jira] [Updated] (HIVE-20859) clean up invocation of Worker/Cleaner/Initiator in test code

2018-11-01 Thread Eugene Koifman (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-20859?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eugene Koifman updated HIVE-20859: -- Priority: Minor (was: Major) > clean up invocation of Worker/Cleaner/Initiator in test code >

[jira] [Updated] (HIVE-20856) ValidReaderWriteIdList() is not valid in most places

2018-11-01 Thread Eugene Koifman (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-20856?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eugene Koifman updated HIVE-20856: -- Description: Most of the time it's something like this:

[jira] [Commented] (HIVE-20852) Compaction Initiator ignores datas inserted by Stream Data Ingest

2018-11-01 Thread Eugene Koifman (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-20852?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16671961#comment-16671961 ] Eugene Koifman commented on HIVE-20852: --- could you provide a more detailed repro case? >

[jira] [Updated] (HIVE-20852) Compaction Initiator ignores datas inserted by Stream Data Ingest

2018-11-01 Thread Eugene Koifman (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-20852?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eugene Koifman updated HIVE-20852: -- Component/s: Transactions > Compaction Initiator ignores datas inserted by Stream Data Ingest

[jira] [Commented] (HIVE-20460) AcidUtils.Directory.getAbortedDirectories() may be missed for full CRUD tables

2018-10-31 Thread Eugene Koifman (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-20460?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16670775#comment-16670775 ] Eugene Koifman commented on HIVE-20460: --- the system isn't quite ready for this. full CRUD still

[jira] [Updated] (HIVE-20823) Make Compactor run in a transaction

2018-10-29 Thread Eugene Koifman (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-20823?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eugene Koifman updated HIVE-20823: -- Status: Patch Available (was: Open) 01.patch - see what breaks > Make Compactor run in a

[jira] [Updated] (HIVE-20823) Make Compactor run in a transaction

2018-10-29 Thread Eugene Koifman (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-20823?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eugene Koifman updated HIVE-20823: -- Attachment: HIVE-20823.01.patch > Make Compactor run in a transaction >

[jira] [Assigned] (HIVE-20825) Hive ACID Merge generates invalid ORC files (bucket files 0 or 3 bytes in length) causing the "Not a valid ORC file" error

2018-10-29 Thread Eugene Koifman (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-20825?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eugene Koifman reassigned HIVE-20825: - Assignee: (was: Eugene Koifman) > Hive ACID Merge generates invalid ORC files

[jira] [Commented] (HIVE-20825) Hive ACID Merge generates invalid ORC files (bucket files 0 or 3 bytes in length) causing the "Not a valid ORC file" error

2018-10-29 Thread Eugene Koifman (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-20825?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16667760#comment-16667760 ] Eugene Koifman commented on HIVE-20825: --- Perhaps HIVE-14014 is relevant. I tried these examples on

[jira] [Assigned] (HIVE-20825) Hive ACID Merge generates invalid ORC files (bucket files 0 or 3 bytes in length) causing the "Not a valid ORC file" error

2018-10-27 Thread Eugene Koifman (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-20825?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eugene Koifman reassigned HIVE-20825: - Assignee: Eugene Koifman > Hive ACID Merge generates invalid ORC files (bucket files 0

[jira] [Assigned] (HIVE-20823) Make Compactor run in a transaction

2018-10-26 Thread Eugene Koifman (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-20823?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eugene Koifman reassigned HIVE-20823: - > Make Compactor run in a transaction > --- > >

[jira] [Updated] (HIVE-14516) OrcInputFormat.SplitGenerator.callInternal() can be optimized

2018-10-25 Thread Eugene Koifman (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-14516?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eugene Koifman updated HIVE-14516: -- Resolution: Fixed Fix Version/s: 4.0.0 Status: Resolved (was: Patch

[jira] [Commented] (HIVE-14516) OrcInputFormat.SplitGenerator.callInternal() can be optimized

2018-10-25 Thread Eugene Koifman (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-14516?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16664066#comment-16664066 ] Eugene Koifman commented on HIVE-14516: --- +1 > OrcInputFormat.SplitGenerator.callInternal() can be

[jira] [Assigned] (HIVE-20699) Query based compactor for full CRUD Acid tables

2018-10-24 Thread Eugene Koifman (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-20699?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eugene Koifman reassigned HIVE-20699: - Assignee: Vaibhav Gumashta (was: Eugene Koifman) > Query based compactor for full CRUD

[jira] [Assigned] (HIVE-14516) OrcInputFormat.SplitGenerator.callInternal() can be optimized

2018-10-24 Thread Eugene Koifman (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-14516?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eugene Koifman reassigned HIVE-14516: - Assignee: Igor Kryvenko (was: Eugene Koifman) >

[jira] [Commented] (HIVE-18045) can VectorizedOrcAcidRowBatchReader be used all the time

2018-10-22 Thread Eugene Koifman (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-18045?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16659680#comment-16659680 ] Eugene Koifman commented on HIVE-18045: --- make sure VirtualColumn like INPUT__FILE__NAME continue to

[jira] [Updated] (HIVE-18772) Make Acid Cleaner use MIN_HISTORY_LEVEL

2018-10-19 Thread Eugene Koifman (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-18772?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eugene Koifman updated HIVE-18772: -- Description: Instead of using Lock Manager state as it currently does. This will eliminate

[jira] [Commented] (HIVE-17296) Acid tests with multiple splits

2018-10-17 Thread Eugene Koifman (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-17296?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16654224#comment-16654224 ] Eugene Koifman commented on HIVE-17296: --- see HIVE-20694 and TestVectorizedOrcAcidRowBatchReader >

[jira] [Updated] (HIVE-17296) Acid tests with multiple splits

2018-10-17 Thread Eugene Koifman (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-17296?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eugene Koifman updated HIVE-17296: -- Priority: Major (was: Blocker) > Acid tests with multiple splits >

[jira] [Resolved] (HIVE-17231) ColumnizedDeleteEventRegistry.DeleteReaderValue optimization

2018-10-16 Thread Eugene Koifman (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-17231?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eugene Koifman resolved HIVE-17231. --- Resolution: Fixed Fix Version/s: 4.0.0 Release Note: n/a committed to master

[jira] [Commented] (HIVE-20753) Derby thread interrupt during ptest

2018-10-16 Thread Eugene Koifman (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-20753?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16652021#comment-16652021 ] Eugene Koifman commented on HIVE-20753: --- derby can't handle concurrent threads. In the past I've

[jira] [Commented] (HIVE-17231) ColumnizedDeleteEventRegistry.DeleteReaderValue optimization

2018-10-16 Thread Eugene Koifman (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-17231?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16651986#comment-16651986 ] Eugene Koifman commented on HIVE-17231: --- [~gopalv], ping >

[jira] [Updated] (HIVE-20538) Allow to store a key value together with a transaction.

2018-10-15 Thread Eugene Koifman (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-20538?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eugene Koifman updated HIVE-20538: -- Resolution: Fixed Fix Version/s: 4.0.0 Status: Resolved (was: Patch

[jira] [Commented] (HIVE-20538) Allow to store a key value together with a transaction.

2018-10-15 Thread Eugene Koifman (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-20538?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16650537#comment-16650537 ] Eugene Koifman commented on HIVE-20538: --- +1 > Allow to store a key value together with a

[jira] [Commented] (HIVE-20723) Allow per table specification of compaction yarn queue

2018-10-13 Thread Eugene Koifman (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-20723?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16649159#comment-16649159 ] Eugene Koifman commented on HIVE-20723: --- committed to master thanks Saurabh for the contribution >

[jira] [Updated] (HIVE-20723) Allow per table specification of compaction yarn queue

2018-10-13 Thread Eugene Koifman (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-20723?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eugene Koifman updated HIVE-20723: -- Resolution: Fixed Fix Version/s: 4.0.0 Status: Resolved (was: Patch

[jira] [Updated] (HIVE-20719) SELECT statement fails after UPDATE with hive.optimize.sort.dynamic.partition optimization and vectorization on

2018-10-13 Thread Eugene Koifman (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-20719?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eugene Koifman updated HIVE-20719: -- Resolution: Fixed Fix Version/s: 4.0.0 Status: Resolved (was: Patch

[jira] [Updated] (HIVE-17231) ColumnizedDeleteEventRegistry.DeleteReaderValue optimization

2018-10-12 Thread Eugene Koifman (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-17231?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eugene Koifman updated HIVE-17231: -- Status: Open (was: Patch Available) cancel patch since it already ran on patch 2 >

[jira] [Commented] (HIVE-17231) ColumnizedDeleteEventRegistry.DeleteReaderValue optimization

2018-10-12 Thread Eugene Koifman (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-17231?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16648583#comment-16648583 ] Eugene Koifman commented on HIVE-17231: --- [~gopalv] could you review please? >

[jira] [Updated] (HIVE-20699) Query based compactor for full CRUD Acid tables

2018-10-12 Thread Eugene Koifman (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-20699?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eugene Koifman updated HIVE-20699: -- Description: Currently the Acid compactor is implemented as generated MR job

[jira] [Updated] (HIVE-20699) Query based compactor for full CRUD Acid tables

2018-10-12 Thread Eugene Koifman (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-20699?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eugene Koifman updated HIVE-20699: -- Description: Currently the Acid compactor is implemented as generated MR job

[jira] [Resolved] (HIVE-20579) VectorizedOrcAcidRowBatchReader.checkBucketId() should run for unbucketed tables

2018-10-12 Thread Eugene Koifman (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-20579?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eugene Koifman resolved HIVE-20579. --- Resolution: Implemented Assignee: Eugene Koifman Release Note: n/a fixed as

[jira] [Updated] (HIVE-20694) Additional unit tests for VectorizedOrcAcidRowBatchReader min max key evaluation

2018-10-12 Thread Eugene Koifman (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-20694?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eugene Koifman updated HIVE-20694: -- Issue Type: Sub-task (was: Test) Parent: HIVE-20738 > Additional unit tests for

[jira] [Updated] (HIVE-20664) Potential ArrayIndexOutOfBoundsException in VectorizedOrcAcidRowBatchReader.findMinMaxKeys

2018-10-12 Thread Eugene Koifman (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-20664?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eugene Koifman updated HIVE-20664: -- Issue Type: Sub-task (was: Bug) Parent: HIVE-20738 > Potential

[jira] [Updated] (HIVE-20635) VectorizedOrcAcidRowBatchReader doesn't filter delete events for original files

2018-10-12 Thread Eugene Koifman (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-20635?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eugene Koifman updated HIVE-20635: -- Issue Type: Sub-task (was: Improvement) Parent: HIVE-20738 >

[jira] [Updated] (HIVE-16812) VectorizedOrcAcidRowBatchReader doesn't filter delete events

2018-10-12 Thread Eugene Koifman (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-16812?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eugene Koifman updated HIVE-16812: -- Issue Type: Sub-task (was: Improvement) Parent: HIVE-20738 >

[jira] [Updated] (HIVE-20579) VectorizedOrcAcidRowBatchReader.checkBucketId() should run for unbucketed tables

2018-10-12 Thread Eugene Koifman (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-20579?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eugene Koifman updated HIVE-20579: -- Issue Type: Sub-task (was: Improvement) Parent: HIVE-20738 >

[jira] [Updated] (HIVE-17231) ColumnizedDeleteEventRegistry.DeleteReaderValue optimization

2018-10-12 Thread Eugene Koifman (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-17231?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eugene Koifman updated HIVE-17231: -- Parent Issue: HIVE-20738 (was: HIVE-17204) > ColumnizedDeleteEventRegistry.DeleteReaderValue

[jira] [Assigned] (HIVE-20738) Enable Delete Event filtering in VectorizedOrcAcidRowBatchReader

2018-10-12 Thread Eugene Koifman (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-20738?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eugene Koifman reassigned HIVE-20738: - > Enable Delete Event filtering in VectorizedOrcAcidRowBatchReader >

[jira] [Updated] (HIVE-17231) ColumnizedDeleteEventRegistry.DeleteReaderValue optimization

2018-10-12 Thread Eugene Koifman (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-17231?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eugene Koifman updated HIVE-17231: -- Attachment: HIVE-17231.02.patch > ColumnizedDeleteEventRegistry.DeleteReaderValue optimization

[jira] [Updated] (HIVE-20719) SELECT statement fails after UPDATE with hive.optimize.sort.dynamic.partition optimization and vectorization on

2018-10-11 Thread Eugene Koifman (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-20719?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eugene Koifman updated HIVE-20719: -- Attachment: HIVE-20719.01.patch > SELECT statement fails after UPDATE with

[jira] [Updated] (HIVE-20719) SELECT statement fails after UPDATE with hive.optimize.sort.dynamic.partition optimization and vectorization on

2018-10-11 Thread Eugene Koifman (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-20719?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eugene Koifman updated HIVE-20719: -- Status: Patch Available (was: Open) > SELECT statement fails after UPDATE with

[jira] [Commented] (HIVE-20719) SELECT statement fails after UPDATE with hive.optimize.sort.dynamic.partition optimization and vectorization on

2018-10-11 Thread Eugene Koifman (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-20719?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16646834#comment-16646834 ] Eugene Koifman commented on HIVE-20719: --- Disabling vectorization doesn't actually fix it. The

[jira] [Assigned] (HIVE-20719) SELECT statement fails after UPDATE with hive.optimize.sort.dynamic.partition optimization and vectorization on

2018-10-11 Thread Eugene Koifman (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-20719?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eugene Koifman reassigned HIVE-20719: - Assignee: Eugene Koifman > SELECT statement fails after UPDATE with

[jira] [Updated] (HIVE-17231) ColumnizedDeleteEventRegistry.DeleteReaderValue optimization

2018-10-10 Thread Eugene Koifman (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-17231?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eugene Koifman updated HIVE-17231: -- Attachment: HIVE-17231.01.patch > ColumnizedDeleteEventRegistry.DeleteReaderValue optimization

[jira] [Updated] (HIVE-17231) ColumnizedDeleteEventRegistry.DeleteReaderValue optimization

2018-10-10 Thread Eugene Koifman (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-17231?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eugene Koifman updated HIVE-17231: -- Status: Patch Available (was: Open) > ColumnizedDeleteEventRegistry.DeleteReaderValue

[jira] [Commented] (HIVE-17231) ColumnizedDeleteEventRegistry.DeleteReaderValue optimization

2018-10-10 Thread Eugene Koifman (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-17231?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16645598#comment-16645598 ] Eugene Koifman commented on HIVE-17231: --- todo: roll HIVE-20579 into this >

[jira] [Assigned] (HIVE-17231) ColumnizedDeleteEventRegistry.DeleteReaderValue optimization

2018-10-10 Thread Eugene Koifman (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-17231?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eugene Koifman reassigned HIVE-17231: - Assignee: Eugene Koifman > ColumnizedDeleteEventRegistry.DeleteReaderValue optimization

[jira] [Commented] (HIVE-20723) Allow per table specification of compaction yarn queue

2018-10-10 Thread Eugene Koifman (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-20723?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16645420#comment-16645420 ] Eugene Koifman commented on HIVE-20723: --- FYI, [~ikryvenko], [~saurabhseth] > Allow per table

[jira] [Updated] (HIVE-20723) Allow per table specification of compaction yarn queue

2018-10-10 Thread Eugene Koifman (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-20723?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eugene Koifman updated HIVE-20723: -- Description: Currently compactions of full CRUD transactional tables are Map-Reduce jobs

[jira] [Updated] (HIVE-20694) Additional unit tests for VectorizedOrcAcidRowBatchReader min max key evaluation

2018-10-09 Thread Eugene Koifman (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-20694?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eugene Koifman updated HIVE-20694: -- Resolution: Fixed Fix Version/s: 4.0.0 Release Note: n/a Status:

[jira] [Commented] (HIVE-20694) Additional unit tests for VectorizedOrcAcidRowBatchReader min max key evaluation

2018-10-09 Thread Eugene Koifman (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-20694?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16644208#comment-16644208 ] Eugene Koifman commented on HIVE-20694: --- +1 > Additional unit tests for

[jira] [Updated] (HIVE-20719) SELECT statement fails after UPDATE with hive.optimize.sort.dynamic.partition optimization and vectorization on

2018-10-09 Thread Eugene Koifman (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-20719?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eugene Koifman updated HIVE-20719: -- Component/s: Transactions > SELECT statement fails after UPDATE with

[jira] [Updated] (HIVE-20635) VectorizedOrcAcidRowBatchReader doesn't filter delete events for original files

2018-10-06 Thread Eugene Koifman (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-20635?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eugene Koifman updated HIVE-20635: -- Resolution: Fixed Fix Version/s: 4.0.0 Release Note: n/a Status:

[jira] [Commented] (HIVE-20635) VectorizedOrcAcidRowBatchReader doesn't filter delete events for original files

2018-10-06 Thread Eugene Koifman (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-20635?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16640876#comment-16640876 ] Eugene Koifman commented on HIVE-20635: --- committed patch 3 to master thanks Saurabh for the

[jira] [Assigned] (HIVE-20699) Query based compactor for full CRUD Acid tables

2018-10-05 Thread Eugene Koifman (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-20699?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eugene Koifman reassigned HIVE-20699: - > Query based compactor for full CRUD Acid tables >

[jira] [Assigned] (HIVE-19550) Enable TestAcidOnTez#testNonStandardConversion01

2018-10-05 Thread Eugene Koifman (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-19550?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eugene Koifman reassigned HIVE-19550: - Assignee: Eugene Koifman > Enable TestAcidOnTez#testNonStandardConversion01 >

[jira] [Assigned] (HIVE-19549) Enable TestAcidOnTez#testCtasTezUnion

2018-10-05 Thread Eugene Koifman (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-19549?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eugene Koifman reassigned HIVE-19549: - Assignee: Eugene Koifman > Enable TestAcidOnTez#testCtasTezUnion >

[jira] [Commented] (HIVE-20635) VectorizedOrcAcidRowBatchReader doesn't filter delete events for original files

2018-10-05 Thread Eugene Koifman (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-20635?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16640053#comment-16640053 ] Eugene Koifman commented on HIVE-20635: --- +1 patch 3 pending tests >

<    1   2   3   4   5   6   7   8   9   10   >