[jira] [Updated] (HIVE-20862) QueryId no longer shows up in the logs

2018-11-08 Thread Eugene Koifman (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-20862?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eugene Koifman updated HIVE-20862: -- Resolution: Fixed Fix Version/s: 4.0.0 Release Note: n/a Status:

[jira] [Commented] (HIVE-20887) Tests: openjdk 8 has a bug that prevents surefire from working

2018-11-08 Thread Eugene Koifman (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-20887?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16680188#comment-16680188 ] Eugene Koifman commented on HIVE-20887: --- Switching to a lower version of surefire also works, like

[jira] [Updated] (HIVE-20823) Make Compactor run in a transaction

2018-11-06 Thread Eugene Koifman (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-20823?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eugene Koifman updated HIVE-20823: -- Attachment: HIVE-20823.04.patch > Make Compactor run in a transaction >

[jira] [Commented] (HIVE-20581) Eliminate rename() from full CRUD transactional tables

2018-11-06 Thread Eugene Koifman (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-20581?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16677349#comment-16677349 ] Eugene Koifman commented on HIVE-20581: --- Like Sergey said, this is to make full CRUD behave like

[jira] [Commented] (HIVE-20730) Do delete event filtering even if hive.acid.index is not there

2018-11-06 Thread Eugene Koifman (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-20730?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16677240#comment-16677240 ] Eugene Koifman commented on HIVE-20730: --- I think {{OrcRecordUpdater.parseKeyIndex(reader);}} will

[jira] [Updated] (HIVE-20874) Add ability to to run high priority compaction

2018-11-06 Thread Eugene Koifman (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-20874?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eugene Koifman updated HIVE-20874: -- Description: currently all compaction requests (via Alter Table command or auto initiated

[jira] [Updated] (HIVE-20863) remove dead code

2018-11-05 Thread Eugene Koifman (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-20863?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eugene Koifman updated HIVE-20863: -- Status: Open (was: Patch Available) > remove dead code > > >

[jira] [Commented] (HIVE-20862) QueryId no longer shows up in the logs

2018-11-05 Thread Eugene Koifman (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-20862?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16675580#comment-16675580 ] Eugene Koifman commented on HIVE-20862: --- no related failures   > QueryId no longer shows up in

[jira] [Commented] (HIVE-20863) remove dead code

2018-11-02 Thread Eugene Koifman (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-20863?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16673874#comment-16673874 ] Eugene Koifman commented on HIVE-20863: --- [~vgumashta] could you review please > remove dead code >

[jira] [Commented] (HIVE-20862) QueryId no longer shows up in the logs

2018-11-02 Thread Eugene Koifman (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-20862?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16673875#comment-16673875 ] Eugene Koifman commented on HIVE-20862: --- [~vgumashta] could you review please > QueryId no longer

[jira] [Updated] (HIVE-20823) Make Compactor run in a transaction

2018-11-02 Thread Eugene Koifman (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-20823?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eugene Koifman updated HIVE-20823: -- Attachment: HIVE-20823.03.patch > Make Compactor run in a transaction >

[jira] [Updated] (HIVE-20863) remove dead code

2018-11-02 Thread Eugene Koifman (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-20863?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eugene Koifman updated HIVE-20863: -- Attachment: HIVE-20863.01.patch > remove dead code > > > Key:

[jira] [Updated] (HIVE-20863) remove dead code

2018-11-02 Thread Eugene Koifman (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-20863?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eugene Koifman updated HIVE-20863: -- Status: Patch Available (was: Open) > remove dead code > > >

[jira] [Updated] (HIVE-20862) QueryId no longer shows up in the logs

2018-11-02 Thread Eugene Koifman (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-20862?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eugene Koifman updated HIVE-20862: -- Status: Patch Available (was: Open) > QueryId no longer shows up in the logs >

[jira] [Updated] (HIVE-20862) QueryId no longer shows up in the logs

2018-11-02 Thread Eugene Koifman (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-20862?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eugene Koifman updated HIVE-20862: -- Attachment: HIVE-20862.01.patch > QueryId no longer shows up in the logs >

[jira] [Assigned] (HIVE-20862) QueryId no longer shows up in the logs

2018-11-02 Thread Eugene Koifman (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-20862?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eugene Koifman reassigned HIVE-20862: - > QueryId no longer shows up in the logs > -- > >

[jira] [Assigned] (HIVE-20863) remove dead code

2018-11-02 Thread Eugene Koifman (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-20863?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eugene Koifman reassigned HIVE-20863: - > remove dead code > > > Key: HIVE-20863 >

[jira] [Commented] (HIVE-18772) Make Acid Cleaner use MIN_HISTORY_LEVEL

2018-11-01 Thread Eugene Koifman (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-18772?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16672392#comment-16672392 ] Eugene Koifman commented on HIVE-18772: --- patch 4 is a rebase of 3 > Make Acid Cleaner use

[jira] [Updated] (HIVE-18772) Make Acid Cleaner use MIN_HISTORY_LEVEL

2018-11-01 Thread Eugene Koifman (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-18772?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eugene Koifman updated HIVE-18772: -- Attachment: HIVE-18772.04.patch > Make Acid Cleaner use MIN_HISTORY_LEVEL >

[jira] [Updated] (HIVE-20859) clean up invocation of Worker/Cleaner/Initiator in test code

2018-11-01 Thread Eugene Koifman (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-20859?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eugene Koifman updated HIVE-20859: -- Priority: Minor (was: Major) > clean up invocation of Worker/Cleaner/Initiator in test code >

[jira] [Updated] (HIVE-20856) ValidReaderWriteIdList() is not valid in most places

2018-11-01 Thread Eugene Koifman (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-20856?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eugene Koifman updated HIVE-20856: -- Description: Most of the time it's something like this:

[jira] [Commented] (HIVE-20852) Compaction Initiator ignores datas inserted by Stream Data Ingest

2018-11-01 Thread Eugene Koifman (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-20852?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16671961#comment-16671961 ] Eugene Koifman commented on HIVE-20852: --- could you provide a more detailed repro case? >

[jira] [Updated] (HIVE-20852) Compaction Initiator ignores datas inserted by Stream Data Ingest

2018-11-01 Thread Eugene Koifman (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-20852?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eugene Koifman updated HIVE-20852: -- Component/s: Transactions > Compaction Initiator ignores datas inserted by Stream Data Ingest

[jira] [Commented] (HIVE-20460) AcidUtils.Directory.getAbortedDirectories() may be missed for full CRUD tables

2018-10-31 Thread Eugene Koifman (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-20460?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16670775#comment-16670775 ] Eugene Koifman commented on HIVE-20460: --- the system isn't quite ready for this. full CRUD still

[jira] [Updated] (HIVE-20823) Make Compactor run in a transaction

2018-10-29 Thread Eugene Koifman (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-20823?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eugene Koifman updated HIVE-20823: -- Status: Patch Available (was: Open) 01.patch - see what breaks > Make Compactor run in a

[jira] [Updated] (HIVE-20823) Make Compactor run in a transaction

2018-10-29 Thread Eugene Koifman (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-20823?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eugene Koifman updated HIVE-20823: -- Attachment: HIVE-20823.01.patch > Make Compactor run in a transaction >

[jira] [Assigned] (HIVE-20825) Hive ACID Merge generates invalid ORC files (bucket files 0 or 3 bytes in length) causing the "Not a valid ORC file" error

2018-10-29 Thread Eugene Koifman (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-20825?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eugene Koifman reassigned HIVE-20825: - Assignee: (was: Eugene Koifman) > Hive ACID Merge generates invalid ORC files

[jira] [Commented] (HIVE-20825) Hive ACID Merge generates invalid ORC files (bucket files 0 or 3 bytes in length) causing the "Not a valid ORC file" error

2018-10-29 Thread Eugene Koifman (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-20825?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16667760#comment-16667760 ] Eugene Koifman commented on HIVE-20825: --- Perhaps HIVE-14014 is relevant. I tried these examples on

[jira] [Assigned] (HIVE-20825) Hive ACID Merge generates invalid ORC files (bucket files 0 or 3 bytes in length) causing the "Not a valid ORC file" error

2018-10-27 Thread Eugene Koifman (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-20825?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eugene Koifman reassigned HIVE-20825: - Assignee: Eugene Koifman > Hive ACID Merge generates invalid ORC files (bucket files 0

[jira] [Assigned] (HIVE-20823) Make Compactor run in a transaction

2018-10-26 Thread Eugene Koifman (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-20823?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eugene Koifman reassigned HIVE-20823: - > Make Compactor run in a transaction > --- > >

[jira] [Updated] (HIVE-14516) OrcInputFormat.SplitGenerator.callInternal() can be optimized

2018-10-25 Thread Eugene Koifman (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-14516?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eugene Koifman updated HIVE-14516: -- Resolution: Fixed Fix Version/s: 4.0.0 Status: Resolved (was: Patch

[jira] [Commented] (HIVE-14516) OrcInputFormat.SplitGenerator.callInternal() can be optimized

2018-10-25 Thread Eugene Koifman (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-14516?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16664066#comment-16664066 ] Eugene Koifman commented on HIVE-14516: --- +1 > OrcInputFormat.SplitGenerator.callInternal() can be

[jira] [Assigned] (HIVE-20699) Query based compactor for full CRUD Acid tables

2018-10-24 Thread Eugene Koifman (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-20699?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eugene Koifman reassigned HIVE-20699: - Assignee: Vaibhav Gumashta (was: Eugene Koifman) > Query based compactor for full CRUD

[jira] [Assigned] (HIVE-14516) OrcInputFormat.SplitGenerator.callInternal() can be optimized

2018-10-24 Thread Eugene Koifman (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-14516?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eugene Koifman reassigned HIVE-14516: - Assignee: Igor Kryvenko (was: Eugene Koifman) >

[jira] [Commented] (HIVE-18045) can VectorizedOrcAcidRowBatchReader be used all the time

2018-10-22 Thread Eugene Koifman (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-18045?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16659680#comment-16659680 ] Eugene Koifman commented on HIVE-18045: --- make sure VirtualColumn like INPUT__FILE__NAME continue to

[jira] [Updated] (HIVE-18772) Make Acid Cleaner use MIN_HISTORY_LEVEL

2018-10-19 Thread Eugene Koifman (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-18772?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eugene Koifman updated HIVE-18772: -- Description: Instead of using Lock Manager state as it currently does. This will eliminate

[jira] [Commented] (HIVE-17296) Acid tests with multiple splits

2018-10-17 Thread Eugene Koifman (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-17296?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16654224#comment-16654224 ] Eugene Koifman commented on HIVE-17296: --- see HIVE-20694 and TestVectorizedOrcAcidRowBatchReader >

[jira] [Updated] (HIVE-17296) Acid tests with multiple splits

2018-10-17 Thread Eugene Koifman (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-17296?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eugene Koifman updated HIVE-17296: -- Priority: Major (was: Blocker) > Acid tests with multiple splits >

[jira] [Resolved] (HIVE-17231) ColumnizedDeleteEventRegistry.DeleteReaderValue optimization

2018-10-16 Thread Eugene Koifman (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-17231?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eugene Koifman resolved HIVE-17231. --- Resolution: Fixed Fix Version/s: 4.0.0 Release Note: n/a committed to master

[jira] [Commented] (HIVE-20753) Derby thread interrupt during ptest

2018-10-16 Thread Eugene Koifman (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-20753?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16652021#comment-16652021 ] Eugene Koifman commented on HIVE-20753: --- derby can't handle concurrent threads. In the past I've

[jira] [Commented] (HIVE-17231) ColumnizedDeleteEventRegistry.DeleteReaderValue optimization

2018-10-16 Thread Eugene Koifman (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-17231?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16651986#comment-16651986 ] Eugene Koifman commented on HIVE-17231: --- [~gopalv], ping >

[jira] [Updated] (HIVE-20538) Allow to store a key value together with a transaction.

2018-10-15 Thread Eugene Koifman (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-20538?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eugene Koifman updated HIVE-20538: -- Resolution: Fixed Fix Version/s: 4.0.0 Status: Resolved (was: Patch

[jira] [Commented] (HIVE-20538) Allow to store a key value together with a transaction.

2018-10-15 Thread Eugene Koifman (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-20538?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16650537#comment-16650537 ] Eugene Koifman commented on HIVE-20538: --- +1 > Allow to store a key value together with a

[jira] [Commented] (HIVE-20723) Allow per table specification of compaction yarn queue

2018-10-13 Thread Eugene Koifman (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-20723?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16649159#comment-16649159 ] Eugene Koifman commented on HIVE-20723: --- committed to master thanks Saurabh for the contribution >

[jira] [Updated] (HIVE-20723) Allow per table specification of compaction yarn queue

2018-10-13 Thread Eugene Koifman (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-20723?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eugene Koifman updated HIVE-20723: -- Resolution: Fixed Fix Version/s: 4.0.0 Status: Resolved (was: Patch

[jira] [Updated] (HIVE-20719) SELECT statement fails after UPDATE with hive.optimize.sort.dynamic.partition optimization and vectorization on

2018-10-13 Thread Eugene Koifman (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-20719?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eugene Koifman updated HIVE-20719: -- Resolution: Fixed Fix Version/s: 4.0.0 Status: Resolved (was: Patch

[jira] [Updated] (HIVE-17231) ColumnizedDeleteEventRegistry.DeleteReaderValue optimization

2018-10-12 Thread Eugene Koifman (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-17231?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eugene Koifman updated HIVE-17231: -- Status: Open (was: Patch Available) cancel patch since it already ran on patch 2 >

[jira] [Commented] (HIVE-17231) ColumnizedDeleteEventRegistry.DeleteReaderValue optimization

2018-10-12 Thread Eugene Koifman (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-17231?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16648583#comment-16648583 ] Eugene Koifman commented on HIVE-17231: --- [~gopalv] could you review please? >

[jira] [Updated] (HIVE-20699) Query based compactor for full CRUD Acid tables

2018-10-12 Thread Eugene Koifman (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-20699?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eugene Koifman updated HIVE-20699: -- Description: Currently the Acid compactor is implemented as generated MR job

[jira] [Updated] (HIVE-20699) Query based compactor for full CRUD Acid tables

2018-10-12 Thread Eugene Koifman (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-20699?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eugene Koifman updated HIVE-20699: -- Description: Currently the Acid compactor is implemented as generated MR job

[jira] [Resolved] (HIVE-20579) VectorizedOrcAcidRowBatchReader.checkBucketId() should run for unbucketed tables

2018-10-12 Thread Eugene Koifman (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-20579?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eugene Koifman resolved HIVE-20579. --- Resolution: Implemented Assignee: Eugene Koifman Release Note: n/a fixed as

[jira] [Updated] (HIVE-20694) Additional unit tests for VectorizedOrcAcidRowBatchReader min max key evaluation

2018-10-12 Thread Eugene Koifman (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-20694?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eugene Koifman updated HIVE-20694: -- Issue Type: Sub-task (was: Test) Parent: HIVE-20738 > Additional unit tests for

[jira] [Updated] (HIVE-20664) Potential ArrayIndexOutOfBoundsException in VectorizedOrcAcidRowBatchReader.findMinMaxKeys

2018-10-12 Thread Eugene Koifman (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-20664?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eugene Koifman updated HIVE-20664: -- Issue Type: Sub-task (was: Bug) Parent: HIVE-20738 > Potential

[jira] [Updated] (HIVE-20635) VectorizedOrcAcidRowBatchReader doesn't filter delete events for original files

2018-10-12 Thread Eugene Koifman (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-20635?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eugene Koifman updated HIVE-20635: -- Issue Type: Sub-task (was: Improvement) Parent: HIVE-20738 >

[jira] [Updated] (HIVE-16812) VectorizedOrcAcidRowBatchReader doesn't filter delete events

2018-10-12 Thread Eugene Koifman (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-16812?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eugene Koifman updated HIVE-16812: -- Issue Type: Sub-task (was: Improvement) Parent: HIVE-20738 >

[jira] [Updated] (HIVE-20579) VectorizedOrcAcidRowBatchReader.checkBucketId() should run for unbucketed tables

2018-10-12 Thread Eugene Koifman (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-20579?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eugene Koifman updated HIVE-20579: -- Issue Type: Sub-task (was: Improvement) Parent: HIVE-20738 >

[jira] [Updated] (HIVE-17231) ColumnizedDeleteEventRegistry.DeleteReaderValue optimization

2018-10-12 Thread Eugene Koifman (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-17231?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eugene Koifman updated HIVE-17231: -- Parent Issue: HIVE-20738 (was: HIVE-17204) > ColumnizedDeleteEventRegistry.DeleteReaderValue

[jira] [Assigned] (HIVE-20738) Enable Delete Event filtering in VectorizedOrcAcidRowBatchReader

2018-10-12 Thread Eugene Koifman (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-20738?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eugene Koifman reassigned HIVE-20738: - > Enable Delete Event filtering in VectorizedOrcAcidRowBatchReader >

[jira] [Updated] (HIVE-17231) ColumnizedDeleteEventRegistry.DeleteReaderValue optimization

2018-10-12 Thread Eugene Koifman (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-17231?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eugene Koifman updated HIVE-17231: -- Attachment: HIVE-17231.02.patch > ColumnizedDeleteEventRegistry.DeleteReaderValue optimization

[jira] [Updated] (HIVE-20719) SELECT statement fails after UPDATE with hive.optimize.sort.dynamic.partition optimization and vectorization on

2018-10-11 Thread Eugene Koifman (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-20719?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eugene Koifman updated HIVE-20719: -- Attachment: HIVE-20719.01.patch > SELECT statement fails after UPDATE with

[jira] [Updated] (HIVE-20719) SELECT statement fails after UPDATE with hive.optimize.sort.dynamic.partition optimization and vectorization on

2018-10-11 Thread Eugene Koifman (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-20719?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eugene Koifman updated HIVE-20719: -- Status: Patch Available (was: Open) > SELECT statement fails after UPDATE with

[jira] [Commented] (HIVE-20719) SELECT statement fails after UPDATE with hive.optimize.sort.dynamic.partition optimization and vectorization on

2018-10-11 Thread Eugene Koifman (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-20719?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16646834#comment-16646834 ] Eugene Koifman commented on HIVE-20719: --- Disabling vectorization doesn't actually fix it. The

[jira] [Assigned] (HIVE-20719) SELECT statement fails after UPDATE with hive.optimize.sort.dynamic.partition optimization and vectorization on

2018-10-11 Thread Eugene Koifman (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-20719?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eugene Koifman reassigned HIVE-20719: - Assignee: Eugene Koifman > SELECT statement fails after UPDATE with

[jira] [Updated] (HIVE-17231) ColumnizedDeleteEventRegistry.DeleteReaderValue optimization

2018-10-10 Thread Eugene Koifman (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-17231?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eugene Koifman updated HIVE-17231: -- Attachment: HIVE-17231.01.patch > ColumnizedDeleteEventRegistry.DeleteReaderValue optimization

[jira] [Updated] (HIVE-17231) ColumnizedDeleteEventRegistry.DeleteReaderValue optimization

2018-10-10 Thread Eugene Koifman (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-17231?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eugene Koifman updated HIVE-17231: -- Status: Patch Available (was: Open) > ColumnizedDeleteEventRegistry.DeleteReaderValue

[jira] [Commented] (HIVE-17231) ColumnizedDeleteEventRegistry.DeleteReaderValue optimization

2018-10-10 Thread Eugene Koifman (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-17231?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16645598#comment-16645598 ] Eugene Koifman commented on HIVE-17231: --- todo: roll HIVE-20579 into this >

[jira] [Assigned] (HIVE-17231) ColumnizedDeleteEventRegistry.DeleteReaderValue optimization

2018-10-10 Thread Eugene Koifman (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-17231?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eugene Koifman reassigned HIVE-17231: - Assignee: Eugene Koifman > ColumnizedDeleteEventRegistry.DeleteReaderValue optimization

[jira] [Commented] (HIVE-20723) Allow per table specification of compaction yarn queue

2018-10-10 Thread Eugene Koifman (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-20723?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16645420#comment-16645420 ] Eugene Koifman commented on HIVE-20723: --- FYI, [~ikryvenko], [~saurabhseth] > Allow per table

[jira] [Updated] (HIVE-20723) Allow per table specification of compaction yarn queue

2018-10-10 Thread Eugene Koifman (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-20723?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eugene Koifman updated HIVE-20723: -- Description: Currently compactions of full CRUD transactional tables are Map-Reduce jobs

[jira] [Updated] (HIVE-20694) Additional unit tests for VectorizedOrcAcidRowBatchReader min max key evaluation

2018-10-09 Thread Eugene Koifman (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-20694?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eugene Koifman updated HIVE-20694: -- Resolution: Fixed Fix Version/s: 4.0.0 Release Note: n/a Status:

[jira] [Commented] (HIVE-20694) Additional unit tests for VectorizedOrcAcidRowBatchReader min max key evaluation

2018-10-09 Thread Eugene Koifman (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-20694?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16644208#comment-16644208 ] Eugene Koifman commented on HIVE-20694: --- +1 > Additional unit tests for

[jira] [Updated] (HIVE-20719) SELECT statement fails after UPDATE with hive.optimize.sort.dynamic.partition optimization and vectorization on

2018-10-09 Thread Eugene Koifman (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-20719?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eugene Koifman updated HIVE-20719: -- Component/s: Transactions > SELECT statement fails after UPDATE with

[jira] [Updated] (HIVE-20635) VectorizedOrcAcidRowBatchReader doesn't filter delete events for original files

2018-10-06 Thread Eugene Koifman (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-20635?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eugene Koifman updated HIVE-20635: -- Resolution: Fixed Fix Version/s: 4.0.0 Release Note: n/a Status:

[jira] [Commented] (HIVE-20635) VectorizedOrcAcidRowBatchReader doesn't filter delete events for original files

2018-10-06 Thread Eugene Koifman (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-20635?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16640876#comment-16640876 ] Eugene Koifman commented on HIVE-20635: --- committed patch 3 to master thanks Saurabh for the

[jira] [Assigned] (HIVE-20699) Query based compactor for full CRUD Acid tables

2018-10-05 Thread Eugene Koifman (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-20699?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eugene Koifman reassigned HIVE-20699: - > Query based compactor for full CRUD Acid tables >

[jira] [Assigned] (HIVE-19550) Enable TestAcidOnTez#testNonStandardConversion01

2018-10-05 Thread Eugene Koifman (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-19550?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eugene Koifman reassigned HIVE-19550: - Assignee: Eugene Koifman > Enable TestAcidOnTez#testNonStandardConversion01 >

[jira] [Assigned] (HIVE-19549) Enable TestAcidOnTez#testCtasTezUnion

2018-10-05 Thread Eugene Koifman (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-19549?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eugene Koifman reassigned HIVE-19549: - Assignee: Eugene Koifman > Enable TestAcidOnTez#testCtasTezUnion >

[jira] [Commented] (HIVE-20635) VectorizedOrcAcidRowBatchReader doesn't filter delete events for original files

2018-10-05 Thread Eugene Koifman (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-20635?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16640053#comment-16640053 ] Eugene Koifman commented on HIVE-20635: --- +1 patch 3 pending tests >

[jira] [Commented] (HIVE-20693) Case-sensitivity for column names when reading from ORC

2018-10-05 Thread Eugene Koifman (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-20693?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16640046#comment-16640046 ] Eugene Koifman commented on HIVE-20693: --- it's probably better to ask on u...@orc.apache.org  >

[jira] [Updated] (HIVE-20664) Potential ArrayIndexOutOfBoundsException in VectorizedOrcAcidRowBatchReader.findMinMaxKeys

2018-10-05 Thread Eugene Koifman (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-20664?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eugene Koifman updated HIVE-20664: -- Resolution: Fixed Fix Version/s: 4.0.0 Release Note: n/a Target

[jira] [Comment Edited] (HIVE-20635) VectorizedOrcAcidRowBatchReader doesn't filter delete events for original files

2018-10-04 Thread Eugene Koifman (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-20635?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16639013#comment-16639013 ] Eugene Koifman edited comment on HIVE-20635 at 10/4/18 11:11 PM: - A nit:

[jira] [Commented] (HIVE-20635) VectorizedOrcAcidRowBatchReader doesn't filter delete events for original files

2018-10-04 Thread Eugene Koifman (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-20635?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16639013#comment-16639013 ] Eugene Koifman commented on HIVE-20635: --- A nit: {{ LOG.info("findOriginalMinMaxKeys(): " +

[jira] [Commented] (HIVE-17296) Acid tests with multiple splits

2018-10-04 Thread Eugene Koifman (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-17296?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16638973#comment-16638973 ] Eugene Koifman commented on HIVE-17296: --- Hive is now on ORC 1.5.3 > Acid tests with multiple

[jira] [Commented] (HIVE-20664) Potential ArrayIndexOutOfBoundsException in VectorizedOrcAcidRowBatchReader.findMinMaxKeys

2018-10-04 Thread Eugene Koifman (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-20664?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16638970#comment-16638970 ] Eugene Koifman commented on HIVE-20664: --- +1 on patch 2 regarding tests, take a look at ORC-228.

[jira] [Updated] (HIVE-17296) Acid tests with multiple splits

2018-10-04 Thread Eugene Koifman (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-17296?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eugene Koifman updated HIVE-17296: -- Priority: Blocker (was: Critical) > Acid tests with multiple splits >

[jira] [Updated] (HIVE-20556) Expose an API to retrieve the TBL_ID from TBLS in the metastore tables

2018-10-04 Thread Eugene Koifman (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-20556?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eugene Koifman updated HIVE-20556: -- Resolution: Fixed Fix Version/s: 4.0.0 Release Note: n/a Status:

[jira] [Commented] (HIVE-20556) Expose an API to retrieve the TBL_ID from TBLS in the metastore tables

2018-10-04 Thread Eugene Koifman (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-20556?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16638726#comment-16638726 ] Eugene Koifman commented on HIVE-20556: --- +1 patch 18 > Expose an API to retrieve the TBL_ID from

[jira] [Commented] (HIVE-20681) Support custom path filter for ORC tables

2018-10-03 Thread Eugene Koifman (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-20681?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16637099#comment-16637099 ] Eugene Koifman commented on HIVE-20681: --- Could you give a concrete example of some files on disk

[jira] [Updated] (HIVE-20435) Failed Dynamic Partition Insert into insert only table may loose transaction metadata

2018-10-02 Thread Eugene Koifman (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-20435?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eugene Koifman updated HIVE-20435: -- Summary: Failed Dynamic Partition Insert into insert only table may loose transaction metadata

[jira] [Comment Edited] (HIVE-20664) Potential ArrayIndexOutOfBoundsException in VectorizedOrcAcidRowBatchReader.findMinMaxKeys

2018-10-01 Thread Eugene Koifman (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-20664?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16634482#comment-16634482 ] Eugene Koifman edited comment on HIVE-20664 at 10/1/18 6:58 PM: I agree

[jira] [Commented] (HIVE-20664) Potential ArrayIndexOutOfBoundsException in VectorizedOrcAcidRowBatchReader.findMinMaxKeys

2018-10-01 Thread Eugene Koifman (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-20664?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16634482#comment-16634482 ] Eugene Koifman commented on HIVE-20664: --- I agree that this can produce {{ArrayIndexOutOfBounds}}.

[jira] [Resolved] (HIVE-19985) ACID: Skip decoding the ROW__ID sections for read-only queries

2018-09-29 Thread Eugene Koifman (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-19985?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eugene Koifman resolved HIVE-19985. --- Resolution: Fixed Fix Version/s: 4.0.0 Target Version/s: 4.0.0 committed

[jira] [Updated] (HIVE-19985) ACID: Skip decoding the ROW__ID sections for read-only queries

2018-09-29 Thread Eugene Koifman (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-19985?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eugene Koifman updated HIVE-19985: -- Attachment: HIVE-19985.07.patch > ACID: Skip decoding the ROW__ID sections for read-only

[jira] [Updated] (HIVE-19985) ACID: Skip decoding the ROW__ID sections for read-only queries

2018-09-29 Thread Eugene Koifman (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-19985?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eugene Koifman updated HIVE-19985: -- Attachment: (was: HIVE-19985.07.patch) > ACID: Skip decoding the ROW__ID sections for

[jira] [Updated] (HIVE-19985) ACID: Skip decoding the ROW__ID sections for read-only queries

2018-09-29 Thread Eugene Koifman (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-19985?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eugene Koifman updated HIVE-19985: -- Attachment: (was: HIVE-19985.07.patch) > ACID: Skip decoding the ROW__ID sections for

[jira] [Updated] (HIVE-19985) ACID: Skip decoding the ROW__ID sections for read-only queries

2018-09-29 Thread Eugene Koifman (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-19985?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eugene Koifman updated HIVE-19985: -- Attachment: HIVE-19985.07.patch > ACID: Skip decoding the ROW__ID sections for read-only

[jira] [Updated] (HIVE-19985) ACID: Skip decoding the ROW__ID sections for read-only queries

2018-09-29 Thread Eugene Koifman (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-19985?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eugene Koifman updated HIVE-19985: -- Attachment: HIVE-19985.07.patch > ACID: Skip decoding the ROW__ID sections for read-only

[jira] [Updated] (HIVE-19985) ACID: Skip decoding the ROW__ID sections for read-only queries

2018-09-29 Thread Eugene Koifman (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-19985?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eugene Koifman updated HIVE-19985: -- Status: Open (was: Patch Available) > ACID: Skip decoding the ROW__ID sections for read-only

[jira] [Commented] (HIVE-20556) Expose an API to retrieve the TBL_ID from TBLS in the metastore tables

2018-09-28 Thread Eugene Koifman (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-20556?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16632248#comment-16632248 ] Eugene Koifman commented on HIVE-20556: --- I added a few minor things on RB, otherwise it makes sense

[jira] [Resolved] (HIVE-18774) ACID: Use the _copy_N files copyNumber as the implicit statement-id

2018-09-28 Thread Eugene Koifman (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-18774?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eugene Koifman resolved HIVE-18774. --- Resolution: Won't Fix since HIVE-17917 reading footers for all copy_N files is done once per

<    1   2   3   4   5   6   7   8   9   10   >