[jira] [Updated] (HIVE-19985) ACID: Skip decoding the ROW__ID sections for read-only queries

2018-09-28 Thread Eugene Koifman (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-19985?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eugene Koifman updated HIVE-19985: -- Affects Version/s: 3.0.0 > ACID: Skip decoding the ROW__ID sections for read-only queries >

[jira] [Updated] (HIVE-19985) ACID: Skip decoding the ROW__ID sections for read-only queries

2018-09-28 Thread Eugene Koifman (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-19985?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eugene Koifman updated HIVE-19985: -- Status: Patch Available (was: Open) > ACID: Skip decoding the ROW__ID sections for read-only

[jira] [Commented] (HIVE-19985) ACID: Skip decoding the ROW__ID sections for read-only queries

2018-09-28 Thread Eugene Koifman (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-19985?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16632154#comment-16632154 ] Eugene Koifman commented on HIVE-19985: --- rebased patch 6 > ACID: Skip decoding the ROW__ID

[jira] [Updated] (HIVE-19985) ACID: Skip decoding the ROW__ID sections for read-only queries

2018-09-28 Thread Eugene Koifman (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-19985?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eugene Koifman updated HIVE-19985: -- Attachment: HIVE-19985.06.patch > ACID: Skip decoding the ROW__ID sections for read-only

[jira] [Updated] (HIVE-20655) Optimize arrayCopy in LlapRecordReader

2018-09-28 Thread Eugene Koifman (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-20655?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eugene Koifman updated HIVE-20655: -- Description: followup to HIVE-19985 See Gopal's comment on 8/3/2018

[jira] [Updated] (HIVE-20655) Optimize arrayCopy in LlapRecordReader

2018-09-28 Thread Eugene Koifman (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-20655?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eugene Koifman updated HIVE-20655: -- Environment: (was: followup to HIVE-19985 See Gopal's comment on 8/3/2018

[jira] [Commented] (HIVE-20635) VectorizedOrcAcidRowBatchReader doesn't filter delete events for original files

2018-09-27 Thread Eugene Koifman (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-20635?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16631274#comment-16631274 ] Eugene Koifman commented on HIVE-20635: --- [~saurabhseth] could you take this on? >

[jira] [Updated] (HIVE-17917) VectorizedOrcAcidRowBatchReader.computeOffsetAndBucket optimization

2018-09-27 Thread Eugene Koifman (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-17917?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eugene Koifman updated HIVE-17917: -- Resolution: Fixed Fix Version/s: 4.0.0 Status: Resolved (was: Patch

[jira] [Commented] (HIVE-17917) VectorizedOrcAcidRowBatchReader.computeOffsetAndBucket optimization

2018-09-27 Thread Eugene Koifman (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-17917?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16631259#comment-16631259 ] Eugene Koifman commented on HIVE-17917: --- +1 >

[jira] [Resolved] (HIVE-16812) VectorizedOrcAcidRowBatchReader doesn't filter delete events

2018-09-27 Thread Eugene Koifman (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-16812?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eugene Koifman resolved HIVE-16812. --- Resolution: Fixed Release Note: n/a committed to master thanks Sergey for the review

[jira] [Commented] (HIVE-16812) VectorizedOrcAcidRowBatchReader doesn't filter delete events

2018-09-27 Thread Eugene Koifman (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-16812?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16630974#comment-16630974 ] Eugene Koifman commented on HIVE-16812: --- patch 7 fixes the typo > VectorizedOrcAcidRowBatchReader

[jira] [Updated] (HIVE-16812) VectorizedOrcAcidRowBatchReader doesn't filter delete events

2018-09-27 Thread Eugene Koifman (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-16812?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eugene Koifman updated HIVE-16812: -- Fix Version/s: 4.0.0 Status: Open (was: Patch Available) >

[jira] [Updated] (HIVE-16812) VectorizedOrcAcidRowBatchReader doesn't filter delete events

2018-09-27 Thread Eugene Koifman (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-16812?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eugene Koifman updated HIVE-16812: -- Attachment: HIVE-16812.07.patch > VectorizedOrcAcidRowBatchReader doesn't filter delete events

[jira] [Commented] (HIVE-16812) VectorizedOrcAcidRowBatchReader doesn't filter delete events

2018-09-27 Thread Eugene Koifman (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-16812?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16630955#comment-16630955 ] Eugene Koifman commented on HIVE-16812: --- I think because we normally drop the top level struct from

[jira] [Commented] (HIVE-19985) ACID: Skip decoding the ROW__ID sections for read-only queries

2018-09-27 Thread Eugene Koifman (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-19985?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16630916#comment-16630916 ] Eugene Koifman commented on HIVE-19985: --- Hive is on ORC 1.5.3 now but this patch needs to be

[jira] [Commented] (HIVE-16812) VectorizedOrcAcidRowBatchReader doesn't filter delete events

2018-09-27 Thread Eugene Koifman (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-16812?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16630909#comment-16630909 ] Eugene Koifman commented on HIVE-16812: --- No related failures > VectorizedOrcAcidRowBatchReader

[jira] [Commented] (HIVE-20640) Upgrade Hive to use ORC 1.5.3

2018-09-27 Thread Eugene Koifman (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-20640?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16630887#comment-16630887 ] Eugene Koifman commented on HIVE-20640: --- looks like spurious failure - passes locally committed to

[jira] [Updated] (HIVE-20640) Upgrade Hive to use ORC 1.5.3

2018-09-27 Thread Eugene Koifman (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-20640?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eugene Koifman updated HIVE-20640: -- Resolution: Fixed Fix Version/s: 4.0.0 Status: Resolved (was: Patch

[jira] [Updated] (HIVE-17231) ColumnizedDeleteEventRegistry.DeleteReaderValue optimization

2018-09-26 Thread Eugene Koifman (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-17231?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eugene Koifman updated HIVE-17231: -- Description: For unbucketed tables DeleteReaderValue will currently return all delete

[jira] [Updated] (HIVE-16812) VectorizedOrcAcidRowBatchReader doesn't filter delete events

2018-09-26 Thread Eugene Koifman (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-16812?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eugene Koifman updated HIVE-16812: -- Attachment: HIVE-16812.06.patch > VectorizedOrcAcidRowBatchReader doesn't filter delete events

[jira] [Commented] (HIVE-16812) VectorizedOrcAcidRowBatchReader doesn't filter delete events

2018-09-26 Thread Eugene Koifman (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-16812?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16629286#comment-16629286 ] Eugene Koifman commented on HIVE-16812: --- looks like at lest vector_acid4.q failure is related >

[jira] [Updated] (HIVE-20604) Minor compaction disables ORC column stats

2018-09-26 Thread Eugene Koifman (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-20604?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eugene Koifman updated HIVE-20604: -- Resolution: Fixed Status: Resolved (was: Patch Available) committed to master thanks

[jira] [Updated] (HIVE-20640) Upgrade Hive to use ORC 1.5.3

2018-09-26 Thread Eugene Koifman (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-20640?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eugene Koifman updated HIVE-20640: -- Status: Patch Available (was: Open) > Upgrade Hive to use ORC 1.5.3 >

[jira] [Updated] (HIVE-20640) Upgrade Hive to use ORC 1.5.3

2018-09-26 Thread Eugene Koifman (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-20640?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eugene Koifman updated HIVE-20640: -- Attachment: HIVE-20640.01.patch > Upgrade Hive to use ORC 1.5.3 >

[jira] [Updated] (HIVE-20640) Upgrade Hive to use ORC 1.5.3

2018-09-26 Thread Eugene Koifman (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-20640?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eugene Koifman updated HIVE-20640: -- Component/s: ORC > Upgrade Hive to use ORC 1.5.3 > - > >

[jira] [Assigned] (HIVE-20640) Upgrade Hive to use ORC 1.5.3

2018-09-26 Thread Eugene Koifman (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-20640?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eugene Koifman reassigned HIVE-20640: - > Upgrade Hive to use ORC 1.5.3 > - > > Key:

[jira] [Updated] (HIVE-17231) ColumnizedDeleteEventRegistry.DeleteReaderValue optimization

2018-09-25 Thread Eugene Koifman (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-17231?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eugene Koifman updated HIVE-17231: -- Description: For unbucketed tables DeleteReaderValue will currently return all delete

[jira] [Updated] (HIVE-20604) Minor compaction disables ORC column stats

2018-09-25 Thread Eugene Koifman (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-20604?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eugene Koifman updated HIVE-20604: -- Target Version/s: 4.0.0 Status: Patch Available (was: Open) [~prasanth_j] could

[jira] [Updated] (HIVE-20604) Minor compaction disables ORC column stats

2018-09-25 Thread Eugene Koifman (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-20604?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eugene Koifman updated HIVE-20604: -- Attachment: HIVE-20604.01.patch > Minor compaction disables ORC column stats >

[jira] [Commented] (HIVE-20556) Expose an API to retrieve the TBL_ID from TBLS in the metastore tables

2018-09-25 Thread Eugene Koifman (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-20556?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16628071#comment-16628071 ] Eugene Koifman commented on HIVE-20556: --- [~jmarhuen] could you create RB for this? {{optional i64

[jira] [Commented] (HIVE-16953) OrcRawRecordMerger.discoverOriginalKeyBounds issue if both split start and end are in the same stripe

2018-09-25 Thread Eugene Koifman (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-16953?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16628034#comment-16628034 ] Eugene Koifman commented on HIVE-16953: --- better long term fix is to make

[jira] [Issue Comment Deleted] (HIVE-17284) remove OrcRecordUpdater.deleteEventIndexBuilder

2018-09-25 Thread Eugene Koifman (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-17284?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eugene Koifman updated HIVE-17284: -- Comment: was deleted (was: this may not be the right thing to do.  ORC flattens structs

[jira] [Updated] (HIVE-17284) remove OrcRecordUpdater.deleteEventIndexBuilder

2018-09-25 Thread Eugene Koifman (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-17284?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eugene Koifman updated HIVE-17284: -- Description: There is no point in it. We know how many rows a delete_delta file has from ORC

[jira] [Comment Edited] (HIVE-16812) VectorizedOrcAcidRowBatchReader doesn't filter delete events

2018-09-25 Thread Eugene Koifman (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-16812?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16628015#comment-16628015 ] Eugene Koifman edited comment on HIVE-16812 at 9/25/18 10:47 PM: - patch 5

[jira] [Commented] (HIVE-16812) VectorizedOrcAcidRowBatchReader doesn't filter delete events

2018-09-25 Thread Eugene Koifman (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-16812?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16628015#comment-16628015 ] Eugene Koifman commented on HIVE-16812: --- patch 5 should be ready for review

[jira] [Updated] (HIVE-16812) VectorizedOrcAcidRowBatchReader doesn't filter delete events

2018-09-25 Thread Eugene Koifman (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-16812?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eugene Koifman updated HIVE-16812: -- Attachment: HIVE-16812.05.patch > VectorizedOrcAcidRowBatchReader doesn't filter delete events

[jira] [Commented] (HIVE-20593) Load Data for partitioned ACID tables fails with bucketId out of range: -1

2018-09-25 Thread Eugene Koifman (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-20593?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16627763#comment-16627763 ] Eugene Koifman commented on HIVE-20593: --- +1 > Load Data for partitioned ACID tables fails with

[jira] [Commented] (HIVE-17917) VectorizedOrcAcidRowBatchReader.computeOffsetAndBucket optimization

2018-09-25 Thread Eugene Koifman (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-17917?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16627692#comment-16627692 ] Eugene Koifman commented on HIVE-17917: --- I don't think non-vector mode is a priority >

[jira] [Updated] (HIVE-16812) VectorizedOrcAcidRowBatchReader doesn't filter delete events

2018-09-24 Thread Eugene Koifman (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-16812?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eugene Koifman updated HIVE-16812: -- Attachment: HIVE-16812.04.patch > VectorizedOrcAcidRowBatchReader doesn't filter delete events

[jira] [Commented] (HIVE-20538) Allow to store a key value together with a transaction.

2018-09-24 Thread Eugene Koifman (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-20538?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16626265#comment-16626265 ] Eugene Koifman commented on HIVE-20538: --- added some comments/nits to RB > Allow to store a key

[jira] [Updated] (HIVE-20627) Concurrent async queries intermittently fails with LockException and cause memory leak.

2018-09-24 Thread Eugene Koifman (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-20627?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eugene Koifman updated HIVE-20627: -- Component/s: Transactions > Concurrent async queries intermittently fails with LockException

[jira] [Commented] (HIVE-20538) Allow to store a key value together with a transaction.

2018-09-21 Thread Eugene Koifman (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-20538?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16624232#comment-16624232 ] Eugene Koifman commented on HIVE-20538: --- could you create an RB please > Allow to store a key

[jira] [Commented] (HIVE-20620) manifest collisions when inserting into bucketed sorted MM tables with dynamic partitioning

2018-09-21 Thread Eugene Koifman (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-20620?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16624226#comment-16624226 ] Eugene Koifman commented on HIVE-20620: --- There are some acid tests that tests more buckets than

[jira] [Updated] (HIVE-16812) VectorizedOrcAcidRowBatchReader doesn't filter delete events

2018-09-20 Thread Eugene Koifman (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-16812?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eugene Koifman updated HIVE-16812: -- Attachment: HIVE-16812.02.patch > VectorizedOrcAcidRowBatchReader doesn't filter delete events

[jira] [Updated] (HIVE-16812) VectorizedOrcAcidRowBatchReader doesn't filter delete events

2018-09-20 Thread Eugene Koifman (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-16812?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eugene Koifman updated HIVE-16812: -- Status: Patch Available (was: Open) > VectorizedOrcAcidRowBatchReader doesn't filter delete

[jira] [Commented] (HIVE-20607) TxnHandler should use PreparedStatement to execute direct SQL queries.

2018-09-20 Thread Eugene Koifman (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-20607?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16622511#comment-16622511 ] Eugene Koifman commented on HIVE-20607: --- How does a PreparedStatement solve this? If you are doing

[jira] [Commented] (HIVE-20607) TxnHandler should use PreparedStatement to execute direct SQL queries.

2018-09-20 Thread Eugene Koifman (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-20607?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16622328#comment-16622328 ] Eugene Koifman commented on HIVE-20607: --- Most of the statements are executed once per DB txn. What

[jira] [Assigned] (HIVE-20604) Minor compaction disables ORC column stats

2018-09-19 Thread Eugene Koifman (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-20604?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eugene Koifman reassigned HIVE-20604: - > Minor compaction disables ORC column stats > -- >

[jira] [Updated] (HIVE-20593) Load Data for partitioned ACID tables fails with bucketId out of range: -1

2018-09-19 Thread Eugene Koifman (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-20593?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eugene Koifman updated HIVE-20593: -- Affects Version/s: 3.1.0 > Load Data for partitioned ACID tables fails with bucketId out of

[jira] [Updated] (HIVE-20593) Load Data for partitioned ACID tables fails with bucketId out of range: -1

2018-09-19 Thread Eugene Koifman (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-20593?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eugene Koifman updated HIVE-20593: -- Component/s: Transactions > Load Data for partitioned ACID tables fails with bucketId out of

[jira] [Updated] (HIVE-18453) ACID: Add "CREATE TRANSACTIONAL TABLE" syntax to unify ACID ORC & Parquet support

2018-09-18 Thread Eugene Koifman (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-18453?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eugene Koifman updated HIVE-18453: -- Resolution: Fixed Status: Resolved (was: Patch Available) +1 Thanks Igor for the

[jira] [Updated] (HIVE-18453) ACID: Add "CREATE TRANSACTIONAL TABLE" syntax to unify ACID ORC & Parquet support

2018-09-18 Thread Eugene Koifman (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-18453?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eugene Koifman updated HIVE-18453: -- Fix Version/s: 4.0.0 > ACID: Add "CREATE TRANSACTIONAL TABLE" syntax to unify ACID ORC &

[jira] [Updated] (HIVE-20590) Allow merge statement to have column schema

2018-09-18 Thread Eugene Koifman (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-20590?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eugene Koifman updated HIVE-20590: -- Component/s: Transactions > Allow merge statement to have column schema >

[jira] [Commented] (HIVE-16812) VectorizedOrcAcidRowBatchReader doesn't filter delete events

2018-09-17 Thread Eugene Koifman (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-16812?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16618265#comment-16618265 ] Eugene Koifman commented on HIVE-16812: --- The above is not quite correct. The

[jira] [Commented] (HIVE-12267) Make Compaction jobs run on Tez

2018-09-17 Thread Eugene Koifman (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-12267?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16618236#comment-16618236 ] Eugene Koifman commented on HIVE-12267: --- Better yet, make a query based compactor > Make

[jira] [Assigned] (HIVE-12267) Make Compaction jobs run on Tez

2018-09-17 Thread Eugene Koifman (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-12267?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eugene Koifman reassigned HIVE-12267: - Assignee: Eugene Koifman > Make Compaction jobs run on Tez >

[jira] [Commented] (HIVE-18453) ACID: Add "CREATE TRANSACTIONAL TABLE" syntax to unify ACID ORC & Parquet support

2018-09-17 Thread Eugene Koifman (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-18453?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16618192#comment-16618192 ] Eugene Koifman commented on HIVE-18453: --- One last question: what does

[jira] [Updated] (HIVE-16812) VectorizedOrcAcidRowBatchReader doesn't filter delete events

2018-09-17 Thread Eugene Koifman (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-16812?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eugene Koifman updated HIVE-16812: -- Description: the c'tor of VectorizedOrcAcidRowBatchReader has {noformat} // Clone

[jira] [Commented] (HIVE-20556) Expose an API to retrieve the TBL_ID from TBLS in the metastore tables

2018-09-14 Thread Eugene Koifman (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-20556?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16615512#comment-16615512 ] Eugene Koifman commented on HIVE-20556: --- it may be useful to add a test that ensures Table.id is

[jira] [Updated] (HIVE-20553) more acid stats tests

2018-09-14 Thread Eugene Koifman (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-20553?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eugene Koifman updated HIVE-20553: -- Resolution: Fixed Fix Version/s: 4.0.0 Release Note: n/a Status:

[jira] [Commented] (HIVE-20553) more acid stats tests

2018-09-14 Thread Eugene Koifman (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-20553?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16615024#comment-16615024 ] Eugene Koifman commented on HIVE-20553: --- [~sershe] could you review please > more acid stats tests

[jira] [Updated] (HIVE-20553) more acid stats tests

2018-09-13 Thread Eugene Koifman (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-20553?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eugene Koifman updated HIVE-20553: -- Attachment: HIVE-20553.02.patch > more acid stats tests > - > >

[jira] [Assigned] (HIVE-20553) more acid stats tests

2018-09-13 Thread Eugene Koifman (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-20553?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eugene Koifman reassigned HIVE-20553: - > more acid stats tests > - > > Key: HIVE-20553 >

[jira] [Updated] (HIVE-20553) more acid stats tests

2018-09-13 Thread Eugene Koifman (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-20553?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eugene Koifman updated HIVE-20553: -- Attachment: HIVE-20553.01.patch > more acid stats tests > - > >

[jira] [Updated] (HIVE-20553) more acid stats tests

2018-09-13 Thread Eugene Koifman (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-20553?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eugene Koifman updated HIVE-20553: -- Status: Patch Available (was: Open) > more acid stats tests > - > >

[jira] [Resolved] (HIVE-17943) select ROW__ID, t, si, i from over10k_orc_bucketed where b = 4294967363 and t < 100 order by ROW__ID fails on LLAP

2018-09-10 Thread Eugene Koifman (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-17943?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eugene Koifman resolved HIVE-17943. --- Resolution: Cannot Reproduce Fix Version/s: 4.0.0 no longer see this in current

[jira] [Assigned] (HIVE-17943) select ROW__ID, t, si, i from over10k_orc_bucketed where b = 4294967363 and t < 100 order by ROW__ID fails on LLAP

2018-09-10 Thread Eugene Koifman (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-17943?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eugene Koifman reassigned HIVE-17943: - Assignee: Eugene Koifman > select ROW__ID, t, si, i from over10k_orc_bucketed where b =

[jira] [Updated] (HIVE-17921) Aggregation with struct in LLAP produces wrong result

2018-09-10 Thread Eugene Koifman (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-17921?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eugene Koifman updated HIVE-17921: -- Resolution: Fixed Fix Version/s: 4.0.0 Status: Resolved (was: Patch

[jira] [Updated] (HIVE-18772) Make Acid Cleaner use MIN_HISTORY_LEVEL

2018-09-10 Thread Eugene Koifman (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-18772?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eugene Koifman updated HIVE-18772: -- Attachment: HIVE-18772.03.patch > Make Acid Cleaner use MIN_HISTORY_LEVEL >

[jira] [Updated] (HIVE-18772) Make Acid Cleaner use MIN_HISTORY_LEVEL

2018-09-10 Thread Eugene Koifman (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-18772?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eugene Koifman updated HIVE-18772: -- Status: Open (was: Patch Available) > Make Acid Cleaner use MIN_HISTORY_LEVEL >

[jira] [Commented] (HIVE-17921) Aggregation with struct in LLAP produces wrong result

2018-09-10 Thread Eugene Koifman (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-17921?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16609641#comment-16609641 ] Eugene Koifman commented on HIVE-17921: --- +1 > Aggregation with struct in LLAP produces wrong

[jira] [Updated] (HIVE-18772) Make Acid Cleaner use MIN_HISTORY_LEVEL

2018-09-04 Thread Eugene Koifman (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-18772?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eugene Koifman updated HIVE-18772: -- Attachment: HIVE-18772.02.patch > Make Acid Cleaner use MIN_HISTORY_LEVEL >

[jira] [Updated] (HIVE-18772) Make Acid Cleaner use MIN_HISTORY_LEVEL

2018-09-04 Thread Eugene Koifman (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-18772?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eugene Koifman updated HIVE-18772: -- Attachment: HIVE-18772.02.patch > Make Acid Cleaner use MIN_HISTORY_LEVEL >

[jira] [Commented] (HIVE-18453) ACID: Add "CREATE TRANSACTIONAL TABLE" syntax to unify ACID ORC & Parquet support

2018-09-04 Thread Eugene Koifman (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-18453?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16603503#comment-16603503 ] Eugene Koifman commented on HIVE-18453: --- [~ikryvenko], no.  "create transactional..." should

[jira] [Commented] (HIVE-17921) Aggregation with struct in LLAP produces wrong result

2018-09-04 Thread Eugene Koifman (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-17921?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16603173#comment-16603173 ] Eugene Koifman commented on HIVE-17921: --- acid_vectorization_original.q.out used to have 1 row of

[jira] [Updated] (HIVE-18772) Make Acid Cleaner use MIN_HISTORY_LEVEL

2018-08-24 Thread Eugene Koifman (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-18772?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eugene Koifman updated HIVE-18772: -- Status: Patch Available (was: Open) > Make Acid Cleaner use MIN_HISTORY_LEVEL >

[jira] [Updated] (HIVE-18772) Make Acid Cleaner use MIN_HISTORY_LEVEL

2018-08-24 Thread Eugene Koifman (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-18772?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eugene Koifman updated HIVE-18772: -- Attachment: HIVE-18772.01.patch > Make Acid Cleaner use MIN_HISTORY_LEVEL >

[jira] [Updated] (HIVE-20435) Failed Dynamic Partition Insert into insert only table may loose transaction metadat

2018-08-24 Thread Eugene Koifman (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-20435?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eugene Koifman updated HIVE-20435: -- Summary: Failed Dynamic Partition Insert into insert only table may loose transaction metadat

[jira] [Assigned] (HIVE-20460) AcidUtils.Directory.getAbortedDirectories() may be missed for full CRUD tables

2018-08-24 Thread Eugene Koifman (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-20460?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eugene Koifman reassigned HIVE-20460: - > AcidUtils.Directory.getAbortedDirectories() may be missed for full CRUD tables >

[jira] [Commented] (HIVE-18772) Make Acid Cleaner use MIN_HISTORY_LEVEL

2018-08-24 Thread Eugene Koifman (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-18772?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16592292#comment-16592292 ] Eugene Koifman commented on HIVE-18772: --- HIVE-20459 would be nice to have here > Make Acid Cleaner

[jira] [Updated] (HIVE-20458) hive-schema-3.1.0.postgres.sql - some tables are not quoted

2018-08-24 Thread Eugene Koifman (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-20458?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eugene Koifman updated HIVE-20458: -- Description: a number of tables related to transactional metadata are not quoted in this

[jira] [Commented] (HIVE-18453) ACID: Add "CREATE TRANSACTIONAL TABLE" syntax to unify ACID ORC & Parquet support

2018-08-24 Thread Eugene Koifman (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-18453?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16592012#comment-16592012 ] Eugene Koifman commented on HIVE-18453: --- PS there is a change in

[jira] [Commented] (HIVE-18453) ACID: Add "CREATE TRANSACTIONAL TABLE" syntax to unify ACID ORC & Parquet support

2018-08-23 Thread Eugene Koifman (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-18453?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16590987#comment-16590987 ] Eugene Koifman commented on HIVE-18453: --- I think you have a problem with insert-only tables.

[jira] [Updated] (HIVE-20454) extend inheritPerms to ACID in Hive 1.X

2018-08-23 Thread Eugene Koifman (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-20454?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eugene Koifman updated HIVE-20454: -- Attachment: HIVE-20454.02.patch > extend inheritPerms to ACID in Hive 1.X >

[jira] [Updated] (HIVE-20454) extend inheritPerms to ACID in Hive 1.X

2018-08-23 Thread Eugene Koifman (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-20454?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eugene Koifman updated HIVE-20454: -- Affects Version/s: 1.0.0 > extend inheritPerms to ACID in Hive 1.X >

[jira] [Updated] (HIVE-20454) extend inheritPerms to ACID in Hive 1.X

2018-08-23 Thread Eugene Koifman (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-20454?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eugene Koifman updated HIVE-20454: -- Fix Version/s: (was: 2.4.0) 1.3.0 > extend inheritPerms to ACID in Hive

[jira] [Updated] (HIVE-20454) extend inheritPerms to ACID in Hive 1.X

2018-08-23 Thread Eugene Koifman (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-20454?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eugene Koifman updated HIVE-20454: -- Component/s: Transactions > extend inheritPerms to ACID in Hive 1.X >

[jira] [Updated] (HIVE-20454) extend inheritPerms to ACID in Hive 1.X

2018-08-23 Thread Eugene Koifman (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-20454?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eugene Koifman updated HIVE-20454: -- Description: CompactorMR.commitJob() does a rename() in way that doesn't respect

[jira] [Updated] (HIVE-20454) extend inheritPerms to ACID in Hive 1.X

2018-08-23 Thread Eugene Koifman (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-20454?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eugene Koifman updated HIVE-20454: -- Summary: extend inheritPerms to ACID in Hive 1.X (was: CLONE - extend inheritPerms to ACID in

[jira] [Assigned] (HIVE-20454) CLONE - extend inheritPerms to ACID in Hive 1.X

2018-08-23 Thread Eugene Koifman (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-20454?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eugene Koifman reassigned HIVE-20454: - > CLONE - extend inheritPerms to ACID in Hive 1.X >

[jira] [Commented] (HIVE-20443) txn stats cleanup in compaction txn handler is unneeded

2018-08-23 Thread Eugene Koifman (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-20443?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16590710#comment-16590710 ] Eugene Koifman commented on HIVE-20443: --- +1 > txn stats cleanup in compaction txn handler is

[jira] [Commented] (HIVE-18772) Make Acid Cleaner use MIN_HISTORY_LEVEL

2018-08-23 Thread Eugene Koifman (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-18772?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16590496#comment-16590496 ] Eugene Koifman commented on HIVE-18772: --- [~sankarh], would this have any impact on replication? >

[jira] [Updated] (HIVE-18772) Make Acid Cleaner use MIN_HISTORY_LEVEL

2018-08-22 Thread Eugene Koifman (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-18772?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eugene Koifman updated HIVE-18772: -- Description: Instead of using Lock Manager state as it currently does. This will eliminate

[jira] [Updated] (HIVE-18772) Make Acid Cleaner use MIN_HISTORY_LEVEL

2018-08-22 Thread Eugene Koifman (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-18772?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eugene Koifman updated HIVE-18772: -- Description: Instead of using Lock Manager state as it currently does. This will eliminate

[jira] [Updated] (HIVE-18772) Make Acid Cleaner use MIN_HISTORY_LEVEL

2018-08-22 Thread Eugene Koifman (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-18772?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eugene Koifman updated HIVE-18772: -- Target Version/s: 4.0.0 (was: 3.0.0) > Make Acid Cleaner use MIN_HISTORY_LEVEL >

[jira] [Updated] (HIVE-18772) Make Acid Cleaner use MIN_HISTORY_LEVEL

2018-08-22 Thread Eugene Koifman (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-18772?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eugene Koifman updated HIVE-18772: -- Description: Instead of using Lock Manager state as it currently does. This will eliminate

[jira] [Assigned] (HIVE-20436) Lock Manager scalability - linear

2018-08-21 Thread Eugene Koifman (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-20436?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eugene Koifman reassigned HIVE-20436: - > Lock Manager scalability - linear > - > >

[jira] [Updated] (HIVE-16139) Clarify Acid concurrency model

2018-08-21 Thread Eugene Koifman (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-16139?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eugene Koifman updated HIVE-16139: -- Affects Version/s: 3.0.0 > Clarify Acid concurrency model > -- > >

[jira] [Assigned] (HIVE-20435) Failed Dynamic Partition Insert into insert only table may looks transaction metadata

2018-08-21 Thread Eugene Koifman (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-20435?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eugene Koifman reassigned HIVE-20435: - > Failed Dynamic Partition Insert into insert only table may looks transaction > metadata

[jira] [Commented] (HIVE-20431) txn stats write ID check triggers on set location

2018-08-21 Thread Eugene Koifman (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-20431?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16588164#comment-16588164 ] Eugene Koifman commented on HIVE-20431: --- I misread the diffs wrt enums +1 > txn stats write ID

<    1   2   3   4   5   6   7   8   9   10   >