[jira] [Commented] (HIVE-20693) Case-sensitivity for column names when reading from ORC

2018-10-05 Thread Eugene Koifman (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-20693?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16640046#comment-16640046 ] Eugene Koifman commented on HIVE-20693: --- it's probably better to ask on u...@orc.apache.org  >

[jira] [Updated] (HIVE-20664) Potential ArrayIndexOutOfBoundsException in VectorizedOrcAcidRowBatchReader.findMinMaxKeys

2018-10-05 Thread Eugene Koifman (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-20664?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eugene Koifman updated HIVE-20664: -- Resolution: Fixed Fix Version/s: 4.0.0 Release Note: n/a Target

[jira] [Comment Edited] (HIVE-20635) VectorizedOrcAcidRowBatchReader doesn't filter delete events for original files

2018-10-04 Thread Eugene Koifman (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-20635?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16639013#comment-16639013 ] Eugene Koifman edited comment on HIVE-20635 at 10/4/18 11:11 PM: - A nit:

[jira] [Commented] (HIVE-20635) VectorizedOrcAcidRowBatchReader doesn't filter delete events for original files

2018-10-04 Thread Eugene Koifman (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-20635?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16639013#comment-16639013 ] Eugene Koifman commented on HIVE-20635: --- A nit: {{ LOG.info("findOriginalMinMaxKeys(): " +

[jira] [Commented] (HIVE-17296) Acid tests with multiple splits

2018-10-04 Thread Eugene Koifman (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-17296?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16638973#comment-16638973 ] Eugene Koifman commented on HIVE-17296: --- Hive is now on ORC 1.5.3 > Acid tests with multiple

[jira] [Commented] (HIVE-20664) Potential ArrayIndexOutOfBoundsException in VectorizedOrcAcidRowBatchReader.findMinMaxKeys

2018-10-04 Thread Eugene Koifman (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-20664?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16638970#comment-16638970 ] Eugene Koifman commented on HIVE-20664: --- +1 on patch 2 regarding tests, take a look at ORC-228.

[jira] [Updated] (HIVE-17296) Acid tests with multiple splits

2018-10-04 Thread Eugene Koifman (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-17296?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eugene Koifman updated HIVE-17296: -- Priority: Blocker (was: Critical) > Acid tests with multiple splits >

[jira] [Updated] (HIVE-20556) Expose an API to retrieve the TBL_ID from TBLS in the metastore tables

2018-10-04 Thread Eugene Koifman (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-20556?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eugene Koifman updated HIVE-20556: -- Resolution: Fixed Fix Version/s: 4.0.0 Release Note: n/a Status:

[jira] [Commented] (HIVE-20556) Expose an API to retrieve the TBL_ID from TBLS in the metastore tables

2018-10-04 Thread Eugene Koifman (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-20556?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16638726#comment-16638726 ] Eugene Koifman commented on HIVE-20556: --- +1 patch 18 > Expose an API to retrieve the TBL_ID from

[jira] [Commented] (HIVE-20681) Support custom path filter for ORC tables

2018-10-03 Thread Eugene Koifman (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-20681?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16637099#comment-16637099 ] Eugene Koifman commented on HIVE-20681: --- Could you give a concrete example of some files on disk

[jira] [Updated] (HIVE-20435) Failed Dynamic Partition Insert into insert only table may loose transaction metadata

2018-10-02 Thread Eugene Koifman (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-20435?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eugene Koifman updated HIVE-20435: -- Summary: Failed Dynamic Partition Insert into insert only table may loose transaction metadata

[jira] [Comment Edited] (HIVE-20664) Potential ArrayIndexOutOfBoundsException in VectorizedOrcAcidRowBatchReader.findMinMaxKeys

2018-10-01 Thread Eugene Koifman (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-20664?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16634482#comment-16634482 ] Eugene Koifman edited comment on HIVE-20664 at 10/1/18 6:58 PM: I agree

[jira] [Commented] (HIVE-20664) Potential ArrayIndexOutOfBoundsException in VectorizedOrcAcidRowBatchReader.findMinMaxKeys

2018-10-01 Thread Eugene Koifman (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-20664?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16634482#comment-16634482 ] Eugene Koifman commented on HIVE-20664: --- I agree that this can produce {{ArrayIndexOutOfBounds}}.

[jira] [Resolved] (HIVE-19985) ACID: Skip decoding the ROW__ID sections for read-only queries

2018-09-29 Thread Eugene Koifman (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-19985?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eugene Koifman resolved HIVE-19985. --- Resolution: Fixed Fix Version/s: 4.0.0 Target Version/s: 4.0.0 committed

[jira] [Updated] (HIVE-19985) ACID: Skip decoding the ROW__ID sections for read-only queries

2018-09-29 Thread Eugene Koifman (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-19985?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eugene Koifman updated HIVE-19985: -- Attachment: HIVE-19985.07.patch > ACID: Skip decoding the ROW__ID sections for read-only

[jira] [Updated] (HIVE-19985) ACID: Skip decoding the ROW__ID sections for read-only queries

2018-09-29 Thread Eugene Koifman (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-19985?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eugene Koifman updated HIVE-19985: -- Attachment: (was: HIVE-19985.07.patch) > ACID: Skip decoding the ROW__ID sections for

[jira] [Updated] (HIVE-19985) ACID: Skip decoding the ROW__ID sections for read-only queries

2018-09-29 Thread Eugene Koifman (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-19985?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eugene Koifman updated HIVE-19985: -- Attachment: (was: HIVE-19985.07.patch) > ACID: Skip decoding the ROW__ID sections for

[jira] [Updated] (HIVE-19985) ACID: Skip decoding the ROW__ID sections for read-only queries

2018-09-29 Thread Eugene Koifman (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-19985?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eugene Koifman updated HIVE-19985: -- Attachment: HIVE-19985.07.patch > ACID: Skip decoding the ROW__ID sections for read-only

[jira] [Updated] (HIVE-19985) ACID: Skip decoding the ROW__ID sections for read-only queries

2018-09-29 Thread Eugene Koifman (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-19985?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eugene Koifman updated HIVE-19985: -- Attachment: HIVE-19985.07.patch > ACID: Skip decoding the ROW__ID sections for read-only

[jira] [Updated] (HIVE-19985) ACID: Skip decoding the ROW__ID sections for read-only queries

2018-09-29 Thread Eugene Koifman (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-19985?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eugene Koifman updated HIVE-19985: -- Status: Open (was: Patch Available) > ACID: Skip decoding the ROW__ID sections for read-only

[jira] [Commented] (HIVE-20556) Expose an API to retrieve the TBL_ID from TBLS in the metastore tables

2018-09-28 Thread Eugene Koifman (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-20556?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16632248#comment-16632248 ] Eugene Koifman commented on HIVE-20556: --- I added a few minor things on RB, otherwise it makes sense

[jira] [Resolved] (HIVE-18774) ACID: Use the _copy_N files copyNumber as the implicit statement-id

2018-09-28 Thread Eugene Koifman (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-18774?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eugene Koifman resolved HIVE-18774. --- Resolution: Won't Fix since HIVE-17917 reading footers for all copy_N files is done once per

[jira] [Updated] (HIVE-19985) ACID: Skip decoding the ROW__ID sections for read-only queries

2018-09-28 Thread Eugene Koifman (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-19985?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eugene Koifman updated HIVE-19985: -- Affects Version/s: 3.0.0 > ACID: Skip decoding the ROW__ID sections for read-only queries >

[jira] [Updated] (HIVE-19985) ACID: Skip decoding the ROW__ID sections for read-only queries

2018-09-28 Thread Eugene Koifman (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-19985?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eugene Koifman updated HIVE-19985: -- Status: Patch Available (was: Open) > ACID: Skip decoding the ROW__ID sections for read-only

[jira] [Commented] (HIVE-19985) ACID: Skip decoding the ROW__ID sections for read-only queries

2018-09-28 Thread Eugene Koifman (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-19985?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16632154#comment-16632154 ] Eugene Koifman commented on HIVE-19985: --- rebased patch 6 > ACID: Skip decoding the ROW__ID

[jira] [Updated] (HIVE-19985) ACID: Skip decoding the ROW__ID sections for read-only queries

2018-09-28 Thread Eugene Koifman (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-19985?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eugene Koifman updated HIVE-19985: -- Attachment: HIVE-19985.06.patch > ACID: Skip decoding the ROW__ID sections for read-only

[jira] [Updated] (HIVE-20655) Optimize arrayCopy in LlapRecordReader

2018-09-28 Thread Eugene Koifman (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-20655?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eugene Koifman updated HIVE-20655: -- Description: followup to HIVE-19985 See Gopal's comment on 8/3/2018

[jira] [Updated] (HIVE-20655) Optimize arrayCopy in LlapRecordReader

2018-09-28 Thread Eugene Koifman (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-20655?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eugene Koifman updated HIVE-20655: -- Environment: (was: followup to HIVE-19985 See Gopal's comment on 8/3/2018

[jira] [Commented] (HIVE-20635) VectorizedOrcAcidRowBatchReader doesn't filter delete events for original files

2018-09-27 Thread Eugene Koifman (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-20635?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16631274#comment-16631274 ] Eugene Koifman commented on HIVE-20635: --- [~saurabhseth] could you take this on? >

[jira] [Updated] (HIVE-17917) VectorizedOrcAcidRowBatchReader.computeOffsetAndBucket optimization

2018-09-27 Thread Eugene Koifman (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-17917?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eugene Koifman updated HIVE-17917: -- Resolution: Fixed Fix Version/s: 4.0.0 Status: Resolved (was: Patch

[jira] [Commented] (HIVE-17917) VectorizedOrcAcidRowBatchReader.computeOffsetAndBucket optimization

2018-09-27 Thread Eugene Koifman (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-17917?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16631259#comment-16631259 ] Eugene Koifman commented on HIVE-17917: --- +1 >

[jira] [Resolved] (HIVE-16812) VectorizedOrcAcidRowBatchReader doesn't filter delete events

2018-09-27 Thread Eugene Koifman (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-16812?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eugene Koifman resolved HIVE-16812. --- Resolution: Fixed Release Note: n/a committed to master thanks Sergey for the review

[jira] [Commented] (HIVE-16812) VectorizedOrcAcidRowBatchReader doesn't filter delete events

2018-09-27 Thread Eugene Koifman (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-16812?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16630974#comment-16630974 ] Eugene Koifman commented on HIVE-16812: --- patch 7 fixes the typo > VectorizedOrcAcidRowBatchReader

[jira] [Updated] (HIVE-16812) VectorizedOrcAcidRowBatchReader doesn't filter delete events

2018-09-27 Thread Eugene Koifman (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-16812?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eugene Koifman updated HIVE-16812: -- Fix Version/s: 4.0.0 Status: Open (was: Patch Available) >

[jira] [Updated] (HIVE-16812) VectorizedOrcAcidRowBatchReader doesn't filter delete events

2018-09-27 Thread Eugene Koifman (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-16812?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eugene Koifman updated HIVE-16812: -- Attachment: HIVE-16812.07.patch > VectorizedOrcAcidRowBatchReader doesn't filter delete events

[jira] [Commented] (HIVE-16812) VectorizedOrcAcidRowBatchReader doesn't filter delete events

2018-09-27 Thread Eugene Koifman (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-16812?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16630955#comment-16630955 ] Eugene Koifman commented on HIVE-16812: --- I think because we normally drop the top level struct from

[jira] [Commented] (HIVE-19985) ACID: Skip decoding the ROW__ID sections for read-only queries

2018-09-27 Thread Eugene Koifman (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-19985?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16630916#comment-16630916 ] Eugene Koifman commented on HIVE-19985: --- Hive is on ORC 1.5.3 now but this patch needs to be

[jira] [Commented] (HIVE-16812) VectorizedOrcAcidRowBatchReader doesn't filter delete events

2018-09-27 Thread Eugene Koifman (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-16812?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16630909#comment-16630909 ] Eugene Koifman commented on HIVE-16812: --- No related failures > VectorizedOrcAcidRowBatchReader

[jira] [Commented] (HIVE-20640) Upgrade Hive to use ORC 1.5.3

2018-09-27 Thread Eugene Koifman (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-20640?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16630887#comment-16630887 ] Eugene Koifman commented on HIVE-20640: --- looks like spurious failure - passes locally committed to

[jira] [Updated] (HIVE-20640) Upgrade Hive to use ORC 1.5.3

2018-09-27 Thread Eugene Koifman (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-20640?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eugene Koifman updated HIVE-20640: -- Resolution: Fixed Fix Version/s: 4.0.0 Status: Resolved (was: Patch

[jira] [Updated] (HIVE-17231) ColumnizedDeleteEventRegistry.DeleteReaderValue optimization

2018-09-26 Thread Eugene Koifman (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-17231?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eugene Koifman updated HIVE-17231: -- Description: For unbucketed tables DeleteReaderValue will currently return all delete

[jira] [Updated] (HIVE-16812) VectorizedOrcAcidRowBatchReader doesn't filter delete events

2018-09-26 Thread Eugene Koifman (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-16812?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eugene Koifman updated HIVE-16812: -- Attachment: HIVE-16812.06.patch > VectorizedOrcAcidRowBatchReader doesn't filter delete events

[jira] [Commented] (HIVE-16812) VectorizedOrcAcidRowBatchReader doesn't filter delete events

2018-09-26 Thread Eugene Koifman (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-16812?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16629286#comment-16629286 ] Eugene Koifman commented on HIVE-16812: --- looks like at lest vector_acid4.q failure is related >

[jira] [Updated] (HIVE-20604) Minor compaction disables ORC column stats

2018-09-26 Thread Eugene Koifman (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-20604?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eugene Koifman updated HIVE-20604: -- Resolution: Fixed Status: Resolved (was: Patch Available) committed to master thanks

[jira] [Updated] (HIVE-20640) Upgrade Hive to use ORC 1.5.3

2018-09-26 Thread Eugene Koifman (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-20640?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eugene Koifman updated HIVE-20640: -- Status: Patch Available (was: Open) > Upgrade Hive to use ORC 1.5.3 >

[jira] [Updated] (HIVE-20640) Upgrade Hive to use ORC 1.5.3

2018-09-26 Thread Eugene Koifman (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-20640?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eugene Koifman updated HIVE-20640: -- Attachment: HIVE-20640.01.patch > Upgrade Hive to use ORC 1.5.3 >

[jira] [Updated] (HIVE-20640) Upgrade Hive to use ORC 1.5.3

2018-09-26 Thread Eugene Koifman (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-20640?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eugene Koifman updated HIVE-20640: -- Component/s: ORC > Upgrade Hive to use ORC 1.5.3 > - > >

[jira] [Assigned] (HIVE-20640) Upgrade Hive to use ORC 1.5.3

2018-09-26 Thread Eugene Koifman (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-20640?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eugene Koifman reassigned HIVE-20640: - > Upgrade Hive to use ORC 1.5.3 > - > > Key:

[jira] [Updated] (HIVE-17231) ColumnizedDeleteEventRegistry.DeleteReaderValue optimization

2018-09-25 Thread Eugene Koifman (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-17231?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eugene Koifman updated HIVE-17231: -- Description: For unbucketed tables DeleteReaderValue will currently return all delete

[jira] [Updated] (HIVE-20604) Minor compaction disables ORC column stats

2018-09-25 Thread Eugene Koifman (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-20604?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eugene Koifman updated HIVE-20604: -- Target Version/s: 4.0.0 Status: Patch Available (was: Open) [~prasanth_j] could

[jira] [Updated] (HIVE-20604) Minor compaction disables ORC column stats

2018-09-25 Thread Eugene Koifman (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-20604?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eugene Koifman updated HIVE-20604: -- Attachment: HIVE-20604.01.patch > Minor compaction disables ORC column stats >

[jira] [Commented] (HIVE-20556) Expose an API to retrieve the TBL_ID from TBLS in the metastore tables

2018-09-25 Thread Eugene Koifman (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-20556?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16628071#comment-16628071 ] Eugene Koifman commented on HIVE-20556: --- [~jmarhuen] could you create RB for this? {{optional i64

[jira] [Commented] (HIVE-16953) OrcRawRecordMerger.discoverOriginalKeyBounds issue if both split start and end are in the same stripe

2018-09-25 Thread Eugene Koifman (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-16953?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16628034#comment-16628034 ] Eugene Koifman commented on HIVE-16953: --- better long term fix is to make

[jira] [Issue Comment Deleted] (HIVE-17284) remove OrcRecordUpdater.deleteEventIndexBuilder

2018-09-25 Thread Eugene Koifman (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-17284?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eugene Koifman updated HIVE-17284: -- Comment: was deleted (was: this may not be the right thing to do.  ORC flattens structs

[jira] [Updated] (HIVE-17284) remove OrcRecordUpdater.deleteEventIndexBuilder

2018-09-25 Thread Eugene Koifman (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-17284?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eugene Koifman updated HIVE-17284: -- Description: There is no point in it. We know how many rows a delete_delta file has from ORC

[jira] [Comment Edited] (HIVE-16812) VectorizedOrcAcidRowBatchReader doesn't filter delete events

2018-09-25 Thread Eugene Koifman (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-16812?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16628015#comment-16628015 ] Eugene Koifman edited comment on HIVE-16812 at 9/25/18 10:47 PM: - patch 5

[jira] [Commented] (HIVE-16812) VectorizedOrcAcidRowBatchReader doesn't filter delete events

2018-09-25 Thread Eugene Koifman (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-16812?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16628015#comment-16628015 ] Eugene Koifman commented on HIVE-16812: --- patch 5 should be ready for review

[jira] [Updated] (HIVE-16812) VectorizedOrcAcidRowBatchReader doesn't filter delete events

2018-09-25 Thread Eugene Koifman (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-16812?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eugene Koifman updated HIVE-16812: -- Attachment: HIVE-16812.05.patch > VectorizedOrcAcidRowBatchReader doesn't filter delete events

[jira] [Commented] (HIVE-20593) Load Data for partitioned ACID tables fails with bucketId out of range: -1

2018-09-25 Thread Eugene Koifman (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-20593?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16627763#comment-16627763 ] Eugene Koifman commented on HIVE-20593: --- +1 > Load Data for partitioned ACID tables fails with

[jira] [Commented] (HIVE-17917) VectorizedOrcAcidRowBatchReader.computeOffsetAndBucket optimization

2018-09-25 Thread Eugene Koifman (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-17917?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16627692#comment-16627692 ] Eugene Koifman commented on HIVE-17917: --- I don't think non-vector mode is a priority >

[jira] [Updated] (HIVE-16812) VectorizedOrcAcidRowBatchReader doesn't filter delete events

2018-09-24 Thread Eugene Koifman (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-16812?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eugene Koifman updated HIVE-16812: -- Attachment: HIVE-16812.04.patch > VectorizedOrcAcidRowBatchReader doesn't filter delete events

[jira] [Commented] (HIVE-20538) Allow to store a key value together with a transaction.

2018-09-24 Thread Eugene Koifman (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-20538?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16626265#comment-16626265 ] Eugene Koifman commented on HIVE-20538: --- added some comments/nits to RB > Allow to store a key

[jira] [Updated] (HIVE-20627) Concurrent async queries intermittently fails with LockException and cause memory leak.

2018-09-24 Thread Eugene Koifman (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-20627?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eugene Koifman updated HIVE-20627: -- Component/s: Transactions > Concurrent async queries intermittently fails with LockException

[jira] [Commented] (HIVE-20538) Allow to store a key value together with a transaction.

2018-09-21 Thread Eugene Koifman (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-20538?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16624232#comment-16624232 ] Eugene Koifman commented on HIVE-20538: --- could you create an RB please > Allow to store a key

[jira] [Commented] (HIVE-20620) manifest collisions when inserting into bucketed sorted MM tables with dynamic partitioning

2018-09-21 Thread Eugene Koifman (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-20620?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16624226#comment-16624226 ] Eugene Koifman commented on HIVE-20620: --- There are some acid tests that tests more buckets than

[jira] [Updated] (HIVE-16812) VectorizedOrcAcidRowBatchReader doesn't filter delete events

2018-09-20 Thread Eugene Koifman (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-16812?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eugene Koifman updated HIVE-16812: -- Attachment: HIVE-16812.02.patch > VectorizedOrcAcidRowBatchReader doesn't filter delete events

[jira] [Updated] (HIVE-16812) VectorizedOrcAcidRowBatchReader doesn't filter delete events

2018-09-20 Thread Eugene Koifman (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-16812?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eugene Koifman updated HIVE-16812: -- Status: Patch Available (was: Open) > VectorizedOrcAcidRowBatchReader doesn't filter delete

[jira] [Commented] (HIVE-20607) TxnHandler should use PreparedStatement to execute direct SQL queries.

2018-09-20 Thread Eugene Koifman (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-20607?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16622511#comment-16622511 ] Eugene Koifman commented on HIVE-20607: --- How does a PreparedStatement solve this? If you are doing

[jira] [Commented] (HIVE-20607) TxnHandler should use PreparedStatement to execute direct SQL queries.

2018-09-20 Thread Eugene Koifman (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-20607?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16622328#comment-16622328 ] Eugene Koifman commented on HIVE-20607: --- Most of the statements are executed once per DB txn. What

[jira] [Assigned] (HIVE-20604) Minor compaction disables ORC column stats

2018-09-19 Thread Eugene Koifman (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-20604?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eugene Koifman reassigned HIVE-20604: - > Minor compaction disables ORC column stats > -- >

[jira] [Updated] (HIVE-20593) Load Data for partitioned ACID tables fails with bucketId out of range: -1

2018-09-19 Thread Eugene Koifman (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-20593?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eugene Koifman updated HIVE-20593: -- Affects Version/s: 3.1.0 > Load Data for partitioned ACID tables fails with bucketId out of

[jira] [Updated] (HIVE-20593) Load Data for partitioned ACID tables fails with bucketId out of range: -1

2018-09-19 Thread Eugene Koifman (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-20593?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eugene Koifman updated HIVE-20593: -- Component/s: Transactions > Load Data for partitioned ACID tables fails with bucketId out of

[jira] [Updated] (HIVE-18453) ACID: Add "CREATE TRANSACTIONAL TABLE" syntax to unify ACID ORC & Parquet support

2018-09-18 Thread Eugene Koifman (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-18453?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eugene Koifman updated HIVE-18453: -- Resolution: Fixed Status: Resolved (was: Patch Available) +1 Thanks Igor for the

[jira] [Updated] (HIVE-18453) ACID: Add "CREATE TRANSACTIONAL TABLE" syntax to unify ACID ORC & Parquet support

2018-09-18 Thread Eugene Koifman (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-18453?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eugene Koifman updated HIVE-18453: -- Fix Version/s: 4.0.0 > ACID: Add "CREATE TRANSACTIONAL TABLE" syntax to unify ACID ORC &

[jira] [Updated] (HIVE-20590) Allow merge statement to have column schema

2018-09-18 Thread Eugene Koifman (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-20590?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eugene Koifman updated HIVE-20590: -- Component/s: Transactions > Allow merge statement to have column schema >

[jira] [Commented] (HIVE-16812) VectorizedOrcAcidRowBatchReader doesn't filter delete events

2018-09-17 Thread Eugene Koifman (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-16812?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16618265#comment-16618265 ] Eugene Koifman commented on HIVE-16812: --- The above is not quite correct. The

[jira] [Commented] (HIVE-12267) Make Compaction jobs run on Tez

2018-09-17 Thread Eugene Koifman (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-12267?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16618236#comment-16618236 ] Eugene Koifman commented on HIVE-12267: --- Better yet, make a query based compactor > Make

[jira] [Assigned] (HIVE-12267) Make Compaction jobs run on Tez

2018-09-17 Thread Eugene Koifman (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-12267?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eugene Koifman reassigned HIVE-12267: - Assignee: Eugene Koifman > Make Compaction jobs run on Tez >

[jira] [Commented] (HIVE-18453) ACID: Add "CREATE TRANSACTIONAL TABLE" syntax to unify ACID ORC & Parquet support

2018-09-17 Thread Eugene Koifman (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-18453?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16618192#comment-16618192 ] Eugene Koifman commented on HIVE-18453: --- One last question: what does

[jira] [Updated] (HIVE-16812) VectorizedOrcAcidRowBatchReader doesn't filter delete events

2018-09-17 Thread Eugene Koifman (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-16812?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eugene Koifman updated HIVE-16812: -- Description: the c'tor of VectorizedOrcAcidRowBatchReader has {noformat} // Clone

[jira] [Commented] (HIVE-20556) Expose an API to retrieve the TBL_ID from TBLS in the metastore tables

2018-09-14 Thread Eugene Koifman (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-20556?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16615512#comment-16615512 ] Eugene Koifman commented on HIVE-20556: --- it may be useful to add a test that ensures Table.id is

[jira] [Updated] (HIVE-20553) more acid stats tests

2018-09-14 Thread Eugene Koifman (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-20553?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eugene Koifman updated HIVE-20553: -- Resolution: Fixed Fix Version/s: 4.0.0 Release Note: n/a Status:

[jira] [Commented] (HIVE-20553) more acid stats tests

2018-09-14 Thread Eugene Koifman (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-20553?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16615024#comment-16615024 ] Eugene Koifman commented on HIVE-20553: --- [~sershe] could you review please > more acid stats tests

[jira] [Updated] (HIVE-20553) more acid stats tests

2018-09-13 Thread Eugene Koifman (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-20553?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eugene Koifman updated HIVE-20553: -- Attachment: HIVE-20553.02.patch > more acid stats tests > - > >

[jira] [Assigned] (HIVE-20553) more acid stats tests

2018-09-13 Thread Eugene Koifman (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-20553?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eugene Koifman reassigned HIVE-20553: - > more acid stats tests > - > > Key: HIVE-20553 >

[jira] [Updated] (HIVE-20553) more acid stats tests

2018-09-13 Thread Eugene Koifman (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-20553?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eugene Koifman updated HIVE-20553: -- Attachment: HIVE-20553.01.patch > more acid stats tests > - > >

[jira] [Updated] (HIVE-20553) more acid stats tests

2018-09-13 Thread Eugene Koifman (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-20553?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eugene Koifman updated HIVE-20553: -- Status: Patch Available (was: Open) > more acid stats tests > - > >

[jira] [Resolved] (HIVE-17943) select ROW__ID, t, si, i from over10k_orc_bucketed where b = 4294967363 and t < 100 order by ROW__ID fails on LLAP

2018-09-10 Thread Eugene Koifman (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-17943?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eugene Koifman resolved HIVE-17943. --- Resolution: Cannot Reproduce Fix Version/s: 4.0.0 no longer see this in current

[jira] [Assigned] (HIVE-17943) select ROW__ID, t, si, i from over10k_orc_bucketed where b = 4294967363 and t < 100 order by ROW__ID fails on LLAP

2018-09-10 Thread Eugene Koifman (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-17943?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eugene Koifman reassigned HIVE-17943: - Assignee: Eugene Koifman > select ROW__ID, t, si, i from over10k_orc_bucketed where b =

[jira] [Updated] (HIVE-17921) Aggregation with struct in LLAP produces wrong result

2018-09-10 Thread Eugene Koifman (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-17921?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eugene Koifman updated HIVE-17921: -- Resolution: Fixed Fix Version/s: 4.0.0 Status: Resolved (was: Patch

[jira] [Updated] (HIVE-18772) Make Acid Cleaner use MIN_HISTORY_LEVEL

2018-09-10 Thread Eugene Koifman (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-18772?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eugene Koifman updated HIVE-18772: -- Attachment: HIVE-18772.03.patch > Make Acid Cleaner use MIN_HISTORY_LEVEL >

[jira] [Updated] (HIVE-18772) Make Acid Cleaner use MIN_HISTORY_LEVEL

2018-09-10 Thread Eugene Koifman (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-18772?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eugene Koifman updated HIVE-18772: -- Status: Open (was: Patch Available) > Make Acid Cleaner use MIN_HISTORY_LEVEL >

[jira] [Commented] (HIVE-17921) Aggregation with struct in LLAP produces wrong result

2018-09-10 Thread Eugene Koifman (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-17921?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16609641#comment-16609641 ] Eugene Koifman commented on HIVE-17921: --- +1 > Aggregation with struct in LLAP produces wrong

[jira] [Updated] (HIVE-18772) Make Acid Cleaner use MIN_HISTORY_LEVEL

2018-09-04 Thread Eugene Koifman (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-18772?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eugene Koifman updated HIVE-18772: -- Attachment: HIVE-18772.02.patch > Make Acid Cleaner use MIN_HISTORY_LEVEL >

[jira] [Updated] (HIVE-18772) Make Acid Cleaner use MIN_HISTORY_LEVEL

2018-09-04 Thread Eugene Koifman (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-18772?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eugene Koifman updated HIVE-18772: -- Attachment: HIVE-18772.02.patch > Make Acid Cleaner use MIN_HISTORY_LEVEL >

[jira] [Commented] (HIVE-18453) ACID: Add "CREATE TRANSACTIONAL TABLE" syntax to unify ACID ORC & Parquet support

2018-09-04 Thread Eugene Koifman (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-18453?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16603503#comment-16603503 ] Eugene Koifman commented on HIVE-18453: --- [~ikryvenko], no.  "create transactional..." should

[jira] [Commented] (HIVE-17921) Aggregation with struct in LLAP produces wrong result

2018-09-04 Thread Eugene Koifman (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-17921?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16603173#comment-16603173 ] Eugene Koifman commented on HIVE-17921: --- acid_vectorization_original.q.out used to have 1 row of

[jira] [Updated] (HIVE-18772) Make Acid Cleaner use MIN_HISTORY_LEVEL

2018-08-24 Thread Eugene Koifman (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-18772?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eugene Koifman updated HIVE-18772: -- Status: Patch Available (was: Open) > Make Acid Cleaner use MIN_HISTORY_LEVEL >

[jira] [Updated] (HIVE-18772) Make Acid Cleaner use MIN_HISTORY_LEVEL

2018-08-24 Thread Eugene Koifman (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-18772?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eugene Koifman updated HIVE-18772: -- Attachment: HIVE-18772.01.patch > Make Acid Cleaner use MIN_HISTORY_LEVEL >

[jira] [Updated] (HIVE-20435) Failed Dynamic Partition Insert into insert only table may loose transaction metadat

2018-08-24 Thread Eugene Koifman (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-20435?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eugene Koifman updated HIVE-20435: -- Summary: Failed Dynamic Partition Insert into insert only table may loose transaction metadat

<    1   2   3   4   5   6   7   8   9   10   >