[jira] [Commented] (HIVE-14633) #.of Files in a partition ! = #.Of buckets in a partitioned,bucketed table

[ https://issues.apache.org/jira/browse/HIVE-14633?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15449148#comment-15449148 ] Abhishek Somani commented on HIVE-14633: I think number of mappers can be controlled via other

[jira] [Commented] (HIVE-14633) #.of Files in a partition ! = #.Of buckets in a partitioned,bucketed table

[ https://issues.apache.org/jira/browse/HIVE-14633?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15448135#comment-15448135 ] Abhishek Somani commented on HIVE-14633: I think this is expected. Insert into will just create

[jira] [Comment Edited] (HIVE-14633) #.of Files in a partition ! = #.Of buckets in a partitioned,bucketed table

[ https://issues.apache.org/jira/browse/HIVE-14633?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15448135#comment-15448135 ] Abhishek Somani edited comment on HIVE-14633 at 8/30/16 5:54 AM: - Isn't

[jira] [Updated] (HIVE-15390) Orc reader unnecessarily reading stripe footers with hive.optimize.index.filter set to true

[ https://issues.apache.org/jira/browse/HIVE-15390?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Abhishek Somani updated HIVE-15390: --- Attachment: HIVE-15390.patch Removing the resetting of the split's maxOffset to

[jira] [Comment Edited] (HIVE-15390) Orc reader unnecessarily reading stripe footers with hive.optimize.index.filter set to true

[ https://issues.apache.org/jira/browse/HIVE-15390?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15732553#comment-15732553 ] Abhishek Somani edited comment on HIVE-15390 at 12/8/16 3:44 PM: -

[jira] [Commented] (HIVE-15390) Orc reader unnecessarily reading stripe footers with hive.optimize.index.filter set to true

[ https://issues.apache.org/jira/browse/HIVE-15390?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15732538#comment-15732538 ] Abhishek Somani commented on HIVE-15390: I think this is happening due to a bug in

[jira] [Comment Edited] (HIVE-15390) Orc reader unnecessarily reading stripe footers with hive.optimize.index.filter set to true

[ https://issues.apache.org/jira/browse/HIVE-15390?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15732553#comment-15732553 ] Abhishek Somani edited comment on HIVE-15390 at 12/8/16 3:46 PM: -

[jira] [Updated] (HIVE-15390) Orc reader unnecessarily reading stripe footers with hive.optimize.index.filter set to true

[ https://issues.apache.org/jira/browse/HIVE-15390?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Abhishek Somani updated HIVE-15390: --- Attachment: (was: HIVE-15390.patch) > Orc reader unnecessarily reading stripe footers

[jira] [Updated] (HIVE-15390) Orc reader unnecessarily reading stripe footers with hive.optimize.index.filter set to true

[ https://issues.apache.org/jira/browse/HIVE-15390?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Abhishek Somani updated HIVE-15390: --- Attachment: HIVE-15390.patch > Orc reader unnecessarily reading stripe footers with >

[jira] [Commented] (HIVE-15390) Orc reader unnecessarily reading stripe footers with hive.optimize.index.filter set to true

[ https://issues.apache.org/jira/browse/HIVE-15390?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15820473#comment-15820473 ] Abhishek Somani commented on HIVE-15390: [~prasanth_j] [~rajesh.balamohan] can you please review.

[jira] [Comment Edited] (HIVE-15390) Orc reader unnecessarily reading stripe footers with hive.optimize.index.filter set to true

[ https://issues.apache.org/jira/browse/HIVE-15390?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15820473#comment-15820473 ] Abhishek Somani edited comment on HIVE-15390 at 1/12/17 8:30 AM: -

[jira] [Updated] (HIVE-15390) Orc reader unnecessarily reading stripe footers with hive.optimize.index.filter set to true

[ https://issues.apache.org/jira/browse/HIVE-15390?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Abhishek Somani updated HIVE-15390: --- Status: Open (was: Patch Available) Trying to trigger precommit tests. > Orc reader

[jira] [Updated] (HIVE-15390) Orc reader unnecessarily reading stripe footers with hive.optimize.index.filter set to true

[ https://issues.apache.org/jira/browse/HIVE-15390?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Abhishek Somani updated HIVE-15390: --- Attachment: HIVE-15390.1.patch > Orc reader unnecessarily reading stripe footers with >

[jira] [Updated] (HIVE-15390) Orc reader unnecessarily reading stripe footers with hive.optimize.index.filter set to true

[ https://issues.apache.org/jira/browse/HIVE-15390?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Abhishek Somani updated HIVE-15390: --- Status: Patch Available (was: Open) > Orc reader unnecessarily reading stripe footers with

[jira] [Updated] (HIVE-15390) Orc reader unnecessarily reading stripe footers with hive.optimize.index.filter set to true

[ https://issues.apache.org/jira/browse/HIVE-15390?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Abhishek Somani updated HIVE-15390: --- Status: Patch Available (was: Open) > Orc reader unnecessarily reading stripe footers with

[jira] [Commented] (HIVE-15390) Orc reader unnecessarily reading stripe footers with hive.optimize.index.filter set to true

[ https://issues.apache.org/jira/browse/HIVE-15390?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15779695#comment-15779695 ] Abhishek Somani commented on HIVE-15390: Review Board: https://reviews.apache.org/r/55045/ Not

[jira] [Comment Edited] (HIVE-15390) Orc reader unnecessarily reading stripe footers with hive.optimize.index.filter set to true

[ https://issues.apache.org/jira/browse/HIVE-15390?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15779695#comment-15779695 ] Abhishek Somani edited comment on HIVE-15390 at 12/27/16 6:03 AM: -- Review

[jira] [Commented] (HIVE-14487) Add REBUILD statement for materialized views

[ https://issues.apache.org/jira/browse/HIVE-14487?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16078518#comment-16078518 ] Abhishek Somani commented on HIVE-14487: [~jcamachorodriguez] Is this being worked on? From your

[jira] [Commented] (HIVE-16907) "INSERT INTO" overwrite old data when destination table encapsulated by backquote

[ https://issues.apache.org/jira/browse/HIVE-16907?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16260596#comment-16260596 ] Abhishek Somani commented on HIVE-16907: I ran into this issue as well. Do we plan to fix it? >

[jira] [Commented] (HIVE-20220) Incorrect result when hive.groupby.skewindata is enabled

[ https://issues.apache.org/jira/browse/HIVE-20220?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16591155#comment-16591155 ] Abhishek Somani commented on HIVE-20220: To add to Ganesha's point above, this is an issue with

[jira] [Comment Edited] (HIVE-20220) Incorrect result when hive.groupby.skewindata is enabled

[ https://issues.apache.org/jira/browse/HIVE-20220?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16591155#comment-16591155 ] Abhishek Somani edited comment on HIVE-20220 at 8/24/18 4:41 AM: - To add

[jira] [Commented] (HIVE-20220) Incorrect result when hive.groupby.skewindata is enabled

[ https://issues.apache.org/jira/browse/HIVE-20220?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16606692#comment-16606692 ] Abhishek Somani commented on HIVE-20220: [~gopalv] [~ashutoshc] can someone please help on this

[jira] [Commented] (HIVE-20823) Make Compactor run in a transaction

[ https://issues.apache.org/jira/browse/HIVE-20823?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16681203#comment-16681203 ] Abhishek Somani commented on HIVE-20823: [~ekoifman] is this expected to solve

[jira] [Commented] (HIVE-20901) running compactor when there is nothing to do produces duplicate data

[ https://issues.apache.org/jira/browse/HIVE-20901?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16809507#comment-16809507 ] Abhishek Somani commented on HIVE-20901: I think I have a fix for this that I'd like to try and

[jira] [Assigned] (HIVE-20901) running compactor when there is nothing to do produces duplicate data

[ https://issues.apache.org/jira/browse/HIVE-20901?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Abhishek Somani reassigned HIVE-20901: -- Assignee: Abhishek Somani (was: Eugene Koifman) > running compactor when there is

[jira] [Updated] (HIVE-20901) running compactor when there is nothing to do produces duplicate data

[ https://issues.apache.org/jira/browse/HIVE-20901?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Abhishek Somani updated HIVE-20901: --- Attachment: HIVE-20901.1.patch > running compactor when there is nothing to do produces

[jira] [Updated] (HIVE-20901) running compactor when there is nothing to do produces duplicate data

[ https://issues.apache.org/jira/browse/HIVE-20901?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Abhishek Somani updated HIVE-20901: --- Status: Patch Available (was: Open) > running compactor when there is nothing to do

[jira] [Commented] (HIVE-20901) running compactor when there is nothing to do produces duplicate data

[ https://issues.apache.org/jira/browse/HIVE-20901?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16810472#comment-16810472 ] Abhishek Somani commented on HIVE-20901: Right. The patch I have uploaded will avoid the

[jira] [Updated] (HIVE-20901) running compactor when there is nothing to do produces duplicate data

[ https://issues.apache.org/jira/browse/HIVE-20901?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Abhishek Somani updated HIVE-20901: --- Status: Patch Available (was: Open) > running compactor when there is nothing to do

[jira] [Updated] (HIVE-20901) running compactor when there is nothing to do produces duplicate data

[ https://issues.apache.org/jira/browse/HIVE-20901?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Abhishek Somani updated HIVE-20901: --- Attachment: HIVE-20901.2.patch > running compactor when there is nothing to do produces

[jira] [Updated] (HIVE-20901) running compactor when there is nothing to do produces duplicate data

[ https://issues.apache.org/jira/browse/HIVE-20901?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Abhishek Somani updated HIVE-20901: --- Status: Open (was: Patch Available) > running compactor when there is nothing to do

[jira] [Commented] (HIVE-16842) insert overwrite with select does not remove data when the select query returns empty resultset

[ https://issues.apache.org/jira/browse/HIVE-16842?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16792408#comment-16792408 ] Abhishek Somani commented on HIVE-16842: [~vgarg] [~ashutoshc] are we planning to fix this? >

[jira] [Commented] (HIVE-13479) Relax sorting requirement in ACID tables

[ https://issues.apache.org/jira/browse/HIVE-13479?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16795678#comment-16795678 ] Abhishek Somani commented on HIVE-13479: [~ekoifman] [~vgumashta] [~gopalv] Do we have any plans

[jira] [Commented] (HIVE-21165) ACID: pass query hint to the writers to write hive.acid.key.index

[ https://issues.apache.org/jira/browse/HIVE-21165?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16795663#comment-16795663 ] Abhishek Somani commented on HIVE-21165: Got it. I was confused between hive.acid.key.index and 

[jira] [Comment Edited] (HIVE-13479) Relax sorting requirement in ACID tables

[ https://issues.apache.org/jira/browse/HIVE-13479?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16795678#comment-16795678 ] Abhishek Somani edited comment on HIVE-13479 at 3/19/19 5:01 AM: -

[jira] [Commented] (HIVE-21165) ACID: pass query hint to the writers to write hive.acid.key.index

[ https://issues.apache.org/jira/browse/HIVE-21165?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16794812#comment-16794812 ] Abhishek Somani commented on HIVE-21165: In ACID v2, as every file has only one type of event

[jira] [Commented] (HIVE-20948) Eliminate file rename in compactor

[ https://issues.apache.org/jira/browse/HIVE-20948?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16794814#comment-16794814 ] Abhishek Somani commented on HIVE-20948: Looks like a duplicate of HIVE-21164. cc [~vgumashta]

[jira] [Commented] (HIVE-13479) Relax sorting requirement in ACID tables

[ https://issues.apache.org/jira/browse/HIVE-13479?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16795933#comment-16795933 ] Abhishek Somani commented on HIVE-13479: What I meant is now that ACID v2 has been implemented,

[jira] [Commented] (HIVE-20823) Make Compactor run in a transaction

[ https://issues.apache.org/jira/browse/HIVE-20823?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16765829#comment-16765829 ] Abhishek Somani commented on HIVE-20823: [~ekoifman], [~vgumashta] Is there a plan to backport

[jira] [Commented] (HIVE-21058) Make Compactor run in a transaction (Umbrella)

[ https://issues.apache.org/jira/browse/HIVE-21058?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16765828#comment-16765828 ] Abhishek Somani commented on HIVE-21058: [~ekoifman], [~vgumashta] Is there a plan to backport

[jira] [Commented] (HIVE-20901) running compactor when there is nothing to do produces duplicate data

[ https://issues.apache.org/jira/browse/HIVE-20901?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16814022#comment-16814022 ] Abhishek Somani commented on HIVE-20901: Looks like HIVE-9995 got merged yesterday with a fix for

[jira] [Commented] (HIVE-20901) running compactor when there is nothing to do produces duplicate data

[ https://issues.apache.org/jira/browse/HIVE-20901?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16812969#comment-16812969 ] Abhishek Somani commented on HIVE-20901: [~ekoifman] [~vgumashta] can you please review the

[jira] [Commented] (HIVE-21714) INSERT OVERWRITE TABLE doesn't clean the table directory before overwriting with ACID table

[ https://issues.apache.org/jira/browse/HIVE-21714?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16838245#comment-16838245 ] Abhishek Somani commented on HIVE-21714: [~isuller] sorry I might have misunderstood, but isn't

[jira] [Commented] (HIVE-21714) INSERT OVERWRITE TABLE doesn't clean the table directory before overwriting with ACID table

[ https://issues.apache.org/jira/browse/HIVE-21714?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16838293#comment-16838293 ] Abhishek Somani commented on HIVE-21714: You can see HIVE-14988. As in the description, old data

[jira] [Commented] (HIVE-21714) Insert overwrite on an acid/mm table is ineffective if the input is empty

[ https://issues.apache.org/jira/browse/HIVE-21714?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16838331#comment-16838331 ] Abhishek Somani commented on HIVE-21714: Got it! Thanks. > Insert overwrite on an acid/mm table

[jira] [Commented] (HIVE-21513) ACID: Running merge concurrently with minor compaction causes a later select * to throw exception

[ https://issues.apache.org/jira/browse/HIVE-21513?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16857265#comment-16857265 ] Abhishek Somani commented on HIVE-21513: Can you please tell [~vgumashta] which Jira is this a

[jira] [Comment Edited] (HIVE-21513) ACID: Running merge concurrently with minor compaction causes a later select * to throw exception

[ https://issues.apache.org/jira/browse/HIVE-21513?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16857265#comment-16857265 ] Abhishek Somani edited comment on HIVE-21513 at 6/6/19 4:04 AM:

[jira] [Commented] (HIVE-21841) Leader election in HMS to run housekeeping tasks.

[ https://issues.apache.org/jira/browse/HIVE-21841?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16863835#comment-16863835 ] Abhishek Somani commented on HIVE-21841: [~ashutosh.bapat] as I understand it currently, multiple

[jira] [Commented] (HIVE-22413) Avoid dirty read when reading the ACID table while compaction is running

[ https://issues.apache.org/jira/browse/HIVE-22413?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16962817#comment-16962817 ] Abhishek Somani commented on HIVE-22413: [~pvary] an issue with HIVE-20823 is that it is in

[jira] [Commented] (HIVE-20901) running compactor when there is nothing to do produces duplicate data

[ https://issues.apache.org/jira/browse/HIVE-20901?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17010587#comment-17010587 ] Abhishek Somani commented on HIVE-20901: [~pvary] Sure! > running compactor when there is

[jira] [Commented] (HIVE-23143) Transactions: PPD in Delete deltas is broken

[ https://issues.apache.org/jira/browse/HIVE-23143?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17076404#comment-17076404 ] Abhishek Somani commented on HIVE-23143: [~pvary] it doesn't help. I tested on current master

[jira] [Comment Edited] (HIVE-23143) Transactions: PPD in Delete deltas is broken

[ https://issues.apache.org/jira/browse/HIVE-23143?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17076404#comment-17076404 ] Abhishek Somani edited comment on HIVE-23143 at 4/6/20, 3:21 PM: -

[jira] [Comment Edited] (HIVE-23143) Transactions: PPD in Delete deltas is broken

[ https://issues.apache.org/jira/browse/HIVE-23143?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17076404#comment-17076404 ] Abhishek Somani edited comment on HIVE-23143 at 4/6/20, 3:21 PM: -

[jira] [Commented] (HIVE-8123) Support parquet ACID

[ https://issues.apache.org/jira/browse/HIVE-8123?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17088800#comment-17088800 ] Abhishek Somani commented on HIVE-8123: --- [~gopalv] [~pvary] [~omalley] Can you please take a look at

[jira] [Commented] (HIVE-21052) Make sure transactions get cleaned if they are aborted before addPartitions is called

[ https://issues.apache.org/jira/browse/HIVE-21052?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17105622#comment-17105622 ] Abhishek Somani commented on HIVE-21052:  This seems like a critical issue. Is this actively

[jira] [Commented] (HIVE-21052) Make sure transactions get cleaned if they are aborted before addPartitions is called

[ https://issues.apache.org/jira/browse/HIVE-21052?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17107480#comment-17107480 ] Abhishek Somani commented on HIVE-21052: Yes [~pvary] we are taking a look at this and will get

[jira] [Commented] (HIVE-23804) Adding defaults for Columns Stats table in the schema to make them backward compatible

[ https://issues.apache.org/jira/browse/HIVE-23804?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17158515#comment-17158515 ] Abhishek Somani commented on HIVE-23804: [~ngangam] the issue exists in all metastore schemas of

[jira] [Comment Edited] (HIVE-23804) Adding defaults for Columns Stats table in the schema to make them backward compatible

[ https://issues.apache.org/jira/browse/HIVE-23804?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17158515#comment-17158515 ] Abhishek Somani edited comment on HIVE-23804 at 7/15/20, 4:33 PM: --