[jira] [Updated] (HIVE-21993) HS/HMS delegationstore with ZK can degrade performance when jute.maxBuffer is reached

2019-07-14 Thread Rajesh Balamohan (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-21993?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rajesh Balamohan updated HIVE-21993: Description: DelegationStore can be configured to run in-mem/DB/ZK based TokenStores. {{To

[jira] [Assigned] (HIVE-21778) CBO: "Struct is not null" gets evaluated as `nullable` always causing pushdown miss in the query

2019-07-17 Thread Rajesh Balamohan (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-21778?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rajesh Balamohan reassigned HIVE-21778: --- Assignee: Rajesh Balamohan > CBO: "Struct is not null" gets evaluated as `nullable`

[jira] [Assigned] (HIVE-21778) CBO: "Struct is not null" gets evaluated as `nullable` always causing pushdown miss in the query

2019-07-17 Thread Rajesh Balamohan (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-21778?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rajesh Balamohan reassigned HIVE-21778: --- Assignee: (was: Rajesh Balamohan) > CBO: "Struct is not null" gets evaluated as

[jira] [Commented] (HIVE-21778) CBO: "Struct is not null" gets evaluated as `nullable` always causing filter miss in the query

2019-07-17 Thread Rajesh Balamohan (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-21778?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16886789#comment-16886789 ] Rajesh Balamohan commented on HIVE-21778: - This happens in master as well. I will

[jira] [Assigned] (HIVE-21778) CBO: "Struct is not null" gets evaluated as `nullable` always causing pushdown miss in the query

2019-07-17 Thread Rajesh Balamohan (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-21778?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rajesh Balamohan reassigned HIVE-21778: --- Assignee: Rajesh Balamohan > CBO: "Struct is not null" gets evaluated as `nullable`

[jira] [Updated] (HIVE-21778) CBO: "Struct is not null" gets evaluated as `nullable` always causing filter miss in the query

2019-07-17 Thread Rajesh Balamohan (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-21778?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rajesh Balamohan updated HIVE-21778: Attachment: test_null.q.out test_null.q > CBO: "Struct is not null" gets ev

[jira] [Updated] (HIVE-21778) CBO: "Struct is not null" gets evaluated as `nullable` always causing filter miss in the query

2019-07-17 Thread Rajesh Balamohan (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-21778?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rajesh Balamohan updated HIVE-21778: Affects Version/s: 4.0.0 > CBO: "Struct is not null" gets evaluated as `nullable` always ca

[jira] [Assigned] (HIVE-21778) CBO: "Struct is not null" gets evaluated as `nullable` always causing pushdown miss in the query

2019-07-17 Thread Rajesh Balamohan (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-21778?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rajesh Balamohan reassigned HIVE-21778: --- Assignee: (was: Rajesh Balamohan) > CBO: "Struct is not null" gets evaluated as

[jira] [Comment Edited] (HIVE-21778) CBO: "Struct is not null" gets evaluated as `nullable` always causing filter miss in the query

2019-07-17 Thread Rajesh Balamohan (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-21778?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16886789#comment-16886789 ] Rajesh Balamohan edited comment on HIVE-21778 at 7/17/19 8:44 AM: -

[jira] [Updated] (HIVE-21778) CBO: "Struct is not null" gets evaluated as `nullable` always causing filter miss in the query

2019-07-17 Thread Rajesh Balamohan (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-21778?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rajesh Balamohan updated HIVE-21778: Summary: CBO: "Struct is not null" gets evaluated as `nullable` always causing filter miss

[jira] [Updated] (HIVE-21778) CBO: "Struct is not null" gets evaluated as `nullable` always causing filter miss in the query

2019-07-17 Thread Rajesh Balamohan (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-21778?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rajesh Balamohan updated HIVE-21778: Description: {noformat} drop table if exists test_struct; CREATE external TABLE test_struct

[jira] [Commented] (HIVE-21778) CBO: "Struct is not null" gets evaluated as `nullable` always causing filter miss in the query

2019-07-17 Thread Rajesh Balamohan (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-21778?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16886797#comment-16886797 ] Rajesh Balamohan commented on HIVE-21778: - It creates the filter in https://gith

[jira] [Commented] (HIVE-21778) CBO: "Struct is not null" gets evaluated as `nullable` always causing filter miss in the query

2019-07-18 Thread Rajesh Balamohan (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-21778?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16887927#comment-16887927 ] Rajesh Balamohan commented on HIVE-21778: - +1 > CBO: "Struct is not null" gets e

[jira] [Updated] (HIVE-22013) "Show table extended" should not compute FS statistics

2019-07-20 Thread Rajesh Balamohan (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-22013?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rajesh Balamohan updated HIVE-22013: Summary: "Show table extended" should not compute FS statistics (was: "Show table extended

[jira] [Updated] (HIVE-22013) "Show table extended" should not compute FS statistics

2019-07-21 Thread Rajesh Balamohan (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-22013?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rajesh Balamohan updated HIVE-22013: Description: In some of the `show table extended` statements, following codepath is invoked

[jira] [Updated] (HIVE-22039) Query with CBO crashes HS2 in corner case

2019-07-24 Thread Rajesh Balamohan (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-22039?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rajesh Balamohan updated HIVE-22039: Summary: Query with CBO crashes HS2 in corner case (was: Query with CBO crashes HS2 in cor

[jira] [Commented] (HIVE-22039) Query with CBO crashes HS2 in corner case

2019-07-24 Thread Rajesh Balamohan (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-22039?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16891824#comment-16891824 ] Rajesh Balamohan commented on HIVE-22039: - Suspecting that {{FilterReduceExpressi

[jira] [Updated] (HIVE-22039) Query with CBO crashes HS2 in corner case

2019-07-24 Thread Rajesh Balamohan (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-22039?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rajesh Balamohan updated HIVE-22039: Description: Here is a very simple repro for this case. Query would crash HS2. Temp workar

[jira] [Updated] (HIVE-22039) Query with CBO crashes HS2 in corner case

2019-07-24 Thread Rajesh Balamohan (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-22039?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rajesh Balamohan updated HIVE-22039: Attachment: image-2019-07-25-04-52-33-686.png > Query with CBO crashes HS2 in corner case >

[jira] [Updated] (HIVE-22039) Query with CBO crashes HS2 in corner case

2019-07-24 Thread Rajesh Balamohan (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-22039?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rajesh Balamohan updated HIVE-22039: Attachment: image-2019-07-25-04-52-20-002.png > Query with CBO crashes HS2 in corner case >

[jira] [Commented] (HIVE-22039) Query with CBO crashes HS2 in corner case

2019-07-24 Thread Rajesh Balamohan (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-22039?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16892283#comment-16892283 ] Rajesh Balamohan commented on HIVE-22039: - [~kgyrtkirk]: I tried from 3.1.1 bits

[jira] [Commented] (HIVE-22039) Query with CBO crashes HS2 in corner case

2019-07-25 Thread Rajesh Balamohan (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-22039?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16892714#comment-16892714 ] Rajesh Balamohan commented on HIVE-22039: - Confirming that https://issues.apache.

[jira] [Commented] (HIVE-22039) Query with CBO crashes HS2 in corner case

2019-07-25 Thread Rajesh Balamohan (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-22039?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16893296#comment-16893296 ] Rajesh Balamohan commented on HIVE-22039: - Just wanted to mention that CALCITE-22

[jira] [Updated] (HIVE-22102) Reduce HMS call when createing HiveSession

2019-08-13 Thread Rajesh Balamohan (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-22102?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rajesh Balamohan updated HIVE-22102: Attachment: HIVE-22102.1.patch > Reduce HMS call when createing HiveSession > -

[jira] [Updated] (HIVE-22102) Reduce HMS call when createing HiveSession

2019-08-13 Thread Rajesh Balamohan (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-22102?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rajesh Balamohan updated HIVE-22102: Status: Patch Available (was: Open) > Reduce HMS call when createing HiveSession > ---

[jira] [Updated] (HIVE-22102) Reduce HMS call when creating HiveSession

2019-08-13 Thread Rajesh Balamohan (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-22102?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rajesh Balamohan updated HIVE-22102: Summary: Reduce HMS call when creating HiveSession (was: Reduce HMS call when createing Hi

[jira] [Commented] (HIVE-22135) Remove Hive.get().getConf() call and instead pass the configuration

2019-08-22 Thread Rajesh Balamohan (Jira)
[ https://issues.apache.org/jira/browse/HIVE-22135?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16913835#comment-16913835 ] Rajesh Balamohan commented on HIVE-22135: - Thanks for creating this ticket [~vgar

[jira] [Commented] (HIVE-22165) Synchronisation introduced by HIVE-14296 on SessionManager.closeSession causes high latency in a busy hive server

2019-09-04 Thread Rajesh Balamohan (Jira)
[ https://issues.apache.org/jira/browse/HIVE-22165?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16923005#comment-16923005 ] Rajesh Balamohan commented on HIVE-22165: - Latest patch LGTM. +1. > Synchronisat

[jira] [Commented] (HIVE-10805) OOM in vectorized reduce

2015-05-24 Thread Rajesh Balamohan (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-10805?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14557977#comment-14557977 ] Rajesh Balamohan commented on HIVE-10805: - Applied .02 patch and tested. Works fi

[jira] [Commented] (HIVE-10551) OOM when running query_89 with vectorization on & hybridgrace=false

2015-06-03 Thread Rajesh Balamohan (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-10551?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14571791#comment-14571791 ] Rajesh Balamohan commented on HIVE-10551: - [~vikram.dixit] - OOM happens in Map-1

[jira] [Updated] (HIVE-10551) OOM when running query_89 with vectorization on & hybridgrace=false

2015-06-03 Thread Rajesh Balamohan (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-10551?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rajesh Balamohan updated HIVE-10551: Attachment: hive-10551.png > OOM when running query_89 with vectorization on & hybridgrace=f

[jira] [Updated] (HIVE-11068) Hive throws OOM in client side

2015-06-22 Thread Rajesh Balamohan (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-11068?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rajesh Balamohan updated HIVE-11068: Attachment: Yourkit_String.png Yourkit_TablScanDesc.png hive_

[jira] [Commented] (HIVE-14925) MSCK repair table hang while running with multi threading enabled

2016-10-12 Thread Rajesh Balamohan (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-14925?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15570317#comment-15570317 ] Rajesh Balamohan commented on HIVE-14925: - It would be helpful to have the repro f

[jira] [Commented] (HIVE-14803) S3: Stats gathering for insert queries can be expensive for partitioned dataset

2016-10-12 Thread Rajesh Balamohan (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-14803?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15570613#comment-15570613 ] Rajesh Balamohan commented on HIVE-14803: - Thanks [~sseth], [~pxiong]. I will fix

[jira] [Commented] (HIVE-14925) MSCK repair table hang while running with multi threading enabled

2016-10-12 Thread Rajesh Balamohan (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-14925?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15570618#comment-15570618 ] Rajesh Balamohan commented on HIVE-14925: - This was tried with with partitions in

[jira] [Updated] (HIVE-14828) Cloud/S3: Stats publishing should be on HDFS instead of S3

2016-10-18 Thread Rajesh Balamohan (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-14828?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rajesh Balamohan updated HIVE-14828: Attachment: HIVE-14828.branch-2.0.001.patch [~ashutoshc] - Attaching the patch for branch-2.

[jira] [Commented] (HIVE-14837) JDBC: standalone jar is missing hadoop core dependencies

2016-10-19 Thread Rajesh Balamohan (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-14837?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15590282#comment-15590282 ] Rajesh Balamohan commented on HIVE-14837: - Tried this patch in master; it works an

[jira] [Updated] (HIVE-14828) Cloud/S3: Stats publishing should be on HDFS instead of S3

2016-10-19 Thread Rajesh Balamohan (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-14828?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rajesh Balamohan updated HIVE-14828: Attachment: HIVE-14828.1.patch it is better to have use hdfs for stats file. rebasing for ma

[jira] [Updated] (HIVE-14803) S3: Stats gathering for insert queries can be expensive for partitioned dataset

2016-10-20 Thread Rajesh Balamohan (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-14803?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rajesh Balamohan updated HIVE-14803: Attachment: HIVE-14803.2.patch Uploading revised patch. Submitting it as patch for jenkins t

[jira] [Updated] (HIVE-14803) S3: Stats gathering for insert queries can be expensive for partitioned dataset

2016-10-20 Thread Rajesh Balamohan (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-14803?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rajesh Balamohan updated HIVE-14803: Status: Patch Available (was: Open) > S3: Stats gathering for insert queries can be expensi

[jira] [Updated] (HIVE-14803) S3: Stats gathering for insert queries can be expensive for partitioned dataset

2016-10-20 Thread Rajesh Balamohan (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-14803?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rajesh Balamohan updated HIVE-14803: Status: Open (was: Patch Available) > S3: Stats gathering for insert queries can be expensi

[jira] [Updated] (HIVE-14803) S3: Stats gathering for insert queries can be expensive for partitioned dataset

2016-10-20 Thread Rajesh Balamohan (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-14803?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rajesh Balamohan updated HIVE-14803: Status: Open (was: Patch Available) > S3: Stats gathering for insert queries can be expensi

[jira] [Commented] (HIVE-14953) don't use globStatus on S3 in MM tables

2016-10-20 Thread Rajesh Balamohan (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-14953?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15593627#comment-15593627 ] Rajesh Balamohan commented on HIVE-14953: - [~sershe] - It was in FileSinkOperator.

[jira] [Commented] (HIVE-14953) don't use globStatus on S3 in MM tables

2016-10-20 Thread Rajesh Balamohan (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-14953?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15593700#comment-15593700 ] Rajesh Balamohan commented on HIVE-14953: - [~sershe] - It should be listFiles(path

[jira] [Comment Edited] (HIVE-14953) don't use globStatus on S3 in MM tables

2016-10-20 Thread Rajesh Balamohan (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-14953?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15593700#comment-15593700 ] Rajesh Balamohan edited comment on HIVE-14953 at 10/21/16 2:16 AM: -

[jira] [Commented] (HIVE-14803) S3: Stats gathering for insert queries can be expensive for partitioned dataset

2016-10-21 Thread Rajesh Balamohan (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-14803?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15594460#comment-15594460 ] Rajesh Balamohan commented on HIVE-14803: - Will check running the patch again. I t

[jira] [Updated] (HIVE-14803) S3: Stats gathering for insert queries can be expensive for partitioned dataset

2016-10-21 Thread Rajesh Balamohan (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-14803?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rajesh Balamohan updated HIVE-14803: Attachment: HIVE-14803.3.patch > S3: Stats gathering for insert queries can be expensive for

[jira] [Updated] (HIVE-14803) S3: Stats gathering for insert queries can be expensive for partitioned dataset

2016-10-21 Thread Rajesh Balamohan (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-14803?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rajesh Balamohan updated HIVE-14803: Status: Patch Available (was: Open) > S3: Stats gathering for insert queries can be expensi

[jira] [Updated] (HIVE-15038) Reuse OrcTail in OrcEncodedDataReader::ReaderOptions

2016-10-23 Thread Rajesh Balamohan (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-15038?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rajesh Balamohan updated HIVE-15038: Attachment: HIVE-15038.1.patch \cc [~gopalv], [~prasanth_j] > Reuse OrcTail in OrcEncodedDa

[jira] [Updated] (HIVE-15038) Reuse OrcTail in OrcEncodedDataReader::ReaderOptions in Llap

2016-10-23 Thread Rajesh Balamohan (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-15038?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rajesh Balamohan updated HIVE-15038: Summary: Reuse OrcTail in OrcEncodedDataReader::ReaderOptions in Llap (was: Reuse OrcTail i

[jira] [Updated] (HIVE-15038) Reuse OrcTail in OrcEncodedDataReader::ReaderOptions

2016-10-23 Thread Rajesh Balamohan (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-15038?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rajesh Balamohan updated HIVE-15038: Status: Patch Available (was: Open) > Reuse OrcTail in OrcEncodedDataReader::ReaderOptions

[jira] [Updated] (HIVE-15038) Reuse OrcTail in OrcEncodedDataReader::ReaderOptions in Llap

2016-10-24 Thread Rajesh Balamohan (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-15038?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rajesh Balamohan updated HIVE-15038: Attachment: HIVE-15038.2.patch Thanks [~gopalv]. Attaching revised patch. > Reuse OrcTail i

[jira] [Updated] (HIVE-15069) Optimize MetaStoreDirectSql:: aggrColStatsForPartitions during query compilation

2016-10-26 Thread Rajesh Balamohan (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-15069?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rajesh Balamohan updated HIVE-15069: Priority: Minor (was: Major) > Optimize MetaStoreDirectSql:: aggrColStatsForPartitions duri

[jira] [Updated] (HIVE-15069) Optimize MetaStoreDirectSql:: aggrColStatsForPartitions during query compilation

2016-10-26 Thread Rajesh Balamohan (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-15069?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rajesh Balamohan updated HIVE-15069: Status: Patch Available (was: Open) > Optimize MetaStoreDirectSql:: aggrColStatsForPartitio

[jira] [Updated] (HIVE-15069) Optimize MetaStoreDirectSql:: aggrColStatsForPartitions during query compilation

2016-10-26 Thread Rajesh Balamohan (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-15069?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rajesh Balamohan updated HIVE-15069: Attachment: HIVE-15069.1.patch With patch, compilation time comes down to "2.62" seconds vs

[jira] [Updated] (HIVE-15069) Optimize MetaStoreDirectSql:: aggrColStatsForPartitions during query compilation

2016-10-26 Thread Rajesh Balamohan (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-15069?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rajesh Balamohan updated HIVE-15069: Status: Open (was: Patch Available) > Optimize MetaStoreDirectSql:: aggrColStatsForPartitio

[jira] [Updated] (HIVE-15069) Optimize MetaStoreDirectSql:: aggrColStatsForPartitions during query compilation

2016-10-26 Thread Rajesh Balamohan (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-15069?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rajesh Balamohan updated HIVE-15069: Attachment: HIVE-15069.2.patch > Optimize MetaStoreDirectSql:: aggrColStatsForPartitions dur

[jira] [Updated] (HIVE-15069) Optimize MetaStoreDirectSql:: aggrColStatsForPartitions during query compilation

2016-10-26 Thread Rajesh Balamohan (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-15069?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rajesh Balamohan updated HIVE-15069: Attachment: (was: HIVE-15069.2.patch) > Optimize MetaStoreDirectSql:: aggrColStatsForPar

[jira] [Updated] (HIVE-15069) Optimize MetaStoreDirectSql:: aggrColStatsForPartitions during query compilation

2016-10-26 Thread Rajesh Balamohan (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-15069?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rajesh Balamohan updated HIVE-15069: Attachment: HIVE-15069.2.patch > Optimize MetaStoreDirectSql:: aggrColStatsForPartitions dur

[jira] [Updated] (HIVE-15069) Optimize MetaStoreDirectSql:: aggrColStatsForPartitions during query compilation

2016-10-26 Thread Rajesh Balamohan (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-15069?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rajesh Balamohan updated HIVE-15069: Status: Patch Available (was: Open) > Optimize MetaStoreDirectSql:: aggrColStatsForPartitio

[jira] [Updated] (HIVE-15069) Optimize MetaStoreDirectSql:: aggrColStatsForPartitions during query compilation

2016-10-27 Thread Rajesh Balamohan (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-15069?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rajesh Balamohan updated HIVE-15069: Status: Open (was: Patch Available) > Optimize MetaStoreDirectSql:: aggrColStatsForPartitio

[jira] [Updated] (HIVE-15069) Optimize MetaStoreDirectSql:: aggrColStatsForPartitions during query compilation

2016-10-27 Thread Rajesh Balamohan (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-15069?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rajesh Balamohan updated HIVE-15069: Attachment: HIVE-15069.3.patch > Optimize MetaStoreDirectSql:: aggrColStatsForPartitions dur

[jira] [Updated] (HIVE-15069) Optimize MetaStoreDirectSql:: aggrColStatsForPartitions during query compilation

2016-10-27 Thread Rajesh Balamohan (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-15069?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rajesh Balamohan updated HIVE-15069: Status: Patch Available (was: Open) > Optimize MetaStoreDirectSql:: aggrColStatsForPartitio

[jira] [Commented] (HIVE-15069) Optimize MetaStoreDirectSql:: aggrColStatsForPartitions during query compilation

2016-11-01 Thread Rajesh Balamohan (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-15069?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15626943#comment-15626943 ] Rajesh Balamohan commented on HIVE-15069: - Thanks [~sershe]. I have enqueued a jen

[jira] [Updated] (HIVE-14803) S3: Stats gathering for insert queries can be expensive for partitioned dataset

2016-11-02 Thread Rajesh Balamohan (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-14803?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rajesh Balamohan updated HIVE-14803: Attachment: HIVE-14803.4.patch > S3: Stats gathering for insert queries can be expensive for

[jira] [Updated] (HIVE-14803) S3: Stats gathering for insert queries can be expensive for partitioned dataset

2016-11-02 Thread Rajesh Balamohan (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-14803?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rajesh Balamohan updated HIVE-14803: Status: Open (was: Patch Available) > S3: Stats gathering for insert queries can be expensi

[jira] [Updated] (HIVE-14803) S3: Stats gathering for insert queries can be expensive for partitioned dataset

2016-11-02 Thread Rajesh Balamohan (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-14803?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rajesh Balamohan updated HIVE-14803: Attachment: HIVE-14803.5.patch > S3: Stats gathering for insert queries can be expensive for

[jira] [Updated] (HIVE-14803) S3: Stats gathering for insert queries can be expensive for partitioned dataset

2016-11-02 Thread Rajesh Balamohan (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-14803?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rajesh Balamohan updated HIVE-14803: Status: Patch Available (was: Open) > S3: Stats gathering for insert queries can be expensi

[jira] [Updated] (HIVE-15129) LLAP : Enhance cache hits for stripe metadata across queries

2016-11-04 Thread Rajesh Balamohan (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-15129?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rajesh Balamohan updated HIVE-15129: Description: When multiple queries are run in LLAP, stripe metadata cache misses were obser

[jira] [Updated] (HIVE-15129) LLAP : Enhance cache hits for stripe metadata across queries

2016-11-04 Thread Rajesh Balamohan (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-15129?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rajesh Balamohan updated HIVE-15129: Description: When multiple queries are run in LLAP, stripe metadata cache misses were obser

[jira] [Updated] (HIVE-15129) LLAP : Enhance cache hits for stripe metadata across queries

2016-11-04 Thread Rajesh Balamohan (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-15129?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rajesh Balamohan updated HIVE-15129: Attachment: HIVE-15129.1.patch \cc [~gopalv], [~sershe] > LLAP : Enhance cache hits for str

[jira] [Updated] (HIVE-15129) LLAP : Enhance cache hits for stripe metadata across queries

2016-11-04 Thread Rajesh Balamohan (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-15129?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rajesh Balamohan updated HIVE-15129: Description: When multiple queries are run in LLAP, stripe metadata cache misses were obser

[jira] [Updated] (HIVE-15129) LLAP : Enhance cache hits for stripe metadata across queries

2016-11-04 Thread Rajesh Balamohan (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-15129?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rajesh Balamohan updated HIVE-15129: Status: Patch Available (was: Open) > LLAP : Enhance cache hits for stripe metadata across

[jira] [Updated] (HIVE-15129) LLAP : Enhance cache hits for stripe metadata across queries

2016-11-04 Thread Rajesh Balamohan (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-15129?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rajesh Balamohan updated HIVE-15129: Description: When multiple queries are run in LLAP, stripe metadata cache misses were obser

[jira] [Commented] (HIVE-15129) LLAP : Enhance cache hits for stripe metadata across queries

2016-11-06 Thread Rajesh Balamohan (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-15129?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15642719#comment-15642719 ] Rajesh Balamohan commented on HIVE-15129: - Thanks [~sershe]. Test failures are not

[jira] [Commented] (HIVE-15038) Reuse OrcTail in OrcEncodedDataReader::ReaderOptions in Llap

2016-11-06 Thread Rajesh Balamohan (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-15038?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15642890#comment-15642890 ] Rajesh Balamohan commented on HIVE-15038: - Thanks [~sershe]. Test failures are unr

[jira] [Comment Edited] (HIVE-15038) Reuse OrcTail in OrcEncodedDataReader::ReaderOptions in Llap

2016-11-06 Thread Rajesh Balamohan (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-15038?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15642890#comment-15642890 ] Rajesh Balamohan edited comment on HIVE-15038 at 11/7/16 2:43 AM: --

[jira] [Comment Edited] (HIVE-15129) LLAP : Enhance cache hits for stripe metadata across queries

2016-11-06 Thread Rajesh Balamohan (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-15129?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15642719#comment-15642719 ] Rajesh Balamohan edited comment on HIVE-15129 at 11/7/16 2:46 AM: --

[jira] [Commented] (HIVE-15138) String + Integer gets converted to UDFToDouble causing number format exceptions

2016-11-06 Thread Rajesh Balamohan (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-15138?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15643274#comment-15643274 ] Rajesh Balamohan commented on HIVE-15138: - \cc [~jcamachorodriguez], [~gopalv] >

[jira] [Updated] (HIVE-15129) LLAP : Enhance cache hits for stripe metadata across queries

2016-11-07 Thread Rajesh Balamohan (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-15129?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rajesh Balamohan updated HIVE-15129: Attachment: HIVE-15129.2.patch Footer information can be reused in {{loadMissingIndexes}} wh

[jira] [Commented] (HIVE-15138) String + Integer gets converted to UDFToDouble causing number format exceptions

2016-11-07 Thread Rajesh Balamohan (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-15138?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15643514#comment-15643514 ] Rajesh Balamohan commented on HIVE-15138: - Yeah, HIVE-5021 would be needed for bet

[jira] [Updated] (HIVE-15129) LLAP : Enhance cache hits for stripe metadata across queries

2016-11-07 Thread Rajesh Balamohan (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-15129?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rajesh Balamohan updated HIVE-15129: Attachment: HIVE-15129.3.patch Removing the last change w.r.t to footer cache. Will create s

[jira] [Commented] (HIVE-15203) Hive export command does export to non HDFS file system

2016-11-14 Thread Rajesh Balamohan (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-15203?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15666334#comment-15666334 ] Rajesh Balamohan commented on HIVE-15203: - [~thejas] - Does this happen with {{hi

[jira] [Commented] (HIVE-15199) INSERT INTO data on S3 is replacing the old rows with the new ones

2016-11-15 Thread Rajesh Balamohan (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-15199?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15666900#comment-15666900 ] Rajesh Balamohan commented on HIVE-15199: - This is covered in test cases in branch

[jira] [Updated] (HIVE-14803) S3: Stats gathering for insert queries can be expensive for partitioned dataset

2016-11-17 Thread Rajesh Balamohan (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-14803?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rajesh Balamohan updated HIVE-14803: Status: Open (was: Patch Available) > S3: Stats gathering for insert queries can be expensi

[jira] [Updated] (HIVE-14803) S3: Stats gathering for insert queries can be expensive for partitioned dataset

2016-11-17 Thread Rajesh Balamohan (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-14803?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rajesh Balamohan updated HIVE-14803: Status: Patch Available (was: Open) > S3: Stats gathering for insert queries can be expensi

[jira] [Updated] (HIVE-14803) S3: Stats gathering for insert queries can be expensive for partitioned dataset

2016-11-17 Thread Rajesh Balamohan (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-14803?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rajesh Balamohan updated HIVE-14803: Attachment: HIVE-14803.6.patch > S3: Stats gathering for insert queries can be expensive for

[jira] [Commented] (HIVE-14803) S3: Stats gathering for insert queries can be expensive for partitioned dataset

2016-11-17 Thread Rajesh Balamohan (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-14803?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15673389#comment-15673389 ] Rajesh Balamohan commented on HIVE-14803: - Test failures are not related to this p

[jira] [Updated] (HIVE-14803) S3: Stats gathering for insert queries can be expensive for partitioned dataset

2016-11-17 Thread Rajesh Balamohan (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-14803?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rajesh Balamohan updated HIVE-14803: Attachment: HIVE-14803.7.patch Minor change in exception handling > S3: Stats gathering for

[jira] [Commented] (HIVE-14803) S3: Stats gathering for insert queries can be expensive for partitioned dataset

2016-11-17 Thread Rajesh Balamohan (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-14803?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15675748#comment-15675748 ] Rajesh Balamohan commented on HIVE-14803: - Thanks [~pxiong]. {noformat}org.apac

[jira] [Resolved] (HIVE-15241) Update/Alter stats in metastore can be expensive in S3

2016-11-17 Thread Rajesh Balamohan (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-15241?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rajesh Balamohan resolved HIVE-15241. - Resolution: Duplicate > Update/Alter stats in metastore can be expensive in S3 > -

[jira] [Updated] (HIVE-15240) Updating/Altering stats in metastore can be expensive in S3

2016-11-21 Thread Rajesh Balamohan (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-15240?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rajesh Balamohan updated HIVE-15240: Attachment: HIVE-15240.1.patch As part of "StatsTask -> updateQuickStats" itself, statistics

[jira] [Updated] (HIVE-15240) Updating/Altering stats in metastore can be expensive in S3

2016-11-21 Thread Rajesh Balamohan (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-15240?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rajesh Balamohan updated HIVE-15240: Status: Patch Available (was: Open) > Updating/Altering stats in metastore can be expensive

[jira] [Assigned] (HIVE-15240) Updating/Altering stats in metastore can be expensive in S3

2016-11-21 Thread Rajesh Balamohan (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-15240?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rajesh Balamohan reassigned HIVE-15240: --- Assignee: Rajesh Balamohan > Updating/Altering stats in metastore can be expensive in

[jira] [Commented] (HIVE-15240) Updating/Altering stats in metastore can be expensive in S3

2016-11-21 Thread Rajesh Balamohan (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-15240?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15682915#comment-15682915 ] Rajesh Balamohan commented on HIVE-15240: - \cc [~sershe], [~pxiong], [~ashutoshc]

[jira] [Updated] (HIVE-15250) Reuse partitions info generated in MoveTask to its subscribers (StatsTask)

2016-11-21 Thread Rajesh Balamohan (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-15250?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rajesh Balamohan updated HIVE-15250: Attachment: HIVE-15250.1.patch Observed 10% improvement on top of HIVE-15240 in 5 node clust

[jira] [Assigned] (HIVE-15250) Reuse partitions info generated in MoveTask to its subscribers (StatsTask)

2016-11-21 Thread Rajesh Balamohan (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-15250?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rajesh Balamohan reassigned HIVE-15250: --- Assignee: Rajesh Balamohan > Reuse partitions info generated in MoveTask to its subsc

[jira] [Updated] (HIVE-15250) Reuse partitions info generated in MoveTask to its subscribers (StatsTask)

2016-11-21 Thread Rajesh Balamohan (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-15250?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rajesh Balamohan updated HIVE-15250: Status: Patch Available (was: Open) > Reuse partitions info generated in MoveTask to its su

[jira] [Updated] (HIVE-15250) Reuse partitions info generated in MoveTask to its subscribers (StatsTask)

2016-11-21 Thread Rajesh Balamohan (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-15250?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rajesh Balamohan updated HIVE-15250: Status: Open (was: Patch Available) > Reuse partitions info generated in MoveTask to its su

[jira] [Updated] (HIVE-15240) Updating/Altering stats in metastore can be expensive in S3

2016-11-21 Thread Rajesh Balamohan (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-15240?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rajesh Balamohan updated HIVE-15240: Attachment: HIVE-15240.2.patch Thanks [~sershe]. Attaching .2 patch. > Updating/Altering

<    1   2   3   4   5   6   7   8   9   10   >