[jira] [Commented] (HIVE-15803) msck can hang when nested partitions are present

2017-02-03 Thread Rajesh Balamohan (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-15803?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15851352#comment-15851352 ] Rajesh Balamohan commented on HIVE-15803: - Stack: {noformat} "main" #1 prio=5 os_prio=0

[jira] [Updated] (HIVE-15565) LLAP: GroupByOperator flushes hash table too frequently

2017-01-22 Thread Rajesh Balamohan (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-15565?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rajesh Balamohan updated HIVE-15565: Resolution: Fixed Status: Resolved (was: Patch Available) Thanks [~prasanth_j],

[jira] [Updated] (HIVE-15693) LLAP: cached threadpool in AMReporter creates too many threads leading to OOM

2017-01-22 Thread Rajesh Balamohan (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-15693?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rajesh Balamohan updated HIVE-15693: Description: branch: master {noformat} 2017-01-22T19:52:42,470 WARN [IPC Server handler

[jira] [Commented] (HIVE-15669) LLAP: Improve aging in shortest job first scheduler

2017-01-22 Thread Rajesh Balamohan (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-15669?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15833777#comment-15833777 ] Rajesh Balamohan commented on HIVE-15669: - [~prasanth_j] - Should the comparison be based on

[jira] [Commented] (HIVE-15679) Some metastore metrics always contains column=null (write_column_statistics, write_partition_column_statistics)

2017-01-22 Thread Rajesh Balamohan (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-15679?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15833929#comment-15833929 ] Rajesh Balamohan commented on HIVE-15679: - LGTM. +1. Thanks [~pvary] > Some metastore metrics

[jira] [Updated] (HIVE-15693) LLAP: cached threadpool in AMReporter creates too many threads leading to OOM

2017-01-27 Thread Rajesh Balamohan (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-15693?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rajesh Balamohan updated HIVE-15693: Resolution: Fixed Fix Version/s: 2.2.0 Status: Resolved (was: Patch

[jira] [Updated] (HIVE-15693) LLAP: cached threadpool in AMReporter creates too many threads leading to OOM

2017-01-27 Thread Rajesh Balamohan (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-15693?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rajesh Balamohan updated HIVE-15693: Attachment: HIVE-15693.5.patch Thanks [~leftylev]. Attaching .5 patch > LLAP: cached

[jira] [Updated] (HIVE-15693) LLAP: cached threadpool in AMReporter creates too many threads leading to OOM

2017-01-26 Thread Rajesh Balamohan (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-15693?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rajesh Balamohan updated HIVE-15693: Attachment: HIVE-15693.4.patch Thanks [~sseth]. Will commit it after jenkin results. >

[jira] [Commented] (HIVE-15669) LLAP: Improve aging in shortest job first scheduler

2017-01-26 Thread Rajesh Balamohan (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-15669?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15840584#comment-15840584 ] Rajesh Balamohan commented on HIVE-15669: - Thanks for the patch [~prasanth_j]. LGTM. +1. >

[jira] [Updated] (HIVE-15693) LLAP: cached threadpool in AMReporter creates too many threads leading to OOM

2017-01-26 Thread Rajesh Balamohan (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-15693?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rajesh Balamohan updated HIVE-15693: Attachment: HIVE-15693.2.patch Attaching .2 version addressing review comments. > LLAP:

[jira] [Updated] (HIVE-15693) LLAP: cached threadpool in AMReporter creates too many threads leading to OOM

2017-01-26 Thread Rajesh Balamohan (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-15693?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rajesh Balamohan updated HIVE-15693: Status: Open (was: Patch Available) > LLAP: cached threadpool in AMReporter creates too

[jira] [Updated] (HIVE-15693) LLAP: cached threadpool in AMReporter creates too many threads leading to OOM

2017-01-26 Thread Rajesh Balamohan (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-15693?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rajesh Balamohan updated HIVE-15693: Attachment: HIVE-15693.3.patch Attaching .3 version of the patch. > LLAP: cached

[jira] [Updated] (HIVE-15693) LLAP: cached threadpool in AMReporter creates too many threads leading to OOM

2017-01-26 Thread Rajesh Balamohan (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-15693?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rajesh Balamohan updated HIVE-15693: Status: Patch Available (was: Open) > LLAP: cached threadpool in AMReporter creates too

[jira] [Updated] (HIVE-15992) LLAP: NPE in LlapTaskCommunicator.getCompletedLogsUrl for unsuccessful attempt

2017-02-20 Thread Rajesh Balamohan (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-15992?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rajesh Balamohan updated HIVE-15992: Attachment: HIVE-15992.1.patch > LLAP: NPE in LlapTaskCommunicator.getCompletedLogsUrl for

[jira] [Updated] (HIVE-15992) LLAP: NPE in LlapTaskCommunicator.getCompletedLogsUrl for unsuccessful attempt

2017-02-20 Thread Rajesh Balamohan (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-15992?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rajesh Balamohan updated HIVE-15992: Status: Patch Available (was: Open) > LLAP: NPE in

[jira] [Commented] (HIVE-15942) Q22 does not get vectorized due to grouping set evaluations

2017-02-16 Thread Rajesh Balamohan (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-15942?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15871029#comment-15871029 ] Rajesh Balamohan commented on HIVE-15942: - Mostly should get fixed with HIVE-14016. Need to check

[jira] [Updated] (HIVE-15964) LLAP: Llap IO codepath not getting invoked due to file column id mismatch

2017-02-17 Thread Rajesh Balamohan (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-15964?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rajesh Balamohan updated HIVE-15964: Attachment: HIVE-15964.2.patch Thanks [~sershe]. Attaching .2 version. Removed isAcidScan

[jira] [Commented] (HIVE-15879) Fix HiveMetaStoreChecker.checkPartitionDirs method

2017-02-23 Thread Rajesh Balamohan (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-15879?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15881827#comment-15881827 ] Rajesh Balamohan commented on HIVE-15879: - Thanks for sharing the details [~vihangk1]. I have a

[jira] [Updated] (HIVE-16020) LLAP : Reduce IPC connection misses

2017-02-23 Thread Rajesh Balamohan (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-16020?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rajesh Balamohan updated HIVE-16020: Resolution: Fixed Fix Version/s: 2.2.0 Status: Resolved (was: Patch

[jira] [Commented] (HIVE-15964) LLAP: Llap IO codepath not getting invoked due to file column id mismatch

2017-02-23 Thread Rajesh Balamohan (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-15964?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15881701#comment-15881701 ] Rajesh Balamohan commented on HIVE-15964: - committed the addendum patch in master. > LLAP: Llap

[jira] [Comment Edited] (HIVE-15879) Fix HiveMetaStoreChecker.checkPartitionDirs method

2017-02-23 Thread Rajesh Balamohan (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-15879?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15881827#comment-15881827 ] Rajesh Balamohan edited comment on HIVE-15879 at 2/24/17 2:53 AM: -- Thanks

[jira] [Updated] (HIVE-15964) LLAP: Llap IO codepath not getting invoked due to file column id mismatch

2017-02-23 Thread Rajesh Balamohan (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-15964?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rajesh Balamohan updated HIVE-15964: Resolution: Fixed Hadoop Flags: Reviewed Fix Version/s: 2.2.0 Status:

[jira] [Updated] (HIVE-15964) LLAP: Llap IO codepath not getting invoked due to file column id mismatch

2017-02-23 Thread Rajesh Balamohan (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-15964?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rajesh Balamohan updated HIVE-15964: Attachment: HIVE-15964.addendum.patch Yes [~prasanth_j]. Attaching the addendum patch for

[jira] [Commented] (HIVE-15879) Fix HiveMetaStoreChecker.checkPartitionDirs method

2017-02-24 Thread Rajesh Balamohan (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-15879?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15882640#comment-15882640 ] Rajesh Balamohan commented on HIVE-15879: - >>> it returns only approximate number of threads and

[jira] [Updated] (HIVE-15964) LLAP: Llap IO codepath not getting invoked due to file column id mismatch

2017-02-23 Thread Rajesh Balamohan (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-15964?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rajesh Balamohan updated HIVE-15964: Attachment: HIVE-15964.4.patch > LLAP: Llap IO codepath not getting invoked due to file

[jira] [Updated] (HIVE-15941) Fix o.a.h.hive.ql.exec.tez.TezTask compilation issue with tez master

2017-02-19 Thread Rajesh Balamohan (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-15941?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rajesh Balamohan updated HIVE-15941: Resolution: Fixed Hadoop Flags: Reviewed Fix Version/s: 2.2.0 Status:

[jira] [Updated] (HIVE-16020) LLAP : Reduce IPC connection misses

2017-02-22 Thread Rajesh Balamohan (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-16020?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rajesh Balamohan updated HIVE-16020: Attachment: HIVE-16020.1.patch Changes: 1. Common SocketFactory passed to

[jira] [Updated] (HIVE-16020) LLAP : Reduce IPC connection misses

2017-02-22 Thread Rajesh Balamohan (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-16020?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rajesh Balamohan updated HIVE-16020: Status: Patch Available (was: Open) > LLAP : Reduce IPC connection misses >

[jira] [Updated] (HIVE-15964) LLAP: Llap IO codepath not getting invoked due to file column id mismatch

2017-02-22 Thread Rajesh Balamohan (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-15964?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rajesh Balamohan updated HIVE-15964: Attachment: HIVE-15964.3.patch addressing review comments from [~prasanth_j]. Added -ve

[jira] [Commented] (HIVE-16014) HiveMetastoreChecker should use hive.metastore.fshandler.threads instead of hive.mv.files.thread for pool size

2017-02-23 Thread Rajesh Balamohan (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-16014?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15880136#comment-15880136 ] Rajesh Balamohan commented on HIVE-16014: - Thanks for creating this jira. Proposed change sounds

[jira] [Updated] (HIVE-15889) LLAP: Some tasks still run after hive cli is shutdown

2017-02-13 Thread Rajesh Balamohan (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-15889?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rajesh Balamohan updated HIVE-15889: Attachment: HIVE-15889.3.patch Thanks [~sershe]. Attaching .3 patch to address review

[jira] [Updated] (HIVE-15889) LLAP: Some tasks still run after hive cli is shutdown

2017-02-13 Thread Rajesh Balamohan (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-15889?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rajesh Balamohan updated HIVE-15889: Resolution: Fixed Hadoop Flags: Reviewed Fix Version/s: 2.2.0 Status:

[jira] [Commented] (HIVE-15909) HiveMetaStoreChecker::checkTable can be expensive in ObjectStores

2017-02-14 Thread Rajesh Balamohan (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-15909?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15865334#comment-15865334 ] Rajesh Balamohan commented on HIVE-15909: - Instead of multi-threading, one option could be to

[jira] [Commented] (HIVE-15869) LLAP: move metadata cache off-heap

2017-02-09 Thread Rajesh Balamohan (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-15869?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15860517#comment-15860517 ] Rajesh Balamohan commented on HIVE-15869: - Would this be on similar lines like HIVE-15665? >

[jira] [Updated] (HIVE-15875) LLAP UI: Rename Executors "used" --> "used (wait queue + executors)"

2017-02-09 Thread Rajesh Balamohan (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-15875?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rajesh Balamohan updated HIVE-15875: Attachment: Llap_ui.png > LLAP UI: Rename Executors "used" --> "used (wait queue +

[jira] [Commented] (HIVE-15909) HiveMetaStoreChecker::checkTable can be expensive in ObjectStores

2017-02-14 Thread Rajesh Balamohan (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-15909?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15866913#comment-15866913 ] Rajesh Balamohan commented on HIVE-15909: - Thanks [~vihangk1]. Please feel free to assign this in

[jira] [Assigned] (HIVE-15336) LLAP UI: Expand the UI to multiple pages

2017-02-12 Thread Rajesh Balamohan (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-15336?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rajesh Balamohan reassigned HIVE-15336: --- Assignee: Gopal V (was: Rajesh Balamohan) > LLAP UI: Expand the UI to multiple

[jira] [Updated] (HIVE-15336) LLAP UI: Expand the UI to multiple pages

2017-02-12 Thread Rajesh Balamohan (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-15336?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rajesh Balamohan updated HIVE-15336: Attachment: HIVE-15336.WIP.master.rebase.patch > LLAP UI: Expand the UI to multiple pages >

[jira] [Assigned] (HIVE-15336) LLAP UI: Expand the UI to multiple pages

2017-02-12 Thread Rajesh Balamohan (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-15336?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rajesh Balamohan reassigned HIVE-15336: --- Assignee: Rajesh Balamohan (was: Gopal V) > LLAP UI: Expand the UI to multiple

[jira] [Commented] (HIVE-15889) LLAP: Some tasks still run after hive cli is shutdown

2017-02-13 Thread Rajesh Balamohan (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-15889?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15863255#comment-15863255 ] Rajesh Balamohan commented on HIVE-15889: - originally reported by [~gopalv]. > LLAP: Some tasks

[jira] [Updated] (HIVE-15889) LLAP: Some tasks still run after hive cli is shutdown

2017-02-13 Thread Rajesh Balamohan (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-15889?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rajesh Balamohan updated HIVE-15889: Attachment: HIVE-15889.1.patch > LLAP: Some tasks still run after hive cli is shutdown >

[jira] [Updated] (HIVE-15889) LLAP: Some tasks still run after hive cli is shutdown

2017-02-13 Thread Rajesh Balamohan (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-15889?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rajesh Balamohan updated HIVE-15889: Status: Patch Available (was: Open) > LLAP: Some tasks still run after hive cli is

[jira] [Updated] (HIVE-15941) Fix o.a.h.hive.ql.exec.tez.TezTask compilation issue with tez master

2017-02-16 Thread Rajesh Balamohan (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-15941?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rajesh Balamohan updated HIVE-15941: Summary: Fix o.a.h.hive.ql.exec.tez.TezTask compilation issue with tez master (was: Fix

[jira] [Assigned] (HIVE-15941) Fix TezTask compilation issue with tez master

2017-02-16 Thread Rajesh Balamohan (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-15941?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rajesh Balamohan reassigned HIVE-15941: --- > Fix TezTask compilation issue with tez master >

[jira] [Commented] (HIVE-15941) Fix TezTask compilation issue with tez master

2017-02-16 Thread Rajesh Balamohan (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-15941?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15869519#comment-15869519 ] Rajesh Balamohan commented on HIVE-15941: - Reported by [~anishek] > Fix TezTask compilation issue

[jira] [Updated] (HIVE-15941) Fix TezTask compilation issue with tez master

2017-02-16 Thread Rajesh Balamohan (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-15941?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rajesh Balamohan updated HIVE-15941: Attachment: HIVE-15941.1.patch > Fix TezTask compilation issue with tez master >

[jira] [Updated] (HIVE-15941) Fix TezTask compilation issue with tez master

2017-02-16 Thread Rajesh Balamohan (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-15941?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rajesh Balamohan updated HIVE-15941: Status: Patch Available (was: Open) > Fix TezTask compilation issue with tez master >

[jira] [Updated] (HIVE-15942) Q22 does not get vectorized due to grouping set evaluations

2017-02-16 Thread Rajesh Balamohan (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-15942?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rajesh Balamohan updated HIVE-15942: Attachment: query_plan_q22_HIVE-15942.txt > Q22 does not get vectorized due to grouping set

[jira] [Updated] (HIVE-15889) LLAP: Some tasks still run after hive cli is shutdown

2017-02-13 Thread Rajesh Balamohan (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-15889?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rajesh Balamohan updated HIVE-15889: Attachment: HIVE-15889.2.patch Attaching .2 version of the patch.

[jira] [Updated] (HIVE-15964) LLAP: Llap IO codepath not getting invoked due to file column id mismatch

2017-02-17 Thread Rajesh Balamohan (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-15964?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rajesh Balamohan updated HIVE-15964: Component/s: llap > LLAP: Llap IO codepath not getting invoked due to file column id

[jira] [Assigned] (HIVE-15964) LLAP: Llap IO codepath not getting invoked due to file column id mismatch

2017-02-17 Thread Rajesh Balamohan (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-15964?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rajesh Balamohan reassigned HIVE-15964: --- > LLAP: Llap IO codepath not getting invoked due to file column id mismatch >

[jira] [Updated] (HIVE-15964) LLAP: Llap IO codepath not getting invoked due to file column id mismatch

2017-02-17 Thread Rajesh Balamohan (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-15964?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rajesh Balamohan updated HIVE-15964: Status: Patch Available (was: Open) > LLAP: Llap IO codepath not getting invoked due to

[jira] [Updated] (HIVE-15964) LLAP: Llap IO codepath not getting invoked due to file column id mismatch

2017-02-17 Thread Rajesh Balamohan (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-15964?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rajesh Balamohan updated HIVE-15964: Attachment: HIVE-15964.1.patch \cc [~prasanth_j] > LLAP: Llap IO codepath not getting

[jira] [Commented] (HIVE-15565) LLAP: GroupByOperator flushes hash table too frequently

2017-01-18 Thread Rajesh Balamohan (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-15565?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15829228#comment-15829228 ] Rajesh Balamohan commented on HIVE-15565: - Had offline discussion with [~prasanth_j] on this. We

[jira] [Commented] (HIVE-15565) LLAP: GroupByOperator flushes hash table too frequently

2017-01-18 Thread Rajesh Balamohan (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-15565?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15829231#comment-15829231 ] Rajesh Balamohan commented on HIVE-15565: - Reverted the patch. Will post a separate patch for

[jira] [Updated] (HIVE-15565) LLAP: GroupByOperator flushes hash table too frequently

2017-01-18 Thread Rajesh Balamohan (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-15565?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rajesh Balamohan updated HIVE-15565: Status: Patch Available (was: Reopened) > LLAP: GroupByOperator flushes hash table too

[jira] [Updated] (HIVE-15565) LLAP: GroupByOperator flushes hash table too frequently

2017-01-18 Thread Rajesh Balamohan (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-15565?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rajesh Balamohan updated HIVE-15565: Attachment: HIVE-15565.2.patch > LLAP: GroupByOperator flushes hash table too frequently >

[jira] [Reopened] (HIVE-15565) LLAP: GroupByOperator flushes hash table too frequently

2017-01-18 Thread Rajesh Balamohan (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-15565?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rajesh Balamohan reopened HIVE-15565: - > LLAP: GroupByOperator flushes hash table too frequently >

[jira] [Commented] (HIVE-15565) LLAP: GroupByOperator flushes hash table too frequently

2017-01-16 Thread Rajesh Balamohan (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-15565?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15824756#comment-15824756 ] Rajesh Balamohan commented on HIVE-15565: - As per old impl, maxMemory in {{GroupByOperator}} was

[jira] [Updated] (HIVE-14545) HiveServer2 with http transport mode spends too much time just creating configs

2016-08-16 Thread Rajesh Balamohan (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-14545?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rajesh Balamohan updated HIVE-14545: Attachment: Screen Shot 2016-08-16 at 12.22.03 PM.png > HiveServer2 with http transport

[jira] [Updated] (HIVE-14545) HiveServer2 with http transport mode spending too much time just creating configs

2016-08-16 Thread Rajesh Balamohan (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-14545?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rajesh Balamohan updated HIVE-14545: Status: Patch Available (was: Open) > HiveServer2 with http transport mode spending too

[jira] [Updated] (HIVE-16044) LLAP: Shuffle Handler keep-alive connections are closed from the server side

2017-02-27 Thread Rajesh Balamohan (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-16044?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rajesh Balamohan updated HIVE-16044: Attachment: HIVE-16044.2.patch Uploading same patch. > LLAP: Shuffle Handler keep-alive

[jira] [Commented] (HIVE-16078) improve abort checking in Tez/LLAP

2017-03-01 Thread Rajesh Balamohan (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-16078?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15891566#comment-15891566 ] Rajesh Balamohan commented on HIVE-16078: - {noformat} int newRows =

[jira] [Commented] (HIVE-16082) Allow user to change number of listener thread in LlapTaskCommunicator

2017-03-01 Thread Rajesh Balamohan (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-16082?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15891525#comment-15891525 ] Rajesh Balamohan commented on HIVE-16082: - lgtm. +1 pending tests. > Allow user to change number

[jira] [Assigned] (HIVE-16044) LLAP: Shuffle Handler keep-alive connections are closed from the server side

2017-02-26 Thread Rajesh Balamohan (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-16044?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rajesh Balamohan reassigned HIVE-16044: --- > LLAP: Shuffle Handler keep-alive connections are closed from the server side >

[jira] [Updated] (HIVE-16044) LLAP: Shuffle Handler keep-alive connections are closed from the server side

2017-02-27 Thread Rajesh Balamohan (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-16044?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rajesh Balamohan updated HIVE-16044: Attachment: withPatch_llap_shuffleHanlder.png

[jira] [Updated] (HIVE-16044) LLAP: Shuffle Handler keep-alive connections are closed from the server side

2017-02-27 Thread Rajesh Balamohan (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-16044?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rajesh Balamohan updated HIVE-16044: Priority: Minor (was: Major) > LLAP: Shuffle Handler keep-alive connections are closed

[jira] [Updated] (HIVE-16044) LLAP: Shuffle Handler keep-alive connections are closed from the server side

2017-02-27 Thread Rajesh Balamohan (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-16044?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rajesh Balamohan updated HIVE-16044: Status: Patch Available (was: Open) > LLAP: Shuffle Handler keep-alive connections are

[jira] [Updated] (HIVE-14462) Reduce number of partition check calls in add_partitions

2016-08-23 Thread Rajesh Balamohan (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-14462?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rajesh Balamohan updated HIVE-14462: Status: Open (was: Patch Available) > Reduce number of partition check calls in

[jira] [Commented] (HIVE-14462) Reduce number of partition check calls in add_partitions

2016-08-23 Thread Rajesh Balamohan (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-14462?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15433088#comment-15433088 ] Rajesh Balamohan commented on HIVE-14462: - Looks like HIVE-14511 got committed and

[jira] [Updated] (HIVE-14462) Reduce number of partition check calls in add_partitions

2016-08-24 Thread Rajesh Balamohan (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-14462?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rajesh Balamohan updated HIVE-14462: Attachment: HIVE-14462.7.patch > Reduce number of partition check calls in add_partitions >

[jira] [Commented] (HIVE-14462) Reduce number of partition check calls in add_partitions

2016-08-24 Thread Rajesh Balamohan (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-14462?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15435929#comment-15435929 ] Rajesh Balamohan commented on HIVE-14462: - Thanks [~sershe]. Addressed in the recent patch. >

[jira] [Updated] (HIVE-14764) Enabling "hive.metastore.metrics.enabled" throws OOM in HiveMetastore

2016-09-15 Thread Rajesh Balamohan (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-14764?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rajesh Balamohan updated HIVE-14764: Attachment: HIVE-14764.1.patch \cc [~vgumashta] > Enabling

[jira] [Updated] (HIVE-14764) Enabling "hive.metastore.metrics.enabled" throws OOM in HiveMetastore

2016-09-15 Thread Rajesh Balamohan (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-14764?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rajesh Balamohan updated HIVE-14764: Status: Patch Available (was: Open) > Enabling "hive.metastore.metrics.enabled" throws OOM

[jira] [Updated] (HIVE-14920) S3: Optimize SimpleFetchOptimizer::checkThreshold()

2016-10-10 Thread Rajesh Balamohan (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-14920?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rajesh Balamohan updated HIVE-14920: Status: Patch Available (was: Open) > S3: Optimize SimpleFetchOptimizer::checkThreshold()

[jira] [Updated] (HIVE-14764) Enabling "hive.metastore.metrics.enabled" throws OOM in HiveMetastore

2016-09-15 Thread Rajesh Balamohan (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-14764?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rajesh Balamohan updated HIVE-14764: Attachment: hd_2.png hd_1.png > Enabling "hive.metastore.metrics.enabled"

[jira] [Commented] (HIVE-14776) Skip 'distcp' call when copying data from HDSF to S3

2016-09-18 Thread Rajesh Balamohan (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-14776?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15501920#comment-15501920 ] Rajesh Balamohan commented on HIVE-14776: - Have you tried with "--hiveconf fs.trash.interval=0"

[jira] [Comment Edited] (HIVE-14776) Skip 'distcp' call when copying data from HDSF to S3

2016-09-18 Thread Rajesh Balamohan (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-14776?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15501920#comment-15501920 ] Rajesh Balamohan edited comment on HIVE-14776 at 9/19/16 12:51 AM: --- Have

[jira] [Updated] (HIVE-14828) Cloud/S3: Stats publishing should be on HDFS instead of S3

2016-09-23 Thread Rajesh Balamohan (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-14828?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rajesh Balamohan updated HIVE-14828: Attachment: HIVE-14828.branch-1.2.001.patch For master branch, HIVE-14270 fixes for blob

[jira] [Comment Edited] (HIVE-14828) Cloud/S3: Stats publishing should be on HDFS instead of S3

2016-09-23 Thread Rajesh Balamohan (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-14828?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15515918#comment-15515918 ] Rajesh Balamohan edited comment on HIVE-14828 at 9/23/16 9:19 AM: -- For

[jira] [Comment Edited] (HIVE-14828) Cloud/S3: Stats publishing should be on HDFS instead of S3

2016-09-23 Thread Rajesh Balamohan (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-14828?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15515918#comment-15515918 ] Rajesh Balamohan edited comment on HIVE-14828 at 9/23/16 9:20 AM: -- For

[jira] [Updated] (HIVE-14828) Cloud/S3: Stats publishing should be on HDFS instead of S3

2016-09-23 Thread Rajesh Balamohan (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-14828?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rajesh Balamohan updated HIVE-14828: Affects Version/s: 1.2.0 > Cloud/S3: Stats publishing should be on HDFS instead of S3 >

[jira] [Updated] (HIVE-14803) S3: Stats gathering for insert queries can be expensive for partitioned dataset

2016-09-20 Thread Rajesh Balamohan (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-14803?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rajesh Balamohan updated HIVE-14803: Target Version/s: 2.2.0 Status: Patch Available (was: Open) > S3: Stats

[jira] [Updated] (HIVE-14803) S3: Stats gathering for insert queries can be expensive for partitioned dataset

2016-09-20 Thread Rajesh Balamohan (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-14803?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rajesh Balamohan updated HIVE-14803: Attachment: HIVE-14803.1.patch Observed 12% improvement in runtime with 100 partition

[jira] [Updated] (HIVE-14462) Reduce number of partition check calls in add_partitions

2016-08-24 Thread Rajesh Balamohan (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-14462?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rajesh Balamohan updated HIVE-14462: Status: Patch Available (was: Open) > Reduce number of partition check calls in

[jira] [Updated] (HIVE-14462) Reduce number of partition check calls in add_partitions

2016-08-24 Thread Rajesh Balamohan (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-14462?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rajesh Balamohan updated HIVE-14462: Attachment: HIVE-14462.6.patch > Reduce number of partition check calls in add_partitions >

[jira] [Updated] (HIVE-14462) Reduce number of partition check calls in add_partitions

2016-08-22 Thread Rajesh Balamohan (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-14462?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rajesh Balamohan updated HIVE-14462: Attachment: HIVE-14462.4.patch > Reduce number of partition check calls in add_partitions >

[jira] [Updated] (HIVE-14462) Reduce number of partition check calls in add_partitions

2016-08-25 Thread Rajesh Balamohan (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-14462?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rajesh Balamohan updated HIVE-14462: Attachment: HIVE-14462.8.patch > Reduce number of partition check calls in add_partitions >

[jira] [Commented] (HIVE-14462) Reduce number of partition check calls in add_partitions

2016-08-25 Thread Rajesh Balamohan (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-14462?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15438140#comment-15438140 ] Rajesh Balamohan commented on HIVE-14462: - [~ashutoshc] - I have reverted the metastore changes in

[jira] [Commented] (HIVE-14803) S3: Stats gathering for insert queries can be expensive for partitioned dataset

2016-10-09 Thread Rajesh Balamohan (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-14803?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15560780#comment-15560780 ] Rajesh Balamohan commented on HIVE-14803: - Thanks [~pxiong]. RB link.

[jira] [Updated] (HIVE-15069) Optimize MetaStoreDirectSql:: aggrColStatsForPartitions during query compilation

2016-10-27 Thread Rajesh Balamohan (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-15069?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rajesh Balamohan updated HIVE-15069: Attachment: HIVE-15069.3.patch > Optimize MetaStoreDirectSql:: aggrColStatsForPartitions

[jira] [Updated] (HIVE-15069) Optimize MetaStoreDirectSql:: aggrColStatsForPartitions during query compilation

2016-10-27 Thread Rajesh Balamohan (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-15069?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rajesh Balamohan updated HIVE-15069: Status: Patch Available (was: Open) > Optimize MetaStoreDirectSql::

[jira] [Updated] (HIVE-15069) Optimize MetaStoreDirectSql:: aggrColStatsForPartitions during query compilation

2016-10-27 Thread Rajesh Balamohan (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-15069?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rajesh Balamohan updated HIVE-15069: Status: Open (was: Patch Available) > Optimize MetaStoreDirectSql::

[jira] [Updated] (HIVE-15069) Optimize MetaStoreDirectSql:: aggrColStatsForPartitions during query compilation

2016-10-26 Thread Rajesh Balamohan (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-15069?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rajesh Balamohan updated HIVE-15069: Attachment: HIVE-15069.2.patch > Optimize MetaStoreDirectSql:: aggrColStatsForPartitions

[jira] [Updated] (HIVE-15069) Optimize MetaStoreDirectSql:: aggrColStatsForPartitions during query compilation

2016-10-26 Thread Rajesh Balamohan (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-15069?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rajesh Balamohan updated HIVE-15069: Status: Patch Available (was: Open) > Optimize MetaStoreDirectSql::

[jira] [Updated] (HIVE-15129) LLAP : Enhance cache hits for stripe metadata across queries

2016-11-07 Thread Rajesh Balamohan (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-15129?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rajesh Balamohan updated HIVE-15129: Attachment: HIVE-15129.2.patch Footer information can be reused in {{loadMissingIndexes}}

[jira] [Commented] (HIVE-15138) String + Integer gets converted to UDFToDouble causing number format exceptions

2016-11-07 Thread Rajesh Balamohan (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-15138?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15643514#comment-15643514 ] Rajesh Balamohan commented on HIVE-15138: - Yeah, HIVE-5021 would be needed for better handling of

[jira] [Commented] (HIVE-15129) LLAP : Enhance cache hits for stripe metadata across queries

2016-11-06 Thread Rajesh Balamohan (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-15129?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15642719#comment-15642719 ] Rajesh Balamohan commented on HIVE-15129: - Thanks [~sershe]. Test failures are not related to this

[jira] [Commented] (HIVE-15038) Reuse OrcTail in OrcEncodedDataReader::ReaderOptions in Llap

2016-11-06 Thread Rajesh Balamohan (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-15038?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15642890#comment-15642890 ] Rajesh Balamohan commented on HIVE-15038: - Thanks [~sershe]. Test failures are unrelated to this

[jira] [Comment Edited] (HIVE-15038) Reuse OrcTail in OrcEncodedDataReader::ReaderOptions in Llap

2016-11-06 Thread Rajesh Balamohan (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-15038?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15642890#comment-15642890 ] Rajesh Balamohan edited comment on HIVE-15038 at 11/7/16 2:43 AM: -- Thanks

<    1   2   3   4   5   6   7   8   9   10   >