[jira] [Updated] (HIVE-17036) Lineage: Minor CPU/Mem optimization for lineage transform

2017-07-05 Thread Rajesh Balamohan (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-17036?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rajesh Balamohan updated HIVE-17036: Attachment: prof_1.png prof_2.png > Lineage: Minor CPU/Mem optimization for

[jira] [Updated] (HIVE-17036) Lineage: Minor CPU/Mem optimization for lineage transform

2017-07-05 Thread Rajesh Balamohan (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-17036?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rajesh Balamohan updated HIVE-17036: Issue Type: Improvement (was: Bug) > Lineage: Minor CPU/Mem optimization for lineage

[jira] [Comment Edited] (HIVE-17012) ACID Table: Number of reduce tasks should be computed correctly when sort.dynamic.partition is enabled

2017-07-05 Thread Rajesh Balamohan (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-17012?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16071990#comment-16071990 ] Rajesh Balamohan edited comment on HIVE-17012 at 7/5/17 8:55 AM: -

[jira] [Comment Edited] (HIVE-17012) ACID Table: Number of reduce tasks should be computed correctly when sort.dynamic.partition is enabled

2017-07-05 Thread Rajesh Balamohan (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-17012?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16071990#comment-16071990 ] Rajesh Balamohan edited comment on HIVE-17012 at 7/5/17 8:54 AM: -

[jira] [Updated] (HIVE-17035) Optimizer: Lineage transform() should be invoked after rest of the optimizers are invoked

2017-07-05 Thread Rajesh Balamohan (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-17035?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rajesh Balamohan updated HIVE-17035: Attachment: HIVE-17035.1.patch \cc [~jcamachorodriguez], [~ashutoshc] > Optimizer: Lineage

[jira] [Updated] (HIVE-17035) Optimizer: Lineage transform() should be invoked after rest of the optimizers are invoked

2017-07-05 Thread Rajesh Balamohan (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-17035?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rajesh Balamohan updated HIVE-17035: Assignee: Rajesh Balamohan Status: Patch Available (was: Open) > Optimizer: Lineage

[jira] [Updated] (HIVE-17011) PlanUtils.getExprList() causes memory pressure when invoked from SharedWorkOptimizer on queries with lots of union operators

2017-07-03 Thread Rajesh Balamohan (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-17011?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rajesh Balamohan updated HIVE-17011: Attachment: HIVE-17011.3.patch Thanks [~jcamachorodriguez]. Attaching .2 patch with

[jira] [Comment Edited] (HIVE-17011) PlanUtils.getExprList() causes memory pressure when invoked from SharedWorkOptimizer on queries with lots of union operators

2017-07-03 Thread Rajesh Balamohan (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-17011?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16072357#comment-16072357 ] Rajesh Balamohan edited comment on HIVE-17011 at 7/3/17 12:37 PM: -- Thanks

[jira] [Commented] (HIVE-17012) ACID Table: Number of reduce tasks should be computed correctly when sort.dynamic.partition is enabled

2017-07-03 Thread Rajesh Balamohan (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-17012?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16071990#comment-16071990 ] Rajesh Balamohan commented on HIVE-17012: - ReducerTraits would be FIXED for ACID tables with

[jira] [Updated] (HIVE-17012) ACID Table: Number of reduce tasks should be computed correctly when sort.dynamic.partition is enabled

2017-07-03 Thread Rajesh Balamohan (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-17012?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rajesh Balamohan updated HIVE-17012: Attachment: plan.txt > ACID Table: Number of reduce tasks should be computed correctly when

[jira] [Updated] (HIVE-17011) PlanUtils.getExprList() causes memory pressure when invoked from SharedWorkOptimizer on queries with lots of union operators

2017-07-02 Thread Rajesh Balamohan (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-17011?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rajesh Balamohan updated HIVE-17011: Priority: Minor (was: Major) > PlanUtils.getExprList() causes memory pressure when invoked

[jira] [Updated] (HIVE-17011) PlanUtils.getExprList() causes memory pressure when invoked from SharedWorkOptimizer on queries with lots of union operators

2017-07-02 Thread Rajesh Balamohan (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-17011?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rajesh Balamohan updated HIVE-17011: Attachment: HIVE-17011.1.patch Attaching .1 patch. Tested on a query which had 100s of

[jira] [Updated] (HIVE-17011) PlanUtils.getExprList() causes memory pressure when invoked from SharedWorkOptimizer on queries with lots of union operators

2017-07-02 Thread Rajesh Balamohan (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-17011?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rajesh Balamohan updated HIVE-17011: Status: Patch Available (was: Open) > PlanUtils.getExprList() causes memory pressure when

[jira] [Updated] (HIVE-17011) PlanUtils.getExprList() causes memory pressure when invoked from SharedWorkOptimizer on queries with lots of union operators

2017-07-02 Thread Rajesh Balamohan (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-17011?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rajesh Balamohan updated HIVE-17011: Attachment: CPU_usage.png Memory_usage.png > PlanUtils.getExprList() causes

[jira] [Commented] (HIVE-16987) Llap: StackOverFlow in EvictionDispatcher:notifyEvicted

2017-06-29 Thread Rajesh Balamohan (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-16987?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16067817#comment-16067817 ] Rajesh Balamohan commented on HIVE-16987: - LGTM. +1 > Llap: StackOverFlow in

[jira] [Updated] (HIVE-16903) LLAP: Fix config name issue in SHUFFLE_MANAGE_OS_CACHE

2017-06-14 Thread Rajesh Balamohan (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-16903?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rajesh Balamohan updated HIVE-16903: Resolution: Fixed Hadoop Flags: Reviewed Fix Version/s: 3.0.0 Status:

[jira] [Assigned] (HIVE-16903) LLAP: Fix config name issue in SHUFFLE_MANAGE_OS_CACHE

2017-06-14 Thread Rajesh Balamohan (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-16903?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rajesh Balamohan reassigned HIVE-16903: --- Assignee: Rajesh Balamohan > LLAP: Fix config name issue in SHUFFLE_MANAGE_OS_CACHE

[jira] [Updated] (HIVE-16903) LLAP: Fix config name issue in SHUFFLE_MANAGE_OS_CACHE

2017-06-14 Thread Rajesh Balamohan (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-16903?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rajesh Balamohan updated HIVE-16903: Attachment: HIVE-16903.1.patch \cc [~sseth]. > LLAP: Fix config name issue in

[jira] [Updated] (HIVE-16903) LLAP: Fix config name issue in SHUFFLE_MANAGE_OS_CACHE

2017-06-14 Thread Rajesh Balamohan (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-16903?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rajesh Balamohan updated HIVE-16903: Status: Patch Available (was: Open) > LLAP: Fix config name issue in

[jira] [Updated] (HIVE-16903) LLAP: Fix config name issue in SHUFFLE_MANAGE_OS_CACHE

2017-06-14 Thread Rajesh Balamohan (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-16903?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rajesh Balamohan updated HIVE-16903: Component/s: llap > LLAP: Fix config name issue in SHUFFLE_MANAGE_OS_CACHE >

[jira] [Commented] (HIVE-16323) HS2 JDOPersistenceManagerFactory.pmCache leaks after HIVE-14204

2017-06-05 Thread Rajesh Balamohan (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-16323?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16037800#comment-16037800 ] Rajesh Balamohan commented on HIVE-16323: - SynchronizedMetaStoreClient is used only in

[jira] [Updated] (HIVE-15300) Reuse table information in SemanticAnalyzer::getMetaData to reduce compilation time

2017-05-25 Thread Rajesh Balamohan (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-15300?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rajesh Balamohan updated HIVE-15300: Resolution: Fixed Hadoop Flags: Reviewed Fix Version/s: 3.0.0 Status:

[jira] [Updated] (HIVE-15300) Reuse table information in SemanticAnalyzer::getMetaData to reduce compilation time

2017-05-24 Thread Rajesh Balamohan (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-15300?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rajesh Balamohan updated HIVE-15300: Attachment: HIVE-15300.5.patch Reuploading the patch with minor fix (i.e adding to cache

[jira] [Updated] (HIVE-16746) Reduce number of index lookups for same table in IndexWhereTaskDispatcher

2017-05-24 Thread Rajesh Balamohan (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-16746?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rajesh Balamohan updated HIVE-16746: Resolution: Fixed Hadoop Flags: Reviewed Fix Version/s: 3.0.0 Status:

[jira] [Commented] (HIVE-16746) Reduce number of index lookups for same table in IndexWhereTaskDispatcher

2017-05-24 Thread Rajesh Balamohan (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-16746?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16022552#comment-16022552 ] Rajesh Balamohan commented on HIVE-16746: - RB: https://reviews.apache.org/r/59517/ > Reduce

[jira] [Commented] (HIVE-16746) Reduce number of index lookups for same table in IndexWhereTaskDispatcher

2017-05-24 Thread Rajesh Balamohan (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-16746?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16022540#comment-16022540 ] Rajesh Balamohan commented on HIVE-16746: - test failures are not related to this patch. > Reduce

[jira] [Assigned] (HIVE-16746) Reduce number of index lookups for same table in IndexWhereTaskDispatcher

2017-05-23 Thread Rajesh Balamohan (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-16746?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rajesh Balamohan reassigned HIVE-16746: --- Assignee: Rajesh Balamohan > Reduce number of index lookups for same table in

[jira] [Updated] (HIVE-16746) Reduce number of index lookups for same table in IndexWhereTaskDispatcher

2017-05-23 Thread Rajesh Balamohan (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-16746?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rajesh Balamohan updated HIVE-16746: Attachment: HIVE-16746.1.patch With patch, response time came down from 185 seconds to

[jira] [Updated] (HIVE-16746) Reduce number of index lookups for same table in IndexWhereTaskDispatcher

2017-05-23 Thread Rajesh Balamohan (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-16746?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rajesh Balamohan updated HIVE-16746: Status: Patch Available (was: Open) > Reduce number of index lookups for same table in

[jira] [Updated] (HIVE-15300) Reuse table information in SemanticAnalyzer::getMetaData to reduce compilation time

2017-05-23 Thread Rajesh Balamohan (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-15300?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rajesh Balamohan updated HIVE-15300: Attachment: HIVE-15300.4.patch Rebasing the patch with minor fixes. This is mainly for

[jira] [Commented] (HIVE-16737) LLAP: Shuffle handler TCP listen queue overflows

2017-05-23 Thread Rajesh Balamohan (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-16737?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16022142#comment-16022142 ] Rajesh Balamohan commented on HIVE-16737: - +1. LGTM. > LLAP: Shuffle handler TCP listen queue

[jira] [Commented] (HIVE-16737) LLAP: Shuffle handler TCP listen queue overflows

2017-05-23 Thread Rajesh Balamohan (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-16737?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16022086#comment-16022086 ] Rajesh Balamohan commented on HIVE-16737: - Minor: would be nice to add backlog detail in the log

[jira] [Updated] (HIVE-16692) LLAP: Keep alive connection in shuffle handler should not be closed until entire data is flushed out

2017-05-18 Thread Rajesh Balamohan (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-16692?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rajesh Balamohan updated HIVE-16692: Attachment: HIVE-16692.addendum.patch Thanks [~sseth]. Realized that there is a minor

[jira] [Updated] (HIVE-16692) LLAP: Keep alive connection in shuffle handler should not be closed until entire data is flushed out

2017-05-17 Thread Rajesh Balamohan (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-16692?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rajesh Balamohan updated HIVE-16692: Status: Patch Available (was: Open) > LLAP: Keep alive connection in shuffle handler

[jira] [Assigned] (HIVE-16692) LLAP: Keep alive connection in shuffle handler should not be closed until entire data is flushed out

2017-05-17 Thread Rajesh Balamohan (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-16692?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rajesh Balamohan reassigned HIVE-16692: --- Assignee: Rajesh Balamohan > LLAP: Keep alive connection in shuffle handler should

[jira] [Updated] (HIVE-16692) LLAP: Keep alive connection in shuffle handler should not be closed until entire data is flushed out

2017-05-17 Thread Rajesh Balamohan (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-16692?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rajesh Balamohan updated HIVE-16692: Attachment: HIVE-16692.1.patch > LLAP: Keep alive connection in shuffle handler should not

[jira] [Resolved] (HIVE-15942) Q22 does not get vectorized due to grouping set evaluations

2017-05-04 Thread Rajesh Balamohan (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-15942?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rajesh Balamohan resolved HIVE-15942. - Resolution: Fixed Checked with apache master. {{Map 1}} gets vectorized now with Q22.

[jira] [Commented] (HIVE-16548) LLAP: EncodedReaderImpl.addOneCompressionBuffer throws NPE

2017-04-27 Thread Rajesh Balamohan (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-16548?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15988194#comment-15988194 ] Rajesh Balamohan commented on HIVE-16548: - This happened as a part of regular data population

[jira] [Commented] (HIVE-16353) Jetty 9 upgrade breaks hive master which is 2.3.0-snapshot

2017-04-24 Thread Rajesh Balamohan (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-16353?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15982369#comment-15982369 ] Rajesh Balamohan commented on HIVE-16353: - Thanks [~gopalv]. Patch lgtm. +1. > Jetty 9 upgrade

[jira] [Commented] (HIVE-16436) Response times in "Task Execution Summary" at the end of the job is not correct

2017-04-13 Thread Rajesh Balamohan (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-16436?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15968393#comment-15968393 ] Rajesh Balamohan commented on HIVE-16436: - [~prasanth_j] - I have not seen negative values in the

[jira] [Comment Edited] (HIVE-16436) Response times in "Task Execution Summary" at the end of the job is not correct

2017-04-13 Thread Rajesh Balamohan (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-16436?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15967338#comment-15967338 ] Rajesh Balamohan edited comment on HIVE-16436 at 4/13/17 9:28 AM: --

[jira] [Updated] (HIVE-16436) Response times in "Task Execution Summary" at the end of the job is not correct

2017-04-13 Thread Rajesh Balamohan (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-16436?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rajesh Balamohan updated HIVE-16436: Status: Patch Available (was: Open) > Response times in "Task Execution Summary" at the

[jira] [Commented] (HIVE-16436) Response times in "Task Execution Summary" at the end of the job is not correct

2017-04-13 Thread Rajesh Balamohan (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-16436?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15967338#comment-15967338 ] Rajesh Balamohan commented on HIVE-16436: - {{perfLogger.PerfLogEnd}} was getting invoked for every

[jira] [Assigned] (HIVE-16436) Response times in "Task Execution Summary" at the end of the job is not correct

2017-04-13 Thread Rajesh Balamohan (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-16436?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rajesh Balamohan reassigned HIVE-16436: --- Assignee: Rajesh Balamohan > Response times in "Task Execution Summary" at the end

[jira] [Updated] (HIVE-16436) Response times in "Task Execution Summary" at the end of the job is not correct

2017-04-13 Thread Rajesh Balamohan (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-16436?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rajesh Balamohan updated HIVE-16436: Attachment: HIVE-16436.1.patch > Response times in "Task Execution Summary" at the end of

[jira] [Updated] (HIVE-16044) LLAP: Shuffle Handler keep-alive connections are closed from the server side

2017-04-12 Thread Rajesh Balamohan (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-16044?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rajesh Balamohan updated HIVE-16044: Resolution: Fixed Fix Version/s: 3.0.0 Status: Resolved (was: Patch

[jira] [Updated] (HIVE-16406) Remove unwanted interning when creating PartitionDesc

2017-04-07 Thread Rajesh Balamohan (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-16406?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rajesh Balamohan updated HIVE-16406: Attachment: HIVE-16406.profiler.png HIVE-16406.2.patch > Remove unwanted

[jira] [Updated] (HIVE-16406) Remove unwanted interning when creating PartitionDesc

2017-04-07 Thread Rajesh Balamohan (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-16406?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rajesh Balamohan updated HIVE-16406: Attachment: (was: HIVE-16406.profiler.png) > Remove unwanted interning when creating

[jira] [Updated] (HIVE-16406) Remove unwanted interning when creating PartitionDesc

2017-04-07 Thread Rajesh Balamohan (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-16406?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rajesh Balamohan updated HIVE-16406: Status: Patch Available (was: Open) > Remove unwanted interning when creating

[jira] [Updated] (HIVE-16406) Remove unwanted interning when creating PartitionDesc

2017-04-07 Thread Rajesh Balamohan (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-16406?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rajesh Balamohan updated HIVE-16406: Attachment: HIVE-16406.1.patch > Remove unwanted interning when creating PartitionDesc >

[jira] [Updated] (HIVE-16406) Remove unwanted interning when creating PartitionDesc

2017-04-07 Thread Rajesh Balamohan (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-16406?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rajesh Balamohan updated HIVE-16406: Attachment: HIVE-16406.profiler.png > Remove unwanted interning when creating PartitionDesc

[jira] [Updated] (HIVE-16290) Stats: StatsRulesProcFactory::evaluateComparator estimates are wrong when minValue == filterValue

2017-04-02 Thread Rajesh Balamohan (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-16290?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rajesh Balamohan updated HIVE-16290: Resolution: Fixed Hadoop Flags: Reviewed Fix Version/s: 2.3.0 Status:

[jira] [Updated] (HIVE-16290) Stats: StatsRulesProcFactory::evaluateComparator estimates are wrong when minValue == filterValue

2017-03-24 Thread Rajesh Balamohan (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-16290?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rajesh Balamohan updated HIVE-16290: Status: Patch Available (was: Open) > Stats: StatsRulesProcFactory::evaluateComparator

[jira] [Updated] (HIVE-16290) Stats: StatsRulesProcFactory::evaluateComparator estimates are wrong when minValue == filterValue

2017-03-24 Thread Rajesh Balamohan (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-16290?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rajesh Balamohan updated HIVE-16290: Description: Issue: = In {{StatsRulesProcFactory::evaluateCompator}}, when

[jira] [Updated] (HIVE-16290) Stats: StatsRulesProcFactory::evaluateComparator estimates are wrong when minValue == filterValue

2017-03-24 Thread Rajesh Balamohan (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-16290?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rajesh Balamohan updated HIVE-16290: Attachment: HIVE-16290.1.patch > Stats: StatsRulesProcFactory::evaluateComparator estimates

[jira] [Commented] (HIVE-16252) Vectorization: Cannot vectorize: Aggregation Function UDF avg

2017-03-21 Thread Rajesh Balamohan (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-16252?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15934887#comment-15934887 ] Rajesh Balamohan commented on HIVE-16252: - Observed slow performance with this query as opposed to

[jira] [Commented] (HIVE-16208) Vectorization: ProcessingModeHashAggregate::sumBatchSize is never reset

2017-03-17 Thread Rajesh Balamohan (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-16208?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15929844#comment-15929844 ] Rajesh Balamohan commented on HIVE-16208: - +1. > Vectorization:

[jira] [Commented] (HIVE-16150) LLAP: HiveInputFormat:getRecordReader: Fix log statements to reduce memory pressure

2017-03-08 Thread Rajesh Balamohan (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-16150?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15902119#comment-15902119 ] Rajesh Balamohan commented on HIVE-16150: - lgtm. +1. Thanks [~prasanth_j]. "LOG.info("Not using

[jira] [Commented] (HIVE-16142) ATSHook NPE via LLAP

2017-03-07 Thread Rajesh Balamohan (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-16142?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15900603#comment-15900603 ] Rajesh Balamohan commented on HIVE-16142: - Is HIVE-16066 similar to this one? > ATSHook NPE via

[jira] [Commented] (HIVE-16078) improve abort checking in Tez/LLAP

2017-03-07 Thread Rajesh Balamohan (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-16078?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15898976#comment-15898976 ] Rajesh Balamohan commented on HIVE-16078: - lgtm. +1. > improve abort checking in Tez/LLAP >

[jira] [Updated] (HIVE-16116) Beeline throws NPE when beeline.hiveconfvariables={} in beeline.properties

2017-03-06 Thread Rajesh Balamohan (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-16116?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rajesh Balamohan updated HIVE-16116: Attachment: HIVE-16116.2.patch Thanks [~pvary]. Yes, it affects {{setHiveVariables}} as

[jira] [Updated] (HIVE-16116) Beeline throws NPE when beeline.hiveconfvariables={} in beeline.properties

2017-03-05 Thread Rajesh Balamohan (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-16116?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rajesh Balamohan updated HIVE-16116: Attachment: HIVE-16116.1.patch {{BeelineOpts.hiveConfVariables}} is set to null when it

[jira] [Comment Edited] (HIVE-16116) Beeline throws NPE when beeline.hiveconfvariables={} in beeline.properties

2017-03-05 Thread Rajesh Balamohan (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-16116?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15896792#comment-15896792 ] Rajesh Balamohan edited comment on HIVE-16116 at 3/6/17 6:26 AM: -

[jira] [Updated] (HIVE-16116) Beeline throws NPE when beeline.hiveconfvariables={} in beeline.properties

2017-03-05 Thread Rajesh Balamohan (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-16116?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rajesh Balamohan updated HIVE-16116: Status: Patch Available (was: Open) > Beeline throws NPE when beeline.hiveconfvariables={}

[jira] [Assigned] (HIVE-16116) Beeline throws NPE when beeline.hiveconfvariables={} in beeline.properties

2017-03-05 Thread Rajesh Balamohan (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-16116?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rajesh Balamohan reassigned HIVE-16116: --- > Beeline throws NPE when beeline.hiveconfvariables={} in beeline.properties >

[jira] [Commented] (HIVE-16078) improve abort checking in Tez/LLAP

2017-03-01 Thread Rajesh Balamohan (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-16078?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15891566#comment-15891566 ] Rajesh Balamohan commented on HIVE-16078: - {noformat} int newRows =

[jira] [Commented] (HIVE-16082) Allow user to change number of listener thread in LlapTaskCommunicator

2017-03-01 Thread Rajesh Balamohan (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-16082?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15891525#comment-15891525 ] Rajesh Balamohan commented on HIVE-16082: - lgtm. +1 pending tests. > Allow user to change number

[jira] [Commented] (HIVE-16066) NPE in ExplainTask

2017-02-28 Thread Rajesh Balamohan (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-16066?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15889337#comment-15889337 ] Rajesh Balamohan commented on HIVE-16066: - This is not part of explain formatted or explain

[jira] [Updated] (HIVE-16044) LLAP: Shuffle Handler keep-alive connections are closed from the server side

2017-02-27 Thread Rajesh Balamohan (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-16044?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rajesh Balamohan updated HIVE-16044: Attachment: HIVE-16044.2.patch Uploading same patch. > LLAP: Shuffle Handler keep-alive

[jira] [Updated] (HIVE-16044) LLAP: Shuffle Handler keep-alive connections are closed from the server side

2017-02-27 Thread Rajesh Balamohan (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-16044?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rajesh Balamohan updated HIVE-16044: Status: Patch Available (was: Open) > LLAP: Shuffle Handler keep-alive connections are

[jira] [Updated] (HIVE-16044) LLAP: Shuffle Handler keep-alive connections are closed from the server side

2017-02-27 Thread Rajesh Balamohan (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-16044?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rajesh Balamohan updated HIVE-16044: Priority: Minor (was: Major) > LLAP: Shuffle Handler keep-alive connections are closed

[jira] [Updated] (HIVE-16044) LLAP: Shuffle Handler keep-alive connections are closed from the server side

2017-02-27 Thread Rajesh Balamohan (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-16044?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rajesh Balamohan updated HIVE-16044: Attachment: withPatch_llap_shuffleHanlder.png

[jira] [Assigned] (HIVE-16044) LLAP: Shuffle Handler keep-alive connections are closed from the server side

2017-02-26 Thread Rajesh Balamohan (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-16044?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rajesh Balamohan reassigned HIVE-16044: --- > LLAP: Shuffle Handler keep-alive connections are closed from the server side >

[jira] [Commented] (HIVE-15879) Fix HiveMetaStoreChecker.checkPartitionDirs method

2017-02-24 Thread Rajesh Balamohan (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-15879?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15882640#comment-15882640 ] Rajesh Balamohan commented on HIVE-15879: - >>> it returns only approximate number of threads and

[jira] [Comment Edited] (HIVE-15879) Fix HiveMetaStoreChecker.checkPartitionDirs method

2017-02-23 Thread Rajesh Balamohan (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-15879?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15881827#comment-15881827 ] Rajesh Balamohan edited comment on HIVE-15879 at 2/24/17 2:53 AM: -- Thanks

[jira] [Commented] (HIVE-15879) Fix HiveMetaStoreChecker.checkPartitionDirs method

2017-02-23 Thread Rajesh Balamohan (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-15879?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15881827#comment-15881827 ] Rajesh Balamohan commented on HIVE-15879: - Thanks for sharing the details [~vihangk1]. I have a

[jira] [Commented] (HIVE-15964) LLAP: Llap IO codepath not getting invoked due to file column id mismatch

2017-02-23 Thread Rajesh Balamohan (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-15964?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15881701#comment-15881701 ] Rajesh Balamohan commented on HIVE-15964: - committed the addendum patch in master. > LLAP: Llap

[jira] [Updated] (HIVE-15964) LLAP: Llap IO codepath not getting invoked due to file column id mismatch

2017-02-23 Thread Rajesh Balamohan (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-15964?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rajesh Balamohan updated HIVE-15964: Attachment: HIVE-15964.addendum.patch Yes [~prasanth_j]. Attaching the addendum patch for

[jira] [Updated] (HIVE-16020) LLAP : Reduce IPC connection misses

2017-02-23 Thread Rajesh Balamohan (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-16020?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rajesh Balamohan updated HIVE-16020: Resolution: Fixed Fix Version/s: 2.2.0 Status: Resolved (was: Patch

[jira] [Updated] (HIVE-15964) LLAP: Llap IO codepath not getting invoked due to file column id mismatch

2017-02-23 Thread Rajesh Balamohan (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-15964?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rajesh Balamohan updated HIVE-15964: Resolution: Fixed Hadoop Flags: Reviewed Fix Version/s: 2.2.0 Status:

[jira] [Updated] (HIVE-15964) LLAP: Llap IO codepath not getting invoked due to file column id mismatch

2017-02-23 Thread Rajesh Balamohan (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-15964?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rajesh Balamohan updated HIVE-15964: Attachment: HIVE-15964.4.patch > LLAP: Llap IO codepath not getting invoked due to file

[jira] [Commented] (HIVE-16014) HiveMetastoreChecker should use hive.metastore.fshandler.threads instead of hive.mv.files.thread for pool size

2017-02-23 Thread Rajesh Balamohan (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-16014?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15880136#comment-15880136 ] Rajesh Balamohan commented on HIVE-16014: - Thanks for creating this jira. Proposed change sounds

[jira] [Updated] (HIVE-15964) LLAP: Llap IO codepath not getting invoked due to file column id mismatch

2017-02-22 Thread Rajesh Balamohan (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-15964?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rajesh Balamohan updated HIVE-15964: Attachment: HIVE-15964.3.patch addressing review comments from [~prasanth_j]. Added -ve

[jira] [Updated] (HIVE-16020) LLAP : Reduce IPC connection misses

2017-02-22 Thread Rajesh Balamohan (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-16020?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rajesh Balamohan updated HIVE-16020: Attachment: HIVE-16020.1.patch Changes: 1. Common SocketFactory passed to

[jira] [Updated] (HIVE-16020) LLAP : Reduce IPC connection misses

2017-02-22 Thread Rajesh Balamohan (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-16020?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rajesh Balamohan updated HIVE-16020: Status: Patch Available (was: Open) > LLAP : Reduce IPC connection misses >

[jira] [Updated] (HIVE-15992) LLAP: NPE in LlapTaskCommunicator.getCompletedLogsUrl for unsuccessful attempt

2017-02-20 Thread Rajesh Balamohan (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-15992?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rajesh Balamohan updated HIVE-15992: Status: Patch Available (was: Open) > LLAP: NPE in

[jira] [Updated] (HIVE-15992) LLAP: NPE in LlapTaskCommunicator.getCompletedLogsUrl for unsuccessful attempt

2017-02-20 Thread Rajesh Balamohan (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-15992?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rajesh Balamohan updated HIVE-15992: Attachment: HIVE-15992.1.patch > LLAP: NPE in LlapTaskCommunicator.getCompletedLogsUrl for

[jira] [Updated] (HIVE-15941) Fix o.a.h.hive.ql.exec.tez.TezTask compilation issue with tez master

2017-02-19 Thread Rajesh Balamohan (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-15941?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rajesh Balamohan updated HIVE-15941: Resolution: Fixed Hadoop Flags: Reviewed Fix Version/s: 2.2.0 Status:

[jira] [Updated] (HIVE-15964) LLAP: Llap IO codepath not getting invoked due to file column id mismatch

2017-02-17 Thread Rajesh Balamohan (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-15964?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rajesh Balamohan updated HIVE-15964: Attachment: HIVE-15964.2.patch Thanks [~sershe]. Attaching .2 version. Removed isAcidScan

[jira] [Updated] (HIVE-15964) LLAP: Llap IO codepath not getting invoked due to file column id mismatch

2017-02-17 Thread Rajesh Balamohan (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-15964?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rajesh Balamohan updated HIVE-15964: Status: Patch Available (was: Open) > LLAP: Llap IO codepath not getting invoked due to

[jira] [Updated] (HIVE-15964) LLAP: Llap IO codepath not getting invoked due to file column id mismatch

2017-02-17 Thread Rajesh Balamohan (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-15964?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rajesh Balamohan updated HIVE-15964: Attachment: HIVE-15964.1.patch \cc [~prasanth_j] > LLAP: Llap IO codepath not getting

[jira] [Assigned] (HIVE-15964) LLAP: Llap IO codepath not getting invoked due to file column id mismatch

2017-02-17 Thread Rajesh Balamohan (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-15964?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rajesh Balamohan reassigned HIVE-15964: --- > LLAP: Llap IO codepath not getting invoked due to file column id mismatch >

[jira] [Updated] (HIVE-15964) LLAP: Llap IO codepath not getting invoked due to file column id mismatch

2017-02-17 Thread Rajesh Balamohan (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-15964?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rajesh Balamohan updated HIVE-15964: Component/s: llap > LLAP: Llap IO codepath not getting invoked due to file column id

[jira] [Commented] (HIVE-15942) Q22 does not get vectorized due to grouping set evaluations

2017-02-16 Thread Rajesh Balamohan (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-15942?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15871029#comment-15871029 ] Rajesh Balamohan commented on HIVE-15942: - Mostly should get fixed with HIVE-14016. Need to check

[jira] [Updated] (HIVE-15942) Q22 does not get vectorized due to grouping set evaluations

2017-02-16 Thread Rajesh Balamohan (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-15942?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rajesh Balamohan updated HIVE-15942: Attachment: query_plan_q22_HIVE-15942.txt > Q22 does not get vectorized due to grouping set

[jira] [Updated] (HIVE-15941) Fix o.a.h.hive.ql.exec.tez.TezTask compilation issue with tez master

2017-02-16 Thread Rajesh Balamohan (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-15941?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rajesh Balamohan updated HIVE-15941: Summary: Fix o.a.h.hive.ql.exec.tez.TezTask compilation issue with tez master (was: Fix

[jira] [Updated] (HIVE-15941) Fix TezTask compilation issue with tez master

2017-02-16 Thread Rajesh Balamohan (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-15941?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rajesh Balamohan updated HIVE-15941: Status: Patch Available (was: Open) > Fix TezTask compilation issue with tez master >

[jira] [Commented] (HIVE-15941) Fix TezTask compilation issue with tez master

2017-02-16 Thread Rajesh Balamohan (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-15941?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15869519#comment-15869519 ] Rajesh Balamohan commented on HIVE-15941: - Reported by [~anishek] > Fix TezTask compilation issue

[jira] [Updated] (HIVE-15941) Fix TezTask compilation issue with tez master

2017-02-16 Thread Rajesh Balamohan (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-15941?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rajesh Balamohan updated HIVE-15941: Attachment: HIVE-15941.1.patch > Fix TezTask compilation issue with tez master >

[jira] [Assigned] (HIVE-15941) Fix TezTask compilation issue with tez master

2017-02-16 Thread Rajesh Balamohan (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-15941?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rajesh Balamohan reassigned HIVE-15941: --- > Fix TezTask compilation issue with tez master >

<    3   4   5   6   7   8   9   10   11   12   >