[jira] [Updated] (HIVE-23488) Optimise PartitionManagementTask::Msck::repair

2020-05-17 Thread Rajesh Balamohan (Jira)
[ https://issues.apache.org/jira/browse/HIVE-23488?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rajesh Balamohan updated HIVE-23488: Assignee: Rajesh Balamohan Status: Patch Available (was: Open) > Optimise

[jira] [Updated] (HIVE-23487) Optimise PartitionManagementTask

2020-05-17 Thread Rajesh Balamohan (Jira)
[ https://issues.apache.org/jira/browse/HIVE-23487?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rajesh Balamohan updated HIVE-23487: Attachment: HIVE-23487.1.patch > Optimise PartitionManagementTask >

[jira] [Updated] (HIVE-23487) Optimise PartitionManagementTask

2020-05-17 Thread Rajesh Balamohan (Jira)
[ https://issues.apache.org/jira/browse/HIVE-23487?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rajesh Balamohan updated HIVE-23487: Assignee: Rajesh Balamohan Status: Patch Available (was: Open) > Optimise

[jira] [Updated] (HIVE-23468) LLAP: Optimise OrcEncodedDataReader to avoid FS init to NN

2020-05-14 Thread Rajesh Balamohan (Jira)
[ https://issues.apache.org/jira/browse/HIVE-23468?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rajesh Balamohan updated HIVE-23468: Attachment: HIVE-23468.1.patch > LLAP: Optimise OrcEncodedDataReader to avoid FS init to

[jira] [Updated] (HIVE-23468) LLAP: Optimise OrcEncodedDataReader to avoid FS init to NN

2020-05-14 Thread Rajesh Balamohan (Jira)
[ https://issues.apache.org/jira/browse/HIVE-23468?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rajesh Balamohan updated HIVE-23468: Status: Patch Available (was: Open) > LLAP: Optimise OrcEncodedDataReader to avoid FS

[jira] [Updated] (HIVE-23446) LLAP: Reduce IPC connection misses to AM for short queries

2020-05-14 Thread Rajesh Balamohan (Jira)
[ https://issues.apache.org/jira/browse/HIVE-23446?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rajesh Balamohan updated HIVE-23446: Attachment: HIVE-23446.3.patch > LLAP: Reduce IPC connection misses to AM for short

[jira] [Updated] (HIVE-23446) LLAP: Reduce IPC connection misses to AM for short queries

2020-05-13 Thread Rajesh Balamohan (Jira)
[ https://issues.apache.org/jira/browse/HIVE-23446?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rajesh Balamohan updated HIVE-23446: Attachment: HIVE-23446.2.patch > LLAP: Reduce IPC connection misses to AM for short

[jira] [Commented] (HIVE-23451) FileSinkOperator calls deleteOnExit (hdfs call) twice for the same file

2020-05-12 Thread Rajesh Balamohan (Jira)
[ https://issues.apache.org/jira/browse/HIVE-23451?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17105941#comment-17105941 ] Rajesh Balamohan commented on HIVE-23451: - I had the same confusion on this codepath on the

[jira] [Updated] (HIVE-23451) FileSinkOperator calls deleteOnExit (hdfs call) twice for the same file

2020-05-12 Thread Rajesh Balamohan (Jira)
[ https://issues.apache.org/jira/browse/HIVE-23451?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rajesh Balamohan updated HIVE-23451: Attachment: HIVE-23451.2.patch > FileSinkOperator calls deleteOnExit (hdfs call) twice for

[jira] [Commented] (HIVE-23449) LLAP: Reduce mkdir and config creations in submitWork hotpath

2020-05-12 Thread Rajesh Balamohan (Jira)
[ https://issues.apache.org/jira/browse/HIVE-23449?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17105932#comment-17105932 ] Rajesh Balamohan commented on HIVE-23449: - .3 is same as .2 with minor comment added. Thanks for

[jira] [Updated] (HIVE-23449) LLAP: Reduce mkdir and config creations in submitWork hotpath

2020-05-12 Thread Rajesh Balamohan (Jira)
[ https://issues.apache.org/jira/browse/HIVE-23449?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rajesh Balamohan updated HIVE-23449: Attachment: HIVE-23449.3.patch > LLAP: Reduce mkdir and config creations in submitWork

[jira] [Updated] (HIVE-23449) LLAP: Reduce mkdir and config creations in submitWork hotpath

2020-05-12 Thread Rajesh Balamohan (Jira)
[ https://issues.apache.org/jira/browse/HIVE-23449?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rajesh Balamohan updated HIVE-23449: Attachment: HIVE-23449.2.patch > LLAP: Reduce mkdir and config creations in submitWork

[jira] [Commented] (HIVE-23449) LLAP: Reduce mkdir and config creations in submitWork hotpath

2020-05-12 Thread Rajesh Balamohan (Jira)
[ https://issues.apache.org/jira/browse/HIVE-23449?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17105776#comment-17105776 ] Rajesh Balamohan commented on HIVE-23449: - RB:

[jira] [Commented] (HIVE-23446) LLAP: Reduce IPC connection misses to AM for short queries

2020-05-12 Thread Rajesh Balamohan (Jira)
[ https://issues.apache.org/jira/browse/HIVE-23446?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17105362#comment-17105362 ] Rajesh Balamohan commented on HIVE-23446: - RB link:

[jira] [Updated] (HIVE-23446) LLAP: Reduce IPC connection misses to AM for short queries

2020-05-12 Thread Rajesh Balamohan (Jira)
[ https://issues.apache.org/jira/browse/HIVE-23446?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rajesh Balamohan updated HIVE-23446: Assignee: Rajesh Balamohan Status: Patch Available (was: Open) > LLAP: Reduce IPC

[jira] [Updated] (HIVE-23446) LLAP: Reduce IPC connection misses to AM for short queries

2020-05-12 Thread Rajesh Balamohan (Jira)
[ https://issues.apache.org/jira/browse/HIVE-23446?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rajesh Balamohan updated HIVE-23446: Attachment: HIVE-23446.1.patch > LLAP: Reduce IPC connection misses to AM for short

[jira] [Updated] (HIVE-23449) LLAP: Reduce mkdir and config creations in submitWork hotpath

2020-05-12 Thread Rajesh Balamohan (Jira)
[ https://issues.apache.org/jira/browse/HIVE-23449?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rajesh Balamohan updated HIVE-23449: Assignee: Rajesh Balamohan Status: Patch Available (was: Open) > LLAP: Reduce mkdir

[jira] [Updated] (HIVE-23449) LLAP: Reduce mkdir and config creations in submitWork hotpath

2020-05-12 Thread Rajesh Balamohan (Jira)
[ https://issues.apache.org/jira/browse/HIVE-23449?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rajesh Balamohan updated HIVE-23449: Attachment: HIVE-23449.1.patch > LLAP: Reduce mkdir and config creations in submitWork

[jira] [Updated] (HIVE-23451) FileSinkOperator calls deleteOnExit (hdfs call) twice for the same file

2020-05-12 Thread Rajesh Balamohan (Jira)
[ https://issues.apache.org/jira/browse/HIVE-23451?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rajesh Balamohan updated HIVE-23451: Assignee: Rajesh Balamohan Status: Patch Available (was: Open) > FileSinkOperator

[jira] [Updated] (HIVE-23451) FileSinkOperator calls deleteOnExit (hdfs call) twice for the same file

2020-05-12 Thread Rajesh Balamohan (Jira)
[ https://issues.apache.org/jira/browse/HIVE-23451?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rajesh Balamohan updated HIVE-23451: Attachment: HIVE-23451.1.patch > FileSinkOperator calls deleteOnExit (hdfs call) twice for

[jira] [Resolved] (HIVE-23430) Optimise ASTNode::getChildren

2020-05-10 Thread Rajesh Balamohan (Jira)
[ https://issues.apache.org/jira/browse/HIVE-23430?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rajesh Balamohan resolved HIVE-23430. - Resolution: Duplicate > Optimise ASTNode::getChildren > --

[jira] [Commented] (HIVE-23430) Optimise ASTNode::getChildren

2020-05-10 Thread Rajesh Balamohan (Jira)
[ https://issues.apache.org/jira/browse/HIVE-23430?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17104047#comment-17104047 ] Rajesh Balamohan commented on HIVE-23430: - Yes, Marking this as duplicate. Just realized it is

[jira] [Updated] (HIVE-23429) LLAP: Optimize retrieving queryId details in LlapTaskCommunicator

2020-05-10 Thread Rajesh Balamohan (Jira)
[ https://issues.apache.org/jira/browse/HIVE-23429?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rajesh Balamohan updated HIVE-23429: Assignee: Rajesh Balamohan Status: Patch Available (was: Open) > LLAP: Optimize

[jira] [Updated] (HIVE-23429) LLAP: Optimize retrieving queryId details in LlapTaskCommunicator

2020-05-10 Thread Rajesh Balamohan (Jira)
[ https://issues.apache.org/jira/browse/HIVE-23429?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rajesh Balamohan updated HIVE-23429: Attachment: HIVE-23429.1.patch > LLAP: Optimize retrieving queryId details in

[jira] [Commented] (HIVE-23429) LLAP: Optimize retrieving queryId details in LlapTaskCommunicator

2020-05-10 Thread Rajesh Balamohan (Jira)
[ https://issues.apache.org/jira/browse/HIVE-23429?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17103984#comment-17103984 ] Rajesh Balamohan commented on HIVE-23429: - Related ticket:

[jira] [Commented] (HIVE-23294) Remove sync bottleneck in TezConfigurationFactory

2020-04-28 Thread Rajesh Balamohan (Jira)
[ https://issues.apache.org/jira/browse/HIVE-23294?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17095005#comment-17095005 ] Rajesh Balamohan commented on HIVE-23294: - Tried out .2 in the cluster. Haven't seen major CPU

[jira] [Commented] (HIVE-23261) Check whether encryption is enabled in the cluster before moving files

2020-04-27 Thread Rajesh Balamohan (Jira)
[ https://issues.apache.org/jira/browse/HIVE-23261?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17093368#comment-17093368 ] Rajesh Balamohan commented on HIVE-23261: - It is possible that one of the dir is encrypted and

[jira] [Commented] (HIVE-23294) Remove sync bottleneck in TezConfigurationFactory

2020-04-27 Thread Rajesh Balamohan (Jira)
[ https://issues.apache.org/jira/browse/HIVE-23294?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17093054#comment-17093054 ] Rajesh Balamohan commented on HIVE-23294: - [~ashutoshc] : Thanks for sharing the patch. Impact

[jira] [Updated] (HIVE-23282) Reduce number of DB calls in ObjectStore::getPartitionsByExprInternal

2020-04-26 Thread Rajesh Balamohan (Jira)
[ https://issues.apache.org/jira/browse/HIVE-23282?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rajesh Balamohan updated HIVE-23282: Assignee: Rajesh Balamohan Status: Patch Available (was: Open) > Reduce number of

[jira] [Comment Edited] (HIVE-23282) Reduce number of DB calls in ObjectStore::getPartitionsByExprInternal

2020-04-26 Thread Rajesh Balamohan (Jira)
[ https://issues.apache.org/jira/browse/HIVE-23282?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17092649#comment-17092649 ] Rajesh Balamohan edited comment on HIVE-23282 at 4/26/20, 10:38 AM:

[jira] [Updated] (HIVE-23282) Reduce number of DB calls in ObjectStore::getPartitionsByExprInternal

2020-04-26 Thread Rajesh Balamohan (Jira)
[ https://issues.apache.org/jira/browse/HIVE-23282?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rajesh Balamohan updated HIVE-23282: Attachment: HIVE-23282.1.patch > Reduce number of DB calls in

[jira] [Commented] (HIVE-23282) Reduce number of DB calls in ObjectStore::getPartitionsByExprInternal

2020-04-26 Thread Rajesh Balamohan (Jira)
[ https://issues.apache.org/jira/browse/HIVE-23282?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17092649#comment-17092649 ] Rajesh Balamohan commented on HIVE-23282: - [~ashutoshc]: PartitionKeys are needed in sqlfilter.

[jira] [Commented] (HIVE-22737) Concurrency: FunctionRegistry::getFunctionInfo is static object locked

2020-04-26 Thread Rajesh Balamohan (Jira)
[ https://issues.apache.org/jira/browse/HIVE-22737?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17092597#comment-17092597 ] Rajesh Balamohan commented on HIVE-22737: - Yeah, missed that. LGTM. +1 pending tests. >

[jira] [Commented] (HIVE-22737) Concurrency: FunctionRegistry::getFunctionInfo is static object locked

2020-04-25 Thread Rajesh Balamohan (Jira)
[ https://issues.apache.org/jira/browse/HIVE-22737?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17092505#comment-17092505 ] Rajesh Balamohan commented on HIVE-22737: - Thanks for the patch [~ashutoshc] . Would it invoke

[jira] [Assigned] (HIVE-23294) Remove sync bottlneck in TezConfigurationFactory

2020-04-24 Thread Rajesh Balamohan (Jira)
[ https://issues.apache.org/jira/browse/HIVE-23294?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rajesh Balamohan reassigned HIVE-23294: --- Assignee: Rajesh Balamohan > Remove sync bottlneck in TezConfigurationFactory >

[jira] [Updated] (HIVE-23294) Remove sync bottlneck in TezConfigurationFactory

2020-04-24 Thread Rajesh Balamohan (Jira)
[ https://issues.apache.org/jira/browse/HIVE-23294?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rajesh Balamohan updated HIVE-23294: Attachment: HIVE-23294.1.patch > Remove sync bottlneck in TezConfigurationFactory >

[jira] [Updated] (HIVE-23294) Remove sync bottlneck in TezConfigurationFactory

2020-04-24 Thread Rajesh Balamohan (Jira)
[ https://issues.apache.org/jira/browse/HIVE-23294?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rajesh Balamohan updated HIVE-23294: Status: Patch Available (was: Open) > Remove sync bottlneck in TezConfigurationFactory >

[jira] [Updated] (HIVE-23282) Reduce number of DB calls in ObjectStore::getPartitionsByExprInternal

2020-04-23 Thread Rajesh Balamohan (Jira)
[ https://issues.apache.org/jira/browse/HIVE-23282?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rajesh Balamohan updated HIVE-23282: Description: ObjectStore::getPartitionsByExprInternal internally uses Table information

[jira] [Updated] (HIVE-23281) ObjectStore::convertToStorageDescriptor can be optimised to reduce calls to DB for ACID tables

2020-04-23 Thread Rajesh Balamohan (Jira)
[ https://issues.apache.org/jira/browse/HIVE-23281?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rajesh Balamohan updated HIVE-23281: Description:

[jira] [Updated] (HIVE-23281) ObjectStore::convertToStorageDescriptor can be optimised to reduce calls to DB for ACID tables

2020-04-23 Thread Rajesh Balamohan (Jira)
[ https://issues.apache.org/jira/browse/HIVE-23281?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rajesh Balamohan updated HIVE-23281: Attachment: image-2020-04-23-13-56-17-210.png > ObjectStore::convertToStorageDescriptor

[jira] [Commented] (HIVE-23261) Check whether encryption is enabled in the cluster before moving files

2020-04-20 Thread Rajesh Balamohan (Jira)
[ https://issues.apache.org/jira/browse/HIVE-23261?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17088285#comment-17088285 ] Rajesh Balamohan commented on HIVE-23261: - +1 pending tests. > Check whether encryption is

[jira] [Commented] (HIVE-23210) Fix shortestjobcomparator when jobs submitted have 1 task their vertices

2020-04-20 Thread Rajesh Balamohan (Jira)
[ https://issues.apache.org/jira/browse/HIVE-23210?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17087599#comment-17087599 ] Rajesh Balamohan commented on HIVE-23210: - Thanks [~pgaref] . Latest patch LGTM. +1. > Fix

[jira] [Updated] (HIVE-23195) set hive.cluster.delegation.token.gc-interval to 15 minutes instead of an hour

2020-04-19 Thread Rajesh Balamohan (Jira)
[ https://issues.apache.org/jira/browse/HIVE-23195?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rajesh Balamohan updated HIVE-23195: Fix Version/s: 4.0.0 Resolution: Fixed Status: Resolved (was: Patch

[jira] [Commented] (HIVE-23195) set hive.cluster.delegation.token.gc-interval to 15 minutes instead of an hour

2020-04-19 Thread Rajesh Balamohan (Jira)
[ https://issues.apache.org/jira/browse/HIVE-23195?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17087291#comment-17087291 ] Rajesh Balamohan commented on HIVE-23195: - +1 > set hive.cluster.delegation.token.gc-interval to

[jira] [Commented] (HIVE-23210) Fix shortestjobcomparator when jobs submitted have 1 task their vertices

2020-04-17 Thread Rajesh Balamohan (Jira)
[ https://issues.apache.org/jira/browse/HIVE-23210?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17085658#comment-17085658 ] Rajesh Balamohan commented on HIVE-23210: - Issue is not only related to single task. It can

[jira] [Commented] (HIVE-23210) Fix shortestjobcomparator when jobs submitted have 1 task their vertices

2020-04-17 Thread Rajesh Balamohan (Jira)
[ https://issues.apache.org/jira/browse/HIVE-23210?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17085647#comment-17085647 ] Rajesh Balamohan commented on HIVE-23210: - [^HIVE-23210.wip.patch] : Sample patch that takes care

[jira] [Updated] (HIVE-23210) Fix shortestjobcomparator when jobs submitted have 1 task their vertices

2020-04-17 Thread Rajesh Balamohan (Jira)
[ https://issues.apache.org/jira/browse/HIVE-23210?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rajesh Balamohan updated HIVE-23210: Attachment: HIVE-23210.wip.patch > Fix shortestjobcomparator when jobs submitted have 1

[jira] [Commented] (HIVE-23196) Reduce number of delete calls to NN during Context::clear

2020-04-16 Thread Rajesh Balamohan (Jira)
[ https://issues.apache.org/jira/browse/HIVE-23196?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17085288#comment-17085288 ] Rajesh Balamohan commented on HIVE-23196: - Another possibility: Context::clear can just enqueue

[jira] [Updated] (HIVE-23212) SemanticAnalyzer::getStagingDirectoryPathname should check for encryption zone only when needed

2020-04-15 Thread Rajesh Balamohan (Jira)
[ https://issues.apache.org/jira/browse/HIVE-23212?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rajesh Balamohan updated HIVE-23212: Assignee: Rajesh Balamohan Status: Patch Available (was: Open) >

[jira] [Updated] (HIVE-23212) SemanticAnalyzer::getStagingDirectoryPathname should check for encryption zone only when needed

2020-04-15 Thread Rajesh Balamohan (Jira)
[ https://issues.apache.org/jira/browse/HIVE-23212?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rajesh Balamohan updated HIVE-23212: Attachment: HIVE-23212.1.patch > SemanticAnalyzer::getStagingDirectoryPathname should

[jira] [Commented] (HIVE-23218) LlapRecordReader queue limit computation is not optimal

2020-04-15 Thread Rajesh Balamohan (Jira)
[ https://issues.apache.org/jira/browse/HIVE-23218?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17084537#comment-17084537 ] Rajesh Balamohan commented on HIVE-23218: - Temp workaround/hack is to set

[jira] [Commented] (HIVE-23210) Fix shortestjobcomparator when jobs submitted have 1 task their vertices

2020-04-15 Thread Rajesh Balamohan (Jira)
[ https://issues.apache.org/jira/browse/HIVE-23210?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17083880#comment-17083880 ] Rajesh Balamohan commented on HIVE-23210: - TestShortestJobFirstComparator::testWaitQueueAging

[jira] [Updated] (HIVE-23210) Fix shortestjobcomparator when jobs submitted have 1 task their vertices

2020-04-15 Thread Rajesh Balamohan (Jira)
[ https://issues.apache.org/jira/browse/HIVE-23210?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rajesh Balamohan updated HIVE-23210: Attachment: TestShortestJobFirstComparator.java > Fix shortestjobcomparator when jobs

[jira] [Updated] (HIVE-23208) Update guaranteed capacity in ZK only when WM is enabled

2020-04-14 Thread Rajesh Balamohan (Jira)
[ https://issues.apache.org/jira/browse/HIVE-23208?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rajesh Balamohan updated HIVE-23208: Summary: Update guaranteed capacity in ZK only when WM is enabled (was: Update guranteed

[jira] [Commented] (HIVE-23196) Reduce number of delete calls to NN during Context::clear

2020-04-14 Thread Rajesh Balamohan (Jira)
[ https://issues.apache.org/jira/browse/HIVE-23196?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17082987#comment-17082987 ] Rajesh Balamohan commented on HIVE-23196: - Ref:

[jira] [Updated] (HIVE-23196) Reduce number of delete calls to NN during Context::clear

2020-04-14 Thread Rajesh Balamohan (Jira)
[ https://issues.apache.org/jira/browse/HIVE-23196?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rajesh Balamohan updated HIVE-23196: Description: {{Context::clear()}} ends up deleting same directories (or its subdirs)

[jira] [Updated] (HIVE-23029) LLAP: Shuffle Handler should support Index Cache configuration

2020-04-13 Thread Rajesh Balamohan (Jira)
[ https://issues.apache.org/jira/browse/HIVE-23029?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rajesh Balamohan updated HIVE-23029: Fix Version/s: 4.0.0 Assignee: Rajesh Balamohan Resolution: Fixed

[jira] [Updated] (HIVE-23154) Fix race condition in Utilities::mvFileToFinalPath

2020-04-09 Thread Rajesh Balamohan (Jira)
[ https://issues.apache.org/jira/browse/HIVE-23154?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rajesh Balamohan updated HIVE-23154: Assignee: Rajesh Balamohan Resolution: Fixed Status: Resolved (was: Patch

[jira] [Updated] (HIVE-23154) Fix race condition in Utilities::mvFileToFinalPath

2020-04-09 Thread Rajesh Balamohan (Jira)
[ https://issues.apache.org/jira/browse/HIVE-23154?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rajesh Balamohan updated HIVE-23154: Attachment: HIVE-23154.3.patch > Fix race condition in Utilities::mvFileToFinalPath >

[jira] [Commented] (HIVE-23154) Fix race condition in Utilities::mvFileToFinalPath

2020-04-08 Thread Rajesh Balamohan (Jira)
[ https://issues.apache.org/jira/browse/HIVE-23154?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17077918#comment-17077918 ] Rajesh Balamohan commented on HIVE-23154: - RB: https://reviews.apache.org/r/72333/diff/1/ > Fix

[jira] [Updated] (HIVE-23154) Fix race condition in Utilities::mvFileToFinalPath

2020-04-08 Thread Rajesh Balamohan (Jira)
[ https://issues.apache.org/jira/browse/HIVE-23154?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rajesh Balamohan updated HIVE-23154: Status: Patch Available (was: Open) > Fix race condition in Utilities::mvFileToFinalPath

[jira] [Updated] (HIVE-23154) Fix race condition in Utilities::mvFileToFinalPath

2020-04-08 Thread Rajesh Balamohan (Jira)
[ https://issues.apache.org/jira/browse/HIVE-23154?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rajesh Balamohan updated HIVE-23154: Attachment: HIVE-23154.1.patch > Fix race condition in Utilities::mvFileToFinalPath >

[jira] [Updated] (HIVE-23140) Optimise file move in CTAS

2020-04-06 Thread Rajesh Balamohan (Jira)
[ https://issues.apache.org/jira/browse/HIVE-23140?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rajesh Balamohan updated HIVE-23140: Fix Version/s: 4.0.0 Resolution: Fixed Status: Resolved (was: Patch

[jira] [Commented] (HIVE-23140) Optimise file move in CTAS

2020-04-06 Thread Rajesh Balamohan (Jira)
[ https://issues.apache.org/jira/browse/HIVE-23140?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17076783#comment-17076783 ] Rajesh Balamohan commented on HIVE-23140: - "Insert overwrite/into" follows

[jira] [Commented] (HIVE-23140) Optimise file move in CTAS

2020-04-06 Thread Rajesh Balamohan (Jira)
[ https://issues.apache.org/jira/browse/HIVE-23140?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17076388#comment-17076388 ] Rajesh Balamohan commented on HIVE-23140: - Test case failure is not related to this patch.

[jira] [Updated] (HIVE-23140) Optimise file move in CTAS

2020-04-06 Thread Rajesh Balamohan (Jira)
[ https://issues.apache.org/jira/browse/HIVE-23140?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rajesh Balamohan updated HIVE-23140: Description: FileSinkOperator can be optimized to run file move operation (/_tmp.-ext -->

[jira] [Updated] (HIVE-23140) Optimise file move in CTAS

2020-04-06 Thread Rajesh Balamohan (Jira)
[ https://issues.apache.org/jira/browse/HIVE-23140?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rajesh Balamohan updated HIVE-23140: Attachment: HIVE-23140.1.patch > Optimise file move in CTAS > ---

[jira] [Updated] (HIVE-23140) Optimise file move in CTAS

2020-04-06 Thread Rajesh Balamohan (Jira)
[ https://issues.apache.org/jira/browse/HIVE-23140?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rajesh Balamohan updated HIVE-23140: Status: Patch Available (was: Open) > Optimise file move in CTAS >

[jira] [Assigned] (HIVE-23140) Optimise file move in CTAS

2020-04-06 Thread Rajesh Balamohan (Jira)
[ https://issues.apache.org/jira/browse/HIVE-23140?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rajesh Balamohan reassigned HIVE-23140: --- > Optimise file move in CTAS > --- > > Key:

[jira] [Commented] (HIVE-23122) LLAP: TaskExecutorService should log details about task eviction decision details

2020-04-02 Thread Rajesh Balamohan (Jira)
[ https://issues.apache.org/jira/browse/HIVE-23122?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17073717#comment-17073717 ] Rajesh Balamohan commented on HIVE-23122: - Given that this is in hotpath, we can move to debug

[jira] [Comment Edited] (HIVE-23083) Enable fast serialization in xprod edge

2020-03-26 Thread Rajesh Balamohan (Jira)
[ https://issues.apache.org/jira/browse/HIVE-23083?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17068253#comment-17068253 ] Rajesh Balamohan edited comment on HIVE-23083 at 3/27/20, 4:19 AM: ---

[jira] [Commented] (HIVE-23083) Enable fast serialization in xprod edge

2020-03-26 Thread Rajesh Balamohan (Jira)
[ https://issues.apache.org/jira/browse/HIVE-23083?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17068253#comment-17068253 ] Rajesh Balamohan commented on HIVE-23083: - Both test failures with following exceptions are

[jira] [Assigned] (HIVE-23083) Enable fast serialization in xprod edge

2020-03-26 Thread Rajesh Balamohan (Jira)
[ https://issues.apache.org/jira/browse/HIVE-23083?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rajesh Balamohan reassigned HIVE-23083: --- Assignee: Rajesh Balamohan > Enable fast serialization in xprod edge >

[jira] [Updated] (HIVE-23083) Enable fast serialization in xprod edge

2020-03-26 Thread Rajesh Balamohan (Jira)
[ https://issues.apache.org/jira/browse/HIVE-23083?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rajesh Balamohan updated HIVE-23083: Status: Patch Available (was: Open) > Enable fast serialization in xprod edge >

[jira] [Updated] (HIVE-23083) Enable fast serialization in xprod edge

2020-03-26 Thread Rajesh Balamohan (Jira)
[ https://issues.apache.org/jira/browse/HIVE-23083?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rajesh Balamohan updated HIVE-23083: Attachment: HIVE-23083.1.patch > Enable fast serialization in xprod edge >

[jira] [Updated] (HIVE-23002) Optimise LazyBinaryUtils.writeVLong

2020-03-19 Thread Rajesh Balamohan (Jira)
[ https://issues.apache.org/jira/browse/HIVE-23002?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rajesh Balamohan updated HIVE-23002: Fix Version/s: 4.0.0 Assignee: Rajesh Balamohan Resolution: Fixed

[jira] [Comment Edited] (HIVE-23002) Optimise LazyBinaryUtils.writeVLong

2020-03-18 Thread Rajesh Balamohan (Jira)
[ https://issues.apache.org/jira/browse/HIVE-23002?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17062275#comment-17062275 ] Rajesh Balamohan edited comment on HIVE-23002 at 3/19/20, 4:36 AM: --- No,

[jira] [Commented] (HIVE-23002) Optimise LazyBinaryUtils.writeVLong

2020-03-18 Thread Rajesh Balamohan (Jira)
[ https://issues.apache.org/jira/browse/HIVE-23002?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17062275#comment-17062275 ] Rajesh Balamohan commented on HIVE-23002: - No, it will not be for every column value & not for

[jira] [Updated] (HIVE-23027) Fix syntax error in llap package.py

2020-03-16 Thread Rajesh Balamohan (Jira)
[ https://issues.apache.org/jira/browse/HIVE-23027?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rajesh Balamohan updated HIVE-23027: Assignee: Rajesh Balamohan Resolution: Fixed Status: Resolved (was: Patch

[jira] [Commented] (HIVE-23027) Fix syntax error in llap package.py

2020-03-16 Thread Rajesh Balamohan (Jira)
[ https://issues.apache.org/jira/browse/HIVE-23027?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17060532#comment-17060532 ] Rajesh Balamohan commented on HIVE-23027: - Committed to master. Thanks [~gopalv] . > Fix syntax

[jira] [Updated] (HIVE-23027) Fix syntax error in llap package.py

2020-03-16 Thread Rajesh Balamohan (Jira)
[ https://issues.apache.org/jira/browse/HIVE-23027?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rajesh Balamohan updated HIVE-23027: Fix Version/s: 4.0.0 > Fix syntax error in llap package.py >

[jira] [Updated] (HIVE-23002) Optimise LazyBinaryUtils.writeVLong

2020-03-16 Thread Rajesh Balamohan (Jira)
[ https://issues.apache.org/jira/browse/HIVE-23002?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rajesh Balamohan updated HIVE-23002: Attachment: HIVE-23002.3.patch > Optimise LazyBinaryUtils.writeVLong >

[jira] [Updated] (HIVE-23029) LLAP: Shuffle Handler should support Index Cache configuration

2020-03-16 Thread Rajesh Balamohan (Jira)
[ https://issues.apache.org/jira/browse/HIVE-23029?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rajesh Balamohan updated HIVE-23029: Status: Patch Available (was: Open) > LLAP: Shuffle Handler should support Index Cache

[jira] [Updated] (HIVE-23029) LLAP: Shuffle Handler should support Index Cache configuration

2020-03-16 Thread Rajesh Balamohan (Jira)
[ https://issues.apache.org/jira/browse/HIVE-23029?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rajesh Balamohan updated HIVE-23029: Attachment: HIVE-23029.1.patch > LLAP: Shuffle Handler should support Index Cache

[jira] [Commented] (HIVE-23029) LLAP: Shuffle Handler should support Index Cache configuration

2020-03-16 Thread Rajesh Balamohan (Jira)
[ https://issues.apache.org/jira/browse/HIVE-23029?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17059987#comment-17059987 ] Rajesh Balamohan commented on HIVE-23029: - Ref: TEZ-3887 > LLAP: Shuffle Handler should support

[jira] [Updated] (HIVE-23027) Fix syntax error in llap package.py

2020-03-15 Thread Rajesh Balamohan (Jira)
[ https://issues.apache.org/jira/browse/HIVE-23027?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rajesh Balamohan updated HIVE-23027: Status: Patch Available (was: Open) > Fix syntax error in llap package.py >

[jira] [Updated] (HIVE-23027) Fix syntax error in llap package.py

2020-03-15 Thread Rajesh Balamohan (Jira)
[ https://issues.apache.org/jira/browse/HIVE-23027?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rajesh Balamohan updated HIVE-23027: Attachment: HIVE-23027.1.patch > Fix syntax error in llap package.py >

[jira] [Updated] (HIVE-23002) Optimise LazyBinaryUtils.writeVLong

2020-03-12 Thread Rajesh Balamohan (Jira)
[ https://issues.apache.org/jira/browse/HIVE-23002?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rajesh Balamohan updated HIVE-23002: Attachment: HIVE-23002.2.patch > Optimise LazyBinaryUtils.writeVLong >

[jira] [Commented] (HIVE-23002) Optimise LazyBinaryUtils.writeVLong

2020-03-11 Thread Rajesh Balamohan (Jira)
[ https://issues.apache.org/jira/browse/HIVE-23002?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17057611#comment-17057611 ] Rajesh Balamohan commented on HIVE-23002: - per LazyBinarySerializeWrite; reused. > Optimise

[jira] [Updated] (HIVE-23002) Optimise LazyBinaryUtils.writeVLong

2020-03-10 Thread Rajesh Balamohan (Jira)
[ https://issues.apache.org/jira/browse/HIVE-23002?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rajesh Balamohan updated HIVE-23002: Status: Patch Available (was: Open) > Optimise LazyBinaryUtils.writeVLong >

[jira] [Updated] (HIVE-23002) Optimise LazyBinaryUtils.writeVLong

2020-03-10 Thread Rajesh Balamohan (Jira)
[ https://issues.apache.org/jira/browse/HIVE-23002?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rajesh Balamohan updated HIVE-23002: Attachment: HIVE-23002.1.patch > Optimise LazyBinaryUtils.writeVLong >

[jira] [Commented] (HIVE-22966) LLAP: Consider including waitTime for comparing attempts in same vertex

2020-03-05 Thread Rajesh Balamohan (Jira)
[ https://issues.apache.org/jira/browse/HIVE-22966?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17052180#comment-17052180 ] Rajesh Balamohan commented on HIVE-22966: - Starvation of tasks waiting for resources within the

[jira] [Updated] (HIVE-22966) LLAP: Consider including waitTime for comparing attempts in same vertex

2020-03-05 Thread Rajesh Balamohan (Jira)
[ https://issues.apache.org/jira/browse/HIVE-22966?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rajesh Balamohan updated HIVE-22966: Fix Version/s: 4.0.0 Resolution: Fixed Status: Resolved (was: Patch

[jira] [Comment Edited] (HIVE-22975) Optimise TopNKeyFilter with boundary checks

2020-03-04 Thread Rajesh Balamohan (Jira)
[ https://issues.apache.org/jira/browse/HIVE-22975?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17051080#comment-17051080 ] Rajesh Balamohan edited comment on HIVE-22975 at 3/4/20, 2:20 PM: -- With

[jira] [Commented] (HIVE-22975) Optimise TopNKeyFilter with boundary checks

2020-03-04 Thread Rajesh Balamohan (Jira)
[ https://issues.apache.org/jira/browse/HIVE-22975?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17051080#comment-17051080 ] Rajesh Balamohan commented on HIVE-22975: - With patch, CPU usage forĀ {{TopNKeyFilter.canForward}}

[jira] [Updated] (HIVE-22975) Optimise TopNKeyFilter with boundary checks

2020-03-04 Thread Rajesh Balamohan (Jira)
[ https://issues.apache.org/jira/browse/HIVE-22975?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rajesh Balamohan updated HIVE-22975: Assignee: Rajesh Balamohan Status: Patch Available (was: Open) > Optimise

[jira] [Updated] (HIVE-22975) Optimise TopNKeyFilter with boundary checks

2020-03-04 Thread Rajesh Balamohan (Jira)
[ https://issues.apache.org/jira/browse/HIVE-22975?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rajesh Balamohan updated HIVE-22975: Attachment: HIVE-22975.1.patch > Optimise TopNKeyFilter with boundary checks >

[jira] [Commented] (HIVE-22966) LLAP: Consider including waitTime for comparing attempts in same vertex

2020-03-03 Thread Rajesh Balamohan (Jira)
[ https://issues.apache.org/jira/browse/HIVE-22966?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17050680#comment-17050680 ] Rajesh Balamohan commented on HIVE-22966: - It does depending on the wait time. Wait time is used

[jira] [Updated] (HIVE-22966) LLAP: Consider including waitTime for comparing attempts in same vertex

2020-03-03 Thread Rajesh Balamohan (Jira)
[ https://issues.apache.org/jira/browse/HIVE-22966?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rajesh Balamohan updated HIVE-22966: Status: Patch Available (was: Open) > LLAP: Consider including waitTime for comparing

[jira] [Updated] (HIVE-22966) LLAP: Consider including waitTime for comparing attempts in same vertex

2020-03-03 Thread Rajesh Balamohan (Jira)
[ https://issues.apache.org/jira/browse/HIVE-22966?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rajesh Balamohan updated HIVE-22966: Attachment: HIVE-22966.4.patch > LLAP: Consider including waitTime for comparing attempts

<    1   2   3   4   5   6   7   8   9   10   >