[jira] [Created] (HIVE-24649) Optimise Hive::addWriteNotificationLog for large data inserts

2021-01-17 Thread Rajesh Balamohan (Jira)
Rajesh Balamohan created HIVE-24649: --- Summary: Optimise Hive::addWriteNotificationLog for large data inserts Key: HIVE-24649 URL: https://issues.apache.org/jira/browse/HIVE-24649 Project: Hive

[jira] [Created] (HIVE-24596) Explain ddl for debugging

2021-01-06 Thread Rajesh Balamohan (Jira)
Rajesh Balamohan created HIVE-24596: --- Summary: Explain ddl for debugging Key: HIVE-24596 URL: https://issues.apache.org/jira/browse/HIVE-24596 Project: Hive Issue Type: Improvement

[jira] [Created] (HIVE-24546) Avoid unwanted cloud storage call during dynamic partition load

2020-12-16 Thread Rajesh Balamohan (Jira)
Rajesh Balamohan created HIVE-24546: --- Summary: Avoid unwanted cloud storage call during dynamic partition load Key: HIVE-24546 URL: https://issues.apache.org/jira/browse/HIVE-24546 Project: Hive

[jira] [Created] (HIVE-24537) Optimise locking in LlapTaskSchedulerService

2020-12-14 Thread Rajesh Balamohan (Jira)
Rajesh Balamohan created HIVE-24537: --- Summary: Optimise locking in LlapTaskSchedulerService Key: HIVE-24537 URL: https://issues.apache.org/jira/browse/HIVE-24537 Project: Hive Issue Type

[jira] [Created] (HIVE-24520) Fix stackoverflow error in HiveMetaStore::get_partitions_by_names

2020-12-10 Thread Rajesh Balamohan (Jira)
Rajesh Balamohan created HIVE-24520: --- Summary: Fix stackoverflow error in HiveMetaStore::get_partitions_by_names Key: HIVE-24520 URL: https://issues.apache.org/jira/browse/HIVE-24520 Project: Hive

[jira] [Created] (HIVE-24519) Optimize MV: Materialized views should not rebuild when tables are not modified

2020-12-10 Thread Rajesh Balamohan (Jira)
Rajesh Balamohan created HIVE-24519: --- Summary: Optimize MV: Materialized views should not rebuild when tables are not modified Key: HIVE-24519 URL: https://issues.apache.org/jira/browse/HIVE-24519

[jira] [Created] (HIVE-24515) Analyze table job can be skipped when stats populated are already accurate

2020-12-10 Thread Rajesh Balamohan (Jira)
Rajesh Balamohan created HIVE-24515: --- Summary: Analyze table job can be skipped when stats populated are already accurate Key: HIVE-24515 URL: https://issues.apache.org/jira/browse/HIVE-24515

[jira] [Created] (HIVE-24472) Optimize LlapTaskSchedulerService::preemptTasksFromMap

2020-12-02 Thread Rajesh Balamohan (Jira)
Rajesh Balamohan created HIVE-24472: --- Summary: Optimize LlapTaskSchedulerService::preemptTasksFromMap Key: HIVE-24472 URL: https://issues.apache.org/jira/browse/HIVE-24472 Project: Hive

[jira] [Created] (HIVE-24466) insert queries should not launch job when condition in the query would output 0 rows

2020-12-01 Thread Rajesh Balamohan (Jira)
Rajesh Balamohan created HIVE-24466: --- Summary: insert queries should not launch job when condition in the query would output 0 rows Key: HIVE-24466 URL: https://issues.apache.org/jira/browse/HIVE-24466

[jira] [Created] (HIVE-24443) Optimise VectorSerializeRow for primitives

2020-11-29 Thread Rajesh Balamohan (Jira)
Rajesh Balamohan created HIVE-24443: --- Summary: Optimise VectorSerializeRow for primitives Key: HIVE-24443 URL: https://issues.apache.org/jira/browse/HIVE-24443 Project: Hive Issue Type

[jira] [Created] (HIVE-24416) Optimise HiveCharWritable::getStrippedValue

2020-11-23 Thread Rajesh Balamohan (Jira)
Rajesh Balamohan created HIVE-24416: --- Summary: Optimise HiveCharWritable::getStrippedValue Key: HIVE-24416 URL: https://issues.apache.org/jira/browse/HIVE-24416 Project: Hive Issue Type

[jira] [Created] (HIVE-24409) Use LazyBinarySerDe2 in PlanUtils::getReduceValueTableDesc

2020-11-22 Thread Rajesh Balamohan (Jira)
Rajesh Balamohan created HIVE-24409: --- Summary: Use LazyBinarySerDe2 in PlanUtils::getReduceValueTableDesc Key: HIVE-24409 URL: https://issues.apache.org/jira/browse/HIVE-24409 Project: Hive

[jira] [Created] (HIVE-24368) Optimise AcidUtils::getAcidFilesForStats for ACID tables

2020-11-10 Thread Rajesh Balamohan (Jira)
Rajesh Balamohan created HIVE-24368: --- Summary: Optimise AcidUtils::getAcidFilesForStats for ACID tables Key: HIVE-24368 URL: https://issues.apache.org/jira/browse/HIVE-24368 Project: Hive

[jira] [Created] (HIVE-24367) Explore whether HiveAlterHandler::alterTable can be optimised for non-partitioned tablesInbox

2020-11-10 Thread Rajesh Balamohan (Jira)
Rajesh Balamohan created HIVE-24367: --- Summary: Explore whether HiveAlterHandler::alterTable can be optimised for non-partitioned tablesInbox Key: HIVE-24367 URL: https://issues.apache.org/jira/browse/HIVE-24367

[jira] [Created] (HIVE-24313) Optimise stats collection for file sizes on cloud storage

2020-10-27 Thread Rajesh Balamohan (Jira)
Rajesh Balamohan created HIVE-24313: --- Summary: Optimise stats collection for file sizes on cloud storage Key: HIVE-24313 URL: https://issues.apache.org/jira/browse/HIVE-24313 Project: Hive

[jira] [Created] (HIVE-24296) NDV adjusted twice causing reducer task underestimation

2020-10-22 Thread Rajesh Balamohan (Jira)
Rajesh Balamohan created HIVE-24296: --- Summary: NDV adjusted twice causing reducer task underestimation Key: HIVE-24296 URL: https://issues.apache.org/jira/browse/HIVE-24296 Project: Hive

[jira] [Created] (HIVE-24290) Explain analyze can be slow in cloud storage

2020-10-20 Thread Rajesh Balamohan (Jira)
Rajesh Balamohan created HIVE-24290: --- Summary: Explain analyze can be slow in cloud storage Key: HIVE-24290 URL: https://issues.apache.org/jira/browse/HIVE-24290 Project: Hive Issue Type

[jira] [Created] (HIVE-24289) RetryingMetaStoreClient should not retry connecting to HMS on genuine errors

2020-10-19 Thread Rajesh Balamohan (Jira)
Rajesh Balamohan created HIVE-24289: --- Summary: RetryingMetaStoreClient should not retry connecting to HMS on genuine errors Key: HIVE-24289 URL: https://issues.apache.org/jira/browse/HIVE-24289

[jira] [Created] (HIVE-24262) Optimise NullScanTaskDispatcher for cloud storage

2020-10-12 Thread Rajesh Balamohan (Jira)
Rajesh Balamohan created HIVE-24262: --- Summary: Optimise NullScanTaskDispatcher for cloud storage Key: HIVE-24262 URL: https://issues.apache.org/jira/browse/HIVE-24262 Project: Hive Issue

[jira] [Created] (HIVE-24234) Improve checkHashModeEfficiency in VectorGroupByOperator

2020-10-06 Thread Rajesh Balamohan (Jira)
Rajesh Balamohan created HIVE-24234: --- Summary: Improve checkHashModeEfficiency in VectorGroupByOperator Key: HIVE-24234 URL: https://issues.apache.org/jira/browse/HIVE-24234 Project: Hive

[jira] [Created] (HIVE-24212) Refactor to take advantage of listStatus optimisations in cloud storage connectors

2020-09-30 Thread Rajesh Balamohan (Jira)
Rajesh Balamohan created HIVE-24212: --- Summary: Refactor to take advantage of listStatus optimisations in cloud storage connectors Key: HIVE-24212 URL: https://issues.apache.org/jira/browse/HIVE-24212

[jira] [Created] (HIVE-24207) LimitOperator can leverage ObjectCache to bail out quickly

2020-09-29 Thread Rajesh Balamohan (Jira)
Rajesh Balamohan created HIVE-24207: --- Summary: LimitOperator can leverage ObjectCache to bail out quickly Key: HIVE-24207 URL: https://issues.apache.org/jira/browse/HIVE-24207 Project: Hive

[jira] [Created] (HIVE-24205) Optimise CuckooSetBytes

2020-09-28 Thread Rajesh Balamohan (Jira)
Rajesh Balamohan created HIVE-24205: --- Summary: Optimise CuckooSetBytes Key: HIVE-24205 URL: https://issues.apache.org/jira/browse/HIVE-24205 Project: Hive Issue Type: Improvement

[jira] [Created] (HIVE-24116) LLAP: Provide an opportunity for preempted tasks to get better locality in next iteration

2020-09-03 Thread Rajesh Balamohan (Jira)
Rajesh Balamohan created HIVE-24116: --- Summary: LLAP: Provide an opportunity for preempted tasks to get better locality in next iteration Key: HIVE-24116 URL: https://issues.apache.org/jira/browse/HIVE-24116

[jira] [Created] (HIVE-24075) Optimise KeyValuesInputMerger

2020-08-25 Thread Rajesh Balamohan (Jira)
Rajesh Balamohan created HIVE-24075: --- Summary: Optimise KeyValuesInputMerger Key: HIVE-24075 URL: https://issues.apache.org/jira/browse/HIVE-24075 Project: Hive Issue Type: Improvement

[jira] [Created] (HIVE-24061) Improve llap task scheduling for better cache hit rate

2020-08-24 Thread Rajesh Balamohan (Jira)
Rajesh Balamohan created HIVE-24061: --- Summary: Improve llap task scheduling for better cache hit rate Key: HIVE-24061 URL: https://issues.apache.org/jira/browse/HIVE-24061 Project: Hive

[jira] [Created] (HIVE-24029) MV fails for queries with subqueries

2020-08-11 Thread Rajesh Balamohan (Jira)
Rajesh Balamohan created HIVE-24029: --- Summary: MV fails for queries with subqueries Key: HIVE-24029 URL: https://issues.apache.org/jira/browse/HIVE-24029 Project: Hive Issue Type: Sub-task

[jira] [Created] (HIVE-24028) MV query fails with CalciteViewSemanticException

2020-08-11 Thread Rajesh Balamohan (Jira)
Rajesh Balamohan created HIVE-24028: --- Summary: MV query fails with CalciteViewSemanticException Key: HIVE-24028 URL: https://issues.apache.org/jira/browse/HIVE-24028 Project: Hive Issue

[jira] [Created] (HIVE-24027) Add support for `intersect` keyword in MV

2020-08-11 Thread Rajesh Balamohan (Jira)
Rajesh Balamohan created HIVE-24027: --- Summary: Add support for `intersect` keyword in MV Key: HIVE-24027 URL: https://issues.apache.org/jira/browse/HIVE-24027 Project: Hive Issue Type: Sub

[jira] [Created] (HIVE-24022) Optimise HiveMetaStoreAuthorizer.createHiveMetaStoreAuthorizer

2020-08-10 Thread Rajesh Balamohan (Jira)
Rajesh Balamohan created HIVE-24022: --- Summary: Optimise HiveMetaStoreAuthorizer.createHiveMetaStoreAuthorizer Key: HIVE-24022 URL: https://issues.apache.org/jira/browse/HIVE-24022 Project: Hive

[jira] [Created] (HIVE-23953) Use task counter information to compute keycount during hashtable loading

2020-07-29 Thread Rajesh Balamohan (Jira)
Rajesh Balamohan created HIVE-23953: --- Summary: Use task counter information to compute keycount during hashtable loading Key: HIVE-23953 URL: https://issues.apache.org/jira/browse/HIVE-23953

[jira] [Created] (HIVE-23952) Reuse VectorAggregationBuffer to reduce GC pressure in VectorGroupByOperator

2020-07-29 Thread Rajesh Balamohan (Jira)
Rajesh Balamohan created HIVE-23952: --- Summary: Reuse VectorAggregationBuffer to reduce GC pressure in VectorGroupByOperator Key: HIVE-23952 URL: https://issues.apache.org/jira/browse/HIVE-23952

[jira] [Created] (HIVE-23936) Provide approximate number of input records to be processed in broadcast reader

2020-07-27 Thread Rajesh Balamohan (Jira)
Rajesh Balamohan created HIVE-23936: --- Summary: Provide approximate number of input records to be processed in broadcast reader Key: HIVE-23936 URL: https://issues.apache.org/jira/browse/HIVE-23936

[jira] [Created] (HIVE-23917) Reset key access count during eviction in VectorGroupByOperator

2020-07-23 Thread Rajesh Balamohan (Jira)
Rajesh Balamohan created HIVE-23917: --- Summary: Reset key access count during eviction in VectorGroupByOperator Key: HIVE-23917 URL: https://issues.apache.org/jira/browse/HIVE-23917 Project: Hive

Re: Review Request 72675: Improve key evictions in VectorGroupByOperator

2020-07-20 Thread Rajesh Balamohan
/diff/1-2/ Testing --- Thanks, Rajesh Balamohan

[jira] [Created] (HIVE-23884) SemanticAnalyze exception when addressing field with table name in group by

2020-07-20 Thread Rajesh Balamohan (Jira)
Rajesh Balamohan created HIVE-23884: --- Summary: SemanticAnalyze exception when addressing field with table name in group by Key: HIVE-23884 URL: https://issues.apache.org/jira/browse/HIVE-23884

[jira] [Created] (HIVE-23878) Aggregate after join throws off MV rewrite

2020-07-19 Thread Rajesh Balamohan (Jira)
Rajesh Balamohan created HIVE-23878: --- Summary: Aggregate after join throws off MV rewrite Key: HIVE-23878 URL: https://issues.apache.org/jira/browse/HIVE-23878 Project: Hive Issue Type

[jira] [Created] (HIVE-23870) Optimise multiple text conversions in WritableHiveCharObjectInspector.getPrimitiveJavaObjec

2020-07-17 Thread Rajesh Balamohan (Jira)
Rajesh Balamohan created HIVE-23870: --- Summary: Optimise multiple text conversions in WritableHiveCharObjectInspector.getPrimitiveJavaObjec Key: HIVE-23870 URL: https://issues.apache.org/jira/browse/HIVE-23870

Review Request 72675: Improve key evictions in VectorGroupByOperator

2020-07-13 Thread Rajesh Balamohan
/vector/TestVectorGroupByOperator.java 3835987170 Diff: https://reviews.apache.org/r/72675/diff/1/ Testing --- Thanks, Rajesh Balamohan

[jira] [Created] (HIVE-23843) Improve key evictions in VectorGroupByOperator

2020-07-13 Thread Rajesh Balamohan (Jira)
Rajesh Balamohan created HIVE-23843: --- Summary: Improve key evictions in VectorGroupByOperator Key: HIVE-23843 URL: https://issues.apache.org/jira/browse/HIVE-23843 Project: Hive Issue Type

[jira] [Created] (HIVE-23805) ValidReadTxnList need not be constructed multiple times in AcidUtils::getAcidState

2020-07-06 Thread Rajesh Balamohan (Jira)
Rajesh Balamohan created HIVE-23805: --- Summary: ValidReadTxnList need not be constructed multiple times in AcidUtils::getAcidState Key: HIVE-23805 URL: https://issues.apache.org/jira/browse/HIVE-23805

[jira] [Created] (HIVE-23788) FilterStatsRule misestimate causes hashtable computation to rehash often

2020-07-01 Thread Rajesh Balamohan (Jira)
Rajesh Balamohan created HIVE-23788: --- Summary: FilterStatsRule misestimate causes hashtable computation to rehash often Key: HIVE-23788 URL: https://issues.apache.org/jira/browse/HIVE-23788 Project

[jira] [Created] (HIVE-23754) LLAP: Add LoggingHandler in ShuffleHandler pipeline for better debuggability

2020-06-23 Thread Rajesh Balamohan (Jira)
Rajesh Balamohan created HIVE-23754: --- Summary: LLAP: Add LoggingHandler in ShuffleHandler pipeline for better debuggability Key: HIVE-23754 URL: https://issues.apache.org/jira/browse/HIVE-23754

[jira] [Created] (HIVE-23739) ShuffleHandler: Unordered partitioned data could be evicted immediately after transfer

2020-06-22 Thread Rajesh Balamohan (Jira)
Rajesh Balamohan created HIVE-23739: --- Summary: ShuffleHandler: Unordered partitioned data could be evicted immediately after transfer Key: HIVE-23739 URL: https://issues.apache.org/jira/browse/HIVE-23739

[jira] [Created] (HIVE-23738) DBLockManager::lock() : Move lock request to debug level

2020-06-22 Thread Rajesh Balamohan (Jira)
Rajesh Balamohan created HIVE-23738: --- Summary: DBLockManager::lock() : Move lock request to debug level Key: HIVE-23738 URL: https://issues.apache.org/jira/browse/HIVE-23738 Project: Hive

[jira] [Created] (HIVE-23735) Reducer misestimate for export command

2020-06-21 Thread Rajesh Balamohan (Jira)
Rajesh Balamohan created HIVE-23735: --- Summary: Reducer misestimate for export command Key: HIVE-23735 URL: https://issues.apache.org/jira/browse/HIVE-23735 Project: Hive Issue Type

[jira] [Created] (HIVE-23597) VectorizedOrcAcidRowBatchReader::ColumnizedDeleteEventRegistry reads delete delta directories multiple times

2020-06-03 Thread Rajesh Balamohan (Jira)
Rajesh Balamohan created HIVE-23597: --- Summary: VectorizedOrcAcidRowBatchReader::ColumnizedDeleteEventRegistry reads delete delta directories multiple times Key: HIVE-23597 URL: https://issues.apache.org/jira

[jira] [Created] (HIVE-23559) Optimise Hive::moveAcidFiles for cloud storage

2020-05-27 Thread Rajesh Balamohan (Jira)
Rajesh Balamohan created HIVE-23559: --- Summary: Optimise Hive::moveAcidFiles for cloud storage Key: HIVE-23559 URL: https://issues.apache.org/jira/browse/HIVE-23559 Project: Hive Issue Type

Re: Review Request 72521: HIVE-23487: Optimise PartitionManagementTask

2020-05-26 Thread Rajesh Balamohan
c == null) so would have happened > > only once, but now will happen everytime. > > Can you explain how this change is more performant? > > Rajesh Balamohan wrote: > This is because, it was creating this for every table. > > With the fix in "PartitionManage

[jira] [Created] (HIVE-23551) Acid: Update queries should purge dir cache entry in AcidUtils

2020-05-26 Thread Rajesh Balamohan (Jira)
Rajesh Balamohan created HIVE-23551: --- Summary: Acid: Update queries should purge dir cache entry in AcidUtils Key: HIVE-23551 URL: https://issues.apache.org/jira/browse/HIVE-23551 Project: Hive

Re: Review Request 72521: HIVE-23487: Optimise PartitionManagementTask

2020-05-26 Thread Rajesh Balamohan
and reuses it across tables. (i.e in Configuration msckConf = Msck.getMsckConf(conf);) - Rajesh --- This is an automatically generated e-mail. To reply, visit: https://reviews.apache.org/r/72521/#review220874 ----

[jira] [Created] (HIVE-23521) REPL: Optimise partition loading during bootstrap

2020-05-20 Thread Rajesh Balamohan (Jira)
Rajesh Balamohan created HIVE-23521: --- Summary: REPL: Optimise partition loading during bootstrap Key: HIVE-23521 URL: https://issues.apache.org/jira/browse/HIVE-23521 Project: Hive Issue

[jira] [Created] (HIVE-23520) REPL: repl dump could add support for immutable dataset

2020-05-20 Thread Rajesh Balamohan (Jira)
Rajesh Balamohan created HIVE-23520: --- Summary: REPL: repl dump could add support for immutable dataset Key: HIVE-23520 URL: https://issues.apache.org/jira/browse/HIVE-23520 Project: Hive

[jira] [Created] (HIVE-23499) REPL: repl load should honor "hive.repl.dump.metadata.only=true"

2020-05-18 Thread Rajesh Balamohan (Jira)
Rajesh Balamohan created HIVE-23499: --- Summary: REPL: repl load should honor "hive.repl.dump.metadata.only=true" Key: HIVE-23499 URL: https://issues.apache.org/jira/browse/HIVE-23499 Pro

Review Request 72522: HIVE-23488: Optimise PartitionManagementTask::Msck::repair

2020-05-17 Thread Rajesh Balamohan
/HiveMetaStoreChecker.java 6f4400a8ef standalone-metastore/metastore-server/src/main/java/org/apache/hadoop/hive/metastore/Msck.java f4e109d1b0 Diff: https://reviews.apache.org/r/72522/diff/1/ Testing --- Thanks, Rajesh Balamohan

Review Request 72521: HIVE-23487: Optimise PartitionManagementTask

2020-05-17 Thread Rajesh Balamohan
/metastore-server/src/main/java/org/apache/hadoop/hive/metastore/PartitionManagementTask.java e4488f4709 Diff: https://reviews.apache.org/r/72521/diff/1/ Testing --- Thanks, Rajesh Balamohan

[jira] [Created] (HIVE-23488) Optimise PartitionManagementTask::Msck::repair

2020-05-17 Thread Rajesh Balamohan (Jira)
Rajesh Balamohan created HIVE-23488: --- Summary: Optimise PartitionManagementTask::Msck::repair Key: HIVE-23488 URL: https://issues.apache.org/jira/browse/HIVE-23488 Project: Hive Issue Type

[jira] [Created] (HIVE-23487) Optimise PartitionManagementTask

2020-05-17 Thread Rajesh Balamohan (Jira)
Rajesh Balamohan created HIVE-23487: --- Summary: Optimise PartitionManagementTask Key: HIVE-23487 URL: https://issues.apache.org/jira/browse/HIVE-23487 Project: Hive Issue Type: Improvement

[jira] [Created] (HIVE-23468) LLAP: Optimise OrcEncodedDataReader to avoid FS init to NN

2020-05-14 Thread Rajesh Balamohan (Jira)
Rajesh Balamohan created HIVE-23468: --- Summary: LLAP: Optimise OrcEncodedDataReader to avoid FS init to NN Key: HIVE-23468 URL: https://issues.apache.org/jira/browse/HIVE-23468 Project: Hive

Re: Review Request 72499: HIVE-23446:LLAP: Reduce IPC connection misses to AM for short queries

2020-05-14 Thread Rajesh Balamohan
/impl/TaskExecutorTestHelpers.java 50dec4759e Diff: https://reviews.apache.org/r/72499/diff/3/ Changes: https://reviews.apache.org/r/72499/diff/2-3/ Testing --- Thanks, Rajesh Balamohan

Re: Review Request 72499: HIVE-23446:LLAP: Reduce IPC connection misses to AM for short queries

2020-05-14 Thread Rajesh Balamohan
> > Is this logic needed? You already have valueloader in get() which must > > return a ugi, so it cant be null. > > Rajesh Balamohan wrote: > Yes, value loader is for initial miss. This is to avoid single connection > becoming a contention for AM communication. > ht

Re: Review Request 72499: HIVE-23446:LLAP: Reduce IPC connection misses to AM for short queries

2020-05-14 Thread Rajesh Balamohan
/daemon/impl/QueryTracker.java eae8e08540 llap-server/src/test/org/apache/hadoop/hive/llap/daemon/impl/TaskExecutorTestHelpers.java 50dec4759e Diff: https://reviews.apache.org/r/72499/diff/2/ Changes: https://reviews.apache.org/r/72499/diff/1-2/ Testing --- Thanks, Rajesh Balamohan

Re: Review Request 72499: HIVE-23446:LLAP: Reduce IPC connection misses to AM for short queries

2020-05-13 Thread Rajesh Balamohan
----- On May 12, 2020, 12:06 p.m., Rajesh Balamohan wrote: > > --- > This is an automatically generated e-mail. To reply, visit: > https://reviews.apache.org/r/72499/ > ---

Re: Review Request 72499: HIVE-23446:LLAP: Reduce IPC connection misses to AM for short queries

2020-05-13 Thread Rajesh Balamohan
--- This is an automatically generated e-mail. To reply, visit: https://reviews.apache.org/r/72499/#review220748 --- On May 12, 2020, 12:06 p.m., Rajesh Balamohan wrote: > >

[jira] [Created] (HIVE-23459) Reduce number of listPath calls in AcidUtils::getAcidState

2020-05-13 Thread Rajesh Balamohan (Jira)
Rajesh Balamohan created HIVE-23459: --- Summary: Reduce number of listPath calls in AcidUtils::getAcidState Key: HIVE-23459 URL: https://issues.apache.org/jira/browse/HIVE-23459 Project: Hive

Re: Review Request 72503: HIVE-23449: LLAP: Reduce mkdir and config creations in submitWork hotpath

2020-05-12 Thread Rajesh Balamohan
omatically generated e-mail. To reply, visit: https://reviews.apache.org/r/72503/#review220734 ------- On May 13, 2020, 2:28 a.m., Rajesh Balamohan wrote: > > --- > This is

Re: Review Request 72503: HIVE-23449: LLAP: Reduce mkdir and config creations in submitWork hotpath

2020-05-12 Thread Rajesh Balamohan
s an automatically generated e-mail. To reply, visit: https://reviews.apache.org/r/72503/#review220732 ------- On May 13, 2020, 2:28 a.m., Rajesh Balamohan wrote: > > --- > This

Re: Review Request 72503: HIVE-23449: LLAP: Reduce mkdir and config creations in submitWork hotpath

2020-05-12 Thread Rajesh Balamohan
/files/2020/05/13/36724ea5-265e-4e61-98a4-18af913b5b48__HIVE-23449.2.patch Thanks, Rajesh Balamohan

Re: Review Request 72503: HIVE-23449: LLAP: Reduce mkdir and config creations in submitWork hotpath

2020-05-12 Thread Rajesh Balamohan
t: https://reviews.apache.org/r/72503/#review220729 ------- On May 12, 2020, 9:59 p.m., Rajesh Balamohan wrote: > > --- > This is an automatically generated e-mail. To reply, visit: > https://reviews.apache.org/r/72503/ >

Review Request 72503: HIVE-23449: LLAP: Reduce mkdir and config creations in submitWork hotpath

2020-05-12 Thread Rajesh Balamohan
/ShuffleHandler.java aff2c2ec39 llap-server/src/test/org/apache/hadoop/hive/llap/daemon/impl/TaskExecutorTestHelpers.java 50dec4759e Diff: https://reviews.apache.org/r/72503/diff/1/ Testing --- Thanks, Rajesh Balamohan

Re: Review Request 72499: HIVE-23446:LLAP: Reduce IPC connection misses to AM for short queries

2020-05-12 Thread Rajesh Balamohan
/impl/TaskExecutorTestHelpers.java 50dec4759e Diff: https://reviews.apache.org/r/72499/diff/1/ Testing --- Thanks, Rajesh Balamohan

Review Request 72499: HIVE-23446:LLAP: Reduce IPC connection misses to AM for short queries

2020-05-12 Thread Rajesh Balamohan
: https://reviews.apache.org/r/72499/diff/1/ Testing --- Thanks, Rajesh Balamohan

[jira] [Created] (HIVE-23451) FileSinkOperator calls deleteOnExit (hdfs call) twice for the same file

2020-05-12 Thread Rajesh Balamohan (Jira)
Rajesh Balamohan created HIVE-23451: --- Summary: FileSinkOperator calls deleteOnExit (hdfs call) twice for the same file Key: HIVE-23451 URL: https://issues.apache.org/jira/browse/HIVE-23451 Project

[jira] [Created] (HIVE-23449) LLAP: Reduce mkdir and config creations in submitWork hotpath

2020-05-12 Thread Rajesh Balamohan (Jira)
Rajesh Balamohan created HIVE-23449: --- Summary: LLAP: Reduce mkdir and config creations in submitWork hotpath Key: HIVE-23449 URL: https://issues.apache.org/jira/browse/HIVE-23449 Project: Hive

[jira] [Created] (HIVE-23446) LLAP: Reduce IPC connection misses to AM for short queries

2020-05-11 Thread Rajesh Balamohan (Jira)
Rajesh Balamohan created HIVE-23446: --- Summary: LLAP: Reduce IPC connection misses to AM for short queries Key: HIVE-23446 URL: https://issues.apache.org/jira/browse/HIVE-23446 Project: Hive

[jira] [Created] (HIVE-23430) Optimise ASTNode::getChildren

2020-05-10 Thread Rajesh Balamohan (Jira)
Rajesh Balamohan created HIVE-23430: --- Summary: Optimise ASTNode::getChildren Key: HIVE-23430 URL: https://issues.apache.org/jira/browse/HIVE-23430 Project: Hive Issue Type: Improvement

[jira] [Created] (HIVE-23429) LLAP: Optimize retrieving queryId details in LlapTaskCommunicator

2020-05-10 Thread Rajesh Balamohan (Jira)
Rajesh Balamohan created HIVE-23429: --- Summary: LLAP: Optimize retrieving queryId details in LlapTaskCommunicator Key: HIVE-23429 URL: https://issues.apache.org/jira/browse/HIVE-23429 Project: Hive

[jira] [Created] (HIVE-23376) Avoid repeated SHA computation in GenericUDTFGetSplits for hive-exec jar

2020-05-06 Thread Rajesh Balamohan (Jira)
Rajesh Balamohan created HIVE-23376: --- Summary: Avoid repeated SHA computation in GenericUDTFGetSplits for hive-exec jar Key: HIVE-23376 URL: https://issues.apache.org/jira/browse/HIVE-23376 Project

[jira] [Created] (HIVE-23318) TxnHandler need not delete from MATERIALIZATION_REBUILD_LOCKS on need basis

2020-04-29 Thread Rajesh Balamohan (Jira)
Rajesh Balamohan created HIVE-23318: --- Summary: TxnHandler need not delete from MATERIALIZATION_REBUILD_LOCKS on need basis Key: HIVE-23318 URL: https://issues.apache.org/jira/browse/HIVE-23318

Review Request 72434: Reduce number of DB calls in ObjectStore::getPartitionsByExprInternal

2020-04-26 Thread Rajesh Balamohan
/1/ Testing --- Thanks, Rajesh Balamohan

[jira] [Created] (HIVE-23294) Remove sync bottlneck in TezConfigurationFactory

2020-04-24 Thread Rajesh Balamohan (Jira)
Rajesh Balamohan created HIVE-23294: --- Summary: Remove sync bottlneck in TezConfigurationFactory Key: HIVE-23294 URL: https://issues.apache.org/jira/browse/HIVE-23294 Project: Hive Issue

[jira] [Created] (HIVE-23292) Reduce PartitionDesc payload in MapWork

2020-04-24 Thread Rajesh Balamohan (Jira)
Rajesh Balamohan created HIVE-23292: --- Summary: Reduce PartitionDesc payload in MapWork Key: HIVE-23292 URL: https://issues.apache.org/jira/browse/HIVE-23292 Project: Hive Issue Type

[jira] [Created] (HIVE-23282) Reduce number of DB calls in ObjectStore::getPartitionsByExprInternal

2020-04-23 Thread Rajesh Balamohan (Jira)
Rajesh Balamohan created HIVE-23282: --- Summary: Reduce number of DB calls in ObjectStore::getPartitionsByExprInternal Key: HIVE-23282 URL: https://issues.apache.org/jira/browse/HIVE-23282 Project

[jira] [Created] (HIVE-23281) ObjectStore::convertToStorageDescriptor can be optimised to reduce calls to DB for ACID tables

2020-04-23 Thread Rajesh Balamohan (Jira)
Rajesh Balamohan created HIVE-23281: --- Summary: ObjectStore::convertToStorageDescriptor can be optimised to reduce calls to DB for ACID tables Key: HIVE-23281 URL: https://issues.apache.org/jira/browse/HIVE

[jira] [Created] (HIVE-23277) HiveProtoLogger should carry out JSON conversion in its own thread

2020-04-22 Thread Rajesh Balamohan (Jira)
Rajesh Balamohan created HIVE-23277: --- Summary: HiveProtoLogger should carry out JSON conversion in its own thread Key: HIVE-23277 URL: https://issues.apache.org/jira/browse/HIVE-23277 Project: Hive

[jira] [Created] (HIVE-23261) Check whether encryption is enabled in the cluster before moving files

2020-04-20 Thread Rajesh Balamohan (Jira)
Rajesh Balamohan created HIVE-23261: --- Summary: Check whether encryption is enabled in the cluster before moving files Key: HIVE-23261 URL: https://issues.apache.org/jira/browse/HIVE-23261 Project

[jira] [Created] (HIVE-23218) LlapRecordReader queue limit computation is not optimal

2020-04-15 Thread Rajesh Balamohan (Jira)
Rajesh Balamohan created HIVE-23218: --- Summary: LlapRecordReader queue limit computation is not optimal Key: HIVE-23218 URL: https://issues.apache.org/jira/browse/HIVE-23218 Project: Hive

[jira] [Created] (HIVE-23212) SemanticAnalyzer::getStagingDirectoryPathname should check for encryption zone only when needed

2020-04-15 Thread Rajesh Balamohan (Jira)
Rajesh Balamohan created HIVE-23212: --- Summary: SemanticAnalyzer::getStagingDirectoryPathname should check for encryption zone only when needed Key: HIVE-23212 URL: https://issues.apache.org/jira/browse/HIVE

[jira] [Created] (HIVE-23210) Fix shortestjobcomparator when jobs submitted have 1 task their vertices

2020-04-15 Thread Rajesh Balamohan (Jira)
Rajesh Balamohan created HIVE-23210: --- Summary: Fix shortestjobcomparator when jobs submitted have 1 task their vertices Key: HIVE-23210 URL: https://issues.apache.org/jira/browse/HIVE-23210 Project

[jira] [Created] (HIVE-23208) Update guranteed capacity in ZK only when WM is enabled

2020-04-14 Thread Rajesh Balamohan (Jira)
Rajesh Balamohan created HIVE-23208: --- Summary: Update guranteed capacity in ZK only when WM is enabled Key: HIVE-23208 URL: https://issues.apache.org/jira/browse/HIVE-23208 Project: Hive

[jira] [Created] (HIVE-23196) Reduce number of delete calls to NN during Context::clear

2020-04-14 Thread Rajesh Balamohan (Jira)
Rajesh Balamohan created HIVE-23196: --- Summary: Reduce number of delete calls to NN during Context::clear Key: HIVE-23196 URL: https://issues.apache.org/jira/browse/HIVE-23196 Project: Hive

Re: Review Request 72333: HIVE-23154: Fix race condition in Utilities::mvFileToFinalPath

2020-04-09 Thread Rajesh Balamohan
-- File Attachments (updated) HIVE-23154.3.patch https://reviews.apache.org/media/uploaded/files/2020/04/09/38ab8dfe-18c2-4174-84da-e1028ad4133c__HIVE-23154.3.patch Thanks, Rajesh Balamohan

Review Request 72333: HIVE-23154: Fix race condition in Utilities::mvFileToFinalPath

2020-04-08 Thread Rajesh Balamohan
Patch fixes this issue as well. Diffs - ql/src/java/org/apache/hadoop/hive/ql/exec/Utilities.java e25dc54e7d Diff: https://reviews.apache.org/r/72333/diff/1/ Testing --- Thanks, Rajesh Balamohan

[jira] [Created] (HIVE-23154) Fix race condition in Utilities::mvFileToFinalPath

2020-04-08 Thread Rajesh Balamohan (Jira)
Rajesh Balamohan created HIVE-23154: --- Summary: Fix race condition in Utilities::mvFileToFinalPath Key: HIVE-23154 URL: https://issues.apache.org/jira/browse/HIVE-23154 Project: Hive Issue

[jira] [Created] (HIVE-23140) Optimise file move in CTAS

2020-04-06 Thread Rajesh Balamohan (Jira)
Rajesh Balamohan created HIVE-23140: --- Summary: Optimise file move in CTAS Key: HIVE-23140 URL: https://issues.apache.org/jira/browse/HIVE-23140 Project: Hive Issue Type: Improvement

[jira] [Created] (HIVE-23083) Enable fast serialization in xprod edge

2020-03-26 Thread Rajesh Balamohan (Jira)
Rajesh Balamohan created HIVE-23083: --- Summary: Enable fast serialization in xprod edge Key: HIVE-23083 URL: https://issues.apache.org/jira/browse/HIVE-23083 Project: Hive Issue Type

[jira] [Created] (HIVE-23029) LLAP: Shuffle Handler should support Index Cache configuration

2020-03-16 Thread Rajesh Balamohan (Jira)
Rajesh Balamohan created HIVE-23029: --- Summary: LLAP: Shuffle Handler should support Index Cache configuration Key: HIVE-23029 URL: https://issues.apache.org/jira/browse/HIVE-23029 Project: Hive

[jira] [Created] (HIVE-23027) Fix syntax error in llap package.py

2020-03-15 Thread Rajesh Balamohan (Jira)
Rajesh Balamohan created HIVE-23027: --- Summary: Fix syntax error in llap package.py Key: HIVE-23027 URL: https://issues.apache.org/jira/browse/HIVE-23027 Project: Hive Issue Type: Bug

[jira] [Created] (HIVE-23002) Optimise LazyBinaryUtils.writeVLong

2020-03-09 Thread Rajesh Balamohan (Jira)
Rajesh Balamohan created HIVE-23002: --- Summary: Optimise LazyBinaryUtils.writeVLong Key: HIVE-23002 URL: https://issues.apache.org/jira/browse/HIVE-23002 Project: Hive Issue Type

Review Request 72213: HIVE-22975: Optimise TopNKeyFilter with boundary checks

2020-03-08 Thread Rajesh Balamohan
/r/72213/diff/1/ Testing --- Yes. Updated in ticket Thanks, Rajesh Balamohan

  1   2   3   4   5   >