Rajesh Balamohan created HIVE-24520:
---
Summary: Fix stackoverflow error in
HiveMetaStore::get_partitions_by_names
Key: HIVE-24520
URL: https://issues.apache.org/jira/browse/HIVE-24520
Project: Hive
Rajesh Balamohan created HIVE-24519:
---
Summary: Optimize MV: Materialized views should not rebuild when
tables are not modified
Key: HIVE-24519
URL: https://issues.apache.org/jira/browse/HIVE-24519
Rajesh Balamohan created HIVE-24515:
---
Summary: Analyze table job can be skipped when stats populated are
already accurate
Key: HIVE-24515
URL: https://issues.apache.org/jira/browse/HIVE-24515
Rajesh Balamohan created HIVE-24472:
---
Summary: Optimize LlapTaskSchedulerService::preemptTasksFromMap
Key: HIVE-24472
URL: https://issues.apache.org/jira/browse/HIVE-24472
Project: Hive
Rajesh Balamohan created HIVE-24466:
---
Summary: insert queries should not launch job when condition in
the query would output 0 rows
Key: HIVE-24466
URL: https://issues.apache.org/jira/browse/HIVE-24466
Rajesh Balamohan created HIVE-24443:
---
Summary: Optimise VectorSerializeRow for primitives
Key: HIVE-24443
URL: https://issues.apache.org/jira/browse/HIVE-24443
Project: Hive
Issue Type
Rajesh Balamohan created HIVE-24416:
---
Summary: Optimise HiveCharWritable::getStrippedValue
Key: HIVE-24416
URL: https://issues.apache.org/jira/browse/HIVE-24416
Project: Hive
Issue Type
Rajesh Balamohan created HIVE-24409:
---
Summary: Use LazyBinarySerDe2 in PlanUtils::getReduceValueTableDesc
Key: HIVE-24409
URL: https://issues.apache.org/jira/browse/HIVE-24409
Project: Hive
Rajesh Balamohan created HIVE-24368:
---
Summary: Optimise AcidUtils::getAcidFilesForStats for ACID tables
Key: HIVE-24368
URL: https://issues.apache.org/jira/browse/HIVE-24368
Project: Hive
Rajesh Balamohan created HIVE-24367:
---
Summary: Explore whether HiveAlterHandler::alterTable can be
optimised for non-partitioned tablesInbox
Key: HIVE-24367
URL: https://issues.apache.org/jira/browse/HIVE-24367
Rajesh Balamohan created HIVE-24313:
---
Summary: Optimise stats collection for file sizes on cloud storage
Key: HIVE-24313
URL: https://issues.apache.org/jira/browse/HIVE-24313
Project: Hive
Rajesh Balamohan created HIVE-24296:
---
Summary: NDV adjusted twice causing reducer task underestimation
Key: HIVE-24296
URL: https://issues.apache.org/jira/browse/HIVE-24296
Project: Hive
Rajesh Balamohan created HIVE-24290:
---
Summary: Explain analyze can be slow in cloud storage
Key: HIVE-24290
URL: https://issues.apache.org/jira/browse/HIVE-24290
Project: Hive
Issue Type
Rajesh Balamohan created HIVE-24289:
---
Summary: RetryingMetaStoreClient should not retry connecting to
HMS on genuine errors
Key: HIVE-24289
URL: https://issues.apache.org/jira/browse/HIVE-24289
Rajesh Balamohan created HIVE-24262:
---
Summary: Optimise NullScanTaskDispatcher for cloud storage
Key: HIVE-24262
URL: https://issues.apache.org/jira/browse/HIVE-24262
Project: Hive
Issue
Rajesh Balamohan created HIVE-24234:
---
Summary: Improve checkHashModeEfficiency in VectorGroupByOperator
Key: HIVE-24234
URL: https://issues.apache.org/jira/browse/HIVE-24234
Project: Hive
Rajesh Balamohan created HIVE-24212:
---
Summary: Refactor to take advantage of listStatus optimisations in
cloud storage connectors
Key: HIVE-24212
URL: https://issues.apache.org/jira/browse/HIVE-24212
Rajesh Balamohan created HIVE-24207:
---
Summary: LimitOperator can leverage ObjectCache to bail out quickly
Key: HIVE-24207
URL: https://issues.apache.org/jira/browse/HIVE-24207
Project: Hive
Rajesh Balamohan created HIVE-24205:
---
Summary: Optimise CuckooSetBytes
Key: HIVE-24205
URL: https://issues.apache.org/jira/browse/HIVE-24205
Project: Hive
Issue Type: Improvement
Rajesh Balamohan created HIVE-24116:
---
Summary: LLAP: Provide an opportunity for preempted tasks to get
better locality in next iteration
Key: HIVE-24116
URL: https://issues.apache.org/jira/browse/HIVE-24116
Rajesh Balamohan created HIVE-24075:
---
Summary: Optimise KeyValuesInputMerger
Key: HIVE-24075
URL: https://issues.apache.org/jira/browse/HIVE-24075
Project: Hive
Issue Type: Improvement
Rajesh Balamohan created HIVE-24061:
---
Summary: Improve llap task scheduling for better cache hit rate
Key: HIVE-24061
URL: https://issues.apache.org/jira/browse/HIVE-24061
Project: Hive
Rajesh Balamohan created HIVE-24029:
---
Summary: MV fails for queries with subqueries
Key: HIVE-24029
URL: https://issues.apache.org/jira/browse/HIVE-24029
Project: Hive
Issue Type: Sub-task
Rajesh Balamohan created HIVE-24028:
---
Summary: MV query fails with CalciteViewSemanticException
Key: HIVE-24028
URL: https://issues.apache.org/jira/browse/HIVE-24028
Project: Hive
Issue
Rajesh Balamohan created HIVE-24027:
---
Summary: Add support for `intersect` keyword in MV
Key: HIVE-24027
URL: https://issues.apache.org/jira/browse/HIVE-24027
Project: Hive
Issue Type: Sub
Rajesh Balamohan created HIVE-24022:
---
Summary: Optimise
HiveMetaStoreAuthorizer.createHiveMetaStoreAuthorizer
Key: HIVE-24022
URL: https://issues.apache.org/jira/browse/HIVE-24022
Project: Hive
Rajesh Balamohan created HIVE-23953:
---
Summary: Use task counter information to compute keycount during
hashtable loading
Key: HIVE-23953
URL: https://issues.apache.org/jira/browse/HIVE-23953
Rajesh Balamohan created HIVE-23952:
---
Summary: Reuse VectorAggregationBuffer to reduce GC pressure in
VectorGroupByOperator
Key: HIVE-23952
URL: https://issues.apache.org/jira/browse/HIVE-23952
Rajesh Balamohan created HIVE-23936:
---
Summary: Provide approximate number of input records to be
processed in broadcast reader
Key: HIVE-23936
URL: https://issues.apache.org/jira/browse/HIVE-23936
Rajesh Balamohan created HIVE-23917:
---
Summary: Reset key access count during eviction in
VectorGroupByOperator
Key: HIVE-23917
URL: https://issues.apache.org/jira/browse/HIVE-23917
Project: Hive
/diff/1-2/
Testing
---
Thanks,
Rajesh Balamohan
Rajesh Balamohan created HIVE-23884:
---
Summary: SemanticAnalyze exception when addressing field with
table name in group by
Key: HIVE-23884
URL: https://issues.apache.org/jira/browse/HIVE-23884
Rajesh Balamohan created HIVE-23878:
---
Summary: Aggregate after join throws off MV rewrite
Key: HIVE-23878
URL: https://issues.apache.org/jira/browse/HIVE-23878
Project: Hive
Issue Type
Rajesh Balamohan created HIVE-23870:
---
Summary: Optimise multiple text conversions in
WritableHiveCharObjectInspector.getPrimitiveJavaObjec
Key: HIVE-23870
URL: https://issues.apache.org/jira/browse/HIVE-23870
/vector/TestVectorGroupByOperator.java
3835987170
Diff: https://reviews.apache.org/r/72675/diff/1/
Testing
---
Thanks,
Rajesh Balamohan
Rajesh Balamohan created HIVE-23843:
---
Summary: Improve key evictions in VectorGroupByOperator
Key: HIVE-23843
URL: https://issues.apache.org/jira/browse/HIVE-23843
Project: Hive
Issue Type
Rajesh Balamohan created HIVE-23805:
---
Summary: ValidReadTxnList need not be constructed multiple times
in AcidUtils::getAcidState
Key: HIVE-23805
URL: https://issues.apache.org/jira/browse/HIVE-23805
Rajesh Balamohan created HIVE-23788:
---
Summary: FilterStatsRule misestimate causes hashtable computation
to rehash often
Key: HIVE-23788
URL: https://issues.apache.org/jira/browse/HIVE-23788
Project
Rajesh Balamohan created HIVE-23754:
---
Summary: LLAP: Add LoggingHandler in ShuffleHandler pipeline for
better debuggability
Key: HIVE-23754
URL: https://issues.apache.org/jira/browse/HIVE-23754
Rajesh Balamohan created HIVE-23739:
---
Summary: ShuffleHandler: Unordered partitioned data could be
evicted immediately after transfer
Key: HIVE-23739
URL: https://issues.apache.org/jira/browse/HIVE-23739
Rajesh Balamohan created HIVE-23738:
---
Summary: DBLockManager::lock() : Move lock request to debug level
Key: HIVE-23738
URL: https://issues.apache.org/jira/browse/HIVE-23738
Project: Hive
Rajesh Balamohan created HIVE-23735:
---
Summary: Reducer misestimate for export command
Key: HIVE-23735
URL: https://issues.apache.org/jira/browse/HIVE-23735
Project: Hive
Issue Type
Rajesh Balamohan created HIVE-23597:
---
Summary:
VectorizedOrcAcidRowBatchReader::ColumnizedDeleteEventRegistry reads delete
delta directories multiple times
Key: HIVE-23597
URL: https://issues.apache.org/jira
Rajesh Balamohan created HIVE-23559:
---
Summary: Optimise Hive::moveAcidFiles for cloud storage
Key: HIVE-23559
URL: https://issues.apache.org/jira/browse/HIVE-23559
Project: Hive
Issue Type
c == null) so would have happened
> > only once, but now will happen everytime.
> > Can you explain how this change is more performant?
>
> Rajesh Balamohan wrote:
> This is because, it was creating this for every table.
>
> With the fix in "PartitionManage
Rajesh Balamohan created HIVE-23551:
---
Summary: Acid: Update queries should purge dir cache entry in
AcidUtils
Key: HIVE-23551
URL: https://issues.apache.org/jira/browse/HIVE-23551
Project: Hive
and reuses it across tables. (i.e in Configuration msckConf =
Msck.getMsckConf(conf);)
- Rajesh
---
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/72521/#review220874
----
Rajesh Balamohan created HIVE-23521:
---
Summary: REPL: Optimise partition loading during bootstrap
Key: HIVE-23521
URL: https://issues.apache.org/jira/browse/HIVE-23521
Project: Hive
Issue
Rajesh Balamohan created HIVE-23520:
---
Summary: REPL: repl dump could add support for immutable dataset
Key: HIVE-23520
URL: https://issues.apache.org/jira/browse/HIVE-23520
Project: Hive
Rajesh Balamohan created HIVE-23499:
---
Summary: REPL: repl load should honor
"hive.repl.dump.metadata.only=true"
Key: HIVE-23499
URL: https://issues.apache.org/jira/browse/HIVE-23499
Pro
/HiveMetaStoreChecker.java
6f4400a8ef
standalone-metastore/metastore-server/src/main/java/org/apache/hadoop/hive/metastore/Msck.java
f4e109d1b0
Diff: https://reviews.apache.org/r/72522/diff/1/
Testing
---
Thanks,
Rajesh Balamohan
/metastore-server/src/main/java/org/apache/hadoop/hive/metastore/PartitionManagementTask.java
e4488f4709
Diff: https://reviews.apache.org/r/72521/diff/1/
Testing
---
Thanks,
Rajesh Balamohan
Rajesh Balamohan created HIVE-23488:
---
Summary: Optimise PartitionManagementTask::Msck::repair
Key: HIVE-23488
URL: https://issues.apache.org/jira/browse/HIVE-23488
Project: Hive
Issue Type
Rajesh Balamohan created HIVE-23487:
---
Summary: Optimise PartitionManagementTask
Key: HIVE-23487
URL: https://issues.apache.org/jira/browse/HIVE-23487
Project: Hive
Issue Type: Improvement
Rajesh Balamohan created HIVE-23468:
---
Summary: LLAP: Optimise OrcEncodedDataReader to avoid FS init to NN
Key: HIVE-23468
URL: https://issues.apache.org/jira/browse/HIVE-23468
Project: Hive
/impl/TaskExecutorTestHelpers.java
50dec4759e
Diff: https://reviews.apache.org/r/72499/diff/3/
Changes: https://reviews.apache.org/r/72499/diff/2-3/
Testing
---
Thanks,
Rajesh Balamohan
> > Is this logic needed? You already have valueloader in get() which must
> > return a ugi, so it cant be null.
>
> Rajesh Balamohan wrote:
> Yes, value loader is for initial miss. This is to avoid single connection
> becoming a contention for AM communication.
> ht
/daemon/impl/QueryTracker.java
eae8e08540
llap-server/src/test/org/apache/hadoop/hive/llap/daemon/impl/TaskExecutorTestHelpers.java
50dec4759e
Diff: https://reviews.apache.org/r/72499/diff/2/
Changes: https://reviews.apache.org/r/72499/diff/1-2/
Testing
---
Thanks,
Rajesh Balamohan
-----
On May 12, 2020, 12:06 p.m., Rajesh Balamohan wrote:
>
> ---
> This is an automatically generated e-mail. To reply, visit:
> https://reviews.apache.org/r/72499/
> ---
---
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/72499/#review220748
---
On May 12, 2020, 12:06 p.m., Rajesh Balamohan wrote:
>
>
Rajesh Balamohan created HIVE-23459:
---
Summary: Reduce number of listPath calls in AcidUtils::getAcidState
Key: HIVE-23459
URL: https://issues.apache.org/jira/browse/HIVE-23459
Project: Hive
omatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/72503/#review220734
-------
On May 13, 2020, 2:28 a.m., Rajesh Balamohan wrote:
>
> ---
> This is
s an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/72503/#review220732
-------
On May 13, 2020, 2:28 a.m., Rajesh Balamohan wrote:
>
> ---
> This
/files/2020/05/13/36724ea5-265e-4e61-98a4-18af913b5b48__HIVE-23449.2.patch
Thanks,
Rajesh Balamohan
t:
https://reviews.apache.org/r/72503/#review220729
-------
On May 12, 2020, 9:59 p.m., Rajesh Balamohan wrote:
>
> ---
> This is an automatically generated e-mail. To reply, visit:
> https://reviews.apache.org/r/72503/
>
/ShuffleHandler.java
aff2c2ec39
llap-server/src/test/org/apache/hadoop/hive/llap/daemon/impl/TaskExecutorTestHelpers.java
50dec4759e
Diff: https://reviews.apache.org/r/72503/diff/1/
Testing
---
Thanks,
Rajesh Balamohan
/impl/TaskExecutorTestHelpers.java
50dec4759e
Diff: https://reviews.apache.org/r/72499/diff/1/
Testing
---
Thanks,
Rajesh Balamohan
: https://reviews.apache.org/r/72499/diff/1/
Testing
---
Thanks,
Rajesh Balamohan
Rajesh Balamohan created HIVE-23451:
---
Summary: FileSinkOperator calls deleteOnExit (hdfs call) twice for
the same file
Key: HIVE-23451
URL: https://issues.apache.org/jira/browse/HIVE-23451
Project
Rajesh Balamohan created HIVE-23449:
---
Summary: LLAP: Reduce mkdir and config creations in submitWork
hotpath
Key: HIVE-23449
URL: https://issues.apache.org/jira/browse/HIVE-23449
Project: Hive
Rajesh Balamohan created HIVE-23446:
---
Summary: LLAP: Reduce IPC connection misses to AM for short queries
Key: HIVE-23446
URL: https://issues.apache.org/jira/browse/HIVE-23446
Project: Hive
Rajesh Balamohan created HIVE-23430:
---
Summary: Optimise ASTNode::getChildren
Key: HIVE-23430
URL: https://issues.apache.org/jira/browse/HIVE-23430
Project: Hive
Issue Type: Improvement
Rajesh Balamohan created HIVE-23429:
---
Summary: LLAP: Optimize retrieving queryId details in
LlapTaskCommunicator
Key: HIVE-23429
URL: https://issues.apache.org/jira/browse/HIVE-23429
Project: Hive
Rajesh Balamohan created HIVE-23376:
---
Summary: Avoid repeated SHA computation in GenericUDTFGetSplits
for hive-exec jar
Key: HIVE-23376
URL: https://issues.apache.org/jira/browse/HIVE-23376
Project
Rajesh Balamohan created HIVE-23318:
---
Summary: TxnHandler need not delete from
MATERIALIZATION_REBUILD_LOCKS on need basis
Key: HIVE-23318
URL: https://issues.apache.org/jira/browse/HIVE-23318
/1/
Testing
---
Thanks,
Rajesh Balamohan
Rajesh Balamohan created HIVE-23294:
---
Summary: Remove sync bottlneck in TezConfigurationFactory
Key: HIVE-23294
URL: https://issues.apache.org/jira/browse/HIVE-23294
Project: Hive
Issue
Rajesh Balamohan created HIVE-23292:
---
Summary: Reduce PartitionDesc payload in MapWork
Key: HIVE-23292
URL: https://issues.apache.org/jira/browse/HIVE-23292
Project: Hive
Issue Type
Rajesh Balamohan created HIVE-23282:
---
Summary: Reduce number of DB calls in
ObjectStore::getPartitionsByExprInternal
Key: HIVE-23282
URL: https://issues.apache.org/jira/browse/HIVE-23282
Project
Rajesh Balamohan created HIVE-23281:
---
Summary: ObjectStore::convertToStorageDescriptor can be optimised
to reduce calls to DB for ACID tables
Key: HIVE-23281
URL: https://issues.apache.org/jira/browse/HIVE
Rajesh Balamohan created HIVE-23277:
---
Summary: HiveProtoLogger should carry out JSON conversion in its
own thread
Key: HIVE-23277
URL: https://issues.apache.org/jira/browse/HIVE-23277
Project: Hive
Rajesh Balamohan created HIVE-23261:
---
Summary: Check whether encryption is enabled in the cluster before
moving files
Key: HIVE-23261
URL: https://issues.apache.org/jira/browse/HIVE-23261
Project
Rajesh Balamohan created HIVE-23218:
---
Summary: LlapRecordReader queue limit computation is not optimal
Key: HIVE-23218
URL: https://issues.apache.org/jira/browse/HIVE-23218
Project: Hive
Rajesh Balamohan created HIVE-23212:
---
Summary: SemanticAnalyzer::getStagingDirectoryPathname should
check for encryption zone only when needed
Key: HIVE-23212
URL: https://issues.apache.org/jira/browse/HIVE
Rajesh Balamohan created HIVE-23210:
---
Summary: Fix shortestjobcomparator when jobs submitted have 1 task
their vertices
Key: HIVE-23210
URL: https://issues.apache.org/jira/browse/HIVE-23210
Project
Rajesh Balamohan created HIVE-23208:
---
Summary: Update guranteed capacity in ZK only when WM is enabled
Key: HIVE-23208
URL: https://issues.apache.org/jira/browse/HIVE-23208
Project: Hive
Rajesh Balamohan created HIVE-23196:
---
Summary: Reduce number of delete calls to NN during Context::clear
Key: HIVE-23196
URL: https://issues.apache.org/jira/browse/HIVE-23196
Project: Hive
--
File Attachments (updated)
HIVE-23154.3.patch
https://reviews.apache.org/media/uploaded/files/2020/04/09/38ab8dfe-18c2-4174-84da-e1028ad4133c__HIVE-23154.3.patch
Thanks,
Rajesh Balamohan
Patch fixes this issue as well.
Diffs
-
ql/src/java/org/apache/hadoop/hive/ql/exec/Utilities.java e25dc54e7d
Diff: https://reviews.apache.org/r/72333/diff/1/
Testing
---
Thanks,
Rajesh Balamohan
Rajesh Balamohan created HIVE-23154:
---
Summary: Fix race condition in Utilities::mvFileToFinalPath
Key: HIVE-23154
URL: https://issues.apache.org/jira/browse/HIVE-23154
Project: Hive
Issue
Rajesh Balamohan created HIVE-23140:
---
Summary: Optimise file move in CTAS
Key: HIVE-23140
URL: https://issues.apache.org/jira/browse/HIVE-23140
Project: Hive
Issue Type: Improvement
Rajesh Balamohan created HIVE-23083:
---
Summary: Enable fast serialization in xprod edge
Key: HIVE-23083
URL: https://issues.apache.org/jira/browse/HIVE-23083
Project: Hive
Issue Type
Rajesh Balamohan created HIVE-23029:
---
Summary: LLAP: Shuffle Handler should support Index Cache
configuration
Key: HIVE-23029
URL: https://issues.apache.org/jira/browse/HIVE-23029
Project: Hive
Rajesh Balamohan created HIVE-23027:
---
Summary: Fix syntax error in llap package.py
Key: HIVE-23027
URL: https://issues.apache.org/jira/browse/HIVE-23027
Project: Hive
Issue Type: Bug
Rajesh Balamohan created HIVE-23002:
---
Summary: Optimise LazyBinaryUtils.writeVLong
Key: HIVE-23002
URL: https://issues.apache.org/jira/browse/HIVE-23002
Project: Hive
Issue Type
/r/72213/diff/1/
Testing
---
Yes. Updated in ticket
Thanks,
Rajesh Balamohan
Rajesh Balamohan created HIVE-22984:
---
Summary: Optimise FetchOperator when fetching large number of
records
Key: HIVE-22984
URL: https://issues.apache.org/jira/browse/HIVE-22984
Project: Hive
Rajesh Balamohan created HIVE-22975:
---
Summary: Optimise TopNKeyFilter with boundary checks
Key: HIVE-22975
URL: https://issues.apache.org/jira/browse/HIVE-22975
Project: Hive
Issue Type
Rajesh Balamohan created HIVE-22966:
---
Summary: LLAP: Consider including waitTime for comparing attempts
in same vertex
Key: HIVE-22966
URL: https://issues.apache.org/jira/browse/HIVE-22966
Project
Rajesh Balamohan created HIVE-22927:
---
Summary: LLAP should filter guaranteed tasks for killing in node
heartbeat
Key: HIVE-22927
URL: https://issues.apache.org/jira/browse/HIVE-22927
Project: Hive
101 - 200 of 517 matches
Mail list logo