Re: Review Request 72360: HIVE-23093: Create new metastore config value for jdbc max batch size

2020-04-16 Thread Peter Vary via Review Board
iption standalone-metastore/metastore-server/src/main/java/org/apache/hadoop/hive/metastore/txn/TxnHandler.java Lines 2520-2525 (patched) <https://reviews.apache.org/r/72360/#comment308658> I would do it in setConf, like we did with the numOpenTxns and friends - Peter Vary On ápr. 14, 2

Re: Review Request 72336: HIVE-23114: Insert overwrite with dynamic partitioning is not working correctly with direct insert

2020-04-08 Thread Peter Vary via Review Board
/src/java/org/apache/hadoop/hive/ql/io/AcidUtils.java Lines 2834 (patched) <https://reviews.apache.org/r/72336/#comment308593> nit: extra space - Peter Vary On ápr. 8, 2020, 12:20 du, Marta Kuczora

Re: Review Request 72290: HIVE-23067: Use batch DB calls in TxnHandler for commitTxn and abortTxns

2020-04-01 Thread Peter Vary via Review Board
/hadoop/hive/metastore/txn/TxnHandler.java Lines 1379 (patched) <https://reviews.apache.org/r/72290/#comment308489> Will this issue unnecessary queries for read only queries? For Oracle this could increase exexution time Also why not use executeQueryiesInBatch for this? - Pete

Re: Review Request 72283: HIVE-23076 Add batching for openTxn

2020-04-01 Thread Peter Vary via Review Board
45.2314.59 openTxn115k-10 33.1632.0725.9262.4115.66 openTxn125k-10062.1669.2430.08187.642.01 Thanks, Peter Vary

Re: Review Request 72112: HIVE-22869 - Add locking benchmark to metastore-tools/metastore-benchmarks

2020-04-03 Thread Peter Vary via Review Board
etastore/metastore-tools/tools-common/src/main/java/org/apache/hadoop/hive/metastore/tools/Util.java Line 40 (original), 35 (patched) <https://reviews.apache.org/r/72112/#comment308525> wildcard import - Peter Vary On ápr. 2, 2020, 2:13 du, Zoltan Chovan wrote: > > -

Re: Review Request 72264: HIVE-23052: Optimize lock enqueueing in TxnHandler

2020-03-31 Thread Peter Vary via Review Board
andalone-metastore/metastore-server/src/main/java/org/apache/hadoop/hive/metastore/txn/TxnHandler.java Lines 2599 (patched) <https://reviews.apache.org/r/72264/#comment308471> Do we need this? We do not commit temp lock id, so we can have just a single value which definitely will not appear in

Re: Review Request 72291: HIVE-23107: Remove MIN_HISTORY_LEVEL table

2020-03-31 Thread Peter Vary via Review Board
Maybe delete immediately, like: DELETE FROM TXN_TO_WRITE_ID WHERE T2W_TXNID < (SELECT MIN...) The hard part is that it is hard to log what happened - Peter Vary On márc. 31, 2020, 1:51 du, Laszlo Pin

Review Request 72283: HIVE-23076 Add batching for openTxn

2020-03-30 Thread Peter Vary via Review Board
30.08187.642.01 Thanks, Peter Vary

Re: Review Request 72283: HIVE-23076 Add batching for openTxn

2020-03-30 Thread Peter Vary via Review Board
he top, since the formatting/parsing and kept this one because of this is used only here, and only once - Peter --- This is an automatically generated e-mail. To reply, visit: https://reviews.apache.org/r/72283/#review220103 ---

Re: Review Request 72290: HIVE-23067: Use batch DB calls in TxnHandler for commitTxn and abortTxns

2020-04-02 Thread Peter Vary via Review Board
- On ápr. 1, 2020, 6:53 de, Marton Bod wrote: > > --- > This is an automatically generated e-mail. To reply, visit: > https://reviews.apache.org/r/72290/ > --- > > (Updated ápr. 1, 2020, 6:53 de) > > &

Re: Review Request 72283: HIVE-23076 Add batching for openTxn

2020-04-02 Thread Peter Vary via Review Board
14.59 openTxn115k-10 33.1632.0725.9262.4115.66 openTxn125k-10062.1669.2430.08187.642.01 Thanks, Peter Vary

Re: Review Request 72444: HIVE-23280: Trigger compaction with old aborted txns

2020-04-28 Thread Peter Vary via Review Board
> On ápr. 28, 2020, 8:54 de, Peter Vary wrote: > > standalone-metastore/metastore-server/src/main/java/org/apache/hadoop/hive/metastore/txn/CompactionTxnHandler.java > > Lines 113 (patched) > > <https://reviews.apache.org/r/72444/diff/1/?file=2229091#file2229091line114

Re: Review Request 72444: HIVE-23280: Trigger compaction with old aborted txns

2020-04-28 Thread Peter Vary via Review Board
--- This is an automatically generated e-mail. To reply, visit: https://reviews.apache.org/r/72444/#review220523 --- Ship it! Ship It! - Peter Vary On ápr. 28, 2020, 10:37 de

Re: Review Request 72388: HIVE-23048 Use sequences for TXN_ID generation

2020-04-27 Thread Peter Vary via Review Board
27 (patched) <https://reviews.apache.org/r/72388/#comment308964> Is this public? - Peter Vary On ápr. 24, 2020, 3:40 du, Peter Varga wrote: > > --- > This is an automatically generated e-mail. To reply, visit: > http

Re: Review Request 72436: Locks: Implement zero-wait readers

2020-04-28 Thread Peter Vary via Review Board
--- This is an automatically generated e-mail. To reply, visit: https://reviews.apache.org/r/72436/#review220526 --- Ship it! Ship It! - Peter Vary On ápr. 28, 2020, 4:23 du

Re: Review Request 72388: HIVE-23048 Use sequences for TXN_ID generation

2020-04-24 Thread Peter Vary via Review Board
88/#comment308934> Why is this change? standalone-metastore/metastore-server/src/main/java/org/apache/hadoop/hive/metastore/txn/TxnStore.java Line 47 (original), 47 (patched) <https://reviews.apache.org/r/72388/#comment308931> What is the reason behind this change? - Peter Var

Re: Review Request 72387: Locks: Add new lock implementations for always zero-wait readers

2020-04-22 Thread Peter Vary via Review Board
s risky here? - Peter Vary On ápr. 22, 2020, 2:29 du, Denys Kuzmenko wrote: > > --- > This is an automatically generated e-mail. To reply, visit: > https://re

Re: Review Request 72436: Locks: Implement zero-wait readers

2020-04-28 Thread Peter Vary via Review Board
Lines 4389-4391 (patched) <https://reviews.apache.org/r/72436/#comment308996> This is strange for me. We do not abort the transaction, but throw an TxnAbortedException, but remove the Locks? - Peter Vary On ápr. 27, 2020, 11:24 de, Denys Ku

Re: Review Request 72444: HIVE-23280: Trigger compaction with old aborted txns

2020-04-28 Thread Peter Vary via Review Board
#comment308987> Maybe single statement return, like: return firstAbortedTxnTime + abortedTimeThreshold < System.currentTimeMillis() - Peter Vary On ápr. 28, 2020, 8:39 de, Karen Coppage wrote: > > --- > This is an

Re: Review Request 72359: HIVE-23104: Minimize critical paths of TxnHandler::commitTxn and abortTxn

2020-04-14 Thread Peter Vary via Review Board
> On ápr. 14, 2020, 11:22 de, Peter Vary wrote: > > standalone-metastore/metastore-server/src/main/java/org/apache/hadoop/hive/metastore/txn/TxnHandler.java > > Lines 1325 (patched) > > <https://reviews.apache.org/r/72359/diff/1/?file=2217523#file2217523line1388> >

Re: Review Request 72481: HIVE-23234: Optimize TxnHandler::allocateTableWriteIds

2020-05-08 Thread Peter Vary via Review Board
nt309292> Why is this change? standalone-metastore/metastore-server/src/main/java/org/apache/hadoop/hive/metastore/txn/TxnHandler.java Line 2090 (original), 2081 (patched) <https://reviews.apache.org/r/72481/#comment309293> Why is this change? - Peter Vary

Re: Review Request 72281: HIVE-22971: Eliminate file rename in insert-only compactor

2020-05-18 Thread Peter Vary via Review Board
es 305 (patched) <https://reviews.apache.org/r/72281/#comment309509> Migth want to add asserts here to check non-null argument - Peter Vary On márc. 30, 2020, 6:18 de, Karen Coppage wrote: > > --- > This is an automatic

Re: Review Request 72281: HIVE-22971: Eliminate file rename in insert-only compactor

2020-05-19 Thread Peter Vary via Review Board
--- This is an automatically generated e-mail. To reply, visit: https://reviews.apache.org/r/72281/#review220822 --- Ship it! Ship It! - Peter Vary On máj. 19, 2020, 5:58 de

Re: Review Request 72281: HIVE-22971: Eliminate file rename in insert-only compactor

2020-05-19 Thread Peter Vary via Review Board
> On máj. 18, 2020, 12:51 du, Peter Vary wrote: > > ql/src/java/org/apache/hadoop/hive/ql/txn/compactor/CompactorMR.java > > Lines 305 (patched) > > <https://reviews.apache.org/r/72281/diff/1/?file=2216347#file2216347line305> > > > > Migth want to add

Re: Review Request 72480: HIVE-23242 Fix flaky tests testHouseKeepingThreadExistence

2020-05-19 Thread Peter Vary via Review Board
rver/src/test/java/org/apache/hadoop/hive/metastore/MetaStoreTestUtils.java Lines 242 (patched) <https://reviews.apache.org/r/72480/#comment309539> Question: Is this again the case when the HMS is started, but the HK threads are not started? Maybe extend the log line that the HMS is

Re: Review Request 72470: ACID: Concurrent MERGE INSERT operations produce duplicates

2020-05-07 Thread Peter Vary via Review Board
--- This is an automatically generated e-mail. To reply, visit: https://reviews.apache.org/r/72470/#review220673 --- Ship it! Ship It! - Peter Vary On máj. 7, 2020, 1:21 du

Re: Review Request 72480: HIVE-23242 Fix flaky tests testHouseKeepingThreadExistence

2020-05-20 Thread Peter Vary via Review Board
--- This is an automatically generated e-mail. To reply, visit: https://reviews.apache.org/r/72480/#review220839 --- Ship it! Ship It! - Peter Vary On máj. 20, 2020, 2:03 du

Review Request 72553: HIVE-23555 Cancel compaction jobs when hive.compactor.worker.timeout is reached

2020-05-27 Thread Peter Vary via Review Board
/TestWorker.java 443f982d66 Diff: https://reviews.apache.org/r/72553/diff/1/ Testing --- Created unit tests to check the timeout functionality. Thanks, Peter Vary

Re: Review Request 72553: HIVE-23555 Cancel compaction jobs when hive.compactor.worker.timeout is reached

2020-05-28 Thread Peter Vary via Review Board
://reviews.apache.org/r/72553/diff/1-2/ Testing --- Created unit tests to check the timeout functionality. Thanks, Peter Vary

Re: Review Request 72528: ValidTxnManager doesn't consider txns opened and committed between snapshot generation and locking when evaluating ValidTxnListState

2020-06-19 Thread Peter Vary via Review Board
-23725 - Peter Vary On jún. 9, 2020, 8:52 de, Denys Kuzmenko wrote: > > --- > This is an automatically generated e-mail. To reply, visit: > https://reviews.apache

<    4   5   6   7   8   9