-----------------------------------------------------------
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/71038/
-----------------------------------------------------------

Review request for hive, Jesús Camacho Rodríguez, Jason Dere, Zoltan Haindrich, 
and Vineet Garg.


Bugs: HIVE-21965
    https://issues.apache.org/jira/browse/HIVE-21965


Repository: hive-git


Description
-------

Implement parallel processing in HiveStrictManagedMigration
===========================================================

1. Process databases and tables paralelly using a thread pool for each. Thread 
pools size can be defined by command line options. If no options are given the 
default pool size is the number of cpu cores / 2
2. Add option for filtering table type.


Diffs
-----

  ql/src/java/org/apache/hadoop/hive/ql/util/CloseableThreadLocal.java 
PRE-CREATION 
  ql/src/java/org/apache/hadoop/hive/ql/util/HiveStrictManagedMigration.java 
80025b7046 
  
ql/src/java/org/apache/hadoop/hive/ql/util/NamedForkJoinWorkerThreadFactory.java
 PRE-CREATION 
  ql/src/test/org/apache/hadoop/hive/ql/TxnCommandsBaseForTests.java 5f39fdccb5 
  ql/src/test/org/apache/hadoop/hive/ql/util/CloseableThreadLocalTest.java 
PRE-CREATION 
  
ql/src/test/org/apache/hadoop/hive/ql/util/TestHiveStrictManagedMigration.java 
PRE-CREATION 


Diff: https://reviews.apache.org/r/71038/diff/1/


Testing
-------

New UT for testing migration.


Thanks,

Krisztian Kasa

Reply via email to