----------------------------------------------------------- This is an automatically generated e-mail. To reply, visit: https://reviews.apache.org/r/33134/ -----------------------------------------------------------
(Updated April 13, 2015, 7:57 p.m.) Review request for sentry, Lenni Kuff, Prasad Mujumdar, and Yibing Shi. Changes ------- * Incorporated Prasad's review feedback * Increased parallelism in CacheInitializer by spreading the partition requests across multiple calls * Allows users to configure the max tables and max partitions per call Repository: sentry Description ------- SENTRY-696 : Improve MetastorePlugin cache initialization latency This path introduces the following changes : 1) Exposes a config variable to allow cache initialization to happen asynchronously (by default false) 2) The Cache initialization itself will now be performed in parallel - It introduces a separate thread pool and attempts to extract DB/Table/Partition information as separate threadpool tasks Diffs (updated) ----- sentry-hdfs/sentry-hdfs-common/src/main/java/org/apache/sentry/hdfs/ServiceConstants.java 489d165 sentry-hdfs/sentry-hdfs-namenode-plugin/pom.xml f35baf4 sentry-hdfs/sentry-hdfs-service/src/main/java/org/apache/sentry/hdfs/MetastoreCacheInitializer.java PRE-CREATION sentry-hdfs/sentry-hdfs-service/src/main/java/org/apache/sentry/hdfs/MetastorePlugin.java 7106e74 sentry-hdfs/sentry-hdfs-service/src/main/java/org/apache/sentry/hdfs/MetastorePluginWithHA.java ee5e0f9 Diff: https://reviews.apache.org/r/33134/diff/ Testing ------- Thanks, Arun Suresh
