dengzhhu653 commented on code in PR #5843:
URL: https://github.com/apache/hive/pull/5843#discussion_r2128179602


##########
standalone-metastore/metastore-common/src/main/java/org/apache/hadoop/hive/metastore/conf/MetastoreConf.java:
##########
@@ -1905,6 +1905,8 @@ public enum ConfVars {
         "Only collect the non-native table's summary that has been 
updated/changed in configured recent days."),
     
METADATA_SUMMARY_MAX_NONNATIVE_TABLES("hive.metatool.summary.maxNonNativeTables",
 "hive.metatool.summary.maxNonNativeTables", "",
         "The maximum non-native tables allowed per table type during 
collecting the summary."),
+    
METADATA_SUMMARY_NONNATIVE_THREADS("hive.metatool.summary.nonnative.threads", 
"hive.metatool.summary.nonnative.threads", 20,
+        "Number of threads to be allocated for MetaToolTaskMetadataSummary for 
collecting the non-native table's summary."),

Review Comment:
   I was inspired by `hive.metastore.fshandler.threads`, which default value is 
15. The thread is used for loading the Iceberg table: reading the metadata 
files, where it might take time over thousands of Iceberg tables, leading to 
timeout. The actual threads is min(number of Iceberg tables, 
hive.metatool.summary.nonnative.threads)



-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: gitbox-unsubscr...@hive.apache.org

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org


---------------------------------------------------------------------
To unsubscribe, e-mail: gitbox-unsubscr...@hive.apache.org
For additional commands, e-mail: gitbox-h...@hive.apache.org

Reply via email to