[ https://issues.apache.org/jira/browse/HIVE-19344?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Vihang Karajgaonkar updated HIVE-19344: --------------------------------------- Resolution: Fixed Fix Version/s: 3.1.0 2.4.0 3.0.0 Status: Resolved (was: Patch Available) merged into master, branch-3 and branch-2. Thanks [~stakiar] for the quick review. > Change default value of msck.repair.batch.size > ----------------------------------------------- > > Key: HIVE-19344 > URL: https://issues.apache.org/jira/browse/HIVE-19344 > Project: Hive > Issue Type: Improvement > Reporter: Vihang Karajgaonkar > Assignee: Vihang Karajgaonkar > Priority: Minor > Fix For: 3.0.0, 2.4.0, 3.1.0 > > Attachments: HIVE-19344.01.patch, HIVE-19344.02.patch > > > {{msck.repair.batch.size}} default to 0 which means msck will try to add all > the partitions in one API call to HMS. This can potentially add huge memory > pressure on HMS. The default value should be changed to a reasonable number > so that in case of large number of partitions we can batch the addition of > partitions. Same goes for {{msck.repair.batch.max.retries}} -- This message was sent by Atlassian JIRA (v7.6.3#76005)