Dan Hecht has posted comments on this change. Change subject: IMPALA-3499: Split catalog update ......................................................................
Patch Set 20: (2 comments) http://gerrit.cloudera.org:8080/#/c/3067/20/be/src/service/impala-server.cc File be/src/service/impala-server.cc: Line 196: const uint64_t MAX_CATALOG_UPDATE_BATCH_SIZE_BYTES = 10 * 1024; > will change this before gvm Please upload the final diff. Also, please add a comment briefly explaining what this controls and *why* we need this (you could also refer to the JIRA). PS20, Line 1262: if (len > 100 * 1024 * 1024 /* 100MB */) { : LOG(WARNING) << "Received large catalog update(>100mb): " : << item.key << " is " : << PrettyPrinter::Print(len, TUnit::BYTES); : } > Sorry just saw this.. busy setting up 2gb topic size.. Dimitris, the split Please update to INFO as suggested by Henry. -- To view, visit http://gerrit.cloudera.org:8080/3067 To unsubscribe, visit http://gerrit.cloudera.org:8080/settings Gerrit-MessageType: comment Gerrit-Change-Id: I176db25124a32944f2396ce8aafbed49cac95928 Gerrit-PatchSet: 20 Gerrit-Project: Impala Gerrit-Branch: cdh5-trunk Gerrit-Owner: Huaisi Xu <[email protected]> Gerrit-Reviewer: Bharath Vissapragada <[email protected]> Gerrit-Reviewer: Dan Hecht <[email protected]> Gerrit-Reviewer: Dimitris Tsirogiannis <[email protected]> Gerrit-Reviewer: Henry Robinson <[email protected]> Gerrit-Reviewer: Huaisi Xu <[email protected]> Gerrit-HasComments: Yes
