Huaisi Xu has posted comments on this change. Change subject: IMPALA-3499: Split catalog update ......................................................................
Patch Set 21: (1 comment) I ran many exhaustive full dataloading job with 10km split limit to test the split works as expected. I did not test this with topic size larger than 2GB though. I am trying to get one.. not sure how that goes. http://gerrit.cloudera.org:8080/#/c/3067/21/be/src/service/impala-server.cc File be/src/service/impala-server.cc: PS21, Line 196: Frontend java is not able to : // deserialize byte array more than 2GB > doesn't the C++ thrift code have trouble also serializing more than 2GB? Yes.. but this is a lesser value. Currently backend cannot serialize more than a little more than 3GB. -- To view, visit http://gerrit.cloudera.org:8080/3067 To unsubscribe, visit http://gerrit.cloudera.org:8080/settings Gerrit-MessageType: comment Gerrit-Change-Id: I176db25124a32944f2396ce8aafbed49cac95928 Gerrit-PatchSet: 21 Gerrit-Project: Impala Gerrit-Branch: cdh5-trunk Gerrit-Owner: Huaisi Xu <[email protected]> Gerrit-Reviewer: Bharath Vissapragada <[email protected]> Gerrit-Reviewer: Dan Hecht <[email protected]> Gerrit-Reviewer: Dimitris Tsirogiannis <[email protected]> Gerrit-Reviewer: Henry Robinson <[email protected]> Gerrit-Reviewer: Huaisi Xu <[email protected]> Gerrit-HasComments: Yes
