Joe McDonnell created IMPALA-6543: ------------------------------------- Summary: Limit RowBatch serialization size to INT_MAX Key: IMPALA-6543 URL: https://issues.apache.org/jira/browse/IMPALA-6543 Project: IMPALA Issue Type: Bug Components: Backend Affects Versions: Impala 2.11.0, Impala 2.12.0 Reporter: Joe McDonnell Assignee: Joe McDonnell
A RowBatch does not support serializing an uncompressed size of greater than INT_MAX. The serialization format relies on tuple offsets of type of int32, so they cannot address greater than INT_MAX. On debug builds, a DCHECK in SerializeInternal() fires when the size exceeds INT_MAX. On release builds, LZ4's limitation of INT_MAX on the size of uncompressed size avoids any issue. The serialization codepath should protect itself and avoid this issue on debug builds. -- This message was sent by Atlassian JIRA (v7.6.3#76005)