Joe McDonnell created IMPALA-6543:
-------------------------------------

             Summary: Limit RowBatch serialization size to INT_MAX
                 Key: IMPALA-6543
                 URL: https://issues.apache.org/jira/browse/IMPALA-6543
             Project: IMPALA
          Issue Type: Bug
          Components: Backend
    Affects Versions: Impala 2.11.0, Impala 2.12.0
            Reporter: Joe McDonnell
            Assignee: Joe McDonnell


A RowBatch does not support serializing an uncompressed size of greater than 
INT_MAX. The serialization format relies on tuple offsets of type of int32, so 
they cannot address greater than INT_MAX.

On debug builds, a DCHECK in SerializeInternal() fires when the size exceeds 
INT_MAX. On release builds, LZ4's limitation of INT_MAX on the size of 
uncompressed size avoids any issue. The serialization codepath should protect 
itself and avoid this issue on debug builds.



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

Reply via email to