Jeff Jirsa created CASSANDRA-10680:
--------------------------------------

             Summary: Deal with small compression chunk size better during 
streaming plan setup
                 Key: CASSANDRA-10680
                 URL: https://issues.apache.org/jira/browse/CASSANDRA-10680
             Project: Cassandra
          Issue Type: Bug
            Reporter: Jeff Jirsa


For clusters using small compression chunk size and terabytes of data, the 
streaming plan calculations will instantiate hundreds of millions of 
compressionmetadata$chunk objects, which will create unreasonable amounts of 
heap pressure. Rather than instantiating all of those at once, streaming should 
instantiate only as many as needed for a single file per table at a time.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Reply via email to