Jeff Jirsa created CASSANDRA-10680:
--------------------------------------
Summary: Deal with small compression chunk size better during
streaming plan setup
Key: CASSANDRA-10680
URL: https://issues.apache.org/jira/browse/CASSANDRA-10680
Project: Cassandra
Issue Type: Bug
Reporter: Jeff Jirsa
For clusters using small compression chunk size and terabytes of data, the
streaming plan calculations will instantiate hundreds of millions of
compressionmetadata$chunk objects, which will create unreasonable amounts of
heap pressure. Rather than instantiating all of those at once, streaming should
instantiate only as many as needed for a single file per table at a time.
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)