Jeff Jirsa created CASSANDRA-10680: -------------------------------------- Summary: Deal with small compression chunk size better during streaming plan setup Key: CASSANDRA-10680 URL: https://issues.apache.org/jira/browse/CASSANDRA-10680 Project: Cassandra Issue Type: Bug Reporter: Jeff Jirsa
For clusters using small compression chunk size and terabytes of data, the streaming plan calculations will instantiate hundreds of millions of compressionmetadata$chunk objects, which will create unreasonable amounts of heap pressure. Rather than instantiating all of those at once, streaming should instantiate only as many as needed for a single file per table at a time. -- This message was sent by Atlassian JIRA (v6.3.4#6332)