[
https://issues.apache.org/jira/browse/CASSANDRA-14556?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16551818#comment-16551818
]
Aleksey Yeschenko commented on CASSANDRA-14556:
-----------------------------------------------
Just to be clear - what I want to look at and verify is that there are no
broader interactions missed here, things that someone new to C* codebase
wouldn't necessarily notice or consider. I do trust Ariel's review of the lower
level logic and don't intend to do a thorough review of that.
After a very quick skim, off the top of my head: the patch breaks counters if
pre-2.0 shards are still around (and there is nothing there to remove them, so
it's just a matter of the table having lived long enough). Receiving side needs
to convert acquired received local shards into remote ones, to not break
reconcile logic.
See
[here|https://github.com/apache/cassandra/blob/645d8278bcf6281c8272f82d0d661e386a7cbe7d/src/java/org/apache/cassandra/db/streaming/CassandraStreamReader.java#L265-L273].
As such, {{shouldStreamFullSSTable()}} should be modified to only return true
for counter tables if there are no legacy shards present (see
{{StatsMetadata.hasLegacyCounterShards}}).
> Optimize streaming path in Cassandra
> ------------------------------------
>
> Key: CASSANDRA-14556
> URL: https://issues.apache.org/jira/browse/CASSANDRA-14556
> Project: Cassandra
> Issue Type: Improvement
> Components: Streaming and Messaging
> Reporter: Dinesh Joshi
> Assignee: Dinesh Joshi
> Priority: Major
> Labels: Performance
> Fix For: 4.x
>
>
> During streaming, Cassandra reifies the sstables into objects. This creates
> unnecessary garbage and slows down the whole streaming process as some
> sstables can be transferred as a whole file rather than individual
> partitions. The objective of the ticket is to detect when a whole sstable can
> be transferred and skip the object reification. We can also use a zero-copy
> path to avoid bringing data into user-space on both sending and receiving
> side.
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
