[
https://issues.apache.org/jira/browse/CASSANDRA-19412?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17819353#comment-17819353
]
Stefan Miklosovic commented on CASSANDRA-19412:
-----------------------------------------------
[CASSANDRA-19412-5.0|https://github.com/instaclustr/cassandra/tree/CASSANDRA-19412-5.0]
{noformat}
java17_pre-commit_tests
✓ j17_build 4m 12s
✓ j17_cqlsh_dtests_py311 5m 43s
✓ j17_cqlsh_dtests_py311_vnode 6m 10s
✓ j17_cqlsh_dtests_py38 5m 54s
✓ j17_cqlsh_dtests_py38_vnode 6m 25s
✓ j17_cqlshlib_cython_tests 7m 34s
✓ j17_cqlshlib_tests 6m 41s
✓ j17_dtests 34m 10s
✓ j17_dtests_vnode 33m 26s
✓ j17_jvm_dtests 19m 26s
✕ j17_jvm_dtests_vnode 17m 16s
org.apache.cassandra.distributed.test.ClearSnapshotTest
clearSnapshotSlowTest
✕ j17_unit_tests 14m 41s
org.apache.cassandra.index.sai.cql.VectorUpdateDeleteTest updateTest
✕ j17_utests_oa 16m 8s
org.apache.cassandra.index.sai.cql.VectorUpdateDeleteTest updateTest
java17_separate_tests
java11_pre-commit_tests
java11_separate_tests
{noformat}
[java17_pre-commit_tests|https://app.circleci.com/pipelines/github/instaclustr/cassandra/3909/workflows/651a6039-ea4c-4c4f-b25b-21f7b85ac889]
[java17_separate_tests|https://app.circleci.com/pipelines/github/instaclustr/cassandra/3909/workflows/8fff875c-0962-4550-bac6-bdd8567dc932]
[java11_pre-commit_tests|https://app.circleci.com/pipelines/github/instaclustr/cassandra/3909/workflows/dc229a55-f7aa-44ac-9634-ab3ef6007712]
[java11_separate_tests|https://app.circleci.com/pipelines/github/instaclustr/cassandra/3909/workflows/afd7e775-7bab-40e2-aaf9-82321243f04f]
> delete useless collection:backPressureHosts in the sendToHintedReplicas to
> improve write performance
> ----------------------------------------------------------------------------------------------------
>
> Key: CASSANDRA-19412
> URL: https://issues.apache.org/jira/browse/CASSANDRA-19412
> Project: Cassandra
> Issue Type: Improvement
> Components: Legacy/Local Write-Read Paths
> Reporter: Ling Mao
> Assignee: Ling Mao
> Priority: Low
> Time Spent: 40m
> Remaining Estimate: 0h
>
> Every normal write request will go through this
> method({_}*sendToHintedReplicas*{_}). However, the list:backPressureHosts in
> the method has never been used functionally.
> The _*backpressure*_ was introduced by:
> {code:java}
> Support optional backpressure strategies at the coordinator
> patch by Sergio Bossa; reviewed by Stefania Alborghetti for CASSANDRA-9318
> d43b9ce5 Sergio Bossa <[email protected]> on 2016/9/19 at 10:42 AM {code}
> {code:java}
> public static void sendToHintedEndpoints(final Mutation mutation,
> Iterable<InetAddress> targets,
>
> AbstractWriteResponseHandler<IMutation> responseHandler,
> String localDataCenter,
> Stage stage)
> throws OverloadedException
> {
> int targetsSize = Iterables.size(targets);
> // this dc replicas:
> Collection<InetAddress> localDc = null;
> // extra-datacenter replicas, grouped by dc
> Map<String, Collection<InetAddress>> dcGroups = null;
> // only need to create a Message for non-local writes
> MessageOut<Mutation> message = null;
> boolean insertLocal = false;
> ArrayList<InetAddress> endpointsToHint = null;
> List<InetAddress> backPressureHosts = null;
> for (InetAddress destination : targets)
> {
> checkHintOverload(destination);
> if (FailureDetector.instance.isAlive(destination))
> {
> if (canDoLocalRequest(destination))
> {
> insertLocal = true;
> }
> else
> {
> // belongs on a different server
> if (message == null)
> message = mutation.createMessage();
> String dc =
> DatabaseDescriptor.getEndpointSnitch().getDatacenter(destination);
> // direct writes to local DC or old Cassandra versions
> // (1.1 knows how to forward old-style String message
> IDs; updated to int in 2.0)
> if (localDataCenter.equals(dc))
> {
> if (localDc == null)
> localDc = new ArrayList<>(targetsSize);
> localDc.add(destination);
> }
> else
> {
> Collection<InetAddress> messages = (dcGroups != null)
> ? dcGroups.get(dc) : null;
> if (messages == null)
> {
> messages = new ArrayList<>(3); // most DCs will
> have <= 3 replicas
> if (dcGroups == null)
> dcGroups = new HashMap<>();
> dcGroups.put(dc, messages);
> }
> messages.add(destination);
> }
> if (backPressureHosts == null)
> backPressureHosts = new ArrayList<>(targetsSize);
> backPressureHosts.add(destination);
> }
> }
> else
> {
> if (shouldHint(destination))
> {
> if (endpointsToHint == null)
> endpointsToHint = new ArrayList<>(targetsSize);
> endpointsToHint.add(destination);
> }
> }
> }
> if (backPressureHosts != null)
> MessagingService.instance().applyBackPressure(backPressureHosts,
> responseHandler.currentTimeout());
> if (endpointsToHint != null)
> submitHint(mutation, endpointsToHint, responseHandler);
> if (insertLocal)
> performLocally(stage, Optional.of(mutation), mutation::apply,
> responseHandler);
> if (localDc != null)
> {
> for (InetAddress destination : localDc)
> MessagingService.instance().sendRR(message, destination,
> responseHandler, true);
> }
> if (dcGroups != null)
> {
> // for each datacenter, send the message to one node to relay the
> write to other replicas
> for (Collection<InetAddress> dcTargets : dcGroups.values())
> sendMessagesToNonlocalDC(message, dcTargets, responseHandler);
> }
> } {code}
> Now the backPressure related codes had been deleted in the codebase, and here
> maybe someone forgot to remove the collection: backPressureHosts. Removing it
> will save every write request to add a few items to a list to reduce the
> memory footprint
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
