[
https://issues.apache.org/jira/browse/CASSANDRA-19412?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17819106#comment-17819106
]
Stefan Miklosovic commented on CASSANDRA-19412:
-----------------------------------------------
[CASSANDRA-19412-trunk|https://github.com/instaclustr/cassandra/tree/CASSANDRA-19412-trunk]
{noformat}
java17_pre-commit_tests
✓ j17_build 5m 5s
✓ j17_cqlsh_dtests_py311 7m 12s
✓ j17_cqlsh_dtests_py311_vnode 7m 24s
✓ j17_cqlsh_dtests_py38 7m 12s
✓ j17_cqlsh_dtests_py38_vnode 7m 1s
✓ j17_cqlshlib_cython_tests 7m 36s
✓ j17_cqlshlib_tests 6m 58s
✓ j17_dtests 35m 13s
✓ j17_dtests_vnode 36m 12s
✕ j17_jvm_dtests 25m 19s
org.apache.cassandra.distributed.test.NativeTransportEncryptionOptionsTest
testEndpointVerificationEnabledIpNotInSAN TIMEOUTED
✕ j17_jvm_dtests_vnode 20m 11s
✕ j17_unit_tests 13m 20s
org.apache.cassandra.index.sai.cql.VectorUpdateDeleteTest updateTest
✕ j17_utests_oa 13m 48s
org.apache.cassandra.index.sai.cql.VectorUpdateDeleteTest updateTest
java17_separate_tests
java11_pre-commit_tests
java11_separate_tests
{noformat}
[java17_pre-commit_tests|https://app.circleci.com/pipelines/github/instaclustr/cassandra/3902/workflows/777f88fe-e6dc-42a1-aa5d-40a22e8009fa]
[java17_separate_tests|https://app.circleci.com/pipelines/github/instaclustr/cassandra/3902/workflows/f1d8d323-c08b-40f3-93e3-9b077d38c377]
[java11_pre-commit_tests|https://app.circleci.com/pipelines/github/instaclustr/cassandra/3902/workflows/4f4d0a17-f8bc-4d58-9f9f-a2d037613aa3]
[java11_separate_tests|https://app.circleci.com/pipelines/github/instaclustr/cassandra/3902/workflows/1b9bc8dd-74a1-4d99-bdb0-5751a1db2755]
> delete useless collection:backPressureHosts in the sendToHintedReplicas to
> improve write performance
> ----------------------------------------------------------------------------------------------------
>
> Key: CASSANDRA-19412
> URL: https://issues.apache.org/jira/browse/CASSANDRA-19412
> Project: Cassandra
> Issue Type: Improvement
> Components: Legacy/Local Write-Read Paths
> Reporter: Ling Mao
> Assignee: Ling Mao
> Priority: Low
> Time Spent: 40m
> Remaining Estimate: 0h
>
> Every normal write request will go through this
> method({_}*sendToHintedReplicas*{_}). However, the list:backPressureHosts in
> the method has never been used functionally.
> The _*backpressure*_ was introduced by:
> {code:java}
> Support optional backpressure strategies at the coordinator
> patch by Sergio Bossa; reviewed by Stefania Alborghetti for CASSANDRA-9318
> d43b9ce5 Sergio Bossa <[email protected]> on 2016/9/19 at 10:42 AM {code}
> {code:java}
> public static void sendToHintedEndpoints(final Mutation mutation,
> Iterable<InetAddress> targets,
>
> AbstractWriteResponseHandler<IMutation> responseHandler,
> String localDataCenter,
> Stage stage)
> throws OverloadedException
> {
> int targetsSize = Iterables.size(targets);
> // this dc replicas:
> Collection<InetAddress> localDc = null;
> // extra-datacenter replicas, grouped by dc
> Map<String, Collection<InetAddress>> dcGroups = null;
> // only need to create a Message for non-local writes
> MessageOut<Mutation> message = null;
> boolean insertLocal = false;
> ArrayList<InetAddress> endpointsToHint = null;
> List<InetAddress> backPressureHosts = null;
> for (InetAddress destination : targets)
> {
> checkHintOverload(destination);
> if (FailureDetector.instance.isAlive(destination))
> {
> if (canDoLocalRequest(destination))
> {
> insertLocal = true;
> }
> else
> {
> // belongs on a different server
> if (message == null)
> message = mutation.createMessage();
> String dc =
> DatabaseDescriptor.getEndpointSnitch().getDatacenter(destination);
> // direct writes to local DC or old Cassandra versions
> // (1.1 knows how to forward old-style String message
> IDs; updated to int in 2.0)
> if (localDataCenter.equals(dc))
> {
> if (localDc == null)
> localDc = new ArrayList<>(targetsSize);
> localDc.add(destination);
> }
> else
> {
> Collection<InetAddress> messages = (dcGroups != null)
> ? dcGroups.get(dc) : null;
> if (messages == null)
> {
> messages = new ArrayList<>(3); // most DCs will
> have <= 3 replicas
> if (dcGroups == null)
> dcGroups = new HashMap<>();
> dcGroups.put(dc, messages);
> }
> messages.add(destination);
> }
> if (backPressureHosts == null)
> backPressureHosts = new ArrayList<>(targetsSize);
> backPressureHosts.add(destination);
> }
> }
> else
> {
> if (shouldHint(destination))
> {
> if (endpointsToHint == null)
> endpointsToHint = new ArrayList<>(targetsSize);
> endpointsToHint.add(destination);
> }
> }
> }
> if (backPressureHosts != null)
> MessagingService.instance().applyBackPressure(backPressureHosts,
> responseHandler.currentTimeout());
> if (endpointsToHint != null)
> submitHint(mutation, endpointsToHint, responseHandler);
> if (insertLocal)
> performLocally(stage, Optional.of(mutation), mutation::apply,
> responseHandler);
> if (localDc != null)
> {
> for (InetAddress destination : localDc)
> MessagingService.instance().sendRR(message, destination,
> responseHandler, true);
> }
> if (dcGroups != null)
> {
> // for each datacenter, send the message to one node to relay the
> write to other replicas
> for (Collection<InetAddress> dcTargets : dcGroups.values())
> sendMessagesToNonlocalDC(message, dcTargets, responseHandler);
> }
> } {code}
> Now the backPressure related codes had been deleted in the codebase, and here
> maybe someone forgot to remove the collection: backPressureHosts. Removing it
> will save every write request to add a few items to a list to reduce the
> memory footprint
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
