[
https://issues.apache.org/jira/browse/CAMEL-16084?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17273062#comment-17273062
]
Jeremy Ross commented on CAMEL-16084:
-------------------------------------
[~davsclaus] If the aggregator output is separate from the incoming thread,
what effect does parallelProcessing have on it?
I've also noticed this doesn't seem to be a problem with non-{{AsyncProducer}}
components, such as http.
Here's my real-world use case. I'm reading a CSV file of tens of thousands of
records, aggregating them in to batches of 25, then sending the batch to
salesforce. Because reading the CSV file is fast, and the aggregator is
operating asynchronously, *hundreds* of batches are being sent to salesforce,
all in-flight at once, before a single response is received. HttpClient hits
its request limits, and I'm sure salesforce doesn't appreciate getting slammed.
What's the best way to operate in a more synchronous fashion, or at least
throttle down the number of in-flight requests?
> salesforce: Out of order execution
> ----------------------------------
>
> Key: CAMEL-16084
> URL: https://issues.apache.org/jira/browse/CAMEL-16084
> Project: Camel
> Issue Type: Bug
> Components: camel-salesforce
> Affects Versions: 3.7.1
> Reporter: Jeremy Ross
> Assignee: Jeremy Ross
> Priority: Major
>
> When using a salesforce operation after an aggregator, control seems to
> return to the aggregate caller immediately instead of proceeding with
> processors downstream from the salesforce operation. This is the behavior I'd
> expect if using the aggregator with parallelProcessing.
> I believe this is longstanding behavior, however with the removal of the
> `synchronous` option from the salesforce component (CAMEL-14138), we've
> removed a workaround to this issue.
> I'm seeing the same behavior with a salesforce operation via a wiretap with a
> threadpool with poolsize, maxsize and queuesize of 1, which should
> effectively behave in a synchronous manner.
> Test case: https://gist.github.com/jeremyross/4d7d14a33452edf236faefda77ad3e3d
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
