GitHub user sandeshh opened a pull request:
https://github.com/apache/apex-core/pull/453
*Review only* APEXCORE-259 Directly write to DataList
Instead of the loop back between the Output port and the buffer server,
tuples are directly written to DataList. This improves the tuples write to
BufferServer, but exposing the bottleneck between downStream and BufferServer,
which in turn mean too much spooling.
This PR along with the following PRs improves the performance to great
extent.
https://github.com/apache/apex-core/pull/445
https://github.com/apache/apex-core/pull/436
@vrozov and @PramodSSImmaneni please see.
You can merge this pull request into a Git repository by running:
$ git pull https://github.com/sandeshh/apex-core APEXCORE-259
Alternatively you can review and apply these changes as the patch at:
https://github.com/apache/apex-core/pull/453.patch
To close this pull request, make a commit to your master/trunk branch
with (at least) the following in the commit message:
This closes #453
----
commit 66a3f756f90ef27df00497d1584f53ece0b74446
Author: Sandesh Hegde <[email protected]>
Date: 2017-01-22T07:44:25Z
APEXCORE-259 Directly write to DataList
----
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at [email protected] or file a JIRA ticket
with INFRA.
---