[
https://issues.apache.org/jira/browse/APEXMALHAR-2106?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15313157#comment-15313157
]
ASF GitHub Bot commented on APEXMALHAR-2106:
--------------------------------------------
GitHub user ilganeli opened a pull request:
https://github.com/apache/incubator-apex-malhar/pull/309
[APEXMALHAR-2106][WIP] Support multiple streams in StreamMerger
* Created a module which creates a binary tree of StreamMerger operators to
support merging multiple streams
* StreamMerger operators are presently allocated as CONTAINER_LOCAL. I
would like for them to be THREAD_LOCAL but I was getting the following error
when attempting this:
```Caused by: javax.validation.ValidationException: Locality THREAD_LOCAL
invalid for operator OperatorMeta{name=Merger_Tier_0_#_0,
operator=StreamMerger{name=null}, attributes={}} with multiple input streams as
they origin from different owner OIO operators
```
* An example application is included but i'm still working on further
tests.
You can merge this pull request into a Git repository by running:
$ git pull https://github.com/ilganeli/incubator-apex-malhar
APEXMALHAR-2106F
Alternatively you can review and apply these changes as the patch at:
https://github.com/apache/incubator-apex-malhar/pull/309.patch
To close this pull request, make a commit to your master/trunk branch
with (at least) the following in the commit message:
This closes #309
----
commit 00e3b274cdecfb254af086bfc1458780a130273a
Author: Ilya Ganelin <[email protected]>
Date: 2016-06-02T21:56:39Z
Created a module to merge multiple streams into a single stream. Created a
test application demonstrating this in action. Still need to add more tests.
----
> Support merging multiple streams with StreamMerger
> ---------------------------------------------------
>
> Key: APEXMALHAR-2106
> URL: https://issues.apache.org/jira/browse/APEXMALHAR-2106
> Project: Apache Apex Malhar
> Issue Type: New Feature
> Reporter: Ilya Ganelin
> Assignee: Ilya Ganelin
>
> To properly implement the Flatten transformation (and other Stream
> combination operations), Apex must support merging data from multiple
> sources. The StreamMerger operator can be improved to merge multiple streams,
> rather than just the two streams it can handle in the present implementation.
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
