Hi Hitesh,
You are absolutely right. The PojoInnerJoin accumulation we have now is
only
to test the implementation of WindowedMergeOperator. I did not considered
the case you mentioned when developing, so please make changes to fix this.
Thanks,
Shunxin
On Wed, Feb 15, 2017 at 4:25 AM, Hitesh Kapo
Hi Hitesh,
This is a great idea IMO. Like I mentioned in another thread, the
PojoInnerJoin and other MergeAccumulations are only to test the
implementation of WindowedMergeOperator. I did not consider
many use cases when writing those accumulations, so it will be
great if we can handle more types o
Hello there,
I am planning to add join support in Windowed Operator, but need some
advice on how to start.
Currently I am thinking to add a new subclass inheriting
AbstractWindowedOperator and do all the work we need in that class (add
more input ports, do join accumulation, etc.), but I am experi
he future join support I planned to add.
> >
> > Also, pay a bit of attention on how you process watermarks from each
> > input, and let me know if you need help.
> >
> > David
> >
> > On Fri, Aug 12, 2016 at 11:03 AM, Shunxin Lu
> wrote:
> >
> >&g
oinAccumulation>
> extends AbstractWindowedOperator RetractionStorageT, AccumulationT>
> implements JoinWindowedOperator InputT5>
> {
> ...
> }
>
> David
>
> On Tue, Aug 16, 2016 at 1:19 PM, Shunxin Lu wrote:
>
> > Hi David,
> >
> > Thanks for the
I would love to help too.
Thanks,
Shunxin
On Thu, Sep 8, 2016 at 9:34 PM, Lakshmi Velineni
wrote:
> i would like to help as well.
>
> thanks
> Lakshmi Prasanna
>
> On Thu, Sep 8, 2016 at 9:15 PM, Dongming Liang
> wrote:
>
> > +1 for me.
> >
> > Thanks,
> > - Dongming
> >
> > Dongming LIANG
> >
Hi Chinmay,
Base on the discussion I had with David, and David please correct me if I
am wrong, the watermark for Windowed Join Operator should be indeed
depending on all the input streams. If a tuple is considered late for one
input stream, it should also be considered late for the whole join
ope
he watermark is only generated when we have seen
> a watermark for all input ports. And the fact that we take the smallest
> timestamp in (2) means we only consider a window as late only if all input
> streams say that particular window is late.
>
> David
>
>
> On Fri, Sep 16
Hi Shunxin,
> >
> > If the watermark code in your PR is not behaving the way it should,
> please
> > do change it. Thanks!
> >
> > David
> >
> > On Fri, Sep 16, 2016 at 11:36 AM, Shunxin Lu
> wrote:
> >
> > > Hi David,
> > >
confusing when it comes to actual implementation, how exactly should
retraction be done in accumulations such as TopN and ReduceFn?
Thanks!
Shunxin Lu
[
https://issues.apache.org/jira/browse/APEXMALHAR-2507?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Shunxin Lu reassigned APEXMALHAR-2507:
--
Assignee: Shunxin Lu
> Example for inner join functionality using Windowed me
[
https://issues.apache.org/jira/browse/APEXMALHAR-2507?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16050777#comment-16050777
]
Shunxin Lu commented on APEXMALHAR-2507:
Hi Bhupesh,
It looks lik
[
https://issues.apache.org/jira/browse/APEXMALHAR-2507?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16052137#comment-16052137
]
Shunxin Lu commented on APEXMALHAR-2507:
Hi all,
Hitesh, could you elabo
[
https://issues.apache.org/jira/browse/APEXMALHAR-2507?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16054273#comment-16054273
]
Shunxin Lu commented on APEXMALHAR-2507:
Thanks everyone for the inpu
[
https://issues.apache.org/jira/browse/APEXMALHAR-2532?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Shunxin Lu reassigned APEXMALHAR-2532:
--
Assignee: Shunxin Lu
> Transform Application Test flooding CI l
Shunxin Lu created APEXMALHAR-2149:
--
Summary: ApexStream.filter() not working properly.
Key: APEXMALHAR-2149
URL: https://issues.apache.org/jira/browse/APEXMALHAR-2149
Project: Apache Apex Malhar
[
https://issues.apache.org/jira/browse/APEXMALHAR-2149?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Shunxin Lu updated APEXMALHAR-2149:
---
Description: Add unittests for FunctionOperator (Map, FlatMap, Filter).
(was: By adding
Shunxin Lu created APEXMALHAR-2168:
--
Summary: Bug Found in JdbcPOJOInputOperator.
Key: APEXMALHAR-2168
URL: https://issues.apache.org/jira/browse/APEXMALHAR-2168
Project: Apache Apex Malhar
[
https://issues.apache.org/jira/browse/APEXMALHAR-2202?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Shunxin Lu reassigned APEXMALHAR-2202:
--
Assignee: Shunxin Lu
> Move accumulations to correct pack
[
https://issues.apache.org/jira/browse/APEXMALHAR-2200?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Shunxin Lu reassigned APEXMALHAR-2200:
--
Assignee: Shunxin Lu
> Enable checkstyle for de
[
https://issues.apache.org/jira/browse/APEXMALHAR-2201?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Shunxin Lu reassigned APEXMALHAR-2201:
--
Assignee: Shunxin Lu
> Suppress console output in Stream API te
Shunxin Lu created APEXMALHAR-2240:
--
Summary: Implement Windowed Join Operator
Key: APEXMALHAR-2240
URL: https://issues.apache.org/jira/browse/APEXMALHAR-2240
Project: Apache Apex Malhar
Shunxin Lu created APEXMALHAR-2300:
--
Summary: Move sample applications in
org.apache.apex.malhar.lib.window.sample to demos package
Key: APEXMALHAR-2300
URL: https://issues.apache.org/jira/browse/APEXMALHAR-2300
23 matches
Mail list logo
