CFP for upcoming big data conferences

2016-09-29 Thread Thomas Weise
The schedule for Apache Big Data EU has been posted and there will be 3 talks about Apex! https://apachebigdataeu2016.sched.org/ https://twitter.com/thweise/status/781389923299360769 Same week is Big Data Spain in Madrid and I will also speak there: https://www.bigdataspain.org/ Finally,

[GitHub] apex-malhar pull request #404: APEXMALHAR-2190 #resolve #comment Use reusabl...

2016-09-29 Thread brightchen
GitHub user brightchen reopened a pull request: https://github.com/apache/apex-malhar/pull/404 APEXMALHAR-2190 #resolve #comment Use reusable buffer to serial spill… …able data structure You can merge this pull request into a Git repository by running: $ git pull

[jira] [Commented] (APEXMALHAR-2190) Use reusable buffer to serial spillable data structure

2016-09-29 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/APEXMALHAR-2190?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15533842#comment-15533842 ] ASF GitHub Bot commented on APEXMALHAR-2190: GitHub user brightchen reopened a pull

[GitHub] apex-malhar pull request #404: APEXMALHAR-2190 #resolve #comment Use reusabl...

2016-09-29 Thread brightchen
Github user brightchen closed the pull request at: https://github.com/apache/apex-malhar/pull/404 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the

[jira] [Updated] (APEXCORE-542) Fix debug level verbose option for apex cli

2016-09-29 Thread Deepak Narkhede (JIRA)
[ https://issues.apache.org/jira/browse/APEXCORE-542?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Deepak Narkhede updated APEXCORE-542: - Summary: Fix debug level verbose option for apex cli (was: Add DEBUG level verbose

[jira] [Updated] (APEXCORE-542) Fix debug level verbose option for apex cli

2016-09-29 Thread Deepak Narkhede (JIRA)
[ https://issues.apache.org/jira/browse/APEXCORE-542?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Deepak Narkhede updated APEXCORE-542: - Description: Fix debug level verbose option for apex cli. Currently "" option

Re: Retraction

2016-09-29 Thread David Yan
Hi Shunxin: Yes, a retraction is just to tell downstream whatever the windowed operator sent before was wrong. In this blog ( https://www.oreilly.com/ideas/the-world-beyond-batch-streaming-102), their normal trigger value is an integer and the retraction trigger is just the negative of the

[jira] [Created] (APEXMALHAR-2273) Retraction trigger is fired if the retraction value is the same as the current value and when fireOnlyUpdatedPanes is false

2016-09-29 Thread David Yan (JIRA)
David Yan created APEXMALHAR-2273: - Summary: Retraction trigger is fired if the retraction value is the same as the current value and when fireOnlyUpdatedPanes is false Key: APEXMALHAR-2273 URL:

Retraction

2016-09-29 Thread Shunxin Lu
Hi, I am planning to revisit the accumulation implementations and rewrite the getRetraction() method so that it behaves correctly. I understand that the concept of retraction is the upstream operator telling its downstream that the previous output is wrong and give it a new output. But it become

[jira] [Created] (APEXMALHAR-2274) AbstractFileInputOperator gets killed when there are a large number of files.

2016-09-29 Thread Munagala V. Ramanath (JIRA)
Munagala V. Ramanath created APEXMALHAR-2274: Summary: AbstractFileInputOperator gets killed when there are a large number of files. Key: APEXMALHAR-2274 URL:

[GitHub] apex-malhar pull request #414: APEXMALHAR-2240 Implement Windowed Join Opera...

2016-09-29 Thread ShunxinLu
Github user ShunxinLu closed the pull request at: https://github.com/apache/apex-malhar/pull/414 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the

[jira] [Commented] (APEXMALHAR-2240) Implement Windowed Join Operator

2016-09-29 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/APEXMALHAR-2240?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15534598#comment-15534598 ] ASF GitHub Bot commented on APEXMALHAR-2240: GitHub user ShunxinLu reopened a pull

[GitHub] apex-malhar pull request #414: APEXMALHAR-2240 Implement Windowed Join Opera...

2016-09-29 Thread ShunxinLu
GitHub user ShunxinLu reopened a pull request: https://github.com/apache/apex-malhar/pull/414 APEXMALHAR-2240 Implement Windowed Join Operator @davidyan74 @tweise @siyuanh This is the first try of implementing join support for windowed stream. This PR is for review purpose only,

[jira] [Commented] (APEXMALHAR-2240) Implement Windowed Join Operator

2016-09-29 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/APEXMALHAR-2240?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15534597#comment-15534597 ] ASF GitHub Bot commented on APEXMALHAR-2240: Github user ShunxinLu closed the pull

Writing to external systems in reconciled fashion

2016-09-29 Thread Priyanka Gugale
Dear community, We had a discussion before about having reconciler for writing to JDBC output operator. I am proposing to write a reconciler plugin which should be generic

Re: Writing to external systems in reconciled fashion

2016-09-29 Thread Priyanka Gugale
Hi, Please refer to this link for earlier discussion reference: https://lists.apache.org/list.html?dev@apex.apache.org -Priyanka On Thu, Sep 29, 2016 at 5:46 PM, Priyanka Gugale wrote: > Dear community, > > We had a discussion >