expose side output stream

Hi there, I am thinking of implement sideOutput into Flink which seems missing support. https://cloud.google.com/dataflow/model/par-do#side-outputs It is useful because it will help pipeline author redirect corrputed input/ code bug to a side stream or write to a table and reconsile afterwards.

Re: N-ary stream operators - status

Hello Aljoscha, Do you think the side inputs might make it to 1.2? On Aug 10, 2016 2:37 AM, "Aljoscha Krettek" wrote: > Hi, > I thought about this while thinking about how to add side inputs to Flink, > as mentioned in the doc. Right now we're focusing on getting a bunch

[jira] [Created] (FLINK-4372) Add ability to take savepoints from job manager web UI

Zhenzhong Xu created FLINK-4372: --- Summary: Add ability to take savepoints from job manager web UI Key: FLINK-4372 URL: https://issues.apache.org/jira/browse/FLINK-4372 Project: Flink Issue

[jira] [Created] (FLINK-4371) Add ability to take savepoints from job manager RESTful API

Zhenzhong Xu created FLINK-4371: --- Summary: Add ability to take savepoints from job manager RESTful API Key: FLINK-4371 URL: https://issues.apache.org/jira/browse/FLINK-4371 Project: Flink

[jira] [Created] (FLINK-4370) Offer a default IntelliJ inspection profile with Flink

Stephan Ewen created FLINK-4370: --- Summary: Offer a default IntelliJ inspection profile with Flink Key: FLINK-4370 URL: https://issues.apache.org/jira/browse/FLINK-4370 Project: Flink Issue

[jira] [Created] (FLINK-4369) Evictingwindowoperator Must Actually Evict Elements

Aljoscha Krettek created FLINK-4369: --- Summary: Evictingwindowoperator Must Actually Evict Elements Key: FLINK-4369 URL: https://issues.apache.org/jira/browse/FLINK-4369 Project: Flink

Re: [DISCUSS] FLIP-5 Only send data to each taskmanager once for broadcasts

Cool first version Felix :-) On Wed, Aug 10, 2016 at 6:48 PM, Stephan Ewen wrote: > Cool, nice results! > > For the iteration unspecialization - we probably should design this hand in > hand with the streaming fault tolerance, as they share the notion of > "intermediate result

Re: [DISCUSS] FLIP-5 Only send data to each taskmanager once for broadcasts

Cool, nice results! For the iteration unspecialization - we probably should design this hand in hand with the streaming fault tolerance, as they share the notion of "intermediate result versions". On Wed, Aug 10, 2016 at 6:09 PM, Felix Neutatz wrote: > Hi everybody, >

[RESULT] [VOTE] Release Apache Flink 1.1.1 (RC1)

This vote has passed with 10 binding +1 votes. I'll go ahead finalize and package this release. +1s (all binding): Marton Balassi Vasia Kalavri Gyula Fora Henry Saputra Stephan Ewen Till Rohrmann Robert Metzger Maximilian Michels Aljoscha Krettek Ufuk Celebi There are no 0s or -1s. On Wed, Aug

Re: [VOTE] Release Apache Flink 1.1.1 (RC1)

This vote has passed with 10 binding +1 votes. I'll go ahead finalize and package this release. +1s (all binding): Marton Balassi Vasia Kalavri Gyula Fora Henry Saputra Stephan Ewen Till Rohrmann Robert Metzger Maximilian Michels Aljoscha Krettek Ufuk Celebi There are no 0s or -1s. On Wed, Aug

Re: [DISCUSS] FLIP-5 Only send data to each taskmanager once for broadcasts

Hi everybody, I found a quick and dirty way to make the blocking subpartition readable by multiple readers. In the JobGraph generation I make all broadcast partitions blocking (see more details here: https://github.com/FelixNeutatz/incubator-flink/commits/blockingMultipleReads). I want to point

Re: Flink 1.1.0 : Hadoop 1/2 compatibility mismatch

Works for me, thanks! -Shannon

[jira] [Created] (FLINK-4367) Offer separate API for watermark generation and timestamp extraction

Robert Metzger created FLINK-4367: - Summary: Offer separate API for watermark generation and timestamp extraction Key: FLINK-4367 URL: https://issues.apache.org/jira/browse/FLINK-4367 Project: Flink

Re: N-ary stream operators - status

OK, thanks Aljoscha! Best, Gábor 2016-08-10 11:37 GMT+02:00 Aljoscha Krettek : > Hi, > I thought about this while thinking about how to add side inputs to Flink, > as mentioned in the doc. Right now we're focusing on getting a bunch of > other features ready for Flink 1.2

Re: [VOTE] Release Apache Flink 1.1.1 (RC1)

+1 to release this as Flink 1.1.1. I've verified the checksums and signatures. On Wed, Aug 10, 2016 at 11:13 AM, Aljoscha Krettek wrote: > +1 (binding) > > On Wed, 10 Aug 2016 at 10:45 Maximilian Michels wrote: > >> +1 (binding) >> >> On Wed, Aug 10, 2016

[jira] [Created] (FLINK-4365) [metrics] MetricConfig has no documentation

Chesnay Schepler created FLINK-4365: --- Summary: [metrics] MetricConfig has no documentation Key: FLINK-4365 URL: https://issues.apache.org/jira/browse/FLINK-4365 Project: Flink Issue Type:

[jira] [Created] (FLINK-4364) TaskManage responses heartbeats from JobManager

Zhijiang Wang created FLINK-4364: Summary: TaskManage responses heartbeats from JobManager Key: FLINK-4364 URL: https://issues.apache.org/jira/browse/FLINK-4364 Project: Flink Issue Type:

[jira] [Created] (FLINK-4363) TaskManager basic startup of all components

Zhijiang Wang created FLINK-4363: Summary: TaskManager basic startup of all components Key: FLINK-4363 URL: https://issues.apache.org/jira/browse/FLINK-4363 Project: Flink Issue Type:

[jira] [Created] (FLINK-4362) Auto generate message sender classes via Java Proxies

Stephan Ewen created FLINK-4362: --- Summary: Auto generate message sender classes via Java Proxies Key: FLINK-4362 URL: https://issues.apache.org/jira/browse/FLINK-4362 Project: Flink Issue

[jira] [Created] (FLINK-4360) TaskManager slot registration at JobManager

Zhijiang Wang created FLINK-4360: Summary: TaskManager slot registration at JobManager Key: FLINK-4360 URL: https://issues.apache.org/jira/browse/FLINK-4360 Project: Flink Issue Type:

[jira] [Created] (FLINK-4359) Add INTERVAL type

Timo Walther created FLINK-4359: --- Summary: Add INTERVAL type Key: FLINK-4359 URL: https://issues.apache.org/jira/browse/FLINK-4359 Project: Flink Issue Type: New Feature Components:

[jira] [Created] (FLINK-4358) TaskManager deploys task into slot

Zhijiang Wang created FLINK-4358: Summary: TaskManager deploys task into slot Key: FLINK-4358 URL: https://issues.apache.org/jira/browse/FLINK-4358 Project: Flink Issue Type: Sub-task

Re: N-ary stream operators - status

Hi, I thought about this while thinking about how to add side inputs to Flink, as mentioned in the doc. Right now we're focusing on getting a bunch of other features ready for Flink 1.2 so it will probably still take a while until someone can start actively working on this again. There is this

[jira] [Created] (FLINK-4357) TaskManager responses slot allocation

Zhijiang Wang created FLINK-4357: Summary: TaskManager responses slot allocation Key: FLINK-4357 URL: https://issues.apache.org/jira/browse/FLINK-4357 Project: Flink Issue Type: Sub-task

[jira] [Created] (FLINK-4356) JobMaster HA

zhangjing created FLINK-4356: Summary: JobMaster HA Key: FLINK-4356 URL: https://issues.apache.org/jira/browse/FLINK-4356 Project: Flink Issue Type: Sub-task Reporter: zhangjing 1.

[jira] [Created] (FLINK-4355) TaskManager registration at ResourceManager

Zhijiang Wang created FLINK-4355: Summary: TaskManager registration at ResourceManager Key: FLINK-4355 URL: https://issues.apache.org/jira/browse/FLINK-4355 Project: Flink Issue Type:

Re: [VOTE] Release Apache Flink 1.1.1 (RC1)

+1 (binding) On Wed, 10 Aug 2016 at 10:45 Maximilian Michels wrote: > +1 (binding) > > On Wed, Aug 10, 2016 at 9:54 AM, Robert Metzger > wrote: > > +1 to release 1.1.1 > > > > I've checked the files in the staging repository and reproduced one of > the > >

[jira] [Created] (FLINK-4354) TaskManager to ResourceManager heartbeats

Zhijiang Wang created FLINK-4354: Summary: TaskManager to ResourceManager heartbeats Key: FLINK-4354 URL: https://issues.apache.org/jira/browse/FLINK-4354 Project: Flink Issue Type: Sub-task

[jira] [Created] (FLINK-4353) cluster components failure process

zhangjing created FLINK-4353: Summary: cluster components failure process Key: FLINK-4353 URL: https://issues.apache.org/jira/browse/FLINK-4353 Project: Flink Issue Type: Sub-task

[jira] [Created] (FLINK-4352) JobClient interaction

zhangjing created FLINK-4352: Summary: JobClient interaction Key: FLINK-4352 URL: https://issues.apache.org/jira/browse/FLINK-4352 Project: Flink Issue Type: Sub-task Components:

[jira] [Created] (FLINK-4351) TaskExecutor interaction

zhangjing created FLINK-4351: Summary: TaskExecutor interaction Key: FLINK-4351 URL: https://issues.apache.org/jira/browse/FLINK-4351 Project: Flink Issue Type: Sub-task Components:

[jira] [Created] (FLINK-4350) ResourceManager interaction

zhangjing created FLINK-4350: Summary: ResourceManager interaction Key: FLINK-4350 URL: https://issues.apache.org/jira/browse/FLINK-4350 Project: Flink Issue Type: Sub-task Components:

Re: [DISCUSS] updating apache-flink homebrew formula

+1 for Scala 2.11 and would be nice to update to Apache Flink 1.1.1 ASAP. After all, Homebrew users like to stay on the bleeding edge :) On Wed, Aug 10, 2016 at 12:00 AM, Wright, Eron wrote: > Will update the homebrew package to Flink 1.1.1 + Hadoop 2.7 + Scala 2.11. > >> On

Re: [VOTE] Release Apache Flink 1.1.1 (RC1)

+1 (binding) On Wed, Aug 10, 2016 at 9:54 AM, Robert Metzger wrote: > +1 to release 1.1.1 > > I've checked the files in the staging repository and reproduced one of the > issues reported on user@. With 1.1.1, the issue is gone. > > The exception with 1.1.0: > Exception in

RE: Flink 1.1.0 : Hadoop 1/2 compatibility mismatch

Hi, Good for me ; my unit tests all passed with this rc version. Thanks, Arnaud -Message d'origine- De : Ufuk Celebi [mailto:u...@apache.org] Envoyé : mardi 9 août 2016 18:33 À : Ufuk Celebi Cc : u...@flink.apache.org; dev@flink.apache.org Objet : Re: Flink 1.1.0 :

[jira] [Created] (FLINK-4349) ResourceManager interaction

zhangjing created FLINK-4349: Summary: ResourceManager interaction Key: FLINK-4349 URL: https://issues.apache.org/jira/browse/FLINK-4349 Project: Flink Issue Type: Task Reporter:

[jira] [Created] (FLINK-4348) implement communication from ResourceManager to TaskManager

Kurt Young created FLINK-4348: - Summary: implement communication from ResourceManager to TaskManager Key: FLINK-4348 URL: https://issues.apache.org/jira/browse/FLINK-4348 Project: Flink Issue

Re: [VOTE] Release Apache Flink 1.1.1 (RC1)

+1 to release 1.1.1 I've checked the files in the staging repository and reproduced one of the issues reported on user@. With 1.1.1, the issue is gone. The exception with 1.1.0: Exception in thread "main" org.apache.flink.runtime.client.JobExecutionException: Failed to submit job

Re: [VOTE] Release Apache Flink 1.1.1 (RC1)

+1 from my side as well. On Tue, Aug 9, 2016 at 9:01 PM, Stephan Ewen wrote: > +1 > > This is a crucial fix and the released sources are actually still the same, > so reduced time should be okay. > > On Tue, Aug 9, 2016 at 8:24 PM, Henry Saputra >