Hi Max

Thanks for the information. I agree with you that 0.3.0 is the way ahead,
but i am hesitant to use 0.3.0-SNAPSHOT due to its changing nature.

Regards
Sumit Chawla


On Fri, Sep 16, 2016 at 5:51 AM, Maximilian Michels <m...@apache.org> wrote:

> Hi Sumit,
>
> Thanks for the PR. Your changes looks good. I think there are
> currently no plans for a minor release 0.2.1-incubating. A lot of
> issues were fixed on the latest master which should give you a better
> experience than the 0.2.0-incubating release.
>
> These are the current issues which will be fixed in 0.3.0-incubating:
> https://issues.apache.org/jira/browse/BEAM-102?jql=
> project%20%3D%20BEAM%20AND%20fixVersion%20%3D%200.3.0-
> incubating%20AND%20component%20%3D%20runner-flink
>
> 1. Most notably, it fixes an issue with comparing keys unencoded in
> streaming mode which was an issue if you had not implemented
> equals/hashCode for your objects.
>
> 2. Further, we support side inputs in streaming now. In the course, we
> have also unified execution paths in streaming mode.
>
> 3. There was an issue with checkpointed sources that has been resolved.
>
> If you could try out the latest version, that would be great. If not,
> we can probably merge your PR and think about a minor release.
>
> Best,
> Max
>
> On Fri, Sep 16, 2016 at 6:10 AM, Chawla,Sumit <sumitkcha...@gmail.com>
> wrote:
> > Hi Max
> >
> > I have opened a PR - https://github.com/apache/incubator-beam/pull/963
> for
> > adding support of Flink 1.1.2 in Beam 0.2.0 release.
> >
> > Regards
> > Sumit Chawla
> >
> >
> > On Wed, Sep 14, 2016 at 1:32 PM, Chawla,Sumit <sumitkcha...@gmail.com>
> > wrote:
> >
> >> Hi Max
> >>
> >> I was able to compile 0.2.0 with Flink 1.1.0 with small modification,
> and
> >> run a simple pipeline.
> >>
> >>    @Override
> >> -  public void restoreState(StreamTaskState taskState, long
> >> recoveryTimestamp) throws Exception {
> >> -    super.restoreState(taskState, recoveryTimestamp);
> >> +  public void restoreState(StreamTaskState taskState) throws Exception
> {
> >> +    super.restoreState(taskState);
> >>
> >>
> >> Can i get a sense of the changes that have happened in 0.3.0 for
> Flink?  I
> >> observed some classes completely reworked.  It will be crucial for me to
> >> understand the scope of change and impact before making a move to 0.3.0
> >>
> >>
> >>
> >> Regards
> >> Sumit Chawla
> >>
> >>
> >> On Wed, Sep 14, 2016 at 3:03 AM, Maximilian Michels <m...@apache.org>
> >> wrote:
> >>
> >>> We support Flink 1.1.2 on the latest snapshot version
> >>> 0.3.0-incubating-SNAPSHOT. Would it be possible for you to work with
> >>> this version?
> >>>
> >>> On Tue, Sep 13, 2016 at 11:55 PM, Chawla,Sumit <sumitkcha...@gmail.com
> >
> >>> wrote:
> >>> > When trying to use Beam 0.2.0 with Flink 1.1.0 jar, i am seeing
> >>> following
> >>> > error:
> >>> >
> >>> > java.lang.NoSuchMethodError:
> >>> > org.apache.flink.streaming.api.operators.StreamingRuntimeCon
> >>> text.registerTimer(JLorg/apache/flink/streaming/
> >>> runtime/operators/Triggerable;)V
> >>> >         at org.apache.beam.runners.flink.
> translation.wrappers.streaming
> >>> .io.UnboundedSourceWrapper.setNextWatermarkTimer(UnboundedSo
> >>> urceWrapper.java:381)
> >>> >         at org.apache.beam.runners.flink.
> translation.wrappers.streaming
> >>> .io.UnboundedSourceWrapper.run(UnboundedSourceWrapper.java:233)
> >>> >         at org.apache.flink.streaming.api.operators.StreamSource.
> run(
> >>> StreamSource.java:80)
> >>> >         at org.apache.flink.streaming.api.operators.StreamSource.
> run(
> >>> StreamSource.java:53)
> >>> >         at org.apache.flink.streaming.runtime.tasks.
> SourceStreamTask.
> >>> run(SourceStreamTask.java:56)
> >>> >         at org.apache.flink.streaming.runtime.tasks.StreamTask.
> invoke(
> >>> StreamTask.java:266)
> >>> >         at org.apache.flink.runtime.taskmanager.Task.run(Task.
> java:584)
> >>> >         at java.lang.Thread.run(Thread.java:745)
> >>> >
> >>> >
> >>> > Regards
> >>> > Sumit Chawla
> >>> >
> >>> >
> >>> > On Tue, Sep 13, 2016 at 2:20 PM, Chawla,Sumit <
> sumitkcha...@gmail.com>
> >>> > wrote:
> >>> >
> >>> >> Hi All
> >>> >>
> >>> >> The release-0.2.0-incubating supports Flink 1.0.3. With Flink 1.1.0
> >>> out,
> >>> >> is there a plan to support it with any 0.2.0 patch? I tried
> compiling
> >>> 0.2.0
> >>> >> with Flink 1.1.0,
> >>> >> and got couple of compliation errors in
> FlinkGroupAlsoByWindowWrapper.
> >>> java.
> >>> >> Going back to master i see lots of change in Flink translation
> >>> wrappers,
> >>> >> and
> >>> >> FlinkGroupAlsoByWindowWrapper.java being removed.
> >>> >>
> >>> >> Just want to get a sense of things here, on what would it take to
> >>> support Flink
> >>> >> 1.1.0 with release-0.2.0. Would appreciate views of people who are
> >>> already
> >>> >> working on upgrading it to Flink 1.1.0
> >>> >>
> >>> >> Regards
> >>> >> Sumit Chawla
> >>> >>
> >>> >>
> >>>
> >>
> >>
>

Reply via email to