Your solution works well, many thanks. This solves the exception that I
described previously.
However, in a different part of the script I come across another problem
about reusing data sets. For example, given the script at
https://gist.github.com/GEOFBOT/d670f567f8c886572c8715a6058f8b34, I get
In this branch: https://github.com/zentol/flink/tree/new-iterations you
can find a more fine-grained fix for chaining with
iterations. relevant commit: ac2305d9589a5c6ab9e94d04c870fba52716d695
On 13.10.2016 23:11, Chesnay Schepler wrote:
The chaining code is definitely related, I also have a
The chaining code is definitely related, I also have a pretty clear idea
how to fix it.
The odd thing is that the Java API doesn't catch this type mismatch; the
date types are
known when the plan is generated. This kind of error shouldn't even happen.
On 13.10.2016 21:15, Geoffrey Mon wrote:
Thank you very much. Disabling chaining with the Python API allows my
actual script to run properly. The division by zero must be an issue with
the job that I posted on gist.
Does that mean that the issue must be in the chaining part of the API?
Chaining from the way I understand it is an
A temporary work around appears to be disabling chaining, which you can
do by commenting out L215 "self._find_chains()" in Environment.py.
Note that you then run into a division by zero error, but i can't tell
whether that is a problem of the job or not.
On 13.10.2016 13:41, Chesnay Schepler
Hey Geoffrey,
I was able to reproduce the error and will look into it in more detail
tomorrow.
Regards,
Chesnay
On 12.10.2016 23:09, Geoffrey Mon wrote:
Hello,
Has anyone had a chance to look into this? I am currently working on the
problem but I have minimal understanding of how the
Hello,
Has anyone had a chance to look into this? I am currently working on the
problem but I have minimal understanding of how the internal Flink Python
API works; any expertise would be greatly appreciated.
Thank you very much!
Geoffrey
On Sat, Oct 8, 2016 at 1:27 PM Geoffrey Mon
Hi Chesnay,
Heh, I have discovered that if I do not restart Flink after running my
original problematic script, then similar issues will manifest themselves
in other otherwise working scripts. I haven't been able to completely
narrow down the problem, but I promise this new script will have a
Hello Geoffrey,
this one works for me as well :D
Regards,
Chesnay
On 28.09.2016 05:38, Geoffrey Mon wrote:
Hello Chesnay,
Thank you for your help. After receiving your message I recompiled my
version of Flink completely, and both the NullPointerException listed in
the TODO and the
Hello Chesnay,
Thank you for your help. After receiving your message I recompiled my
version of Flink completely, and both the NullPointerException listed in
the TODO and the ClassCastException with the join operation went away.
Previously, I had been only recompiling the modules of Flink that
Hello Geoffrey,
i could not reproduce this issue with the commits and plan you provided.
I tried out both the FLINK-4098 and bulk-iterations branches (and
reverted back to the specified commits) and built Flink from scratch.
Could you double check that the code you provided produces the
Hello,
I'll try to take a look this week.
Regards,
Chesnay
On 20.09.2016 02:38, Geoffrey Mon wrote:
Hello all,
I have recently been working on adding bulk iterations to the Python API of
Flink in order to facilitate a research project I am working on. The
current changes can be seen in this
Hello all,
I have recently been working on adding bulk iterations to the Python API of
Flink in order to facilitate a research project I am working on. The
current changes can be seen in this GitHub diff:
13 matches
Mail list logo
