Heh, I have discovered that if I do not restart Flink after running my
original problematic script, then similar issues will manifest themselves
in other otherwise working scripts. I haven't been able to completely
narrow down the problem, but I promise this new script will have a
ClassCastException that is completely reproducible. :)
On Wed, Sep 28, 2016 at 9:16 AM Chesnay Schepler <ches...@apache.org>
this one works for me as well :D
On 28.09.2016 05:38, Geoffrey Mon wrote:
Thank you for your help. After receiving your message I recompiled my
version of Flink completely, and both the NullPointerException listed in
the TODO and the ClassCastException with the join operation went away.
Previously, I had been only recompiling the modules of Flink that had
changed to save time using "mvn clean install -pl :module" and apparently
that may have been causing some of my issues.
Now, the problem is more clear: when a specific group reduce function in
research project plan file is used within an iteration, I get a
Caused by: java.lang.ClassCastException:
org.apache.flink.api.java.tuple.Tuple2 cannot be cast to [B
I'm not sure why this is causing an exception, and I would greatly
appreciate any assistance. I've revised the barebones error-causing plan
file to focus on this new error source:
The group reduce function in question seems to work just fine outside of
iterations. I have organized the commits and pushed to a new branch to
it easier to test and hopefully review soon:
On Mon, Sep 26, 2016 at 6:32 AM Chesnay Schepler <ches...@apache.org>
i could not reproduce this issue with the commits and plan you provided.
I tried out both the FLINK-4098 and bulk-iterations branches (and
reverted back to the specified commits) and built Flink from scratch.
Could you double check that the code you provided produces the error?
Also, which OS/python version are you using?
On 20.09.2016 11:13, Chesnay Schepler wrote:
I'll try to take a look this week.
On 20.09.2016 02:38, Geoffrey Mon wrote:
I have recently been working on adding bulk iterations to the Python
Flink in order to facilitate a research project I am working on. The
current changes can be seen in this GitHub diff:
This implementation seems to work for, at least, simple examples,
incrementing numbers in a data set. However, with the transformations
required for my project, I get an exception
[B cannot be cast to org.apache.flink.api.java.tuple.Tuple" thrown
deserializers called by
I've created the following simplified Python plan by stripping down my
research project code to the problem-causing parts:
I have been working on this issue but I don't have any ideas on what
be the problem. Perhaps someone more knowledgeable about the interior
the Python API could kindly help?
Thank you very much.