Hello,
I am trying to use Java 8 lambdas in my project and hit the following
error:
Exception in thread main
org.apache.flink.api.common.functions.InvalidTypesException: The
generic type parameters of 'Tuple2' are missing.
It seems that your compiler has not stored them into the .class
file.
I have a fix for this user-discovered bug:
https://issues.apache.org/jira/browse/FLINK-1463?jql=project%20%3D%20FLINK%20AND%20assignee%20%3D%20currentUser()%20AND%20resolution%20%3D%20Unresolved
in this PR: https://github.com/apache/flink/pull/353
This should probably also be back-ported to
Hi,
looking at your code, it seems that you are creating a DataSet for each
file in the directory. Flink can also read entire directories.
Now regarding the actual problem:
How are you starting the Flink job?
Out of your IDE, or using the ./bin/flink run tool?
Best,
Robert
On Fri, Feb 6,
Sorry, I didn't see the pathID which is added in the map() method.
Then your approach looks good for using Flink locally.
On Fri, Feb 6, 2015 at 3:03 PM, Nam-Luc Tran namluc.t...@euranova.eu
wrote:
Thank you for your replies.
@Stephen
Updating to 0.9-SNAPSHOT and using the return statement
@Aljoscha, can you merge the backported fix to the release-0.8 branch
when its ready?
On Fri, Feb 6, 2015 at 11:39 AM, Aljoscha Krettek aljos...@apache.org
wrote:
I have a fix for this user-discovered bug:
Hey,
We've been implementing a simple Storm-like fault tolerance system
with persisting source records and keeping track of all the records
(whether they've been processed), and replaying them if they fail. The
straightforward way to do this was creating a special AbstractJobVertex
(and
