[
https://issues.apache.org/jira/browse/FLINK-671?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14059707#comment-14059707
]
Chesnay Schepler commented on FLINK-671:
----------------------------------------
Status Update:
not much this week :/
* Documentation is in a good state right now as far as i can tell
* you can now specify local execution in the plan (previously this worked with
a static variable in a java class)
I couldn't pinpoint the issue that is preventing the WC from finishing. I ran
it with some debug messages, printing every word send from python (these are
send to java as well!) and every word received form java. the result is that on
the failing node, 120.000.000 transmissions work fine, then suddenly wrong data
is received. It is not related to the words processed at the time, after all
the debug messages come through, which follow pretty much the same protocol. i
also double checked these words with an extra program.
Something seems to be messing with the streams. It fails like clockwork after
18-20 minutes (there's nothing interesting in the job-/taskmanager logs around
this time though).
> Python interface for new API (Map/Reduce)
> -----------------------------------------
>
> Key: FLINK-671
> URL: https://issues.apache.org/jira/browse/FLINK-671
> Project: Flink
> Issue Type: Improvement
> Components: Python API
> Reporter: Chesnay Schepler
> Assignee: Chesnay Schepler
> Labels: github-import
> Fix For: pre-apache
>
> Attachments: pull-request-671-9139035883911146960.patch
>
>
> ([#615|https://github.com/stratosphere/stratosphere/issues/615] |
> [FLINK-615|https://issues.apache.org/jira/browse/FLINK-615])
> ---------------- Imported from GitHub ----------------
> Url: https://github.com/stratosphere/stratosphere/pull/671
> Created by: [zentol|https://github.com/zentol]
> Labels: enhancement, java api,
> Milestone: Release 0.6 (unplanned)
> Created at: Wed Apr 09 20:52:06 CEST 2014
> State: open
--
This message was sent by Atlassian JIRA
(v6.2#6252)
