[
https://issues.apache.org/jira/browse/FLINK-377?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14346670#comment-14346670
]
ASF GitHub Bot commented on FLINK-377:
--------------------------------------
Github user aljoscha commented on the pull request:
https://github.com/apache/flink/pull/202#issuecomment-77127742
Thanks, I have two last requests, sorry for that.
Could you rename flink-generic to flink-language-binding-generic? The
problem is, that the package name is now flink-generic, it pops up like this in
maven central and so on without the information that it is actually a sub
package of flink-language-binding. This could be quite confusing.
In MapFunctin.py and FilterFunction.py you use map() and filter()
respectively. These operations are not lazy, i.e. in map() it does first apply
the user map-function to every element in the partition and then it collects
the results. This can become a problem if the input is very big. Instead we
should iterate over the iterator and output each element after mapping. This
keeps memory consumption low. Same applies to filter().
> Create a general purpose framework for language bindings
> --------------------------------------------------------
>
> Key: FLINK-377
> URL: https://issues.apache.org/jira/browse/FLINK-377
> Project: Flink
> Issue Type: Improvement
> Reporter: GitHub Import
> Assignee: Chesnay Schepler
> Labels: github-import
> Fix For: pre-apache
>
>
> A general purpose API to run operators with arbitrary binaries.
> This will allow to run Stratosphere programs written in Python, JavaScript,
> Ruby, Go or whatever you like.
> We suggest using Google Protocol Buffers for data serialization. This is the
> list of languages that currently support ProtoBuf:
> https://code.google.com/p/protobuf/wiki/ThirdPartyAddOns
> Very early prototype with python:
> https://github.com/rmetzger/scratch/tree/learn-protobuf (basically testing
> protobuf)
> For Ruby: https://github.com/infochimps-labs/wukong
> Two new students working at Stratosphere (@skunert and @filiphaase) are
> working on this.
> The reference binding language will be for Python, but other bindings are
> very welcome.
> The best name for this so far is "stratosphere-lang-bindings".
> I created this issue to track the progress (and give everybody a chance to
> comment on this)
> ---------------- Imported from GitHub ----------------
> Url: https://github.com/stratosphere/stratosphere/issues/377
> Created by: [rmetzger|https://github.com/rmetzger]
> Labels: enhancement,
> Assignee: [filiphaase|https://github.com/filiphaase]
> Created at: Tue Jan 07 19:47:20 CET 2014
> State: open
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
