[
https://issues.apache.org/jira/browse/FLINK-377?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14314456#comment-14314456
]
ASF GitHub Bot commented on FLINK-377:
--------------------------------------
Github user mxm commented on the pull request:
https://github.com/apache/flink/pull/202#issuecomment-73736669
Now I'm getting:
02/10/2015 17:47:06 Job execution switched to status RUNNING.
02/10/2015 17:47:06 DataSource (ValueSource)(1/1) switched to
SCHEDULED
02/10/2015 17:47:06 DataSource (ValueSource)(1/1) switched to
DEPLOYING
02/10/2015 17:47:06 DataSource (ValueSource)(1/1) switched to
RUNNING
02/10/2015 17:47:06 MapPartition (PythonFlatMap ->
PythonCombine)(1/1) switched to SCHEDULED
02/10/2015 17:47:06 MapPartition (PythonFlatMap ->
PythonCombine)(1/1) switched to DEPLOYING
02/10/2015 17:47:06 DataSource (ValueSource)(1/1) switched to
FINISHED
02/10/2015 17:47:06 MapPartition (PythonFlatMap ->
PythonCombine)(1/1) switched to RUNNING
02/10/2015 17:47:16 MapPartition (PythonFlatMap ->
PythonCombine)(1/1) switched to FAILED
java.lang.Exception: The user defined 'open()' method caused an
exception: External process for task MapPartition (PythonFlatMap ->
PythonCombine) stopped responding.
Traceback (most recent call last):
File
"/var/folders/p0/153pkhvn2vn79b2yszvb64th0000gn/T/tmp_d688cd6ddf2347ab1d713a847b73d234/flink/executor.py",
line 55, in <module>
s.bind((socket.gethostname(), 0))
File
"/usr/local/Cellar/python/2.7.9/Frameworks/Python.framework/Versions/2.7/lib/python2.7/socket.py",
line 224, in meth
return getattr(self._sock,name)(*args)
socket.gaierror: [Errno 8] nodename nor servname provided, or not known
at
org.apache.flink.runtime.operators.RegularPactTask.run(RegularPactTask.java:491)
at
org.apache.flink.runtime.operators.RegularPactTask.invoke(RegularPactTask.java:360)
at
org.apache.flink.runtime.execution.RuntimeEnvironment.run(RuntimeEnvironment.java:204)
at java.lang.Thread.run(Thread.java:745)
Caused by: java.lang.RuntimeException: External process for task
MapPartition (PythonFlatMap -> PythonCombine) stopped responding.
Traceback (most recent call last):
File
"/var/folders/p0/153pkhvn2vn79b2yszvb64th0000gn/T/tmp_d688cd6ddf2347ab1d713a847b73d234/flink/executor.py",
line 55, in <module>
s.bind((socket.gethostname(), 0))
File
"/usr/local/Cellar/python/2.7.9/Frameworks/Python.framework/Versions/2.7/lib/python2.7/socket.py",
line 224, in meth
return getattr(self._sock,name)(*args)
socket.gaierror: [Errno 8] nodename nor servname provided, or not known
at
org.apache.flink.languagebinding.api.java.common.streaming.Streamer.open(Streamer.java:72)
at
org.apache.flink.languagebinding.api.java.python.functions.PythonMapPartition.open(PythonMapPartition.java:48)
at
org.apache.flink.api.common.functions.util.FunctionUtils.openFunction(FunctionUtils.java:33)
at
org.apache.flink.runtime.operators.RegularPactTask.run(RegularPactTask.java:487)
... 3 more
02/10/2015 17:47:16 Job execution switched to status FAILING.
02/10/2015 17:47:16 GroupReduce (PythonGroupReducePreStep)(1/1)
switched to CANCELED
02/10/2015 17:47:16 MapPartition (PythonGroupReduce)(1/1) switched
to CANCELED
02/10/2015 17:47:16 DataSink(PrintSink)(1/1) switched to CANCELED
02/10/2015 17:47:16 Job execution switched to status FAILED.
Error: The program execution failed: java.lang.Exception: The user
defined 'open()' method caused an exception: External process for task
MapPartition (PythonFlatMap -> PythonCombine) stopped responding.
Traceback (most recent call last):
File
"/var/folders/p0/153pkhvn2vn79b2yszvb64th0000gn/T/tmp_d688cd6ddf2347ab1d713a847b73d234/flink/executor.py",
line 55, in <module>
s.bind((socket.gethostname(), 0))
File
"/usr/local/Cellar/python/2.7.9/Frameworks/Python.framework/Versions/2.7/lib/python2.7/socket.py",
line 224, in meth
return getattr(self._sock,name)(*args)
socket.gaierror: [Errno 8] nodename nor servname provided, or not known
at
org.apache.flink.runtime.operators.RegularPactTask.run(RegularPactTask.java:491)
at
org.apache.flink.runtime.operators.RegularPactTask.invoke(RegularPactTask.java:360)
at
org.apache.flink.runtime.execution.RuntimeEnvironment.run(RuntimeEnvironment.java:204)
at java.lang.Thread.run(Thread.java:745)
Caused by: java.lang.RuntimeException: External process for task
MapPartition (PythonFlatMap -> PythonCombine) stopped responding.
Traceback (most recent call last):
File
"/var/folders/p0/153pkhvn2vn79b2yszvb64th0000gn/T/tmp_d688cd6ddf2347ab1d713a847b73d234/flink/executor.py",
line 55, in <module>
s.bind((socket.gethostname(), 0))
File
"/usr/local/Cellar/python/2.7.9/Frameworks/Python.framework/Versions/2.7/lib/python2.7/socket.py",
line 224, in meth
return getattr(self._sock,name)(*args)
socket.gaierror: [Errno 8] nodename nor servname provided, or not known
at
org.apache.flink.languagebinding.api.java.common.streaming.Streamer.open(Streamer.java:72)
at
org.apache.flink.languagebinding.api.java.python.functions.PythonMapPartition.open(PythonMapPartition.java:48)
at
org.apache.flink.api.common.functions.util.FunctionUtils.openFunction(FunctionUtils.java:33)
at
org.apache.flink.runtime.operators.RegularPactTask.run(RegularPactTask.java:487)
... 3 more
org.apache.flink.client.program.ProgramInvocationException: The program
execution failed: java.lang.Exception: The user defined 'open()' method caused
an exception: External process for task MapPartition (PythonFlatMap ->
PythonCombine) stopped responding.
Traceback (most recent call last):
File
"/var/folders/p0/153pkhvn2vn79b2yszvb64th0000gn/T/tmp_d688cd6ddf2347ab1d713a847b73d234/flink/executor.py",
line 55, in <module>
s.bind((socket.gethostname(), 0))
File
"/usr/local/Cellar/python/2.7.9/Frameworks/Python.framework/Versions/2.7/lib/python2.7/socket.py",
line 224, in meth
return getattr(self._sock,name)(*args)
socket.gaierror: [Errno 8] nodename nor servname provided, or not known
at
org.apache.flink.runtime.operators.RegularPactTask.run(RegularPactTask.java:491)
at
org.apache.flink.runtime.operators.RegularPactTask.invoke(RegularPactTask.java:360)
at
org.apache.flink.runtime.execution.RuntimeEnvironment.run(RuntimeEnvironment.java:204)
at java.lang.Thread.run(Thread.java:745)
Caused by: java.lang.RuntimeException: External process for task
MapPartition (PythonFlatMap -> PythonCombine) stopped responding.
Traceback (most recent call last):
File
"/var/folders/p0/153pkhvn2vn79b2yszvb64th0000gn/T/tmp_d688cd6ddf2347ab1d713a847b73d234/flink/executor.py",
line 55, in <module>
s.bind((socket.gethostname(), 0))
File
"/usr/local/Cellar/python/2.7.9/Frameworks/Python.framework/Versions/2.7/lib/python2.7/socket.py",
line 224, in meth
return getattr(self._sock,name)(*args)
socket.gaierror: [Errno 8] nodename nor servname provided, or not known
at
org.apache.flink.languagebinding.api.java.common.streaming.Streamer.open(Streamer.java:72)
at
org.apache.flink.languagebinding.api.java.python.functions.PythonMapPartition.open(PythonMapPartition.java:48)
at
org.apache.flink.api.common.functions.util.FunctionUtils.openFunction(FunctionUtils.java:33)
at
org.apache.flink.runtime.operators.RegularPactTask.run(RegularPactTask.java:487)
... 3 more
at org.apache.flink.client.program.Client.run(Client.java:337)
at org.apache.flink.client.program.Client.run(Client.java:296)
at org.apache.flink.client.program.Client.run(Client.java:290)
at
org.apache.flink.client.program.ContextEnvironment.execute(ContextEnvironment.java:55)
at
org.apache.flink.api.java.ExecutionEnvironment.execute(ExecutionEnvironment.java:675)
at
org.apache.flink.languagebinding.api.java.python.PythonPlanBinder.runPlan(PythonPlanBinder.java:108)
at
org.apache.flink.languagebinding.api.java.python.PythonPlanBinder.main(PythonPlanBinder.java:79)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at
sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
at
sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:483)
at
org.apache.flink.client.program.PackagedProgram.callMainMethod(PackagedProgram.java:434)
at
org.apache.flink.client.program.PackagedProgram.invokeInteractiveModeForExecution(PackagedProgram.java:350)
at org.apache.flink.client.program.Client.run(Client.java:242)
at
org.apache.flink.client.CliFrontend.executeProgram(CliFrontend.java:389)
at org.apache.flink.client.CliFrontend.run(CliFrontend.java:358)
at
org.apache.flink.client.CliFrontend.parseParameters(CliFrontend.java:1068)
at
org.apache.flink.client.CliFrontend.main(CliFrontend.java:1092)
> Create a general purpose framework for language bindings
> --------------------------------------------------------
>
> Key: FLINK-377
> URL: https://issues.apache.org/jira/browse/FLINK-377
> Project: Flink
> Issue Type: Improvement
> Reporter: GitHub Import
> Assignee: Chesnay Schepler
> Labels: github-import
> Fix For: pre-apache
>
>
> A general purpose API to run operators with arbitrary binaries.
> This will allow to run Stratosphere programs written in Python, JavaScript,
> Ruby, Go or whatever you like.
> We suggest using Google Protocol Buffers for data serialization. This is the
> list of languages that currently support ProtoBuf:
> https://code.google.com/p/protobuf/wiki/ThirdPartyAddOns
> Very early prototype with python:
> https://github.com/rmetzger/scratch/tree/learn-protobuf (basically testing
> protobuf)
> For Ruby: https://github.com/infochimps-labs/wukong
> Two new students working at Stratosphere (@skunert and @filiphaase) are
> working on this.
> The reference binding language will be for Python, but other bindings are
> very welcome.
> The best name for this so far is "stratosphere-lang-bindings".
> I created this issue to track the progress (and give everybody a chance to
> comment on this)
> ---------------- Imported from GitHub ----------------
> Url: https://github.com/stratosphere/stratosphere/issues/377
> Created by: [rmetzger|https://github.com/rmetzger]
> Labels: enhancement,
> Assignee: [filiphaase|https://github.com/filiphaase]
> Created at: Tue Jan 07 19:47:20 CET 2014
> State: open
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)