Do you have any suggestions for addressing this issue? I am unsure of what to try next.
On Fri, Feb 7, 2020 at 5:55 PM Ankur Goenka <[email protected]> wrote: > That seems to be a problem. > > When I try the command, I get > > $ telnet localhost 8099 > Trying ::1... > Connected to localhost. > Escape character is '^]'. > �^CConnection closed by foreign host. > > On Fri, Feb 7, 2020 at 5:34 PM Xander Song <[email protected]> wrote: > >> Thanks for the response. After entering telnet localhost 8099, I receive >> >> Trying ::1... >> >> telnet: connect to address ::1: Connection refused >> >> Trying 127.0.0.1... >> >> telnet: connect to address 127.0.0.1: Connection refused >> >> telnet: Unable to connect to remote host >> >> >> On Fri, Feb 7, 2020 at 11:41 AM Ankur Goenka <[email protected]> wrote: >> >>> Seems that pipeline submission from sdk is not able to reach the job >>> server which was started in docker. >>> >>> Can you try running "telnet localhost 8099" to make sure that pipeline >>> submission can reach the job server. >>> >>> On Thu, Feb 6, 2020 at 8:16 PM Xander Song <[email protected]> >>> wrote: >>> >>>> I am having difficulty following the Python guide for running Beam on >>>> Flink <https://beam.apache.org/documentation/runners/flink/>. I >>>> created a virtual environment with Apache Beam installed, then I started up >>>> the JobService Docker container with >>>> >>>> docker run --net=host apachebeam/flink1.9_job_server:latest >>>> >>>> >>>> I receive the following message confirming that the container is >>>> running. >>>> >>>> >>>> [main] INFO >>>> org.apache.beam.runners.fnexecution.jobsubmission.JobServerDriver - >>>> ArtifactStagingService started on localhost:8098 >>>> >>>> [main] INFO >>>> org.apache.beam.runners.fnexecution.jobsubmission.JobServerDriver - Java >>>> ExpansionService started on localhost:8097 >>>> >>>> [main] INFO >>>> org.apache.beam.runners.fnexecution.jobsubmission.JobServerDriver - >>>> JobService started on localhost:8099 >>>> >>>> >>>> In another terminal, I execute a Beam script called >>>> test_beam_local_flink.py based on the example. >>>> >>>> >>>> from __future__ import print_function >>>> import apache_beamfrom apache_beam.options.pipeline_options import >>>> PipelineOptions >>>> >>>> data = [1,2,3] >>>> >>>> options = PipelineOptions([ >>>> "--runner=PortableRunner", >>>> "--job_endpoint=localhost:8099", >>>> "--environment_type=LOOPBACK"]) >>>> with apache_beam.Pipeline(options=options) as p: >>>> video_collection = ( >>>> p | apache_beam.Create(data) >>>> | apache_beam.Map(lambda x: x + 1) >>>> | apache_beam.Map(lambda x: print(x)) >>>> ) >>>> print('Done') >>>> >>>> After a wait, I get the following traceback. >>>> >>>> /Users/xander/Projects/flink-test/env2/lib/python2.7/site-packages/apache_beam/__init__.py:84: >>>> UserWarning: You are using Apache Beam with Python 2. New releases of >>>> Apache Beam will soon support Python 3 only. >>>> >>>> 'You are using Apache Beam with Python 2. ' >>>> >>>> Traceback (most recent call last): >>>> >>>> File "test_beam_local_flink.py", line 18, in <module> >>>> >>>> | apache_beam.Map(lambda x: print(x)) >>>> >>>> File >>>> "/Users/xander/Projects/flink-test/env2/lib/python2.7/site-packages/apache_beam/pipeline.py", >>>> line 481, in __exit__ >>>> >>>> self.run().wait_until_finish() >>>> >>>> File >>>> "/Users/xander/Projects/flink-test/env2/lib/python2.7/site-packages/apache_beam/pipeline.py", >>>> line 461, in run >>>> >>>> self._options).run(False) >>>> >>>> File >>>> "/Users/xander/Projects/flink-test/env2/lib/python2.7/site-packages/apache_beam/pipeline.py", >>>> line 474, in run >>>> >>>> return self.runner.run_pipeline(self, self._options) >>>> >>>> File >>>> "/Users/xander/Projects/flink-test/env2/lib/python2.7/site-packages/apache_beam/runners/portability/portable_runner.py", >>>> line 220, in run_pipeline >>>> >>>> job_service = self.create_job_service(options) >>>> >>>> File >>>> "/Users/xander/Projects/flink-test/env2/lib/python2.7/site-packages/apache_beam/runners/portability/portable_runner.py", >>>> line 136, in create_job_service >>>> >>>> return server.start() >>>> >>>> File >>>> "/Users/xander/Projects/flink-test/env2/lib/python2.7/site-packages/apache_beam/runners/portability/job_server.py", >>>> line 59, in start >>>> >>>> grpc.channel_ready_future(channel).result(timeout=self._timeout) >>>> >>>> File >>>> "/Users/xander/Projects/flink-test/env2/lib/python2.7/site-packages/grpc/_utilities.py", >>>> line 140, in result >>>> >>>> self._block(timeout) >>>> >>>> File >>>> "/Users/xander/Projects/flink-test/env2/lib/python2.7/site-packages/grpc/_utilities.py", >>>> line 86, in _block >>>> >>>> raise grpc.FutureTimeoutError() >>>> >>>> grpc.FutureTimeoutError >>>> >>>> >>>> >>>> Any help is greatly appreciated. >>>> >>>>
