Hi Andrea,
You could use the new worker_pool_main.py which was developed for the
Kubernetes use case. It works together with the external environment
factory.
Cheers,
Max
On 11.09.19 18:51, Lukasz Cwik wrote:
Yes.
On Wed, Sep 11, 2019 at 3:12 AM Andrea Medeghini
Nope: dang, thanks.
On 9/11/19, 3:49 PM, "Robert Bradshaw" wrote:
CAUTION: This email originated from outside of the organization. Do not
click links or open attachments unless you recognize the sender and know the
content is safe.
Is your input on a file system accessible
Is your input on a file system accessible to the workers? (Including,
from within Docker, if the workers are running in docker.)
On Wed, Sep 11, 2019 at 12:03 PM Matthew Patterson
wrote:
>
> Hi Beamers,
>
>
>
> I am running the `wordcount` example, but following example from
>
Hi Beamers,
I am running the `wordcount` example, but following example from
https://beam.apache.org/documentation/runners/flink/, that is, I change the
pipeline initialization as follows.
```
import apache_beam as beam
from apache_beam.options.pipeline_options import PipelineOptions
options
Yes.
On Wed, Sep 11, 2019 at 3:12 AM Andrea Medeghini <
andrea.medegh...@10xbanking.com> wrote:
> Hi Lukasz,
>
> Thanks for your answer.
>
> I had a look at the ProcessEnvironmentFactory, and I understand that the
> factory is expecting to run the boot process which is in the python
> container
Hi Kyle,
Thanks!
First mistake was that I was on master. I can now build, and the containers are
spun up. I will definitely send more naïve questions as they arise…
Matt
From: Kyle Weaver
Reply-To: "user@beam.apache.org"
Date: Wednesday, September 11, 2019 at 11:07 AM
To:
Hi Matt,
As of recently, I think you need to specify the python version in the
gradle command, e.g.
./gradlew :sdks:python:container:py35:docker
Please don't hesitate to let us know if you have any further questions --
this is how we know where to improve our documentation :)
Kyle Weaver |
Hi Beamers,
Sorry for the naïve question, but I am trying to find a way around gradle build
errors (rat & virtualenv) on master (as of yesterday, 10.09.19).
As I can’t build as suggested (./gradlew :sdks:python:container:docker -> *
What went wrong:
Execution failed for task
Hi
I was developing a simple pipeline where I aggregate records by key and sum
values for a predefined window. I was getting some errors, and after
checking, I am getting exactly the same issues when running Wikipedia
example from the Beam repo. The output is as follows:
Hi Lukasz,
Thanks for your answer.
I had a look at the ProcessEnvironmentFactory, and I understand that the
factory is expecting to run the boot process which is in the python container
(source file boot.go). Is that right?
Best,
Andrea
From: Lukasz Cwik
Reply-To: "user@beam.apache.org"
Hi Lukasz,
Please can you provide some detail on the "process environment"? I would like
to understand how to launch the SDK as a child process.
Thanks!
Fred
From: Lukasz Cwik [mailto:lc...@google.com]
Sent: 10 September 2019 23:19
To: user
Subject: EXTERNAL: Re: How do I run Beam Python
11 matches
Mail list logo
