You should be able to provide extra_args to the expansion service:
```
--defaultEnvironmentType=PROCESS
--defaultEnvironmentConfig={"command":"/opt/apache/beam_java/boot"}
```
I am also running the Xlang pipeline in flink k8s cluster. After setting
the defaultEnvironmentType to PROCESS, I don't
If I’m not mistaken you could create a PCollection from the pubsub read
operation, and then apply 3 different windowing strategies in different
“chains” of the graph. Ex
PCollection msgs = PubsubIO.read(…);
msgs.apply(Window.into(FixedWindows.of(1 min)).apply(allMyTransforms)
The worker pool means `starting a java or python sdk`, to accept the java
or python pipeline running. For example, to execute python pipeline, we
have to start a python worker pool with `--worker_pool` arguments. For the
Java code, besides the docker mode (default one), do we have other better
Hey Beam community,
We are organizing a few in-person community meetups for Apache Beam and
opening up calls for proposals. Please send me directly the topics / ideas
you'd like to present at the following dates and locations:
November 2, Santa Clara, CA
November 10, NYC
November 12, Bangalore,
I’m not sure that I get it correctly. What do you mean by “worker pool” in your
case?
—
Alexey
> On 8 Oct 2022, at 03:24, Xiao Ma wrote:
>
> Hello,
>
> I would like to run a pipeline with Java as the main language and python
> transformation embedded. The beam pipeline is running on the
Is there a specific I/O connector you are hoping to use ?
Thanks,
Cham
On Tue, Oct 11, 2022 at 4:31 AM Alexey Romanenko
wrote:
> Yes, it’s possible though Java IO connector should support being used via
> X-language.
>
> For more details regarding which connector supports this, you may want to
Yes, it’s possible though Java IO connector should support being used via
X-language.
For more details regarding which connector supports this, you may want to take
a look on IO connectors table on this page [1] and check if the required
connector is supported "via X-language" for Python SDK.
Hi,
Does the present cross Language functionality support creating custom Java
transforms and calling from python in Dataflow runner.
Use case: use existing Java IO as cross Language transform and call in
python pipeline in Dataflow runner.
Regards
Phani Geeth
