On Mon, Apr 24, 2023 at 11:06 AM Sahith Nallapareddy <sahi...@spotify.com> wrote:
> Hello, > > Ah I missed that thank you! I am assuming for java jobs with java external > transform, we run a Java Job Service? > No, the job service is tied to the runner not to the pipeline SDK. The Java quickstart guide gives instructions for starting up a job service for Python portable runner for running Java jobs. - Cham > > Thanks, > > Sahith > > On Mon, Apr 24, 2023 at 2:01 PM Chamikara Jayalath <chamik...@google.com> > wrote: > >> Have you looked into quickstart guides (Java [1], Python [2]) which also >> gives instructions for running using DirectRunner ? >> >> Thanks, >> Cham >> >> [1] >> https://beam.apache.org/documentation/sdks/java-multi-language-pipelines/ >> [2] >> https://beam.apache.org/documentation/sdks/python-multi-language-pipelines/ >> >> On Mon, Apr 24, 2023 at 10:57 AM Sahith Nallapareddy via dev < >> dev@beam.apache.org> wrote: >> >>> Hello, >>> >>> I was wondering the best way to test a pipeline with external transform. >>> We were trying to use the DirectRunner but it seemed to hang on the >>> external transform step. I was wondering if someone could point me to >>> somewhere in the beam code where this is done or give some pointers on how >>> to test a pipeline with an External step in it? I tried searching a bit but >>> was unsuccessful, but maybe I was looking in the wrong place. >>> >>> Thanks, >>> >>> Sahith >>> >>