That did it, thanks for the help Ruoyun, I did forget to pull in the dependency in my pom! bad mistake :)
On 2018/12/05 05:24:29, Ruoyun Huang <[email protected]> wrote: > This should work. but maybe try adding a section like this to your pom.xml > file: > > <profile> > > <id>portable-runner</id> > > <activation> > > <activeByDefault>true</activeByDefault> > > </activation> > > <!-- Makes the PortableRunner available when running a pipeline. --> > > <dependencies> > > <dependency> > > <groupId>org.apache.beam</groupId> > > <artifactId>beam-runners-reference-java</artifactId> > > <version>${beam.version}</version> > > <scope>runtime</scope> > > </dependency> > > </dependencies> > > </profile> > > > Note that PortableRunner has major features still in development. It > currently can only run sample pipeline without file output. There are > active efforts on it though. > > > > > > On Tue, Dec 4, 2018 at 2:21 PM Sai Inampudi <[email protected]> wrote: > > > Thanks for the help Ankur and Ruoyun, appreciate it. I went through the > > wiki and I am still facing the same issue as before (where it complains > > about the following: > > java.lang.IllegalArgumentException: Unknown 'runner' specified > > 'PortableRunner', supported pipeline runners [DirectRunner, FlinkRunner, > > SparkRunner, TestFlinkRunner, TestSparkRunner]) > > > > I am probably doing a naive mistake but I am not sure where, below is > > everything I have done thus far: > > * Confirmed I have met the prerequisities in the wiki > > * Docker is installed and working without sudo > > * gradle target for the java container works > > > > * Successfully started the JobServer (for now, I didn't bother with the > > flink job server and instead just kicked off the reference job server) by > > running the following > > * ./gradlew :beam-runners-reference-job-server:run > > * Confirmed that the JobService started at 8099 port > > * Started ReferenceRunnerJobService at localhost:8099 > > <============-> 98% EXECUTING [22m 43s] > > > :beam-runners-reference-job-server:run > > > IDLE > > > > * My code itself is being managed via maven, so I made sure to pull in the > > latest 2.10.0-SNAPSHOT dependencies as per > > https://repository.apache.org/content/repositories/snapshots/ > > > > * The pipeline is kicked off with the following options: > > * --runner=PortableRunner --jobEndpoint=localhost:8099 > > --streaming=true > > * Running the pipeline results in the following error > > * java.lang.IllegalArgumentException: Unknown 'runner' > > specified 'PortableRunner', supported pipeline runners [DirectRunner, > > FlinkRunner, SparkRunner, TestFlinkRunner, TestSparkRunner] > > > > > > > > I am sure I am missing something basic but I was hoping I could get ideas > > on what it might be? > > > > > > -- > ================ > Ruoyun Huang >
