Hello!
I'm trying to get into Beam, but it seems rather puzzling.
started
> bin\java" -jar \...\...\beam-runners-flink-1.14-job-server-2.46.0.jar
Logs seems ok. Then, I build java starter with beam-sdks-java-core:2.46.0
and beam-runners-portability-java:2.46.0
> bin\java -jar build\pipeline.jar --runner=PortableRunner
--jobEndpoint=localhost:8099
RuntimeException: Error staging files.
at
org.apache.beam.runners.portability.PortableRunner.run(PortableRunner.java:205)
java.nio.file.InvalidPathException: Illegal char <:> at index 6:
1-beam:env:external:v1-pipeline-f-6uWdJSaUObjowFz7tLG7n6QWovK_iNWxPHekV7ECo.jar
at
java.base/sun.nio.fs.WindowsPathParser.normalize(WindowsPathParser.java:182)
at
java.base/sun.nio.fs.WindowsPathParser.parse(WindowsPathParser.java:153)
at
java.base/sun.nio.fs.WindowsPathParser.parse(WindowsPathParser.java:77)
at java.base/sun.nio.fs.WindowsPath.parse(WindowsPath.java:92)
at
java.base/sun.nio.fs.WindowsFileSystem.getPath(WindowsFileSystem.java:232)
at java.base/java.nio.file.Path.resolve(Path.java:515)
at
org.apache.beam.sdk.io.LocalResourceId.resolveLocalPathWindowsOS(LocalResourceId.java:106)
at
org.apache.beam.sdk.io.LocalResourceId.resolve(LocalResourceId.java:66)
at
org.apache.beam.sdk.io.LocalResourceId.resolve(LocalResourceId.java:37)
at
org.apache.beam.runners.fnexecution.artifact.ArtifactStagingService$1.getDestination(ArtifactStagingService.java:170)
at
org.apache.beam.runners.fnexecution.artifact.ArtifactStagingService$StoreArtifact.call(ArtifactStagingService.java:271)
For me it seems like a code error like a path is replaced with some logical
resource id. Specifying --filesToStage=build\pipeline.jar doesn't help.
I'm sure I miss some concepts. FWIW I'd like to kick off Java pipeline on
Flink via PortableRunner. Is it possible?
Thanks!
--
Sincerely yours
Mikhail Khludnev
