max-lepikhin commented on issue #24367: URL: https://github.com/apache/beam/issues/24367#issuecomment-1336548839
@phoerious AzureBlobStoreFileSystemRegistrar is not included in beam-runners-flink-1.14-job-server-2.43.0.jar, so [this line](https://github.com/apache/beam/blob/b5a0f4895ccf7bd2f8b03217d866e8d0c67f6f52/runners/flink/src/main/java/org/apache/beam/runners/flink/FlinkJobServerDriver.java#L76) doesn't register the filesystem causing the exception when "azfs://" is used with [artifacts_dir](https://github.com/apache/beam/blob/883a362c930aca4298551697d7aaacbe7b6602f1/sdks/python/apache_beam/options/pipeline_options.py#L1428) pipeline option. It seems we need to add "runtimeOnly project(":sdks:java:io:azure")" in here: https://github.com/apache/beam/blob/master/runners/flink/job-server/flink_job_server.gradle#L96 Is it possible for someone with contributor permissions to make the one line change to be included in the next release? I confirmed that the shadow jar built locally with "./gradlew -p runners/flink/1.14/job-server build" contains AzureBlobStoreFileSystemRegistrar.class. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
