Re: Flink-Yarn-Kerberos integration

Ping, any comments? Thanks a lot. Shuyi On Wed, Jan 3, 2018 at 3:43 PM, Shuyi Chen wrote: > Thanks a lot for the clarification, Eron. That's very helpful. Currently, > we are more concerned about 1) data access, but will get to 2) and 3) > eventually. > > I was thinking

Re: adding a new cloud filesystem

Thanks. I'm looking at the s3 example and I can only find the S3FileSystemFactory but not the File System implementation (subclass of  org.apache.flink.core.fs.FileSystem). Is that requirement still needed?On Wednesday, January 17, 2018, 3:59:47 PM PST, Fabian Hueske

Re: adding a new cloud filesystem

Hi, please have a look at this doc page [1]. It describes how to add new file system implementations and also how to configure them. Best, Fabian [1] https://ci.apache.org/projects/flink/flink-docs-release-1.4/ops/filesystems.html#adding-new-file-system-implementations 2018-01-18 0:32

adding a new cloud filesystem

Hi, I'm adding support for more cloud storage providers such as Google (gcs://) and Oracle (oci://). I have an oci:// test working based on the s3a:// test but when I try it on an actual Flink job like WordCount, I get this message:

[jira] [Created] (FLINK-8446) Add support for multiple broadcast states.

Kostas Kloudas created FLINK-8446: - Summary: Add support for multiple broadcast states. Key: FLINK-8446 URL: https://issues.apache.org/jira/browse/FLINK-8446 Project: Flink Issue Type: New

[jira] [Created] (FLINK-8445) hostname used in metric names for taskmanager and jobmanager are not consistent

Chris Thomson created FLINK-8445: Summary: hostname used in metric names for taskmanager and jobmanager are not consistent Key: FLINK-8445 URL: https://issues.apache.org/jira/browse/FLINK-8445

[jira] [Created] (FLINK-8444) Rework dependency setup docs

Chesnay Schepler created FLINK-8444: --- Summary: Rework dependency setup docs Key: FLINK-8444 URL: https://issues.apache.org/jira/browse/FLINK-8444 Project: Flink Issue Type: Improvement

[jira] [Created] (FLINK-8443) YARNSessionCapacitySchedulerITCase is flakky

Piotr Nowojski created FLINK-8443: - Summary: YARNSessionCapacitySchedulerITCase is flakky Key: FLINK-8443 URL: https://issues.apache.org/jira/browse/FLINK-8443 Project: Flink Issue Type: Bug

[jira] [Created] (FLINK-8442) Should recovery the input split when an execution failover with FailoverRegion

shuai.xu created FLINK-8442: --- Summary: Should recovery the input split when an execution failover with FailoverRegion Key: FLINK-8442 URL: https://issues.apache.org/jira/browse/FLINK-8442 Project: Flink