[
https://issues.apache.org/jira/browse/FLINK-28231?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
bianqi updated FLINK-28231:
---------------------------
Description:
h3. Background：
Apache Ozone has become a new generation object storage system. The future is
promising.
Currently, Flink already supports S3, aliyunOSS, and Google Cloud Storage. But
Apache Ozone is not supported.
h3. Purpose：
Flink supports the Apache Ozone file system
h3. work content：
We need to develop Flink to support Apache Ozone FileSystem. Also improve the
documentation.
[https://nightlies.apache.org/flink/flink-docs-release-1.15/docs/deployment/filesystems/overview/]
was:
After the ozone environment is currently configured, mapreduce tasks can be
submitted to read and write ozone, but flink tasks cannot be submitted
The error is as follows
{code:java}
[root@jykj0 ozone-fs-hadoop]# flink run
/soft/flink13/examples/batch/WordCount.jar --input
ofs://jykj0.yarn.com/volume/bucket/warehouse/input --output
ofs://jykj0.yarn.com/volume/bucket/warehouse/output/
SLF4J: Class path contains multiple SLF4J bindings.
SLF4J: Found binding in
[jar:file:/soft/flink-1.13.5/lib/log4j-slf4j-impl-2.16.0.jar!/org/slf4j/impl/StaticLoggerBinder.class]
SLF4J: Found binding in
[jar:file:/soft/hadoop-3.2.2/share/hadoop/common/lib/slf4j-log4j12-1.7.25.jar!/org/slf4j/impl/StaticLoggerBinder.class]
SLF4J: See http://www.slf4j.org/codes.html#multiple_bindings for an explanation.
SLF4J: Actual binding is of type [org.apache.logging.slf4j.Log4jLoggerFactory]
2022-06-23 22:30:24,131 INFO org.apache.flink.yarn.cli.FlinkYarnSessionCli
[] - Found Yarn properties file under
/tmp/flink-1.13.5/.yarn-properties-root.
2022-06-23 22:30:24,131 INFO org.apache.flink.yarn.cli.FlinkYarnSessionCli
[] - Found Yarn properties file under
/tmp/flink-1.13.5/.yarn-properties-root.
2022-06-23 22:30:27,151 INFO org.apache.hadoop.io.retry.RetryInvocationHandler
[] - java.lang.IllegalStateException, while invoking
$Proxy27.submitRequest over nodeId=null,nodeAddress=jykj0.yarn.com:9862 after 1
failover attempts. Trying to failover after sleeping for 4000ms.
2022-06-23 22:30:31,152 INFO org.apache.hadoop.io.retry.RetryInvocationHandler
[] - java.lang.IllegalStateException, while invoking
$Proxy27.submitRequest over nodeId=null,nodeAddress=jykj0.yarn.com:9862 after 2
failover attempts. Trying to failover after sleeping for 6000ms.
{code}
Maybe there is something wrong with my configuration，Hope to update the
documentation
https://nightlies.apache.org/flink/flink-docs-release-1.15/docs/deployment/filesystems/overview/
> Support Apache Ozone FileSystem
> -------------------------------
>
> Key: FLINK-28231
> URL: https://issues.apache.org/jira/browse/FLINK-28231
> Project: Flink
> Issue Type: New Feature
> Components: fs
> Affects Versions: 1.12.1
> Environment: * Flink1.12.1
> * Hadoop3.2.2
> * Ozone1.2.1
> Reporter: bianqi
> Priority: Major
> Attachments: abc.png, image-2022-06-24-10-05-42-193.png,
> image-2022-06-24-10-08-26-010.png, mapreduce-webui.png,
> 微信图片_20220623224142.png
>
>
> h3. Background：
> Apache Ozone has become a new generation object storage system. The future is
> promising.
> Currently, Flink already supports S3, aliyunOSS, and Google Cloud Storage.
> But Apache Ozone is not supported.
> h3. Purpose：
>
> Flink supports the Apache Ozone file system
> h3. work content：
> We need to develop Flink to support Apache Ozone FileSystem. Also improve the
> documentation.
> [https://nightlies.apache.org/flink/flink-docs-release-1.15/docs/deployment/filesystems/overview/]
--
This message was sent by Atlassian Jira
(v8.20.7#820007)
