bianqi created FLINK-28231:
------------------------------
Summary: Support Ozone file system
Key: FLINK-28231
URL: https://issues.apache.org/jira/browse/FLINK-28231
Project: Flink
Issue Type: New Feature
Components: fs
Affects Versions: 1.14.5
Environment: * Flink1.12.1
* Hadoop3.2.2
* Ozone1.2.1
Reporter: bianqi
After the ozone environment is currently configured, mapreduce tasks can be
submitted to read and write ozone, but flink tasks cannot be submitted
The error is as follows
{code:java}
[root@jykj0 ozone-fs-hadoop]# flink run
/soft/flink13/examples/batch/WordCount.jar --input
ofs://jykj0.yarn.com/volume/bucket/warehouse/input --output
ofs://jykj0.yarn.com/volume/bucket/warehouse/output/
SLF4J: Class path contains multiple SLF4J bindings.
SLF4J: Found binding in
[jar:file:/soft/flink-1.13.5/lib/log4j-slf4j-impl-2.16.0.jar!/org/slf4j/impl/StaticLoggerBinder.class]
SLF4J: Found binding in
[jar:file:/soft/hadoop-3.2.2/share/hadoop/common/lib/slf4j-log4j12-1.7.25.jar!/org/slf4j/impl/StaticLoggerBinder.class]
SLF4J: See http://www.slf4j.org/codes.html#multiple_bindings for an explanation.
SLF4J: Actual binding is of type [org.apache.logging.slf4j.Log4jLoggerFactory]
2022-06-23 22:30:24,131 INFO org.apache.flink.yarn.cli.FlinkYarnSessionCli
[] - Found Yarn properties file under
/tmp/flink-1.13.5/.yarn-properties-root.
2022-06-23 22:30:24,131 INFO org.apache.flink.yarn.cli.FlinkYarnSessionCli
[] - Found Yarn properties file under
/tmp/flink-1.13.5/.yarn-properties-root.
2022-06-23 22:30:27,151 INFO org.apache.hadoop.io.retry.RetryInvocationHandler
[] - java.lang.IllegalStateException, while invoking
$Proxy27.submitRequest over nodeId=null,nodeAddress=jykj0.yarn.com:9862 after 1
failover attempts. Trying to failover after sleeping for 4000ms.
2022-06-23 22:30:31,152 INFO org.apache.hadoop.io.retry.RetryInvocationHandler
[] - java.lang.IllegalStateException, while invoking
$Proxy27.submitRequest over nodeId=null,nodeAddress=jykj0.yarn.com:9862 after 2
failover attempts. Trying to failover after sleeping for 6000ms. {code}
--
This message was sent by Atlassian Jira
(v8.20.7#820007)
