[
https://issues.apache.org/jira/browse/FLINK-28231?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17558297#comment-17558297
]
bianqi commented on FLINK-28231:
--------------------------------
this is debug log
{code:java}
2022-06-24 10:23:06,547 DEBUG org.apache.flink.runtime.util.HadoopUtils
[] - Adding /soft/hadoop/etc/hadoop/hdfs-site.xml to hadoop
configuration
2022-06-24 10:23:06,568 DEBUG
org.apache.flink.runtime.leaderelection.DefaultLeaderElectionService [] - Grant
leadership to contender http://jykj3.yarn.com:37478 with session ID
34137e8d-3a8c-4788-b50d-d991a9d9b157.
2022-06-24 10:23:06,568 INFO
org.apache.flink.runtime.jobmaster.MiniDispatcherRestEndpoint [] -
http://jykj3.yarn.com:37478 was granted leadership with
leaderSessionID=34137e8d-3a8c-4788-b50d-d991a9d9b157
2022-06-24 10:23:06,568 DEBUG
org.apache.flink.runtime.leaderelection.DefaultLeaderElectionService [] -
Confirm leader session ID 34137e8d-3a8c-4788-b50d-d991a9d9b157 for leader
http://jykj3.yarn.com:37478.
2022-06-24 10:23:06,569 DEBUG
org.apache.flink.runtime.leaderelection.ZooKeeperLeaderElectionDriver [] -
Write leader information:
LeaderInformation{leaderSessionID='34137e8d-3a8c-4788-b50d-d991a9d9b157',
leaderAddress=http://jykj3.yarn.com:37478}.
2022-06-24 10:23:06,593 DEBUG
org.apache.flink.runtime.leaderelection.ZooKeeperLeaderElectionDriver [] -
Successfully wrote leader information:
LeaderInformation{leaderSessionID='34137e8d-3a8c-4788-b50d-d991a9d9b157',
leaderAddress=http://jykj3.yarn.com:37478}.
2022-06-24 10:23:06,595 DEBUG org.apache.flink.runtime.rpc.akka.SupervisorActor
[] - Starting FencedAkkaRpcActor with name resourcemanager_0.
2022-06-24 10:23:06,596 INFO org.apache.flink.runtime.rpc.akka.AkkaRpcService
[] - Starting RPC endpoint for
org.apache.flink.runtime.resourcemanager.active.ActiveResourceManager at
akka://flink/user/rpc/resourcemanager_0 .
2022-06-24 10:23:06,619 DEBUG
org.apache.flink.runtime.entrypoint.component.DefaultDispatcherResourceManagerComponentFactory
[] - Starting Dispatcher.
2022-06-24 10:23:06,624 INFO
org.apache.flink.runtime.leaderelection.DefaultLeaderElectionService [] -
Starting DefaultLeaderElectionService with
ZooKeeperLeaderElectionDriver{leaderPath='/leader/dispatcher_lock'}.
2022-06-24 10:23:06,624 DEBUG
org.apache.flink.runtime.entrypoint.component.DefaultDispatcherResourceManagerComponentFactory
[] - Starting ResourceManager.
2022-06-24 10:23:06,624 INFO
org.apache.flink.runtime.resourcemanager.active.ActiveResourceManager [] -
Starting the resource manager.
2022-06-24 10:23:06,631 INFO
org.apache.flink.runtime.leaderretrieval.DefaultLeaderRetrievalService [] -
Starting DefaultLeaderRetrievalService with
ZookeeperLeaderRetrievalDriver{retrievalPath='/leader/resource_manager_lock'}.
2022-06-24 10:23:06,631 INFO
org.apache.flink.runtime.leaderretrieval.DefaultLeaderRetrievalService [] -
Starting DefaultLeaderRetrievalService with
ZookeeperLeaderRetrievalDriver{retrievalPath='/leader/dispatcher_lock'}.
2022-06-24 10:23:06,668 INFO org.apache.hadoop.yarn.client.RMProxy
[] - Connecting to ResourceManager at
jykj0.yarn.com/192.168.149.101:8030
2022-06-24 10:23:06,681 DEBUG
org.apache.flink.shaded.curator4.org.apache.curator.framework.imps.CreateBuilderImpl
[] - Protected mode findNode result: null
2022-06-24 10:23:06,687 DEBUG
org.apache.flink.runtime.leaderelection.DefaultLeaderElectionService [] - Grant
leadership to contender LeaderContender: DefaultDispatcherRunner with session
ID 5180000f-64dd-41cd-9a5f-40485d5fcf3c.
2022-06-24 10:23:06,688 INFO
org.apache.flink.runtime.dispatcher.runner.DefaultDispatcherRunner [] -
DefaultDispatcherRunner was granted leadership with leader id
5180000f-64dd-41cd-9a5f-40485d5fcf3c. Creating new DispatcherLeaderProcess.
2022-06-24 10:23:06,746 INFO
org.apache.flink.runtime.dispatcher.runner.SessionDispatcherLeaderProcess [] -
Start SessionDispatcherLeaderProcess.
2022-06-24 10:23:06,759 INFO
org.apache.flink.runtime.dispatcher.runner.SessionDispatcherLeaderProcess [] -
Recover all persisted job graphs.
2022-06-24 10:23:06,759 DEBUG
org.apache.flink.runtime.jobmanager.DefaultJobGraphStore [] - Retrieving
all stored job ids from
ZooKeeperStateHandleStore{namespace='flink/application_1655993758285_0008/jobgraphs'}.
2022-06-24 10:23:06,782 INFO
org.apache.flink.runtime.jobmanager.DefaultJobGraphStore [] - Retrieved job
ids [] from
ZooKeeperStateHandleStore{namespace='flink/application_1655993758285_0008/jobgraphs'}
2022-06-24 10:23:06,783 INFO
org.apache.flink.runtime.dispatcher.runner.SessionDispatcherLeaderProcess [] -
Successfully recovered 0 persisted job graphs.
2022-06-24 10:23:06,798 DEBUG org.apache.flink.runtime.rpc.akka.SupervisorActor
[] - Starting FencedAkkaRpcActor with name dispatcher_1.
2022-06-24 10:23:06,804 INFO org.apache.flink.runtime.rpc.akka.AkkaRpcService
[] - Starting RPC endpoint for
org.apache.flink.runtime.dispatcher.StandaloneDispatcher at
akka://flink/user/rpc/dispatcher_1 .
2022-06-24 10:23:06,828 DEBUG
org.apache.flink.runtime.leaderelection.DefaultLeaderElectionService [] -
Confirm leader session ID 5180000f-64dd-41cd-9a5f-40485d5fcf3c for leader
akka.tcp://[email protected]:38636/user/rpc/dispatcher_1.
2022-06-24 10:23:06,828 DEBUG
org.apache.flink.runtime.leaderelection.ZooKeeperLeaderElectionDriver [] -
Write leader information:
LeaderInformation{leaderSessionID='5180000f-64dd-41cd-9a5f-40485d5fcf3c',
leaderAddress=akka.tcp://[email protected]:38636/user/rpc/dispatcher_1}.
2022-06-24 10:23:06,840 INFO org.apache.flink.client.ClientUtils
[] - Starting program (detached: false)
2022-06-24 10:23:06,845 DEBUG
org.apache.flink.runtime.leaderelection.ZooKeeperLeaderElectionDriver [] -
Successfully wrote leader information:
LeaderInformation{leaderSessionID='5180000f-64dd-41cd-9a5f-40485d5fcf3c',
leaderAddress=akka.tcp://[email protected]:38636/user/rpc/dispatcher_1}.
2022-06-24 10:23:06,854 INFO org.apache.flink.yarn.YarnResourceManagerDriver
[] - Recovered 0 containers from previous attempts ([]).
2022-06-24 10:23:06,855 INFO
org.apache.flink.runtime.resourcemanager.active.ActiveResourceManager [] -
Recovered 0 workers from previous attempt.
2022-06-24 10:23:06,871 DEBUG
org.apache.flink.runtime.leaderretrieval.ZooKeeperLeaderRetrievalDriver [] -
Leader node has changed.
2022-06-24 10:23:06,873 DEBUG
org.apache.flink.runtime.leaderretrieval.DefaultLeaderRetrievalService [] - New
leader information:
Leader=akka.tcp://[email protected]:38636/user/rpc/dispatcher_1, session
ID=5180000f-64dd-41cd-9a5f-40485d5fcf3c.
2022-06-24 10:23:06,879 DEBUG org.apache.flink.runtime.rpc.akka.AkkaRpcService
[] - Try to connect to remote RPC endpoint with address
akka.tcp://[email protected]:38636/user/rpc/dispatcher_1. Returning a
org.apache.flink.runtime.dispatcher.DispatcherGateway gateway.
2022-06-24 10:23:06,923 INFO org.apache.hadoop.conf.Configuration
[] - resource-types.xml not found
2022-06-24 10:23:06,924 INFO
org.apache.hadoop.yarn.util.resource.ResourceUtils [] - Unable to
find 'resource-types.xml'.
2022-06-24 10:23:06,952 INFO
org.apache.flink.runtime.externalresource.ExternalResourceUtils [] - Enabled
external resources: []
2022-06-24 10:23:06,963 INFO
org.apache.hadoop.yarn.client.api.async.impl.NMClientAsyncImpl [] - Upper bound
of the thread pool size is 500
2022-06-24 10:23:06,968 INFO
org.apache.flink.runtime.leaderelection.DefaultLeaderElectionService [] -
Starting DefaultLeaderElectionService with
ZooKeeperLeaderElectionDriver{leaderPath='/leader/resource_manager_lock'}.
2022-06-24 10:23:06,993 DEBUG
org.apache.flink.shaded.curator4.org.apache.curator.framework.imps.CreateBuilderImpl
[] - Protected mode findNode result: null
2022-06-24 10:23:06,997 DEBUG
org.apache.flink.runtime.leaderelection.DefaultLeaderElectionService [] - Grant
leadership to contender LeaderContender: ActiveResourceManager with session ID
d72df1be-a8e7-4817-8d4c-828871abd3f1.
2022-06-24 10:23:06,999 INFO
org.apache.flink.runtime.resourcemanager.active.ActiveResourceManager [] -
ResourceManager
akka.tcp://[email protected]:38636/user/rpc/resourcemanager_0 was granted
leadership with fencing token 8d4c828871abd3f1d72df1bea8e74817
2022-06-24 10:23:07,004 DEBUG
org.apache.flink.runtime.resourcemanager.slotmanager.DeclarativeSlotManager []
- Starting the slot manager.
2022-06-24 10:23:07,015 DEBUG
org.apache.flink.runtime.resourcemanager.active.ActiveResourceManager [] -
Trigger heartbeat request.
2022-06-24 10:23:07,015 DEBUG
org.apache.flink.runtime.resourcemanager.active.ActiveResourceManager [] -
Trigger heartbeat request.
2022-06-24 10:23:07,016 DEBUG
org.apache.flink.runtime.leaderelection.DefaultLeaderElectionService [] -
Confirm leader session ID d72df1be-a8e7-4817-8d4c-828871abd3f1 for leader
akka.tcp://[email protected]:38636/user/rpc/resourcemanager_0.
2022-06-24 10:23:07,016 DEBUG
org.apache.flink.runtime.leaderelection.ZooKeeperLeaderElectionDriver [] -
Write leader information:
LeaderInformation{leaderSessionID='d72df1be-a8e7-4817-8d4c-828871abd3f1',
leaderAddress=akka.tcp://[email protected]:38636/user/rpc/resourcemanager_0}.
2022-06-24 10:23:07,024 DEBUG
org.apache.flink.runtime.leaderelection.ZooKeeperLeaderElectionDriver [] -
Successfully wrote leader information:
LeaderInformation{leaderSessionID='d72df1be-a8e7-4817-8d4c-828871abd3f1',
leaderAddress=akka.tcp://[email protected]:38636/user/rpc/resourcemanager_0}.
2022-06-24 10:23:07,057 DEBUG
org.apache.flink.runtime.leaderretrieval.ZooKeeperLeaderRetrievalDriver [] -
Leader node has changed.
2022-06-24 10:23:07,058 DEBUG
org.apache.flink.runtime.leaderretrieval.DefaultLeaderRetrievalService [] - New
leader information:
Leader=akka.tcp://[email protected]:38636/user/rpc/resourcemanager_0,
session ID=d72df1be-a8e7-4817-8d4c-828871abd3f1.
2022-06-24 10:23:07,058 DEBUG org.apache.flink.runtime.rpc.akka.AkkaRpcService
[] - Try to connect to remote RPC endpoint with address
akka.tcp://[email protected]:38636/user/rpc/resourcemanager_0. Returning a
org.apache.flink.runtime.resourcemanager.ResourceManagerGateway gateway.
2022-06-24 10:23:07,085 INFO org.apache.flink.api.java.utils.PlanGenerator
[] - The job has 0 registered types and 0 default Kryo serializers
2022-06-24 10:23:07,085 DEBUG org.apache.flink.api.java.utils.PlanGenerator
[] - Registered Kryo types: []
2022-06-24 10:23:07,086 DEBUG org.apache.flink.api.java.utils.PlanGenerator
[] - Registered Kryo with Serializers types: []
2022-06-24 10:23:07,086 DEBUG org.apache.flink.api.java.utils.PlanGenerator
[] - Registered Kryo with Serializer Classes types: []
2022-06-24 10:23:07,086 DEBUG org.apache.flink.api.java.utils.PlanGenerator
[] - Registered Kryo default Serializers: []
2022-06-24 10:23:07,086 DEBUG org.apache.flink.api.java.utils.PlanGenerator
[] - Registered Kryo default Serializers Classes []
2022-06-24 10:23:07,086 DEBUG org.apache.flink.api.java.utils.PlanGenerator
[] - Registered POJO types: []
2022-06-24 10:23:07,093 DEBUG org.apache.flink.client.PlanTranslator
[] - Set parallelism 1, plan default parallelism 1
2022-06-24 10:23:07,101 DEBUG org.apache.flink.optimizer.Optimizer
[] - Beginning compilation of program 'WordCount Example'
2022-06-24 10:23:07,101 DEBUG org.apache.flink.optimizer.Optimizer
[] - Using a default parallelism of 1
2022-06-24 10:23:07,101 DEBUG org.apache.flink.optimizer.Optimizer
[] - Using default data exchange mode PIPELINED
2022-06-24 10:23:07,137 DEBUG org.apache.flink.runtime.fs.hdfs.HadoopFsFactory
[] - Instantiating for file system scheme ofs Hadoop File System
org.apache.hadoop.fs.ozone.RootedOzoneFileSystem
2022-06-24 10:23:10,201 INFO org.apache.hadoop.io.retry.RetryInvocationHandler
[] - java.lang.IllegalStateException, while invoking
$Proxy43.submitRequest over nodeId=null,nodeAddress=jykj0.yarn.com:9862 after 1
failover attempts. Trying to failover after sleeping for 4000ms.
2022-06-24 10:23:14,205 INFO org.apache.hadoop.io.retry.RetryInvocationHandler
[] - java.lang.IllegalStateException, while invoking
$Proxy43.submitRequest over nodeId=null,nodeAddress=jykj0.yarn.com:9862 after 2
failover attempts. Trying to failover after sleeping for 6000ms.
2022-06-24 10:23:17,033 DEBUG
org.apache.flink.runtime.resourcemanager.active.ActiveResourceManager [] -
Trigger heartbeat request.
2022-06-24 10:23:17,034 DEBUG
org.apache.flink.runtime.resourcemanager.active.ActiveResourceManager [] -
Trigger heartbeat request.
2022-06-24 10:23:20,209 INFO org.apache.hadoop.io.retry.RetryInvocationHandler
[] - java.lang.IllegalStateException, while invoking
$Proxy43.submitRequest over nodeId=null,nodeAddress=jykj0.yarn.com:9862 after 3
failover attempts. Trying to failover after sleeping for 8000ms.
2022-06-24 10:23:27,052 DEBUG
org.apache.flink.runtime.resourcemanager.active.ActiveResourceManager [] -
Trigger heartbeat request.
2022-06-24 10:23:27,052 DEBUG
org.apache.flink.runtime.resourcemanager.active.ActiveResourceManager [] -
Trigger heartbeat request.
2022-06-24 10:23:28,210 INFO org.apache.hadoop.io.retry.RetryInvocationHandler
[] - java.lang.IllegalStateException, while invoking
$Proxy43.submitRequest over nodeId=null,nodeAddress=jykj0.yarn.com:9862 after 4
failover attempts. Trying to failover after sleeping for 10000ms {code}
> Support Apache Ozone FileSystem
> -------------------------------
>
> Key: FLINK-28231
> URL: https://issues.apache.org/jira/browse/FLINK-28231
> Project: Flink
> Issue Type: New Feature
> Components: fs
> Affects Versions: 1.12.1
> Environment: * Flink1.12.1
> * Hadoop3.2.2
> * Ozone1.2.1
> Reporter: bianqi
> Priority: Major
> Attachments: abc.png, image-2022-06-24-10-05-42-193.png,
> image-2022-06-24-10-08-26-010.png, mapreduce-webui.png,
> 微信图片_20220623224142.png
>
>
> After the ozone environment is currently configured, mapreduce tasks can be
> submitted to read and write ozone, but flink tasks cannot be submitted
> The error is as follows
> {code:java}
> [root@jykj0 ozone-fs-hadoop]# flink run
> /soft/flink13/examples/batch/WordCount.jar --input
> ofs://jykj0.yarn.com/volume/bucket/warehouse/input --output
> ofs://jykj0.yarn.com/volume/bucket/warehouse/output/
> SLF4J: Class path contains multiple SLF4J bindings.
> SLF4J: Found binding in
> [jar:file:/soft/flink-1.13.5/lib/log4j-slf4j-impl-2.16.0.jar!/org/slf4j/impl/StaticLoggerBinder.class]
> SLF4J: Found binding in
> [jar:file:/soft/hadoop-3.2.2/share/hadoop/common/lib/slf4j-log4j12-1.7.25.jar!/org/slf4j/impl/StaticLoggerBinder.class]
> SLF4J: See http://www.slf4j.org/codes.html#multiple_bindings for an
> explanation.
> SLF4J: Actual binding is of type [org.apache.logging.slf4j.Log4jLoggerFactory]
> 2022-06-23 22:30:24,131 INFO org.apache.flink.yarn.cli.FlinkYarnSessionCli
> [] - Found Yarn properties file under
> /tmp/flink-1.13.5/.yarn-properties-root.
> 2022-06-23 22:30:24,131 INFO org.apache.flink.yarn.cli.FlinkYarnSessionCli
> [] - Found Yarn properties file under
> /tmp/flink-1.13.5/.yarn-properties-root.
> 2022-06-23 22:30:27,151 INFO
> org.apache.hadoop.io.retry.RetryInvocationHandler [] -
> java.lang.IllegalStateException, while invoking $Proxy27.submitRequest over
> nodeId=null,nodeAddress=jykj0.yarn.com:9862 after 1 failover attempts. Trying
> to failover after sleeping for 4000ms.
> 2022-06-23 22:30:31,152 INFO
> org.apache.hadoop.io.retry.RetryInvocationHandler [] -
> java.lang.IllegalStateException, while invoking $Proxy27.submitRequest over
> nodeId=null,nodeAddress=jykj0.yarn.com:9862 after 2 failover attempts. Trying
> to failover after sleeping for 6000ms.
> {code}
> Maybe there is something wrong with my configuration，Hope to update the
> documentation
> https://nightlies.apache.org/flink/flink-docs-release-1.15/docs/deployment/filesystems/overview/
--
This message was sent by Atlassian Jira
(v8.20.7#820007)
