yanxiaobin created FLINK-16792:
----------------------------------

             Summary: flink-s3-fs-hadoop cannot access s3
                 Key: FLINK-16792
                 URL: https://issues.apache.org/jira/browse/FLINK-16792
             Project: Flink
          Issue Type: Bug
          Components: FileSystems
    Affects Versions: 1.10.0
            Reporter: yanxiaobin


When flink-s3-fs-hadoop-1.10.0.jar is placed in the lib directory and flink 
accesses aws s3, the following exception occurs:

 

Caused by: java.util.concurrent.ExecutionException: 
java.lang.NoSuchMethodError: 
org.apache.hadoop.util.SemaphoredDelegatingExecutor.<init>(Lcom/google/common/util/concurrent/ListeningExecutorService;IZ)V
 at java.util.concurrent.FutureTask.report(FutureTask.java:122) at 
java.util.concurrent.FutureTask.get(FutureTask.java:192) at 
org.apache.flink.runtime.concurrent.FutureUtils.runIfNotDoneAndGet(FutureUtils.java:461)
 at 
org.apache.flink.streaming.api.operators.OperatorSnapshotFinalizer.<init>(OperatorSnapshotFinalizer.java:53)
 at 
org.apache.flink.streaming.runtime.tasks.StreamTask$AsyncCheckpointRunnable.run(StreamTask.java:1143)
 ... 3 more Caused by: java.lang.NoSuchMethodError: 
org.apache.hadoop.util.SemaphoredDelegatingExecutor.<init>(Lcom/google/common/util/concurrent/ListeningExecutorService;IZ)V
 at org.apache.hadoop.fs.s3a.S3AFileSystem.create(S3AFileSystem.java:769) at 
org.apache.hadoop.fs.FileSystem.create(FileSystem.java:1169) at 
org.apache.hadoop.fs.FileSystem.create(FileSystem.java:1149) at 
org.apache.hadoop.fs.FileSystem.create(FileSystem.java:1038) at 
org.apache.flink.fs.s3hadoop.common.HadoopFileSystem.create(HadoopFileSystem.java:141)
 at 
org.apache.flink.fs.s3hadoop.common.HadoopFileSystem.create(HadoopFileSystem.java:37)
 at 
org.apache.flink.core.fs.SafetyNetWrapperFileSystem.create(SafetyNetWrapperFileSystem.java:126)
 at 
org.apache.flink.core.fs.EntropyInjector.createEntropyAware(EntropyInjector.java:61)
 at 
org.apache.flink.runtime.state.filesystem.FsCheckpointStreamFactory$FsCheckpointStateOutputStream.createStream(FsCheckpointStreamFactory.java:356)
 at 
org.apache.flink.runtime.state.filesystem.FsCheckpointStreamFactory$FsCheckpointStateOutputStream.flush(FsCheckpointStreamFactory.java:234)
 at 
org.apache.flink.runtime.state.filesystem.FsCheckpointStreamFactory$FsCheckpointStateOutputStream.closeAndGetHandle(FsCheckpointStreamFactory.java:309)
 at 
org.apache.flink.runtime.state.DefaultOperatorStateBackendSnapshotStrategy$1.callInternal(DefaultOperatorStateBackendSnapshotStrategy.java:179)
 at 
org.apache.flink.runtime.state.DefaultOperatorStateBackendSnapshotStrategy$1.callInternal(DefaultOperatorStateBackendSnapshotStrategy.java:108)
 at 
org.apache.flink.runtime.state.AsyncSnapshotCallable.call(AsyncSnapshotCallable.java:75)
 at java.util.concurrent.FutureTask.run(FutureTask.java:266) at 
org.apache.flink.runtime.concurrent.FutureUtils.runIfNotDoneAndGet(FutureUtils.java:458)



--
This message was sent by Atlassian Jira
(v8.3.4#803005)

Reply via email to