[
https://issues.apache.org/jira/browse/FLINK-33793?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17795464#comment-17795464
]
Chris Nauroth commented on FLINK-33793:
---
I expect this will be fixed by FLINK-33603.
CC: [~jjayadeep]
> java.lang.NoSuchMethodError when checkpointing in Google Cloud Storage
> --
>
> Key: FLINK-33793
> URL: https://issues.apache.org/jira/browse/FLINK-33793
> Project: Flink
> Issue Type: Bug
> Components: Runtime / Checkpointing
>Affects Versions: 1.18.0
> Environment: Flink 1.18
>Reporter: ChangZhuo Chen (陳昌倬)
>Priority: Major
>
> We have the following exception when checkpointing in Flink 1.18 + Google
> Cloud Storage. The same code works well in Flink 1.17:
>
> {{2023-12-11 07:45:28,861 ERROR
> org.apache.flink.util.FatalExitExceptionHandler [] - FATAL:
> Thread 'jobmanager-io-thread-5' produced an uncaught exception. Stopping the
> process...}}
> {{java.lang.NoSuchMethodError: 'com.google.common.collect.ImmutableMap
> com.google.common.collect.ImmutableMap$Builder.buildOrThrow()'}}
> {{ at
> com.google.cloud.storage.UnifiedOpts$Opts.getRpcOptions(UnifiedOpts.java:2096)
> ~[?:?]}}
> {{ at
> com.google.cloud.storage.StorageImpl.writer(StorageImpl.java:624) ~[?:?]}}
> {{ at com.google.cloud.storage.StorageImpl.writer(StorageImpl.java:90)
> ~[?:?]}}
> {{ at
> org.apache.flink.fs.gs.storage.GSBlobStorageImpl.writeBlob(GSBlobStorageImpl.java:64)
> ~[?:?]}}
> {{ at
> org.apache.flink.fs.gs.writer.GSRecoverableFsDataOutputStream.createWriteChannel(GSRecoverableFsDataOutputStream.java:229)
> ~[?:?]}}
> {{ at
> org.apache.flink.fs.gs.writer.GSRecoverableFsDataOutputStream.write(GSRecoverableFsDataOutputStream.java:152)
> ~[?:?]}}
> {{ at
> org.apache.flink.fs.gs.writer.GSRecoverableFsDataOutputStream.write(GSRecoverableFsDataOutputStream.java:135)
> ~[?:?]}}
> {{ at
> org.apache.flink.fs.gs.writer.GSRecoverableFsDataOutputStream.write(GSRecoverableFsDataOutputStream.java:128)
> ~[?:?]}}
> {{ at
> org.apache.flink.runtime.state.filesystem.FsCheckpointMetadataOutputStream.write(FsCheckpointMetadataOutputStream.java:73)
> ~[flink-dist-1.18.0.jar:1.18.0]}}
> {{ at java.io.DataOutputStream.writeInt(Unknown Source) ~[?:?]}}
> {{ at
> org.apache.flink.runtime.checkpoint.Checkpoints.storeCheckpointMetadata(Checkpoints.java:98)
> ~[flink-dist-1.18.0.jar:1.18.0]}}
> {{ at
> org.apache.flink.runtime.checkpoint.Checkpoints.storeCheckpointMetadata(Checkpoints.java:88)
> ~[flink-dist-1.18.0.jar:1.18.0]}}
> {{ at
> org.apache.flink.runtime.checkpoint.Checkpoints.storeCheckpointMetadata(Checkpoints.java:83)
> ~[flink-dist-1.18.0.jar:1.18.0]}}
> {{ at
> org.apache.flink.runtime.checkpoint.PendingCheckpoint.finalizeCheckpoint(PendingCheckpoint.java:335)
> ~[flink-dist-1.18.0.jar:1.18.0]}}
> {{ at
> org.apache.flink.runtime.checkpoint.CheckpointCoordinator.finalizeCheckpoint(CheckpointCoordinator.java:1404)
> ~[flink-dist-1.18.0.jar:1.18.0]}}
> {{ at
> org.apache.flink.runtime.checkpoint.CheckpointCoordinator.completePendingCheckpoint(CheckpointCoordinator.java:1303)
> ~[flink-dist-1.18.0.jar:1.18.0]}}
> {{ at
> org.apache.flink.runtime.checkpoint.CheckpointCoordinator.receiveAcknowledgeMessage(CheckpointCoordinator.java:1195)
> ~[flink-dist-1.18.0.jar:1.18.0]}}
> {{ at
> org.apache.flink.runtime.scheduler.ExecutionGraphHandler.lambda$acknowledgeCheckpoint$1(ExecutionGraphHandler.java:89)
> ~[flink-dist-1.18.0.jar:1.18.0]}}
> {{ at
> org.apache.flink.runtime.scheduler.ExecutionGraphHandler.lambda$processCheckpointCoordinatorMessage$3(ExecutionGraphHandler.java:119)
> ~[flink-dist-1.18.0.jar:1.18.0]}}
> {{ at java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown
> Source) ~[?:?]}}
> {{ at java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown
> Source) ~[?:?]}}
> {{ at java.lang.Thread.run(Unknown Source) [?:?]}}
>
> The issue has been reported in GitHub
> [https://github.com/apache/flink/pull/22281#issuecomment-1728553794.]
> However, it is still not fixed yet in 1.18.0.
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
