ChangZhuo Chen (陳昌倬) created FLINK-33793:
--------------------------------------------
Summary: java.lang.NoSuchMethodError when checkpointing in Google
Cloud Storage
Key: FLINK-33793
URL: https://issues.apache.org/jira/browse/FLINK-33793
Project: Flink
Issue Type: Bug
Components: Runtime / Checkpointing
Affects Versions: 1.18.0
Environment: Flink 1.18
Reporter: ChangZhuo Chen (陳昌倬)
We have the following exception when checkpointing in Flink 1.18 + Google Cloud
Storage. The same code works well in Flink 1.17:
{{2023-12-11 07:45:28,861 ERROR org.apache.flink.util.FatalExitExceptionHandler
[] - FATAL: Thread 'jobmanager-io-thread-5' produced an uncaught
exception. Stopping the process...}}
{{java.lang.NoSuchMethodError: 'com.google.common.collect.ImmutableMap
com.google.common.collect.ImmutableMap$Builder.buildOrThrow()'}}
{{ at
com.google.cloud.storage.UnifiedOpts$Opts.getRpcOptions(UnifiedOpts.java:2096)
~[?:?]}}
{{ at com.google.cloud.storage.StorageImpl.writer(StorageImpl.java:624)
~[?:?]}}
{{ at com.google.cloud.storage.StorageImpl.writer(StorageImpl.java:90)
~[?:?]}}
{{ at
org.apache.flink.fs.gs.storage.GSBlobStorageImpl.writeBlob(GSBlobStorageImpl.java:64)
~[?:?]}}
{{ at
org.apache.flink.fs.gs.writer.GSRecoverableFsDataOutputStream.createWriteChannel(GSRecoverableFsDataOutputStream.java:229)
~[?:?]}}
{{ at
org.apache.flink.fs.gs.writer.GSRecoverableFsDataOutputStream.write(GSRecoverableFsDataOutputStream.java:152)
~[?:?]}}
{{ at
org.apache.flink.fs.gs.writer.GSRecoverableFsDataOutputStream.write(GSRecoverableFsDataOutputStream.java:135)
~[?:?]}}
{{ at
org.apache.flink.fs.gs.writer.GSRecoverableFsDataOutputStream.write(GSRecoverableFsDataOutputStream.java:128)
~[?:?]}}
{{ at
org.apache.flink.runtime.state.filesystem.FsCheckpointMetadataOutputStream.write(FsCheckpointMetadataOutputStream.java:73)
~[flink-dist-1.18.0.jar:1.18.0]}}
{{ at java.io.DataOutputStream.writeInt(Unknown Source) ~[?:?]}}
{{ at
org.apache.flink.runtime.checkpoint.Checkpoints.storeCheckpointMetadata(Checkpoints.java:98)
~[flink-dist-1.18.0.jar:1.18.0]}}
{{ at
org.apache.flink.runtime.checkpoint.Checkpoints.storeCheckpointMetadata(Checkpoints.java:88)
~[flink-dist-1.18.0.jar:1.18.0]}}
{{ at
org.apache.flink.runtime.checkpoint.Checkpoints.storeCheckpointMetadata(Checkpoints.java:83)
~[flink-dist-1.18.0.jar:1.18.0]}}
{{ at
org.apache.flink.runtime.checkpoint.PendingCheckpoint.finalizeCheckpoint(PendingCheckpoint.java:335)
~[flink-dist-1.18.0.jar:1.18.0]}}
{{ at
org.apache.flink.runtime.checkpoint.CheckpointCoordinator.finalizeCheckpoint(CheckpointCoordinator.java:1404)
~[flink-dist-1.18.0.jar:1.18.0]}}
{{ at
org.apache.flink.runtime.checkpoint.CheckpointCoordinator.completePendingCheckpoint(CheckpointCoordinator.java:1303)
~[flink-dist-1.18.0.jar:1.18.0]}}
{{ at
org.apache.flink.runtime.checkpoint.CheckpointCoordinator.receiveAcknowledgeMessage(CheckpointCoordinator.java:1195)
~[flink-dist-1.18.0.jar:1.18.0]}}
{{ at
org.apache.flink.runtime.scheduler.ExecutionGraphHandler.lambda$acknowledgeCheckpoint$1(ExecutionGraphHandler.java:89)
~[flink-dist-1.18.0.jar:1.18.0]}}
{{ at
org.apache.flink.runtime.scheduler.ExecutionGraphHandler.lambda$processCheckpointCoordinatorMessage$3(ExecutionGraphHandler.java:119)
~[flink-dist-1.18.0.jar:1.18.0]}}
{{ at java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source)
~[?:?]}}
{{ at java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source)
~[?:?]}}
{{ at java.lang.Thread.run(Unknown Source) [?:?]}}
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
