Nico Kruber created FLINK-18241:
-----------------------------------
Summary: Custom OptionsFactory in user code not working when
configured via flink-conf.yaml
Key: FLINK-18241
URL: https://issues.apache.org/jira/browse/FLINK-18241
Project: Flink
Issue Type: Bug
Components: Runtime / State Backends
Affects Versions: 1.10.1, 1.10.0
Reporter: Nico Kruber
Attachments: DefaultConfigurableOptionsFactoryWithLog.java
It seems like Flink 1.10 broke custom {{OptionsFactory}} definitions via the
{{state.backend.rocksdb.options-factory}} configuration if the implementation
resides in the user-code jar file. This is particularly bad to debug RocksDB
issues since we disabled its (ever-growing) LOG file in FLINK-15068.
If you look at the stack trace from the error below, you will notice, that
{{StreamExecutionEnvironment}} is not provided with a user-code classloader and
will us the one of its own class which is the parent loader that does not know
about our {{OptionsFactory}}. This exact same code was working with Flink 1.9.3.
(I believe putting the custom {{OptionsFactory}} into a separate jar file
inside Flink's lib folder may be a workaround but that should ideally not be
needed).
{code:java}
2020-06-09 16:18:59,409 ERROR
org.apache.flink.runtime.entrypoint.ClusterEntrypoint [] - Could not
start cluster entrypoint StandaloneJobClusterEntryPoint.
org.apache.flink.runtime.entrypoint.ClusterEntrypointException: Failed to
initialize the cluster entrypoint StandaloneJobClusterEntryPoint.
at
org.apache.flink.runtime.entrypoint.ClusterEntrypoint.startCluster(ClusterEntrypoint.java:192)
~[flink-dist_2.12-1.10.1-stream1.jar:1.10.1-stream1]
at
org.apache.flink.runtime.entrypoint.ClusterEntrypoint.runClusterEntrypoint(ClusterEntrypoint.java:525)
[flink-dist_2.12-1.10.1-stream1.jar:1.10.1-stream1]
at
org.apache.flink.container.entrypoint.StandaloneJobClusterEntryPoint.main(StandaloneJobClusterEntryPoint.java:116)
[flink-dist_2.12-1.10.1-stream1.jar:1.10.1-stream1]
Caused by: org.apache.flink.util.FlinkException: Could not create the
DispatcherResourceManagerComponent.
at
org.apache.flink.runtime.entrypoint.component.DefaultDispatcherResourceManagerComponentFactory.create(DefaultDispatcherResourceManagerComponentFactory.java:261)
~[flink-dist_2.12-1.10.1-stream1.jar:1.10.1-stream1]
at
org.apache.flink.runtime.entrypoint.ClusterEntrypoint.runCluster(ClusterEntrypoint.java:220)
~[flink-dist_2.12-1.10.1-stream1.jar:1.10.1-stream1]
at
org.apache.flink.runtime.entrypoint.ClusterEntrypoint.lambda$startCluster$0(ClusterEntrypoint.java:174)
~[flink-dist_2.12-1.10.1-stream1.jar:1.10.1-stream1]
at
org.apache.flink.runtime.security.NoOpSecurityContext.runSecured(NoOpSecurityContext.java:30)
~[flink-dist_2.12-1.10.1-stream1.jar:1.10.1-stream1]
at
org.apache.flink.runtime.entrypoint.ClusterEntrypoint.startCluster(ClusterEntrypoint.java:173)
~[flink-dist_2.12-1.10.1-stream1.jar:1.10.1-stream1]
... 2 more
Caused by: org.apache.flink.util.FlinkRuntimeException: Could not retrieve the
JobGraph.
at
org.apache.flink.runtime.dispatcher.runner.JobDispatcherLeaderProcessFactoryFactory.createFactory(JobDispatcherLeaderProcessFactoryFactory.java:57)
~[flink-dist_2.12-1.10.1-stream1.jar:1.10.1-stream1]
at
org.apache.flink.runtime.dispatcher.runner.DefaultDispatcherRunnerFactory.createDispatcherRunner(DefaultDispatcherRunnerFactory.java:51)
~[flink-dist_2.12-1.10.1-stream1.jar:1.10.1-stream1]
at
org.apache.flink.runtime.entrypoint.component.DefaultDispatcherResourceManagerComponentFactory.create(DefaultDispatcherResourceManagerComponentFactory.java:196)
~[flink-dist_2.12-1.10.1-stream1.jar:1.10.1-stream1]
at
org.apache.flink.runtime.entrypoint.ClusterEntrypoint.runCluster(ClusterEntrypoint.java:220)
~[flink-dist_2.12-1.10.1-stream1.jar:1.10.1-stream1]
at
org.apache.flink.runtime.entrypoint.ClusterEntrypoint.lambda$startCluster$0(ClusterEntrypoint.java:174)
~[flink-dist_2.12-1.10.1-stream1.jar:1.10.1-stream1]
at
org.apache.flink.runtime.security.NoOpSecurityContext.runSecured(NoOpSecurityContext.java:30)
~[flink-dist_2.12-1.10.1-stream1.jar:1.10.1-stream1]
at
org.apache.flink.runtime.entrypoint.ClusterEntrypoint.startCluster(ClusterEntrypoint.java:173)
~[flink-dist_2.12-1.10.1-stream1.jar:1.10.1-stream1]
... 2 more
Caused by: org.apache.flink.util.FlinkException: Could not create the JobGraph
from the provided user code jar.
at
org.apache.flink.container.entrypoint.ClassPathJobGraphRetriever.retrieveJobGraph(ClassPathJobGraphRetriever.java:114)
~[flink-dist_2.12-1.10.1-stream1.jar:1.10.1-stream1]
at
org.apache.flink.runtime.dispatcher.runner.JobDispatcherLeaderProcessFactoryFactory.createFactory(JobDispatcherLeaderProcessFactoryFactory.java:55)
~[flink-dist_2.12-1.10.1-stream1.jar:1.10.1-stream1]
at
org.apache.flink.runtime.dispatcher.runner.DefaultDispatcherRunnerFactory.createDispatcherRunner(DefaultDispatcherRunnerFactory.java:51)
~[flink-dist_2.12-1.10.1-stream1.jar:1.10.1-stream1]
at
org.apache.flink.runtime.entrypoint.component.DefaultDispatcherResourceManagerComponentFactory.create(DefaultDispatcherResourceManagerComponentFactory.java:196)
~[flink-dist_2.12-1.10.1-stream1.jar:1.10.1-stream1]
at
org.apache.flink.runtime.entrypoint.ClusterEntrypoint.runCluster(ClusterEntrypoint.java:220)
~[flink-dist_2.12-1.10.1-stream1.jar:1.10.1-stream1]
at
org.apache.flink.runtime.entrypoint.ClusterEntrypoint.lambda$startCluster$0(ClusterEntrypoint.java:174)
~[flink-dist_2.12-1.10.1-stream1.jar:1.10.1-stream1]
at
org.apache.flink.runtime.security.NoOpSecurityContext.runSecured(NoOpSecurityContext.java:30)
~[flink-dist_2.12-1.10.1-stream1.jar:1.10.1-stream1]
at
org.apache.flink.runtime.entrypoint.ClusterEntrypoint.startCluster(ClusterEntrypoint.java:173)
~[flink-dist_2.12-1.10.1-stream1.jar:1.10.1-stream1]
... 2 more
Caused by: org.apache.flink.client.program.ProgramInvocationException: The main
method caused an error: org.apache.flink.util.DynamicCodeLoadingException:
Cannot find configured options factory class:
com.ververica.DefaultConfigurableOptionsFactoryWithLog
at
org.apache.flink.client.program.PackagedProgram.callMainMethod(PackagedProgram.java:335)
~[flink-dist_2.12-1.10.1-stream1.jar:1.10.1-stream1]
at
org.apache.flink.client.program.PackagedProgram.invokeInteractiveModeForExecution(PackagedProgram.java:205)
~[flink-dist_2.12-1.10.1-stream1.jar:1.10.1-stream1]
at
org.apache.flink.client.program.OptimizerPlanEnvironment.getPipeline(OptimizerPlanEnvironment.java:80)
~[flink-dist_2.12-1.10.1-stream1.jar:1.10.1-stream1]
at
org.apache.flink.client.program.PackagedProgramUtils.getPipelineFromProgram(PackagedProgramUtils.java:108)
~[flink-dist_2.12-1.10.1-stream1.jar:1.10.1-stream1]
at
org.apache.flink.client.program.PackagedProgramUtils.createJobGraph(PackagedProgramUtils.java:58)
~[flink-dist_2.12-1.10.1-stream1.jar:1.10.1-stream1]
at
org.apache.flink.container.entrypoint.ClassPathJobGraphRetriever.retrieveJobGraph(ClassPathJobGraphRetriever.java:104)
~[flink-dist_2.12-1.10.1-stream1.jar:1.10.1-stream1]
at
org.apache.flink.runtime.dispatcher.runner.JobDispatcherLeaderProcessFactoryFactory.createFactory(JobDispatcherLeaderProcessFactoryFactory.java:55)
~[flink-dist_2.12-1.10.1-stream1.jar:1.10.1-stream1]
at
org.apache.flink.runtime.dispatcher.runner.DefaultDispatcherRunnerFactory.createDispatcherRunner(DefaultDispatcherRunnerFactory.java:51)
~[flink-dist_2.12-1.10.1-stream1.jar:1.10.1-stream1]
at
org.apache.flink.runtime.entrypoint.component.DefaultDispatcherResourceManagerComponentFactory.create(DefaultDispatcherResourceManagerComponentFactory.java:196)
~[flink-dist_2.12-1.10.1-stream1.jar:1.10.1-stream1]
at
org.apache.flink.runtime.entrypoint.ClusterEntrypoint.runCluster(ClusterEntrypoint.java:220)
~[flink-dist_2.12-1.10.1-stream1.jar:1.10.1-stream1]
at
org.apache.flink.runtime.entrypoint.ClusterEntrypoint.lambda$startCluster$0(ClusterEntrypoint.java:174)
~[flink-dist_2.12-1.10.1-stream1.jar:1.10.1-stream1]
at
org.apache.flink.runtime.security.NoOpSecurityContext.runSecured(NoOpSecurityContext.java:30)
~[flink-dist_2.12-1.10.1-stream1.jar:1.10.1-stream1]
at
org.apache.flink.runtime.entrypoint.ClusterEntrypoint.startCluster(ClusterEntrypoint.java:173)
~[flink-dist_2.12-1.10.1-stream1.jar:1.10.1-stream1]
... 2 more
Caused by: org.apache.flink.util.FlinkRuntimeException:
org.apache.flink.util.DynamicCodeLoadingException: Cannot find configured
options factory class: com.ververica.DefaultConfigurableOptionsFactoryWithLog
at
org.apache.flink.contrib.streaming.state.RocksDBStateBackend.<init>(RocksDBStateBackend.java:376)
~[flink-dist_2.12-1.10.1-stream1.jar:1.10.1-stream1]
at
org.apache.flink.contrib.streaming.state.RocksDBStateBackend.configure(RocksDBStateBackend.java:394)
~[flink-dist_2.12-1.10.1-stream1.jar:1.10.1-stream1]
at
org.apache.flink.contrib.streaming.state.RocksDBStateBackendFactory.createFromConfig(RocksDBStateBackendFactory.java:47)
~[flink-dist_2.12-1.10.1-stream1.jar:1.10.1-stream1]
at
org.apache.flink.contrib.streaming.state.RocksDBStateBackendFactory.createFromConfig(RocksDBStateBackendFactory.java:32)
~[flink-dist_2.12-1.10.1-stream1.jar:1.10.1-stream1]
at
org.apache.flink.runtime.state.StateBackendLoader.loadStateBackendFromConfig(StateBackendLoader.java:154)
~[flink-dist_2.12-1.10.1-stream1.jar:1.10.1-stream1]
at
org.apache.flink.streaming.api.environment.StreamExecutionEnvironment.loadStateBackend(StreamExecutionEnvironment.java:767)
~[flink-dist_2.12-1.10.1-stream1.jar:1.10.1-stream1]
at
org.apache.flink.streaming.api.environment.StreamExecutionEnvironment.configure(StreamExecutionEnvironment.java:750)
~[flink-dist_2.12-1.10.1-stream1.jar:1.10.1-stream1]
at
org.apache.flink.streaming.api.environment.StreamExecutionEnvironment.<init>(StreamExecutionEnvironment.java:218)
~[flink-dist_2.12-1.10.1-stream1.jar:1.10.1-stream1]
at
org.apache.flink.streaming.api.environment.StreamExecutionEnvironment.<init>(StreamExecutionEnvironment.java:190)
~[flink-dist_2.12-1.10.1-stream1.jar:1.10.1-stream1]
at
org.apache.flink.streaming.api.environment.StreamPlanEnvironment.<init>(StreamPlanEnvironment.java:38)
~[flink-dist_2.12-1.10.1-stream1.jar:1.10.1-stream1]
at
org.apache.flink.streaming.api.environment.StreamExecutionEnvironment.createStreamExecutionEnvironment(StreamExecutionEnvironment.java:1871)
~[flink-dist_2.12-1.10.1-stream1.jar:1.10.1-stream1]
at java.util.Optional.orElseGet(Optional.java:267) ~[?:1.8.0_252]
at
org.apache.flink.streaming.api.environment.StreamExecutionEnvironment.getExecutionEnvironment(StreamExecutionEnvironment.java:1859)
~[flink-dist_2.12-1.10.1-stream1.jar:1.10.1-stream1]
at
com.ververica.flinktraining.exercises.troubleshoot.TroubledStreamingJobUtils.createConfiguredEnvironment(TroubledStreamingJobUtils.java:40)
~[?:?]
at
com.ververica.flinktraining.solutions.troubleshoot.TroubledStreamingJobSolution43.main(TroubledStreamingJobSolution43.java:40)
~[?:?]
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
~[?:1.8.0_252]
at
sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
~[?:1.8.0_252]
at
sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
~[?:1.8.0_252]
at java.lang.reflect.Method.invoke(Method.java:498) ~[?:1.8.0_252]
at
org.apache.flink.client.program.PackagedProgram.callMainMethod(PackagedProgram.java:321)
~[flink-dist_2.12-1.10.1-stream1.jar:1.10.1-stream1]
at
org.apache.flink.client.program.PackagedProgram.invokeInteractiveModeForExecution(PackagedProgram.java:205)
~[flink-dist_2.12-1.10.1-stream1.jar:1.10.1-stream1]
at
org.apache.flink.client.program.OptimizerPlanEnvironment.getPipeline(OptimizerPlanEnvironment.java:80)
~[flink-dist_2.12-1.10.1-stream1.jar:1.10.1-stream1]
at
org.apache.flink.client.program.PackagedProgramUtils.getPipelineFromProgram(PackagedProgramUtils.java:108)
~[flink-dist_2.12-1.10.1-stream1.jar:1.10.1-stream1]
at
org.apache.flink.client.program.PackagedProgramUtils.createJobGraph(PackagedProgramUtils.java:58)
~[flink-dist_2.12-1.10.1-stream1.jar:1.10.1-stream1]
at
org.apache.flink.container.entrypoint.ClassPathJobGraphRetriever.retrieveJobGraph(ClassPathJobGraphRetriever.java:104)
~[flink-dist_2.12-1.10.1-stream1.jar:1.10.1-stream1]
at
org.apache.flink.runtime.dispatcher.runner.JobDispatcherLeaderProcessFactoryFactory.createFactory(JobDispatcherLeaderProcessFactoryFactory.java:55)
~[flink-dist_2.12-1.10.1-stream1.jar:1.10.1-stream1]
at
org.apache.flink.runtime.dispatcher.runner.DefaultDispatcherRunnerFactory.createDispatcherRunner(DefaultDispatcherRunnerFactory.java:51)
~[flink-dist_2.12-1.10.1-stream1.jar:1.10.1-stream1]
at
org.apache.flink.runtime.entrypoint.component.DefaultDispatcherResourceManagerComponentFactory.create(DefaultDispatcherResourceManagerComponentFactory.java:196)
~[flink-dist_2.12-1.10.1-stream1.jar:1.10.1-stream1]
at
org.apache.flink.runtime.entrypoint.ClusterEntrypoint.runCluster(ClusterEntrypoint.java:220)
~[flink-dist_2.12-1.10.1-stream1.jar:1.10.1-stream1]
at
org.apache.flink.runtime.entrypoint.ClusterEntrypoint.lambda$startCluster$0(ClusterEntrypoint.java:174)
~[flink-dist_2.12-1.10.1-stream1.jar:1.10.1-stream1]
at
org.apache.flink.runtime.security.NoOpSecurityContext.runSecured(NoOpSecurityContext.java:30)
~[flink-dist_2.12-1.10.1-stream1.jar:1.10.1-stream1]
at
org.apache.flink.runtime.entrypoint.ClusterEntrypoint.startCluster(ClusterEntrypoint.java:173)
~[flink-dist_2.12-1.10.1-stream1.jar:1.10.1-stream1]
... 2 more
Caused by: org.apache.flink.util.DynamicCodeLoadingException: Cannot find
configured options factory class:
com.ververica.DefaultConfigurableOptionsFactoryWithLog
at
org.apache.flink.contrib.streaming.state.RocksDBStateBackend.configureOptionsFactory(RocksDBStateBackend.java:605)
~[flink-dist_2.12-1.10.1-stream1.jar:1.10.1-stream1]
at
org.apache.flink.contrib.streaming.state.RocksDBStateBackend.<init>(RocksDBStateBackend.java:370)
~[flink-dist_2.12-1.10.1-stream1.jar:1.10.1-stream1]
at
org.apache.flink.contrib.streaming.state.RocksDBStateBackend.configure(RocksDBStateBackend.java:394)
~[flink-dist_2.12-1.10.1-stream1.jar:1.10.1-stream1]
at
org.apache.flink.contrib.streaming.state.RocksDBStateBackendFactory.createFromConfig(RocksDBStateBackendFactory.java:47)
~[flink-dist_2.12-1.10.1-stream1.jar:1.10.1-stream1]
at
org.apache.flink.contrib.streaming.state.RocksDBStateBackendFactory.createFromConfig(RocksDBStateBackendFactory.java:32)
~[flink-dist_2.12-1.10.1-stream1.jar:1.10.1-stream1]
at
org.apache.flink.runtime.state.StateBackendLoader.loadStateBackendFromConfig(StateBackendLoader.java:154)
~[flink-dist_2.12-1.10.1-stream1.jar:1.10.1-stream1]
at
org.apache.flink.streaming.api.environment.StreamExecutionEnvironment.loadStateBackend(StreamExecutionEnvironment.java:767)
~[flink-dist_2.12-1.10.1-stream1.jar:1.10.1-stream1]
at
org.apache.flink.streaming.api.environment.StreamExecutionEnvironment.configure(StreamExecutionEnvironment.java:750)
~[flink-dist_2.12-1.10.1-stream1.jar:1.10.1-stream1]
at
org.apache.flink.streaming.api.environment.StreamExecutionEnvironment.<init>(StreamExecutionEnvironment.java:218)
~[flink-dist_2.12-1.10.1-stream1.jar:1.10.1-stream1]
at
org.apache.flink.streaming.api.environment.StreamExecutionEnvironment.<init>(StreamExecutionEnvironment.java:190)
~[flink-dist_2.12-1.10.1-stream1.jar:1.10.1-stream1]
at
org.apache.flink.streaming.api.environment.StreamPlanEnvironment.<init>(StreamPlanEnvironment.java:38)
~[flink-dist_2.12-1.10.1-stream1.jar:1.10.1-stream1]
at
org.apache.flink.streaming.api.environment.StreamExecutionEnvironment.createStreamExecutionEnvironment(StreamExecutionEnvironment.java:1871)
~[flink-dist_2.12-1.10.1-stream1.jar:1.10.1-stream1]
at java.util.Optional.orElseGet(Optional.java:267) ~[?:1.8.0_252]
at
org.apache.flink.streaming.api.environment.StreamExecutionEnvironment.getExecutionEnvironment(StreamExecutionEnvironment.java:1859)
~[flink-dist_2.12-1.10.1-stream1.jar:1.10.1-stream1]
at
com.ververica.flinktraining.exercises.troubleshoot.TroubledStreamingJobUtils.createConfiguredEnvironment(TroubledStreamingJobUtils.java:40)
~[?:?]
at
com.ververica.flinktraining.solutions.troubleshoot.TroubledStreamingJobSolution43.main(TroubledStreamingJobSolution43.java:40)
~[?:?]
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
~[?:1.8.0_252]
at
sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
~[?:1.8.0_252]
at
sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
~[?:1.8.0_252]
at java.lang.reflect.Method.invoke(Method.java:498) ~[?:1.8.0_252]
at
org.apache.flink.client.program.PackagedProgram.callMainMethod(PackagedProgram.java:321)
~[flink-dist_2.12-1.10.1-stream1.jar:1.10.1-stream1]
at
org.apache.flink.client.program.PackagedProgram.invokeInteractiveModeForExecution(PackagedProgram.java:205)
~[flink-dist_2.12-1.10.1-stream1.jar:1.10.1-stream1]
at
org.apache.flink.client.program.OptimizerPlanEnvironment.getPipeline(OptimizerPlanEnvironment.java:80)
~[flink-dist_2.12-1.10.1-stream1.jar:1.10.1-stream1]
at
org.apache.flink.client.program.PackagedProgramUtils.getPipelineFromProgram(PackagedProgramUtils.java:108)
~[flink-dist_2.12-1.10.1-stream1.jar:1.10.1-stream1]
at
org.apache.flink.client.program.PackagedProgramUtils.createJobGraph(PackagedProgramUtils.java:58)
~[flink-dist_2.12-1.10.1-stream1.jar:1.10.1-stream1]
at
org.apache.flink.container.entrypoint.ClassPathJobGraphRetriever.retrieveJobGraph(ClassPathJobGraphRetriever.java:104)
~[flink-dist_2.12-1.10.1-stream1.jar:1.10.1-stream1]
at
org.apache.flink.runtime.dispatcher.runner.JobDispatcherLeaderProcessFactoryFactory.createFactory(JobDispatcherLeaderProcessFactoryFactory.java:55)
~[flink-dist_2.12-1.10.1-stream1.jar:1.10.1-stream1]
at
org.apache.flink.runtime.dispatcher.runner.DefaultDispatcherRunnerFactory.createDispatcherRunner(DefaultDispatcherRunnerFactory.java:51)
~[flink-dist_2.12-1.10.1-stream1.jar:1.10.1-stream1]
at
org.apache.flink.runtime.entrypoint.component.DefaultDispatcherResourceManagerComponentFactory.create(DefaultDispatcherResourceManagerComponentFactory.java:196)
~[flink-dist_2.12-1.10.1-stream1.jar:1.10.1-stream1]
at
org.apache.flink.runtime.entrypoint.ClusterEntrypoint.runCluster(ClusterEntrypoint.java:220)
~[flink-dist_2.12-1.10.1-stream1.jar:1.10.1-stream1]
at
org.apache.flink.runtime.entrypoint.ClusterEntrypoint.lambda$startCluster$0(ClusterEntrypoint.java:174)
~[flink-dist_2.12-1.10.1-stream1.jar:1.10.1-stream1]
at
org.apache.flink.runtime.security.NoOpSecurityContext.runSecured(NoOpSecurityContext.java:30)
~[flink-dist_2.12-1.10.1-stream1.jar:1.10.1-stream1]
at
org.apache.flink.runtime.entrypoint.ClusterEntrypoint.startCluster(ClusterEntrypoint.java:173)
~[flink-dist_2.12-1.10.1-stream1.jar:1.10.1-stream1]
... 2 more
Caused by: java.lang.ClassNotFoundException:
com.ververica.DefaultConfigurableOptionsFactoryWithLog
at java.net.URLClassLoader.findClass(URLClassLoader.java:382)
~[?:1.8.0_252]
at java.lang.ClassLoader.loadClass(ClassLoader.java:418) ~[?:1.8.0_252]
at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:352)
~[?:1.8.0_252]
at java.lang.ClassLoader.loadClass(ClassLoader.java:351) ~[?:1.8.0_252]
at java.lang.Class.forName0(Native Method) ~[?:1.8.0_252]
at java.lang.Class.forName(Class.java:348) ~[?:1.8.0_252]
at
org.apache.flink.contrib.streaming.state.RocksDBStateBackend.configureOptionsFactory(RocksDBStateBackend.java:594)
~[flink-dist_2.12-1.10.1-stream1.jar:1.10.1-stream1]
at
org.apache.flink.contrib.streaming.state.RocksDBStateBackend.<init>(RocksDBStateBackend.java:370)
~[flink-dist_2.12-1.10.1-stream1.jar:1.10.1-stream1]
at
org.apache.flink.contrib.streaming.state.RocksDBStateBackend.configure(RocksDBStateBackend.java:394)
~[flink-dist_2.12-1.10.1-stream1.jar:1.10.1-stream1]
at
org.apache.flink.contrib.streaming.state.RocksDBStateBackendFactory.createFromConfig(RocksDBStateBackendFactory.java:47)
~[flink-dist_2.12-1.10.1-stream1.jar:1.10.1-stream1]
at
org.apache.flink.contrib.streaming.state.RocksDBStateBackendFactory.createFromConfig(RocksDBStateBackendFactory.java:32)
~[flink-dist_2.12-1.10.1-stream1.jar:1.10.1-stream1]
at
org.apache.flink.runtime.state.StateBackendLoader.loadStateBackendFromConfig(StateBackendLoader.java:154)
~[flink-dist_2.12-1.10.1-stream1.jar:1.10.1-stream1]
at
org.apache.flink.streaming.api.environment.StreamExecutionEnvironment.loadStateBackend(StreamExecutionEnvironment.java:767)
~[flink-dist_2.12-1.10.1-stream1.jar:1.10.1-stream1]
at
org.apache.flink.streaming.api.environment.StreamExecutionEnvironment.configure(StreamExecutionEnvironment.java:750)
~[flink-dist_2.12-1.10.1-stream1.jar:1.10.1-stream1]
at
org.apache.flink.streaming.api.environment.StreamExecutionEnvironment.<init>(StreamExecutionEnvironment.java:218)
~[flink-dist_2.12-1.10.1-stream1.jar:1.10.1-stream1]
at
org.apache.flink.streaming.api.environment.StreamExecutionEnvironment.<init>(StreamExecutionEnvironment.java:190)
~[flink-dist_2.12-1.10.1-stream1.jar:1.10.1-stream1]
at
org.apache.flink.streaming.api.environment.StreamPlanEnvironment.<init>(StreamPlanEnvironment.java:38)
~[flink-dist_2.12-1.10.1-stream1.jar:1.10.1-stream1]
at
org.apache.flink.streaming.api.environment.StreamExecutionEnvironment.createStreamExecutionEnvironment(StreamExecutionEnvironment.java:1871)
~[flink-dist_2.12-1.10.1-stream1.jar:1.10.1-stream1]
at java.util.Optional.orElseGet(Optional.java:267) ~[?:1.8.0_252]
at
org.apache.flink.streaming.api.environment.StreamExecutionEnvironment.getExecutionEnvironment(StreamExecutionEnvironment.java:1859)
~[flink-dist_2.12-1.10.1-stream1.jar:1.10.1-stream1]
at
com.ververica.flinktraining.exercises.troubleshoot.TroubledStreamingJobUtils.createConfiguredEnvironment(TroubledStreamingJobUtils.java:40)
~[?:?]
at
com.ververica.flinktraining.solutions.troubleshoot.TroubledStreamingJobSolution43.main(TroubledStreamingJobSolution43.java:40)
~[?:?]
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
~[?:1.8.0_252]
at
sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
~[?:1.8.0_252]
at
sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
~[?:1.8.0_252]
at java.lang.reflect.Method.invoke(Method.java:498) ~[?:1.8.0_252]
at
org.apache.flink.client.program.PackagedProgram.callMainMethod(PackagedProgram.java:321)
~[flink-dist_2.12-1.10.1-stream1.jar:1.10.1-stream1]
at
org.apache.flink.client.program.PackagedProgram.invokeInteractiveModeForExecution(PackagedProgram.java:205)
~[flink-dist_2.12-1.10.1-stream1.jar:1.10.1-stream1]
at
org.apache.flink.client.program.OptimizerPlanEnvironment.getPipeline(OptimizerPlanEnvironment.java:80)
~[flink-dist_2.12-1.10.1-stream1.jar:1.10.1-stream1]
at
org.apache.flink.client.program.PackagedProgramUtils.getPipelineFromProgram(PackagedProgramUtils.java:108)
~[flink-dist_2.12-1.10.1-stream1.jar:1.10.1-stream1]
at
org.apache.flink.client.program.PackagedProgramUtils.createJobGraph(PackagedProgramUtils.java:58)
~[flink-dist_2.12-1.10.1-stream1.jar:1.10.1-stream1]
at
org.apache.flink.container.entrypoint.ClassPathJobGraphRetriever.retrieveJobGraph(ClassPathJobGraphRetriever.java:104)
~[flink-dist_2.12-1.10.1-stream1.jar:1.10.1-stream1]
at
org.apache.flink.runtime.dispatcher.runner.JobDispatcherLeaderProcessFactoryFactory.createFactory(JobDispatcherLeaderProcessFactoryFactory.java:55)
~[flink-dist_2.12-1.10.1-stream1.jar:1.10.1-stream1]
at
org.apache.flink.runtime.dispatcher.runner.DefaultDispatcherRunnerFactory.createDispatcherRunner(DefaultDispatcherRunnerFactory.java:51)
~[flink-dist_2.12-1.10.1-stream1.jar:1.10.1-stream1]
at
org.apache.flink.runtime.entrypoint.component.DefaultDispatcherResourceManagerComponentFactory.create(DefaultDispatcherResourceManagerComponentFactory.java:196)
~[flink-dist_2.12-1.10.1-stream1.jar:1.10.1-stream1]
at
org.apache.flink.runtime.entrypoint.ClusterEntrypoint.runCluster(ClusterEntrypoint.java:220)
~[flink-dist_2.12-1.10.1-stream1.jar:1.10.1-stream1]
at
org.apache.flink.runtime.entrypoint.ClusterEntrypoint.lambda$startCluster$0(ClusterEntrypoint.java:174)
~[flink-dist_2.12-1.10.1-stream1.jar:1.10.1-stream1]
at
org.apache.flink.runtime.security.NoOpSecurityContext.runSecured(NoOpSecurityContext.java:30)
~[flink-dist_2.12-1.10.1-stream1.jar:1.10.1-stream1]
at
org.apache.flink.runtime.entrypoint.ClusterEntrypoint.startCluster(ClusterEntrypoint.java:173)
~[flink-dist_2.12-1.10.1-stream1.jar:1.10.1-stream1]{code}
I attached the {{OptionsFactory}} that I used to show the error. (just put it
into the user code jar and configure
{code:java}
state.backend.rocksdb.options-factory:
com.ververica.DefaultConfigurableOptionsFactoryWithLog {code}
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
