aniruddhj commented on PR #38: URL: https://github.com/apache/flink-connector-opensearch/pull/38#issuecomment-2755899690
@snuyanzin I am having a similar issue. We have Flink 1.19.1 and Opensearch 2.19.0 installed on our system. I have added the `flink-sql-connector-opensearch2-2.0.0-1.19.jar` (downloaded from [maven](https://repo.maven.apache.org/maven2/org/apache/flink/flink-sql-connector-opensearch2/2.0.0-1.19/)) ``` 2025-03-26 21:53:28,183 INFO org.apache.flink.runtime.entrypoint.ClusterEntrypoint [] - Classpath: /opt/flink/lib/flink-sql-connector-opensearch2-2.0.0-1.19.jar:::: ``` From the latest code I could see the [`opensearch.version` is `2.13.0`](https://github.com/apache/flink-connector-opensearch/blob/11cde7b1526b220e2836b0492fd97bcc3c81d3bd/flink-connector-opensearch2/pom.xml#L39) hence I installed a 2.13.0 Opensearch. Even with all the above changes when I run the `.bin/sql-client.sh` and follow steps from https://opensearch.org/blog/OpenSearch-Flink-Connector/ it ends in error ``` 2025-03-26 21:59:33,352 INFO org.apache.flink.runtime.executiongraph.ExecutionGraph [] - myUserTable[3]: Writer (1/1) (8bd01e472d186428f97d3b2b608c8985_306d8342cb5b2ad8b53f1be57f65bee8_0_0) switched from INITIALIZING to FAILED on 10.254.16.48:6122-8a0669 @ 10.254.16.48 (dataPort=41903). java.lang.ExceptionInInitializerError: null at java.lang.J9VMInternals.recordInitializationFailure(Unknown Source) ~[?:?] at org.apache.flink.opensearch2.shaded.org.opensearch.transport.RemoteClusterService.lambda$static$1(RemoteClusterService.java:123) ~[flink-sql-connector-opensearch2-2.0.0-1.19.jar:2.0.0-1.19] at org.apache.flink.opensearch2.shaded.org.opensearch.common.settings.Setting.affixKeySetting(Setting.java:2837) ~[flink-sql-connector-opensearch2-2.0.0-1.19.jar:2.0.0-1.19] at org.apache.flink.opensearch2.shaded.org.opensearch.transport.RemoteClusterService.<clinit>(RemoteClusterService.java:120) ~[flink-sql-connector-opensearch2-2.0.0-1.19.jar:2.0.0-1.19] at org.apache.flink.opensearch2.shaded.org.opensearch.node.Node.<clinit>(Node.java:318) ~[flink-sql-connector-opensearch2-2.0.0-1.19.jar:2.0.0-1.19] at org.apache.flink.opensearch2.shaded.org.opensearch.common.util.concurrent.OpenSearchExecutors.threadName(OpenSearchExecutors.java:361) ~[flink-sql-connector-opensearch2-2.0.0-1.19.jar:2.0.0-1.19] at org.apache.flink.opensearch2.shaded.org.opensearch.common.util.concurrent.OpenSearchExecutors.daemonThreadFactory(OpenSearchExecutors.java:375) ~[flink-sql-connector-opensearch2-2.0.0-1.19.jar:2.0.0-1.19] at org.apache.flink.opensearch2.shaded.org.opensearch.threadpool.Scheduler.initScheduler(Scheduler.java:73) ~[flink-sql-connector-opensearch2-2.0.0-1.19.jar:2.0.0-1.19] at org.apache.flink.opensearch2.shaded.org.opensearch.action.bulk.BulkProcessor.builder(BulkProcessor.java:263) ~[flink-sql-connector-opensearch2-2.0.0-1.19.jar:2.0.0-1.19] at org.apache.flink.connector.opensearch.sink.Opensearch2Writer.createBulkProcessor(Opensearch2Writer.java:166) ~[flink-sql-connector-opensearch2-2.0.0-1.19.jar:2.0.0-1.19] at org.apache.flink.connector.opensearch.sink.Opensearch2Writer.<init>(Opensearch2Writer.java:113) ~[flink-sql-connector-opensearch2-2.0.0-1.19.jar:2.0.0-1.19] at org.apache.flink.connector.opensearch.sink.Opensearch2Sink.createWriter(Opensearch2Sink.java:95) ~[flink-sql-connector-opensearch2-2.0.0-1.19.jar:2.0.0-1.19] at org.apache.flink.api.connector.sink2.Sink.createWriter(Sink.java:77) ~[flink-dist-1.19.1.jar:1.19.1] at org.apache.flink.streaming.runtime.operators.sink.StatelessSinkWriterStateHandler.createWriter(StatelessSinkWriterStateHandler.java:39) ~[flink-dist-1.19.1.jar:1.19.1] at org.apache.flink.streaming.runtime.operators.sink.SinkWriterOperator.initializeState(SinkWriterOperator.java:148) ~[flink-dist-1.19.1.jar:1.19.1] at org.apache.flink.streaming.api.operators.StreamOperatorStateHandler.initializeOperatorState(StreamOperatorStateHandler.java:134) ~[flink-dist-1.19.1.jar:1.19.1] at org.apache.flink.streaming.api.operators.AbstractStreamOperator.initializeState(AbstractStreamOperator.java:286) ~[flink-dist-1.19.1.jar:1.19.1] at org.apache.flink.streaming.runtime.tasks.RegularOperatorChain.initializeStateAndOpenOperators(RegularOperatorChain.java:106) ~[flink-dist-1.19.1.jar:1.19.1] at org.apache.flink.streaming.runtime.tasks.StreamTask.restoreStateAndGates(StreamTask.java:799) ~[flink-dist-1.19.1.jar:1.19.1] at org.apache.flink.streaming.runtime.tasks.StreamTask.lambda$restoreInternal$3(StreamTask.java:753) ~[flink-dist-1.19.1.jar:1.19.1] at org.apache.flink.streaming.runtime.tasks.StreamTaskActionExecutor$1.call(StreamTaskActionExecutor.java:55) ~[flink-dist-1.19.1.jar:1.19.1] at org.apache.flink.streaming.runtime.tasks.StreamTask.restoreInternal(StreamTask.java:753) ~[flink-dist-1.19.1.jar:1.19.1] at org.apache.flink.streaming.runtime.tasks.StreamTask.restore(StreamTask.java:712) ~[flink-dist-1.19.1.jar:1.19.1] at org.apache.flink.runtime.taskmanager.Task.runWithSystemExitMonitoring(Task.java:958) ~[flink-dist-1.19.1.jar:1.19.1] at org.apache.flink.runtime.taskmanager.Task.restoreAndInvoke(Task.java:927) ~[flink-dist-1.19.1.jar:1.19.1] at org.apache.flink.runtime.taskmanager.Task.doRun(Task.java:751) ~[flink-dist-1.19.1.jar:1.19.1] at org.apache.flink.runtime.taskmanager.Task.run(Task.java:566) ~[flink-dist-1.19.1.jar:1.19.1] at java.lang.Thread.run(Unknown Source) ~[?:?] Caused by: java.lang.NullPointerException at org.apache.flink.opensearch2.shaded.org.opensearch.common.settings.Setting.arrayToParsableString(Setting.java:2373) ~[flink-sql-connector-opensearch2-2.0.0-1.19.jar:2.0.0-1.19] at org.apache.flink.opensearch2.shaded.org.opensearch.common.settings.Setting$ListSetting.lambda$new$0(Setting.java:2405) ~[flink-sql-connector-opensearch2-2.0.0-1.19.jar:2.0.0-1.19] at org.apache.flink.opensearch2.shaded.org.opensearch.common.settings.Setting$ListSetting.innerGetRaw(Setting.java:2416) ~[flink-sql-connector-opensearch2-2.0.0-1.19.jar:2.0.0-1.19] at org.apache.flink.opensearch2.shaded.org.opensearch.common.settings.Setting.getRaw(Setting.java:549) ~[flink-sql-connector-opensearch2-2.0.0-1.19.jar:2.0.0-1.19] at org.apache.flink.opensearch2.shaded.org.opensearch.common.settings.Setting.lambda$listSetting$37(Setting.java:2300) ~[flink-sql-connector-opensearch2-2.0.0-1.19.jar:2.0.0-1.19] at org.apache.flink.opensearch2.shaded.org.opensearch.common.settings.Setting.listSetting(Setting.java:2340) ~[flink-sql-connector-opensearch2-2.0.0-1.19.jar:2.0.0-1.19] at org.apache.flink.opensearch2.shaded.org.opensearch.common.settings.Setting.listSetting(Setting.java:2329) ~[flink-sql-connector-opensearch2-2.0.0-1.19.jar:2.0.0-1.19] at org.apache.flink.opensearch2.shaded.org.opensearch.common.settings.Setting.listSetting(Setting.java:2300) ~[flink-sql-connector-opensearch2-2.0.0-1.19.jar:2.0.0-1.19] at org.apache.flink.opensearch2.shaded.org.opensearch.transport.TransportSettings.<clinit>(TransportSettings.java:68) ~[flink-sql-connector-opensearch2-2.0.0-1.19.jar:2.0.0-1.19] ``` and ``` 2025-03-26 22:00:03,509 INFO org.apache.flink.runtime.executiongraph.ExecutionGraph [] - myUserTable[3]: Writer (1/1) (8bd01e472d186428f97d3b2b608c8985_306d8342cb5b2ad8b53f1be57f65bee8_0_1) switched from INITIALIZING to FAILED on 10.254.16.48:6122-8a0669 @ 10.254.16.48 (dataPort=41903). java.lang.NoClassDefFoundError: org.apache.flink.opensearch2.shaded.org.opensearch.node.Node (initialization failure) at java.lang.J9VMInternals.initializationAlreadyFailed(Unknown Source) ~[?:?] at org.apache.flink.opensearch2.shaded.org.opensearch.common.util.concurrent.OpenSearchExecutors.threadName(OpenSearchExecutors.java:361) ~[flink-sql-connector-opensearch2-2.0.0-1.19.jar:2.0.0-1.19] at org.apache.flink.opensearch2.shaded.org.opensearch.common.util.concurrent.OpenSearchExecutors.daemonThreadFactory(OpenSearchExecutors.java:375) ~[flink-sql-connector-opensearch2-2.0.0-1.19.jar:2.0.0-1.19] at org.apache.flink.opensearch2.shaded.org.opensearch.threadpool.Scheduler.initScheduler(Scheduler.java:73) ~[flink-sql-connector-opensearch2-2.0.0-1.19.jar:2.0.0-1.19] at org.apache.flink.opensearch2.shaded.org.opensearch.action.bulk.BulkProcessor.builder(BulkProcessor.java:263) ~[flink-sql-connector-opensearch2-2.0.0-1.19.jar:2.0.0-1.19] at org.apache.flink.connector.opensearch.sink.Opensearch2Writer.createBulkProcessor(Opensearch2Writer.java:166) ~[flink-sql-connector-opensearch2-2.0.0-1.19.jar:2.0.0-1.19] at org.apache.flink.connector.opensearch.sink.Opensearch2Writer.<init>(Opensearch2Writer.java:113) ~[flink-sql-connector-opensearch2-2.0.0-1.19.jar:2.0.0-1.19] at org.apache.flink.connector.opensearch.sink.Opensearch2Sink.createWriter(Opensearch2Sink.java:95) ~[flink-sql-connector-opensearch2-2.0.0-1.19.jar:2.0.0-1.19] at org.apache.flink.api.connector.sink2.Sink.createWriter(Sink.java:77) ~[flink-dist-1.19.1.jar:1.19.1] at org.apache.flink.streaming.runtime.operators.sink.StatelessSinkWriterStateHandler.createWriter(StatelessSinkWriterStateHandler.java:39) ~[flink-dist-1.19.1.jar:1.19.1] at org.apache.flink.streaming.runtime.operators.sink.SinkWriterOperator.initializeState(SinkWriterOperator.java:148) ~[flink-dist-1.19.1.jar:1.19.1] at org.apache.flink.streaming.api.operators.StreamOperatorStateHandler.initializeOperatorState(StreamOperatorStateHandler.java:134) ~[flink-dist-1.19.1.jar:1.19.1] at org.apache.flink.streaming.api.operators.AbstractStreamOperator.initializeState(AbstractStreamOperator.java:286) ~[flink-dist-1.19.1.jar:1.19.1] at org.apache.flink.streaming.runtime.tasks.RegularOperatorChain.initializeStateAndOpenOperators(RegularOperatorChain.java:106) ~[flink-dist-1.19.1.jar:1.19.1] at org.apache.flink.streaming.runtime.tasks.StreamTask.restoreStateAndGates(StreamTask.java:799) ~[flink-dist-1.19.1.jar:1.19.1] at org.apache.flink.streaming.runtime.tasks.StreamTask.lambda$restoreInternal$3(StreamTask.java:753) ~[flink-dist-1.19.1.jar:1.19.1] at org.apache.flink.streaming.runtime.tasks.StreamTaskActionExecutor$1.call(StreamTaskActionExecutor.java:55) ~[flink-dist-1.19.1.jar:1.19.1] at org.apache.flink.streaming.runtime.tasks.StreamTask.restoreInternal(StreamTask.java:753) ~[flink-dist-1.19.1.jar:1.19.1] at org.apache.flink.streaming.runtime.tasks.StreamTask.restore(StreamTask.java:712) ~[flink-dist-1.19.1.jar:1.19.1] at org.apache.flink.runtime.taskmanager.Task.runWithSystemExitMonitoring(Task.java:958) ~[flink-dist-1.19.1.jar:1.19.1] at org.apache.flink.runtime.taskmanager.Task.restoreAndInvoke(Task.java:927) ~[flink-dist-1.19.1.jar:1.19.1] at org.apache.flink.runtime.taskmanager.Task.doRun(Task.java:751) ~[flink-dist-1.19.1.jar:1.19.1] at org.apache.flink.runtime.taskmanager.Task.run(Task.java:566) ~[flink-dist-1.19.1.jar:1.19.1] at java.lang.Thread.run(Unknown Source) ~[?:?] Caused by: java.lang.ExceptionInInitializerError at java.lang.J9VMInternals.recordInitializationFailure(Unknown Source) ~[?:?] at org.apache.flink.opensearch2.shaded.org.opensearch.transport.RemoteClusterService.lambda$static$1(RemoteClusterService.java:123) ~[flink-sql-connector-opensearch2-2.0.0-1.19.jar:2.0.0-1.19] at org.apache.flink.opensearch2.shaded.org.opensearch.common.settings.Setting.affixKeySetting(Setting.java:2837) ~[flink-sql-connector-opensearch2-2.0.0-1.19.jar:2.0.0-1.19] at org.apache.flink.opensearch2.shaded.org.opensearch.transport.RemoteClusterService.<clinit>(RemoteClusterService.java:120) ~[flink-sql-connector-opensearch2-2.0.0-1.19.jar:2.0.0-1.19] at org.apache.flink.opensearch2.shaded.org.opensearch.node.Node.<clinit>(Node.java:318) ~[flink-sql-connector-opensearch2-2.0.0-1.19.jar:2.0.0-1.19] ... 23 more Caused by: java.lang.NullPointerException at org.apache.flink.opensearch2.shaded.org.opensearch.common.settings.Setting.arrayToParsableString(Setting.java:2373) ~[flink-sql-connector-opensearch2-2.0.0-1.19.jar:2.0.0-1.19] at org.apache.flink.opensearch2.shaded.org.opensearch.common.settings.Setting$ListSetting.lambda$new$0(Setting.java:2405) ~[flink-sql-connector-opensearch2-2.0.0-1.19.jar:2.0.0-1.19] at org.apache.flink.opensearch2.shaded.org.opensearch.common.settings.Setting$ListSetting.innerGetRaw(Setting.java:2416) ~[flink-sql-connector-opensearch2-2.0.0-1.19.jar:2.0.0-1.19] at org.apache.flink.opensearch2.shaded.org.opensearch.common.settings.Setting.getRaw(Setting.java:549) ~[flink-sql-connector-opensearch2-2.0.0-1.19.jar:2.0.0-1.19] at org.apache.flink.opensearch2.shaded.org.opensearch.common.settings.Setting.lambda$listSetting$37(Setting.java:2300) ~[flink-sql-connector-opensearch2-2.0.0-1.19.jar:2.0.0-1.19] at org.apache.flink.opensearch2.shaded.org.opensearch.common.settings.Setting.listSetting(Setting.java:2340) ~[flink-sql-connector-opensearch2-2.0.0-1.19.jar:2.0.0-1.19] at org.apache.flink.opensearch2.shaded.org.opensearch.common.settings.Setting.listSetting(Setting.java:2329) ~[flink-sql-connector-opensearch2-2.0.0-1.19.jar:2.0.0-1.19] at org.apache.flink.opensearch2.shaded.org.opensearch.common.settings.Setting.listSetting(Setting.java:2300) ~[flink-sql-connector-opensearch2-2.0.0-1.19.jar:2.0.0-1.19] at org.apache.flink.opensearch2.shaded.org.opensearch.transport.TransportSettings.<clinit>(TransportSettings.java:68) ~[flink-sql-connector-opensearch2-2.0.0-1.19.jar:2.0.0-1.19] at org.apache.flink.opensearch2.shaded.org.opensearch.transport.RemoteClusterService.lambda$static$1(RemoteClusterService.java:123) ~[flink-sql-connector-opensearch2-2.0.0-1.19.jar:2.0.0-1.19] at org.apache.flink.opensearch2.shaded.org.opensearch.common.settings.Setting.affixKeySetting(Setting.java:2837) ~[flink-sql-connector-opensearch2-2.0.0-1.19.jar:2.0.0-1.19] at org.apache.flink.opensearch2.shaded.org.opensearch.transport.RemoteClusterService.<clinit>(RemoteClusterService.java:120) ~[flink-sql-connector-opensearch2-2.0.0-1.19.jar:2.0.0-1.19] at org.apache.flink.opensearch2.shaded.org.opensearch.node.Node.<clinit>(Node.java:318) ~[flink-sql-connector-opensearch2-2.0.0-1.19.jar:2.0.0-1.19] ... 23 more ``` My understanding with the second part of the issue is the class is not being available at the runtime. Is there something that needs to provided additional to the jar or is this an issue with sql-client? Thanks! -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
