wael shehata created FLINK-34663:
------------------------------------
Summary: flink-opensearch connector Unable to parse response body
for Response
Key: FLINK-34663
URL: https://issues.apache.org/jira/browse/FLINK-34663
Project: Flink
Issue Type: Bug
Components: Connectors / Opensearch
Affects Versions: 1.18.1
Environment: Docker-Compose:
Flink 1.18.1 - Java11
OpenSearch 2.12.0
Flink-Sql-Opensearch-connector (flink 1.18.1 → Os 1.3)
Reporter: wael shehata
I`m trying to use flink-sql-opensearch connector to sink stream data to
OpenSearch via Flink …
After submitting the Job to Flink cluster successfully , the job runs normally
for 30sec and create the index with data … then it fails with the following
message:
_*org.apache.flink.util.FlinkRuntimeException: Complete bulk has failed… Caused
by: java.io.IOException: Unable to parse response body for Response*_
_*{requestLine=POST /_bulk?timeout=1m HTTP/1.1,
host=[http://172.20.0.6:9200|http://172.20.0.6:9200/], response=HTTP/1.1 200
OK}*_
at
org.opensearch.client.RestHighLevelClient$1.onSuccess(RestHighLevelClient.java:1942)
at
org.opensearch.client.RestClient$FailureTrackingResponseListener.onSuccess(RestClient.java:662)
at org.opensearch.client.RestClient$1.completed(RestClient.java:396)
at org.opensearch.client.RestClient$1.completed(RestClient.java:390)
at org.apache.http.concurrent.BasicFuture.completed(BasicFuture.java:122)
at
org.apache.http.impl.nio.client.DefaultClientExchangeHandlerImpl.responseCompleted(DefaultClientExchangeHandlerImpl.java:182)
at
org.apache.http.nio.protocol.HttpAsyncRequestExecutor.processResponse(HttpAsyncRequestExecutor.java:448)
at
org.apache.http.nio.protocol.HttpAsyncRequestExecutor.inputReady(HttpAsyncRequestExecutor.java:338)
at
org.apache.http.impl.nio.DefaultNHttpClientConnection.consumeInput(DefaultNHttpClientConnection.java:265)
at
org.apache.http.impl.nio.client.InternalIODispatch.onInputReady(InternalIODispatch.java:87)
at
org.apache.http.impl.nio.client.InternalIODispatch.onInputReady(InternalIODispatch.java:40)
at
org.apache.http.impl.nio.reactor.AbstractIODispatch.inputReady(AbstractIODispatch.java:114)
at
org.apache.http.impl.nio.reactor.BaseIOReactor.readable(BaseIOReactor.java:162)
at
org.apache.http.impl.nio.reactor.AbstractIOReactor.processEvent(AbstractIOReactor.java:337)
at
org.apache.http.impl.nio.reactor.AbstractIOReactor.processEvents(AbstractIOReactor.java:315)
at
org.apache.http.impl.nio.reactor.AbstractIOReactor.execute(AbstractIOReactor.java:276)
at
org.apache.http.impl.nio.reactor.BaseIOReactor.execute(BaseIOReactor.java:104)
at
org.apache.http.impl.nio.reactor.AbstractMultiworkerIOReactor$Worker.run(AbstractMultiworkerIOReactor.java:591)
… 1 more
*Caused by: java.lang.NullPointerException*
*at java.base/java.util.Objects.requireNonNull(Unknown Source)*
*at org.opensearch.action.DocWriteResponse.(DocWriteResponse.java:140)*
*at org.opensearch.action.index.IndexResponse.(IndexResponse.java:67) …*
It seems that this error is common but without any solution …
the flink connector despite it was built for OpenSearch 1.3 , but it still
working in sending and creating index to OpenSearch 2.12.0 … but this error
persists with all OpenSearch versions greater than 1.13 …
*Opensearch support reply was:*
*"this is unexpected, could you please create an issue here [1], the issue is
caused by _type property that has been removed in 2.x"*
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
