[ 
https://issues.apache.org/jira/browse/FLINK-30359?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17645652#comment-17645652
 ] 

Weijie Guo edited comment on FLINK-30359 at 12/11/22 4:57 AM:
--------------------------------------------------------------

To fix this problem, I think we no longer need to exclude `com.carrotsearch: 
hppc` from the sql connector jar of elasticsearch-6. In addition, I tested the 
6.3.1 version of es excluding `hppc`, and the 6.8.20 version of es including 
`hppc`, all of which work well, hope this can help confirm which versions of 
flink(since the es connector was previously maintained in apache/flink repo) 
has this problem.

I am willing to fix this, [~chesnay] would you like to assign this ticket to me 
and I will open a pull request later.


was (Author: weijie guo):
To fix this problem, I think we no longer need to exclude `com.carrotsearch: 
hppc` from the sql connector jar of elasticsearch-6. In addition, I tested the 
6.3.1 version of es excluding `hppc`, and the 6.8.20 version of es including 
`hppc`, all of which work well, hope this can help confirm which versions of 
flink(since the es connector was previously maintained in apache/flink repo) 
has this problem.

I am willing to fix this, [~chesnay] would you like assign this ticket to me 
and help review the change.

> Encountered NoClassDefFoundError when using  
> flink-sql-connector-elasticsearch6 
> --------------------------------------------------------------------------------
>
>                 Key: FLINK-30359
>                 URL: https://issues.apache.org/jira/browse/FLINK-30359
>             Project: Flink
>          Issue Type: Bug
>          Components: Connectors / ElasticSearch
>            Reporter: Weijie Guo
>            Priority: Major
>         Attachments: image-2022-12-11-01-09-47-337.png
>
>
> When I use sql-client to submit job that sink data to elasticsearch, it seems 
> that the `NoClassDefFoundError` arises as shown in the figure below. Note 
> that the connector jar I used is 
> flink-sql-connector-elasticsearch6-4.0-SNAPSHOT.jar, it is a uber jar 
> compiled from flink-connector-elasticsearch repo's main branch.
> !image-2022-12-11-01-09-47-337.png|width=596,height=285!
> Through some investigations, I found that in 
> flink-sql-connector-elasticsearch6 module's pom.xml, we manually excluded the 
> `com.carrotsearch: hppc` dependency, which is no problem for the 6.3.1 
> version of elasticsearch. However, FLINK-25189 bump this to 6.8.20, which 
> does requires the dependence of hppc. Therefore, an `NoClassDefFoundError` 
> occurred.
>  
>  



--
This message was sent by Atlassian Jira
(v8.20.10#820010)

Reply via email to