[
https://issues.apache.org/jira/browse/FLINK-5353?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15848105#comment-15848105
]
Flavio Pompermaier commented on FLINK-5353:
-------------------------------------------
My previous PR was https://github.com/apache/flink/pull/2790.
The error was thrown in afterBulk and hasFailure was set to true. Then close()
was throwing a RunTimeException also for a single malformed document and the
entire job used to fail also for a single malformed document.
Maybe that PR could be useful to test the error. Unfortunately right now I
don't have much time to help on this :(
I'd like to avoid to set {{ignore_malformed}} in my indices. Maybe it could
also be usefult to add an accumulator that keeps track of documents that
weren't indexed because malformed.
I like the idea of a {{FailedActionRequestHandler}} as suggested in #5122 as
long as it address this issue properly
> Elasticsearch Sink loses well-formed documents when there are malformed
> documents
> ---------------------------------------------------------------------------------
>
> Key: FLINK-5353
> URL: https://issues.apache.org/jira/browse/FLINK-5353
> Project: Flink
> Issue Type: Bug
> Components: Batch Connectors and Input/Output Formats
> Affects Versions: 1.1.3
> Reporter: Flavio Pompermaier
>
--
This message was sent by Atlassian JIRA
(v6.3.15#6346)
