[
https://issues.apache.org/jira/browse/BEAM-5757?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16653311#comment-16653311
]
Etienne Chauchot commented on BEAM-5757:
----------------------------------------
Hi [~praddy],
I'm not sure delete support belongs to a big data project such as Beam. Beam is
more targeting big collections of data to read or to write; but dropping an
index belongs more to an administrative tool.
It would be different if you had thousand of indexes to drop you would create a
PCollection<index> and call collection.delete() but I'm not sure such a use
case exists. Besides AFAIK in other big data projects such as spark, ES IO
connectors do not support delete either.
> Elasticsearch IO provide delete function
> ----------------------------------------
>
> Key: BEAM-5757
> URL: https://issues.apache.org/jira/browse/BEAM-5757
> Project: Beam
> Issue Type: New Feature
> Components: io-java-elasticsearch
> Affects Versions: 2.7.0
> Reporter: Prasad Marne
> Assignee: Etienne Chauchot
> Priority: Major
>
> Hello beam maintainers,
> I am trying to delete some index from Elasticsearch using beam pipeline. I
> couldn't find and delete function in ElasticsearchIO. It would be nice to
> have and would make sense for cleaning up indexes overtime.
> I also checked some other IO classes and they also don't support delete. Not
> sure if beam has some policy against supporting delete.
> Please guide me on this. I am willing to create pull request if this feature
> makes sense to project contributors.
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
