[ 
https://issues.apache.org/jira/browse/BEAM-6654?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17131431#comment-17131431
 ] 

Beam JIRA Bot commented on BEAM-6654:
-------------------------------------

This issue was marked "stale-assigned" and has not received a public comment in 
7 days. It is now automatically unassigned. If you are still working on it, you 
can assign it to yourself again. Please also give an update about the status of 
the work.

> Support SDF within ElasticsearchIO
> ----------------------------------
>
>                 Key: BEAM-6654
>                 URL: https://issues.apache.org/jira/browse/BEAM-6654
>             Project: Beam
>          Issue Type: New Feature
>          Components: io-java-elasticsearch
>            Reporter: Tony Moulton
>            Priority: P3
>
> Similar to HbaseIO.ReadAll, it would be very useful to support a SDF based 
> transform which can compose queries based off of input elements. 
> Implementation would split the work similarly to how the current Source API 
> implementation works (leveraging slices within Elasticsearch).
> This work can facilitate a transition of ElasticsearchIO to SDF when more 
> runners have implemented support.  Until then, I propose leaving the read() 
> implementation alone and add a readAll method and associated transform to be 
> implemented as an SDF.  Once enough runner support is ready, the existing 
> Read transform would be updated to use the same SDF as the ReadAll transform 
> with a null input element.
> A prototype implementation currently exists (albeit developed in a bubble) at 
> [https://github.com/0xdecaf/beam/tree/feature/elasticsearchio.readall] 
>  



--
This message was sent by Atlassian Jira
(v8.3.4#803005)

Reply via email to