Hi all, I’m having a bit of trouble with ElasticsearchIO Write transform. I’m able to successfully index documents into my elasticsearch cluster, but batching does not seem to work. There ends up being a 1:1 ratio between HTTP requests sent to `/my-index/_doc/_bulk` and the number of documents in my PCollection to which I apply the ElasticsearchIO PTransform. I’ve noticed this specifically under the DirectRunner by utilizing a debugger.
Am I missing something? Is this possibly a difference between execution environments (Ex. DirectRunner Vs. DataflowRunner)? How can I make sure my program is taking advantage of batching/bulk indexing? Thanks, Evan
