chitralverma opened a new pull request #569: [GRIFFIN-326] New Data Connector for Elasticsearch URL: https://github.com/apache/griffin/pull/569 **What changes were proposed in this pull request?** This ticket proposes the following changes, - Deprecate the current implementation in favour of the direct implementation in the official [elasticsearch-hadoop](https://github.com/elastic/elasticsearch-hadoop/tree/master/spark/sql-20) library. - This library is built on DataSource API built on spark 2.2.x+ and thus brings support for filter pushdowns, column pruning, unified read and write and additional optimizations. - Many configuration options are available for ES connectivity, [check here](https://github.com/elastic/elasticsearch-hadoop/blob/master/mr/src/main/java/org/elasticsearch/hadoop/cfg/ConfigurationOptions.java). - Any filters can be applied as expressions directly on the data frame and are pushed automatically to the source. **Does this PR introduce any user-facing change?** Yes. As mentioned above, the old connector has been deprecated and config structure for Elasticsearch data connector has changed now. **How was this patch tested?** Griffin test suite and additional unit test cases
---------------------------------------------------------------- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: [email protected] With regards, Apache Git Services
