Hello, I am reading data from elasticsearch using spark (ES-Spark). After i get the data using sc.esRDD(".../...") I want to store everything in HDFS so I use the saveAsTextFile method but it is very slow ... Am I doing the right things ? It takes 15min to save (and it is saving 11Go)
Best regards -- Please update your bookmarks! We moved to https://discuss.elastic.co/ --- You received this message because you are subscribed to the Google Groups "elasticsearch" group. To unsubscribe from this group and stop receiving emails from it, send an email to elasticsearch+unsubscr...@googlegroups.com. To view this discussion on the web visit https://groups.google.com/d/msgid/elasticsearch/3fb6d71e-ec3d-4ecf-a293-a1ffb23cd04a%40googlegroups.com. For more options, visit https://groups.google.com/d/optout.