Thanks Tathagata Das
Currently in my use case I am planning to collect() all the data in the
driver and publish it into KairosDB something like this
I am not worried about the size of the data. If I am doing something simple
like this do I still need to bother about the un-stability of the API ?
This is interface is actually unstable. The v2 of DataSource APIs is being
designed right now which will be public and stable in a release or two. So
unfortunately there is no stable interface right now that I can officially
recommend.
That said, you could always use the ForeachWriter interface
We are using Spark 2.3 and would want to know if it is recommended to create
a custom KairoDBSink by implementing the StreamSinkProvider ?
The interface is marked experimental and in-stable ?
--
Sent from: http://apache-spark-user-list.1001560.n3.nabble.com/
