Thanks TD. When will 2.3 scheduled for release ?
On Thursday, January 25, 2018 11:32 PM, Tathagata Das
wrote:
Hello Mans,
The streaming DataSource APIs are still evolving and are not public yet. Hence
there is no official documentation. In fact, there is a new DataSourceV2 API
(in
Hello Mans,
The streaming DataSource APIs are still evolving and are not public yet.
Hence there is no official documentation. In fact, there is a new
DataSourceV2 API (in Spark 2.3) that we are migrating towards. So at this
point of time, it's hard to make any concrete suggestion. You can take a
Hi:
I am trying to create a custom structured streaming source and would like to
know if there is any example or documentation on the steps involved.
I've looked at the some methods available in the SparkSession but these are
internal to the sql package:
private[sql] def internalCreateDataFrame
