Structured Streaming source APIs are not yet public, so there isnt a guide. However, if you are adventurous enough, you can take a look at the source code in Spark. Source API: https://github.com/apache/spark/blob/master/sql/core/src/main/scala/org/apache/spark/sql/execution/streaming/Source.scala Text socket source implementation: https://github.com/apache/spark/blob/master/sql/core/src/main/scala/org/apache/spark/sql/execution/streaming/socket.scala
Note that these APIs are still internal APIs and are very likely to change in future versions of Spark. On Wed, Nov 1, 2017 at 5:45 PM, Daniel Haviv <danielru...@gmail.com> wrote: > Hi, > Is there a guide to writing a custom Structured Streaming receiver? > > Thank you. > Daniel >
