Re: Does Apache Livy support Spark Structured Streaming 2.2.0?

2017-11-28 Thread kant kodali
Sorry I am new to this. By Job API I assume you meant programmatic API what is interactive query? On Tue, Nov 28, 2017 at 11:25 PM, Saisai Shao wrote: > Livy doesn't support WebSocket. I think for your

Re: Does Apache Livy support Spark Structured Streaming 2.2.0?

2017-11-28 Thread Saisai Shao
Livy doesn't support WebSocket. I think for your scenario, you need to use Livy's JobAPI instead of interactive query, Livy doesn't push results back to client in real time. So this maybe slightly different from what you want (IIUC). 2017-11-29 14:34 GMT+08:00 kant kodali : >

Re: Does Apache Livy support Spark Structured Streaming 2.2.0?

2017-11-28 Thread kant kodali
Nice! so if I submit a streaming query over REST can I get the results back over REST or Websocket? On Tue, Nov 28, 2017 at 10:29 PM, Saisai Shao wrote: > Livy doesn't add any restriction on how user uses Spark API, so of course > Structured Streaming is supported. > >

Does Apache Livy support Spark Structured Streaming 2.2.0?

2017-11-28 Thread kant kodali
Hi All, Does Apache Livy support Spark Structured Streaming 2.2.0? If so, any examples please? preferably in Java. Thanks, kant