Re: How to see the full contents of dataset or dataframe is structured streaming?

You can write it to the memory sink. df.writeStream.format("memory").queryName("myStream").start() spark.table("myStream").show() On Wed, May 17, 2017 at 7:55 PM, kant kodali wrote: > Hi All, > > How to see the full contents of dataset or dataframe is structured >

Re: How to see the full contents of dataset or dataframe is structured streaming?

Looks like there is .option("truncate", "false") On Wed, May 17, 2017 at 11:30 PM, Jörn Franke wrote: > You can also write it into a file and view it using your favorite > viewer/editor > > On 18. May 2017, at 04:55, kant kodali wrote: > > Hi All, > >

Re: How to see the full contents of dataset or dataframe is structured streaming?

so for console sink it is not possible? On Wed, May 17, 2017 at 11:30 PM, Jörn Franke wrote: > You can also write it into a file and view it using your favorite > viewer/editor > > On 18. May 2017, at 04:55, kant kodali wrote: > > Hi All, > > How to

Re: How to see the full contents of dataset or dataframe is structured streaming?

You can also write it into a file and view it using your favorite viewer/editor > On 18. May 2017, at 04:55, kant kodali wrote: > > Hi All, > > How to see the full contents of dataset or dataframe is structured streaming > just like we normally with df.show(false)? Is

How to see the full contents of dataset or dataframe is structured streaming?

Hi All, How to see the full contents of dataset or dataframe is structured streaming just like we normally with *df.show(false)*? Is there any parameter I can pass in to the code below? val df1 = df.selectExpr("payload.data.*"); df1.writeStream().outputMode("append").format("console").start()