Any help?
Need urgent help. Someone please clarify the doubt?
-- Forwarded message --
From: Aakash Basu
Date: Thu, Apr 5, 2018 at 2:50 PM
Subject: Spark Structured Streaming Inner Queries fails
To: user
Hi,
Why are inner queries not allowed in Spark Streaming? Spark assumes
Hi,
Why are inner queries not allowed in Spark Streaming? Spark assumes the
inner query to be a separate stream altogether and expects it to be
triggered with a separate writeStream.start().
Why so?
Error: pyspark.sql.utils.StreamingQueryException: 'Queries with streaming
sources must be execute
