2023 16:39
> *To:* Martin Andersson
> *Cc:* Spark dev list
> *Subject:* Re: Adding pause() method to
> pyspark.sql.streaming.StreamingQuery
>
>
> EXTERNAL SENDER. Do not click links or open attachments unless you
> recognize the sender and know the content is safe. DO NOT prov
stop?
Best regards, Martin
From: Mich Talebzadeh
mailto:mich.talebza...@gmail.com>>
Sent: Thursday, March 9, 2023 17:12
To: Spark dev list mailto:dev@spark.apache.org>>
Subject: Adding pause() method to pyspark.sql.streaming.StreamingQuery
EXTERNAL SENDER. D
e use-cases where it
> would be beneficial with a pause and how a pause would differ functionally
> from a stop?
>
> Best regards, Martin
> --
> *From:* Mich Talebzadeh
> *Sent:* Thursday, March 9, 2023 17:12
> *To:* Spark dev list
>
Spark dev list
Subject: Adding pause() method to pyspark.sql.streaming.StreamingQuery
EXTERNAL SENDER. Do not click links or open attachments unless you recognize
the sender and know the content is safe. DO NOT provide your username or
password.
Hi,
Currently for Spark Streaming we hav
Hi,
Currently for Spark Streaming we have the following class:
pyspark.sql.streaming.StreamingQuery
There are a number of useful methods, for example stop() which stops the
streaming process gracefully.
Can we add another method pause() so w can pause the processing. This will
come handy in
