Yesheng Ma created SPARK-34078:
----------------------------------

             Summary: Provide async variants for Dataset APIs
                 Key: SPARK-34078
                 URL: https://issues.apache.org/jira/browse/SPARK-34078
             Project: Spark
          Issue Type: Improvement
          Components: SQL
    Affects Versions: 3.0.1
            Reporter: Yesheng Ma


Spark RDDs have async variants such as `collectAsync`, which comes handy when 
we want to cancel a job. However, Dataset APIs are lacking such APIs, which 
makes it very painful to cancel a Dataset/SQL job.

 

The proposed change was to add async variants so that we can directly cancel a 
Dataset/SQL query via a future programmatically.



--
This message was sent by Atlassian Jira
(v8.3.4#803005)

---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]

Reply via email to