This is an automated email from the ASF dual-hosted git repository.
kabhwan pushed a change to branch master
in repository https://gitbox.apache.org/repos/asf/spark.git
from 6a668cde87c3 [SPARK-51150][ML] Explicitly pass the session in meta
algorithm writers
add 394458fc1fa8 [SPARK-51147][SS] Refactor streaming related classes to a
dedicated streaming directory
No new revisions were added by this update.
Summary of changes:
python/pyspark/sql/streaming/readwriter.py | 3 ++-
.../org/apache/spark/sql/connect/planner/SparkConnectPlanner.scala | 3 ++-
.../scala/org/apache/spark/sql/execution/SparkStrategies.scala | 3 ++-
.../execution/datasources/v2/python/PythonMicroBatchStream.scala | 3 +--
.../{ => streaming}/ApplyInPandasWithStatePythonRunner.scala | 7 ++++---
.../python/{ => streaming}/ApplyInPandasWithStateWriter.scala | 2 +-
.../python/{ => streaming}/BaseStreamingArrowWriter.scala | 2 +-
.../{ => streaming}/FlatMapGroupsInPandasWithStateExec.scala | 3 ++-
.../sql/execution/python/{ => streaming}/PythonForeachWriter.scala | 3 ++-
.../python/{ => streaming}/PythonStreamingSourceRunner.scala | 2 +-
.../{ => streaming}/TransformWithStateInPandasDeserializer.scala | 2 +-
.../python/{ => streaming}/TransformWithStateInPandasExec.scala | 3 ++-
.../{ => streaming}/TransformWithStateInPandasPythonRunner.scala | 5 +++--
.../{ => streaming}/TransformWithStateInPandasStateServer.scala | 2 +-
.../spark/sql/execution/streaming/IncrementalExecution.scala | 2 +-
.../spark/sql/execution/streaming/sources/ForeachWriterTable.scala | 2 +-
.../python/{ => streaming}/BaseStreamingArrowWriterSuite.scala | 2 +-
.../python/{ => streaming}/PythonForeachWriterSuite.scala | 4 ++--
.../python/{ => streaming}/PythonStreamingDataSourceSuite.scala | 3 ++-
.../TransformWithStateInPandasStateServerSuite.scala | 2 +-
.../FlatMapGroupsInPandasWithStateDistributionSuite.scala | 2 +-
.../spark/sql/streaming/FlatMapGroupsInPandasWithStateSuite.scala | 2 +-
22 files changed, 35 insertions(+), 27 deletions(-)
rename sql/core/src/main/scala/org/apache/spark/sql/execution/python/{ =>
streaming}/ApplyInPandasWithStatePythonRunner.scala (95%)
rename sql/core/src/main/scala/org/apache/spark/sql/execution/python/{ =>
streaming}/ApplyInPandasWithStateWriter.scala (99%)
rename sql/core/src/main/scala/org/apache/spark/sql/execution/python/{ =>
streaming}/BaseStreamingArrowWriter.scala (98%)
rename sql/core/src/main/scala/org/apache/spark/sql/execution/python/{ =>
streaming}/FlatMapGroupsInPandasWithStateExec.scala (98%)
rename sql/core/src/main/scala/org/apache/spark/sql/execution/python/{ =>
streaming}/PythonForeachWriter.scala (98%)
rename sql/core/src/main/scala/org/apache/spark/sql/execution/python/{ =>
streaming}/PythonStreamingSourceRunner.scala (99%)
rename sql/core/src/main/scala/org/apache/spark/sql/execution/python/{ =>
streaming}/TransformWithStateInPandasDeserializer.scala (97%)
rename sql/core/src/main/scala/org/apache/spark/sql/execution/python/{ =>
streaming}/TransformWithStateInPandasExec.scala (99%)
rename sql/core/src/main/scala/org/apache/spark/sql/execution/python/{ =>
streaming}/TransformWithStateInPandasPythonRunner.scala (97%)
rename sql/core/src/main/scala/org/apache/spark/sql/execution/python/{ =>
streaming}/TransformWithStateInPandasStateServer.scala (99%)
rename sql/core/src/test/scala/org/apache/spark/sql/execution/python/{ =>
streaming}/BaseStreamingArrowWriterSuite.scala (98%)
rename sql/core/src/test/scala/org/apache/spark/sql/execution/python/{ =>
streaming}/PythonForeachWriterSuite.scala (96%)
rename sql/core/src/test/scala/org/apache/spark/sql/execution/python/{ =>
streaming}/PythonStreamingDataSourceSuite.scala (99%)
rename sql/core/src/test/scala/org/apache/spark/sql/execution/python/{ =>
streaming}/TransformWithStateInPandasStateServerSuite.scala (99%)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
