This is an automated email from the ASF dual-hosted git repository.
wenchen pushed a change to branch master
in repository https://gitbox.apache.org/repos/asf/spark.git
from bab98afd490b [SPARK-54231][SDP] Fill gaps in SDP docs
add f9191248900c [SPARK-54232][GEO][CONNECT] Enable Arrow serialization
for Geography and Geometry types
No new revisions were added by this update.
Summary of changes:
.../spark/sql/GeographyConnectDataFrameSuite.scala | 106 +++++++++++++++++++
.../spark/sql/GeometryConnectDataFrameSuite.scala | 112 +++++++++++++++++++++
.../connect/client/arrow/ArrowEncoderSuite.scala | 98 +++++++++++++++++-
.../connect/client/arrow/ArrowDeserializer.scala | 8 ++
.../connect/client/arrow/ArrowEncoderUtils.scala | 16 +++
.../sql/connect/client/arrow/ArrowSerializer.scala | 14 ++-
.../client/arrow/GeospatialArrowSerDe.scala | 101 +++++++++++++++++++
.../connect/common/DataTypeProtoConverter.scala | 35 +++++++
8 files changed, 487 insertions(+), 3 deletions(-)
create mode 100644
sql/connect/client/jvm/src/test/scala/org/apache/spark/sql/GeographyConnectDataFrameSuite.scala
create mode 100644
sql/connect/client/jvm/src/test/scala/org/apache/spark/sql/GeometryConnectDataFrameSuite.scala
create mode 100644
sql/connect/common/src/main/scala/org/apache/spark/sql/connect/client/arrow/GeospatialArrowSerDe.scala
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]