[jira] [Updated] (SPARK-38098) Add support for ArrayType of nested StructType to arrow-based conversion
[ https://issues.apache.org/jira/browse/SPARK-38098?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-38098: --- Labels: pull-request-available (was: ) > Add support for ArrayType of nested StructType to arrow-based conversion > > > Key: SPARK-38098 > URL: https://issues.apache.org/jira/browse/SPARK-38098 > Project: Spark > Issue Type: Improvement > Components: PySpark >Affects Versions: 3.2.1 >Reporter: Luca Canali >Assignee: Luca Canali >Priority: Minor > Labels: pull-request-available > Fix For: 3.4.0 > > > This proposes to add support for ArrayType of nested StructType to > arrow-based conversion. > This allows Pandas UDFs, mapInArrow UDFs, and toPandas to operate on columns > of type Array of Struct, via arrow serialization. -- This message was sent by Atlassian Jira (v8.20.10#820010) - To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org For additional commands, e-mail: issues-h...@spark.apache.org
[jira] [Updated] (SPARK-38098) Add support for ArrayType of nested StructType to arrow-based conversion
[ https://issues.apache.org/jira/browse/SPARK-38098?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Luca Canali updated SPARK-38098: Summary: Add support for ArrayType of nested StructType to arrow-based conversion (was: Support Array of Struct for Pandas UDFs) > Add support for ArrayType of nested StructType to arrow-based conversion > > > Key: SPARK-38098 > URL: https://issues.apache.org/jira/browse/SPARK-38098 > Project: Spark > Issue Type: Improvement > Components: PySpark >Affects Versions: 3.2.1 >Reporter: Luca Canali >Priority: Minor > > This is to allow Pandas UDFs (and mapInArrow UDFs) to operate on columns of > type Array of Struct via arrow serialization. -- This message was sent by Atlassian Jira (v8.20.1#820001) - To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org For additional commands, e-mail: issues-h...@spark.apache.org
[jira] [Updated] (SPARK-38098) Add support for ArrayType of nested StructType to arrow-based conversion
[ https://issues.apache.org/jira/browse/SPARK-38098?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Luca Canali updated SPARK-38098: Description: This proposes to add support for ArrayType of nested StructType to arrow-based conversion. This allows Pandas UDFs, mapInArrow UDFs, and toPandas to operate on columns of type Array of Struct, via arrow serialization. was:This is to allow Pandas UDFs (and mapInArrow UDFs) to operate on columns of type Array of Struct via arrow serialization. > Add support for ArrayType of nested StructType to arrow-based conversion > > > Key: SPARK-38098 > URL: https://issues.apache.org/jira/browse/SPARK-38098 > Project: Spark > Issue Type: Improvement > Components: PySpark >Affects Versions: 3.2.1 >Reporter: Luca Canali >Priority: Minor > > This proposes to add support for ArrayType of nested StructType to > arrow-based conversion. > This allows Pandas UDFs, mapInArrow UDFs, and toPandas to operate on columns > of type Array of Struct, via arrow serialization. -- This message was sent by Atlassian Jira (v8.20.1#820001) - To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org For additional commands, e-mail: issues-h...@spark.apache.org
