Hyukjin Kwon created SPARK-26920: ------------------------------------ Summary: Deduplicate type checking across Arrow optimization and vectorized APIs in SparkR Key: SPARK-26920 URL: https://issues.apache.org/jira/browse/SPARK-26920 Project: Spark Issue Type: Bug Components: SparkR Affects Versions: 3.0.0 Reporter: Hyukjin Kwon
There are duplication about type checking in Arrow <> SparkR code paths. For instance, https://github.com/apache/spark/blob/8126d09fb5b969c1e293f1f8c41bec35357f74b5/R/pkg/R/group.R#L229-L253 struct type and map type should also be restricted. We should pull it out as a separate function and add deduplicated tests separately. -- This message was sent by Atlassian JIRA (v7.6.3#76005) --------------------------------------------------------------------- To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org For additional commands, e-mail: issues-h...@spark.apache.org