Github user xuanyuanking commented on a diff in the pull request:
https://github.com/apache/spark/pull/14957#discussion_r77760397
--- Diff:
sql/catalyst/src/main/scala/org/apache/spark/sql/types/StructType.scala ---
@@ -280,6 +280,29 @@ case class StructType(fields: Array[StructField])
extends DataType with Seq[Stru
}
/**
+ * Extracts the [[StructField]] with the given name recursively.
+ *
+ * @throws IllegalArgumentException if the parent field's type is not
StructType
+ */
+ def getFieldRecursively(name: String): StructField = {
--- End diff --
The mark of nested fields is one kind of tmp data, finally it will convert
to a pruned StructType and pass to
`org.apache.spark.sql.parquet.row.requested_schema`
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at [email protected] or file a JIRA ticket
with INFRA.
---
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
