Github user liancheng commented on a diff in the pull request:
https://github.com/apache/spark/pull/12002#discussion_r57860269
--- Diff:
sql/core/src/main/scala/org/apache/spark/sql/sources/interfaces.scala ---
@@ -462,20 +462,24 @@ trait FileFormat {
/**
* Returns a function that can be used to read a single file in as an
Iterator of InternalRow.
*
+ * @param dataSchema The global data schema. It can be either specified
by the user, or
+ * reconciled/merged from all underlying data files.
If any partition columns
+ * are contained in the files, they are preserved in
this schema.
* @param partitionSchema The schema of the partition column row that
will be present in each
- * PartitionedFile. These columns should be
prepended to the rows that
+ * PartitionedFile. These columns should be
appended to the rows that
--- End diff --
Typo fixed here. Partition values are appended rather than prepended to
produced rows.
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at [email protected] or file a JIRA ticket
with INFRA.
---
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
