Github user tejasapatil commented on a diff in the pull request:
https://github.com/apache/spark/pull/15951#discussion_r89014484
--- Diff:
sql/core/src/main/scala/org/apache/spark/sql/execution/datasources/DataSource.scala
---
@@ -84,30 +84,95 @@ case class DataSource(
private val caseInsensitiveOptions = new CaseInsensitiveMap(options)
/**
- * Infer the schema of the given FileFormat, returns a pair of schema
and partition column names.
+ * Get the schema of the given FileFormat, if provided by
`userSpecifiedSchema`, or try to infer
+ * it. In the read path, only Hive managed tables provide the partition
columns properly when
--- End diff --
`Managed tables` is a thing in Hive (google for managed and external tables
in hive). `Hive managed tables` can be confused to that. You could say 'tables
managed by Hive`.
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at [email protected] or file a JIRA ticket
with INFRA.
---
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
