Github user HyukjinKwon commented on a diff in the pull request:
https://github.com/apache/spark/pull/19871#discussion_r154638156
--- Diff:
sql/core/src/main/scala/org/apache/spark/sql/execution/datasources/DataSource.scala
---
@@ -85,7 +87,8 @@ case class DataSource(
case class SourceInfo(name: String, schema: StructType,
partitionColumns: Seq[String])
- lazy val providingClass: Class[_] =
DataSource.lookupDataSource(className)
+ lazy val providingClass: Class[_] =
+ DataSource.lookupDataSource(sparkSession.sessionState.conf, className)
--- End diff --
I'd put this conf as the last argument actually if you wouldn't mind ..
---
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
