cloud-fan commented on code in PR #48971:
URL: https://github.com/apache/spark/pull/48971#discussion_r1858658711
##########
sql/core/src/main/scala/org/apache/spark/sql/execution/datasources/DataSource.scala:
##########
@@ -682,10 +682,6 @@ object DataSource extends Logging {
throw e
}
}
- case _ :: Nil if isUserDefinedDataSource =>
- // There was DSv1 or DSv2 loaded, but the same name source was found
- // in user defined data source.
- throw QueryCompilationErrors.foundMultipleDataSources(provider)
Review Comment:
Given the cost of loading the python data sources, I feel it's better to
give up producing a better error message here, and just say that Java data
source will be picked over Python if the short name conflicts.
We must document this.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: [email protected]
For queries about this service, please contact Infrastructure at:
[email protected]
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
