Github user gengliangwang commented on a diff in the pull request:
https://github.com/apache/spark/pull/22119#discussion_r210489530
--- Diff:
sql/core/src/main/scala/org/apache/spark/sql/execution/datasources/DataSource.scala
---
@@ -637,6 +635,12 @@ object DataSource extends Logging {
"Hive built-in ORC data source must be used with Hive
support enabled. " +
"Please use the native ORC data source by setting
'spark.sql.orc.impl' to " +
"'native'")
+ } else if (provider1.toLowerCase(Locale.ROOT) == "avro" ||
+ provider1 == "com.databricks.spark.avro") {
+ throw new AnalysisException(
+ s"Failed to find data source:
${provider1.toLowerCase(Locale.ROOT)}. " +
+ "AVRO is built-in data source since Spark 2.4. Please
deploy the application " +
+ "as per
https://spark.apache.org/docs/latest/avro-data-source.html#deploying";)
--- End diff --
I am creating a documentation for AVRO data source. Let's merge this PR
after the README is done.
---
---------------------------------------------------------------------
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands, e-mail: reviews-h...@spark.apache.org
