Github user HyukjinKwon commented on a diff in the pull request:
https://github.com/apache/spark/pull/21878#discussion_r205360211
--- Diff:
sql/core/src/main/scala/org/apache/spark/sql/execution/datasources/DataSource.scala
---
@@ -635,12 +637,6 @@ object DataSource extends Logging {
"Hive built-in ORC data source must be used with Hive
support enabled. " +
"Please use the native ORC data source by setting
'spark.sql.orc.impl' to " +
"'native'")
- } else if (provider1.toLowerCase(Locale.ROOT) == "avro" ||
- provider1 == "com.databricks.spark.avro") {
- throw new AnalysisException(
--- End diff --
Ah, I see. Okay. Then, how about this: I assume the documentation about
Avro will be done to Spark for 2.4.0 soon. When it's done, we add a message
here for Avro like please see the documentation to use Spark's avro package?
---
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
