MaxGekk opened a new pull request #31578:
URL: https://github.com/apache/spark/pull/31578


   ### What changes were proposed in this pull request?
   1. Put the SQL config `spark.sql.legacy.replaceDatabricksSparkAvro.enabled` 
to the list of deprecated configs `deprecatedSQLConfigs`
   2. Update docs for the Avro datasource
   <img width="982" alt="Screenshot 2021-02-17 at 21 04 26" 
src="https://user-images.githubusercontent.com/1580697/108249890-abed7180-7166-11eb-8cb7-0c246d2a34fc.png";>
   
   
   ### Why are the changes needed?
   The config exists for enough time. We can deprecate it, and recommend users 
to use `.format("avro")` instead.
   
   ### Does this PR introduce _any_ user-facing change?
   Should not except of the warning with the recommendation to use the `avro` 
format.
   
   ### How was this patch tested?
   1. By generating docs via:
   ```
   $ SKIP_API=1 SKIP_SCALADOC=1 SKIP_PYTHONDOC=1 SKIP_RDOC=1 jekyll serve 
--watch
   ```
   2. Manually checking the warning:
   ```
   scala> spark.conf.set("spark.sql.legacy.replaceDatabricksSparkAvro.enabled", 
false)
   21/02/17 21:20:18 WARN SQLConf: The SQL config 
'spark.sql.legacy.replaceDatabricksSparkAvro.enabled' has been deprecated in 
Spark v3.2 and may be removed in the future. Use `.format("avro")` in 
`DataFrameWriter` or `DataFrameReader` instead.
   ```
   


----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

For queries about this service, please contact Infrastructure at:
[email protected]



---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]

Reply via email to