HyukjinKwon commented on a change in pull request #23742: [SPARK-26835][DOCS] Document configuration properties of Spark SQL Generic Load/Save Functions URL: https://github.com/apache/spark/pull/23742#discussion_r254941629
########## File path: docs/sql-data-sources-load-save-functions.md ########## @@ -41,6 +41,11 @@ name (i.e., `org.apache.spark.sql.parquet`), but for built-in sources you can al names (`json`, `parquet`, `jdbc`, `orc`, `libsvm`, `csv`, `text`). DataFrames loaded from any data source type can be converted into other types using this syntax. +For built-in sources, the available extra options are documented in the API documentation, Review comment: BTW, I asked https://github.com/apache/spark/pull/23742#discussion_r254673374 for the reasons below: - documented, documentation sounds duplicated - `the method corresponding to the format` some formats don't have the methods. Like avro, kafka, etc. - There are more places like `org.apache.spark.sql.DataStreamReader`. So it better makes it simpler and generalized. ---------------------------------------------------------------- This is an automated message from the Apache Git Service. To respond to the message, please log on GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: [email protected] With regards, Apache Git Services --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
