peter-gergely-horvath commented on a change in pull request #23742: [SPARK-26835][DOCS] Documentationof Spark SQL Generic Load/Save Functions options extended URL: https://github.com/apache/spark/pull/23742#discussion_r255553847
########## File path: docs/sql-data-sources-load-save-functions.md ########## @@ -41,6 +41,11 @@ name (i.e., `org.apache.spark.sql.parquet`), but for built-in sources you can al names (`json`, `parquet`, `jdbc`, `orc`, `libsvm`, `csv`, `text`). DataFrames loaded from any data source type can be converted into other types using this syntax. +The available extra options are documented in the API documentation. For basic formats +(like `json`, `parquet`, `jdbc`, `orc`, `csv`, `text`) you want to check the API documentation of +`org.apache.spark.sql.DataFrameReader` and `org.apache.spark.sql.DataFrameWriter`. For other Review comment: OK, I agree it should cover other languages as well. Could you please list the places one would look at for Pyspark and Sparks, please? Then I can do the legwork of formatting it nicely and updating the pull request. ---------------------------------------------------------------- This is an automated message from the Apache Git Service. To respond to the message, please log on GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: [email protected] With regards, Apache Git Services --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
