This is an automated email from the ASF dual-hosted git repository.
srowen pushed a commit to branch master
in repository https://gitbox.apache.org/repos/asf/spark.git
The following commit(s) were added to refs/heads/master by this push:
new 653d1bc [SPARK-26835][DOCS] Notes API documentation for available
options of Data sources in SparkSQL guide
653d1bc is described below
commit 653d1bc232622282031cf6f5eab08ac8f39ec296
Author: Peter G. Horvath <peter.gergely.horv...@gmail.com>
AuthorDate: Wed Feb 13 08:02:51 2019 -0600
[SPARK-26835][DOCS] Notes API documentation for available options of Data
sources in SparkSQL guide
## What changes were proposed in this pull request?
This PR proposes to add some pointers of available options of Data source
in Spark SQL guide.
## How was this patch tested?
N/A: documentation change
Closes #23742 from peter-gergely-horvath/SPARK-26835.
Authored-by: Peter G. Horvath <peter.gergely.horv...@gmail.com>
Signed-off-by: Sean Owen <sean.o...@databricks.com>
---
docs/sql-data-sources-load-save-functions.md | 5 +++++
1 file changed, 5 insertions(+)
diff --git a/docs/sql-data-sources-load-save-functions.md
b/docs/sql-data-sources-load-save-functions.md
index 4386cae..b45561c 100644
--- a/docs/sql-data-sources-load-save-functions.md
+++ b/docs/sql-data-sources-load-save-functions.md
@@ -41,6 +41,11 @@ name (i.e., `org.apache.spark.sql.parquet`), but for
built-in sources you can al
names (`json`, `parquet`, `jdbc`, `orc`, `libsvm`, `csv`, `text`). DataFrames
loaded from any data
source type can be converted into other types using this syntax.
+Please refer the API documentation for available options of built-in sources,
for example,
+`org.apache.spark.sql.DataFrameReader` and
`org.apache.spark.sql.DataFrameWriter`. The
+options documented there should be applicable through non-Scala Spark APIs
(e.g. PySpark)
+as well. For other formats, refer to the API documentation of the particular
format.
+
To load a JSON file you can use:
<div class="codetabs">
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscr...@spark.apache.org
For additional commands, e-mail: commits-h...@spark.apache.org
