http://git-wip-us.apache.org/repos/asf/spark-website/blob/e1001463/site/docs/2.2.2/api/R/coalesce.html ---------------------------------------------------------------------- diff --git a/site/docs/2.2.2/api/R/coalesce.html b/site/docs/2.2.2/api/R/coalesce.html new file mode 100644 index 0000000..f52fce8 --- /dev/null +++ b/site/docs/2.2.2/api/R/coalesce.html @@ -0,0 +1,147 @@ +<!DOCTYPE html PUBLIC "-//W3C//DTD XHTML 1.0 Strict//EN" "http://www.w3.org/TR/xhtml1/DTD/xhtml1-strict.dtd"><html xmlns="http://www.w3.org/1999/xhtml"><head><title>R: Coalesce</title> +<meta http-equiv="Content-Type" content="text/html; charset=utf-8" /> +<link rel="stylesheet" type="text/css" href="R.css" /> + +<link rel="stylesheet" href="https://cdnjs.cloudflare.com/ajax/libs/highlight.js/8.3/styles/github.min.css"> +<script src="https://cdnjs.cloudflare.com/ajax/libs/highlight.js/8.3/highlight.min.js"></script> +<script src="https://cdnjs.cloudflare.com/ajax/libs/highlight.js/8.3/languages/r.min.js"></script> +<script>hljs.initHighlightingOnLoad();</script> +</head><body> + +<table width="100%" summary="page for coalesce {SparkR}"><tr><td>coalesce {SparkR}</td><td style="text-align: right;">R Documentation</td></tr></table> + +<h2>Coalesce</h2> + +<h3>Description</h3> + +<p>Returns a new SparkDataFrame that has exactly <code>numPartitions</code> partitions. +This operation results in a narrow dependency, e.g. if you go from 1000 partitions to 100 +partitions, there will not be a shuffle, instead each of the 100 new partitions will claim 10 of +the current partitions. If a larger number of partitions is requested, it will stay at the +current number of partitions. +</p> +<p>Returns the first column that is not NA, or NA if all inputs are. +</p> + + +<h3>Usage</h3> + +<pre> +coalesce(x, ...) + +## S4 method for signature 'SparkDataFrame' +coalesce(x, numPartitions) + +## S4 method for signature 'Column' +coalesce(x, ...) +</pre> + + +<h3>Arguments</h3> + +<table summary="R argblock"> +<tr valign="top"><td><code>x</code></td> +<td> +<p>a Column or a SparkDataFrame.</p> +</td></tr> +<tr valign="top"><td><code>...</code></td> +<td> +<p>additional argument(s). If <code>x</code> is a Column, additional Columns can be optionally +provided.</p> +</td></tr> +<tr valign="top"><td><code>numPartitions</code></td> +<td> +<p>the number of partitions to use.</p> +</td></tr> +</table> + + +<h3>Details</h3> + +<p>However, if you're doing a drastic coalesce on a SparkDataFrame, e.g. to numPartitions = 1, +this may result in your computation taking place on fewer nodes than +you like (e.g. one node in the case of numPartitions = 1). To avoid this, +call <code>repartition</code>. This will add a shuffle step, but means the +current upstream partitions will be executed in parallel (per whatever +the current partitioning is). +</p> + + +<h3>Note</h3> + +<p>coalesce(SparkDataFrame) since 2.1.1 +</p> +<p>coalesce(Column) since 2.1.1 +</p> + + +<h3>See Also</h3> + +<p><a href="repartition.html">repartition</a> +</p> +<p>Other SparkDataFrame functions: <code><a href="SparkDataFrame.html">SparkDataFrame-class</a></code>, +<code><a href="summarize.html">agg</a></code>, <code><a href="arrange.html">arrange</a></code>, +<code><a href="as.data.frame.html">as.data.frame</a></code>, +<code><a href="attach.html">attach,SparkDataFrame-method</a></code>, +<code><a href="cache.html">cache</a></code>, <code><a href="checkpoint.html">checkpoint</a></code>, +<code><a href="collect.html">collect</a></code>, <code><a href="columns.html">colnames</a></code>, +<code><a href="coltypes.html">coltypes</a></code>, +<code><a href="createOrReplaceTempView.html">createOrReplaceTempView</a></code>, +<code><a href="crossJoin.html">crossJoin</a></code>, <code><a href="dapplyCollect.html">dapplyCollect</a></code>, +<code><a href="dapply.html">dapply</a></code>, <code><a href="summary.html">describe</a></code>, +<code><a href="dim.html">dim</a></code>, <code><a href="distinct.html">distinct</a></code>, +<code><a href="dropDuplicates.html">dropDuplicates</a></code>, <code><a href="nafunctions.html">dropna</a></code>, +<code><a href="drop.html">drop</a></code>, <code><a href="dtypes.html">dtypes</a></code>, +<code><a href="except.html">except</a></code>, <code><a href="explain.html">explain</a></code>, +<code><a href="filter.html">filter</a></code>, <code><a href="first.html">first</a></code>, +<code><a href="gapplyCollect.html">gapplyCollect</a></code>, <code><a href="gapply.html">gapply</a></code>, +<code><a href="getNumPartitions.html">getNumPartitions</a></code>, <code><a href="groupBy.html">group_by</a></code>, +<code><a href="head.html">head</a></code>, <code><a href="hint.html">hint</a></code>, +<code><a href="histogram.html">histogram</a></code>, <code><a href="insertInto.html">insertInto</a></code>, +<code><a href="intersect.html">intersect</a></code>, <code><a href="isLocal.html">isLocal</a></code>, +<code><a href="isStreaming.html">isStreaming</a></code>, <code><a href="join.html">join</a></code>, +<code><a href="limit.html">limit</a></code>, <code><a href="merge.html">merge</a></code>, +<code><a href="mutate.html">mutate</a></code>, <code><a href="ncol.html">ncol</a></code>, +<code><a href="nrow.html">nrow</a></code>, <code><a href="persist.html">persist</a></code>, +<code><a href="printSchema.html">printSchema</a></code>, <code><a href="randomSplit.html">randomSplit</a></code>, +<code><a href="rbind.html">rbind</a></code>, <code><a href="registerTempTable-deprecated.html">registerTempTable</a></code>, +<code><a href="rename.html">rename</a></code>, <code><a href="repartition.html">repartition</a></code>, +<code><a href="sample.html">sample</a></code>, <code><a href="saveAsTable.html">saveAsTable</a></code>, +<code><a href="schema.html">schema</a></code>, <code><a href="selectExpr.html">selectExpr</a></code>, +<code><a href="select.html">select</a></code>, <code><a href="showDF.html">showDF</a></code>, +<code><a href="show.html">show</a></code>, <code><a href="storageLevel.html">storageLevel</a></code>, +<code><a href="str.html">str</a></code>, <code><a href="subset.html">subset</a></code>, +<code><a href="take.html">take</a></code>, <code><a href="toJSON.html">toJSON</a></code>, +<code><a href="union.html">union</a></code>, <code><a href="unpersist.html">unpersist</a></code>, +<code><a href="withColumn.html">withColumn</a></code>, <code><a href="with.html">with</a></code>, +<code><a href="write.df.html">write.df</a></code>, <code><a href="write.jdbc.html">write.jdbc</a></code>, +<code><a href="write.json.html">write.json</a></code>, <code><a href="write.orc.html">write.orc</a></code>, +<code><a href="write.parquet.html">write.parquet</a></code>, <code><a href="write.stream.html">write.stream</a></code>, +<code><a href="write.text.html">write.text</a></code> +</p> +<p>Other normal_funcs: <code><a href="abs.html">abs</a></code>, +<code><a href="bitwiseNOT.html">bitwiseNOT</a></code>, <code><a href="column.html">column</a></code>, +<code><a href="expr.html">expr</a></code>, <code><a href="from_json.html">from_json</a></code>, +<code><a href="greatest.html">greatest</a></code>, <code><a href="ifelse.html">ifelse</a></code>, +<code><a href="is.nan.html">isnan</a></code>, <code><a href="least.html">least</a></code>, +<code><a href="lit.html">lit</a></code>, <code><a href="nanvl.html">nanvl</a></code>, +<code><a href="negate.html">negate</a></code>, <code><a href="randn.html">randn</a></code>, +<code><a href="rand.html">rand</a></code>, <code><a href="struct.html">struct</a></code>, +<code><a href="to_json.html">to_json</a></code>, <code><a href="when.html">when</a></code> +</p> + + +<h3>Examples</h3> + +<pre><code class="r">## Not run: +##D sparkR.session() +##D path <- "path/to/file.json" +##D df <- read.json(path) +##D newDF <- coalesce(df, 1L) +## End(Not run) +## Not run: coalesce(df$c, df$d, df$e) +</code></pre> + + +<hr /><div style="text-align: center;">[Package <em>SparkR</em> version 2.2.2 <a href="00Index.html">Index</a>]</div> +</body></html>
http://git-wip-us.apache.org/repos/asf/spark-website/blob/e1001463/site/docs/2.2.2/api/R/collect.html ---------------------------------------------------------------------- diff --git a/site/docs/2.2.2/api/R/collect.html b/site/docs/2.2.2/api/R/collect.html new file mode 100644 index 0000000..cbd2ea8 --- /dev/null +++ b/site/docs/2.2.2/api/R/collect.html @@ -0,0 +1,113 @@ +<!DOCTYPE html PUBLIC "-//W3C//DTD XHTML 1.0 Strict//EN" "http://www.w3.org/TR/xhtml1/DTD/xhtml1-strict.dtd"><html xmlns="http://www.w3.org/1999/xhtml"><head><title>R: Collects all the elements of a SparkDataFrame and coerces...</title> +<meta http-equiv="Content-Type" content="text/html; charset=utf-8" /> +<link rel="stylesheet" type="text/css" href="R.css" /> + +<link rel="stylesheet" href="https://cdnjs.cloudflare.com/ajax/libs/highlight.js/8.3/styles/github.min.css"> +<script src="https://cdnjs.cloudflare.com/ajax/libs/highlight.js/8.3/highlight.min.js"></script> +<script src="https://cdnjs.cloudflare.com/ajax/libs/highlight.js/8.3/languages/r.min.js"></script> +<script>hljs.initHighlightingOnLoad();</script> +</head><body> + +<table width="100%" summary="page for collect {SparkR}"><tr><td>collect {SparkR}</td><td style="text-align: right;">R Documentation</td></tr></table> + +<h2>Collects all the elements of a SparkDataFrame and coerces them into an R data.frame.</h2> + +<h3>Description</h3> + +<p>Collects all the elements of a SparkDataFrame and coerces them into an R data.frame. +</p> + + +<h3>Usage</h3> + +<pre> +collect(x, ...) + +## S4 method for signature 'SparkDataFrame' +collect(x, stringsAsFactors = FALSE) +</pre> + + +<h3>Arguments</h3> + +<table summary="R argblock"> +<tr valign="top"><td><code>x</code></td> +<td> +<p>a SparkDataFrame.</p> +</td></tr> +<tr valign="top"><td><code>...</code></td> +<td> +<p>further arguments to be passed to or from other methods.</p> +</td></tr> +<tr valign="top"><td><code>stringsAsFactors</code></td> +<td> +<p>(Optional) a logical indicating whether or not string columns +should be converted to factors. FALSE by default.</p> +</td></tr> +</table> + + +<h3>Note</h3> + +<p>collect since 1.4.0 +</p> + + +<h3>See Also</h3> + +<p>Other SparkDataFrame functions: <code><a href="SparkDataFrame.html">SparkDataFrame-class</a></code>, +<code><a href="summarize.html">agg</a></code>, <code><a href="arrange.html">arrange</a></code>, +<code><a href="as.data.frame.html">as.data.frame</a></code>, +<code><a href="attach.html">attach,SparkDataFrame-method</a></code>, +<code><a href="cache.html">cache</a></code>, <code><a href="checkpoint.html">checkpoint</a></code>, +<code><a href="coalesce.html">coalesce</a></code>, <code><a href="columns.html">colnames</a></code>, +<code><a href="coltypes.html">coltypes</a></code>, +<code><a href="createOrReplaceTempView.html">createOrReplaceTempView</a></code>, +<code><a href="crossJoin.html">crossJoin</a></code>, <code><a href="dapplyCollect.html">dapplyCollect</a></code>, +<code><a href="dapply.html">dapply</a></code>, <code><a href="summary.html">describe</a></code>, +<code><a href="dim.html">dim</a></code>, <code><a href="distinct.html">distinct</a></code>, +<code><a href="dropDuplicates.html">dropDuplicates</a></code>, <code><a href="nafunctions.html">dropna</a></code>, +<code><a href="drop.html">drop</a></code>, <code><a href="dtypes.html">dtypes</a></code>, +<code><a href="except.html">except</a></code>, <code><a href="explain.html">explain</a></code>, +<code><a href="filter.html">filter</a></code>, <code><a href="first.html">first</a></code>, +<code><a href="gapplyCollect.html">gapplyCollect</a></code>, <code><a href="gapply.html">gapply</a></code>, +<code><a href="getNumPartitions.html">getNumPartitions</a></code>, <code><a href="groupBy.html">group_by</a></code>, +<code><a href="head.html">head</a></code>, <code><a href="hint.html">hint</a></code>, +<code><a href="histogram.html">histogram</a></code>, <code><a href="insertInto.html">insertInto</a></code>, +<code><a href="intersect.html">intersect</a></code>, <code><a href="isLocal.html">isLocal</a></code>, +<code><a href="isStreaming.html">isStreaming</a></code>, <code><a href="join.html">join</a></code>, +<code><a href="limit.html">limit</a></code>, <code><a href="merge.html">merge</a></code>, +<code><a href="mutate.html">mutate</a></code>, <code><a href="ncol.html">ncol</a></code>, +<code><a href="nrow.html">nrow</a></code>, <code><a href="persist.html">persist</a></code>, +<code><a href="printSchema.html">printSchema</a></code>, <code><a href="randomSplit.html">randomSplit</a></code>, +<code><a href="rbind.html">rbind</a></code>, <code><a href="registerTempTable-deprecated.html">registerTempTable</a></code>, +<code><a href="rename.html">rename</a></code>, <code><a href="repartition.html">repartition</a></code>, +<code><a href="sample.html">sample</a></code>, <code><a href="saveAsTable.html">saveAsTable</a></code>, +<code><a href="schema.html">schema</a></code>, <code><a href="selectExpr.html">selectExpr</a></code>, +<code><a href="select.html">select</a></code>, <code><a href="showDF.html">showDF</a></code>, +<code><a href="show.html">show</a></code>, <code><a href="storageLevel.html">storageLevel</a></code>, +<code><a href="str.html">str</a></code>, <code><a href="subset.html">subset</a></code>, +<code><a href="take.html">take</a></code>, <code><a href="toJSON.html">toJSON</a></code>, +<code><a href="union.html">union</a></code>, <code><a href="unpersist.html">unpersist</a></code>, +<code><a href="withColumn.html">withColumn</a></code>, <code><a href="with.html">with</a></code>, +<code><a href="write.df.html">write.df</a></code>, <code><a href="write.jdbc.html">write.jdbc</a></code>, +<code><a href="write.json.html">write.json</a></code>, <code><a href="write.orc.html">write.orc</a></code>, +<code><a href="write.parquet.html">write.parquet</a></code>, <code><a href="write.stream.html">write.stream</a></code>, +<code><a href="write.text.html">write.text</a></code> +</p> + + +<h3>Examples</h3> + +<pre><code class="r">## Not run: +##D sparkR.session() +##D path <- "path/to/file.json" +##D df <- read.json(path) +##D collected <- collect(df) +##D firstName <- collected[[1]]$name +## End(Not run) +</code></pre> + + +<hr /><div style="text-align: center;">[Package <em>SparkR</em> version 2.2.2 <a href="00Index.html">Index</a>]</div> +</body></html> http://git-wip-us.apache.org/repos/asf/spark-website/blob/e1001463/site/docs/2.2.2/api/R/coltypes.html ---------------------------------------------------------------------- diff --git a/site/docs/2.2.2/api/R/coltypes.html b/site/docs/2.2.2/api/R/coltypes.html new file mode 100644 index 0000000..c3e5e9a --- /dev/null +++ b/site/docs/2.2.2/api/R/coltypes.html @@ -0,0 +1,129 @@ +<!DOCTYPE html PUBLIC "-//W3C//DTD XHTML 1.0 Strict//EN" "http://www.w3.org/TR/xhtml1/DTD/xhtml1-strict.dtd"><html xmlns="http://www.w3.org/1999/xhtml"><head><title>R: coltypes</title> +<meta http-equiv="Content-Type" content="text/html; charset=utf-8" /> +<link rel="stylesheet" type="text/css" href="R.css" /> + +<link rel="stylesheet" href="https://cdnjs.cloudflare.com/ajax/libs/highlight.js/8.3/styles/github.min.css"> +<script src="https://cdnjs.cloudflare.com/ajax/libs/highlight.js/8.3/highlight.min.js"></script> +<script src="https://cdnjs.cloudflare.com/ajax/libs/highlight.js/8.3/languages/r.min.js"></script> +<script>hljs.initHighlightingOnLoad();</script> +</head><body> + +<table width="100%" summary="page for coltypes {SparkR}"><tr><td>coltypes {SparkR}</td><td style="text-align: right;">R Documentation</td></tr></table> + +<h2>coltypes</h2> + +<h3>Description</h3> + +<p>Get column types of a SparkDataFrame +</p> +<p>Set the column types of a SparkDataFrame. +</p> + + +<h3>Usage</h3> + +<pre> +coltypes(x) + +coltypes(x) <- value + +## S4 method for signature 'SparkDataFrame' +coltypes(x) + +## S4 replacement method for signature 'SparkDataFrame,character' +coltypes(x) <- value +</pre> + + +<h3>Arguments</h3> + +<table summary="R argblock"> +<tr valign="top"><td><code>x</code></td> +<td> +<p>A SparkDataFrame</p> +</td></tr> +<tr valign="top"><td><code>value</code></td> +<td> +<p>A character vector with the target column types for the given +SparkDataFrame. Column types can be one of integer, numeric/double, character, logical, or NA +to keep that column as-is.</p> +</td></tr> +</table> + + +<h3>Value</h3> + +<p>value A character vector with the column types of the given SparkDataFrame +</p> + + +<h3>Note</h3> + +<p>coltypes since 1.6.0 +</p> +<p>coltypes<- since 1.6.0 +</p> + + +<h3>See Also</h3> + +<p>Other SparkDataFrame functions: <code><a href="SparkDataFrame.html">SparkDataFrame-class</a></code>, +<code><a href="summarize.html">agg</a></code>, <code><a href="arrange.html">arrange</a></code>, +<code><a href="as.data.frame.html">as.data.frame</a></code>, +<code><a href="attach.html">attach,SparkDataFrame-method</a></code>, +<code><a href="cache.html">cache</a></code>, <code><a href="checkpoint.html">checkpoint</a></code>, +<code><a href="coalesce.html">coalesce</a></code>, <code><a href="collect.html">collect</a></code>, +<code><a href="columns.html">colnames</a></code>, +<code><a href="createOrReplaceTempView.html">createOrReplaceTempView</a></code>, +<code><a href="crossJoin.html">crossJoin</a></code>, <code><a href="dapplyCollect.html">dapplyCollect</a></code>, +<code><a href="dapply.html">dapply</a></code>, <code><a href="summary.html">describe</a></code>, +<code><a href="dim.html">dim</a></code>, <code><a href="distinct.html">distinct</a></code>, +<code><a href="dropDuplicates.html">dropDuplicates</a></code>, <code><a href="nafunctions.html">dropna</a></code>, +<code><a href="drop.html">drop</a></code>, <code><a href="dtypes.html">dtypes</a></code>, +<code><a href="except.html">except</a></code>, <code><a href="explain.html">explain</a></code>, +<code><a href="filter.html">filter</a></code>, <code><a href="first.html">first</a></code>, +<code><a href="gapplyCollect.html">gapplyCollect</a></code>, <code><a href="gapply.html">gapply</a></code>, +<code><a href="getNumPartitions.html">getNumPartitions</a></code>, <code><a href="groupBy.html">group_by</a></code>, +<code><a href="head.html">head</a></code>, <code><a href="hint.html">hint</a></code>, +<code><a href="histogram.html">histogram</a></code>, <code><a href="insertInto.html">insertInto</a></code>, +<code><a href="intersect.html">intersect</a></code>, <code><a href="isLocal.html">isLocal</a></code>, +<code><a href="isStreaming.html">isStreaming</a></code>, <code><a href="join.html">join</a></code>, +<code><a href="limit.html">limit</a></code>, <code><a href="merge.html">merge</a></code>, +<code><a href="mutate.html">mutate</a></code>, <code><a href="ncol.html">ncol</a></code>, +<code><a href="nrow.html">nrow</a></code>, <code><a href="persist.html">persist</a></code>, +<code><a href="printSchema.html">printSchema</a></code>, <code><a href="randomSplit.html">randomSplit</a></code>, +<code><a href="rbind.html">rbind</a></code>, <code><a href="registerTempTable-deprecated.html">registerTempTable</a></code>, +<code><a href="rename.html">rename</a></code>, <code><a href="repartition.html">repartition</a></code>, +<code><a href="sample.html">sample</a></code>, <code><a href="saveAsTable.html">saveAsTable</a></code>, +<code><a href="schema.html">schema</a></code>, <code><a href="selectExpr.html">selectExpr</a></code>, +<code><a href="select.html">select</a></code>, <code><a href="showDF.html">showDF</a></code>, +<code><a href="show.html">show</a></code>, <code><a href="storageLevel.html">storageLevel</a></code>, +<code><a href="str.html">str</a></code>, <code><a href="subset.html">subset</a></code>, +<code><a href="take.html">take</a></code>, <code><a href="toJSON.html">toJSON</a></code>, +<code><a href="union.html">union</a></code>, <code><a href="unpersist.html">unpersist</a></code>, +<code><a href="withColumn.html">withColumn</a></code>, <code><a href="with.html">with</a></code>, +<code><a href="write.df.html">write.df</a></code>, <code><a href="write.jdbc.html">write.jdbc</a></code>, +<code><a href="write.json.html">write.json</a></code>, <code><a href="write.orc.html">write.orc</a></code>, +<code><a href="write.parquet.html">write.parquet</a></code>, <code><a href="write.stream.html">write.stream</a></code>, +<code><a href="write.text.html">write.text</a></code> +</p> + + +<h3>Examples</h3> + +<pre><code class="r">## Not run: +##D irisDF <- createDataFrame(iris) +##D coltypes(irisDF) # get column types +## End(Not run) +## Not run: +##D sparkR.session() +##D path <- "path/to/file.json" +##D df <- read.json(path) +##D coltypes(df) <- c("character", "integer") # set column types +##D coltypes(df) <- c(NA, "numeric") # set column types +## End(Not run) +</code></pre> + + +<hr /><div style="text-align: center;">[Package <em>SparkR</em> version 2.2.2 <a href="00Index.html">Index</a>]</div> +</body></html> http://git-wip-us.apache.org/repos/asf/spark-website/blob/e1001463/site/docs/2.2.2/api/R/column.html ---------------------------------------------------------------------- diff --git a/site/docs/2.2.2/api/R/column.html b/site/docs/2.2.2/api/R/column.html new file mode 100644 index 0000000..1fd04af --- /dev/null +++ b/site/docs/2.2.2/api/R/column.html @@ -0,0 +1,84 @@ +<!DOCTYPE html PUBLIC "-//W3C//DTD XHTML 1.0 Strict//EN" "http://www.w3.org/TR/xhtml1/DTD/xhtml1-strict.dtd"><html xmlns="http://www.w3.org/1999/xhtml"><head><title>R: S4 class that represents a SparkDataFrame column</title> +<meta http-equiv="Content-Type" content="text/html; charset=utf-8" /> +<link rel="stylesheet" type="text/css" href="R.css" /> + +<link rel="stylesheet" href="https://cdnjs.cloudflare.com/ajax/libs/highlight.js/8.3/styles/github.min.css"> +<script src="https://cdnjs.cloudflare.com/ajax/libs/highlight.js/8.3/highlight.min.js"></script> +<script src="https://cdnjs.cloudflare.com/ajax/libs/highlight.js/8.3/languages/r.min.js"></script> +<script>hljs.initHighlightingOnLoad();</script> +</head><body> + +<table width="100%" summary="page for column {SparkR}"><tr><td>column {SparkR}</td><td style="text-align: right;">R Documentation</td></tr></table> + +<h2>S4 class that represents a SparkDataFrame column</h2> + +<h3>Description</h3> + +<p>The column class supports unary, binary operations on SparkDataFrame columns +</p> +<p>Returns a Column based on the given column name. +</p> + + +<h3>Usage</h3> + +<pre> +column(x) + +## S4 method for signature 'jobj' +column(x) + +## S4 method for signature 'character' +column(x) +</pre> + + +<h3>Arguments</h3> + +<table summary="R argblock"> +<tr valign="top"><td><code>x</code></td> +<td> +<p>Character column name.</p> +</td></tr> +</table> + + +<h3>Slots</h3> + + +<dl> +<dt><code>jc</code></dt><dd><p>reference to JVM SparkDataFrame column</p> +</dd> +</dl> + + +<h3>Note</h3> + +<p>Column since 1.4.0 +</p> +<p>column since 1.6.0 +</p> + + +<h3>See Also</h3> + +<p>Other normal_funcs: <code><a href="abs.html">abs</a></code>, +<code><a href="bitwiseNOT.html">bitwiseNOT</a></code>, <code><a href="coalesce.html">coalesce</a></code>, +<code><a href="expr.html">expr</a></code>, <code><a href="from_json.html">from_json</a></code>, +<code><a href="greatest.html">greatest</a></code>, <code><a href="ifelse.html">ifelse</a></code>, +<code><a href="is.nan.html">isnan</a></code>, <code><a href="least.html">least</a></code>, +<code><a href="lit.html">lit</a></code>, <code><a href="nanvl.html">nanvl</a></code>, +<code><a href="negate.html">negate</a></code>, <code><a href="randn.html">randn</a></code>, +<code><a href="rand.html">rand</a></code>, <code><a href="struct.html">struct</a></code>, +<code><a href="to_json.html">to_json</a></code>, <code><a href="when.html">when</a></code> +</p> + + +<h3>Examples</h3> + +<pre><code class="r">## Not run: column("name") +</code></pre> + + +<hr /><div style="text-align: center;">[Package <em>SparkR</em> version 2.2.2 <a href="00Index.html">Index</a>]</div> +</body></html> http://git-wip-us.apache.org/repos/asf/spark-website/blob/e1001463/site/docs/2.2.2/api/R/columnfunctions.html ---------------------------------------------------------------------- diff --git a/site/docs/2.2.2/api/R/columnfunctions.html b/site/docs/2.2.2/api/R/columnfunctions.html new file mode 100644 index 0000000..ed1d0a7 --- /dev/null +++ b/site/docs/2.2.2/api/R/columnfunctions.html @@ -0,0 +1,55 @@ +<!DOCTYPE html PUBLIC "-//W3C//DTD XHTML 1.0 Strict//EN" "http://www.w3.org/TR/xhtml1/DTD/xhtml1-strict.dtd"><html xmlns="http://www.w3.org/1999/xhtml"><head><title>R: A set of operations working with SparkDataFrame columns</title> +<meta http-equiv="Content-Type" content="text/html; charset=utf-8" /> +<link rel="stylesheet" type="text/css" href="R.css" /> +</head><body> + +<table width="100%" summary="page for asc {SparkR}"><tr><td>asc {SparkR}</td><td style="text-align: right;">R Documentation</td></tr></table> + +<h2>A set of operations working with SparkDataFrame columns</h2> + +<h3>Description</h3> + +<p>A set of operations working with SparkDataFrame columns +</p> + + +<h3>Usage</h3> + +<pre> +asc(x) + +contains(x, ...) + +desc(x) + +getField(x, ...) + +getItem(x, ...) + +isNaN(x) + +isNull(x) + +isNotNull(x) + +like(x, ...) + +rlike(x, ...) +</pre> + + +<h3>Arguments</h3> + +<table summary="R argblock"> +<tr valign="top"><td><code>x</code></td> +<td> +<p>a Column object.</p> +</td></tr> +<tr valign="top"><td><code>...</code></td> +<td> +<p>additional argument(s).</p> +</td></tr> +</table> + +<hr /><div style="text-align: center;">[Package <em>SparkR</em> version 2.2.2 <a href="00Index.html">Index</a>]</div> +</body></html> http://git-wip-us.apache.org/repos/asf/spark-website/blob/e1001463/site/docs/2.2.2/api/R/columns.html ---------------------------------------------------------------------- diff --git a/site/docs/2.2.2/api/R/columns.html b/site/docs/2.2.2/api/R/columns.html new file mode 100644 index 0000000..9f65b50 --- /dev/null +++ b/site/docs/2.2.2/api/R/columns.html @@ -0,0 +1,141 @@ +<!DOCTYPE html PUBLIC "-//W3C//DTD XHTML 1.0 Strict//EN" "http://www.w3.org/TR/xhtml1/DTD/xhtml1-strict.dtd"><html xmlns="http://www.w3.org/1999/xhtml"><head><title>R: Column Names of SparkDataFrame</title> +<meta http-equiv="Content-Type" content="text/html; charset=utf-8" /> +<link rel="stylesheet" type="text/css" href="R.css" /> + +<link rel="stylesheet" href="https://cdnjs.cloudflare.com/ajax/libs/highlight.js/8.3/styles/github.min.css"> +<script src="https://cdnjs.cloudflare.com/ajax/libs/highlight.js/8.3/highlight.min.js"></script> +<script src="https://cdnjs.cloudflare.com/ajax/libs/highlight.js/8.3/languages/r.min.js"></script> +<script>hljs.initHighlightingOnLoad();</script> +</head><body> + +<table width="100%" summary="page for colnames {SparkR}"><tr><td>colnames {SparkR}</td><td style="text-align: right;">R Documentation</td></tr></table> + +<h2>Column Names of SparkDataFrame</h2> + +<h3>Description</h3> + +<p>Return a vector of column names. +</p> + + +<h3>Usage</h3> + +<pre> +colnames(x, do.NULL = TRUE, prefix = "col") + +colnames(x) <- value + +columns(x) + +## S4 method for signature 'SparkDataFrame' +columns(x) + +## S4 method for signature 'SparkDataFrame' +names(x) + +## S4 replacement method for signature 'SparkDataFrame' +names(x) <- value + +## S4 method for signature 'SparkDataFrame' +colnames(x) + +## S4 replacement method for signature 'SparkDataFrame' +colnames(x) <- value +</pre> + + +<h3>Arguments</h3> + +<table summary="R argblock"> +<tr valign="top"><td><code>x</code></td> +<td> +<p>a SparkDataFrame.</p> +</td></tr> +<tr valign="top"><td><code>do.NULL</code></td> +<td> +<p>currently not used.</p> +</td></tr> +<tr valign="top"><td><code>prefix</code></td> +<td> +<p>currently not used.</p> +</td></tr> +<tr valign="top"><td><code>value</code></td> +<td> +<p>a character vector. Must have the same length as the number +of columns to be renamed.</p> +</td></tr> +</table> + + +<h3>Note</h3> + +<p>columns since 1.4.0 +</p> +<p>names since 1.5.0 +</p> +<p>names<- since 1.5.0 +</p> +<p>colnames since 1.6.0 +</p> +<p>colnames<- since 1.6.0 +</p> + + +<h3>See Also</h3> + +<p>Other SparkDataFrame functions: <code><a href="SparkDataFrame.html">SparkDataFrame-class</a></code>, +<code><a href="summarize.html">agg</a></code>, <code><a href="arrange.html">arrange</a></code>, +<code><a href="as.data.frame.html">as.data.frame</a></code>, +<code><a href="attach.html">attach,SparkDataFrame-method</a></code>, +<code><a href="cache.html">cache</a></code>, <code><a href="checkpoint.html">checkpoint</a></code>, +<code><a href="coalesce.html">coalesce</a></code>, <code><a href="collect.html">collect</a></code>, +<code><a href="coltypes.html">coltypes</a></code>, +<code><a href="createOrReplaceTempView.html">createOrReplaceTempView</a></code>, +<code><a href="crossJoin.html">crossJoin</a></code>, <code><a href="dapplyCollect.html">dapplyCollect</a></code>, +<code><a href="dapply.html">dapply</a></code>, <code><a href="summary.html">describe</a></code>, +<code><a href="dim.html">dim</a></code>, <code><a href="distinct.html">distinct</a></code>, +<code><a href="dropDuplicates.html">dropDuplicates</a></code>, <code><a href="nafunctions.html">dropna</a></code>, +<code><a href="drop.html">drop</a></code>, <code><a href="dtypes.html">dtypes</a></code>, +<code><a href="except.html">except</a></code>, <code><a href="explain.html">explain</a></code>, +<code><a href="filter.html">filter</a></code>, <code><a href="first.html">first</a></code>, +<code><a href="gapplyCollect.html">gapplyCollect</a></code>, <code><a href="gapply.html">gapply</a></code>, +<code><a href="getNumPartitions.html">getNumPartitions</a></code>, <code><a href="groupBy.html">group_by</a></code>, +<code><a href="head.html">head</a></code>, <code><a href="hint.html">hint</a></code>, +<code><a href="histogram.html">histogram</a></code>, <code><a href="insertInto.html">insertInto</a></code>, +<code><a href="intersect.html">intersect</a></code>, <code><a href="isLocal.html">isLocal</a></code>, +<code><a href="isStreaming.html">isStreaming</a></code>, <code><a href="join.html">join</a></code>, +<code><a href="limit.html">limit</a></code>, <code><a href="merge.html">merge</a></code>, +<code><a href="mutate.html">mutate</a></code>, <code><a href="ncol.html">ncol</a></code>, +<code><a href="nrow.html">nrow</a></code>, <code><a href="persist.html">persist</a></code>, +<code><a href="printSchema.html">printSchema</a></code>, <code><a href="randomSplit.html">randomSplit</a></code>, +<code><a href="rbind.html">rbind</a></code>, <code><a href="registerTempTable-deprecated.html">registerTempTable</a></code>, +<code><a href="rename.html">rename</a></code>, <code><a href="repartition.html">repartition</a></code>, +<code><a href="sample.html">sample</a></code>, <code><a href="saveAsTable.html">saveAsTable</a></code>, +<code><a href="schema.html">schema</a></code>, <code><a href="selectExpr.html">selectExpr</a></code>, +<code><a href="select.html">select</a></code>, <code><a href="showDF.html">showDF</a></code>, +<code><a href="show.html">show</a></code>, <code><a href="storageLevel.html">storageLevel</a></code>, +<code><a href="str.html">str</a></code>, <code><a href="subset.html">subset</a></code>, +<code><a href="take.html">take</a></code>, <code><a href="toJSON.html">toJSON</a></code>, +<code><a href="union.html">union</a></code>, <code><a href="unpersist.html">unpersist</a></code>, +<code><a href="withColumn.html">withColumn</a></code>, <code><a href="with.html">with</a></code>, +<code><a href="write.df.html">write.df</a></code>, <code><a href="write.jdbc.html">write.jdbc</a></code>, +<code><a href="write.json.html">write.json</a></code>, <code><a href="write.orc.html">write.orc</a></code>, +<code><a href="write.parquet.html">write.parquet</a></code>, <code><a href="write.stream.html">write.stream</a></code>, +<code><a href="write.text.html">write.text</a></code> +</p> + + +<h3>Examples</h3> + +<pre><code class="r">## Not run: +##D sparkR.session() +##D path <- "path/to/file.json" +##D df <- read.json(path) +##D columns(df) +##D colnames(df) +## End(Not run) +</code></pre> + + +<hr /><div style="text-align: center;">[Package <em>SparkR</em> version 2.2.2 <a href="00Index.html">Index</a>]</div> +</body></html> http://git-wip-us.apache.org/repos/asf/spark-website/blob/e1001463/site/docs/2.2.2/api/R/concat.html ---------------------------------------------------------------------- diff --git a/site/docs/2.2.2/api/R/concat.html b/site/docs/2.2.2/api/R/concat.html new file mode 100644 index 0000000..69bd981 --- /dev/null +++ b/site/docs/2.2.2/api/R/concat.html @@ -0,0 +1,77 @@ +<!DOCTYPE html PUBLIC "-//W3C//DTD XHTML 1.0 Strict//EN" "http://www.w3.org/TR/xhtml1/DTD/xhtml1-strict.dtd"><html xmlns="http://www.w3.org/1999/xhtml"><head><title>R: concat</title> +<meta http-equiv="Content-Type" content="text/html; charset=utf-8" /> +<link rel="stylesheet" type="text/css" href="R.css" /> + +<link rel="stylesheet" href="https://cdnjs.cloudflare.com/ajax/libs/highlight.js/8.3/styles/github.min.css"> +<script src="https://cdnjs.cloudflare.com/ajax/libs/highlight.js/8.3/highlight.min.js"></script> +<script src="https://cdnjs.cloudflare.com/ajax/libs/highlight.js/8.3/languages/r.min.js"></script> +<script>hljs.initHighlightingOnLoad();</script> +</head><body> + +<table width="100%" summary="page for concat {SparkR}"><tr><td>concat {SparkR}</td><td style="text-align: right;">R Documentation</td></tr></table> + +<h2>concat</h2> + +<h3>Description</h3> + +<p>Concatenates multiple input string columns together into a single string column. +</p> + + +<h3>Usage</h3> + +<pre> +concat(x, ...) + +## S4 method for signature 'Column' +concat(x, ...) +</pre> + + +<h3>Arguments</h3> + +<table summary="R argblock"> +<tr valign="top"><td><code>x</code></td> +<td> +<p>Column to compute on</p> +</td></tr> +<tr valign="top"><td><code>...</code></td> +<td> +<p>other columns</p> +</td></tr> +</table> + + +<h3>Note</h3> + +<p>concat since 1.5.0 +</p> + + +<h3>See Also</h3> + +<p>Other string_funcs: <code><a href="ascii.html">ascii</a></code>, +<code><a href="base64.html">base64</a></code>, <code><a href="concat_ws.html">concat_ws</a></code>, +<code><a href="decode.html">decode</a></code>, <code><a href="encode.html">encode</a></code>, +<code><a href="format_number.html">format_number</a></code>, <code><a href="format_string.html">format_string</a></code>, +<code><a href="initcap.html">initcap</a></code>, <code><a href="instr.html">instr</a></code>, +<code><a href="length.html">length</a></code>, <code><a href="levenshtein.html">levenshtein</a></code>, +<code><a href="locate.html">locate</a></code>, <code><a href="lower.html">lower</a></code>, +<code><a href="lpad.html">lpad</a></code>, <code><a href="ltrim.html">ltrim</a></code>, +<code><a href="regexp_extract.html">regexp_extract</a></code>, +<code><a href="regexp_replace.html">regexp_replace</a></code>, <code><a href="reverse.html">reverse</a></code>, +<code><a href="rpad.html">rpad</a></code>, <code><a href="rtrim.html">rtrim</a></code>, +<code><a href="soundex.html">soundex</a></code>, <code><a href="substring_index.html">substring_index</a></code>, +<code><a href="translate.html">translate</a></code>, <code><a href="trim.html">trim</a></code>, +<code><a href="unbase64.html">unbase64</a></code>, <code><a href="upper.html">upper</a></code> +</p> + + +<h3>Examples</h3> + +<pre><code class="r">## Not run: concat(df$strings, df$strings2) +</code></pre> + + +<hr /><div style="text-align: center;">[Package <em>SparkR</em> version 2.2.2 <a href="00Index.html">Index</a>]</div> +</body></html> http://git-wip-us.apache.org/repos/asf/spark-website/blob/e1001463/site/docs/2.2.2/api/R/concat_ws.html ---------------------------------------------------------------------- diff --git a/site/docs/2.2.2/api/R/concat_ws.html b/site/docs/2.2.2/api/R/concat_ws.html new file mode 100644 index 0000000..645aee5 --- /dev/null +++ b/site/docs/2.2.2/api/R/concat_ws.html @@ -0,0 +1,82 @@ +<!DOCTYPE html PUBLIC "-//W3C//DTD XHTML 1.0 Strict//EN" "http://www.w3.org/TR/xhtml1/DTD/xhtml1-strict.dtd"><html xmlns="http://www.w3.org/1999/xhtml"><head><title>R: concat_ws</title> +<meta http-equiv="Content-Type" content="text/html; charset=utf-8" /> +<link rel="stylesheet" type="text/css" href="R.css" /> + +<link rel="stylesheet" href="https://cdnjs.cloudflare.com/ajax/libs/highlight.js/8.3/styles/github.min.css"> +<script src="https://cdnjs.cloudflare.com/ajax/libs/highlight.js/8.3/highlight.min.js"></script> +<script src="https://cdnjs.cloudflare.com/ajax/libs/highlight.js/8.3/languages/r.min.js"></script> +<script>hljs.initHighlightingOnLoad();</script> +</head><body> + +<table width="100%" summary="page for concat_ws {SparkR}"><tr><td>concat_ws {SparkR}</td><td style="text-align: right;">R Documentation</td></tr></table> + +<h2>concat_ws</h2> + +<h3>Description</h3> + +<p>Concatenates multiple input string columns together into a single string column, +using the given separator. +</p> + + +<h3>Usage</h3> + +<pre> +concat_ws(sep, x, ...) + +## S4 method for signature 'character,Column' +concat_ws(sep, x, ...) +</pre> + + +<h3>Arguments</h3> + +<table summary="R argblock"> +<tr valign="top"><td><code>sep</code></td> +<td> +<p>separator to use.</p> +</td></tr> +<tr valign="top"><td><code>x</code></td> +<td> +<p>column to concatenate.</p> +</td></tr> +<tr valign="top"><td><code>...</code></td> +<td> +<p>other columns to concatenate.</p> +</td></tr> +</table> + + +<h3>Note</h3> + +<p>concat_ws since 1.5.0 +</p> + + +<h3>See Also</h3> + +<p>Other string_funcs: <code><a href="ascii.html">ascii</a></code>, +<code><a href="base64.html">base64</a></code>, <code><a href="concat.html">concat</a></code>, +<code><a href="decode.html">decode</a></code>, <code><a href="encode.html">encode</a></code>, +<code><a href="format_number.html">format_number</a></code>, <code><a href="format_string.html">format_string</a></code>, +<code><a href="initcap.html">initcap</a></code>, <code><a href="instr.html">instr</a></code>, +<code><a href="length.html">length</a></code>, <code><a href="levenshtein.html">levenshtein</a></code>, +<code><a href="locate.html">locate</a></code>, <code><a href="lower.html">lower</a></code>, +<code><a href="lpad.html">lpad</a></code>, <code><a href="ltrim.html">ltrim</a></code>, +<code><a href="regexp_extract.html">regexp_extract</a></code>, +<code><a href="regexp_replace.html">regexp_replace</a></code>, <code><a href="reverse.html">reverse</a></code>, +<code><a href="rpad.html">rpad</a></code>, <code><a href="rtrim.html">rtrim</a></code>, +<code><a href="soundex.html">soundex</a></code>, <code><a href="substring_index.html">substring_index</a></code>, +<code><a href="translate.html">translate</a></code>, <code><a href="trim.html">trim</a></code>, +<code><a href="unbase64.html">unbase64</a></code>, <code><a href="upper.html">upper</a></code> +</p> + + +<h3>Examples</h3> + +<pre><code class="r">## Not run: concat_ws('-', df$s, df$d) +</code></pre> + + +<hr /><div style="text-align: center;">[Package <em>SparkR</em> version 2.2.2 <a href="00Index.html">Index</a>]</div> +</body></html> http://git-wip-us.apache.org/repos/asf/spark-website/blob/e1001463/site/docs/2.2.2/api/R/conv.html ---------------------------------------------------------------------- diff --git a/site/docs/2.2.2/api/R/conv.html b/site/docs/2.2.2/api/R/conv.html new file mode 100644 index 0000000..8a9d978 --- /dev/null +++ b/site/docs/2.2.2/api/R/conv.html @@ -0,0 +1,87 @@ +<!DOCTYPE html PUBLIC "-//W3C//DTD XHTML 1.0 Strict//EN" "http://www.w3.org/TR/xhtml1/DTD/xhtml1-strict.dtd"><html xmlns="http://www.w3.org/1999/xhtml"><head><title>R: conv</title> +<meta http-equiv="Content-Type" content="text/html; charset=utf-8" /> +<link rel="stylesheet" type="text/css" href="R.css" /> + +<link rel="stylesheet" href="https://cdnjs.cloudflare.com/ajax/libs/highlight.js/8.3/styles/github.min.css"> +<script src="https://cdnjs.cloudflare.com/ajax/libs/highlight.js/8.3/highlight.min.js"></script> +<script src="https://cdnjs.cloudflare.com/ajax/libs/highlight.js/8.3/languages/r.min.js"></script> +<script>hljs.initHighlightingOnLoad();</script> +</head><body> + +<table width="100%" summary="page for conv {SparkR}"><tr><td>conv {SparkR}</td><td style="text-align: right;">R Documentation</td></tr></table> + +<h2>conv</h2> + +<h3>Description</h3> + +<p>Convert a number in a string column from one base to another. +</p> + + +<h3>Usage</h3> + +<pre> +conv(x, fromBase, toBase) + +## S4 method for signature 'Column,numeric,numeric' +conv(x, fromBase, toBase) +</pre> + + +<h3>Arguments</h3> + +<table summary="R argblock"> +<tr valign="top"><td><code>x</code></td> +<td> +<p>column to convert.</p> +</td></tr> +<tr valign="top"><td><code>fromBase</code></td> +<td> +<p>base to convert from.</p> +</td></tr> +<tr valign="top"><td><code>toBase</code></td> +<td> +<p>base to convert to.</p> +</td></tr> +</table> + + +<h3>Note</h3> + +<p>conv since 1.5.0 +</p> + + +<h3>See Also</h3> + +<p>Other math_funcs: <code><a href="acos.html">acos</a></code>, <code><a href="asin.html">asin</a></code>, +<code><a href="atan2.html">atan2</a></code>, <code><a href="atan.html">atan</a></code>, +<code><a href="bin.html">bin</a></code>, <code><a href="bround.html">bround</a></code>, +<code><a href="cbrt.html">cbrt</a></code>, <code><a href="ceil.html">ceil</a></code>, +<code><a href="corr.html">corr</a></code>, <code><a href="cosh.html">cosh</a></code>, +<code><a href="cos.html">cos</a></code>, <code><a href="covar_pop.html">covar_pop</a></code>, +<code><a href="cov.html">cov</a></code>, <code><a href="expm1.html">expm1</a></code>, +<code><a href="exp.html">exp</a></code>, <code><a href="factorial.html">factorial</a></code>, +<code><a href="floor.html">floor</a></code>, <code><a href="hex.html">hex</a></code>, +<code><a href="hypot.html">hypot</a></code>, <code><a href="log10.html">log10</a></code>, +<code><a href="log1p.html">log1p</a></code>, <code><a href="log2.html">log2</a></code>, +<code><a href="log.html">log</a></code>, <code><a href="pmod.html">pmod</a></code>, +<code><a href="rint.html">rint</a></code>, <code><a href="round.html">round</a></code>, +<code><a href="shiftLeft.html">shiftLeft</a></code>, +<code><a href="shiftRightUnsigned.html">shiftRightUnsigned</a></code>, +<code><a href="shiftRight.html">shiftRight</a></code>, <code><a href="sign.html">signum</a></code>, +<code><a href="sinh.html">sinh</a></code>, <code><a href="sin.html">sin</a></code>, +<code><a href="sqrt.html">sqrt</a></code>, <code><a href="tanh.html">tanh</a></code>, +<code><a href="tan.html">tan</a></code>, <code><a href="toDegrees.html">toDegrees</a></code>, +<code><a href="toRadians.html">toRadians</a></code>, <code><a href="unhex.html">unhex</a></code> +</p> + + +<h3>Examples</h3> + +<pre><code class="r">## Not run: conv(df$n, 2, 16) +</code></pre> + + +<hr /><div style="text-align: center;">[Package <em>SparkR</em> version 2.2.2 <a href="00Index.html">Index</a>]</div> +</body></html> http://git-wip-us.apache.org/repos/asf/spark-website/blob/e1001463/site/docs/2.2.2/api/R/corr.html ---------------------------------------------------------------------- diff --git a/site/docs/2.2.2/api/R/corr.html b/site/docs/2.2.2/api/R/corr.html new file mode 100644 index 0000000..3b8a60b --- /dev/null +++ b/site/docs/2.2.2/api/R/corr.html @@ -0,0 +1,126 @@ +<!DOCTYPE html PUBLIC "-//W3C//DTD XHTML 1.0 Strict//EN" "http://www.w3.org/TR/xhtml1/DTD/xhtml1-strict.dtd"><html xmlns="http://www.w3.org/1999/xhtml"><head><title>R: corr</title> +<meta http-equiv="Content-Type" content="text/html; charset=utf-8" /> +<link rel="stylesheet" type="text/css" href="R.css" /> + +<link rel="stylesheet" href="https://cdnjs.cloudflare.com/ajax/libs/highlight.js/8.3/styles/github.min.css"> +<script src="https://cdnjs.cloudflare.com/ajax/libs/highlight.js/8.3/highlight.min.js"></script> +<script src="https://cdnjs.cloudflare.com/ajax/libs/highlight.js/8.3/languages/r.min.js"></script> +<script>hljs.initHighlightingOnLoad();</script> +</head><body> + +<table width="100%" summary="page for corr {SparkR}"><tr><td>corr {SparkR}</td><td style="text-align: right;">R Documentation</td></tr></table> + +<h2>corr</h2> + +<h3>Description</h3> + +<p>Computes the Pearson Correlation Coefficient for two Columns. +</p> +<p>Calculates the correlation of two columns of a SparkDataFrame. +Currently only supports the Pearson Correlation Coefficient. +For Spearman Correlation, consider using RDD methods found in MLlib's Statistics. +</p> + + +<h3>Usage</h3> + +<pre> +corr(x, ...) + +## S4 method for signature 'Column' +corr(x, col2) + +## S4 method for signature 'SparkDataFrame' +corr(x, colName1, colName2, method = "pearson") +</pre> + + +<h3>Arguments</h3> + +<table summary="R argblock"> +<tr valign="top"><td><code>x</code></td> +<td> +<p>a Column or a SparkDataFrame.</p> +</td></tr> +<tr valign="top"><td><code>...</code></td> +<td> +<p>additional argument(s). If <code>x</code> is a Column, a Column +should be provided. If <code>x</code> is a SparkDataFrame, two column names should +be provided.</p> +</td></tr> +<tr valign="top"><td><code>col2</code></td> +<td> +<p>a (second) Column.</p> +</td></tr> +<tr valign="top"><td><code>colName1</code></td> +<td> +<p>the name of the first column</p> +</td></tr> +<tr valign="top"><td><code>colName2</code></td> +<td> +<p>the name of the second column</p> +</td></tr> +<tr valign="top"><td><code>method</code></td> +<td> +<p>Optional. A character specifying the method for calculating the correlation. +only "pearson" is allowed now.</p> +</td></tr> +</table> + + +<h3>Value</h3> + +<p>The Pearson Correlation Coefficient as a Double. +</p> + + +<h3>Note</h3> + +<p>corr since 1.6.0 +</p> +<p>corr since 1.6.0 +</p> + + +<h3>See Also</h3> + +<p>Other math_funcs: <code><a href="acos.html">acos</a></code>, <code><a href="asin.html">asin</a></code>, +<code><a href="atan2.html">atan2</a></code>, <code><a href="atan.html">atan</a></code>, +<code><a href="bin.html">bin</a></code>, <code><a href="bround.html">bround</a></code>, +<code><a href="cbrt.html">cbrt</a></code>, <code><a href="ceil.html">ceil</a></code>, +<code><a href="conv.html">conv</a></code>, <code><a href="cosh.html">cosh</a></code>, +<code><a href="cos.html">cos</a></code>, <code><a href="covar_pop.html">covar_pop</a></code>, +<code><a href="cov.html">cov</a></code>, <code><a href="expm1.html">expm1</a></code>, +<code><a href="exp.html">exp</a></code>, <code><a href="factorial.html">factorial</a></code>, +<code><a href="floor.html">floor</a></code>, <code><a href="hex.html">hex</a></code>, +<code><a href="hypot.html">hypot</a></code>, <code><a href="log10.html">log10</a></code>, +<code><a href="log1p.html">log1p</a></code>, <code><a href="log2.html">log2</a></code>, +<code><a href="log.html">log</a></code>, <code><a href="pmod.html">pmod</a></code>, +<code><a href="rint.html">rint</a></code>, <code><a href="round.html">round</a></code>, +<code><a href="shiftLeft.html">shiftLeft</a></code>, +<code><a href="shiftRightUnsigned.html">shiftRightUnsigned</a></code>, +<code><a href="shiftRight.html">shiftRight</a></code>, <code><a href="sign.html">signum</a></code>, +<code><a href="sinh.html">sinh</a></code>, <code><a href="sin.html">sin</a></code>, +<code><a href="sqrt.html">sqrt</a></code>, <code><a href="tanh.html">tanh</a></code>, +<code><a href="tan.html">tan</a></code>, <code><a href="toDegrees.html">toDegrees</a></code>, +<code><a href="toRadians.html">toRadians</a></code>, <code><a href="unhex.html">unhex</a></code> +</p> +<p>Other stat functions: <code><a href="approxQuantile.html">approxQuantile</a></code>, +<code><a href="cov.html">cov</a></code>, <code><a href="crosstab.html">crosstab</a></code>, +<code><a href="freqItems.html">freqItems</a></code>, <code><a href="sampleBy.html">sampleBy</a></code> +</p> + + +<h3>Examples</h3> + +<pre><code class="r">## Not run: corr(df$c, df$d) +## Not run: +##D df <- read.json("/path/to/file.json") +##D corr <- corr(df, "title", "gender") +##D corr <- corr(df, "title", "gender", method = "pearson") +## End(Not run) +</code></pre> + + +<hr /><div style="text-align: center;">[Package <em>SparkR</em> version 2.2.2 <a href="00Index.html">Index</a>]</div> +</body></html> http://git-wip-us.apache.org/repos/asf/spark-website/blob/e1001463/site/docs/2.2.2/api/R/cos.html ---------------------------------------------------------------------- diff --git a/site/docs/2.2.2/api/R/cos.html b/site/docs/2.2.2/api/R/cos.html new file mode 100644 index 0000000..e2e743a --- /dev/null +++ b/site/docs/2.2.2/api/R/cos.html @@ -0,0 +1,77 @@ +<!DOCTYPE html PUBLIC "-//W3C//DTD XHTML 1.0 Strict//EN" "http://www.w3.org/TR/xhtml1/DTD/xhtml1-strict.dtd"><html xmlns="http://www.w3.org/1999/xhtml"><head><title>R: cos</title> +<meta http-equiv="Content-Type" content="text/html; charset=utf-8" /> +<link rel="stylesheet" type="text/css" href="R.css" /> + +<link rel="stylesheet" href="https://cdnjs.cloudflare.com/ajax/libs/highlight.js/8.3/styles/github.min.css"> +<script src="https://cdnjs.cloudflare.com/ajax/libs/highlight.js/8.3/highlight.min.js"></script> +<script src="https://cdnjs.cloudflare.com/ajax/libs/highlight.js/8.3/languages/r.min.js"></script> +<script>hljs.initHighlightingOnLoad();</script> +</head><body> + +<table width="100%" summary="page for cos {SparkR}"><tr><td>cos {SparkR}</td><td style="text-align: right;">R Documentation</td></tr></table> + +<h2>cos</h2> + +<h3>Description</h3> + +<p>Computes the cosine of the given value. +</p> + + +<h3>Usage</h3> + +<pre> +## S4 method for signature 'Column' +cos(x) +</pre> + + +<h3>Arguments</h3> + +<table summary="R argblock"> +<tr valign="top"><td><code>x</code></td> +<td> +<p>Column to compute on.</p> +</td></tr> +</table> + + +<h3>Note</h3> + +<p>cos since 1.5.0 +</p> + + +<h3>See Also</h3> + +<p>Other math_funcs: <code><a href="acos.html">acos</a></code>, <code><a href="asin.html">asin</a></code>, +<code><a href="atan2.html">atan2</a></code>, <code><a href="atan.html">atan</a></code>, +<code><a href="bin.html">bin</a></code>, <code><a href="bround.html">bround</a></code>, +<code><a href="cbrt.html">cbrt</a></code>, <code><a href="ceil.html">ceil</a></code>, +<code><a href="conv.html">conv</a></code>, <code><a href="corr.html">corr</a></code>, +<code><a href="cosh.html">cosh</a></code>, <code><a href="covar_pop.html">covar_pop</a></code>, +<code><a href="cov.html">cov</a></code>, <code><a href="expm1.html">expm1</a></code>, +<code><a href="exp.html">exp</a></code>, <code><a href="factorial.html">factorial</a></code>, +<code><a href="floor.html">floor</a></code>, <code><a href="hex.html">hex</a></code>, +<code><a href="hypot.html">hypot</a></code>, <code><a href="log10.html">log10</a></code>, +<code><a href="log1p.html">log1p</a></code>, <code><a href="log2.html">log2</a></code>, +<code><a href="log.html">log</a></code>, <code><a href="pmod.html">pmod</a></code>, +<code><a href="rint.html">rint</a></code>, <code><a href="round.html">round</a></code>, +<code><a href="shiftLeft.html">shiftLeft</a></code>, +<code><a href="shiftRightUnsigned.html">shiftRightUnsigned</a></code>, +<code><a href="shiftRight.html">shiftRight</a></code>, <code><a href="sign.html">signum</a></code>, +<code><a href="sinh.html">sinh</a></code>, <code><a href="sin.html">sin</a></code>, +<code><a href="sqrt.html">sqrt</a></code>, <code><a href="tanh.html">tanh</a></code>, +<code><a href="tan.html">tan</a></code>, <code><a href="toDegrees.html">toDegrees</a></code>, +<code><a href="toRadians.html">toRadians</a></code>, <code><a href="unhex.html">unhex</a></code> +</p> + + +<h3>Examples</h3> + +<pre><code class="r">## Not run: cos(df$c) +</code></pre> + + +<hr /><div style="text-align: center;">[Package <em>SparkR</em> version 2.2.2 <a href="00Index.html">Index</a>]</div> +</body></html> http://git-wip-us.apache.org/repos/asf/spark-website/blob/e1001463/site/docs/2.2.2/api/R/cosh.html ---------------------------------------------------------------------- diff --git a/site/docs/2.2.2/api/R/cosh.html b/site/docs/2.2.2/api/R/cosh.html new file mode 100644 index 0000000..d481d56 --- /dev/null +++ b/site/docs/2.2.2/api/R/cosh.html @@ -0,0 +1,77 @@ +<!DOCTYPE html PUBLIC "-//W3C//DTD XHTML 1.0 Strict//EN" "http://www.w3.org/TR/xhtml1/DTD/xhtml1-strict.dtd"><html xmlns="http://www.w3.org/1999/xhtml"><head><title>R: cosh</title> +<meta http-equiv="Content-Type" content="text/html; charset=utf-8" /> +<link rel="stylesheet" type="text/css" href="R.css" /> + +<link rel="stylesheet" href="https://cdnjs.cloudflare.com/ajax/libs/highlight.js/8.3/styles/github.min.css"> +<script src="https://cdnjs.cloudflare.com/ajax/libs/highlight.js/8.3/highlight.min.js"></script> +<script src="https://cdnjs.cloudflare.com/ajax/libs/highlight.js/8.3/languages/r.min.js"></script> +<script>hljs.initHighlightingOnLoad();</script> +</head><body> + +<table width="100%" summary="page for cosh {SparkR}"><tr><td>cosh {SparkR}</td><td style="text-align: right;">R Documentation</td></tr></table> + +<h2>cosh</h2> + +<h3>Description</h3> + +<p>Computes the hyperbolic cosine of the given value. +</p> + + +<h3>Usage</h3> + +<pre> +## S4 method for signature 'Column' +cosh(x) +</pre> + + +<h3>Arguments</h3> + +<table summary="R argblock"> +<tr valign="top"><td><code>x</code></td> +<td> +<p>Column to compute on.</p> +</td></tr> +</table> + + +<h3>Note</h3> + +<p>cosh since 1.5.0 +</p> + + +<h3>See Also</h3> + +<p>Other math_funcs: <code><a href="acos.html">acos</a></code>, <code><a href="asin.html">asin</a></code>, +<code><a href="atan2.html">atan2</a></code>, <code><a href="atan.html">atan</a></code>, +<code><a href="bin.html">bin</a></code>, <code><a href="bround.html">bround</a></code>, +<code><a href="cbrt.html">cbrt</a></code>, <code><a href="ceil.html">ceil</a></code>, +<code><a href="conv.html">conv</a></code>, <code><a href="corr.html">corr</a></code>, +<code><a href="cos.html">cos</a></code>, <code><a href="covar_pop.html">covar_pop</a></code>, +<code><a href="cov.html">cov</a></code>, <code><a href="expm1.html">expm1</a></code>, +<code><a href="exp.html">exp</a></code>, <code><a href="factorial.html">factorial</a></code>, +<code><a href="floor.html">floor</a></code>, <code><a href="hex.html">hex</a></code>, +<code><a href="hypot.html">hypot</a></code>, <code><a href="log10.html">log10</a></code>, +<code><a href="log1p.html">log1p</a></code>, <code><a href="log2.html">log2</a></code>, +<code><a href="log.html">log</a></code>, <code><a href="pmod.html">pmod</a></code>, +<code><a href="rint.html">rint</a></code>, <code><a href="round.html">round</a></code>, +<code><a href="shiftLeft.html">shiftLeft</a></code>, +<code><a href="shiftRightUnsigned.html">shiftRightUnsigned</a></code>, +<code><a href="shiftRight.html">shiftRight</a></code>, <code><a href="sign.html">signum</a></code>, +<code><a href="sinh.html">sinh</a></code>, <code><a href="sin.html">sin</a></code>, +<code><a href="sqrt.html">sqrt</a></code>, <code><a href="tanh.html">tanh</a></code>, +<code><a href="tan.html">tan</a></code>, <code><a href="toDegrees.html">toDegrees</a></code>, +<code><a href="toRadians.html">toRadians</a></code>, <code><a href="unhex.html">unhex</a></code> +</p> + + +<h3>Examples</h3> + +<pre><code class="r">## Not run: cosh(df$c) +</code></pre> + + +<hr /><div style="text-align: center;">[Package <em>SparkR</em> version 2.2.2 <a href="00Index.html">Index</a>]</div> +</body></html> http://git-wip-us.apache.org/repos/asf/spark-website/blob/e1001463/site/docs/2.2.2/api/R/count.html ---------------------------------------------------------------------- diff --git a/site/docs/2.2.2/api/R/count.html b/site/docs/2.2.2/api/R/count.html new file mode 100644 index 0000000..3b46145 --- /dev/null +++ b/site/docs/2.2.2/api/R/count.html @@ -0,0 +1,94 @@ +<!DOCTYPE html PUBLIC "-//W3C//DTD XHTML 1.0 Strict//EN" "http://www.w3.org/TR/xhtml1/DTD/xhtml1-strict.dtd"><html xmlns="http://www.w3.org/1999/xhtml"><head><title>R: Count</title> +<meta http-equiv="Content-Type" content="text/html; charset=utf-8" /> +<link rel="stylesheet" type="text/css" href="R.css" /> + +<link rel="stylesheet" href="https://cdnjs.cloudflare.com/ajax/libs/highlight.js/8.3/styles/github.min.css"> +<script src="https://cdnjs.cloudflare.com/ajax/libs/highlight.js/8.3/highlight.min.js"></script> +<script src="https://cdnjs.cloudflare.com/ajax/libs/highlight.js/8.3/languages/r.min.js"></script> +<script>hljs.initHighlightingOnLoad();</script> +</head><body> + +<table width="100%" summary="page for count {SparkR}"><tr><td>count {SparkR}</td><td style="text-align: right;">R Documentation</td></tr></table> + +<h2>Count</h2> + +<h3>Description</h3> + +<p>Count the number of rows for each group when we have <code>GroupedData</code> input. +The resulting SparkDataFrame will also contain the grouping columns. +</p> +<p>This can be used as a column aggregate function with <code>Column</code> as input, +and returns the number of items in a group. +</p> + + +<h3>Usage</h3> + +<pre> +count(x) + +n(x) + +## S4 method for signature 'GroupedData' +count(x) + +## S4 method for signature 'Column' +count(x) + +## S4 method for signature 'Column' +n(x) +</pre> + + +<h3>Arguments</h3> + +<table summary="R argblock"> +<tr valign="top"><td><code>x</code></td> +<td> +<p>a GroupedData or Column.</p> +</td></tr> +</table> + + +<h3>Value</h3> + +<p>A SparkDataFrame. +</p> + + +<h3>Note</h3> + +<p>count since 1.4.0 +</p> +<p>count since 1.4.0 +</p> +<p>n since 1.4.0 +</p> + + +<h3>See Also</h3> + +<p>Other agg_funcs: <code><a href="summarize.html">agg</a></code>, <code><a href="avg.html">avg</a></code>, +<code><a href="countDistinct.html">countDistinct</a></code>, <code><a href="first.html">first</a></code>, +<code><a href="kurtosis.html">kurtosis</a></code>, <code><a href="last.html">last</a></code>, +<code><a href="max.html">max</a></code>, <code><a href="mean.html">mean</a></code>, <code><a href="min.html">min</a></code>, +<code><a href="sd.html">sd</a></code>, <code><a href="skewness.html">skewness</a></code>, +<code><a href="stddev_pop.html">stddev_pop</a></code>, <code><a href="stddev_samp.html">stddev_samp</a></code>, +<code><a href="sumDistinct.html">sumDistinct</a></code>, <code><a href="sum.html">sum</a></code>, +<code><a href="var_pop.html">var_pop</a></code>, <code><a href="var_samp.html">var_samp</a></code>, +<code><a href="var.html">var</a></code> +</p> + + +<h3>Examples</h3> + +<pre><code class="r">## Not run: +##D count(groupBy(df, "name")) +## End(Not run) +## Not run: count(df$c) +## Not run: n(df$c) +</code></pre> + + +<hr /><div style="text-align: center;">[Package <em>SparkR</em> version 2.2.2 <a href="00Index.html">Index</a>]</div> +</body></html> http://git-wip-us.apache.org/repos/asf/spark-website/blob/e1001463/site/docs/2.2.2/api/R/countDistinct.html ---------------------------------------------------------------------- diff --git a/site/docs/2.2.2/api/R/countDistinct.html b/site/docs/2.2.2/api/R/countDistinct.html new file mode 100644 index 0000000..147a1f5 --- /dev/null +++ b/site/docs/2.2.2/api/R/countDistinct.html @@ -0,0 +1,88 @@ +<!DOCTYPE html PUBLIC "-//W3C//DTD XHTML 1.0 Strict//EN" "http://www.w3.org/TR/xhtml1/DTD/xhtml1-strict.dtd"><html xmlns="http://www.w3.org/1999/xhtml"><head><title>R: Count Distinct Values</title> +<meta http-equiv="Content-Type" content="text/html; charset=utf-8" /> +<link rel="stylesheet" type="text/css" href="R.css" /> + +<link rel="stylesheet" href="https://cdnjs.cloudflare.com/ajax/libs/highlight.js/8.3/styles/github.min.css"> +<script src="https://cdnjs.cloudflare.com/ajax/libs/highlight.js/8.3/highlight.min.js"></script> +<script src="https://cdnjs.cloudflare.com/ajax/libs/highlight.js/8.3/languages/r.min.js"></script> +<script>hljs.initHighlightingOnLoad();</script> +</head><body> + +<table width="100%" summary="page for countDistinct {SparkR}"><tr><td>countDistinct {SparkR}</td><td style="text-align: right;">R Documentation</td></tr></table> + +<h2>Count Distinct Values</h2> + +<h3>Description</h3> + +<p>Count Distinct Values +</p> +<p>Aggregate function: returns the number of distinct items in a group. +</p> + + +<h3>Usage</h3> + +<pre> +countDistinct(x, ...) + +n_distinct(x, ...) + +## S4 method for signature 'Column' +countDistinct(x, ...) + +## S4 method for signature 'Column' +n_distinct(x, ...) +</pre> + + +<h3>Arguments</h3> + +<table summary="R argblock"> +<tr valign="top"><td><code>x</code></td> +<td> +<p>Column to compute on</p> +</td></tr> +<tr valign="top"><td><code>...</code></td> +<td> +<p>other columns</p> +</td></tr> +</table> + + +<h3>Value</h3> + +<p>the number of distinct items in a group. +</p> + + +<h3>Note</h3> + +<p>countDistinct since 1.4.0 +</p> +<p>n_distinct since 1.4.0 +</p> + + +<h3>See Also</h3> + +<p>Other agg_funcs: <code><a href="summarize.html">agg</a></code>, <code><a href="avg.html">avg</a></code>, +<code><a href="count.html">count</a></code>, <code><a href="first.html">first</a></code>, +<code><a href="kurtosis.html">kurtosis</a></code>, <code><a href="last.html">last</a></code>, +<code><a href="max.html">max</a></code>, <code><a href="mean.html">mean</a></code>, <code><a href="min.html">min</a></code>, +<code><a href="sd.html">sd</a></code>, <code><a href="skewness.html">skewness</a></code>, +<code><a href="stddev_pop.html">stddev_pop</a></code>, <code><a href="stddev_samp.html">stddev_samp</a></code>, +<code><a href="sumDistinct.html">sumDistinct</a></code>, <code><a href="sum.html">sum</a></code>, +<code><a href="var_pop.html">var_pop</a></code>, <code><a href="var_samp.html">var_samp</a></code>, +<code><a href="var.html">var</a></code> +</p> + + +<h3>Examples</h3> + +<pre><code class="r">## Not run: countDistinct(df$c) +## Not run: n_distinct(df$c) +</code></pre> + + +<hr /><div style="text-align: center;">[Package <em>SparkR</em> version 2.2.2 <a href="00Index.html">Index</a>]</div> +</body></html> http://git-wip-us.apache.org/repos/asf/spark-website/blob/e1001463/site/docs/2.2.2/api/R/cov.html ---------------------------------------------------------------------- diff --git a/site/docs/2.2.2/api/R/cov.html b/site/docs/2.2.2/api/R/cov.html new file mode 100644 index 0000000..4a8ab63 --- /dev/null +++ b/site/docs/2.2.2/api/R/cov.html @@ -0,0 +1,134 @@ +<!DOCTYPE html PUBLIC "-//W3C//DTD XHTML 1.0 Strict//EN" "http://www.w3.org/TR/xhtml1/DTD/xhtml1-strict.dtd"><html xmlns="http://www.w3.org/1999/xhtml"><head><title>R: cov</title> +<meta http-equiv="Content-Type" content="text/html; charset=utf-8" /> +<link rel="stylesheet" type="text/css" href="R.css" /> + +<link rel="stylesheet" href="https://cdnjs.cloudflare.com/ajax/libs/highlight.js/8.3/styles/github.min.css"> +<script src="https://cdnjs.cloudflare.com/ajax/libs/highlight.js/8.3/highlight.min.js"></script> +<script src="https://cdnjs.cloudflare.com/ajax/libs/highlight.js/8.3/languages/r.min.js"></script> +<script>hljs.initHighlightingOnLoad();</script> +</head><body> + +<table width="100%" summary="page for cov {SparkR}"><tr><td>cov {SparkR}</td><td style="text-align: right;">R Documentation</td></tr></table> + +<h2>cov</h2> + +<h3>Description</h3> + +<p>Compute the sample covariance between two expressions. +</p> +<p>Calculate the sample covariance of two numerical columns of a SparkDataFrame. +</p> + + +<h3>Usage</h3> + +<pre> +cov(x, ...) + +covar_samp(col1, col2) + +## S4 method for signature 'characterOrColumn' +cov(x, col2) + +## S4 method for signature 'characterOrColumn,characterOrColumn' +covar_samp(col1, col2) + +## S4 method for signature 'SparkDataFrame' +cov(x, colName1, colName2) +</pre> + + +<h3>Arguments</h3> + +<table summary="R argblock"> +<tr valign="top"><td><code>x</code></td> +<td> +<p>a Column or a SparkDataFrame.</p> +</td></tr> +<tr valign="top"><td><code>...</code></td> +<td> +<p>additional argument(s). If <code>x</code> is a Column, a Column +should be provided. If <code>x</code> is a SparkDataFrame, two column names should +be provided.</p> +</td></tr> +<tr valign="top"><td><code>col1</code></td> +<td> +<p>the first Column.</p> +</td></tr> +<tr valign="top"><td><code>col2</code></td> +<td> +<p>the second Column.</p> +</td></tr> +<tr valign="top"><td><code>colName1</code></td> +<td> +<p>the name of the first column</p> +</td></tr> +<tr valign="top"><td><code>colName2</code></td> +<td> +<p>the name of the second column</p> +</td></tr> +</table> + + +<h3>Value</h3> + +<p>The covariance of the two columns. +</p> + + +<h3>Note</h3> + +<p>cov since 1.6.0 +</p> +<p>covar_samp since 2.0.0 +</p> +<p>cov since 1.6.0 +</p> + + +<h3>See Also</h3> + +<p>Other math_funcs: <code><a href="acos.html">acos</a></code>, <code><a href="asin.html">asin</a></code>, +<code><a href="atan2.html">atan2</a></code>, <code><a href="atan.html">atan</a></code>, +<code><a href="bin.html">bin</a></code>, <code><a href="bround.html">bround</a></code>, +<code><a href="cbrt.html">cbrt</a></code>, <code><a href="ceil.html">ceil</a></code>, +<code><a href="conv.html">conv</a></code>, <code><a href="corr.html">corr</a></code>, +<code><a href="cosh.html">cosh</a></code>, <code><a href="cos.html">cos</a></code>, +<code><a href="covar_pop.html">covar_pop</a></code>, <code><a href="expm1.html">expm1</a></code>, +<code><a href="exp.html">exp</a></code>, <code><a href="factorial.html">factorial</a></code>, +<code><a href="floor.html">floor</a></code>, <code><a href="hex.html">hex</a></code>, +<code><a href="hypot.html">hypot</a></code>, <code><a href="log10.html">log10</a></code>, +<code><a href="log1p.html">log1p</a></code>, <code><a href="log2.html">log2</a></code>, +<code><a href="log.html">log</a></code>, <code><a href="pmod.html">pmod</a></code>, +<code><a href="rint.html">rint</a></code>, <code><a href="round.html">round</a></code>, +<code><a href="shiftLeft.html">shiftLeft</a></code>, +<code><a href="shiftRightUnsigned.html">shiftRightUnsigned</a></code>, +<code><a href="shiftRight.html">shiftRight</a></code>, <code><a href="sign.html">signum</a></code>, +<code><a href="sinh.html">sinh</a></code>, <code><a href="sin.html">sin</a></code>, +<code><a href="sqrt.html">sqrt</a></code>, <code><a href="tanh.html">tanh</a></code>, +<code><a href="tan.html">tan</a></code>, <code><a href="toDegrees.html">toDegrees</a></code>, +<code><a href="toRadians.html">toRadians</a></code>, <code><a href="unhex.html">unhex</a></code> +</p> +<p>Other stat functions: <code><a href="approxQuantile.html">approxQuantile</a></code>, +<code><a href="corr.html">corr</a></code>, <code><a href="crosstab.html">crosstab</a></code>, +<code><a href="freqItems.html">freqItems</a></code>, <code><a href="sampleBy.html">sampleBy</a></code> +</p> + + +<h3>Examples</h3> + +<pre><code class="r">## Not run: +##D cov(df$c, df$d) +##D cov("c", "d") +##D covar_samp(df$c, df$d) +##D covar_samp("c", "d") +## End(Not run) +## Not run: +##D df <- read.json("/path/to/file.json") +##D cov <- cov(df, "title", "gender") +## End(Not run) +</code></pre> + + +<hr /><div style="text-align: center;">[Package <em>SparkR</em> version 2.2.2 <a href="00Index.html">Index</a>]</div> +</body></html> http://git-wip-us.apache.org/repos/asf/spark-website/blob/e1001463/site/docs/2.2.2/api/R/covar_pop.html ---------------------------------------------------------------------- diff --git a/site/docs/2.2.2/api/R/covar_pop.html b/site/docs/2.2.2/api/R/covar_pop.html new file mode 100644 index 0000000..f8ea31c --- /dev/null +++ b/site/docs/2.2.2/api/R/covar_pop.html @@ -0,0 +1,85 @@ +<!DOCTYPE html PUBLIC "-//W3C//DTD XHTML 1.0 Strict//EN" "http://www.w3.org/TR/xhtml1/DTD/xhtml1-strict.dtd"><html xmlns="http://www.w3.org/1999/xhtml"><head><title>R: covar_pop</title> +<meta http-equiv="Content-Type" content="text/html; charset=utf-8" /> +<link rel="stylesheet" type="text/css" href="R.css" /> + +<link rel="stylesheet" href="https://cdnjs.cloudflare.com/ajax/libs/highlight.js/8.3/styles/github.min.css"> +<script src="https://cdnjs.cloudflare.com/ajax/libs/highlight.js/8.3/highlight.min.js"></script> +<script src="https://cdnjs.cloudflare.com/ajax/libs/highlight.js/8.3/languages/r.min.js"></script> +<script>hljs.initHighlightingOnLoad();</script> +</head><body> + +<table width="100%" summary="page for covar_pop {SparkR}"><tr><td>covar_pop {SparkR}</td><td style="text-align: right;">R Documentation</td></tr></table> + +<h2>covar_pop</h2> + +<h3>Description</h3> + +<p>Compute the population covariance between two expressions. +</p> + + +<h3>Usage</h3> + +<pre> +covar_pop(col1, col2) + +## S4 method for signature 'characterOrColumn,characterOrColumn' +covar_pop(col1, col2) +</pre> + + +<h3>Arguments</h3> + +<table summary="R argblock"> +<tr valign="top"><td><code>col1</code></td> +<td> +<p>First column to compute cov_pop.</p> +</td></tr> +<tr valign="top"><td><code>col2</code></td> +<td> +<p>Second column to compute cov_pop.</p> +</td></tr> +</table> + + +<h3>Note</h3> + +<p>covar_pop since 2.0.0 +</p> + + +<h3>See Also</h3> + +<p>Other math_funcs: <code><a href="acos.html">acos</a></code>, <code><a href="asin.html">asin</a></code>, +<code><a href="atan2.html">atan2</a></code>, <code><a href="atan.html">atan</a></code>, +<code><a href="bin.html">bin</a></code>, <code><a href="bround.html">bround</a></code>, +<code><a href="cbrt.html">cbrt</a></code>, <code><a href="ceil.html">ceil</a></code>, +<code><a href="conv.html">conv</a></code>, <code><a href="corr.html">corr</a></code>, +<code><a href="cosh.html">cosh</a></code>, <code><a href="cos.html">cos</a></code>, <code><a href="cov.html">cov</a></code>, +<code><a href="expm1.html">expm1</a></code>, <code><a href="exp.html">exp</a></code>, +<code><a href="factorial.html">factorial</a></code>, <code><a href="floor.html">floor</a></code>, +<code><a href="hex.html">hex</a></code>, <code><a href="hypot.html">hypot</a></code>, +<code><a href="log10.html">log10</a></code>, <code><a href="log1p.html">log1p</a></code>, +<code><a href="log2.html">log2</a></code>, <code><a href="log.html">log</a></code>, +<code><a href="pmod.html">pmod</a></code>, <code><a href="rint.html">rint</a></code>, +<code><a href="round.html">round</a></code>, <code><a href="shiftLeft.html">shiftLeft</a></code>, +<code><a href="shiftRightUnsigned.html">shiftRightUnsigned</a></code>, +<code><a href="shiftRight.html">shiftRight</a></code>, <code><a href="sign.html">signum</a></code>, +<code><a href="sinh.html">sinh</a></code>, <code><a href="sin.html">sin</a></code>, +<code><a href="sqrt.html">sqrt</a></code>, <code><a href="tanh.html">tanh</a></code>, +<code><a href="tan.html">tan</a></code>, <code><a href="toDegrees.html">toDegrees</a></code>, +<code><a href="toRadians.html">toRadians</a></code>, <code><a href="unhex.html">unhex</a></code> +</p> + + +<h3>Examples</h3> + +<pre><code class="r">## Not run: +##D covar_pop(df$c, df$d) +##D covar_pop("c", "d") +## End(Not run) +</code></pre> + + +<hr /><div style="text-align: center;">[Package <em>SparkR</em> version 2.2.2 <a href="00Index.html">Index</a>]</div> +</body></html> http://git-wip-us.apache.org/repos/asf/spark-website/blob/e1001463/site/docs/2.2.2/api/R/crc32.html ---------------------------------------------------------------------- diff --git a/site/docs/2.2.2/api/R/crc32.html b/site/docs/2.2.2/api/R/crc32.html new file mode 100644 index 0000000..66c8b29 --- /dev/null +++ b/site/docs/2.2.2/api/R/crc32.html @@ -0,0 +1,63 @@ +<!DOCTYPE html PUBLIC "-//W3C//DTD XHTML 1.0 Strict//EN" "http://www.w3.org/TR/xhtml1/DTD/xhtml1-strict.dtd"><html xmlns="http://www.w3.org/1999/xhtml"><head><title>R: crc32</title> +<meta http-equiv="Content-Type" content="text/html; charset=utf-8" /> +<link rel="stylesheet" type="text/css" href="R.css" /> + +<link rel="stylesheet" href="https://cdnjs.cloudflare.com/ajax/libs/highlight.js/8.3/styles/github.min.css"> +<script src="https://cdnjs.cloudflare.com/ajax/libs/highlight.js/8.3/highlight.min.js"></script> +<script src="https://cdnjs.cloudflare.com/ajax/libs/highlight.js/8.3/languages/r.min.js"></script> +<script>hljs.initHighlightingOnLoad();</script> +</head><body> + +<table width="100%" summary="page for crc32 {SparkR}"><tr><td>crc32 {SparkR}</td><td style="text-align: right;">R Documentation</td></tr></table> + +<h2>crc32</h2> + +<h3>Description</h3> + +<p>Calculates the cyclic redundancy check value (CRC32) of a binary column and +returns the value as a bigint. +</p> + + +<h3>Usage</h3> + +<pre> +crc32(x) + +## S4 method for signature 'Column' +crc32(x) +</pre> + + +<h3>Arguments</h3> + +<table summary="R argblock"> +<tr valign="top"><td><code>x</code></td> +<td> +<p>Column to compute on.</p> +</td></tr> +</table> + + +<h3>Note</h3> + +<p>crc32 since 1.5.0 +</p> + + +<h3>See Also</h3> + +<p>Other misc_funcs: <code><a href="hash.html">hash</a></code>, <code><a href="md5.html">md5</a></code>, +<code><a href="monotonically_increasing_id.html">monotonically_increasing_id</a></code>, +<code><a href="sha1.html">sha1</a></code>, <code><a href="sha2.html">sha2</a></code> +</p> + + +<h3>Examples</h3> + +<pre><code class="r">## Not run: crc32(df$c) +</code></pre> + + +<hr /><div style="text-align: center;">[Package <em>SparkR</em> version 2.2.2 <a href="00Index.html">Index</a>]</div> +</body></html> http://git-wip-us.apache.org/repos/asf/spark-website/blob/e1001463/site/docs/2.2.2/api/R/createDataFrame.html ---------------------------------------------------------------------- diff --git a/site/docs/2.2.2/api/R/createDataFrame.html b/site/docs/2.2.2/api/R/createDataFrame.html new file mode 100644 index 0000000..7955bf0 --- /dev/null +++ b/site/docs/2.2.2/api/R/createDataFrame.html @@ -0,0 +1,90 @@ +<!DOCTYPE html PUBLIC "-//W3C//DTD XHTML 1.0 Strict//EN" "http://www.w3.org/TR/xhtml1/DTD/xhtml1-strict.dtd"><html xmlns="http://www.w3.org/1999/xhtml"><head><title>R: Create a SparkDataFrame</title> +<meta http-equiv="Content-Type" content="text/html; charset=utf-8" /> +<link rel="stylesheet" type="text/css" href="R.css" /> + +<link rel="stylesheet" href="https://cdnjs.cloudflare.com/ajax/libs/highlight.js/8.3/styles/github.min.css"> +<script src="https://cdnjs.cloudflare.com/ajax/libs/highlight.js/8.3/highlight.min.js"></script> +<script src="https://cdnjs.cloudflare.com/ajax/libs/highlight.js/8.3/languages/r.min.js"></script> +<script>hljs.initHighlightingOnLoad();</script> +</head><body> + +<table width="100%" summary="page for createDataFrame {SparkR}"><tr><td>createDataFrame {SparkR}</td><td style="text-align: right;">R Documentation</td></tr></table> + +<h2>Create a SparkDataFrame</h2> + +<h3>Description</h3> + +<p>Converts R data.frame or list into SparkDataFrame. +</p> + + +<h3>Usage</h3> + +<pre> +## Default S3 method: +createDataFrame(data, schema = NULL, samplingRatio = 1, + numPartitions = NULL) + +## Default S3 method: +as.DataFrame(data, schema = NULL, samplingRatio = 1, + numPartitions = NULL) + +as.DataFrame(data, ...) +</pre> + + +<h3>Arguments</h3> + +<table summary="R argblock"> +<tr valign="top"><td><code>data</code></td> +<td> +<p>a list or data.frame.</p> +</td></tr> +<tr valign="top"><td><code>schema</code></td> +<td> +<p>a list of column names or named list (StructType), optional.</p> +</td></tr> +<tr valign="top"><td><code>samplingRatio</code></td> +<td> +<p>Currently not used.</p> +</td></tr> +<tr valign="top"><td><code>numPartitions</code></td> +<td> +<p>the number of partitions of the SparkDataFrame. Defaults to 1, this is +limited by length of the list or number of rows of the data.frame</p> +</td></tr> +<tr valign="top"><td><code>...</code></td> +<td> +<p>additional argument(s).</p> +</td></tr> +</table> + + +<h3>Value</h3> + +<p>A SparkDataFrame. +</p> + + +<h3>Note</h3> + +<p>createDataFrame since 1.4.0 +</p> +<p>as.DataFrame since 1.6.0 +</p> + + +<h3>Examples</h3> + +<pre><code class="r">## Not run: +##D sparkR.session() +##D df1 <- as.DataFrame(iris) +##D df2 <- as.DataFrame(list(3,4,5,6)) +##D df3 <- createDataFrame(iris) +##D df4 <- createDataFrame(cars, numPartitions = 2) +## End(Not run) +</code></pre> + + +<hr /><div style="text-align: center;">[Package <em>SparkR</em> version 2.2.2 <a href="00Index.html">Index</a>]</div> +</body></html> http://git-wip-us.apache.org/repos/asf/spark-website/blob/e1001463/site/docs/2.2.2/api/R/createExternalTable-deprecated.html ---------------------------------------------------------------------- diff --git a/site/docs/2.2.2/api/R/createExternalTable-deprecated.html b/site/docs/2.2.2/api/R/createExternalTable-deprecated.html new file mode 100644 index 0000000..e7ca49d --- /dev/null +++ b/site/docs/2.2.2/api/R/createExternalTable-deprecated.html @@ -0,0 +1,93 @@ +<!DOCTYPE html PUBLIC "-//W3C//DTD XHTML 1.0 Strict//EN" "http://www.w3.org/TR/xhtml1/DTD/xhtml1-strict.dtd"><html xmlns="http://www.w3.org/1999/xhtml"><head><title>R: (Deprecated) Create an external table</title> +<meta http-equiv="Content-Type" content="text/html; charset=utf-8" /> +<link rel="stylesheet" type="text/css" href="R.css" /> + +<link rel="stylesheet" href="https://cdnjs.cloudflare.com/ajax/libs/highlight.js/8.3/styles/github.min.css"> +<script src="https://cdnjs.cloudflare.com/ajax/libs/highlight.js/8.3/highlight.min.js"></script> +<script src="https://cdnjs.cloudflare.com/ajax/libs/highlight.js/8.3/languages/r.min.js"></script> +<script>hljs.initHighlightingOnLoad();</script> +</head><body> + +<table width="100%" summary="page for createExternalTable {SparkR}"><tr><td>createExternalTable {SparkR}</td><td style="text-align: right;">R Documentation</td></tr></table> + +<h2>(Deprecated) Create an external table</h2> + +<h3>Description</h3> + +<p>Creates an external table based on the dataset in a data source, +Returns a SparkDataFrame associated with the external table. +</p> + + +<h3>Usage</h3> + +<pre> +## Default S3 method: +createExternalTable(tableName, path = NULL, source = NULL, + schema = NULL, ...) +</pre> + + +<h3>Arguments</h3> + +<table summary="R argblock"> +<tr valign="top"><td><code>tableName</code></td> +<td> +<p>a name of the table.</p> +</td></tr> +<tr valign="top"><td><code>path</code></td> +<td> +<p>the path of files to load.</p> +</td></tr> +<tr valign="top"><td><code>source</code></td> +<td> +<p>the name of external data source.</p> +</td></tr> +<tr valign="top"><td><code>schema</code></td> +<td> +<p>the schema of the data required for some data sources.</p> +</td></tr> +<tr valign="top"><td><code>...</code></td> +<td> +<p>additional argument(s) passed to the method.</p> +</td></tr> +</table> + + +<h3>Details</h3> + +<p>The data source is specified by the <code>source</code> and a set of options(...). +If <code>source</code> is not specified, the default data source configured by +"spark.sql.sources.default" will be used. +</p> + + +<h3>Value</h3> + +<p>A SparkDataFrame. +</p> + + +<h3>Note</h3> + +<p>createExternalTable since 1.4.0 +</p> + + +<h3>See Also</h3> + +<p><a href="createTable.html">createTable</a> +</p> + + +<h3>Examples</h3> + +<pre><code class="r">## Not run: +##D sparkR.session() +##D df <- createExternalTable("myjson", path="path/to/json", source="json", schema) +## End(Not run) +</code></pre> + + +<hr /><div style="text-align: center;">[Package <em>SparkR</em> version 2.2.2 <a href="00Index.html">Index</a>]</div> +</body></html> http://git-wip-us.apache.org/repos/asf/spark-website/blob/e1001463/site/docs/2.2.2/api/R/createOrReplaceTempView.html ---------------------------------------------------------------------- diff --git a/site/docs/2.2.2/api/R/createOrReplaceTempView.html b/site/docs/2.2.2/api/R/createOrReplaceTempView.html new file mode 100644 index 0000000..8af5764 --- /dev/null +++ b/site/docs/2.2.2/api/R/createOrReplaceTempView.html @@ -0,0 +1,108 @@ +<!DOCTYPE html PUBLIC "-//W3C//DTD XHTML 1.0 Strict//EN" "http://www.w3.org/TR/xhtml1/DTD/xhtml1-strict.dtd"><html xmlns="http://www.w3.org/1999/xhtml"><head><title>R: Creates a temporary view using the given name.</title> +<meta http-equiv="Content-Type" content="text/html; charset=utf-8" /> +<link rel="stylesheet" type="text/css" href="R.css" /> + +<link rel="stylesheet" href="https://cdnjs.cloudflare.com/ajax/libs/highlight.js/8.3/styles/github.min.css"> +<script src="https://cdnjs.cloudflare.com/ajax/libs/highlight.js/8.3/highlight.min.js"></script> +<script src="https://cdnjs.cloudflare.com/ajax/libs/highlight.js/8.3/languages/r.min.js"></script> +<script>hljs.initHighlightingOnLoad();</script> +</head><body> + +<table width="100%" summary="page for createOrReplaceTempView {SparkR}"><tr><td>createOrReplaceTempView {SparkR}</td><td style="text-align: right;">R Documentation</td></tr></table> + +<h2>Creates a temporary view using the given name.</h2> + +<h3>Description</h3> + +<p>Creates a new temporary view using a SparkDataFrame in the Spark Session. If a +temporary view with the same name already exists, replaces it. +</p> + + +<h3>Usage</h3> + +<pre> +createOrReplaceTempView(x, viewName) + +## S4 method for signature 'SparkDataFrame,character' +createOrReplaceTempView(x, viewName) +</pre> + + +<h3>Arguments</h3> + +<table summary="R argblock"> +<tr valign="top"><td><code>x</code></td> +<td> +<p>A SparkDataFrame</p> +</td></tr> +<tr valign="top"><td><code>viewName</code></td> +<td> +<p>A character vector containing the name of the table</p> +</td></tr> +</table> + + +<h3>Note</h3> + +<p>createOrReplaceTempView since 2.0.0 +</p> + + +<h3>See Also</h3> + +<p>Other SparkDataFrame functions: <code><a href="SparkDataFrame.html">SparkDataFrame-class</a></code>, +<code><a href="summarize.html">agg</a></code>, <code><a href="arrange.html">arrange</a></code>, +<code><a href="as.data.frame.html">as.data.frame</a></code>, +<code><a href="attach.html">attach,SparkDataFrame-method</a></code>, +<code><a href="cache.html">cache</a></code>, <code><a href="checkpoint.html">checkpoint</a></code>, +<code><a href="coalesce.html">coalesce</a></code>, <code><a href="collect.html">collect</a></code>, +<code><a href="columns.html">colnames</a></code>, <code><a href="coltypes.html">coltypes</a></code>, +<code><a href="crossJoin.html">crossJoin</a></code>, <code><a href="dapplyCollect.html">dapplyCollect</a></code>, +<code><a href="dapply.html">dapply</a></code>, <code><a href="summary.html">describe</a></code>, +<code><a href="dim.html">dim</a></code>, <code><a href="distinct.html">distinct</a></code>, +<code><a href="dropDuplicates.html">dropDuplicates</a></code>, <code><a href="nafunctions.html">dropna</a></code>, +<code><a href="drop.html">drop</a></code>, <code><a href="dtypes.html">dtypes</a></code>, +<code><a href="except.html">except</a></code>, <code><a href="explain.html">explain</a></code>, +<code><a href="filter.html">filter</a></code>, <code><a href="first.html">first</a></code>, +<code><a href="gapplyCollect.html">gapplyCollect</a></code>, <code><a href="gapply.html">gapply</a></code>, +<code><a href="getNumPartitions.html">getNumPartitions</a></code>, <code><a href="groupBy.html">group_by</a></code>, +<code><a href="head.html">head</a></code>, <code><a href="hint.html">hint</a></code>, +<code><a href="histogram.html">histogram</a></code>, <code><a href="insertInto.html">insertInto</a></code>, +<code><a href="intersect.html">intersect</a></code>, <code><a href="isLocal.html">isLocal</a></code>, +<code><a href="isStreaming.html">isStreaming</a></code>, <code><a href="join.html">join</a></code>, +<code><a href="limit.html">limit</a></code>, <code><a href="merge.html">merge</a></code>, +<code><a href="mutate.html">mutate</a></code>, <code><a href="ncol.html">ncol</a></code>, +<code><a href="nrow.html">nrow</a></code>, <code><a href="persist.html">persist</a></code>, +<code><a href="printSchema.html">printSchema</a></code>, <code><a href="randomSplit.html">randomSplit</a></code>, +<code><a href="rbind.html">rbind</a></code>, <code><a href="registerTempTable-deprecated.html">registerTempTable</a></code>, +<code><a href="rename.html">rename</a></code>, <code><a href="repartition.html">repartition</a></code>, +<code><a href="sample.html">sample</a></code>, <code><a href="saveAsTable.html">saveAsTable</a></code>, +<code><a href="schema.html">schema</a></code>, <code><a href="selectExpr.html">selectExpr</a></code>, +<code><a href="select.html">select</a></code>, <code><a href="showDF.html">showDF</a></code>, +<code><a href="show.html">show</a></code>, <code><a href="storageLevel.html">storageLevel</a></code>, +<code><a href="str.html">str</a></code>, <code><a href="subset.html">subset</a></code>, +<code><a href="take.html">take</a></code>, <code><a href="toJSON.html">toJSON</a></code>, +<code><a href="union.html">union</a></code>, <code><a href="unpersist.html">unpersist</a></code>, +<code><a href="withColumn.html">withColumn</a></code>, <code><a href="with.html">with</a></code>, +<code><a href="write.df.html">write.df</a></code>, <code><a href="write.jdbc.html">write.jdbc</a></code>, +<code><a href="write.json.html">write.json</a></code>, <code><a href="write.orc.html">write.orc</a></code>, +<code><a href="write.parquet.html">write.parquet</a></code>, <code><a href="write.stream.html">write.stream</a></code>, +<code><a href="write.text.html">write.text</a></code> +</p> + + +<h3>Examples</h3> + +<pre><code class="r">## Not run: +##D sparkR.session() +##D path <- "path/to/file.json" +##D df <- read.json(path) +##D createOrReplaceTempView(df, "json_df") +##D new_df <- sql("SELECT * FROM json_df") +## End(Not run) +</code></pre> + + +<hr /><div style="text-align: center;">[Package <em>SparkR</em> version 2.2.2 <a href="00Index.html">Index</a>]</div> +</body></html> http://git-wip-us.apache.org/repos/asf/spark-website/blob/e1001463/site/docs/2.2.2/api/R/createTable.html ---------------------------------------------------------------------- diff --git a/site/docs/2.2.2/api/R/createTable.html b/site/docs/2.2.2/api/R/createTable.html new file mode 100644 index 0000000..7c0594b --- /dev/null +++ b/site/docs/2.2.2/api/R/createTable.html @@ -0,0 +1,96 @@ +<!DOCTYPE html PUBLIC "-//W3C//DTD XHTML 1.0 Strict//EN" "http://www.w3.org/TR/xhtml1/DTD/xhtml1-strict.dtd"><html xmlns="http://www.w3.org/1999/xhtml"><head><title>R: Creates a table based on the dataset in a data source</title> +<meta http-equiv="Content-Type" content="text/html; charset=utf-8" /> +<link rel="stylesheet" type="text/css" href="R.css" /> + +<link rel="stylesheet" href="https://cdnjs.cloudflare.com/ajax/libs/highlight.js/8.3/styles/github.min.css"> +<script src="https://cdnjs.cloudflare.com/ajax/libs/highlight.js/8.3/highlight.min.js"></script> +<script src="https://cdnjs.cloudflare.com/ajax/libs/highlight.js/8.3/languages/r.min.js"></script> +<script>hljs.initHighlightingOnLoad();</script> +</head><body> + +<table width="100%" summary="page for createTable {SparkR}"><tr><td>createTable {SparkR}</td><td style="text-align: right;">R Documentation</td></tr></table> + +<h2>Creates a table based on the dataset in a data source</h2> + +<h3>Description</h3> + +<p>Creates a table based on the dataset in a data source. Returns a SparkDataFrame associated with +the table. +</p> + + +<h3>Usage</h3> + +<pre> +createTable(tableName, path = NULL, source = NULL, schema = NULL, ...) +</pre> + + +<h3>Arguments</h3> + +<table summary="R argblock"> +<tr valign="top"><td><code>tableName</code></td> +<td> +<p>the qualified or unqualified name that designates a table. If no database +identifier is provided, it refers to a table in the current database.</p> +</td></tr> +<tr valign="top"><td><code>path</code></td> +<td> +<p>(optional) the path of files to load.</p> +</td></tr> +<tr valign="top"><td><code>source</code></td> +<td> +<p>(optional) the name of the data source.</p> +</td></tr> +<tr valign="top"><td><code>schema</code></td> +<td> +<p>(optional) the schema of the data required for some data sources.</p> +</td></tr> +<tr valign="top"><td><code>...</code></td> +<td> +<p>additional named parameters as options for the data source.</p> +</td></tr> +</table> + + +<h3>Details</h3> + +<p>The data source is specified by the <code>source</code> and a set of options(...). +If <code>source</code> is not specified, the default data source configured by +"spark.sql.sources.default" will be used. When a <code>path</code> is specified, an external table is +created from the data at the given path. Otherwise a managed table is created. +</p> + + +<h3>Value</h3> + +<p>A SparkDataFrame. +</p> + + +<h3>Note</h3> + +<p>createTable since 2.2.0 +</p> + + +<h3>See Also</h3> + +<p><a href="createExternalTable-deprecated.html">createExternalTable</a> +</p> + + +<h3>Examples</h3> + +<pre><code class="r">## Not run: +##D sparkR.session() +##D df <- createTable("myjson", path="path/to/json", source="json", schema) +##D +##D createTable("people", source = "json", schema = schema) +##D insertInto(df, "people") +## End(Not run) +</code></pre> + + +<hr /><div style="text-align: center;">[Package <em>SparkR</em> version 2.2.2 <a href="00Index.html">Index</a>]</div> +</body></html> --------------------------------------------------------------------- To unsubscribe, e-mail: commits-unsubscr...@spark.apache.org For additional commands, e-mail: commits-h...@spark.apache.org