Repository: spark
Updated Branches:
refs/heads/master ffaf0f9fd -> d1eb8d3dd
[SPARK-24094][SS][MINOR] Change description strings of v2 streaming sources to
reflect the change
## What changes were proposed in this pull request?
This makes it easy to understand at runtime which version is runn
Repository: spark
Updated Branches:
refs/heads/master cd10f9df8 -> ffaf0f9fd
[SPARK-24062][THRIFT SERVER] Fix SASL encryption cannot enabled issue in thrift
server
## What changes were proposed in this pull request?
For the details of the exception please see
[SPARK-24062](https://issues.ap
Repository: spark
Updated Branches:
refs/heads/branch-2.3 096defdd7 -> 07ec75ca0
[SPARK-24062][THRIFT SERVER] Fix SASL encryption cannot enabled issue in thrift
server
## What changes were proposed in this pull request?
For the details of the exception please see
[SPARK-24062](https://issue
Repository: spark
Updated Branches:
refs/heads/master 58c55cb4a -> cd10f9df8
[SPARK-23916][SQL] Add array_join function
## What changes were proposed in this pull request?
The PR adds the SQL function `array_join`. The behavior of the function is
based on Presto's one.
The function accepts
Repository: spark
Updated Branches:
refs/heads/master 3f1e999d3 -> 58c55cb4a
[SPARK-23902][SQL] Add roundOff flag to months_between
## What changes were proposed in this pull request?
HIVE-15511 introduced the `roundOff` flag in order to disable the rounding to 8
digits which is performed in
Author: pwendell
Date: Thu Apr 26 03:15:06 2018
New Revision: 26546
Log:
Apache Spark 2.4.0-SNAPSHOT-2018_04_25_20_01-3f1e999 docs
[This commit notification would consist of 1460 parts,
which exceeds the limit of 50 ones, so it was shortened to the summary.]
---
Repository: spark
Updated Branches:
refs/heads/master 95a651339 -> 3f1e999d3
[SPARK-23849][SQL] Tests for samplingRatio of json datasource
## What changes were proposed in this pull request?
Added the `samplingRatio` option to the `json()` method of PySpark DataFrame
Reader. Improving existi
Repository: spark
Updated Branches:
refs/heads/master ac4ca7c4d -> 95a651339
[SPARK-24069][R] Add array_min / array_max functions
## What changes were proposed in this pull request?
This PR proposes to add array_max and array_min in R side too.
array_max:
```r
df <- createDataFrame(cbind(mo
Author: pwendell
Date: Wed Apr 25 23:16:08 2018
New Revision: 26545
Log:
Apache Spark 2.4.0-SNAPSHOT-2018_04_25_16_01-ac4ca7c docs
[This commit notification would consist of 1460 parts,
which exceeds the limit of 50 ones, so it was shortened to the summary.]
---
Repository: spark
Updated Branches:
refs/heads/master 396938ef0 -> ac4ca7c4d
[SPARK-24012][SQL][TEST][FOLLOWUP] add unit test
## What changes were proposed in this pull request?
a followup of https://github.com/apache/spark/pull/21100
## How was this patch tested?
N/A
Author: Wenchen Fan
Repository: spark
Updated Branches:
refs/heads/master 20ca208bc -> 396938ef0
[SPARK-24050][SS] Calculate input / processing rates correctly for DataSourceV2
streaming sources
## What changes were proposed in this pull request?
In some streaming queries, the input and processing rates are not
Author: pwendell
Date: Wed Apr 25 15:18:19 2018
New Revision: 26533
Log:
Apache Spark 2.4.0-SNAPSHOT-2018_04_25_08_01-20ca208 docs
[This commit notification would consist of 1460 parts,
which exceeds the limit of 50 ones, so it was shortened to the summary.]
---
Author: pwendell
Date: Wed Apr 25 11:22:12 2018
New Revision: 26529
Log:
Apache Spark 2.4.0-SNAPSHOT-2018_04_25_04_03-64e8408 docs
[This commit notification would consist of 1460 parts,
which exceeds the limit of 50 ones, so it was shortened to the summary.]
---
Repository: spark
Updated Branches:
refs/heads/master 64e8408e6 -> 20ca208bc
[SPARK-23880][SQL] Do not trigger any jobs for caching data
## What changes were proposed in this pull request?
This pr fixed code so that `cache` could prevent any jobs from being triggered.
For example, in the curre
Repository: spark
Updated Branches:
refs/heads/master 5fea17b3b -> 64e8408e6
[SPARK-24012][SQL] Union of map and other compatible column
## What changes were proposed in this pull request?
Union of map and other compatible column result in unresolved operator 'Union;
exception
Reproduction
`
15 matches
Mail list logo
