Repository: spark
Updated Branches:
refs/heads/branch-2.2 3cad66e5e -> 3686c2e96
[SPARK-20790][MLLIB] Correctly handle negative values for implicit feedback in
ALS
## What changes were proposed in this pull request?
Revert the handling of negative values in ALS with implicit feedback, so tha
Repository: spark
Updated Branches:
refs/heads/master beed5e20a -> d52f63622
[SPARK-20790][MLLIB] Correctly handle negative values for implicit feedback in
ALS
## What changes were proposed in this pull request?
Revert the handling of negative values in ALS with implicit feedback, so that
t
Repository: spark
Updated Branches:
refs/heads/master 6d05c1c1d -> 0975019cd
[SPARK-20109][MLLIB] Rewrote toBlockMatrix method on IndexedRowMatrix
## What changes were proposed in this pull request?
- ~~I added the method `toBlockMatrixDense` to the IndexedRowMatrix class. The
current implem
Repository: spark-website
Updated Branches:
refs/heads/asf-site 80f50ecca -> 004856aaa
Fix wrong user list email address
Project: http://git-wip-us.apache.org/repos/asf/spark-website/repo
Commit: http://git-wip-us.apache.org/repos/asf/spark-website/commit/004856aa
Tree: http://git-wip-us.apac
Repository: spark
Updated Branches:
refs/heads/master 2134196a9 -> 0e31e28d4
[MINOR][PYTHON] Ignore pep8 on test scripts generated in tests in work directory
## What changes were proposed in this pull request?
Currently, if we run `./python/run-tests.py` and they are aborted without
cleaning
Repository: spark
Updated Branches:
refs/heads/master 0e31e28d4 -> 625cebfde
[SPARK-20942][WEB-UI] The title style about field is error in the history
server web ui.
## What changes were proposed in this pull request?
1.The title style about field is error.
fix before:
 === after)` to check
Repository: spark
Updated Branches:
refs/heads/master 887cf0ec3 -> c70c38eb9
[DOCS] Fix a typo in Encoder.clsTag
## What changes were proposed in this pull request?
Fixes a typo: `and` -> `an`
## How was this patch tested?
Not at all.
Author: Wieland Hoffmann
Closes #17759 from mineo/pat
Repository: spark
Updated Branches:
refs/heads/master dec9aa3b3 -> 2d39711b0
[SPARK-20945] Fix TID key not found in TaskSchedulerImpl
## What changes were proposed in this pull request?
This pull request fix the TaskScheulerImpl bug in some condition.
Detail see:
https://issues.apache.org/jir
Repository: spark
Updated Branches:
refs/heads/master 2d39711b0 -> 98b5ccd32
[SPARK-20930][ML] Destroy broadcasted centers after computing cost in KMeans
## What changes were proposed in this pull request?
Destroy broadcasted centers after computing cost
## How was this patch tested?
existing
Repository: spark
Updated Branches:
refs/heads/master 98b5ccd32 -> 1665b5f72
[SPARK-19762][ML] Hierarchy for consolidating ML aggregator/loss code
## What changes were proposed in this pull request?
JIRA: [SPARK-19762](https://issues.apache.org/jira/browse/SPARK-19762)
The larger changes in
Repository: spark
Updated Branches:
refs/heads/master 88a23d3de -> 44de108d7
[SPARK-20985] Stop SparkContext using LocalSparkContext.withSpark
## What changes were proposed in this pull request?
SparkContext should always be stopped after using, thus other tests won't
complain that there's on
Repository: spark
Updated Branches:
refs/heads/master cb83ca143 -> 3218505a0
[MINOR][DOC] Update deprecation notes on Python/Hadoop/Scala.
## What changes were proposed in this pull request?
We had better update the deprecation notes about Python 2.6, Hadoop (before
2.6.5) and Scala 2.10 in
Repository: spark
Updated Branches:
refs/heads/branch-2.2 3f93d076b -> 9a4341b83
[MINOR][DOC] Update deprecation notes on Python/Hadoop/Scala.
## What changes were proposed in this pull request?
We had better update the deprecation notes about Python 2.6, Hadoop (before
2.6.5) and Scala 2.10
Repository: spark
Updated Branches:
refs/heads/master 3218505a0 -> 0ca69c4cc
[SPARK-20966][WEB-UI][SQL] Table data is not sorted by startTime time desc,
time is not formatted and redundant code in JDBC/ODBC Server page.
## What changes were proposed in this pull request?
1. Question 1 : Tabl
h tested?
Existing compilation/test
Author: Sean Owen
Closes #18215 from srowen/SPARK-20914.
Project: http://git-wip-us.apache.org/repos/asf/spark/repo
Commit: http://git-wip-us.apache.org/repos/asf/spark/commit/847efe12
Tree: http://git-wip-us.apache.org/repos/asf/spark/tree/847efe12
Diff: http:/
h tested?
Existing compilation/test
Author: Sean Owen
Closes #18215 from srowen/SPARK-20914.
(cherry picked from commit 847efe12656756f9ad6a4dc14bd183ac1a0760a6)
Signed-off-by: Sean Owen
Project: http://git-wip-us.apache.org/repos/asf/spark/repo
Commit: http://git-wip-us.apache.org/repos/a
h tested?
Existing compilation/test
Author: Sean Owen
Closes #18215 from srowen/SPARK-20914.
(cherry picked from commit 847efe12656756f9ad6a4dc14bd183ac1a0760a6)
Signed-off-by: Sean Owen
Project: http://git-wip-us.apache.org/repos/asf/spark/repo
Commit: http://git-wip-us.apache.org/repos/a
Repository: spark
Updated Branches:
refs/heads/master 847efe126 -> 9be794586
[SPARK-21006][TESTS] Create rpcEnv and run later needs shutdown and
awaitTermination
Signed-off-by: 10087686
## What changes were proposed in this pull request?
When run test("port conflict") case, we need run ano
Repository: spark
Updated Branches:
refs/heads/master 9be794586 -> b771fed73
[INFRA] Close stale PRs
# What changes were proposed in this pull request?
This PR proposes to close stale PRs, mostly the same instances with
https://github.com/apache/spark/pull/18017
Closes #11459
Closes #13833
Repository: spark
Updated Branches:
refs/heads/master 2a23cdd07 -> 5a3371883
[SPARK-14408][CORE] Changed RDD.treeAggregate to use fold instead of reduce
## What changes were proposed in this pull request?
Previously, `RDD.treeAggregate` used `reduceByKey` and `reduce` in its
implementation,
Repository: spark
Updated Branches:
refs/heads/master 5a3371883 -> bdcd6e4c6
[SPARK-20995][CORE] Spark-env.sh.template' should add 'YARN_CONF_DIR'
configuration instructions.
## What changes were proposed in this pull request?
Ensure that `HADOOP_CONF_DIR` or `YARN_CONF_DIR` points to the di
Repository: spark
Updated Branches:
refs/heads/master bdcd6e4c6 -> 033839559
Fixed broken link
## What changes were proposed in this pull request?
I fixed some incorrect formatting on a link in the docs
## How was this patch tested?
I looked at the markdown preview before and after, and the
Repository: spark
Updated Branches:
refs/heads/branch-2.2 3f6812cf8 -> 714153c79
Fixed broken link
## What changes were proposed in this pull request?
I fixed some incorrect formatting on a link in the docs
## How was this patch tested?
I looked at the markdown preview before and after, and
Repository: spark
Updated Branches:
refs/heads/master 033839559 -> 6491cbf06
Fix bug in JavaRegressionMetricsExample.
the original code cant visit the last element of the"parts" array.
so the v[v.lengthâ1] always equals 0
## What changes were proposed in this pull request?
change the recycl
Repository: spark
Updated Branches:
refs/heads/branch-2.2 714153c79 -> 869af5bcb
Fix bug in JavaRegressionMetricsExample.
the original code cant visit the last element of the"parts" array.
so the v[v.lengthâ1] always equals 0
## What changes were proposed in this pull request?
change the re
Break out security info into dedicated page, to match other ASF projects who
list security information
Project: http://git-wip-us.apache.org/repos/asf/spark-website/repo
Commit: http://git-wip-us.apache.org/repos/asf/spark-website/commit/fda1364c
Tree: http://git-wip-us.apache.org/repos/asf/spar
Repository: spark-website
Updated Branches:
refs/heads/asf-site 004856aaa -> fda1364c8
http://git-wip-us.apache.org/repos/asf/spark-website/blob/fda1364c/site/releases/spark-release-1-0-1.html
--
diff --git a/site/releases/spar
Repository: spark
Updated Branches:
refs/heads/master 6491cbf06 -> 82faacd79
[SPARK-20997][CORE] driver-cores' standalone or Mesos or YARN in Cluster deploy
mode only.
## What changes were proposed in this pull request?
'--driver-cores' standalone or Mesos or YARN in Cluster deploy mode onl
Repository: spark
Updated Branches:
refs/heads/master dc4c35183 -> 8da3f7041
[SPARK-21000][MESOS] Add Mesos labels support to the Spark Dispatcher
## What changes were proposed in this pull request?
Add Mesos labels support to the Spark Dispatcher
## How was this patch tested?
unit tests
A
Repository: spark
Updated Branches:
refs/heads/master 8da3f7041 -> eb3ea3a08
[SPARK-20935][STREAMING] Always close WriteAheadLog and make it idempotent
## What changes were proposed in this pull request?
This PR proposes to stop `ReceiverTracker` to close `WriteAheadLog` whenever it
is and m
Repository: spark
Updated Branches:
refs/heads/master eb3ea3a08 -> 823f1eef5
[SPARK-13933][BUILD] Update hadoop-2.7 profile's curator version to 2.7.1
## What changes were proposed in this pull request?
Update hadoop-2.7 profile's curator version to 2.7.1, more see
[SPARK-13933](https://issu
Repository: spark
Updated Branches:
refs/heads/master 9f4ff9552 -> 3a840048e
Fixed typo in sql.functions
## What changes were proposed in this pull request?
I fixed a typo in the Scaladoc for the method `def struct(cols: Column*):
Column`. 'retained' was misspelt as 'remained'.
## How was t
Repository: spark
Updated Branches:
refs/heads/master d14091809 -> e6eb02df1
[DOCS] Fix error: ambiguous reference to overloaded definition
## What changes were proposed in this pull request?
`df.groupBy.count()` should be `df.groupBy().count()` , otherwise there is an
error :
ambiguous ref
Repository: spark
Updated Branches:
refs/heads/branch-2.2 26003de55 -> a4d78e4b3
[DOCS] Fix error: ambiguous reference to overloaded definition
## What changes were proposed in this pull request?
`df.groupBy.count()` should be `df.groupBy().count()` , otherwise there is an
error :
ambiguous
ing from AlterTableRecoverPartitionsCommand DDL
command
## How was this patch tested?
Existing tests.
Author: Sean Owen
Closes #18216 from srowen/SPARK-20920.
(cherry picked from commit 7b7c85ede398996aafffb126440e5f0c67f67210)
Signed-off-by: Sean Owen
Project: http://git-wip-us.apache.org/repos/asf/spark/repo
Comm
ing from AlterTableRecoverPartitionsCommand DDL
command
## How was this patch tested?
Existing tests.
Author: Sean Owen
Closes #18216 from srowen/SPARK-20920.
Project: http://git-wip-us.apache.org/repos/asf/spark/repo
Commit: http://git-wip-us.apache.org/repos/asf/spark/commit/7b7c85ed
Tree: http://git-wip-us.apache.org/r
ing from AlterTableRecoverPartitionsCommand DDL
command
## How was this patch tested?
Existing tests.
Author: Sean Owen
Closes #18216 from srowen/SPARK-20920.
(cherry picked from commit 7b7c85ede398996aafffb126440e5f0c67f67210)
Signed-off-by: Sean Owen
Project: http://git-wip-us.apache.org/repos/asf/spark/repo
Comm
Repository: spark
Updated Branches:
refs/heads/master 7b7c85ede -> 2aaed0a4d
[SPARK-21006][TESTS][FOLLOW-UP] Some Worker's RpcEnv is leaked in WorkerSuite
## What changes were proposed in this pull request?
Create rpcEnv and run later needs shutdown. as #18226
## How was this patch tested?
u
Repository: spark
Updated Branches:
refs/heads/master 2aaed0a4d -> 9b2c877be
[SPARK-21039][SPARK CORE] Use treeAggregate instead of aggregate in
DataFrame.stat.bloomFilter
## What changes were proposed in this pull request?
To use treeAggregate instead of aggregate in DataFrame.stat.bloomFilt
Repository: spark
Updated Branches:
refs/heads/branch-2.2 24836be54 -> 039c46506
[SPARK-21060][WEB-UI] Css style about paging function is error in the executor
page. Css style about paging function is error in the executor page. It is
different of history server ui paging function css style.
Repository: spark
Updated Branches:
refs/heads/master 9b2c877be -> b7304f255
[SPARK-21060][WEB-UI] Css style about paging function is error in the executor
page. Css style about paging function is error in the executor page. It is
different of history server ui paging function css style.
##
Repository: spark
Updated Branches:
refs/heads/master b7304f255 -> b36ce2a24
[SPARK-21064][CORE][TEST] Fix the default value bug in
NettyBlockTransferServiceSuite
## What changes were proposed in this pull request?
The default value for `spark.port.maxRetries` is 100,
but we use 10 in the su
Repository: spark
Updated Branches:
refs/heads/branch-2.2 039c46506 -> 2bc2c1539
[SPARK-21064][CORE][TEST] Fix the default value bug in
NettyBlockTransferServiceSuite
## What changes were proposed in this pull request?
The default value for `spark.port.maxRetries` is 100,
but we use 10 in th
Repository: spark
Updated Branches:
refs/heads/branch-2.1 58a8a379d -> ee0e74e65
[SPARK-21064][CORE][TEST] Fix the default value bug in
NettyBlockTransferServiceSuite
## What changes were proposed in this pull request?
The default value for `spark.port.maxRetries` is 100,
but we use 10 in th
sts.
Author: Sean Owen
Closes #18276 from srowen/SPARK-21057.
Project: http://git-wip-us.apache.org/repos/asf/spark/repo
Commit: http://git-wip-us.apache.org/repos/asf/spark/commit/d6f76eb3
Tree: http://git-wip-us.apache.org/repos/asf/spark/tree/d6f76eb3
Diff: http://git-wip-us.apache.org/re
Repository: spark
Updated Branches:
refs/heads/master 2837b14cd -> 45824fb60
[MINOR][DOCS] Improve Running R Tests docs
## What changes were proposed in this pull request?
Update Running R Tests dependence packages to:
```bash
R -e "install.packages(c('knitr', 'rmarkdown', 'testthat', 'e1071'
Repository: spark
Updated Branches:
refs/heads/branch-2.2 653e6f128 -> d3deeb35b
[MINOR][DOCS] Improve Running R Tests docs
## What changes were proposed in this pull request?
Update Running R Tests dependence packages to:
```bash
R -e "install.packages(c('knitr', 'rmarkdown', 'testthat', 'e1
Repository: spark
Updated Branches:
refs/heads/master edcb878e2 -> 0d8604bb8
[SPARK-21126] The configuration which named
"spark.core.connection.auth.wait.timeout" hasn't been used in spark
[https://issues.apache.org/jira/browse/SPARK-21126](https://issues.apache.org/jira/browse/SPARK-21126)
T
Repository: spark
Updated Branches:
refs/heads/branch-2.2 d3deeb35b -> 8747f8ef0
[SPARK-21126] The configuration which named
"spark.core.connection.auth.wait.timeout" hasn't been used in spark
[https://issues.apache.org/jira/browse/SPARK-21126](https://issues.apache.org/jira/browse/SPARK-2112
Repository: spark
Updated Branches:
refs/heads/branch-2.2 8747f8ef0 -> c0d4acce5
[MINOR][R] Add knitr and rmarkdown packages/improve output for version info in
AppVeyor tests
## What changes were proposed in this pull request?
This PR proposes three things as below:
**Install packages per d
Repository: spark
Updated Branches:
refs/heads/master 0d8604bb8 -> 75a6d0585
[MINOR][R] Add knitr and rmarkdown packages/improve output for version info in
AppVeyor tests
## What changes were proposed in this pull request?
This PR proposes three things as below:
**Install packages per docum
Repository: spark
Updated Branches:
refs/heads/master 9413b84b5 -> 9a145fd79
[MINOR] Bump SparkR and PySpark version to 2.3.0.
## What changes were proposed in this pull request?
#17753 bumps master branch version to 2.3.0-SNAPSHOT, but it seems SparkR and
PySpark version were omitted.
ditt
Repository: spark
Updated Branches:
refs/heads/master e5387018e -> ecc563135
[MINOR][BUILD] Fix Java linter errors
## What changes were proposed in this pull request?
This PR cleans up a few Java linter errors for Apache Spark 2.2 release.
## How was this patch tested?
```bash
$ dev/lint-ja
Repository: spark
Updated Branches:
refs/heads/branch-2.2 7b50736c4 -> e329beaff
[MINOR][BUILD] Fix Java linter errors
This PR cleans up a few Java linter errors for Apache Spark 2.2 release.
```bash
$ dev/lint-java
Using `mvn` from path: /usr/local/bin/mvn
Checkstyle checks passed.
```
We c
Repository: spark
Updated Branches:
refs/heads/master ecc563135 -> 0a4b7e4f8
[MINOR] Fix some typo of the document
## What changes were proposed in this pull request?
Fix some typo of the document.
## How was this patch tested?
Existing tests.
Please review http://spark.apache.org/contribu
Repository: spark-website
Updated Branches:
refs/heads/asf-site fda1364c8 -> 2c375dc4f
Add .DS_Store in .gitignore
Project: http://git-wip-us.apache.org/repos/asf/spark-website/repo
Commit: http://git-wip-us.apache.org/repos/asf/spark-website/commit/2c375dc4
Tree: http://git-wip-us.apache.org
Repository: spark-website
Updated Branches:
refs/heads/asf-site 2c375dc4f -> af0b9fba2
Add a note for searching PySpark and SparkR version changes in
release-process.md
Project: http://git-wip-us.apache.org/repos/asf/spark-website/repo
Commit: http://git-wip-us.apache.org/repos/asf/spark-web
Repository: spark
Updated Branches:
refs/heads/master d107b3b91 -> 987eb8fad
[MINOR][DOCS] Add lost tag for configuration.md
## What changes were proposed in this pull request?
Add lost `` tag for `configuration.md`.
## How was this patch tested?
N/A
Author: Yuming Wang
Closes #18372 fro
Repository: spark
Updated Branches:
refs/heads/branch-2.2 e88349873 -> 529c04f01
[MINOR][DOCS] Add lost tag for configuration.md
## What changes were proposed in this pull request?
Add lost `` tag for `configuration.md`.
## How was this patch tested?
N/A
Author: Yuming Wang
Closes #18372
Repository: spark
Updated Branches:
refs/heads/master 987eb8fad -> e92befcb4
[MINOR][DOC] modified issue link and updated status
## What changes were proposed in this pull request?
This PR aims to clarify some outdated comments that i found at
**spark-catalyst** and **spark-sql** pom files.
Repository: spark
Updated Branches:
refs/heads/branch-2.2 6ef7a5bd3 -> d62573471
[SQL][DOC] Fix documentation of lpad
## What changes were proposed in this pull request?
Fix incomplete documentation for `lpad`.
Author: actuaryzhang
Closes #18367 from actuaryzhang/SQLDoc.
(cherry picked fro
Repository: spark
Updated Branches:
refs/heads/master 67c75021c -> 97b307c87
[SQL][DOC] Fix documentation of lpad
## What changes were proposed in this pull request?
Fix incomplete documentation for `lpad`.
Author: actuaryzhang
Closes #18367 from actuaryzhang/SQLDoc.
Project: http://git-w
Repository: spark
Updated Branches:
refs/heads/master bfd73a7c4 -> 7c7bc8fc0
[SPARK-21189][INFRA] Handle unknown error codes in Jenkins rather then leaving
incomplete comment in PRs
## What changes were proposed in this pull request?
Recently, Jenkins tests were unstable due to unknown reaso
Repository: spark
Updated Branches:
refs/heads/master b449a1d6a -> 884347e1f
[HOT FIX] fix stats functions in the recent patch
## What changes were proposed in this pull request?
Builds failed due to the recent
[merge](https://github.com/apache/spark/commit/b449a1d6aa322a50cf221cd7a2ae85a91d
Repository: spark-website
Updated Branches:
refs/heads/asf-site 15e7ae4fc -> 9749c8e2f
jekyll build
Project: http://git-wip-us.apache.org/repos/asf/spark-website/repo
Commit: http://git-wip-us.apache.org/repos/asf/spark-website/commit/9749c8e2
Tree: http://git-wip-us.apache.org/repos/asf/spar
Repository: spark-website
Updated Branches:
refs/heads/asf-site af0b9fba2 -> 15e7ae4fc
fix hardcoded jira issue in link to SPIPs
Project: http://git-wip-us.apache.org/repos/asf/spark-website/repo
Commit: http://git-wip-us.apache.org/repos/asf/spark-website/commit/15e7ae4f
Tree: http://git-wip
Repository: spark
Updated Branches:
refs/heads/master 3cb3ccce1 -> b32bd005e
[INFRA] Close stale PRs
## What changes were proposed in this pull request?
This PR proposes to close stale PRs, mostly the same instances with
https://github.com/apache/spark/pull/18017
I believe the author in #14
Repository: spark
Updated Branches:
refs/heads/branch-2.2 970f68c05 -> 17a04b900
[SPARK-21210][DOC][ML] Javadoc 8 fixes for ML shared param traits
PR #15999 included fixes for doc strings in the ML shared param traits
(occurrences of `>` and `>=`).
This PR simply uses the HTML-escaped versio
Repository: spark
Updated Branches:
refs/heads/master a2d562354 -> 70085e83d
[SPARK-21210][DOC][ML] Javadoc 8 fixes for ML shared param traits
PR #15999 included fixes for doc strings in the ML shared param traits
(occurrences of `>` and `>=`).
This PR simply uses the HTML-escaped version of
Repository: spark
Updated Branches:
refs/heads/master 70085e83d -> d106a74c5
[SPARK-21240] Fix code style for constructing and stopping a SparkContext in UT.
## What changes were proposed in this pull request?
Same with SPARK-20985.
Fix code style for constructing and stopping a `SparkContext
Repository: spark
Updated Branches:
refs/heads/master d106a74c5 -> d7da2b94d
[SPARK-21135][WEB UI] On history server pageï¼duration of incompleted
applications should be hidden instead of showing up as 0
## What changes were proposed in this pull request?
Hide duration of incompleted applic
Repository: spark
Updated Branches:
refs/heads/master 528c9281a -> 1fe08d62f
[SPARK-21223] Change fileToAppInfo in FsHistoryProvider to fix concurrent issue.
# What issue does this PR address ?
Jira:https://issues.apache.org/jira/browse/SPARK-21223
fix the Thread-safety issue in FsHistoryProvi
Repository: spark
Updated Branches:
refs/heads/master e0b047eaf -> 6beca9ce9
[SPARK-21170][CORE] Utils.tryWithSafeFinallyAndFailureCallbacks throws
IllegalArgumentException: Self-suppression not permitted
## What changes were proposed in this pull request?
Not adding the exception to the sup
Repository: spark
Updated Branches:
refs/heads/branch-2.2 85fddf406 -> 6fd39ea1c
[SPARK-21170][CORE] Utils.tryWithSafeFinallyAndFailureCallbacks throws
IllegalArgumentException: Self-suppression not permitted
## What changes were proposed in this pull request?
Not adding the exception to the
Repository: spark
Updated Branches:
refs/heads/master 6beca9ce9 -> c605fee01
[SPARK-21260][SQL][MINOR] Remove the unused OutputFakerExec
## What changes were proposed in this pull request?
OutputFakerExec was added long ago and is not used anywhere now so we should
remove it.
## How was thi
Repository: spark
Updated Branches:
refs/heads/master a848d552e -> 8ca4ebefa
[MINOR] Add french stop word "les"
## What changes were proposed in this pull request?
Added "les" as french stop word (plurial of le)
Author: Thomas Decaux
Closes #18514 from ebuildy/patch-1.
Project: http://gi
Repository: spark
Updated Branches:
refs/heads/master 8ca4ebefa -> 2b1e94b9a
[MINOR][SPARK SUBMIT] Print out R file usage in spark-submit
## What changes were proposed in this pull request?
Currently, running the shell below:
```bash
$ ./bin/spark-submit tmp.R a b c
```
with R file, `tmp.R`
Repository: spark
Updated Branches:
refs/heads/master 1b50e0e0d -> 4d6d8192c
[SPARK-21268][MLLIB] Move center calculations to a distributed map in KMeans
## What changes were proposed in this pull request?
The scal() and creation of newCenter vector is done in the driver, after a
collectAsMa
Repository: spark
Updated Branches:
refs/heads/master e3e2b5da3 -> 960298ee6
[SPARK-20858][DOC][MINOR] Document ListenerBus event queue size
## What changes were proposed in this pull request?
This change adds a new configuration option
`spark.scheduler.listenerbus.eventqueue.size` to the co
Repository: spark-website
Updated Branches:
refs/heads/asf-site 9749c8e2f -> 8a9ae6b7d
Update committer page.
Project: http://git-wip-us.apache.org/repos/asf/spark-website/repo
Commit: http://git-wip-us.apache.org/repos/asf/spark-website/commit/8a9ae6b7
Tree: http://git-wip-us.apache.org/repo
Repository: spark-website
Updated Branches:
refs/heads/asf-site 8a9ae6b7d -> 878dcfd84
Update Sandy.
Project: http://git-wip-us.apache.org/repos/asf/spark-website/repo
Commit: http://git-wip-us.apache.org/repos/asf/spark-website/commit/878dcfd8
Tree: http://git-wip-us.apache.org/repos/asf/spa
Repository: spark
Updated Branches:
refs/heads/master 5df99bd36 -> 7fcbb9b57
[SPARK-21313][SS] ConsoleSink's string representation
## What changes were proposed in this pull request?
Add `toString` with options for `ConsoleSink` so it shows nicely in query
progress.
**BEFORE**
```
"sink"
Repository: spark
Updated Branches:
refs/heads/master f5f02d213 -> 01f183e84
Mesos doc fixes
## What changes were proposed in this pull request?
Some link fixes for the documentation [Running Spark on
Mesos](https://spark.apache.org/docs/latest/running-on-mesos.html):
* Updated Link to Meso
Repository: spark
Updated Branches:
refs/heads/master 01f183e84 -> 330bf5c99
[SPARK-20609][MLLIB][TEST] manually cleared 'spark.local.dir' before/after a
test in ALSCleanerSuite
## What changes were proposed in this pull request?
This PR is similar to #17869.
Once` 'spark.local.dir'` is set.
Repository: spark
Updated Branches:
refs/heads/branch-1.6 765307f41 -> 1fcd17f84
[SPARK-13901][CORE] correct the logDebug information when jump to the next
locality level
JIRA Issue:https://issues.apache.org/jira/browse/SPARK-13901
In getAllowedLocalityLevel method of TaskSetManager,we get wr
Repository: spark
Updated Branches:
refs/heads/master e47408814 -> 20fd25410
http://git-wip-us.apache.org/repos/asf/spark/blob/20fd2541/sql/core/src/main/java/org/apache/spark/sql/execution/vectorized/ColumnarBatch.java
--
diff
[SPARK-14011][CORE][SQL] Enable `LineLength` Java checkstyle rule
## What changes were proposed in this pull request?
[Spark Coding Style
Guide](https://cwiki.apache.org/confluence/display/SPARK/Spark+Code+Style+Guide)
has 100-character limit on lines, but it's disabled for Java since 11/09/15.
http://git-wip-us.apache.org/repos/asf/spark/blob/20fd2541/core/src/test/java/org/apache/spark/JavaAPISuite.java
--
diff --git a/core/src/test/java/org/apache/spark/JavaAPISuite.java
b/core/src/test/java/org/apache/spark/JavaAPISu
Repository: spark
Updated Branches:
refs/heads/master 20fd25410 -> 761c2d1b6
[MINOR][DOCS] Add proper periods and spaces for CLI help messages and `config`
doc.
## What changes were proposed in this pull request?
This PR adds some proper periods and spaces to Spark CLI help messages and
SQL
Repository: spark
Updated Branches:
refs/heads/master 761c2d1b6 -> c35c60fa9
[SPARK-14028][STREAMING][KINESIS][TESTS] Remove deprecated methods; fix two
other warnings
## What changes were proposed in this pull request?
- Removed two methods that has been deprecated since 1.4
- Fixed two oth
Repository: spark
Updated Branches:
refs/heads/master 17a3f0067 -> df61fbd97
[SPARK-13986][CORE][MLLIB] Remove `DeveloperApi`-annotations for non-publics
## What changes were proposed in this pull request?
Spark uses `DeveloperApi` annotation, but sometimes it seems to conflict with
visibili
Repository: spark
Updated Branches:
refs/heads/master abacf5f25 -> 4d955cd69
[SPARK-14035][MLLIB] Make error message more verbose for mllib NaiveBayesSuite
## What changes were proposed in this pull request?
Print more info about failed NaiveBayesSuite tests which have exhibited
flakiness.
Repository: spark
Updated Branches:
refs/heads/master 01849da08 -> 1803bf633
Fix typo in ALS.scala
## What changes were proposed in this pull request?
Just a typo
## How was this patch tested?
N/A
Author: Juarez Bochi
Closes #11896 from jbochi/patch-1.
Project: http://git-wip-us.apache
Repository: spark
Updated Branches:
refs/heads/master 1803bf633 -> 048a7594e
[SPARK-14030][MLLIB] Add parameter check to MLLIB
## What changes were proposed in this pull request?
add parameter verification to MLLIB, like
numCorrections > 0
tolerance >= 0
iters > 0
regParam >= 0
## How was th
Repository: spark
Updated Branches:
refs/heads/master 048a7594e -> dd9ca7b96
[SPARK-13019][DOCS] fix for scala-2.10 build: Replace example code in
mllib-statistics.md using include_example
## What changes were proposed in this pull request?
This PR for ticket SPARK-13019 is based on previous
Repository: spark
Updated Branches:
refs/heads/master dd9ca7b96 -> 5519760e0
[SPARK-2208] Fix for local metrics tests can fail on fast machines
## What changes were proposed in this pull request?
A fix for local metrics tests that can fail on fast machines.
This is probably what is suggested
801 - 900 of 5050 matches
Mail list logo
