Repository: spark
Updated Branches:
refs/heads/branch-1.5 21a10a86d -> 5220db9e3
[SPARK-9316] [SPARKR] Add support for filtering using `[` (synonym for filter /
select)
Add support for
```
df[df$name == "Smith", c(1,2)]
df[df$age %in% c(19, 30), 1:2]
```
shivaram
Author: felixcheung
Repository: spark
Updated Branches:
refs/heads/master 321d77596 -> 75d4773aa
[SPARK-9316] [SPARKR] Add support for filtering using `[` (synonym for filter /
select)
Add support for
```
df[df$name == "Smith", c(1,2)]
df[df$age %in% c(19, 30), 1:2]
```
shivaram
Author: felixcheung
Clo
Repository: spark
Updated Branches:
refs/heads/master 4657fa1f3 -> 321d77596
[SPARK-10236] [MLLIB] update since versions in mllib.feature
Same as #8421 but for `mllib.feature`.
cc dbtsai
Author: Xiangrui Meng
Closes #8449 from mengxr/SPARK-10236.feature and squashes the following commits:
Repository: spark
Updated Branches:
refs/heads/branch-1.5 08d390f45 -> 21a10a86d
[SPARK-10236] [MLLIB] update since versions in mllib.feature
Same as #8421 but for `mllib.feature`.
cc dbtsai
Author: Xiangrui Meng
Closes #8449 from mengxr/SPARK-10236.feature and squashes the following commi
Repository: spark
Updated Branches:
refs/heads/master fb7e12fe2 -> 4657fa1f3
[SPARK-10235] [MLLIB] update since versions in mllib.regression
Same as #8421 but for `mllib.regression`.
cc freeman-lab dbtsai
Author: Xiangrui Meng
Closes #8426 from mengxr/SPARK-10235 and squashes the following
Repository: spark
Updated Branches:
refs/heads/branch-1.5 6d8ebc801 -> 08d390f45
[SPARK-10235] [MLLIB] update since versions in mllib.regression
Same as #8421 but for `mllib.regression`.
cc freeman-lab dbtsai
Author: Xiangrui Meng
Closes #8426 from mengxr/SPARK-10235 and squashes the follo
Repository: spark
Updated Branches:
refs/heads/branch-1.5 be0c9915c -> 6d8ebc801
[SPARK-10243] [MLLIB] update since versions in mllib.tree
Same as #8421 but for `mllib.tree`.
cc jkbradley
Author: Xiangrui Meng
Closes #8442 from mengxr/SPARK-10236.
(cherry picked from commit fb7e12fe2e14af
Repository: spark
Updated Branches:
refs/heads/master d703372f8 -> fb7e12fe2
[SPARK-10243] [MLLIB] update since versions in mllib.tree
Same as #8421 but for `mllib.tree`.
cc jkbradley
Author: Xiangrui Meng
Closes #8442 from mengxr/SPARK-10236.
Project: http://git-wip-us.apache.org/repos/
Repository: spark
Updated Branches:
refs/heads/branch-1.5 b7766699a -> be0c9915c
[SPARK-10234] [MLLIB] update since version in mllib.clustering
Same as #8421 but for `mllib.clustering`.
cc feynmanliang yu-iskw
Author: Xiangrui Meng
Closes #8435 from mengxr/SPARK-10234.
(cherry picked from
Repository: spark
Updated Branches:
refs/heads/master c3a54843c -> d703372f8
[SPARK-10234] [MLLIB] update since version in mllib.clustering
Same as #8421 but for `mllib.clustering`.
cc feynmanliang yu-iskw
Author: Xiangrui Meng
Closes #8435 from mengxr/SPARK-10234.
Project: http://git-wi
Repository: spark
Updated Branches:
refs/heads/branch-1.5 46750b912 -> b7766699a
[SPARK-10240] [SPARK-10242] [MLLIB] update since versions in mlilb.random and
mllib.stat
The same as #8241 but for `mllib.stat` and `mllib.random`.
cc feynmanliang
Author: Xiangrui Meng
Closes #8439 from meng
Repository: spark
Updated Branches:
refs/heads/master ab431f8a9 -> c3a54843c
[SPARK-10240] [SPARK-10242] [MLLIB] update since versions in mlilb.random and
mllib.stat
The same as #8241 but for `mllib.stat` and `mllib.random`.
cc feynmanliang
Author: Xiangrui Meng
Closes #8439 from mengxr/S
Repository: spark
Updated Branches:
refs/heads/branch-1.5 af98e51f2 -> 46750b912
[SPARK-10238] [MLLIB] update since versions in mllib.linalg
Same as #8421 but for `mllib.linalg`.
cc dbtsai
Author: Xiangrui Meng
Closes #8440 from mengxr/SPARK-10238 and squashes the following commits:
b3843
Repository: spark
Updated Branches:
refs/heads/master 8668ead2e -> ab431f8a9
[SPARK-10238] [MLLIB] update since versions in mllib.linalg
Same as #8421 but for `mllib.linalg`.
cc dbtsai
Author: Xiangrui Meng
Closes #8440 from mengxr/SPARK-10238 and squashes the following commits:
b38437e [
Repository: spark
Updated Branches:
refs/heads/branch-1.5 5cf266fde -> af98e51f2
[SPARK-10233] [MLLIB] update since version in mllib.evaluation
Same as #8421 but for `mllib.evaluation`.
cc avulanov
Author: Xiangrui Meng
Closes #8423 from mengxr/SPARK-10233.
(cherry picked from commit 8668
Repository: spark
Updated Branches:
refs/heads/master 125205cdb -> 8668ead2e
[SPARK-10233] [MLLIB] update since version in mllib.evaluation
Same as #8421 but for `mllib.evaluation`.
cc avulanov
Author: Xiangrui Meng
Closes #8423 from mengxr/SPARK-10233.
Project: http://git-wip-us.apache.
Repository: spark
Updated Tags: refs/tags/v1.4.1-rc4 [deleted] dbaa5c294
-
To unsubscribe, e-mail: commits-unsubscr...@spark.apache.org
For additional commands, e-mail: commits-h...@spark.apache.org
Repository: spark
Updated Tags: refs/tags/v1.4.1-rc2 [deleted] 07b95c7ad
-
To unsubscribe, e-mail: commits-unsubscr...@spark.apache.org
For additional commands, e-mail: commits-h...@spark.apache.org
Repository: spark
Updated Tags: refs/tags/v1.4.1-rc3 [deleted] 3e8ae3894
-
To unsubscribe, e-mail: commits-unsubscr...@spark.apache.org
For additional commands, e-mail: commits-h...@spark.apache.org
Repository: spark
Updated Tags: refs/tags/v1.4.1-rc1 [deleted] 60e08e507
-
To unsubscribe, e-mail: commits-unsubscr...@spark.apache.org
For additional commands, e-mail: commits-h...@spark.apache.org
Repository: spark
Updated Branches:
refs/heads/branch-1.5 4c03cb4da -> 5cf266fde
[SPARK-9888] [MLLIB] User guide for new LDA features
* Adds two new sections to LDA's user guide; one for each optimizer/model
* Documents new features added to LDA (e.g. topXXXperXXX, asymmetric priors,
hyperp
Repository: spark
Updated Branches:
refs/heads/master 7467b52ed -> 125205cdb
[SPARK-9888] [MLLIB] User guide for new LDA features
* Adds two new sections to LDA's user guide; one for each optimizer/model
* Documents new features added to LDA (e.g. topXXXperXXX, asymmetric priors,
hyperpam o
Preparing development version 1.5.1-SNAPSHOT
Project: http://git-wip-us.apache.org/repos/asf/spark/repo
Commit: http://git-wip-us.apache.org/repos/asf/spark/commit/4c03cb4d
Tree: http://git-wip-us.apache.org/repos/asf/spark/tree/4c03cb4d
Diff: http://git-wip-us.apache.org/repos/asf/spark/diff/4c0
Repository: spark
Updated Branches:
refs/heads/branch-1.5 ab7d46d1d -> 4c03cb4da
Preparing Spark release v1.5.0-rc2
Project: http://git-wip-us.apache.org/repos/asf/spark/repo
Commit: http://git-wip-us.apache.org/repos/asf/spark/commit/72777135
Tree: http://git-wip-us.apache.org/repos/asf/spar
Repository: spark
Updated Tags: refs/tags/v1.5.0-rc2 [created] 727771352
-
To unsubscribe, e-mail: commits-unsubscr...@spark.apache.org
For additional commands, e-mail: commits-h...@spark.apache.org
Repository: spark
Updated Branches:
refs/heads/branch-1.5 8925896b1 -> ab7d46d1d
[SPARK-10215] [SQL] Fix precision of division (follow the rule in Hive)
Follow the rule in Hive for decimal division. see
https://github.com/apache/hive/blob/ac755ebe26361a4647d53db2a28500f71697b276/ql/src/java/o
Repository: spark
Updated Branches:
refs/heads/master ec89bd840 -> 7467b52ed
[SPARK-10215] [SQL] Fix precision of division (follow the rule in Hive)
Follow the rule in Hive for decimal division. see
https://github.com/apache/hive/blob/ac755ebe26361a4647d53db2a28500f71697b276/ql/src/java/org/a
Repository: spark
Updated Branches:
refs/heads/branch-1.5 6f05b7aeb -> 8925896b1
[SPARK-10245] [SQL] Fix decimal literals with precision < scale
In BigDecimal or java.math.BigDecimal, the precision could be smaller than
scale, for example, BigDecimal("0.001") has precision = 1 and scale = 3.
Repository: spark
Updated Branches:
refs/heads/master 00ae4be97 -> ec89bd840
[SPARK-10245] [SQL] Fix decimal literals with precision < scale
In BigDecimal or java.math.BigDecimal, the precision could be smaller than
scale, for example, BigDecimal("0.001") has precision = 1 and scale = 3. But
Repository: spark
Updated Branches:
refs/heads/branch-1.5 055387c08 -> 6f05b7aeb
[SPARK-10239] [SPARK-10244] [MLLIB] update since versions in mllib.pmml and
mllib.util
Same as #8421 but for `mllib.pmml` and `mllib.util`.
cc dbtsai
Author: Xiangrui Meng
Closes #8430 from mengxr/SPARK-10239
Repository: spark
Updated Branches:
refs/heads/master 920590787 -> 00ae4be97
[SPARK-10239] [SPARK-10244] [MLLIB] update since versions in mllib.pmml and
mllib.util
Same as #8421 but for `mllib.pmml` and `mllib.util`.
cc dbtsai
Author: Xiangrui Meng
Closes #8430 from mengxr/SPARK-10239 and
Repository: spark
Updated Branches:
refs/heads/branch-1.5 186326df2 -> 055387c08
[SPARK-9797] [MLLIB] [DOC] StreamingLinearRegressionWithSGD.setConvergenceTol
default value
Adds default convergence tolerance (0.001, set in
`GradientDescent.convergenceTol`) to `setConvergenceTol`'s scaladoc
Repository: spark
Updated Branches:
refs/heads/master c619c7552 -> 920590787
[SPARK-9797] [MLLIB] [DOC] StreamingLinearRegressionWithSGD.setConvergenceTol
default value
Adds default convergence tolerance (0.001, set in
`GradientDescent.convergenceTol`) to `setConvergenceTol`'s scaladoc
Auth
Repository: spark
Updated Branches:
refs/heads/master c0e9ff158 -> c619c7552
[SPARK-10237] [MLLIB] update since versions in mllib.fpm
Same as #8421 but for `mllib.fpm`.
cc feynmanliang
Author: Xiangrui Meng
Closes #8429 from mengxr/SPARK-10237.
Project: http://git-wip-us.apache.org/repos
Repository: spark
Updated Branches:
refs/heads/branch-1.5 95e44b4df -> 186326df2
[SPARK-10237] [MLLIB] update since versions in mllib.fpm
Same as #8421 but for `mllib.fpm`.
cc feynmanliang
Author: Xiangrui Meng
Closes #8429 from mengxr/SPARK-10237.
(cherry picked from commit c619c7552f22d
Repository: spark
Updated Branches:
refs/heads/master 71a138cd0 -> c0e9ff158
[SPARK-9800] Adds docs for GradientDescent$.runMiniBatchSGD alias
* Adds doc for alias of runMIniBatchSGD documenting default value for
convergeTol
* Cleans up a note in code
Author: Feynman Liang
Closes #8425 fro
Repository: spark
Updated Branches:
refs/heads/branch-1.5 5a32ed75c -> 95e44b4df
[SPARK-9800] Adds docs for GradientDescent$.runMiniBatchSGD alias
* Adds doc for alias of runMIniBatchSGD documenting default value for
convergeTol
* Cleans up a note in code
Author: Feynman Liang
Closes #8425
Repository: spark
Updated Branches:
refs/heads/master 16a2be1a8 -> 71a138cd0
[SPARK-10048] [SPARKR] Support arbitrary nested Java array in serde.
This PR:
1. supports transferring arbitrary nested array from JVM to R side in SerDe;
2. based on 1, collect() implemenation is improved. Now it can
Repository: spark
Updated Branches:
refs/heads/branch-1.5 c740f5dd2 -> 5a32ed75c
[SPARK-10231] [MLLIB] update @Since annotation for mllib.classification
Update `Since` annotation in `mllib.classification`:
1. add version to classes, objects, constructors, and public variables declared
in con
Repository: spark
Updated Branches:
refs/heads/master 881208a8e -> 16a2be1a8
[SPARK-10231] [MLLIB] update @Since annotation for mllib.classification
Update `Since` annotation in `mllib.classification`:
1. add version to classes, objects, constructors, and public variables declared
in constru
Repository: spark
Updated Branches:
refs/heads/branch-1.5 742c82ed9 -> c740f5dd2
[SPARK-10230] [MLLIB] Rename optimizeAlpha to optimizeDocConcentration
See [discussion](https://github.com/apache/spark/pull/8254#discussion_r37837770)
CC jkbradley
Author: Feynman Liang
Closes #8422 from feyn
Repository: spark
Updated Branches:
refs/heads/master b37f0cc1b -> 881208a8e
[SPARK-10230] [MLLIB] Rename optimizeAlpha to optimizeDocConcentration
See [discussion](https://github.com/apache/spark/pull/8254#discussion_r37837770)
CC jkbradley
Author: Feynman Liang
Closes #8422 from feynmanl
Repository: spark
Updated Branches:
refs/heads/master 5c08c86bf -> b37f0cc1b
[SPARK-8531] [ML] Update ML user guide for MinMaxScaler
jira: https://issues.apache.org/jira/browse/SPARK-8531
Update ML user guide for MinMaxScaler
Author: Yuhao Yang
Author: unknown
Closes #7211 from hhbyyh/min
Repository: spark
Updated Branches:
refs/heads/branch-1.5 0402f1297 -> 742c82ed9
[SPARK-8531] [ML] Update ML user guide for MinMaxScaler
jira: https://issues.apache.org/jira/browse/SPARK-8531
Update ML user guide for MinMaxScaler
Author: Yuhao Yang
Author: unknown
Closes #7211 from hhbyyh
Repository: spark
Updated Branches:
refs/heads/branch-1.5 bdcc8e608 -> 0402f1297
[SPARK-10198] [SQL] Turn off partition verification by default
Author: Michael Armbrust
Closes #8404 from marmbrus/turnOffPartitionVerification.
(cherry picked from commit 5c08c86bfa43462fb2ca5f7c5980ddfb44dd57
Repository: spark
Updated Branches:
refs/heads/master 69c9c1771 -> 5c08c86bf
[SPARK-10198] [SQL] Turn off partition verification by default
Author: Michael Armbrust
Closes #8404 from marmbrus/turnOffPartitionVerification.
Project: http://git-wip-us.apache.org/repos/asf/spark/repo
Commit: h
Repository: spark
Updated Branches:
refs/heads/branch-1.3 3d2eaf0a7 -> e8b0564e7
[SPARK-8400] [ML] Added check in ml.ALS for positive block size parameter
setting
Added check for positive block size with a note that -1 for auto-configuring is
not supported
Author: Bryan Cutler
Closes #836
http://git-wip-us.apache.org/repos/asf/spark/blob/69c9c177/core/src/main/scala/org/apache/spark/network/netty/NettyBlockRpcServer.scala
--
diff --git
a/core/src/main/scala/org/apache/spark/network/netty/NettyBlockRpcServer.scala
http://git-wip-us.apache.org/repos/asf/spark/blob/69c9c177/external/flume/src/main/scala/org/apache/spark/streaming/flume/PollingFlumeTestUtils.scala
--
diff --git
a/external/flume/src/main/scala/org/apache/spark/streaming/flume/P
[SPARK-9613] [CORE] Ban use of JavaConversions and migrate all existing uses to
JavaConverters
Replace `JavaConversions` implicits with `JavaConverters`
Most occurrences I've seen so far are necessary conversions; a few have been
avoidable. None are in critical code as far as I see, yet.
Autho
Repository: spark
Updated Branches:
refs/heads/master 7f1e507bf -> 69c9c1771
http://git-wip-us.apache.org/repos/asf/spark/blob/69c9c177/yarn/src/main/scala/org/apache/spark/deploy/yarn/YarnAllocator.scala
--
diff --git
a/yarn/
http://git-wip-us.apache.org/repos/asf/spark/blob/69c9c177/sql/hive/src/main/scala/org/apache/spark/sql/hive/HiveMetastoreCatalog.scala
--
diff --git
a/sql/hive/src/main/scala/org/apache/spark/sql/hive/HiveMetastoreCatalog.scala
Repository: spark
Updated Branches:
refs/heads/master 5c1489015 -> 7f1e507bf
Fixed a typo in DAGScheduler.
Author: ehnalis
Closes #8308 from ehnalis/master.
Project: http://git-wip-us.apache.org/repos/asf/spark/repo
Commit: http://git-wip-us.apache.org/repos/asf/spark/commit/7f1e507b
Tree:
Repository: spark
Updated Branches:
refs/heads/branch-1.5 5d6840569 -> bdcc8e608
Fixed a typo in DAGScheduler.
Author: ehnalis
Closes #8308 from ehnalis/master.
(cherry picked from commit 7f1e507bf7e82bff323c5dec3c1ee044687c4173)
Signed-off-by: Sean Owen
Project: http://git-wip-us.apache
Repository: spark
Updated Branches:
refs/heads/branch-1.5 73f1dd1b5 -> 5d6840569
[DOC] add missing parameters in SparkContext.scala for scala doc
Author: Zhang, Liye
Closes #8412 from liyezhang556520/minorDoc.
(cherry picked from commit 5c14890159a5711072bf395f662b2433a389edf9)
Signed-off-b
Repository: spark
Updated Branches:
refs/heads/master 0e6368ffa -> 5c1489015
[DOC] add missing parameters in SparkContext.scala for scala doc
Author: Zhang, Liye
Closes #8412 from liyezhang556520/minorDoc.
Project: http://git-wip-us.apache.org/repos/asf/spark/repo
Commit: http://git-wip-us
Repository: spark
Updated Branches:
refs/heads/branch-1.5 a0f22cf29 -> 73f1dd1b5
[SPARK-10197] [SQL] Add null check in wrapperFor (inside HiveInspectors).
https://issues.apache.org/jira/browse/SPARK-10197
Author: Yin Huai
Closes #8407 from yhuai/ORCSPARK-10197.
(cherry picked from commit 0
Repository: spark
Updated Branches:
refs/heads/master 7bc9a8c62 -> 0e6368ffa
[SPARK-10197] [SQL] Add null check in wrapperFor (inside HiveInspectors).
https://issues.apache.org/jira/browse/SPARK-10197
Author: Yin Huai
Closes #8407 from yhuai/ORCSPARK-10197.
Project: http://git-wip-us.apac
Repository: spark
Updated Branches:
refs/heads/branch-1.5 e5cea566a -> a0f22cf29
[SPARK-10195] [SQL] Data sources Filter should not expose internal types
Spark SQL's data sources API exposes Catalyst's internal types through its
Filter interfaces. This is a problem because types like UTF8Stri
Repository: spark
Updated Branches:
refs/heads/master 2f493f7e3 -> 7bc9a8c62
[SPARK-10195] [SQL] Data sources Filter should not expose internal types
Spark SQL's data sources API exposes Catalyst's internal types through its
Filter interfaces. This is a problem because types like UTF8String a
Repository: spark
Updated Branches:
refs/heads/branch-1.5 2032d6670 -> e5cea566a
[SPARK-10177] [SQL] fix reading Timestamp in parquet from Hive
We misunderstood the Julian days and nanoseconds of the day in parquet (as
TimestampType) from Hive/Impala, they are overlapped, so can't be added
t
Repository: spark
Updated Branches:
refs/heads/master 1fc37581a -> 2f493f7e3
[SPARK-10177] [SQL] fix reading Timestamp in parquet from Hive
We misunderstood the Julian days and nanoseconds of the day in parquet (as
TimestampType) from Hive/Impala, they are overlapped, so can't be added
toget
Repository: spark
Updated Branches:
refs/heads/branch-1.5 4841ebb18 -> 2032d6670
[SPARK-10210] [STREAMING] Filter out non-existent blocks before creating
BlockRDD
When write ahead log is not enabled, a recovered streaming driver still tries
to run jobs using pre-failure block ids, and fails
Repository: spark
Updated Branches:
refs/heads/master 57b960bf3 -> 1fc37581a
[SPARK-10210] [STREAMING] Filter out non-existent blocks before creating
BlockRDD
When write ahead log is not enabled, a recovered streaming driver still tries
to run jobs using pre-failure block ids, and fails as t
Repository: spark
Updated Branches:
refs/heads/branch-1.5 76d920f2b -> 4841ebb18
[SPARK-6196] [BUILD] Remove MapR profiles in favor of hadoop-provided
Follow up to https://github.com/apache/spark/pull/7047
pwendell mentioned that MapR should use `hadoop-provided` now, and indeed the
new buil
Repository: spark
Updated Branches:
refs/heads/master d4549fe58 -> 57b960bf3
[SPARK-6196] [BUILD] Remove MapR profiles in favor of hadoop-provided
Follow up to https://github.com/apache/spark/pull/7047
pwendell mentioned that MapR should use `hadoop-provided` now, and indeed the
new build sc
Repository: spark
Updated Branches:
refs/heads/branch-1.5 b7c4ff144 -> 76d920f2b
[SPARK-10214] [SPARKR] [DOCS] Improve SparkR Column, DataFrame API docs
cc: shivaram
## Summary
- Add name tags to each methods in DataFrame.R and column.R
- Replace `rdname column` with `rdname {each_func}`. i.
Repository: spark
Updated Branches:
refs/heads/master 82268f07a -> d4549fe58
[SPARK-10214] [SPARKR] [DOCS] Improve SparkR Column, DataFrame API docs
cc: shivaram
## Summary
- Add name tags to each methods in DataFrame.R and column.R
- Replace `rdname column` with `rdname {each_func}`. i.e. a
Repository: spark
Updated Branches:
refs/heads/branch-1.5 95a14e9f2 -> b7c4ff144
[SPARK-9293] [SPARK-9813] Analysis should check that set operations are only
performed on tables with equal numbers of columns
This patch adds an analyzer rule to ensure that set operations (union,
intersect, an
Repository: spark
Updated Branches:
refs/heads/master bf03fe68d -> 82268f07a
[SPARK-9293] [SPARK-9813] Analysis should check that set operations are only
performed on tables with equal numbers of columns
This patch adds an analyzer rule to ensure that set operations (union,
intersect, and ex
70 matches
Mail list logo
