Repository: spark
Updated Branches:
refs/heads/master dd0614fd6 - c34e9ff0e
[MINOR] fix the comments in IndexShuffleBlockResolver
it might be a typo introduced at the first moment or some leftover after some
renaming..
the name of the method accessing the index file is called
Repository: spark
Updated Branches:
refs/heads/branch-1.5 40b89c38a - 42a0b4890
[MINOR] fix the comments in IndexShuffleBlockResolver
it might be a typo introduced at the first moment or some leftover after some
renaming..
the name of the method accessing the index file is called
Repository: spark
Updated Branches:
refs/heads/branch-1.5 2803e8b2e - e5fbe4f24
[SPARK-10038] [SQL] fix bug in generated unsafe projection when there is binary
in ArrayData
The type for array of array in Java is slightly different than array of others.
cc cloud-fan
Author: Davies Liu
Repository: spark
Updated Branches:
refs/heads/branch-1.5 35542504c - 2803e8b2e
[MINOR] Format the comment of `translate` at `functions.scala`
Author: Yu ISHIKAWA yuu.ishik...@gmail.com
Closes #8265 from yu-iskw/minor-translate-comment.
(cherry picked from commit
Repository: spark
Updated Branches:
refs/heads/master e290029a3 - a0910315d
[MINOR] Format the comment of `translate` at `functions.scala`
Author: Yu ISHIKAWA yuu.ishik...@gmail.com
Closes #8265 from yu-iskw/minor-translate-comment.
Project:
Repository: spark
Updated Branches:
refs/heads/master a0910315d - 5af3838d2
[SPARK-10038] [SQL] fix bug in generated unsafe projection when there is binary
in ArrayData
The type for array of array in Java is slightly different than array of others.
cc cloud-fan
Author: Davies Liu
Repository: spark
Updated Branches:
refs/heads/master 5af3838d2 - dd0614fd6
[SPARK-10076] [ML] make MultilayerPerceptronClassifier layers and weights public
Fix the issue that ```layers``` and ```weights``` should be public variables of
```MultilayerPerceptronClassificationModel```. Users
Repository: spark
Updated Branches:
refs/heads/branch-1.5 e5fbe4f24 - 40b89c38a
[SPARK-10076] [ML] make MultilayerPerceptronClassifier layers and weights public
Fix the issue that ```layers``` and ```weights``` should be public variables of
```MultilayerPerceptronClassificationModel```.
Repository: spark
Updated Branches:
refs/heads/master c34e9ff0e - 5723d26d7
[SPARK-8118] [SQL] Redirects Parquet JUL logger via SLF4J
Parquet hard coded a JUL logger which always writes to stdout. This PR
redirects it via SLF4j JUL bridge handler, so that we can control Parquet logs
via
Repository: spark
Updated Branches:
refs/heads/branch-1.5 42a0b4890 - a512250cd
[SPARK-8118] [SQL] Redirects Parquet JUL logger via SLF4J
Parquet hard coded a JUL logger which always writes to stdout. This PR
redirects it via SLF4j JUL bridge handler, so that we can control Parquet logs
via
Repository: spark
Updated Branches:
refs/heads/master 354f4582b - c1840a862
[SPARK-7736] [CORE] Fix a race introduced in PythonRunner.
The fix for SPARK-7736 introduced a race where a port value of -1
could be passed down to the pyspark process, causing it to fail to
connect back to the JVM.
Repository: spark
Updated Branches:
refs/heads/branch-1.5 20a760a00 - b86378cf2
[SPARK-9028] [ML] Add CountVectorizer as an estimator to generate
CountVectorizerModel
jira: https://issues.apache.org/jira/browse/SPARK-9028
Add an estimator for CountVectorizerModel. The estimator will extract
Repository: spark
Updated Branches:
refs/heads/master 1968276af - 354f4582b
[SPARK-9028] [ML] Add CountVectorizer as an estimator to generate
CountVectorizerModel
jira: https://issues.apache.org/jira/browse/SPARK-9028
Add an estimator for CountVectorizerModel. The estimator will extract a
Repository: spark
Updated Branches:
refs/heads/branch-1.5 b86378cf2 - 7ff0e5d2f
[SPARK-9900] [MLLIB] User guide for Association Rules
Updates FPM user guide to include Association Rules.
Author: Feynman Liang fli...@databricks.com
Closes #8207 from feynmanliang/SPARK-9900-arules.
(cherry
Repository: spark
Updated Branches:
refs/heads/branch-1.5 ec7079f9c - 9bd2e6f7c
[SPARK-10085] [MLLIB] [DOCS] removed unnecessary numpy array import
See https://issues.apache.org/jira/browse/SPARK-10085
Author: Piotr Migdal pmig...@gmail.com
Closes #8284 from stared/spark-10085.
(cherry
Repository: spark
Updated Branches:
refs/heads/master 747c2ba80 - 8bae9015b
[SPARK-10085] [MLLIB] [DOCS] removed unnecessary numpy array import
See https://issues.apache.org/jira/browse/SPARK-10085
Author: Piotr Migdal pmig...@gmail.com
Closes #8284 from stared/spark-10085.
Project:
Repository: spark
Updated Branches:
refs/heads/master f5ea39129 - f4fa61eff
[SPARK-10029] [MLLIB] [DOC] Add Python examples for mllib IsotonicRegression
user guide
Add Python examples for mllib IsotonicRegression user guide
Author: Yanbo Liang yblia...@gmail.com
Closes #8225 from
Repository: spark
Updated Branches:
refs/heads/master bf1d6614d - 80cb25b22
[SPARK-10080] [SQL] Fix binary incompatibility for $ column interpolation
Turns out that inner classes of inner objects are referenced directly, and thus
moving it will break binary compatibility.
Author: Michael
Repository: spark
Updated Branches:
refs/heads/branch-1.5 2bccd918f - 80a6fb521
[SPARK-10080] [SQL] Fix binary incompatibility for $ column interpolation
Turns out that inner classes of inner objects are referenced directly, and thus
moving it will break binary compatibility.
Author:
Repository: spark
Updated Branches:
refs/heads/branch-1.5 56f4da263 - fb207b245
[SPARK-10012] [ML] Missing test case for Params#arrayLengthGt
Currently there is no test case for `Params#arrayLengthGt`.
Author: lewuathe lewua...@me.com
Closes #8223 from Lewuathe/SPARK-10012.
(cherry picked
Repository: spark
Updated Branches:
refs/heads/master c1840a862 - f5ea39129
[SPARK-9900] [MLLIB] User guide for Association Rules
Updates FPM user guide to include Association Rules.
Author: Feynman Liang fli...@databricks.com
Closes #8207 from feynmanliang/SPARK-9900-arules.
Project:
Repository: spark
Updated Branches:
refs/heads/branch-1.5 80a6fb521 - 74a6b1a13
[SPARK-10089] [SQL] Add missing golden files.
Author: Marcelo Vanzin van...@cloudera.com
Closes #8283 from vanzin/SPARK-10089.
(cherry picked from commit fa41e0242f075843beff7dc600d1a6bac004bdc7)
Signed-off-by:
Repository: spark
Updated Branches:
refs/heads/master 9b731fad2 - fa41e0242
[SPARK-10089] [SQL] Add missing golden files.
Author: Marcelo Vanzin van...@cloudera.com
Closes #8283 from vanzin/SPARK-10089.
Project: http://git-wip-us.apache.org/repos/asf/spark/repo
Commit:
Repository: spark
Updated Branches:
refs/heads/master 1dbffba37 - c635a16f6
[SPARK-10012] [ML] Missing test case for Params#arrayLengthGt
Currently there is no test case for `Params#arrayLengthGt`.
Author: lewuathe lewua...@me.com
Closes #8223 from Lewuathe/SPARK-10012.
Project:
Repository: spark
Updated Branches:
refs/heads/branch-1.5 9b42e2404 - 0a1385e31
[SPARKR] [MINOR] Get rid of a long line warning
```
R/functions.R:74:1: style: lines should not be more than 100 characters.
jc - callJStatic(org.apache.spark.sql.functions, lit,
ifelse(class(x) ==
Repository: spark
Updated Branches:
refs/heads/master bf32c1f7f - 270ee6777
[SPARK-10095] [SQL] use public API of BigInteger
In UnsafeRow, we use the private field of BigInteger for better performance,
but it actually didn't contribute much (3% in one benchmark) to end-to-end
runtime, and
Repository: spark
Updated Branches:
refs/heads/master b4b35f133 - 1aeae05bb
[SPARK-10072] [STREAMING] BlockGenerator can deadlock when the queue of
generate blocks fills up to capacity
Generated blocks are inserted into an ArrayBlockingQueue, and another thread
pulls stuff from the
Repository: spark
Updated Branches:
refs/heads/branch-1.5 0a1385e31 - 08c5962a2
[SPARK-10072] [STREAMING] BlockGenerator can deadlock when the queue of
generate blocks fills up to capacity
Generated blocks are inserted into an ArrayBlockingQueue, and another thread
pulls stuff from the
Repository: spark
Updated Branches:
refs/heads/branch-1.5 a6f8979c8 - bb2fb59f9
[SPARK-9939] [SQL] Resorts to Java process API in CliSuite,
HiveSparkSubmitSuite and HiveThriftServer2 test suites
Scala process API has a known bug ([SI-8768] [1]), which may be the reason why
several test
Repository: spark
Updated Branches:
refs/heads/master 90273eff9 - a5b5b9365
[SPARK-9939] [SQL] Resorts to Java process API in CliSuite,
HiveSparkSubmitSuite and HiveThriftServer2 test suites
Scala process API has a known bug ([SI-8768] [1]), which may be the reason why
several test suites
Repository: spark
Updated Branches:
refs/heads/master 1f8902964 - b4b35f133
[SPARKR] [MINOR] Get rid of a long line warning
```
R/functions.R:74:1: style: lines should not be more than 100 characters.
jc - callJStatic(org.apache.spark.sql.functions, lit,
ifelse(class(x) ==
Repository: spark
Updated Branches:
refs/heads/branch-1.5 08c5962a2 - a6f8979c8
[SPARK-10102] [STREAMING] Fix a race condition that startReceiver may happen
before setting trackerState to Started
Test failure:
Repository: spark
Updated Branches:
refs/heads/master 1aeae05bb - 90273eff9
[SPARK-10102] [STREAMING] Fix a race condition that startReceiver may happen
before setting trackerState to Started
Test failure:
Repository: spark
Updated Branches:
refs/heads/master a5b5b9365 - bf32c1f7f
[SPARK-10075] [SPARKR] Add `when` expressino function in SparkR
- Add `when` and `otherwise` as `Column` methods
- Add `When` as an expression function
- Add `%otherwise%` infix as an alias of `otherwise`
Since R
Repository: spark
Updated Branches:
refs/heads/branch-1.5 ebaeb1892 - 11c933505
[SPARK-10095] [SQL] use public API of BigInteger
In UnsafeRow, we use the private field of BigInteger for better performance,
but it actually didn't contribute much (3% in one benchmark) to end-to-end
runtime,
Repository: spark
Updated Branches:
refs/heads/branch-1.5 bb2fb59f9 - ebaeb1892
[SPARK-10075] [SPARKR] Add `when` expressino function in SparkR
- Add `when` and `otherwise` as `Column` methods
- Add `When` as an expression function
- Add `%otherwise%` infix as an alias of `otherwise`
Since R
Repository: spark
Updated Branches:
refs/heads/master 8bae9015b - bf1d6614d
[SPARK-9574] [STREAMING] Remove unnecessary contents of
spark-streaming-XXX-assembly jars
Removed contents already included in Spark assembly jar from
spark-streaming-XXX-assembly jars.
Author: zsxwing
Repository: spark
Updated Branches:
refs/heads/master 80cb25b22 - 9b731fad2
[SPARK-9782] [YARN] Support YARN application tags via SparkConf
Add a new test case in yarn/ClientSuite which checks how the various SparkConf
and ClientArguments propagate into the ApplicationSubmissionContext.
Repository: spark
Updated Branches:
refs/heads/branch-1.5 74a6b1a13 - 8b0df5a5e
[SPARK-10088] [SQL] Add support for stored as avro in HiveQL parser.
Author: Marcelo Vanzin van...@cloudera.com
Closes #8282 from vanzin/SPARK-10088.
(cherry picked from commit
Repository: spark
Updated Branches:
refs/heads/master fa41e0242 - 492ac1fac
[SPARK-10088] [SQL] Add support for stored as avro in HiveQL parser.
Author: Marcelo Vanzin van...@cloudera.com
Closes #8282 from vanzin/SPARK-10088.
Project: http://git-wip-us.apache.org/repos/asf/spark/repo
Repository: spark
Updated Branches:
refs/heads/branch-1.5 8b0df5a5e - 56f4da263
[SPARK-8924] [MLLIB, DOCUMENTATION] Added @since tags to mllib.tree
Added since tags to mllib.tree
Author: Bryan Cutler bjcut...@us.ibm.com
Closes #7380 from BryanCutler/sinceTag-mllibTree-8924.
(cherry picked
Repository: spark
Updated Branches:
refs/heads/master 492ac1fac - 1dbffba37
[SPARK-8924] [MLLIB, DOCUMENTATION] Added @since tags to mllib.tree
Added since tags to mllib.tree
Author: Bryan Cutler bjcut...@us.ibm.com
Closes #7380 from BryanCutler/sinceTag-mllibTree-8924.
Project:
Repository: spark
Updated Branches:
refs/heads/master badf7fa65 - 04e0fea79
Bump SparkR version string to 1.5.0
This patch is against master, but we need to apply it to 1.5 branch as well.
cc shivaram and rxin
Author: Hossein hoss...@databricks.com
Closes #8291 from
Repository: spark
Updated Branches:
refs/heads/branch-1.5 4ee225af8 - 9b42e2404
Bump SparkR version string to 1.5.0
This patch is against master, but we need to apply it to 1.5 branch as well.
cc shivaram and rxin
Author: Hossein hoss...@databricks.com
Closes #8291 from
Repository: spark
Updated Branches:
refs/heads/master c635a16f6 - 9108eff74
[SPARK-10098] [STREAMING] [TEST] Cleanup active context after test in
FailureSuite
Failures in streaming.FailureSuite can leak StreamingContext and SparkContext
which fails all subsequent tests
Author: Tathagata
Repository: spark
Updated Branches:
refs/heads/branch-1.5 fb207b245 - e1b50c7d2
[SPARK-10098] [STREAMING] [TEST] Cleanup active context after test in
FailureSuite
Failures in streaming.FailureSuite can leak StreamingContext and SparkContext
which fails all subsequent tests
Author:
Repository: spark
Updated Branches:
refs/heads/branch-1.5 e1b50c7d2 - 4ee225af8
[SPARK-8473] [SPARK-9889] [ML] User guide and example code for DCT
mengxr jkbradley
Author: Feynman Liang fli...@databricks.com
Closes #8184 from feynmanliang/SPARK-9889-DCT-docs.
(cherry picked from commit
Repository: spark
Updated Branches:
refs/heads/master 9108eff74 - badf7fa65
[SPARK-8473] [SPARK-9889] [ML] User guide and example code for DCT
mengxr jkbradley
Author: Feynman Liang fli...@databricks.com
Closes #8184 from feynmanliang/SPARK-9889-DCT-docs.
Project:
Repository: spark
Updated Branches:
refs/heads/branch-1.5 3c33931aa - 03a8a889a
[SPARK-9705] [DOC] fix docs about Python version
cc JoshRosen
Author: Davies Liu dav...@databricks.com
Closes #8245 from davies/python_doc.
(cherry picked from commit de3223872a217c5224ba7136604f6b7753b29108)
Repository: spark
Updated Branches:
refs/heads/master 1ff0580ed - de3223872
[SPARK-9705] [DOC] fix docs about Python version
cc JoshRosen
Author: Davies Liu dav...@databricks.com
Closes #8245 from davies/python_doc.
Project: http://git-wip-us.apache.org/repos/asf/spark/repo
Commit:
Repository: spark
Updated Branches:
refs/heads/master 1c843e284 - 010b03ed5
[SPARK-9952] Fix N^2 loop when DAGScheduler.getPreferredLocsInternal accesses
cacheLocs
In Scala, `Seq.fill` always seems to return a List. Accessing a list by index
is an O(N) operation. Thus, the following code
Repository: spark
Updated Branches:
refs/heads/master 270ee6777 - 1ff0580ed
[SPARK-10093] [SPARK-10096] [SQL] Avoid transformation on executors fix UDFs
on complex types
This is kind of a weird case, but given a sufficiently complex query plan (in
this case a TungstenProject with an
Repository: spark
Updated Branches:
refs/heads/branch-1.5 11c933505 - 3c33931aa
[SPARK-10093] [SPARK-10096] [SQL] Avoid transformation on executors fix UDFs
on complex types
This is kind of a weird case, but given a sufficiently complex query plan (in
this case a TungstenProject with an
Repository: spark
Updated Branches:
refs/heads/branch-1.5 03a8a889a - 416392697
[SPARK-9508] GraphX Pregel docs update with new Pregel code
SPARK-9436 simplifies the Pregel code. graphx-programming-guide needs to be
modified accordingly since it lists the old Pregel code
Author: Alexander
Repository: spark
Updated Branches:
refs/heads/master de3223872 - 1c843e284
[SPARK-9508] GraphX Pregel docs update with new Pregel code
SPARK-9436 simplifies the Pregel code. graphx-programming-guide needs to be
modified accordingly since it lists the old Pregel code
Author: Alexander
Repository: spark
Updated Branches:
refs/heads/branch-1.5 416392697 - 3ceee5572
[SPARK-9952] Fix N^2 loop when DAGScheduler.getPreferredLocsInternal accesses
cacheLocs
In Scala, `Seq.fill` always seems to return a List. Accessing a list by index
is an O(N) operation. Thus, the following
Repository: spark
Updated Branches:
refs/heads/master f4fa61eff - 747c2ba80
[SPARK-10032] [PYSPARK] [DOC] Add Python example for mllib LDAModel user guide
Add Python example for mllib LDAModel user guide
Author: Yanbo Liang yblia...@gmail.com
Closes #8227 from yanboliang/spark-10032.
Repository: spark
Updated Branches:
refs/heads/branch-1.5 80debff12 - ec7079f9c
[SPARK-10032] [PYSPARK] [DOC] Add Python example for mllib LDAModel user guide
Add Python example for mllib LDAModel user guide
Author: Yanbo Liang yblia...@gmail.com
Closes #8227 from yanboliang/spark-10032.
Repository: spark
Updated Branches:
refs/heads/branch-1.5 7ff0e5d2f - 80debff12
[SPARK-10029] [MLLIB] [DOC] Add Python examples for mllib IsotonicRegression
user guide
Add Python examples for mllib IsotonicRegression user guide
Author: Yanbo Liang yblia...@gmail.com
Closes #8225 from
Repository: spark
Updated Branches:
refs/heads/branch-1.5 9bd2e6f7c - 2bccd918f
[SPARK-9574] [STREAMING] Remove unnecessary contents of
spark-streaming-XXX-assembly jars
Removed contents already included in Spark assembly jar from
spark-streaming-XXX-assembly jars.
Author: zsxwing
Repository: spark
Updated Branches:
refs/heads/master 5723d26d7 - 1968276af
[SPARK-10007] [SPARKR] Update `NAMESPACE` file in SparkR for simple parameters
functions
### JIRA
[[SPARK-10007] Update `NAMESPACE` file in SparkR for simple parameters
functions - ASF
Repository: spark
Updated Branches:
refs/heads/branch-1.5 a512250cd - 20a760a00
[SPARK-10007] [SPARKR] Update `NAMESPACE` file in SparkR for simple parameters
functions
### JIRA
[[SPARK-10007] Update `NAMESPACE` file in SparkR for simple parameters
functions - ASF
62 matches
Mail list logo
