[GitHub] spark pull request: [SPARK-11409][SPARKR] Enable url link in R doc...

2015-10-29 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/9363#issuecomment-152338963 **[Test build #44641 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/44641/consoleFull)** for PR 9363 at commit

[GitHub] spark pull request: [SPARK-10342] [SPARK-10309] [SPARK-10474] [SPA...

2015-10-29 Thread JoshRosen
Github user JoshRosen commented on a diff in the pull request: https://github.com/apache/spark/pull/9241#discussion_r43449556 --- Diff: core/src/main/java/org/apache/spark/shuffle/sort/ShuffleExternalSorter.java --- @@ -108,42 +102,20 @@ public ShuffleExternalSorter(

[GitHub] spark pull request: [SPARK-10342] [SPARK-10309] [SPARK-10474] [SPA...

2015-10-29 Thread davies
Github user davies commented on a diff in the pull request: https://github.com/apache/spark/pull/9241#discussion_r43449494 --- Diff: core/src/main/java/org/apache/spark/memory/TaskMemoryManager.java --- @@ -101,29 +107,161 @@ private final boolean inHeap; /**

[GitHub] spark pull request: [SPARK-8546] Add PMML export for Naive Bayes

2015-10-29 Thread selvinsource
Github user selvinsource commented on the pull request: https://github.com/apache/spark/pull/9057#issuecomment-152340315 I will do it, no prob. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not

[GitHub] spark pull request: [SPARK-11410] [SQL] Add APIs to provide functi...

2015-10-29 Thread nongli
GitHub user nongli opened a pull request: https://github.com/apache/spark/pull/9364 [SPARK-11410] [SQL] Add APIs to provide functionality similar to Hive… …'s DISTRIBUTE BY DISTRIBUTE BY allows the user to hash partition the data by specified exprs. It also allows for

[GitHub] spark pull request: [SPARK-11410] [SQL] Add APIs to provide functi...

2015-10-29 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/9364#issuecomment-152341865 Can one of the admins verify this patch? --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your

[GitHub] spark pull request: [SPARK-10342] [SPARK-10309] [SPARK-10474] [SPA...

2015-10-29 Thread JoshRosen
Github user JoshRosen commented on a diff in the pull request: https://github.com/apache/spark/pull/9241#discussion_r43450812 --- Diff: core/src/main/java/org/apache/spark/shuffle/sort/ShuffleExternalSorter.java --- @@ -370,96 +344,45 @@ private void growPointerArrayIfNecessary()

[GitHub] spark pull request: [SPARK-11409][SPARKR] Enable url link in R doc...

2015-10-29 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/9363#issuecomment-152342540 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] spark pull request: [SPARK-11409][SPARKR] Enable url link in R doc...

2015-10-29 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/9363#issuecomment-152342425 **[Test build #44641 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/44641/consoleFull)** for PR 9363 at commit

[GitHub] spark pull request: [SPARK-10342] [SPARK-10309] [SPARK-10474] [SPA...

2015-10-29 Thread davies
Github user davies commented on a diff in the pull request: https://github.com/apache/spark/pull/9241#discussion_r43451271 --- Diff: core/src/main/java/org/apache/spark/shuffle/sort/ShuffleExternalSorter.java --- @@ -353,15 +320,22 @@ private void growPointerArrayIfNecessary()

[GitHub] spark pull request: [SPARK-11141][STREAMING] Batch ReceivedBlockTr...

2015-10-29 Thread tdas
Github user tdas commented on a diff in the pull request: https://github.com/apache/spark/pull/9143#discussion_r43451333 --- Diff: streaming/src/main/scala/org/apache/spark/streaming/scheduler/ReceivedBlockTracker.scala --- @@ -40,7 +41,9 @@ private[streaming] case class

[GitHub] spark pull request: [SPARK-11141][STREAMING] Batch ReceivedBlockTr...

2015-10-29 Thread tdas
Github user tdas commented on a diff in the pull request: https://github.com/apache/spark/pull/9143#discussion_r43451237 --- Diff: streaming/src/main/scala/org/apache/spark/streaming/scheduler/ReceivedBlockTracker.scala --- @@ -176,7 +201,7 @@ private[streaming] class

[GitHub] spark pull request: [SPARK-11353][IO] Update jets3t version to 0.9...

2015-10-29 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/9306#issuecomment-152343082 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your

[GitHub] spark pull request: [SPARK-11141][STREAMING] Batch ReceivedBlockTr...

2015-10-29 Thread tdas
Github user tdas commented on a diff in the pull request: https://github.com/apache/spark/pull/9143#discussion_r43451585 --- Diff: streaming/src/main/scala/org/apache/spark/streaming/scheduler/ReceivedBlockTracker.scala --- @@ -22,12 +22,13 @@ import java.nio.ByteBuffer

[GitHub] spark pull request: [SPARK-10342] [SPARK-10309] [SPARK-10474] [SPA...

2015-10-29 Thread davies
Github user davies commented on a diff in the pull request: https://github.com/apache/spark/pull/9241#discussion_r43451491 --- Diff: core/src/main/java/org/apache/spark/shuffle/sort/ShuffleExternalSorter.java --- @@ -370,96 +344,45 @@ private void growPointerArrayIfNecessary()

[GitHub] spark pull request: [SPARK-6517][mllib] Implement the Algorithm of...

2015-10-29 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/5267#issuecomment-152343011 **[Test build #44642 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/44642/consoleFull)** for PR 5267 at commit

[GitHub] spark pull request: [SPARK-11353][IO] Update jets3t version to 0.9...

2015-10-29 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/9306#issuecomment-152343083 Test FAILed. Refer to this link for build results (access rights to CI server needed):

[GitHub] spark pull request: [SPARK-10342] [SPARK-10309] [SPARK-10474] [SPA...

2015-10-29 Thread JoshRosen
Github user JoshRosen commented on a diff in the pull request: https://github.com/apache/spark/pull/9241#discussion_r43451586 --- Diff: core/src/main/java/org/apache/spark/shuffle/sort/ShuffleExternalSorter.java --- @@ -370,96 +344,45 @@ private void growPointerArrayIfNecessary()

[GitHub] spark pull request: [SPARK-10342] [SPARK-10309] [SPARK-10474] [SPA...

2015-10-29 Thread JoshRosen
Github user JoshRosen commented on a diff in the pull request: https://github.com/apache/spark/pull/9241#discussion_r43452194 --- Diff: core/src/main/java/org/apache/spark/unsafe/map/BytesToBytesMap.java --- @@ -219,61 +232,156 @@ public BytesToBytesMap( */ public

[GitHub] spark pull request: [SPARK-8992] [SQL] Add pivot to dataframe api

2015-10-29 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/7841#issuecomment-152344322 **[Test build #44643 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/44643/consoleFull)** for PR 7841 at commit

[GitHub] spark pull request: [SPARK-11410] [SQL] Add APIs to provide functi...

2015-10-29 Thread yhuai
Github user yhuai commented on a diff in the pull request: https://github.com/apache/spark/pull/9364#discussion_r43452517 --- Diff: sql/core/src/test/scala/org/apache/spark/sql/DataFrameSuite.scala --- @@ -987,4 +992,116 @@ class DataFrameSuite extends QueryTest with

[GitHub] spark pull request: [SPARK-10342] [SPARK-10309] [SPARK-10474] [SPA...

2015-10-29 Thread davies
Github user davies commented on a diff in the pull request: https://github.com/apache/spark/pull/9241#discussion_r43452468 --- Diff: core/src/main/java/org/apache/spark/shuffle/sort/ShuffleExternalSorter.java --- @@ -370,96 +344,45 @@ private void growPointerArrayIfNecessary()

[GitHub] spark pull request: [SPARK-11141][STREAMING] Batch ReceivedBlockTr...

2015-10-29 Thread tdas
Github user tdas commented on a diff in the pull request: https://github.com/apache/spark/pull/9143#discussion_r43452841 --- Diff: streaming/src/main/scala/org/apache/spark/streaming/util/WriteAheadLogUtils.scala --- @@ -64,6 +65,10 @@ private[streaming] object WriteAheadLogUtils

[GitHub] spark pull request: [SPARK-10342] [SPARK-10309] [SPARK-10474] [SPA...

2015-10-29 Thread davies
Github user davies commented on a diff in the pull request: https://github.com/apache/spark/pull/9241#discussion_r43452800 --- Diff: core/src/main/java/org/apache/spark/unsafe/map/BytesToBytesMap.java --- @@ -219,61 +232,156 @@ public BytesToBytesMap( */ public int

[GitHub] spark pull request: [SPARK-11141][STREAMING] Batch ReceivedBlockTr...

2015-10-29 Thread tdas
Github user tdas commented on a diff in the pull request: https://github.com/apache/spark/pull/9143#discussion_r43452869 --- Diff: streaming/src/main/scala/org/apache/spark/streaming/scheduler/ReceivedBlockTracker.scala --- @@ -22,12 +22,13 @@ import java.nio.ByteBuffer

[GitHub] spark pull request: [SPARK-11389][WIP][CORE] Add support for off-h...

2015-10-29 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/9344#issuecomment-152346341 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your

[GitHub] spark pull request: [SPARK-11410] [SQL] Add APIs to provide functi...

2015-10-29 Thread yhuai
Github user yhuai commented on a diff in the pull request: https://github.com/apache/spark/pull/9364#discussion_r43453219 --- Diff: sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/plans/logical/partitioning.scala --- @@ -38,3 +38,11 @@ case class

[GitHub] spark pull request: [SPARK-10342] [SPARK-10309] [SPARK-10474] [SPA...

2015-10-29 Thread JoshRosen
Github user JoshRosen commented on a diff in the pull request: https://github.com/apache/spark/pull/9241#discussion_r43454081 --- Diff: core/src/main/java/org/apache/spark/unsafe/map/BytesToBytesMap.java --- @@ -219,61 +232,156 @@ public BytesToBytesMap( */ public

[GitHub] spark pull request: [SPARK-10342] [SPARK-10309] [SPARK-10474] [SPA...

2015-10-29 Thread JoshRosen
Github user JoshRosen commented on a diff in the pull request: https://github.com/apache/spark/pull/9241#discussion_r43454416 --- Diff: core/src/main/java/org/apache/spark/unsafe/map/BytesToBytesMap.java --- @@ -219,61 +232,156 @@ public BytesToBytesMap( */ public

[GitHub] spark pull request: [SPARK-10342] [SPARK-10309] [SPARK-10474] [SPA...

2015-10-29 Thread JoshRosen
Github user JoshRosen commented on a diff in the pull request: https://github.com/apache/spark/pull/9241#discussion_r43454477 --- Diff: core/src/main/java/org/apache/spark/unsafe/map/BytesToBytesMap.java --- @@ -219,61 +232,156 @@ public BytesToBytesMap( */ public

[GitHub] spark pull request: [SPARK-11385][ML][WIP] foreach added to mllib....

2015-10-29 Thread srowen
Github user srowen commented on a diff in the pull request: https://github.com/apache/spark/pull/9362#discussion_r43455187 --- Diff: mllib/src/main/scala/org/apache/spark/mllib/linalg/Vectors.scala --- @@ -712,6 +722,9 @@ class SparseVector @Since("1.0.0") ( } }

[GitHub] spark pull request: [SPARK-10827] [CORE] AppClient should not use ...

2015-10-29 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/9317#issuecomment-152351699 Test FAILed. Refer to this link for build results (access rights to CI server needed):

[GitHub] spark pull request: [SPARK-10827] [CORE] AppClient should not use ...

2015-10-29 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/9317#issuecomment-152351632 **[Test build #44639 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/44639/consoleFull)** for PR 9317 at commit

[GitHub] spark pull request: [SPARK-9858][SPARK-9859][SPARK-9861][SQL] Add ...

2015-10-29 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/9276#issuecomment-152352253 **[Test build #44638 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/44638/consoleFull)** for PR 9276 at commit

[GitHub] spark pull request: [SPARK-11301][SQL] fix case sensitivity for fi...

2015-10-29 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/9271#issuecomment-152351943 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your

[GitHub] spark pull request: [SPARK-11301][SQL] fix case sensitivity for fi...

2015-10-29 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/9271#issuecomment-152351944 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] spark pull request: [SPARK-10342] [SPARK-10309] [SPARK-10474] [SPA...

2015-10-29 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/9241#issuecomment-152352991 **[Test build #44631 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/44631/consoleFull)** for PR 9241 at commit

[GitHub] spark pull request: [SPARK-10342] [SPARK-10309] [SPARK-10474] [SPA...

2015-10-29 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/9241#issuecomment-152353139 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your

[GitHub] spark pull request: [SPARK-11188][SQL] Elide stacktraces in bin/sp...

2015-10-29 Thread dilipbiswal
Github user dilipbiswal commented on the pull request: https://github.com/apache/spark/pull/9194#issuecomment-152253043 @marmbrus Took out "WIP" and also changed the description. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as

[GitHub] spark pull request: [SPARK-11207][ML] Add test cases for solver se...

2015-10-29 Thread dbtsai
Github user dbtsai commented on a diff in the pull request: https://github.com/apache/spark/pull/9180#discussion_r43418162 --- Diff: mllib/src/test/scala/org/apache/spark/ml/regression/LinearRegressionSuite.scala --- @@ -34,6 +34,7 @@ class LinearRegressionSuite extends

[GitHub] spark pull request: [SPARK-11207][ML] Add test cases for solver se...

2015-10-29 Thread dbtsai
Github user dbtsai commented on a diff in the pull request: https://github.com/apache/spark/pull/9180#discussion_r43418378 --- Diff: mllib/src/main/scala/org/apache/spark/mllib/util/LinearDataGenerator.scala --- @@ -104,7 +103,35 @@ object LinearDataGenerator { nPoints:

[GitHub] spark pull request: [SPARK-11024][SQL] Optimize NULL in

2015-10-29 Thread dilipbiswal
Github user dilipbiswal commented on a diff in the pull request: https://github.com/apache/spark/pull/9348#discussion_r43419241 --- Diff: sql/catalyst/src/test/scala/org/apache/spark/sql/catalyst/optimizer/OptimizeInSuite.scala --- @@ -36,6 +36,7 @@ class OptimizeInSuite extends

[GitHub] spark pull request: [SPARK-6517][mllib] Implement the Algorithm of...

2015-10-29 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/5267#issuecomment-152262191 **[Test build #44615 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/44615/consoleFull)** for PR 5267 at commit

[GitHub] spark pull request: [SPARK-11207][ML] Add test cases for solver se...

2015-10-29 Thread dbtsai
Github user dbtsai commented on a diff in the pull request: https://github.com/apache/spark/pull/9180#discussion_r43419153 --- Diff: mllib/src/main/scala/org/apache/spark/mllib/util/LinearDataGenerator.scala --- @@ -112,8 +139,13 @@ object LinearDataGenerator { x.foreach

[GitHub] spark pull request: [SPARK-11383][Docs] Replaced example code in m...

2015-10-29 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/9353#issuecomment-152266167 Merged build started. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not

[GitHub] spark pull request: [SPARK-11383][Docs] Replaced example code in m...

2015-10-29 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/9353#issuecomment-152266138 Merged build triggered. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not

[GitHub] spark pull request: SPARK-11406: Patch for a utf-8 decode issue th...

2015-10-29 Thread tdas
Github user tdas commented on the pull request: https://github.com/apache/spark/pull/9360#issuecomment-152364046 ok to test --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark pull request: SPARK-11406: Patch for a utf-8 decode issue th...

2015-10-29 Thread tdas
Github user tdas commented on the pull request: https://github.com/apache/spark/pull/9360#issuecomment-152364038 this is ok to test --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this

[GitHub] spark pull request: [SPARK-10890][SQL] don't log expected JdbcSQLE...

2015-10-29 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/9345#issuecomment-152364190 Merged build started. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not

[GitHub] spark pull request: [SPARK-10890][SQL] don't log expected JdbcSQLE...

2015-10-29 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/9345#issuecomment-152364166 Merged build triggered. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not

[GitHub] spark pull request: SPARK-11406: Patch for a utf-8 decode issue th...

2015-10-29 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/9360#issuecomment-152364191 Merged build started. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not

[GitHub] spark pull request: SPARK-11406: Patch for a utf-8 decode issue th...

2015-10-29 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/9360#issuecomment-152364163 Merged build triggered. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not

[GitHub] spark pull request: [SPARK-11057] [SQL] Add correlation and covari...

2015-10-29 Thread NarineK
GitHub user NarineK opened a pull request: https://github.com/apache/spark/pull/9366 [SPARK-11057] [SQL] Add correlation and covariance matrices Hi there, As we know R has the option to calculate the correlation and covariance for all columns of a dataframe or between

[GitHub] spark pull request: SPARK-11406: Patch for a utf-8 decode issue th...

2015-10-29 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/9360#issuecomment-152365313 **[Test build #44649 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/44649/consoleFull)** for PR 9360 at commit

[GitHub] spark pull request: [SPARK-10342] [SPARK-10309] [SPARK-10474] [SPA...

2015-10-29 Thread JoshRosen
Github user JoshRosen commented on a diff in the pull request: https://github.com/apache/spark/pull/9241#discussion_r43461487 --- Diff: core/src/main/java/org/apache/spark/unsafe/map/BytesToBytesMap.java --- @@ -531,113 +645,59 @@ public int getValueLength() { * @return

[GitHub] spark pull request: [SPARK-11057] [SQL] Add correlation and covari...

2015-10-29 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/9366#issuecomment-152366240 Merged build started. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not

[GitHub] spark pull request: [SPARK-10342] [SPARK-10309] [SPARK-10474] [SPA...

2015-10-29 Thread JoshRosen
Github user JoshRosen commented on a diff in the pull request: https://github.com/apache/spark/pull/9241#discussion_r43461576 --- Diff: core/src/main/java/org/apache/spark/unsafe/map/BytesToBytesMap.java --- @@ -531,113 +645,59 @@ public int getValueLength() { * @return

[GitHub] spark pull request: [SPARK-10342] [SPARK-10309] [SPARK-10474] [SPA...

2015-10-29 Thread JoshRosen
Github user JoshRosen commented on a diff in the pull request: https://github.com/apache/spark/pull/9241#discussion_r43461668 --- Diff: core/src/main/java/org/apache/spark/unsafe/map/BytesToBytesMap.java --- @@ -647,16 +707,24 @@ public boolean putNewKey( * Acquire a new

[GitHub] spark pull request: [SPARK-11057] [SQL] Add correlation and covari...

2015-10-29 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/9366#issuecomment-152366155 Merged build triggered. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not

[GitHub] spark pull request: [SPARK-11057] [SQL] Add correlation and covari...

2015-10-29 Thread NarineK
Github user NarineK commented on the pull request: https://github.com/apache/spark/pull/9366#issuecomment-152366433 @shivaram , @rxin , would you guys, please, take a look at this ? Thanks! --- If your project is set up for it, you can reply to this email and have your reply

[GitHub] spark pull request: [SPARK-10890][SQL] don't log expected JdbcSQLE...

2015-10-29 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/9345#issuecomment-152367762 **[Test build #44650 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/44650/consoleFull)** for PR 9345 at commit

[GitHub] spark pull request: [SPARK-11057] [SQL] Add correlation and covari...

2015-10-29 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/9366#issuecomment-152368326 **[Test build #44651 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/44651/consoleFull)** for PR 9366 at commit

[GitHub] spark pull request: SPARK-11406: Patch for a utf-8 decode issue th...

2015-10-29 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/9360#issuecomment-152369872 **[Test build #44649 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/44649/consoleFull)** for PR 9360 at commit

[GitHub] spark pull request: SPARK-11406: Patch for a utf-8 decode issue th...

2015-10-29 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/9360#issuecomment-152369960 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] spark pull request: SPARK-11406: Patch for a utf-8 decode issue th...

2015-10-29 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/9360#issuecomment-152369959 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your

[GitHub] spark pull request: [SPARK-10342] [SPARK-10309] [SPARK-10474] [SPA...

2015-10-29 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/9241#issuecomment-152370890 Merged build triggered. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not

[GitHub] spark pull request: [SPARK-10342] [SPARK-10309] [SPARK-10474] [SPA...

2015-10-29 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/9241#issuecomment-152370910 Merged build started. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not

[GitHub] spark pull request: [SPARK-10342] [SPARK-10309] [SPARK-10474] [SPA...

2015-10-29 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/9241#issuecomment-152371889 **[Test build #44652 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/44652/consoleFull)** for PR 9241 at commit

[GitHub] spark pull request: [SPARK-11195][CORE] Use correct classloader fo...

2015-10-29 Thread choochootrain
GitHub user choochootrain opened a pull request: https://github.com/apache/spark/pull/9367 [SPARK-11195][CORE] Use correct classloader for TaskResultGetter Make sure we are using the context classloader when deserializing failed TaskResults instead of the Spark classloader. You

[GitHub] spark pull request: [SPARK-11383][Docs] Replaced example code in m...

2015-10-29 Thread yinxusen
Github user yinxusen commented on a diff in the pull request: https://github.com/apache/spark/pull/9353#discussion_r43463517 --- Diff: examples/src/main/java/org/apache/spark/examples/mllib/JavaNaiveBayesExample.java --- @@ -0,0 +1,72 @@ +/* + * Licensed to the Apache

[GitHub] spark pull request: [SPARK-11383][Docs] Replaced example code in m...

2015-10-29 Thread yinxusen
Github user yinxusen commented on a diff in the pull request: https://github.com/apache/spark/pull/9353#discussion_r43463456 --- Diff: docs/mllib-isotonic-regression.md --- @@ -173,32 +83,7 @@ labels and real labels in the test set. Refer to the [`IsotonicRegression`

[GitHub] spark pull request: [SPARK-11383][Docs] Replaced example code in m...

2015-10-29 Thread yinxusen
Github user yinxusen commented on a diff in the pull request: https://github.com/apache/spark/pull/9353#discussion_r43463474 --- Diff: docs/mllib-naive-bayes.md --- @@ -124,33 +70,7 @@ Note that the Python API does not yet support model save/load but will in the fu

[GitHub] spark pull request: [SPARK-11383][Docs] Replaced example code in m...

2015-10-29 Thread yinxusen
Github user yinxusen commented on a diff in the pull request: https://github.com/apache/spark/pull/9353#discussion_r43463534 --- Diff: examples/src/main/scala/org/apache/spark/examples/mllib/IsotonicRegressionExample.scala --- @@ -0,0 +1,69 @@ +/* + * Licensed to the

[GitHub] spark pull request: [SPARK-11195][CORE] Use correct classloader fo...

2015-10-29 Thread JoshRosen
Github user JoshRosen commented on the pull request: https://github.com/apache/spark/pull/9367#issuecomment-152372506 Jenkins, this is ok to test. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not

[GitHub] spark pull request: [SPARK-11383][Docs] Replaced example code in m...

2015-10-29 Thread yinxusen
Github user yinxusen commented on the pull request: https://github.com/apache/spark/pull/9353#issuecomment-152372599 @mengxr This pr LGTM, except for some blank lines. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If

[GitHub] spark pull request: [SPARK-11195][CORE] Use correct classloader fo...

2015-10-29 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/9367#issuecomment-152372707 Can one of the admins verify this patch? --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your

[GitHub] spark pull request: [SPARK-9298][SQL] Add pearson correlation aggr...

2015-10-29 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/8587#issuecomment-152372756 Test FAILed. Refer to this link for build results (access rights to CI server needed):

[GitHub] spark pull request: [SPARK-9298][SQL] Add pearson correlation aggr...

2015-10-29 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/8587#issuecomment-152372702 **[Test build #44645 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/44645/consoleFull)** for PR 8587 at commit

[GitHub] spark pull request: [SPARK-9298][SQL] Add pearson correlation aggr...

2015-10-29 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/8587#issuecomment-152372753 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your

[GitHub] spark pull request: [SPARK-11195][CORE] Use correct classloader fo...

2015-10-29 Thread choochootrain
Github user choochootrain commented on the pull request: https://github.com/apache/spark/pull/9367#issuecomment-152372967 I have a manual test that exhibits this behavior in https://issues.apache.org/jira/browse/SPARK-11195 and I am working on adding a test to the repo. In

[GitHub] spark pull request: [SPARK-9298][SQL] Add pearson correlation aggr...

2015-10-29 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/8587#issuecomment-152354220 Merged build triggered. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not

[GitHub] spark pull request: [SPARK-9298][SQL] Add pearson correlation aggr...

2015-10-29 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/8587#issuecomment-152354238 Merged build started. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not

[GitHub] spark pull request: [SPARK-11385][ML][WIP] foreach added to mllib....

2015-10-29 Thread holdenk
Github user holdenk commented on a diff in the pull request: https://github.com/apache/spark/pull/9362#discussion_r43456658 --- Diff: mllib/src/main/scala/org/apache/spark/mllib/linalg/Vectors.scala --- @@ -712,6 +722,9 @@ class SparseVector @Since("1.0.0") ( } }

[GitHub] spark pull request: [SPARK-6517][mllib] Implement the Algorithm of...

2015-10-29 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/5267#issuecomment-152356488 **[Test build #44646 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/44646/consoleFull)** for PR 5267 at commit

[GitHub] spark pull request: [SPARK-10342] [SPARK-10309] [SPARK-10474] [SPA...

2015-10-29 Thread JoshRosen
Github user JoshRosen commented on a diff in the pull request: https://github.com/apache/spark/pull/9241#discussion_r43457537 --- Diff: core/src/main/java/org/apache/spark/memory/MemoryConsumer.java --- @@ -0,0 +1,131 @@ +/* + * Licensed to the Apache Software Foundation

[GitHub] spark pull request: [SPARK-10342] [SPARK-10309] [SPARK-10474] [SPA...

2015-10-29 Thread JoshRosen
Github user JoshRosen commented on a diff in the pull request: https://github.com/apache/spark/pull/9241#discussion_r43457661 --- Diff: core/src/main/java/org/apache/spark/memory/TaskMemoryManager.java --- @@ -101,29 +105,103 @@ private final boolean inHeap;

[GitHub] spark pull request: [SPARK-11301][SQL] fix case sensitivity for fi...

2015-10-29 Thread yhuai
Github user yhuai commented on the pull request: https://github.com/apache/spark/pull/9271#issuecomment-152357268 LGTM. Merging to master. Looks it will not apply cleanly with 1.5 branch. Can you have a separate pr for 1.5 branch? --- If your project is set up for it, you can reply

[GitHub] spark pull request: [SPARK-11301][SQL] fix case sensitivity for fi...

2015-10-29 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/spark/pull/9271 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is

[GitHub] spark pull request: SPARK-11371 Make "mean" an alias for "avg" ope...

2015-10-29 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/9332#issuecomment-152358017 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your

[GitHub] spark pull request: SPARK-11371 Make "mean" an alias for "avg" ope...

2015-10-29 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/9332#issuecomment-152358020 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] spark pull request: SPARK-11371 Make "mean" an alias for "avg" ope...

2015-10-29 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/9332#issuecomment-152357887 **[Test build #44640 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/44640/consoleFull)** for PR 9332 at commit

[GitHub] spark pull request: [SPARK-10890][SQL] don't log expected JdbcSQLE...

2015-10-29 Thread ckadner
Github user ckadner commented on the pull request: https://github.com/apache/spark/pull/9345#issuecomment-152357861 @**Rick**, I was running the `JDBCWriteSuite` in IntelliJ and each test case got setup with log `Level.DEBUG`, even if an unexpected `Exception` prevented resetting the

[GitHub] spark pull request: [SPARK-10342] [SPARK-10309] [SPARK-10474] [SPA...

2015-10-29 Thread davies
Github user davies commented on a diff in the pull request: https://github.com/apache/spark/pull/9241#discussion_r43458390 --- Diff: core/src/main/java/org/apache/spark/unsafe/map/BytesToBytesMap.java --- @@ -219,61 +232,156 @@ public BytesToBytesMap( */ public int

[GitHub] spark pull request: [SPARK-10342] [SPARK-10309] [SPARK-10474] [SPA...

2015-10-29 Thread JoshRosen
Github user JoshRosen commented on a diff in the pull request: https://github.com/apache/spark/pull/9241#discussion_r43458691 --- Diff: core/src/main/java/org/apache/spark/shuffle/sort/ShuffleExternalSorter.java --- @@ -353,15 +320,22 @@ private void growPointerArrayIfNecessary()

[GitHub] spark pull request: [SPARK-10342] [SPARK-10309] [SPARK-10474] [SPA...

2015-10-29 Thread JoshRosen
Github user JoshRosen commented on a diff in the pull request: https://github.com/apache/spark/pull/9241#discussion_r43459132 --- Diff: core/src/main/java/org/apache/spark/shuffle/sort/ShuffleInMemorySorter.java --- @@ -37,33 +37,52 @@ public int compare(PackedRecordPointer left,

[GitHub] spark pull request: [SPARK-11410] [SQL] Add APIs to provide functi...

2015-10-29 Thread nongli
Github user nongli commented on a diff in the pull request: https://github.com/apache/spark/pull/9364#discussion_r43459695 --- Diff: sql/core/src/test/scala/org/apache/spark/sql/DataFrameSuite.scala --- @@ -987,4 +992,116 @@ class DataFrameSuite extends QueryTest with

[GitHub] spark pull request: [SPARK-11024][SQL] Optimize NULL in

2015-10-29 Thread cloud-fan
Github user cloud-fan commented on the pull request: https://github.com/apache/spark/pull/9348#issuecomment-152361118 retest this please --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this

[GitHub] spark pull request: [SPARK-11024][SQL] Optimize NULL in

2015-10-29 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/9348#issuecomment-152361585 Merged build started. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not

[GitHub] spark pull request: [SPARK-11024][SQL] Optimize NULL in

2015-10-29 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/9348#issuecomment-152361575 Merged build triggered. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not

[GitHub] spark pull request: [SPARK-11207][ML] Add test cases for solver se...

2015-10-29 Thread Lewuathe
Github user Lewuathe commented on the pull request: https://github.com/apache/spark/pull/9180#issuecomment-152362069 @dbtsai Thank you so much for reviewing even you would busy in Spark Summit. I'll update. --- If your project is set up for it, you can reply to this email and have

<    1   2   3   4   5   6   7   8   9   10   >