[GitHub] spark pull request: [SPARK-9858][SPARK-9859][SPARK-9861][SQL] Add ...

2015-10-29 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/9276#issuecomment-152329755 **[Test build #44638 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/44638/consoleFull)** for PR 9276 at commit

[GitHub] spark pull request: [SPARK-11141][STREAMING] Batch ReceivedBlockTr...

2015-10-29 Thread tdas
Github user tdas commented on a diff in the pull request: https://github.com/apache/spark/pull/9143#discussion_r43446276 --- Diff: streaming/src/main/scala/org/apache/spark/streaming/scheduler/ReceivedBlockTracker.scala --- @@ -82,34 +85,45 @@ private[streaming] class

[GitHub] spark pull request: [SPARK-11141][STREAMING] Batch ReceivedBlockTr...

2015-10-29 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/9143#issuecomment-152304761 **[Test build #44627 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/44627/consoleFull)** for PR 9143 at commit

[GitHub] spark pull request: [SPARK-10186][SQL] Array types using JDBCRDD a...

2015-10-29 Thread mariusvniekerk
Github user mariusvniekerk commented on a diff in the pull request: https://github.com/apache/spark/pull/9137#discussion_r43437555 --- Diff: sql/core/src/main/scala/org/apache/spark/sql/jdbc/JdbcDialects.scala --- @@ -207,6 +225,25 @@ case object PostgresDialect extends

[GitHub] spark pull request: [SPARK-10532][EC2]Added --profile option to sp...

2015-10-29 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/spark/pull/8696 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is

[GitHub] spark pull request: [SPARK-11141][STREAMING] Batch ReceivedBlockTr...

2015-10-29 Thread tdas
Github user tdas commented on a diff in the pull request: https://github.com/apache/spark/pull/9143#discussion_r43438667 --- Diff: streaming/src/test/scala/org/apache/spark/streaming/util/WriteAheadLogSuite.scala --- @@ -102,6 +105,114 @@ class WriteAheadLogSuite extends

[GitHub] spark pull request: [SPARK-9926] [SPARK-10340] [SQL] Use S3 bulk l...

2015-10-29 Thread yhuai
Github user yhuai commented on a diff in the pull request: https://github.com/apache/spark/pull/8512#discussion_r43440241 --- Diff: core/src/main/scala/org/apache/spark/rdd/UnionRDD.scala --- @@ -62,7 +64,20 @@ class UnionRDD[T: ClassTag]( var rdds: Seq[RDD[T]])

[GitHub] spark pull request: [SPARK-9858][SPARK-9859][SPARK-9861][SQL] Add ...

2015-10-29 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/9276#issuecomment-152309854 Merged build started. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not

[GitHub] spark pull request: [SPARK-9858][SPARK-9859][SPARK-9861][SQL] Add ...

2015-10-29 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/9276#issuecomment-152309820 Merged build triggered. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not

[GitHub] spark pull request: [SPARK-11353][IO] Update jets3t version to 0.9...

2015-10-29 Thread JoshRosen
Github user JoshRosen commented on the pull request: https://github.com/apache/spark/pull/9306#issuecomment-152310270 Jenkins, retest this please. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not

[GitHub] spark pull request: [SPARK-10342] [SPARK-10309] [SPARK-10474] [SPA...

2015-10-29 Thread JoshRosen
Github user JoshRosen commented on a diff in the pull request: https://github.com/apache/spark/pull/9241#discussion_r43442582 --- Diff: core/src/main/java/org/apache/spark/memory/TaskMemoryManager.java --- @@ -101,29 +107,161 @@ private final boolean inHeap;

[GitHub] spark pull request: [SPARK-10342] [SPARK-10309] [SPARK-10474] [SPA...

2015-10-29 Thread JoshRosen
Github user JoshRosen commented on a diff in the pull request: https://github.com/apache/spark/pull/9241#discussion_r43443271 --- Diff: core/src/main/java/org/apache/spark/memory/MemoryConsumer.java --- @@ -0,0 +1,108 @@ +/* + * Licensed to the Apache Software Foundation

[GitHub] spark pull request: [SPARK-11301][SQL] fix case sensitivity for fi...

2015-10-29 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/9271#issuecomment-152327038 **[Test build #44636 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/44636/consoleFull)** for PR 9271 at commit

[GitHub] spark pull request: [SPARK-11301][SQL] fix case sensitivity for fi...

2015-10-29 Thread yhuai
Github user yhuai commented on the pull request: https://github.com/apache/spark/pull/9271#issuecomment-152327003 @cloud-fan Seems we also need to fix it in branch 1.5? --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If

[GitHub] spark pull request: [SPARK-10342] [SPARK-10309] [SPARK-10474] [SPA...

2015-10-29 Thread JoshRosen
Github user JoshRosen commented on a diff in the pull request: https://github.com/apache/spark/pull/9241#discussion_r4310 --- Diff: sql/core/src/test/scala/org/apache/spark/sql/execution/UnsafeFixedWidthAggregationMapSuite.scala --- @@ -193,10 +193,6 @@ class

[GitHub] spark pull request: [SPARK-10827] [CORE] AppClient should not use ...

2015-10-29 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/9317#issuecomment-152330856 Merged build started. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not

[GitHub] spark pull request: [SPARK-10827] [CORE] AppClient should not use ...

2015-10-29 Thread BryanCutler
Github user BryanCutler commented on the pull request: https://github.com/apache/spark/pull/9317#issuecomment-152330545 retest this please --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have

[GitHub] spark pull request: [SPARK-10827] [CORE] AppClient should not use ...

2015-10-29 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/9317#issuecomment-152330835 Merged build triggered. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not

[GitHub] spark pull request: [SPARK-11141][STREAMING] Batch ReceivedBlockTr...

2015-10-29 Thread tdas
Github user tdas commented on a diff in the pull request: https://github.com/apache/spark/pull/9143#discussion_r43445514 --- Diff: streaming/src/test/scala/org/apache/spark/streaming/util/WriteAheadLogSuite.scala --- @@ -102,6 +105,114 @@ class WriteAheadLogSuite extends

[GitHub] spark pull request: [SPARK-10342] [SPARK-10309] [SPARK-10474] [SPA...

2015-10-29 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/9241#issuecomment-152332873 **[Test build #44625 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/44625/consoleFull)** for PR 9241 at commit

[GitHub] spark pull request: [SPARK-10827] [CORE] AppClient should not use ...

2015-10-29 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/9317#issuecomment-152332806 **[Test build #44639 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/44639/consoleFull)** for PR 9317 at commit

[GitHub] spark pull request: [SPARK-10342] [SPARK-10309] [SPARK-10474] [SPA...

2015-10-29 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/9241#issuecomment-152333075 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] spark pull request: [SPARK-10342] [SPARK-10309] [SPARK-10474] [SPA...

2015-10-29 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/9241#issuecomment-152308300 **[Test build #44631 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/44631/consoleFull)** for PR 9241 at commit

[GitHub] spark pull request: [SPARK-11265] [YARN] YarnClient can't get toke...

2015-10-29 Thread steveloughran
Github user steveloughran commented on a diff in the pull request: https://github.com/apache/spark/pull/9232#discussion_r43439849 --- Diff: yarn/src/test/scala/org/apache/spark/deploy/yarn/YarnSparkHadoopUtilSuite.scala --- @@ -245,4 +247,55 @@ class YarnSparkHadoopUtilSuite

[GitHub] spark pull request: [SPARK-10342] [SPARK-10309] [SPARK-10474] [SPA...

2015-10-29 Thread JoshRosen
Github user JoshRosen commented on a diff in the pull request: https://github.com/apache/spark/pull/9241#discussion_r43442179 --- Diff: core/src/main/java/org/apache/spark/memory/TaskMemoryManager.java --- @@ -101,29 +107,161 @@ private final boolean inHeap;

[GitHub] spark pull request: [SPARK-11389][WIP][CORE] Add support for off-h...

2015-10-29 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/9344#issuecomment-152316822 **[Test build #44633 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/44633/consoleFull)** for PR 9344 at commit

[GitHub] spark pull request: [SPARK-10342] [SPARK-10309] [SPARK-10474] [SPA...

2015-10-29 Thread JoshRosen
Github user JoshRosen commented on a diff in the pull request: https://github.com/apache/spark/pull/9241#discussion_r43442805 --- Diff: core/src/main/java/org/apache/spark/memory/TaskMemoryManager.java --- @@ -261,17 +397,14 @@ public long getOffsetInPage(long

[GitHub] spark pull request: [SPARK-11340][SPARKR] Support setting driver p...

2015-10-29 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/9290#issuecomment-152324095 **[Test build #44624 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/44624/consoleFull)** for PR 9290 at commit

[GitHub] spark pull request: [SPARK-10342] [SPARK-10309] [SPARK-10474] [SPA...

2015-10-29 Thread JoshRosen
Github user JoshRosen commented on a diff in the pull request: https://github.com/apache/spark/pull/9241#discussion_r43444037 --- Diff: core/src/main/java/org/apache/spark/memory/TaskMemoryManager.java --- @@ -261,17 +397,14 @@ public long getOffsetInPage(long

[GitHub] spark pull request: [SPARK-10158] [PySpark] [MLlib] ALS better err...

2015-10-29 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/9361#issuecomment-152328151 **[Test build #44635 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/44635/consoleFull)** for PR 9361 at commit

[GitHub] spark pull request: [SPARK-11141][STREAMING] Batch ReceivedBlockTr...

2015-10-29 Thread tdas
Github user tdas commented on a diff in the pull request: https://github.com/apache/spark/pull/9143#discussion_r43446421 --- Diff: streaming/src/main/scala/org/apache/spark/streaming/scheduler/ReceivedBlockTracker.scala --- @@ -82,34 +85,45 @@ private[streaming] class

[GitHub] spark pull request: SPARK-11371 Make "mean" an alias for "avg" ope...

2015-10-29 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/9332#issuecomment-152336684 Merged build triggered. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not

[GitHub] spark pull request: [SPARK-11409][SPARKR] Enable url link in R doc...

2015-10-29 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/9363#issuecomment-152338795 Merged build started. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not

[GitHub] spark pull request: [SPARK-10158] [PySpark] [MLlib] ALS better err...

2015-10-29 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/9361#issuecomment-152338657 **[Test build #44635 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/44635/consoleFull)** for PR 9361 at commit

[GitHub] spark pull request: [SPARK-10158] [PySpark] [MLlib] ALS better err...

2015-10-29 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/9361#issuecomment-152338829 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] spark pull request: [SPARK-11409][SPARKR] Enable url link in R doc...

2015-10-29 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/9363#issuecomment-152338763 Merged build triggered. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not

[GitHub] spark pull request: [SPARK-10342] [SPARK-10309] [SPARK-10474] [SPA...

2015-10-29 Thread JoshRosen
Github user JoshRosen commented on a diff in the pull request: https://github.com/apache/spark/pull/9241#discussion_r43449396 --- Diff: core/src/main/java/org/apache/spark/shuffle/sort/ShuffleExternalSorter.java --- @@ -370,96 +344,45 @@ private void growPointerArrayIfNecessary()

[GitHub] spark pull request: [SPARK-10158] [PySpark] [MLlib] ALS better err...

2015-10-29 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/9361#issuecomment-152338826 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your

[GitHub] spark pull request: [SPARK-10342] [SPARK-10309] [SPARK-10474] [SPA...

2015-10-29 Thread davies
Github user davies commented on a diff in the pull request: https://github.com/apache/spark/pull/9241#discussion_r43449674 --- Diff: core/src/main/java/org/apache/spark/shuffle/sort/ShuffleExternalSorter.java --- @@ -370,96 +344,45 @@ private void growPointerArrayIfNecessary()

[GitHub] spark pull request: [SPARK-10342] [SPARK-10309] [SPARK-10474] [SPA...

2015-10-29 Thread davies
Github user davies commented on a diff in the pull request: https://github.com/apache/spark/pull/9241#discussion_r43449616 --- Diff: core/src/main/java/org/apache/spark/memory/TaskMemoryManager.java --- @@ -101,29 +107,161 @@ private final boolean inHeap; /**

[GitHub] spark pull request: [SPARK-11409][SPARKR] Enable url link in R doc...

2015-10-29 Thread shivaram
Github user shivaram commented on the pull request: https://github.com/apache/spark/pull/9363#issuecomment-152339112 LGTM. Thanks @felixcheung --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not

[GitHub] spark pull request: [SPARK-10342] [SPARK-10309] [SPARK-10474] [SPA...

2015-10-29 Thread JoshRosen
Github user JoshRosen commented on a diff in the pull request: https://github.com/apache/spark/pull/9241#discussion_r43450454 --- Diff: core/src/main/java/org/apache/spark/shuffle/sort/ShuffleExternalSorter.java --- @@ -370,96 +344,45 @@ private void growPointerArrayIfNecessary()

[GitHub] spark pull request: [SPARK-10342] [SPARK-10309] [SPARK-10474] [SPA...

2015-10-29 Thread JoshRosen
Github user JoshRosen commented on a diff in the pull request: https://github.com/apache/spark/pull/9241#discussion_r43450295 --- Diff: core/src/main/java/org/apache/spark/shuffle/sort/ShuffleExternalSorter.java --- @@ -353,15 +320,22 @@ private void growPointerArrayIfNecessary()

[GitHub] spark pull request: [SPARK-11410] [SQL] Add APIs to provide functi...

2015-10-29 Thread yhuai
Github user yhuai commented on the pull request: https://github.com/apache/spark/pull/9364#issuecomment-152341432 ok to test. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark pull request: [SPARK-6517][mllib] Implement the Algorithm of...

2015-10-29 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/5267#issuecomment-152342812 Merged build started. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not

[GitHub] spark pull request: [SPARK-6517][mllib] Implement the Algorithm of...

2015-10-29 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/5267#issuecomment-152342783 Merged build triggered. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not

[GitHub] spark pull request: [SPARK-11353][IO] Update jets3t version to 0.9...

2015-10-29 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/9306#issuecomment-152343026 **[Test build #44634 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/44634/consoleFull)** for PR 9306 at commit

[GitHub] spark pull request: SPARK-11406: Patch for a utf-8 decode issue th...

2015-10-29 Thread tdas
Github user tdas commented on the pull request: https://github.com/apache/spark/pull/9360#issuecomment-152343661 Good catch. Could you add unit tests for this. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your

[GitHub] spark pull request: [SPARK-8992] [SQL] Add pivot to dataframe api

2015-10-29 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/7841#issuecomment-152343672 Merged build triggered. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not

[GitHub] spark pull request: [SPARK-11410] [SQL] Add APIs to provide functi...

2015-10-29 Thread yhuai
Github user yhuai commented on a diff in the pull request: https://github.com/apache/spark/pull/9364#discussion_r43452005 --- Diff: sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/plans/logical/partitioning.scala --- @@ -38,3 +38,11 @@ case class

[GitHub] spark pull request: SPARK-11406: Patch for a utf-8 decode issue th...

2015-10-29 Thread tdas
Github user tdas commented on the pull request: https://github.com/apache/spark/pull/9360#issuecomment-152343626 ok to test. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark pull request: [SPARK-8992] [SQL] Add pivot to dataframe api

2015-10-29 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/7841#issuecomment-152343703 Merged build started. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not

[GitHub] spark pull request: [SPARK-11410] [SQL] Add APIs to provide functi...

2015-10-29 Thread yhuai
Github user yhuai commented on a diff in the pull request: https://github.com/apache/spark/pull/9364#discussion_r43452473 --- Diff: sql/core/src/test/scala/org/apache/spark/sql/DataFrameSuite.scala --- @@ -987,4 +992,116 @@ class DataFrameSuite extends QueryTest with

[GitHub] spark pull request: [SPARK-10342] [SPARK-10309] [SPARK-10474] [SPA...

2015-10-29 Thread JoshRosen
Github user JoshRosen commented on a diff in the pull request: https://github.com/apache/spark/pull/9241#discussion_r43452672 --- Diff: core/src/main/java/org/apache/spark/unsafe/map/BytesToBytesMap.java --- @@ -219,61 +232,156 @@ public BytesToBytesMap( */ public

[GitHub] spark pull request: [SPARK-11410] [SQL] Add APIs to provide functi...

2015-10-29 Thread yhuai
Github user yhuai commented on a diff in the pull request: https://github.com/apache/spark/pull/9364#discussion_r43452642 --- Diff: sql/core/src/test/scala/org/apache/spark/sql/DataFrameSuite.scala --- @@ -987,4 +992,116 @@ class DataFrameSuite extends QueryTest with

[GitHub] spark pull request: [SPARK-11410] [SQL] Add APIs to provide functi...

2015-10-29 Thread yhuai
Github user yhuai commented on a diff in the pull request: https://github.com/apache/spark/pull/9364#discussion_r43452622 --- Diff: sql/core/src/test/scala/org/apache/spark/sql/DataFrameSuite.scala --- @@ -987,4 +992,116 @@ class DataFrameSuite extends QueryTest with

[GitHub] spark pull request: [SPARK-10342] [SPARK-10309] [SPARK-10474] [SPA...

2015-10-29 Thread davies
Github user davies commented on a diff in the pull request: https://github.com/apache/spark/pull/9241#discussion_r43452944 --- Diff: core/src/main/java/org/apache/spark/unsafe/map/BytesToBytesMap.java --- @@ -219,61 +232,156 @@ public BytesToBytesMap( */ public int

[GitHub] spark pull request: [SPARK-11410] [SQL] Add APIs to provide functi...

2015-10-29 Thread yhuai
Github user yhuai commented on a diff in the pull request: https://github.com/apache/spark/pull/9364#discussion_r43453259 --- Diff: sql/core/src/main/scala/org/apache/spark/sql/DataFrame.scala --- @@ -663,6 +667,35 @@ class DataFrame private[sql]( def orderBy(sortExprs:

[GitHub] spark pull request: [SPARK-9298][SQL] Add pearson correlation aggr...

2015-10-29 Thread viirya
Github user viirya commented on a diff in the pull request: https://github.com/apache/spark/pull/8587#discussion_r43453305 --- Diff: sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/expressions/aggregate/functions.scala --- @@ -524,6 +525,116 @@ case class Sum(child:

[GitHub] spark pull request: [SPARK-10342] [SPARK-10309] [SPARK-10474] [SPA...

2015-10-29 Thread JoshRosen
Github user JoshRosen commented on a diff in the pull request: https://github.com/apache/spark/pull/9241#discussion_r43454317 --- Diff: core/src/main/java/org/apache/spark/unsafe/map/BytesToBytesMap.java --- @@ -219,61 +232,156 @@ public BytesToBytesMap( */ public

[GitHub] spark pull request: [SPARK-6517][mllib] Implement the Algorithm of...

2015-10-29 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/5267#issuecomment-152350863 **[Test build #44642 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/44642/consoleFull)** for PR 5267 at commit

[GitHub] spark pull request: [SPARK-10342] [SPARK-10309] [SPARK-10474] [SPA...

2015-10-29 Thread JoshRosen
Github user JoshRosen commented on a diff in the pull request: https://github.com/apache/spark/pull/9241#discussion_r43454924 --- Diff: core/src/main/java/org/apache/spark/unsafe/map/BytesToBytesMap.java --- @@ -444,6 +545,19 @@ private Location with(MemoryBlock page, long

[GitHub] spark pull request: [SPARK-6517][mllib] Implement the Algorithm of...

2015-10-29 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/5267#issuecomment-152350977 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] spark pull request: [SPARK-11385][ML][WIP] foreach added to mllib....

2015-10-29 Thread holdenk
Github user holdenk commented on a diff in the pull request: https://github.com/apache/spark/pull/9362#discussion_r43455038 --- Diff: mllib/src/main/scala/org/apache/spark/mllib/linalg/Vectors.scala --- @@ -712,6 +722,9 @@ class SparseVector @Since("1.0.0") ( } }

[GitHub] spark pull request: [SPARK-6517][mllib] Implement the Algorithm of...

2015-10-29 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/5267#issuecomment-152350975 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your

[GitHub] spark pull request: SPARK-11371 Make "mean" an alias for "avg" ope...

2015-10-29 Thread JoshRosen
Github user JoshRosen commented on the pull request: https://github.com/apache/spark/pull/9332#issuecomment-152336532 jenkins add to whitelist --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have

[GitHub] spark pull request: SPARK-11371 Make "mean" an alias for "avg" ope...

2015-10-29 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/9332#issuecomment-152336713 Merged build started. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not

[GitHub] spark pull request: SPARK-11371 Make "mean" an alias for "avg" ope...

2015-10-29 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/9332#issuecomment-152337487 **[Test build #44640 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/44640/consoleFull)** for PR 9332 at commit

[GitHub] spark pull request: [SPARK-10342] [SPARK-10309] [SPARK-10474] [SPA...

2015-10-29 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/9241#issuecomment-152338462 **[Test build #44629 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/44629/consoleFull)** for PR 9241 at commit

[GitHub] spark pull request: [SPARK-10342] [SPARK-10309] [SPARK-10474] [SPA...

2015-10-29 Thread JoshRosen
Github user JoshRosen commented on a diff in the pull request: https://github.com/apache/spark/pull/9241#discussion_r43449223 --- Diff: core/src/main/java/org/apache/spark/shuffle/sort/ShuffleExternalSorter.java --- @@ -108,42 +102,20 @@ public ShuffleExternalSorter(

[GitHub] spark pull request: [SPARK-11141][STREAMING] Batch ReceivedBlockTr...

2015-10-29 Thread tdas
Github user tdas commented on a diff in the pull request: https://github.com/apache/spark/pull/9143#discussion_r43451078 --- Diff: streaming/src/main/scala/org/apache/spark/streaming/scheduler/ReceivedBlockTracker.scala --- @@ -195,30 +219,35 @@ private[streaming] class

[GitHub] spark pull request: [SPARK-11409][SPARKR] Enable url link in R doc...

2015-10-29 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/9363#issuecomment-152342539 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your

[GitHub] spark pull request: [SPARK-2827][GraphX] Add collectDegreeDist to ...

2015-10-29 Thread maropu
Github user maropu commented on the pull request: https://github.com/apache/spark/pull/4399#issuecomment-152342718 Ok, I'll fix it. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this

[GitHub] spark pull request: [SPARK-9298][SQL] Add pearson correlation aggr...

2015-10-29 Thread viirya
Github user viirya commented on a diff in the pull request: https://github.com/apache/spark/pull/8587#discussion_r43451783 --- Diff: sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/expressions/aggregate/functions.scala --- @@ -524,6 +525,133 @@ case class Sum(child:

[GitHub] spark pull request: [SPARK-11236][CORE] Update Tachyon dependency ...

2015-10-29 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/spark/pull/9204 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is

[GitHub] spark pull request: [SPARK-9298][SQL] Add pearson correlation aggr...

2015-10-29 Thread viirya
Github user viirya commented on a diff in the pull request: https://github.com/apache/spark/pull/8587#discussion_r43452255 --- Diff: sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/expressions/aggregates.scala --- @@ -747,6 +747,19 @@ case class LastFunction( }

[GitHub] spark pull request: [SPARK-11410] [SQL] Add APIs to provide functi...

2015-10-29 Thread yhuai
Github user yhuai commented on a diff in the pull request: https://github.com/apache/spark/pull/9364#discussion_r43452307 --- Diff: sql/core/src/test/scala/org/apache/spark/sql/DataFrameSuite.scala --- @@ -19,6 +19,11 @@ package org.apache.spark.sql import java.io.File

[GitHub] spark pull request: [SPARK-11410] [SQL] Add APIs to provide functi...

2015-10-29 Thread yhuai
Github user yhuai commented on a diff in the pull request: https://github.com/apache/spark/pull/9364#discussion_r43452264 --- Diff: sql/core/src/main/scala/org/apache/spark/sql/DataFrame.scala --- @@ -663,6 +667,35 @@ class DataFrame private[sql]( def orderBy(sortExprs:

[GitHub] spark pull request: SPARK-11406: Patch for a utf-8 decode issue th...

2015-10-29 Thread tdas
Github user tdas commented on a diff in the pull request: https://github.com/apache/spark/pull/9360#discussion_r43452162 --- Diff: python/pyspark/streaming/kinesis.py --- @@ -26,6 +26,7 @@ def utf8_decoder(s): """ Decode the unicode as UTF-8 """ +s =

[GitHub] spark pull request: [SPARK-10046] [SQL] Hive warehouse dir not set...

2015-10-29 Thread xwu0226
GitHub user xwu0226 opened a pull request: https://github.com/apache/spark/pull/9365 [SPARK-10046] [SQL] Hive warehouse dir not set in current directory when not … Doc change to align with HiveConf default in terms of where to create `warehouse` directory. You can merge this

[GitHub] spark pull request: [SPARK-10046] [SQL] Hive warehouse dir not set...

2015-10-29 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/9365#issuecomment-152344617 Can one of the admins verify this patch? --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your

[GitHub] spark pull request: [SPARK-10342] [SPARK-10309] [SPARK-10474] [SPA...

2015-10-29 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/9241#issuecomment-152346334 Merged build started. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not

[GitHub] spark pull request: [SPARK-11389][WIP][CORE] Add support for off-h...

2015-10-29 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/9344#issuecomment-152346289 **[Test build #44633 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/44633/consoleFull)** for PR 9344 at commit

[GitHub] spark pull request: [SPARK-10342] [SPARK-10309] [SPARK-10474] [SPA...

2015-10-29 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/9241#issuecomment-152346305 Merged build triggered. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not

[GitHub] spark pull request: [SPARK-10342] [SPARK-10309] [SPARK-10474] [SPA...

2015-10-29 Thread JoshRosen
Github user JoshRosen commented on a diff in the pull request: https://github.com/apache/spark/pull/9241#discussion_r43453011 --- Diff: core/src/main/java/org/apache/spark/unsafe/map/BytesToBytesMap.java --- @@ -219,61 +232,156 @@ public BytesToBytesMap( */ public

[GitHub] spark pull request: [SPARK-11389][WIP][CORE] Add support for off-h...

2015-10-29 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/9344#issuecomment-152346342 Test FAILed. Refer to this link for build results (access rights to CI server needed):

[GitHub] spark pull request: [SPARK-11410] [SQL] Add APIs to provide functi...

2015-10-29 Thread yhuai
Github user yhuai commented on a diff in the pull request: https://github.com/apache/spark/pull/9364#discussion_r43453065 --- Diff: sql/core/src/test/scala/org/apache/spark/sql/DataFrameSuite.scala --- @@ -987,4 +992,116 @@ class DataFrameSuite extends QueryTest with

[GitHub] spark pull request: [SPARK-10342] [SPARK-10309] [SPARK-10474] [SPA...

2015-10-29 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/9241#issuecomment-152347313 **[Test build #44644 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/44644/consoleFull)** for PR 9241 at commit

[GitHub] spark pull request: Fix typo in AggregationQuerySuite.scala

2015-10-29 Thread srowen
Github user srowen commented on the pull request: https://github.com/apache/spark/pull/9357#issuecomment-152351375 That's OK; almost not worth bothering with. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your

[GitHub] spark pull request: SPARK-6541 - Sort executors by ID (numeric)

2015-10-29 Thread srowen
Github user srowen commented on a diff in the pull request: https://github.com/apache/spark/pull/9165#discussion_r43455437 --- Diff: core/src/main/scala/org/apache/spark/ui/jobs/ExecutorTable.scala --- @@ -102,7 +102,7 @@ private[ui] class ExecutorTable(stageId: Int,

[GitHub] spark pull request: [SPARK-11301][SQL] fix case sensitivity for fi...

2015-10-29 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/9271#issuecomment-152351834 **[Test build #44636 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/44636/consoleFull)** for PR 9271 at commit

[GitHub] spark pull request: [SPARK-9858][SPARK-9859][SPARK-9861][SQL] Add ...

2015-10-29 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/9276#issuecomment-152352368 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your

[GitHub] spark pull request: [SPARK-9858][SPARK-9859][SPARK-9861][SQL] Add ...

2015-10-29 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/9276#issuecomment-152352371 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] spark pull request: [SPARK-10827] [CORE] AppClient should not use ...

2015-10-29 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/9317#issuecomment-152351698 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your

[GitHub] spark pull request: [SPARK-11385][ML][WIP] foreach added to mllib....

2015-10-29 Thread holdenk
Github user holdenk commented on a diff in the pull request: https://github.com/apache/spark/pull/9362#discussion_r43455921 --- Diff: mllib/src/main/scala/org/apache/spark/mllib/linalg/Vectors.scala --- @@ -712,6 +722,9 @@ class SparseVector @Since("1.0.0") ( } }

[GitHub] spark pull request: [SPARK-10342] [SPARK-10309] [SPARK-10474] [SPA...

2015-10-29 Thread JoshRosen
Github user JoshRosen commented on a diff in the pull request: https://github.com/apache/spark/pull/9241#discussion_r43448501 --- Diff: sql/core/src/test/scala/org/apache/spark/sql/execution/UnsafeFixedWidthAggregationMapSuite.scala --- @@ -193,10 +193,6 @@ class

[GitHub] spark pull request: [SPARK-10342] [SPARK-10309] [SPARK-10474] [SPA...

2015-10-29 Thread JoshRosen
Github user JoshRosen commented on a diff in the pull request: https://github.com/apache/spark/pull/9241#discussion_r43448855 --- Diff: core/src/main/java/org/apache/spark/shuffle/sort/ShuffleExternalSorter.java --- @@ -108,42 +102,20 @@ public ShuffleExternalSorter(

[GitHub] spark pull request: [SPARK-11409][SPARKR] Enable url link in R doc...

2015-10-29 Thread felixcheung
GitHub user felixcheung opened a pull request: https://github.com/apache/spark/pull/9363 [SPARK-11409][SPARKR] Enable url link in R doc for Persist Quick one line doc fix link is not clickable

[GitHub] spark pull request: [SPARK-10342] [SPARK-10309] [SPARK-10474] [SPA...

2015-10-29 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/9241#issuecomment-152338548 Test FAILed. Refer to this link for build results (access rights to CI server needed):

[GitHub] spark pull request: [SPARK-10342] [SPARK-10309] [SPARK-10474] [SPA...

2015-10-29 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/9241#issuecomment-152338544 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your

<    1   2   3   4   5   6   7   8   9   10   >