[GitHub] spark pull request: [SPARK-4939] revive offers periodically in Loc...

2015-02-03 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/spark/pull/4147 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is

[GitHub] spark pull request: [SPARK-5578][SQL][DataFrame] Provide a conveni...

2015-02-03 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/spark/pull/4345 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is

[GitHub] spark pull request: [SPARK-4795][Core] Redesign the primitive typ...

2015-02-03 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/spark/pull/3642 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is

[GitHub] spark pull request: [SPARK-4587] [mllib] ML model import/export

2015-02-03 Thread selvinsource
Github user selvinsource commented on a diff in the pull request: https://github.com/apache/spark/pull/4233#discussion_r24066997 --- Diff: mllib/src/main/scala/org/apache/spark/mllib/classification/LogisticRegression.scala --- @@ -17,14 +17,17 @@ package

[GitHub] spark pull request: [SPARK-5484] Checkpoint every 25 iterations in...

2015-02-03 Thread maropu
Github user maropu commented on the pull request: https://github.com/apache/spark/pull/4273#issuecomment-72804614 And also, this issue seems to be related to SPARK-5561. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If

[GitHub] spark pull request: [SPARK-5068] [SQL] Fix bug query data when pat...

2015-02-03 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/4356#issuecomment-72805635 [Test build #26729 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/26729/consoleFull) for PR 4356 at commit

[GitHub] spark pull request: [SPARK-5068] [SQL] Fix bug query data when pat...

2015-02-03 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/4356#issuecomment-72805642 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] spark pull request: [SPARK-5068] [SQL] Fix bug query data when pat...

2015-02-03 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/4356#issuecomment-72799255 [Test build #26729 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/26729/consoleFull) for PR 4356 at commit

[GitHub] spark pull request: [SPARK-4939] move to next locality when no pen...

2015-02-03 Thread kayousterhout
Github user kayousterhout commented on a diff in the pull request: https://github.com/apache/spark/pull/3779#discussion_r24065502 --- Diff: core/src/main/scala/org/apache/spark/scheduler/TaskSetManager.scala --- @@ -506,13 +506,59 @@ private[spark] class TaskSetManager( *

[GitHub] spark pull request: [SPARK-4939] move to next locality when no pen...

2015-02-03 Thread davies
Github user davies commented on a diff in the pull request: https://github.com/apache/spark/pull/3779#discussion_r24066639 --- Diff: core/src/main/scala/org/apache/spark/scheduler/TaskSetManager.scala --- @@ -506,13 +506,59 @@ private[spark] class TaskSetManager( * Get the

[GitHub] spark pull request: [SPARK-4939] move to next locality when no pen...

2015-02-03 Thread davies
Github user davies commented on the pull request: https://github.com/apache/spark/pull/3779#issuecomment-72803247 @kayousterhout @markhamstra @JoshRosen I should had addressed all your comments, they are very helpful, thanks you all! --- If your project is set up for it, you can

[GitHub] spark pull request: [SPARK-4939] move to next locality when no pen...

2015-02-03 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/3779#issuecomment-72803322 [Test build #26732 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/26732/consoleFull) for PR 3779 at commit

[GitHub] spark pull request: [SPARK-4969][STREAMING][PYTHON] Add binaryReco...

2015-02-03 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/3803#issuecomment-72799033 [Test build #26725 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/26725/consoleFull) for PR 3803 at commit

[GitHub] spark pull request: [SPARK-4939] move to next locality when no pen...

2015-02-03 Thread kayousterhout
Github user kayousterhout commented on a diff in the pull request: https://github.com/apache/spark/pull/3779#discussion_r24065454 --- Diff: core/src/main/scala/org/apache/spark/scheduler/TaskSetManager.scala --- @@ -506,13 +506,59 @@ private[spark] class TaskSetManager( *

[GitHub] spark pull request: [SPARK-4939] move to next locality when no pen...

2015-02-03 Thread davies
Github user davies commented on a diff in the pull request: https://github.com/apache/spark/pull/3779#discussion_r24065965 --- Diff: core/src/main/scala/org/apache/spark/scheduler/TaskSetManager.scala --- @@ -506,13 +506,59 @@ private[spark] class TaskSetManager( * Get the

[GitHub] spark pull request: [SPARK-4939] move to next locality when no pen...

2015-02-03 Thread kayousterhout
Github user kayousterhout commented on the pull request: https://github.com/apache/spark/pull/3779#issuecomment-72800486 Echoing the comments from @markhamstra and @JoshRosen, this change looks correct but is very subtle, so it would be great to improve the commenting throughout to

[GitHub] spark pull request: [SPARK-5587][SQL] Support change database owne...

2015-02-03 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/4357#issuecomment-72800621 [Test build #26730 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/26730/consoleFull) for PR 4357 at commit

[GitHub] spark pull request: [SPARK-4939] move to next locality when no pen...

2015-02-03 Thread davies
Github user davies commented on a diff in the pull request: https://github.com/apache/spark/pull/3779#discussion_r24067444 --- Diff: core/src/main/scala/org/apache/spark/scheduler/TaskSetManager.scala --- @@ -506,13 +506,63 @@ private[spark] class TaskSetManager( * Get the

[GitHub] spark pull request: [SPARK-2945][YARN][Doc]add doc for spark.execu...

2015-02-03 Thread WangTaoTheTonic
Github user WangTaoTheTonic commented on the pull request: https://github.com/apache/spark/pull/4350#issuecomment-72799695 Seems like the UT has broken, but I think it is unralted with this patch. --- If your project is set up for it, you can reply to this email and have your reply

[GitHub] spark pull request: [SPARK-4939] move to next locality when no pen...

2015-02-03 Thread davies
Github user davies commented on a diff in the pull request: https://github.com/apache/spark/pull/3779#discussion_r24066617 --- Diff: core/src/main/scala/org/apache/spark/scheduler/TaskSetManager.scala --- @@ -506,13 +506,59 @@ private[spark] class TaskSetManager( * Get the

[GitHub] spark pull request: [SPARK-4939] move to next locality when no pen...

2015-02-03 Thread markhamstra
Github user markhamstra commented on a diff in the pull request: https://github.com/apache/spark/pull/3779#discussion_r24067073 --- Diff: core/src/main/scala/org/apache/spark/scheduler/TaskSetManager.scala --- @@ -506,13 +506,63 @@ private[spark] class TaskSetManager( *

[GitHub] spark pull request: [SQL] Minor changes for DataFrame Implementati...

2015-02-03 Thread chenghao-intel
GitHub user chenghao-intel opened a pull request: https://github.com/apache/spark/pull/4339 [SQL] Minor changes for DataFrame Implementation You can merge this pull request into a Git repository by running: $ git pull https://github.com/chenghao-intel/spark dataframe_minor2

[GitHub] spark pull request: [SPARK-4964] [Streaming] Exactly-once semantic...

2015-02-03 Thread dibbhatt
Github user dibbhatt commented on a diff in the pull request: https://github.com/apache/spark/pull/3798#discussion_r24010956 --- Diff: external/kafka/src/main/scala/org/apache/spark/streaming/kafka/KafkaCluster.scala --- @@ -0,0 +1,344 @@ +/* + * Licensed to the Apache

[GitHub] spark pull request: [SQL] Minor changes for DataFrame Implementati...

2015-02-03 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/4339#issuecomment-72664280 [Test build #26655 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/26655/consoleFull) for PR 4339 at commit

[GitHub] spark pull request: [SPARK-5498][SQL]fix bug when query the data w...

2015-02-03 Thread chenghao-intel
Github user chenghao-intel commented on the pull request: https://github.com/apache/spark/pull/4289#issuecomment-72671869 Sorry for the late reply @jeanlyn ! I think it's a bug of Hive DDL, which probably was resolved in Hive 0.14 / 0.15, and I am not sure if we really want to fix

[GitHub] spark pull request: [STREAMING] SPARK-4986 Wait for receivers to d...

2015-02-03 Thread cleaton
GitHub user cleaton opened a pull request: https://github.com/apache/spark/pull/4338 [STREAMING] SPARK-4986 Wait for receivers to deregister and receiver job to terminate A slow receiver might not have enough time to shutdown cleanly even when graceful shutdown is used. This PR

[GitHub] spark pull request: [STREAMING] SPARK-4986 Wait for receivers to d...

2015-02-03 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/4338#issuecomment-72662235 Can one of the admins verify this patch? --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your

[GitHub] spark pull request: [SQL] Minor changes for dataframe implementati...

2015-02-03 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/4336#issuecomment-72667971 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] spark pull request: [SQL] Minor changes for dataframe implementati...

2015-02-03 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/4336#issuecomment-72667963 [Test build #26653 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/26653/consoleFull) for PR 4336 at commit

[GitHub] spark pull request: [STREAMING] SPARK-4986 Wait for receivers to d...

2015-02-03 Thread cleaton
Github user cleaton commented on the pull request: https://github.com/apache/spark/pull/3868#issuecomment-72662664 @tdas I have created a new master branch PR. You can find it here: https://github.com/apache/spark/pull/4338 --- If your project is set up for it, you can reply to this

[GitHub] spark pull request: [SPARK-5498][SQL]fix bug when query the data w...

2015-02-03 Thread chenghao-intel
Github user chenghao-intel commented on a diff in the pull request: https://github.com/apache/spark/pull/4289#discussion_r24010127 --- Diff: sql/hive/src/test/scala/org/apache/spark/sql/hive/InsertIntoHiveTableSuite.scala --- @@ -172,4 +172,19 @@ class InsertIntoHiveTableSuite

[GitHub] spark pull request: [SPARK-5559] [Streaming] [Test] Remove oppotun...

2015-02-03 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/4337#issuecomment-72669182 [Test build #26654 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/26654/consoleFull) for PR 4337 at commit

[GitHub] spark pull request: [SPARK-5559] [Streaming] [Test] Remove oppotun...

2015-02-03 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/4337#issuecomment-72669193 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] spark pull request: [SPARK-1405][MLLIB] LDA on GraphX

2015-02-03 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/spark/pull/2388 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is

[GitHub] spark pull request: [SPARK-1405] [mllib] Latent Dirichlet Allocati...

2015-02-03 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/spark/pull/4047 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is

[GitHub] spark pull request: [minor] update streaming linear algorithms

2015-02-03 Thread mengxr
Github user mengxr commented on the pull request: https://github.com/apache/spark/pull/4329#issuecomment-72610576 This is a minor update. I've merged this into master. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If

[GitHub] spark pull request: [SPARK-4987] [SQL] parquet timestamp type supp...

2015-02-03 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/3820#issuecomment-72611319 [Test build #26622 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/26622/consoleFull) for PR 3820 at commit

[GitHub] spark pull request: [SPARK-4879] [WIP] Use driver to coordinate Ha...

2015-02-03 Thread JoshRosen
Github user JoshRosen commented on a diff in the pull request: https://github.com/apache/spark/pull/4066#discussion_r23988557 --- Diff: core/src/main/scala/org/apache/spark/scheduler/OutputCommitCoordinator.scala --- @@ -0,0 +1,179 @@ +/* + * Licensed to the Apache

[GitHub] spark pull request: [SPARK-4964] [Streaming] Exactly-once semantic...

2015-02-03 Thread pwendell
Github user pwendell commented on a diff in the pull request: https://github.com/apache/spark/pull/3798#discussion_r23988445 --- Diff: external/kafka/src/main/scala/org/apache/spark/streaming/kafka/KafkaUtils.scala --- @@ -144,4 +150,174 @@ object KafkaUtils {

[GitHub] spark pull request: [SPARK-4964] [Streaming] Exactly-once semantic...

2015-02-03 Thread pwendell
Github user pwendell commented on a diff in the pull request: https://github.com/apache/spark/pull/3798#discussion_r23988871 --- Diff: external/kafka/src/main/scala/org/apache/spark/streaming/kafka/OffsetRange.scala --- @@ -0,0 +1,69 @@ +/* + * Licensed to the Apache

[GitHub] spark pull request: [SPARK-4879] [WIP] Use driver to coordinate Ha...

2015-02-03 Thread JoshRosen
Github user JoshRosen commented on a diff in the pull request: https://github.com/apache/spark/pull/4066#discussion_r23988843 --- Diff: core/src/main/scala/org/apache/spark/SparkHadoopWriter.scala --- @@ -105,24 +106,61 @@ class SparkHadoopWriter(@transient jobConf: JobConf)

[GitHub] spark pull request: [SPARK-5551][SQL] Create type alias for Schema...

2015-02-03 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/spark/pull/4327 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is

[GitHub] spark pull request: [SQL][DataFrame] Remove DataFrameApi, Expressi...

2015-02-03 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/spark/pull/4328 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is

[GitHub] spark pull request: [SPARK-4795][Core] Redesign the primitive typ...

2015-02-03 Thread zsxwing
Github user zsxwing commented on a diff in the pull request: https://github.com/apache/spark/pull/3642#discussion_r23989500 --- Diff: graphx/src/test/scala/org/apache/spark/graphx/lib/ShortestPathsSuite.scala --- @@ -40,7 +40,7 @@ class ShortestPathsSuite extends FunSuite with

[GitHub] spark pull request: [SPARK-5549] Define TaskContext interface in S...

2015-02-03 Thread rxin
Github user rxin commented on the pull request: https://github.com/apache/spark/pull/4324#issuecomment-72613931 Going to merge since tests passed previously, and the latest failure was due to a flaky test in streaming. --- If your project is set up for it, you can reply to this

[GitHub] spark pull request: [SPARK-5278][SQL] complete the check of ambigu...

2015-02-03 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/4068#issuecomment-72614165 [Test build #26641 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/26641/consoleFull) for PR 4068 at commit

[GitHub] spark pull request: [SPARK-4508] [SQL] build native date type to c...

2015-02-03 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/4325#issuecomment-72614700 Test FAILed. Refer to this link for build results (access rights to CI server needed):

[GitHub] spark pull request: [SPARK-4508] [SQL] build native date type to c...

2015-02-03 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/4325#issuecomment-72614694 [Test build #26639 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/26639/consoleFull) for PR 4325 at commit

[GitHub] spark pull request: [SPARK-5426][SQL] Add SparkSQL Java API helper...

2015-02-03 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/4243#issuecomment-72614630 Can one of the admins verify this patch? --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your

[GitHub] spark pull request: [SPARK-4964] [Streaming] Exactly-once semantic...

2015-02-03 Thread pwendell
Github user pwendell commented on a diff in the pull request: https://github.com/apache/spark/pull/3798#discussion_r23989829 --- Diff: external/kafka/src/main/scala/org/apache/spark/streaming/kafka/KafkaUtils.scala --- @@ -144,4 +150,174 @@ object KafkaUtils {

[GitHub] spark pull request: [SPARK-4964] [Streaming] Exactly-once semantic...

2015-02-03 Thread pwendell
Github user pwendell commented on a diff in the pull request: https://github.com/apache/spark/pull/3798#discussion_r23989786 --- Diff: external/kafka/src/main/scala/org/apache/spark/streaming/kafka/KafkaUtils.scala --- @@ -144,4 +150,174 @@ object KafkaUtils {

[GitHub] spark pull request: [SPARK-4795][Core] Redesign the primitive typ...

2015-02-03 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/3642#issuecomment-72615909 Test FAILed. Refer to this link for build results (access rights to CI server needed):

[GitHub] spark pull request: [SQL][DataFrame] Remove DataFrameApi, Expressi...

2015-02-03 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/4328#issuecomment-72615989 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] spark pull request: [SQL][DataFrame] Remove DataFrameApi, Expressi...

2015-02-03 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/4328#issuecomment-72615985 [Test build #26634 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/26634/consoleFull) for PR 4328 at commit

[GitHub] spark pull request: [SPARK-4964] [Streaming] Exactly-once semantic...

2015-02-03 Thread pwendell
Github user pwendell commented on a diff in the pull request: https://github.com/apache/spark/pull/3798#discussion_r23990370 --- Diff: external/kafka/src/main/scala/org/apache/spark/streaming/kafka/KafkaUtils.scala --- @@ -144,4 +150,174 @@ object KafkaUtils {

[GitHub] spark pull request: [SPARK-4795][Core] Redesign the primitive typ...

2015-02-03 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/3642#issuecomment-72615904 [Test build #26636 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/26636/consoleFull) for PR 3642 at commit

[GitHub] spark pull request: [SPARK-1405] [mllib] Latent Dirichlet Allocati...

2015-02-03 Thread mengxr
Github user mengxr commented on the pull request: https://github.com/apache/spark/pull/4047#issuecomment-72609253 LGTM. Merged into master. Thanks everyone for collaborating on LDA! @jkbradley Please create follow-up JIRAs and see who are interested in working on LDA features. ---

[GitHub] spark pull request: [SPARK-5550] [SQL] Support the case insensitiv...

2015-02-03 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/4326#issuecomment-72609562 [Test build #26625 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/26625/consoleFull) for PR 4326 at commit

[GitHub] spark pull request: [SQL][DataFrame] Remove DataFrameApi, Expressi...

2015-02-03 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/4328#issuecomment-72610285 [Test build #26626 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/26626/consoleFull) for PR 4328 at commit

[GitHub] spark pull request: [SPARK-5554] [SQL] [PySpark] add more tests fo...

2015-02-03 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/4331#issuecomment-72610330 [Test build #26635 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/26635/consoleFull) for PR 4331 at commit

[GitHub] spark pull request: [minor] update streaming linear algorithms

2015-02-03 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/4329#issuecomment-72610392 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] spark pull request: [SPARK-4795][Core] Redesign the primitive typ...

2015-02-03 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/3642#issuecomment-72610354 [Test build #26636 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/26636/consoleFull) for PR 3642 at commit

[GitHub] spark pull request: [minor] update streaming linear algorithms

2015-02-03 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/4329#issuecomment-72610387 [Test build #26628 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/26628/consoleFull) for PR 4329 at commit

[GitHub] spark pull request: [SQL][DataFrame] Remove DataFrameApi, Expressi...

2015-02-03 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/4328#issuecomment-72610291 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] spark pull request: [SPARK-4508] [SQL] build native date type to c...

2015-02-03 Thread davies
Github user davies commented on a diff in the pull request: https://github.com/apache/spark/pull/4325#discussion_r23988701 --- Diff: sql/catalyst/src/main/scala/org/apache/spark/sql/types/DateUtils.scala --- @@ -0,0 +1,60 @@ +/* + * Licensed to the Apache Software

[GitHub] spark pull request: [SPARK-5182] [SPARK-5528] [SPARK-5509] [SPARK-...

2015-02-03 Thread liancheng
Github user liancheng commented on a diff in the pull request: https://github.com/apache/spark/pull/4308#discussion_r23988104 --- Diff: sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/expressions/predicates.scala --- @@ -175,7 +175,10 @@ case class EqualTo(left:

[GitHub] spark pull request: [SPARK-4964] [Streaming] Exactly-once semantic...

2015-02-03 Thread pwendell
Github user pwendell commented on a diff in the pull request: https://github.com/apache/spark/pull/3798#discussion_r23988318 --- Diff: external/kafka/src/main/scala/org/apache/spark/streaming/kafka/KafkaUtils.scala --- @@ -144,4 +150,174 @@ object KafkaUtils {

[GitHub] spark pull request: [SPARK-4508] [SQL] build native date type to c...

2015-02-03 Thread adrian-wang
Github user adrian-wang commented on a diff in the pull request: https://github.com/apache/spark/pull/4325#discussion_r23988264 --- Diff: sql/catalyst/src/main/scala/org/apache/spark/sql/types/DateUtils.scala --- @@ -0,0 +1,60 @@ +/* + * Licensed to the Apache Software

[GitHub] spark pull request: [minor] update streaming linear algorithms

2015-02-03 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/spark/pull/4329 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is

[GitHub] spark pull request: [SPARK-4969][STREAMING][PYTHON] Add binaryReco...

2015-02-03 Thread davies
Github user davies commented on the pull request: https://github.com/apache/spark/pull/3803#issuecomment-72612066 The Python parts look good to me, thanks! --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project

[GitHub] spark pull request: [SPARK-4879] [WIP] Use driver to coordinate Ha...

2015-02-03 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/4066#issuecomment-72611873 [Test build #26637 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/26637/consoleFull) for PR 4066 at commit

[GitHub] spark pull request: [SPARK-5278][SQL] complete the check of ambigu...

2015-02-03 Thread cloud-fan
Github user cloud-fan commented on the pull request: https://github.com/apache/spark/pull/4068#issuecomment-72613023 Hi @yhuai , I have updated this PR introducing `UnresolvedGetField` to fix this issue. Do you have time to review it? Thanks! --- If your project is set up for it,

[GitHub] spark pull request: [SPARK-4879] Use the Spark driver to authorize...

2015-02-03 Thread JoshRosen
Github user JoshRosen commented on a diff in the pull request: https://github.com/apache/spark/pull/4155#discussion_r23989226 --- Diff: core/src/main/scala/org/apache/spark/scheduler/DAGScheduler.scala --- @@ -808,6 +810,7 @@ class DAGScheduler( // will be posted, which

[GitHub] spark pull request: [SPARK-5345][DEPLOY] Fix unstable test case in...

2015-02-03 Thread JoshRosen
Github user JoshRosen commented on the pull request: https://github.com/apache/spark/pull/4133#issuecomment-72614051 Jenkins, retest this please. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not

[GitHub] spark pull request: [SPARK-5549] Define TaskContext interface in S...

2015-02-03 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/spark/pull/4324 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is

[GitHub] spark pull request: [SPARK-5345][DEPLOY] Fix unstable test case in...

2015-02-03 Thread JoshRosen
Github user JoshRosen commented on the pull request: https://github.com/apache/spark/pull/4133#issuecomment-72614122 I think we've observed this test's flakiness even after fixing #4220, so we should continue investigating it. --- If your project is set up for it, you can reply to

[GitHub] spark pull request: [SPARK-5345][DEPLOY] Fix unstable test case in...

2015-02-03 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/4133#issuecomment-72614113 [Test build #26640 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/26640/consoleFull) for PR 4133 at commit

[GitHub] spark pull request: [SPARK-5521] PCA wrapper for easy transform ve...

2015-02-03 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/4304#issuecomment-72614765 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] spark pull request: [SPARK-5521] PCA wrapper for easy transform ve...

2015-02-03 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/4304#issuecomment-72614756 [Test build #26632 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/26632/consoleFull) for PR 4304 at commit

[GitHub] spark pull request: [SPARK-1405][MLLIB] LDA on GraphX

2015-02-03 Thread mengxr
Github user mengxr commented on the pull request: https://github.com/apache/spark/pull/2388#issuecomment-72616260 @witgo We've merged #4047 and closed this PR. Thanks for your contribution! Please create JIRAs and propose new features that can be added to the LDA implementation in

[GitHub] spark pull request: [SPARK-5550] [SQL] Support the case insensitiv...

2015-02-03 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/4326#issuecomment-72609568 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] spark pull request: [SPARK-5554] [SQL] [PySpark] add more tests fo...

2015-02-03 Thread davies
GitHub user davies opened a pull request: https://github.com/apache/spark/pull/4331 [SPARK-5554] [SQL] [PySpark] add more tests for DataFrame Add more tests and docs for DataFrame Python API, improve test coverage, fix bugs. You can merge this pull request into a Git repository by

[GitHub] spark pull request: [SPARK-5551][SQL] Create type alias for Schema...

2015-02-03 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/4327#issuecomment-72610169 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] spark pull request: [SPARK-5551][SQL] Create type alias for Schema...

2015-02-03 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/4327#issuecomment-72610160 [Test build #26627 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/26627/consoleFull) for PR 4327 at commit

[GitHub] spark pull request: [SPARK-4964] [Streaming] Exactly-once semantic...

2015-02-03 Thread pwendell
Github user pwendell commented on a diff in the pull request: https://github.com/apache/spark/pull/3798#discussion_r23988994 --- Diff: external/kafka/src/main/scala/org/apache/spark/streaming/kafka/Leader.scala --- @@ -0,0 +1,46 @@ +/* + * Licensed to the Apache Software

[GitHub] spark pull request: [SPARK-4964] [Streaming] Exactly-once semantic...

2015-02-03 Thread pwendell
Github user pwendell commented on a diff in the pull request: https://github.com/apache/spark/pull/3798#discussion_r23988976 --- Diff: external/kafka/src/main/scala/org/apache/spark/streaming/kafka/OffsetRange.scala --- @@ -0,0 +1,69 @@ +/* + * Licensed to the Apache

[GitHub] spark pull request: [SPARK-4964] [Streaming] Exactly-once semantic...

2015-02-03 Thread pwendell
Github user pwendell commented on a diff in the pull request: https://github.com/apache/spark/pull/3798#discussion_r23989107 --- Diff: external/kafka/src/main/scala/org/apache/spark/streaming/kafka/OffsetRange.scala --- @@ -0,0 +1,69 @@ +/* + * Licensed to the Apache

[GitHub] spark pull request: [SPARK-4879] [WIP] Use driver to coordinate Ha...

2015-02-03 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/4066#issuecomment-72613283 [Test build #26629 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/26629/consoleFull) for PR 4066 at commit

[GitHub] spark pull request: [SPARK-5549] Define TaskContext interface in S...

2015-02-03 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/4324#issuecomment-72613282 Test FAILed. Refer to this link for build results (access rights to CI server needed):

[GitHub] spark pull request: [SPARK-4879] [WIP] Use driver to coordinate Ha...

2015-02-03 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/4066#issuecomment-72613292 Test FAILed. Refer to this link for build results (access rights to CI server needed):

[GitHub] spark pull request: [SPARK-5549] Define TaskContext interface in S...

2015-02-03 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/4324#issuecomment-72613272 [Test build #26633 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/26633/consoleFull) for PR 4324 at commit

[GitHub] spark pull request: [SPARK-4508] [SQL] build native date type to c...

2015-02-03 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/4325#issuecomment-72613604 [Test build #26639 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/26639/consoleFull) for PR 4325 at commit

[GitHub] spark pull request: [SPARK-4795][Core] Redesign the primitive typ...

2015-02-03 Thread zsxwing
Github user zsxwing commented on the pull request: https://github.com/apache/spark/pull/3642#issuecomment-72614319 @zsxwing if we merge this one, are there any other usecases for importing SparkContext._ ? There will be no implicit methods/objects in SparkContext object. So

[GitHub] spark pull request: [SPARK-4964] [Streaming] Exactly-once semantic...

2015-02-03 Thread pwendell
Github user pwendell commented on a diff in the pull request: https://github.com/apache/spark/pull/3798#discussion_r23989943 --- Diff: external/kafka/src/main/scala/org/apache/spark/streaming/kafka/KafkaUtils.scala --- @@ -144,4 +150,249 @@ object KafkaUtils {

[GitHub] spark pull request: [SPARK-4508] [SQL] build native date type to c...

2015-02-03 Thread adrian-wang
Github user adrian-wang commented on a diff in the pull request: https://github.com/apache/spark/pull/4325#discussion_r23990278 --- Diff: sql/catalyst/src/main/scala/org/apache/spark/sql/types/DateUtils.scala --- @@ -0,0 +1,60 @@ +/* + * Licensed to the Apache Software

[GitHub] spark pull request: [SPARK-4508] [SQL] build native date type to c...

2015-02-03 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/4325#issuecomment-72615808 [Test build #26642 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/26642/consoleFull) for PR 4325 at commit

[GitHub] spark pull request: [SPARK-4508] [SQL] build native date type to c...

2015-02-03 Thread adrian-wang
Github user adrian-wang commented on the pull request: https://github.com/apache/spark/pull/4325#issuecomment-72615722 retest this please. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have

[GitHub] spark pull request: [SPARK-4879] [WIP] Use driver to coordinate Ha...

2015-02-03 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/4066#issuecomment-72744869 [Test build #26677 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/26677/consoleFull) for PR 4066 at commit

[GitHub] spark pull request: [SPARK-5554] [SQL] [PySpark] add more tests fo...

2015-02-03 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/4331#issuecomment-72745468 [Test build #26672 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/26672/consoleFull) for PR 4331 at commit

[GitHub] spark pull request: [SPARK-5554] [SQL] [PySpark] add more tests fo...

2015-02-03 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/4331#issuecomment-72745480 Test FAILed. Refer to this link for build results (access rights to CI server needed):

<    1   2   3   4   5   6   7   >