[GitHub] spark pull request: [SPARK-4151][SQL] Add string operation functio...

2014-10-31 Thread chenghao-intel
Github user chenghao-intel commented on a diff in the pull request: https://github.com/apache/spark/pull/2998#discussion_r19653172 --- Diff: sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/expressions/stringOperations.scala --- @@ -92,6 +92,29 @@ trait

[GitHub] spark pull request: [SPARK-4151][SQL] Add string operation functio...

2014-10-31 Thread chenghao-intel
Github user chenghao-intel commented on a diff in the pull request: https://github.com/apache/spark/pull/2998#discussion_r19653194 --- Diff: sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/expressions/stringOperations.scala --- @@ -92,6 +92,29 @@ trait

[GitHub] spark pull request: [SPARK-3838][examples][mllib][python] Word2Vec...

2014-10-31 Thread anantasty
Github user anantasty commented on the pull request: https://github.com/apache/spark/pull/2952#issuecomment-61222153 @davies @mengxr Just made the suggested changes. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If

[GitHub] spark pull request: [SPARK-4108][SQL] Fixed usage of deprecated in...

2014-10-31 Thread anantasty
Github user anantasty commented on the pull request: https://github.com/apache/spark/pull/2970#issuecomment-61222188 @marmbrus can we merge this now? --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does

[GitHub] spark pull request: [SPARK-3572] [sql] [mllib] User-Defined Types ...

2014-10-31 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/2919#issuecomment-61222170 [Test build #22597 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/22597/consoleFull) for PR 2919 at commit

[GitHub] spark pull request: [SPARK-3572] [sql] [mllib] User-Defined Types ...

2014-10-31 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/2919#issuecomment-6136 [Test build #22597 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/22597/consoleFull) for PR 2919 at commit

[GitHub] spark pull request: [SPARK-3572] [sql] [mllib] User-Defined Types ...

2014-10-31 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/2919#issuecomment-6139 Test FAILed. Refer to this link for build results (access rights to CI server needed):

[GitHub] spark pull request: [SPARK-3826][SQL]enable hive-thriftserver to s...

2014-10-31 Thread pwendell
Github user pwendell commented on the pull request: https://github.com/apache/spark/pull/2685#issuecomment-6147 it is not possible to mutate them after the fact. Let's stick with 0.13.1a - I will fully release it now. But don't remove the extra repository (we can remove it later)

[GitHub] spark pull request: [SPARK-3572] [sql] [mllib] User-Defined Types ...

2014-10-31 Thread jkbradley
Github user jkbradley commented on the pull request: https://github.com/apache/spark/pull/2919#issuecomment-61222349 @marmbrus @mengxr I removed the Java UDT and made UDTs private for now. I think it's good enough to work with MLlib Datasets, and we can take more time to design

[GitHub] spark pull request: [SPARK-3247][SQL] An API for adding data sourc...

2014-10-31 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/2475#issuecomment-61222343 [Test build #22592 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/22592/consoleFull) for PR 2475 at commit

[GitHub] spark pull request: [SPARK-3826][SQL]enable hive-thriftserver to s...

2014-10-31 Thread pwendell
Github user pwendell commented on a diff in the pull request: https://github.com/apache/spark/pull/2685#discussion_r19653250 --- Diff: dev/run-tests --- @@ -142,17 +142,24 @@ CURRENT_BLOCK=$BLOCK_BUILD # We always build with Hive because the PySpark Spark SQL tests need it.

[GitHub] spark pull request: [SPARK-4108][SQL] Fixed usage of deprecated in...

2014-10-31 Thread marmbrus
Github user marmbrus commented on the pull request: https://github.com/apache/spark/pull/2970#issuecomment-61222322 Thanks! Merged to master. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have

[GitHub] spark pull request: [SPARK-3247][SQL] An API for adding data sourc...

2014-10-31 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/2475#issuecomment-61222348 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] spark pull request: [SPARK-4149][SQL] ISO 8601 support for json da...

2014-10-31 Thread davies
Github user davies commented on the pull request: https://github.com/apache/spark/pull/3012#issuecomment-61222405 Thanks for working on it. Can it infer the type as DateType/TimestampType from String in Json? It's common to have date/time in json, such as create time of tweet, it

[GitHub] spark pull request: [SPARK-4108][SQL] Fixed usage of deprecated in...

2014-10-31 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/spark/pull/2970 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is

[GitHub] spark pull request: [SPARK-3838][examples][mllib][python] Word2Vec...

2014-10-31 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/2952#issuecomment-61222418 [Test build #22598 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/22598/consoleFull) for PR 2952 at commit

[GitHub] spark pull request: [SPARK-3826][SQL]enable hive-thriftserver to s...

2014-10-31 Thread pwendell
Github user pwendell commented on a diff in the pull request: https://github.com/apache/spark/pull/2685#discussion_r19653264 --- Diff: dev/run-tests --- @@ -142,17 +142,24 @@ CURRENT_BLOCK=$BLOCK_BUILD # We always build with Hive because the PySpark Spark SQL tests need it.

[GitHub] spark pull request: [SPARK-3838][examples][mllib][python] Word2Vec...

2014-10-31 Thread davies
Github user davies commented on a diff in the pull request: https://github.com/apache/spark/pull/2952#discussion_r19653295 --- Diff: docs/mllib-feature-extraction.md --- @@ -162,6 +162,24 @@ for((synonym, cosineSimilarity) - synonyms) { } {% endhighlight %} /div

[GitHub] spark pull request: [SPARK-4151][SQL] Add string operation functio...

2014-10-31 Thread chenghao-intel
Github user chenghao-intel commented on the pull request: https://github.com/apache/spark/pull/2998#issuecomment-61222708 @OopsOutOfMemory thank you working on this, it will be nice if we have those functions. I have some comments on it. --- If your project is set up for it, you can

[GitHub] spark pull request: [SPARK-3838][examples][mllib][python] Word2Vec...

2014-10-31 Thread davies
Github user davies commented on a diff in the pull request: https://github.com/apache/spark/pull/2952#discussion_r19653338 --- Diff: examples/src/main/python/mllib/word2vec.py --- @@ -0,0 +1,50 @@ +# +# Licensed to the Apache Software Foundation (ASF) under one or more

[GitHub] spark pull request: [SPARK-3572] [sql] [mllib] User-Defined Types ...

2014-10-31 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/2919#issuecomment-61222747 [Test build #22599 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/22599/consoleFull) for PR 2919 at commit

[GitHub] spark pull request: [MLLIB] SPARK-1547: Add Gradient Boosting to M...

2014-10-31 Thread jkbradley
Github user jkbradley commented on the pull request: https://github.com/apache/spark/pull/2607#issuecomment-61222744 True, it's a good point about LR. OK, let's keep them with caveats, but hopefully run some tests to make sure they seem to be working. I'll make a pass tomorrow

[GitHub] spark pull request: [SPARK-4029][Streaming] Update streaming drive...

2014-10-31 Thread pwendell
Github user pwendell commented on the pull request: https://github.com/apache/spark/pull/3026#issuecomment-61222814 Hey @tdas I did a first pass on this. This makes sense to me overall and seems like a straightforward next step in the design. I had a few comments about naming. The

[GitHub] spark pull request: [SPARK-3826][SQL]enable hive-thriftserver to s...

2014-10-31 Thread zhzhan
Github user zhzhan commented on the pull request: https://github.com/apache/spark/pull/2685#issuecomment-61222998 whew, finally. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark pull request: [SPARK-4029][Streaming] Update streaming drive...

2014-10-31 Thread pwendell
Github user pwendell commented on a diff in the pull request: https://github.com/apache/spark/pull/3026#discussion_r19653425 --- Diff: streaming/src/main/scala/org/apache/spark/streaming/scheduler/ReceivedBlockTracker.scala --- @@ -0,0 +1,207 @@ +/* + * Licensed to the

[GitHub] spark pull request: [SPARK-3572] [sql] [mllib] User-Defined Types ...

2014-10-31 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/2919#issuecomment-61223274 [Test build #22599 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/22599/consoleFull) for PR 2919 at commit

[GitHub] spark pull request: [SPARK-3572] [sql] [mllib] User-Defined Types ...

2014-10-31 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/2919#issuecomment-61223276 Test FAILed. Refer to this link for build results (access rights to CI server needed):

[GitHub] spark pull request: [SPARK-4163][Core][Web UI] Send the fetch fail...

2014-10-31 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/3032#issuecomment-61223601 [Test build #22600 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/22600/consoleFull) for PR 3032 at commit

[GitHub] spark pull request: [SPARK-2033] Automatically cleanup checkpoint

2014-10-31 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/855#issuecomment-61223905 [Test build #22601 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/22601/consoleFull) for PR 855 at commit

[GitHub] spark pull request: [SPARK-3826][SQL]enable hive-thriftserver to s...

2014-10-31 Thread scwf
Github user scwf commented on a diff in the pull request: https://github.com/apache/spark/pull/2685#discussion_r19653726 --- Diff: dev/run-tests --- @@ -142,17 +142,24 @@ CURRENT_BLOCK=$BLOCK_BUILD # We always build with Hive because the PySpark Spark SQL tests need it.

[GitHub] spark pull request: SPARK-3223 runAsSparkUser cannot change HDFS w...

2014-10-31 Thread tnachen
Github user tnachen commented on the pull request: https://github.com/apache/spark/pull/2126#issuecomment-61224117 @jongyoul are you planning to rebase this or? --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your

[GitHub] spark pull request: [SPARK-3826][SQL]enable hive-thriftserver to s...

2014-10-31 Thread scwf
Github user scwf commented on a diff in the pull request: https://github.com/apache/spark/pull/2685#discussion_r19653776 --- Diff: dev/run-tests --- @@ -142,17 +142,24 @@ CURRENT_BLOCK=$BLOCK_BUILD # We always build with Hive because the PySpark Spark SQL tests need it.

[GitHub] spark pull request: [SPARK-3826][SQL]enable hive-thriftserver to s...

2014-10-31 Thread scwf
Github user scwf commented on a diff in the pull request: https://github.com/apache/spark/pull/2685#discussion_r19653777 --- Diff: dev/run-tests --- @@ -142,17 +142,24 @@ CURRENT_BLOCK=$BLOCK_BUILD # We always build with Hive because the PySpark Spark SQL tests need it.

[GitHub] spark pull request: [SPARK-4029][Streaming] Update streaming drive...

2014-10-31 Thread tdas
Github user tdas commented on a diff in the pull request: https://github.com/apache/spark/pull/3026#discussion_r19653884 --- Diff: streaming/src/main/scala/org/apache/spark/streaming/scheduler/ReceivedBlockTracker.scala --- @@ -0,0 +1,207 @@ +/* + * Licensed to the Apache

[GitHub] spark pull request: [SPARK-4029][Streaming] Update streaming drive...

2014-10-31 Thread tdas
Github user tdas commented on a diff in the pull request: https://github.com/apache/spark/pull/3026#discussion_r19653881 --- Diff: streaming/src/main/scala/org/apache/spark/streaming/scheduler/ReceivedBlockTracker.scala --- @@ -0,0 +1,207 @@ +/* + * Licensed to the Apache

[GitHub] spark pull request: [SPARK-4029][Streaming] Update streaming drive...

2014-10-31 Thread tdas
Github user tdas commented on a diff in the pull request: https://github.com/apache/spark/pull/3026#discussion_r19653892 --- Diff: streaming/src/main/scala/org/apache/spark/streaming/scheduler/ReceivedBlockTracker.scala --- @@ -0,0 +1,207 @@ +/* + * Licensed to the Apache

[GitHub] spark pull request: [SPARK-4062][Streaming]Add ReliableKafkaReceiv...

2014-10-31 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/2991#issuecomment-61224754 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] spark pull request: [SPARK-4062][Streaming]Add ReliableKafkaReceiv...

2014-10-31 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/2991#issuecomment-61224748 [Test build #22595 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/22595/consoleFull) for PR 2991 at commit

[GitHub] spark pull request: [SPARK-4029][Streaming] Update streaming drive...

2014-10-31 Thread tdas
Github user tdas commented on a diff in the pull request: https://github.com/apache/spark/pull/3026#discussion_r19653928 --- Diff: streaming/src/main/scala/org/apache/spark/streaming/scheduler/ReceivedBlockTracker.scala --- @@ -0,0 +1,207 @@ +/* + * Licensed to the Apache

[GitHub] spark pull request: [SPARK-3826][SQL]enable hive-thriftserver to s...

2014-10-31 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/2685#issuecomment-61224765 [Test build #22602 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/22602/consoleFull) for PR 2685 at commit

[GitHub] spark pull request: [SPARK-4151][SQL] Add string operation functio...

2014-10-31 Thread OopsOutOfMemory
Github user OopsOutOfMemory commented on a diff in the pull request: https://github.com/apache/spark/pull/2998#discussion_r19653967 --- Diff: sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/expressions/stringOperations.scala --- @@ -92,6 +92,29 @@ trait

[GitHub] spark pull request: [SPARK-4151][SQL] Add string operation functio...

2014-10-31 Thread OopsOutOfMemory
Github user OopsOutOfMemory commented on a diff in the pull request: https://github.com/apache/spark/pull/2998#discussion_r19653994 --- Diff: sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/expressions/stringOperations.scala --- @@ -134,10 +157,51 @@ case class

[GitHub] spark pull request: [SPARK-4163][Core][Web UI] Send the fetch fail...

2014-10-31 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/3032#issuecomment-61225060 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] spark pull request: [SPARK-4163][Core][Web UI] Send the fetch fail...

2014-10-31 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/3032#issuecomment-61225058 [Test build #22594 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/22594/consoleFull) for PR 3032 at commit

[GitHub] spark pull request: [SPARK-3247][SQL] An API for adding data sourc...

2014-10-31 Thread scwf
Github user scwf commented on a diff in the pull request: https://github.com/apache/spark/pull/2475#discussion_r19654020 --- Diff: sql/core/src/main/scala/org/apache/spark/sql/sources/ddl.scala --- @@ -0,0 +1,110 @@ +/* + * Licensed to the Apache Software Foundation (ASF)

[GitHub] spark pull request: [SPARK-4151][SQL] Add string operation functio...

2014-10-31 Thread OopsOutOfMemory
Github user OopsOutOfMemory commented on a diff in the pull request: https://github.com/apache/spark/pull/2998#discussion_r19654021 --- Diff: sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/expressions/stringOperations.scala --- @@ -134,10 +157,51 @@ case class

[GitHub] spark pull request: [MLLIB] SPARK-1547: Add Gradient Boosting to M...

2014-10-31 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/2607#issuecomment-61225506 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] spark pull request: [MLLIB] SPARK-1547: Add Gradient Boosting to M...

2014-10-31 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/2607#issuecomment-61225502 [Test build #22596 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/22596/consoleFull) for PR 2607 at commit

[GitHub] spark pull request: [SPARK-4143] [SQL] Move inner class DeferredOb...

2014-10-31 Thread marmbrus
Github user marmbrus commented on the pull request: https://github.com/apache/spark/pull/3007#issuecomment-61225734 Thanks, merged to master. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have

[GitHub] spark pull request: [SPARK-4151][SQL] Add string operation functio...

2014-10-31 Thread OopsOutOfMemory
Github user OopsOutOfMemory commented on a diff in the pull request: https://github.com/apache/spark/pull/2998#discussion_r19654215 --- Diff: sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/expressions/stringOperations.scala --- @@ -134,10 +157,51 @@ case class

[GitHub] spark pull request: [SPARK-4141] Hide Accumulators column on stage...

2014-10-31 Thread JoshRosen
Github user JoshRosen commented on the pull request: https://github.com/apache/spark/pull/3031#issuecomment-61225803 Jenkins, this is ok to test. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not

[GitHub] spark pull request: Display the executor ID in the Web UI when Exe...

2014-10-31 Thread zsxwing
GitHub user zsxwing opened a pull request: https://github.com/apache/spark/pull/3033 Display the executor ID in the Web UI when ExecutorLostFailure happens Now when ExecutorLostFailure happens, it only displays `ExecutorLostFailure (executor lost)`. Adding the executor id will help

[GitHub] spark pull request: [SPARK-4143] [SQL] Move inner class DeferredOb...

2014-10-31 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/spark/pull/3007 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is

[GitHub] spark pull request: [SPARK-4141] Hide Accumulators column on stage...

2014-10-31 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/3031#issuecomment-61226262 [Test build #22604 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/22604/consoleFull) for PR 3031 at commit

[GitHub] spark pull request: [SPARK-4166][Core][WebUI] Display the executor...

2014-10-31 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/3033#issuecomment-61226259 [Test build #22603 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/22603/consoleFull) for PR 3033 at commit

[GitHub] spark pull request: [SPARK-4141] Hide Accumulators column on stage...

2014-10-31 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/3031#issuecomment-61226351 Test FAILed. Refer to this link for build results (access rights to CI server needed):

[GitHub] spark pull request: [SPARK-4141] Hide Accumulators column on stage...

2014-10-31 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/3031#issuecomment-61226349 [Test build #22604 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/22604/consoleFull) for PR 3031 at commit

[GitHub] spark pull request: [SPARK-3930] [SPARK-3933] Support fixed-precis...

2014-10-31 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/2983#issuecomment-61226735 [Test build #22605 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/22605/consoleFull) for PR 2983 at commit

[GitHub] spark pull request: [SPARK-3826][SQL]enable hive-thriftserver to s...

2014-10-31 Thread liancheng
Github user liancheng commented on a diff in the pull request: https://github.com/apache/spark/pull/2685#discussion_r19654494 --- Diff: dev/run-tests --- @@ -142,17 +142,24 @@ CURRENT_BLOCK=$BLOCK_BUILD # We always build with Hive because the PySpark Spark SQL tests need it.

[GitHub] spark pull request: [SPARK-3247][SQL] An API for adding data sourc...

2014-10-31 Thread scwf
Github user scwf commented on a diff in the pull request: https://github.com/apache/spark/pull/2475#discussion_r19654557 --- Diff: sql/core/src/main/scala/org/apache/spark/sql/sources/interfaces.scala --- @@ -0,0 +1,86 @@ +/* +* Licensed to the Apache Software Foundation

[GitHub] spark pull request: [SPARK-3247][SQL] An API for adding data sourc...

2014-10-31 Thread scwf
Github user scwf commented on a diff in the pull request: https://github.com/apache/spark/pull/2475#discussion_r19654586 --- Diff: sql/core/src/main/scala/org/apache/spark/sql/sources/interfaces.scala --- @@ -0,0 +1,86 @@ +/* +* Licensed to the Apache Software Foundation

[GitHub] spark pull request: [SPARK-4151][SQL] Add string operation functio...

2014-10-31 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/2998#issuecomment-61227165 [Test build #22606 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/22606/consoleFull) for PR 2998 at commit

[GitHub] spark pull request: [SPARK-3826][SQL]enable hive-thriftserver to s...

2014-10-31 Thread liancheng
Github user liancheng commented on the pull request: https://github.com/apache/spark/pull/2685#issuecomment-61227318 @zhzhan Had a glance of the Kryo issue you pointed out should be related to the POM inconsistency problem I mentioned above, but I'm not sure whether they are

[GitHub] spark pull request: [SPARK-3247][SQL] An API for adding data sourc...

2014-10-31 Thread scwf
Github user scwf commented on a diff in the pull request: https://github.com/apache/spark/pull/2475#discussion_r19654727 --- Diff: sql/core/src/main/scala/org/apache/spark/sql/json/JSONRelation.scala --- @@ -0,0 +1,49 @@ +/* + * Licensed to the Apache Software Foundation

[GitHub] spark pull request: [SPARK-4151][SQL] Add string operation functio...

2014-10-31 Thread OopsOutOfMemory
Github user OopsOutOfMemory commented on the pull request: https://github.com/apache/spark/pull/2998#issuecomment-61227669 @chenghao-intel thanks for your review and comment :) --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as

[GitHub] spark pull request: [SPARK-4163][Core][WebUI] Send the fetch failu...

2014-10-31 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/3032#issuecomment-61227899 [Test build #22600 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/22600/consoleFull) for PR 3032 at commit

[GitHub] spark pull request: [SPARK-4163][Core][WebUI] Send the fetch failu...

2014-10-31 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/3032#issuecomment-61227902 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] spark pull request: [SPARK-2033] Automatically cleanup checkpoint

2014-10-31 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/855#issuecomment-61228046 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] spark pull request: [SPARK-2033] Automatically cleanup checkpoint

2014-10-31 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/855#issuecomment-61228040 [Test build #22601 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/22601/consoleFull) for PR 855 at commit

[GitHub] spark pull request: [SPARK-3247][SQL] An API for adding data sourc...

2014-10-31 Thread liancheng
Github user liancheng commented on the pull request: https://github.com/apache/spark/pull/2475#issuecomment-61228389 Encountered compilation error while compiling locally (with a clean checkout `./sbt/sbt -Phive,hadoop-2.3 compil`): ``` [error]

[GitHub] spark pull request: [SPARK-3247][SQL] An API for adding data sourc...

2014-10-31 Thread liancheng
Github user liancheng commented on the pull request: https://github.com/apache/spark/pull/2475#issuecomment-61228429 Oh, I see, the last Jenkins build success was actually for the commit right before the last one. --- If your project is set up for it, you can reply to this email and

[GitHub] spark pull request: [SPARK-3838][examples][mllib][python] Word2Vec...

2014-10-31 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/2952#issuecomment-61228643 [Test build #22598 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/22598/consoleFull) for PR 2952 at commit

[GitHub] spark pull request: [SPARK-3838][examples][mllib][python] Word2Vec...

2014-10-31 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/2952#issuecomment-61228648 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] spark pull request: [SPARK-4151][SQL] Add string operation functio...

2014-10-31 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/2998#issuecomment-61230479 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] spark pull request: [SPARK-4151][SQL] Add string operation functio...

2014-10-31 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/2998#issuecomment-61230476 [Test build #22606 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/22606/consoleFull) for PR 2998 at commit

[GitHub] spark pull request: [SPARK-4166][Core][WebUI] Display the executor...

2014-10-31 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/3033#issuecomment-61230972 [Test build #22603 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/22603/consoleFull) for PR 3033 at commit

[GitHub] spark pull request: [SPARK-4166][Core][WebUI] Display the executor...

2014-10-31 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/3033#issuecomment-61230978 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] spark pull request: [SPARK-3826][SQL]enable hive-thriftserver to s...

2014-10-31 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/2685#issuecomment-61231536 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] spark pull request: [SPARK-3826][SQL]enable hive-thriftserver to s...

2014-10-31 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/2685#issuecomment-61231533 [Test build #22602 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/22602/consoleFull) for PR 2685 at commit

[GitHub] spark pull request: SPARK-3223 runAsSparkUser cannot change HDFS w...

2014-10-31 Thread jongyoul
GitHub user jongyoul opened a pull request: https://github.com/apache/spark/pull/3034 SPARK-3223 runAsSparkUser cannot change HDFS write permission properly i... ...n mesos cluster mode - change master newer You can merge this pull request into a Git repository by running:

[GitHub] spark pull request: [SPARK-3930] [SPARK-3933] Support fixed-precis...

2014-10-31 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/2983#issuecomment-61232397 Test FAILed. Refer to this link for build results (access rights to CI server needed):

[GitHub] spark pull request: [SPARK-3930] [SPARK-3933] Support fixed-precis...

2014-10-31 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/2983#issuecomment-61232391 [Test build #22605 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/22605/consoleFull) for PR 2983 at commit

[GitHub] spark pull request: SPARK-3223 runAsSparkUser cannot change HDFS w...

2014-10-31 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/3034#issuecomment-61232535 Can one of the admins verify this patch? --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your

[GitHub] spark pull request: SPARK-3223 runAsSparkUser cannot change HDFS w...

2014-10-31 Thread jongyoul
Github user jongyoul commented on the pull request: https://github.com/apache/spark/pull/3034#issuecomment-61232560 @mateiz @tgravescs @tnachen @andrewor14 @timothysc I fix the older master issue from getting new forking sources. Test is again please. --- If your project is set up

[GitHub] spark pull request: SPARK-3223 runAsSparkUser cannot change HDFS w...

2014-10-31 Thread jongyoul
Github user jongyoul commented on the pull request: https://github.com/apache/spark/pull/3034#issuecomment-61232627 This is a new version of PR #2126 . --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does

[GitHub] spark pull request: SPARK-3223 runAsSparkUser cannot change HDFS w...

2014-10-31 Thread jongyoul
Github user jongyoul commented on the pull request: https://github.com/apache/spark/pull/2126#issuecomment-61232689 @tnachen I fix this issue. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have

[GitHub] spark pull request: SPARK-1209 [CORE] SparkHadoop{MapRed,MapReduce...

2014-10-31 Thread srowen
Github user srowen commented on the pull request: https://github.com/apache/spark/pull/2814#issuecomment-61233478 Hm, that's weird since I thought I ran the test against the default Hadoop, and that's 1.0.4. Which test failed? (I'll go look around jenkins too) I can't find

[GitHub] spark pull request: Streaming KMeans [MLLIB][SPARK-3254]

2014-10-31 Thread freeman-lab
Github user freeman-lab commented on the pull request: https://github.com/apache/spark/pull/2942#issuecomment-61234517 @mengxr I implemented the new parameterization (and tried to make the docs on it more intuitive), see what you think! --- If your project is set up for it, you can

[GitHub] spark pull request: Streaming KMeans [MLLIB][SPARK-3254]

2014-10-31 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/2942#issuecomment-61234935 [Test build #22607 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/22607/consoleFull) for PR 2942 at commit

[GitHub] spark pull request: [SPARK-3247][SQL] An API for adding data sourc...

2014-10-31 Thread liancheng
Github user liancheng commented on a diff in the pull request: https://github.com/apache/spark/pull/2475#discussion_r19657566 --- Diff: sql/core/src/main/scala/org/apache/spark/sql/sources/ddl.scala --- @@ -0,0 +1,110 @@ +/* + * Licensed to the Apache Software Foundation

[GitHub] spark pull request: [SPARK-4168][WebUI] web statges number should ...

2014-10-31 Thread liyezhang556520
GitHub user liyezhang556520 opened a pull request: https://github.com/apache/spark/pull/3035 [SPARK-4168][WebUI] web statges number should show correctly when stages are more than 1000 The number of completed stages and failed stages showed on webUI will always be less than 1000.

[GitHub] spark pull request: [SPARK-4168][WebUI] web statges number should ...

2014-10-31 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/3035#issuecomment-61238619 [Test build #22608 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/22608/consoleFull) for PR 3035 at commit

[GitHub] spark pull request: [Core] Locale dependent code

2014-10-31 Thread numbnut
GitHub user numbnut opened a pull request: https://github.com/apache/spark/pull/3036 [Core] Locale dependent code For me the core tests failed because there are two locale dependent parts in the code. Look at the Jira ticket for details. Why is it necessary to check

[GitHub] spark pull request: [Core] Locale dependent code

2014-10-31 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/3036#issuecomment-61239351 Can one of the admins verify this patch? --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your

[GitHub] spark pull request: [SPARK-3247][SQL] An API for adding data sourc...

2014-10-31 Thread liancheng
Github user liancheng commented on a diff in the pull request: https://github.com/apache/spark/pull/2475#discussion_r19658936 --- Diff: sql/core/src/main/scala/org/apache/spark/sql/sources/interfaces.scala --- @@ -0,0 +1,86 @@ +/* +* Licensed to the Apache Software

[GitHub] spark pull request: [SPARK-3247][SQL] An API for adding data sourc...

2014-10-31 Thread liancheng
Github user liancheng commented on a diff in the pull request: https://github.com/apache/spark/pull/2475#discussion_r19659305 --- Diff: sql/core/src/main/scala/org/apache/spark/sql/sources/interfaces.scala --- @@ -0,0 +1,86 @@ +/* +* Licensed to the Apache Software

[GitHub] spark pull request: [Core] Locale dependent code

2014-10-31 Thread srowen
Github user srowen commented on a diff in the pull request: https://github.com/apache/spark/pull/3036#discussion_r19659505 --- Diff: core/src/main/scala/org/apache/spark/util/Utils.scala --- @@ -1683,7 +1683,7 @@ private[spark] object Utils extends Logging { def

[GitHub] spark pull request: [Core] Locale dependent code

2014-10-31 Thread srowen
Github user srowen commented on a diff in the pull request: https://github.com/apache/spark/pull/3036#discussion_r19659592 --- Diff: core/src/test/scala/org/apache/spark/util/UtilsSuite.scala --- @@ -103,14 +105,16 @@ class UtilsSuite extends FunSuite { val hour = minute *

[GitHub] spark pull request: [SPARK-3247][SQL] An API for adding data sourc...

2014-10-31 Thread liancheng
Github user liancheng commented on a diff in the pull request: https://github.com/apache/spark/pull/2475#discussion_r19659626 --- Diff: sql/core/src/main/scala/org/apache/spark/sql/sources/interfaces.scala --- @@ -0,0 +1,86 @@ +/* +* Licensed to the Apache Software

[GitHub] spark pull request: [SPARK-3247][SQL] An API for adding data sourc...

2014-10-31 Thread liancheng
Github user liancheng commented on a diff in the pull request: https://github.com/apache/spark/pull/2475#discussion_r19659690 --- Diff: sql/core/src/main/scala/org/apache/spark/sql/sources/interfaces.scala --- @@ -0,0 +1,86 @@ +/* +* Licensed to the Apache Software

  1   2   3   4   5   6   >