[GitHub] spark issue #14634: [SPARK-17051][SQL] we should use hadoopConf in InsertInt...

2016-08-15 Thread gatorsmile
Github user gatorsmile commented on the issue: https://github.com/apache/spark/pull/14634 If users want to use the `DataFrameWriter`'s `insertInto` API for partitioned Hive table, they have to set `hive.exec.dynamic.partition` to `true` and `hive.exec.dynamic.partition.mode` to

[GitHub] spark issue #14613: [SPARK-16883][SparkR]:SQL decimal type is not properly c...

2016-08-15 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/14613 **[Test build #63775 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/63775/consoleFull)** for PR 14613 at commit

[GitHub] spark issue #14634: [SPARK-17051][SQL] we should use hadoopConf in InsertInt...

2016-08-15 Thread gatorsmile
Github user gatorsmile commented on the issue: https://github.com/apache/spark/pull/14634 Sorry, let me rephrase the potential issue. - `insertInto` API forces users to set `hive.exec.dynamic.partition` to `true` and `hive.exec.dynamic.partition.mode` to `nonstrict`. This

[GitHub] spark issue #14643: [SPARK-17057][ML] ProbabilisticClassifierModels' predict...

2016-08-15 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/14643 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/63774/ Test PASSed. ---

[GitHub] spark issue #14643: [SPARK-17057][ML] ProbabilisticClassifierModels' predict...

2016-08-15 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/14643 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #14643: [SPARK-17057][ML] ProbabilisticClassifierModels' predict...

2016-08-15 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/14643 **[Test build #63774 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/63774/consoleFull)** for PR 14643 at commit

[GitHub] spark issue #14613: [SPARK-16883][SparkR]:SQL decimal type is not properly c...

2016-08-15 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/14613 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/63775/ Test PASSed. ---

[GitHub] spark issue #14644: [MESOS] Enable GPU support with Mesos

2016-08-15 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/14644 **[Test build #63777 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/63777/consoleFull)** for PR 14644 at commit

[GitHub] spark issue #14613: [SPARK-16883][SparkR]:SQL decimal type is not properly c...

2016-08-15 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/14613 **[Test build #63775 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/63775/consoleFull)** for PR 14613 at commit

[GitHub] spark issue #14613: [SPARK-16883][SparkR]:SQL decimal type is not properly c...

2016-08-15 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/14613 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark pull request #14520: [SPARK-16934][ML][MLLib] Improve LogisticCostFun ...

2016-08-15 Thread dbtsai
Github user dbtsai commented on a diff in the pull request: https://github.com/apache/spark/pull/14520#discussion_r74725756 --- Diff: mllib/src/main/scala/org/apache/spark/ml/classification/LogisticRegression.scala --- @@ -932,11 +935,15 @@ class BinaryLogisticRegressionSummary

[GitHub] spark issue #14645: [MINOR] [DOC] Correct code snippet results in quick star...

2016-08-15 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/14645 Can one of the admins verify this patch? --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this

[GitHub] spark issue #14520: [SPARK-16934][ML][MLLib] Improve LogisticCostFun to avoi...

2016-08-15 Thread MLnick
Github user MLnick commented on the issue: https://github.com/apache/spark/pull/14520 @WeichenXu123 would you mind updating the title of the JIRA and PR, as well as the description, to reflect the fact that this is not actually affecting serialization, but more to update the approach

[GitHub] spark pull request #14620: [SPARK-17032][SQL] Add test cases for methods in ...

2016-08-15 Thread jiangxb1987
Github user jiangxb1987 commented on a diff in the pull request: https://github.com/apache/spark/pull/14620#discussion_r74725943 --- Diff: sql/catalyst/src/test/scala/org/apache/spark/sql/catalyst/parser/ParserUtilsSuite.scala --- @@ -61,5 +88,39 @@ class ParserUtilsSuite extends

[GitHub] spark issue #14644: [MESOS] Enable GPU support with Mesos

2016-08-15 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/14644 **[Test build #63776 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/63776/consoleFull)** for PR 14644 at commit

[GitHub] spark pull request #14520: [SPARK-16934][ML][MLLib] Improve LogisticCostFun ...

2016-08-15 Thread dbtsai
Github user dbtsai commented on a diff in the pull request: https://github.com/apache/spark/pull/14520#discussion_r74726107 --- Diff: mllib/src/main/scala/org/apache/spark/ml/classification/LogisticRegression.scala --- @@ -1071,24 +1074,23 @@ private class LogisticCostFun(

[GitHub] spark pull request #13796: [SPARK-7159][ML] Add multiclass logistic regressi...

2016-08-15 Thread dbtsai
Github user dbtsai commented on a diff in the pull request: https://github.com/apache/spark/pull/13796#discussion_r74726485 --- Diff: mllib/src/main/scala/org/apache/spark/ml/classification/LogisticRegression.scala --- @@ -930,10 +942,8 @@ class BinaryLogisticRegressionSummary

[GitHub] spark pull request #14558: [SPARK-16508][SparkR] Fix warnings on undocumente...

2016-08-15 Thread junyangq
Github user junyangq commented on a diff in the pull request: https://github.com/apache/spark/pull/14558#discussion_r74727208 --- Diff: R/pkg/R/mllib.R --- @@ -602,14 +599,14 @@ setMethod("spark.survreg", signature(data = "SparkDataFrame", formula = "formula # Returns a

[GitHub] spark pull request #14558: [SPARK-16508][SparkR] Fix warnings on undocumente...

2016-08-15 Thread junyangq
Github user junyangq commented on a diff in the pull request: https://github.com/apache/spark/pull/14558#discussion_r74728822 --- Diff: R/pkg/R/generics.R --- @@ -1277,8 +1384,11 @@ setGeneric("spark.naiveBayes", function(data, formula, ...) { standardGeneric("s #'

[GitHub] spark issue #14520: [SPARK-16934][ML][MLLib]Update LogisticCostAggregator se...

2016-08-15 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/14520 **[Test build #63778 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/63778/consoleFull)** for PR 14520 at commit

[GitHub] spark issue #14520: [SPARK-16934][ML][MLLib]Update LogisticCostAggregator se...

2016-08-15 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/14520 **[Test build #63778 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/63778/consoleFull)** for PR 14520 at commit

[GitHub] spark pull request #14558: [SPARK-16508][SparkR] Fix warnings on undocumente...

2016-08-15 Thread junyangq
Github user junyangq commented on a diff in the pull request: https://github.com/apache/spark/pull/14558#discussion_r74729028 --- Diff: R/pkg/R/generics.R --- @@ -1251,10 +1311,57 @@ setGeneric("year", function(x) { standardGeneric("year") }) #' @export

[GitHub] spark issue #14520: [SPARK-16934][ML][MLLib]Update LogisticCostAggregator se...

2016-08-15 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/14520 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #11956: [SPARK-14098][SQL] Generate Java code that gets a float/...

2016-08-15 Thread kiszk
Github user kiszk commented on the issue: https://github.com/apache/spark/pull/11956 @davies could you please review this? --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #14520: [SPARK-16934][ML][MLLib]Update LogisticCostAggregator se...

2016-08-15 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/14520 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/63778/ Test FAILed. ---

[GitHub] spark issue #14520: [SPARK-16934][ML][MLLib]Update LogisticCostAggregator se...

2016-08-15 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/14520 **[Test build #63779 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/63779/consoleFull)** for PR 14520 at commit

[GitHub] spark issue #14634: [SPARK-17051][SQL] we should use hadoopConf in InsertInt...

2016-08-15 Thread cloud-fan
Github user cloud-fan commented on the issue: https://github.com/apache/spark/pull/14634 1. `hadoopConf` contains all the confs from SQL conf, see `SessionState.newHadoopConf` 2. users can change `hadoopConf` at runtime. 3. the default value is from hive, I'm ok to not follow

[GitHub] spark pull request #14558: [SPARK-16508][SparkR] Fix warnings on undocumente...

2016-08-15 Thread junyangq
Github user junyangq commented on a diff in the pull request: https://github.com/apache/spark/pull/14558#discussion_r74728351 --- Diff: R/pkg/R/mllib.R --- @@ -142,15 +143,6 @@ setMethod("spark.glm", signature(data = "SparkDataFrame", formula = "formula"), #' Generalized

[GitHub] spark pull request #14645: [MINOR] [DOC] Correct code snippet results in qui...

2016-08-15 Thread srowen
Github user srowen commented on a diff in the pull request: https://github.com/apache/spark/pull/14645#discussion_r74730995 --- Diff: docs/quick-start.md --- @@ -40,7 +40,7 @@ RDDs have _[actions](programming-guide.html#actions)_, which return values, and {% highlight

[GitHub] spark pull request #14643: [SPARK-17057][ML] ProbabilisticClassifierModels' ...

2016-08-15 Thread srowen
Github user srowen commented on a diff in the pull request: https://github.com/apache/spark/pull/14643#discussion_r74732778 --- Diff: mllib/src/main/scala/org/apache/spark/ml/classification/ProbabilisticClassifier.scala --- @@ -201,11 +201,18 @@ abstract class

[GitHub] spark pull request #14633: [Trivial] [ML] Fix LogisticRegression typo in err...

2016-08-15 Thread srowen
Github user srowen commented on a diff in the pull request: https://github.com/apache/spark/pull/14633#discussion_r74732910 --- Diff: mllib/src/main/scala/org/apache/spark/ml/classification/LogisticRegression.scala --- @@ -303,7 +303,7 @@ class LogisticRegression @Since("1.2.0")

[GitHub] spark pull request #14645: [MINOR] [DOC] Correct code snippet results in qui...

2016-08-15 Thread linbojin
Github user linbojin commented on a diff in the pull request: https://github.com/apache/spark/pull/14645#discussion_r74733368 --- Diff: docs/quick-start.md --- @@ -40,7 +40,7 @@ RDDs have _[actions](programming-guide.html#actions)_, which return values, and {% highlight

[GitHub] spark issue #11157: [SPARK-11714][Mesos] Make Spark on Mesos honor port rest...

2016-08-15 Thread skonto
Github user skonto commented on the issue: https://github.com/apache/spark/pull/11157 @srowen could you merge this pls? --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled

[GitHub] spark issue #14520: [SPARK-16934][ML][MLLib]Update LogisticCostAggregator se...

2016-08-15 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/14520 **[Test build #63779 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/63779/consoleFull)** for PR 14520 at commit

[GitHub] spark issue #11157: [SPARK-11714][Mesos] Make Spark on Mesos honor port rest...

2016-08-15 Thread srowen
Github user srowen commented on the issue: https://github.com/apache/spark/pull/11157 Merged to master --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or

[GitHub] spark pull request #11157: [SPARK-11714][Mesos] Make Spark on Mesos honor po...

2016-08-15 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/spark/pull/11157 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is

[GitHub] spark pull request #14633: [Trivial] [ML] Fix LogisticRegression typo in err...

2016-08-15 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/spark/pull/14633 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is

[GitHub] spark pull request #14645: [MINOR] [DOC] Correct code snippet results in qui...

2016-08-15 Thread linbojin
Github user linbojin commented on a diff in the pull request: https://github.com/apache/spark/pull/14645#discussion_r74737989 --- Diff: docs/quick-start.md --- @@ -40,7 +40,7 @@ RDDs have _[actions](programming-guide.html#actions)_, which return values, and {% highlight

[GitHub] spark pull request #14644: Enable GPU support with Mesos

2016-08-15 Thread tnachen
GitHub user tnachen opened a pull request: https://github.com/apache/spark/pull/14644 Enable GPU support with Mesos ## What changes were proposed in this pull request? Enable GPU resources to be used when running coarse grain mode with Mesos. ## How was this

[GitHub] spark pull request #14645: [MINOR] [DOC] Correct code snippet results in qui...

2016-08-15 Thread linbojin
GitHub user linbojin opened a pull request: https://github.com/apache/spark/pull/14645 [MINOR] [DOC] Correct code snippet results in quick start documentation ## What changes were proposed in this pull request? As README.md file is updated over time. Some code snippet

[GitHub] spark issue #14642: [SPARK-17056][Core] Fix a wrong assert regarding unroll ...

2016-08-15 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/14642 **[Test build #63773 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/63773/consoleFull)** for PR 14642 at commit

[GitHub] spark issue #14642: [SPARK-17056][Core] Fix a wrong assert regarding unroll ...

2016-08-15 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/14642 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/63773/ Test PASSed. ---

[GitHub] spark issue #14642: [SPARK-17056][Core] Fix a wrong assert regarding unroll ...

2016-08-15 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/14642 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #14642: [SPARK-17056][Core] Fix a wrong assert regarding unroll ...

2016-08-15 Thread viirya
Github user viirya commented on the issue: https://github.com/apache/spark/pull/14642 Actually I think it might be able to remove this assert... --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not

[GitHub] spark issue #13758: [SPARK-16043][SQL] Prepare GenericArrayData implementati...

2016-08-15 Thread kiszk
Github user kiszk commented on the issue: https://github.com/apache/spark/pull/13758 @hvanhovell , @cloud-fan , @davies could you please review this? --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does

[GitHub] spark issue #13704: [SPARK-15985][SQL] Eliminate redundant cast from an arra...

2016-08-15 Thread kiszk
Github user kiszk commented on the issue: https://github.com/apache/spark/pull/13704 @liancheng would it be possible to review this? --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this

[GitHub] spark issue #13680: [SPARK-15962][SQL] Introduce implementation with a dense...

2016-08-15 Thread kiszk
Github user kiszk commented on the issue: https://github.com/apache/spark/pull/13680 @davies could you please review this again since I addressed comments? --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project

[GitHub] spark pull request #14558: [SPARK-16508][SparkR] Fix warnings on undocumente...

2016-08-15 Thread junyangq
Github user junyangq commented on a diff in the pull request: https://github.com/apache/spark/pull/14558#discussion_r74729338 --- Diff: R/pkg/R/DataFrame.R --- @@ -510,9 +510,7 @@ setMethod("registerTempTable", #' #' Insert the contents of a SparkDataFrame into a table

[GitHub] spark issue #14644: [MESOS] Enable GPU support with Mesos

2016-08-15 Thread srowen
Github user srowen commented on the issue: https://github.com/apache/spark/pull/14644 Does Mesos have a general node labeling mechanism like YARN that one could use to choose machines with a certain property? It seems OK to also support a Mesos-specific property under spark.mesos.*

[GitHub] spark issue #14644: [MESOS] Enable GPU support with Mesos

2016-08-15 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/14644 **[Test build #63776 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/63776/consoleFull)** for PR 14644 at commit

[GitHub] spark issue #14644: [MESOS] Enable GPU support with Mesos

2016-08-15 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/14644 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #14644: [MESOS] Enable GPU support with Mesos

2016-08-15 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/14644 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/63776/ Test PASSed. ---

[GitHub] spark issue #14644: [MESOS] Enable GPU support with Mesos

2016-08-15 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/14644 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #14644: [MESOS] Enable GPU support with Mesos

2016-08-15 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/14644 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/63777/ Test PASSed. ---

[GitHub] spark issue #14644: [MESOS] Enable GPU support with Mesos

2016-08-15 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/14644 **[Test build #63777 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/63777/consoleFull)** for PR 14644 at commit

[GitHub] spark issue #14520: [SPARK-16934][ML][MLLib]Update LogisticCostAggregator se...

2016-08-15 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/14520 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #14520: [SPARK-16934][ML][MLLib]Update LogisticCostAggregator se...

2016-08-15 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/14520 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/63779/ Test PASSed. ---

[GitHub] spark issue #10808: [SPARK-11714][Mesos] Make Spark on Mesos honor port rest...

2016-08-15 Thread srowen
Github user srowen commented on the issue: https://github.com/apache/spark/pull/10808 @skonto you can close this PR now --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled

[GitHub] spark pull request #14645: [MINOR] [DOC] Correct code snippet results in qui...

2016-08-15 Thread srowen
Github user srowen commented on a diff in the pull request: https://github.com/apache/spark/pull/14645#discussion_r74735625 --- Diff: docs/quick-start.md --- @@ -40,7 +40,7 @@ RDDs have _[actions](programming-guide.html#actions)_, which return values, and {% highlight

[GitHub] spark issue #14520: [SPARK-16934][ML][MLLib]Update LogisticCostAggregator se...

2016-08-15 Thread srowen
Github user srowen commented on the issue: https://github.com/apache/spark/pull/14520 @yanboliang are you OK with this? --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled

[GitHub] spark issue #14633: [Trivial] [ML] Fix LogisticRegression typo in error mess...

2016-08-15 Thread srowen
Github user srowen commented on the issue: https://github.com/apache/spark/pull/14633 Merged to master --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or

[GitHub] spark pull request #14645: [MINOR] [DOC] Correct code snippet results in qui...

2016-08-15 Thread linbojin
Github user linbojin commented on a diff in the pull request: https://github.com/apache/spark/pull/14645#discussion_r74737117 --- Diff: docs/quick-start.md --- @@ -40,7 +40,7 @@ RDDs have _[actions](programming-guide.html#actions)_, which return values, and {% highlight

[GitHub] spark issue #14637: [WIP] [SPARK-16967] move mesos to module

2016-08-15 Thread srowen
Github user srowen commented on the issue: https://github.com/apache/spark/pull/14637 Directionally this is looking spot on, thank you. Ping when you want a review. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If

[GitHub] spark pull request #14645: [MINOR] [DOC] Correct code snippet results in qui...

2016-08-15 Thread srowen
Github user srowen commented on a diff in the pull request: https://github.com/apache/spark/pull/14645#discussion_r74737211 --- Diff: docs/quick-start.md --- @@ -40,7 +40,7 @@ RDDs have _[actions](programming-guide.html#actions)_, which return values, and {% highlight

[GitHub] spark issue #14279: [SPARK-16216][SQL] Write Timestamp and Date in ISO 8601 ...

2016-08-15 Thread srowen
Github user srowen commented on the issue: https://github.com/apache/spark/pull/14279 OK, I'd like to merge this for master if there are no other comments. I'm waiting more than usual to make sure --- If your project is set up for it, you can reply to this email and have your reply

[GitHub] spark pull request #14597: [SPARK-17017][MLLIB] add a chiSquare Selector bas...

2016-08-15 Thread srowen
Github user srowen commented on a diff in the pull request: https://github.com/apache/spark/pull/14597#discussion_r74738464 --- Diff: mllib/src/main/scala/org/apache/spark/mllib/feature/ChiSqSelector.scala --- @@ -197,3 +197,28 @@ class ChiSqSelector @Since("1.3.0") ( new

[GitHub] spark issue #14645: [MINOR] [DOC] Correct code snippet results in quick star...

2016-08-15 Thread srowen
Github user srowen commented on the issue: https://github.com/apache/spark/pull/14645 Jenkins test this please --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes

[GitHub] spark pull request #14645: [MINOR] [DOC] Correct code snippet results in qui...

2016-08-15 Thread srowen
Github user srowen commented on a diff in the pull request: https://github.com/apache/spark/pull/14645#discussion_r74738593 --- Diff: docs/quick-start.md --- @@ -40,7 +40,7 @@ RDDs have _[actions](programming-guide.html#actions)_, which return values, and {% highlight

[GitHub] spark pull request #14597: [SPARK-17017][MLLIB] add a chiSquare Selector bas...

2016-08-15 Thread mpjlu
Github user mpjlu commented on a diff in the pull request: https://github.com/apache/spark/pull/14597#discussion_r74740698 --- Diff: mllib/src/main/scala/org/apache/spark/mllib/feature/ChiSqSelector.scala --- @@ -197,3 +197,28 @@ class ChiSqSelector @Since("1.3.0") ( new

[GitHub] spark issue #14551: [SPARK-16961][CORE] Fixed off-by-one error that biased r...

2016-08-15 Thread srowen
Github user srowen commented on the issue: https://github.com/apache/spark/pull/14551 If we can get that last test failure patched in any reasonable form, I'll merge --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If

[GitHub] spark pull request #14597: [SPARK-17017][MLLIB] add a chiSquare Selector bas...

2016-08-15 Thread srowen
Github user srowen commented on a diff in the pull request: https://github.com/apache/spark/pull/14597#discussion_r74741127 --- Diff: mllib/src/main/scala/org/apache/spark/mllib/feature/ChiSqSelector.scala --- @@ -197,3 +197,28 @@ class ChiSqSelector @Since("1.3.0") ( new

[GitHub] spark pull request #14597: [SPARK-17017][MLLIB] add a chiSquare Selector bas...

2016-08-15 Thread srowen
Github user srowen commented on a diff in the pull request: https://github.com/apache/spark/pull/14597#discussion_r74742606 --- Diff: mllib/src/main/scala/org/apache/spark/mllib/feature/ChiSqSelector.scala --- @@ -197,3 +197,28 @@ class ChiSqSelector @Since("1.3.0") ( new

[GitHub] spark pull request #14597: [SPARK-17017][MLLIB] add a chiSquare Selector bas...

2016-08-15 Thread mpjlu
Github user mpjlu commented on a diff in the pull request: https://github.com/apache/spark/pull/14597#discussion_r74742525 --- Diff: mllib/src/main/scala/org/apache/spark/mllib/feature/ChiSqSelector.scala --- @@ -197,3 +197,28 @@ class ChiSqSelector @Since("1.3.0") ( new

[GitHub] spark pull request #14597: [SPARK-17017][MLLIB] add a chiSquare Selector bas...

2016-08-15 Thread mpjlu
Github user mpjlu commented on a diff in the pull request: https://github.com/apache/spark/pull/14597#discussion_r74743026 --- Diff: mllib/src/main/scala/org/apache/spark/mllib/feature/ChiSqSelector.scala --- @@ -197,3 +197,28 @@ class ChiSqSelector @Since("1.3.0") ( new

[GitHub] spark issue #13758: [SPARK-16043][SQL] Prepare GenericArrayData implementati...

2016-08-15 Thread hvanhovell
Github user hvanhovell commented on the issue: https://github.com/apache/spark/pull/13758 @kiszk I have the feeling this is not that useful anymore since we are getting close to committing your work on the UnsafeArrayData. This seems like it is addressing an edge case. What are the

[GitHub] spark pull request #14646: [SPARK-17058] [build] Add maven snapshots-and-sta...

2016-08-15 Thread steveloughran
GitHub user steveloughran opened a pull request: https://github.com/apache/spark/pull/14646 [SPARK-17058] [build] Add maven snapshots-and-staging profile to build/test against staging artifacts ## What changes were proposed in this pull request? Adds a

[GitHub] spark issue #14645: [MINOR] [DOC] Correct code snippet results in quick star...

2016-08-15 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/14645 **[Test build #63780 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/63780/consoleFull)** for PR 14645 at commit

[GitHub] spark issue #14524: [SPARK-16832] [ML] [WIP] CrossValidator and TrainValidat...

2016-08-15 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/14524 **[Test build #63781 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/63781/consoleFull)** for PR 14524 at commit

[GitHub] spark issue #14646: [SPARK-17058] [build] Add maven snapshots-and-staging pr...

2016-08-15 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/14646 **[Test build #63782 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/63782/consoleFull)** for PR 14646 at commit

[GitHub] spark issue #14645: [MINOR] [DOC] Correct code snippet results in quick star...

2016-08-15 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/14645 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/63780/ Test PASSed. ---

[GitHub] spark issue #14645: [MINOR] [DOC] Correct code snippet results in quick star...

2016-08-15 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/14645 **[Test build #63780 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/63780/consoleFull)** for PR 14645 at commit

[GitHub] spark issue #14645: [MINOR] [DOC] Correct code snippet results in quick star...

2016-08-15 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/14645 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #14524: [SPARK-16832] [ML] [WIP] CrossValidator and TrainValidat...

2016-08-15 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/14524 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/63781/ Test PASSed. ---

[GitHub] spark issue #14524: [SPARK-16832] [ML] [WIP] CrossValidator and TrainValidat...

2016-08-15 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/14524 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #14524: [SPARK-16832] [ML] [WIP] CrossValidator and TrainValidat...

2016-08-15 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/14524 **[Test build #63781 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/63781/consoleFull)** for PR 14524 at commit

[GitHub] spark pull request #14520: [SPARK-16934][ML][MLLib]Update LogisticCostAggreg...

2016-08-15 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/spark/pull/14520 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is

[GitHub] spark issue #14634: [SPARK-17051][SQL] we should use hadoopConf in InsertInt...

2016-08-15 Thread gatorsmile
Github user gatorsmile commented on the issue: https://github.com/apache/spark/pull/14634 uh, I see. Thank you! No more question. : ) --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this

[GitHub] spark issue #14520: [SPARK-16934][ML][MLLib]Update LogisticCostAggregator se...

2016-08-15 Thread yanboliang
Github user yanboliang commented on the issue: https://github.com/apache/spark/pull/14520 LGTM, merged into master. Thanks! --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #14647: [WIP][Test only][SPARK-6235]Address various 2G limits

2016-08-15 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/14647 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #14646: [SPARK-17058] [build] Add maven snapshots-and-staging pr...

2016-08-15 Thread steveloughran
Github user steveloughran commented on the issue: https://github.com/apache/spark/pull/14646 Note that Jenkins, being SBT-based, isn't going to explore the codepath here --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If

[GitHub] spark issue #14647: [WIP][Test only][SPARK-6235]Address various 2G limits

2016-08-15 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/14647 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/63783/ Test FAILed. ---

[GitHub] spark issue #14647: [WIP][Test only][SPARK-6235]Address various 2G limits

2016-08-15 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/14647 **[Test build #63783 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/63783/consoleFull)** for PR 14647 at commit

[GitHub] spark pull request #14643: [SPARK-17057][ML] ProbabilisticClassifierModels' ...

2016-08-15 Thread srowen
Github user srowen commented on a diff in the pull request: https://github.com/apache/spark/pull/14643#discussion_r74774476 --- Diff: mllib/src/main/scala/org/apache/spark/ml/classification/ProbabilisticClassifier.scala --- @@ -201,11 +201,18 @@ abstract class

[GitHub] spark issue #14646: [SPARK-17058] [build] Add maven snapshots-and-staging pr...

2016-08-15 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/14646 **[Test build #63782 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/63782/consoleFull)** for PR 14646 at commit

[GitHub] spark issue #14646: [SPARK-17058] [build] Add maven snapshots-and-staging pr...

2016-08-15 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/14646 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #14647: [WIP][Test only][SPARK-6235]Address various 2G limits

2016-08-15 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/14647 **[Test build #63783 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/63783/consoleFull)** for PR 14647 at commit

[GitHub] spark pull request #14643: [SPARK-17057][ML] ProbabilisticClassifierModels' ...

2016-08-15 Thread holdenk
Github user holdenk commented on a diff in the pull request: https://github.com/apache/spark/pull/14643#discussion_r74767763 --- Diff: mllib/src/main/scala/org/apache/spark/ml/classification/ProbabilisticClassifier.scala --- @@ -201,11 +201,18 @@ abstract class

[GitHub] spark pull request #14647: [WIP][Test only][SPARK-6235]Address various 2G li...

2016-08-15 Thread witgo
GitHub user witgo opened a pull request: https://github.com/apache/spark/pull/14647 [WIP][Test only][SPARK-6235]Address various 2G limits ## What changes were proposed in this pull request? The main changes. 1. Replace DiskStore method `def getBytes (blockId: BlockId):

[GitHub] spark issue #14646: [SPARK-17058] [build] Add maven snapshots-and-staging pr...

2016-08-15 Thread srowen
Github user srowen commented on the issue: https://github.com/apache/spark/pull/14646 How about adding this to the default set of repos rather than putting it behind a profile -- does that cause a problem? --- If your project is set up for it, you can reply to this email and have

[GitHub] spark issue #14647: [WIP][Test only][DEMO][SPARK-6235]Address various 2G lim...

2016-08-15 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/14647 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

  1   2   3   4   5   6   >