[GitHub] spark pull request: [SPARK-9148][SPARK-10252][SQL] Update SQL Prog...

2015-08-27 Thread marmbrus
Github user marmbrus commented on the pull request: https://github.com/apache/spark/pull/8441#issuecomment-135519881 Thanks guys! Merged to master and 1.5 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project

[GitHub] spark pull request: [SPARK-9986][SPARK-9991][SPARK-9993][SQL]Creat...

2015-08-27 Thread marmbrus
Github user marmbrus commented on a diff in the pull request: https://github.com/apache/spark/pull/8464#discussion_r38132954 --- Diff: sql/core/src/test/scala/org/apache/spark/sql/execution/local/ProjectNodeSuite.scala --- @@ -0,0 +1,42 @@ +/* +* Licensed to the Apache

[GitHub] spark pull request: [SPARK-4223] [Core] Support * in acls.

2015-08-27 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/8398#issuecomment-135539098 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your

[GitHub] spark pull request: [SPARK-10295] [CORE] Dynamic allocation in Mes...

2015-08-27 Thread srowen
GitHub user srowen opened a pull request: https://github.com/apache/spark/pull/8489 [SPARK-10295] [CORE] Dynamic allocation in Mesos does not release when RDDs are cached Remove obsolete warning about dynamic allocation not working with cached RDDs See discussion in

[GitHub] spark pull request: [SPARK-10321] sizeInBytes in HadoopFsRelation

2015-08-27 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/8490#issuecomment-135545386 Merged build triggered. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not

[GitHub] spark pull request: [SPARK-10321] sizeInBytes in HadoopFsRelation

2015-08-27 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/8490#issuecomment-135545440 Merged build started. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not

[GitHub] spark pull request: [SPARK-9680][MLlib][Doc] StopWordsRemovers use...

2015-08-27 Thread mengxr
Github user mengxr commented on a diff in the pull request: https://github.com/apache/spark/pull/8436#discussion_r38146489 --- Diff: docs/ml-features.md --- @@ -306,16 +306,88 @@ regexTokenizer = RegexTokenizer(inputCol=sentence, outputCol=words, pattern= /div /div

[GitHub] spark pull request: [SPARK-10287] [SQL] Fixes JSONRelation refresh...

2015-08-27 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/8469#issuecomment-135556521 [Test build #1698 has started](https://amplab.cs.berkeley.edu/jenkins/job/NewSparkPullRequestBuilder/1698/consoleFull) for PR 8469 at commit

[GitHub] spark pull request: [SPARK-4980] [MLlib] Add decay factors to stre...

2015-08-27 Thread rotationsymmetry
Github user rotationsymmetry commented on the pull request: https://github.com/apache/spark/pull/8022#issuecomment-135557506 @feynmanliang Thank you very much for your review. I have incorporated your comments in commit a4ed2b0. * Add ScalaDoc for public API. *

[GitHub] spark pull request: [SPARK-9680][MLlib][Doc] StopWordsRemovers use...

2015-08-27 Thread feynmanliang
Github user feynmanliang commented on a diff in the pull request: https://github.com/apache/spark/pull/8436#discussion_r38148019 --- Diff: docs/ml-features.md --- @@ -306,16 +306,88 @@ regexTokenizer = RegexTokenizer(inputCol=sentence, outputCol=words, pattern= /div /div

[GitHub] spark pull request: [SPARK-9680][MLlib][Doc] StopWordsRemovers use...

2015-08-27 Thread feynmanliang
Github user feynmanliang commented on a diff in the pull request: https://github.com/apache/spark/pull/8436#discussion_r38149122 --- Diff: mllib/src/test/java/org/apache/spark/ml/feature/JavaStopWordsRemoverSuite.java --- @@ -0,0 +1,72 @@ +/* + * Licensed to the Apache

[GitHub] spark pull request: [SPARK-4980] [MLlib] Add decay factors to stre...

2015-08-27 Thread feynmanliang
Github user feynmanliang commented on a diff in the pull request: https://github.com/apache/spark/pull/8022#discussion_r38149662 --- Diff: mllib/src/main/scala/org/apache/spark/mllib/classification/StreamingLogisticRegressionWithSGD.scala --- @@ -32,6 +32,11 @@ import

[GitHub] spark pull request: [SPARK-9680][MLlib][Doc] StopWordsRemovers use...

2015-08-27 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/8436#issuecomment-135564548 [Test build #41708 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/41708/consoleFull) for PR 8436 at commit

[GitHub] spark pull request: [SPARK-4980] [MLlib] Add decay factors to stre...

2015-08-27 Thread feynmanliang
Github user feynmanliang commented on a diff in the pull request: https://github.com/apache/spark/pull/8022#discussion_r38150131 --- Diff: mllib/src/main/scala/org/apache/spark/mllib/regression/StreamingDecay.scala --- @@ -0,0 +1,116 @@ +/* + * Licensed to the Apache

[GitHub] spark pull request: [SPARK-4980] [MLlib] Add decay factors to stre...

2015-08-27 Thread feynmanliang
Github user feynmanliang commented on a diff in the pull request: https://github.com/apache/spark/pull/8022#discussion_r38150103 --- Diff: mllib/src/main/scala/org/apache/spark/mllib/regression/StreamingDecay.scala --- @@ -0,0 +1,116 @@ +/* + * Licensed to the Apache

[GitHub] spark pull request: [SPARK-10295] [CORE] Dynamic allocation in Mes...

2015-08-27 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/8489#issuecomment-135542644 Merged build triggered. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not

[GitHub] spark pull request: [SPARK-10321] sizeInBytes in HadoopFsRelation

2015-08-27 Thread davies
GitHub user davies opened a pull request: https://github.com/apache/spark/pull/8490 [SPARK-10321] sizeInBytes in HadoopFsRelation Having sizeInBytes in HadoopFsRelation to enable broadcast join. cc @marmbrus You can merge this pull request into a Git repository by

[GitHub] spark pull request: [SPARK-10287] [SQL] Fixes JSONRelation refresh...

2015-08-27 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/8469#issuecomment-135543732 [Test build #41705 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/41705/consoleFull) for PR 8469 at commit

[GitHub] spark pull request: [SPARK-10295] [CORE] Dynamic allocation in Mes...

2015-08-27 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/8489#issuecomment-135542752 Merged build started. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not

[GitHub] spark pull request: [SPARK-10295] [CORE] Dynamic allocation in Mes...

2015-08-27 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/8489#issuecomment-135545953 [Test build #41706 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/41706/consoleFull) for PR 8489 at commit

[GitHub] spark pull request: [SPARK-10321] sizeInBytes in HadoopFsRelation

2015-08-27 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/8490#issuecomment-135548190 [Test build #41707 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/41707/consoleFull) for PR 8490 at commit

[GitHub] spark pull request: [SPARK-9680][MLlib][Doc] StopWordsRemovers use...

2015-08-27 Thread feynmanliang
Github user feynmanliang commented on a diff in the pull request: https://github.com/apache/spark/pull/8436#discussion_r38147717 --- Diff: docs/ml-features.md --- @@ -306,16 +306,88 @@ regexTokenizer = RegexTokenizer(inputCol=sentence, outputCol=words, pattern= /div /div

[GitHub] spark pull request: [SPARK-10101] [SQL] Added stringDataType optio...

2015-08-27 Thread rama-mullapudi
Github user rama-mullapudi commented on the pull request: https://github.com/apache/spark/pull/8374#issuecomment-135557977 Added maxlength for field metadata so string types can be converted to VARCHAR(n). Added JDBCDialects for OracleDialect, NetezzaDialect and modifed

[GitHub] spark pull request: [SPARK-9680][MLlib][Doc] StopWordsRemovers use...

2015-08-27 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/8436#issuecomment-135562698 Merged build triggered. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not

[GitHub] spark pull request: [SPARK-9680][MLlib][Doc] StopWordsRemovers use...

2015-08-27 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/8436#issuecomment-135562745 Merged build started. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not

[GitHub] spark pull request: [SPARK-4980] [MLlib] Add decay factors to stre...

2015-08-27 Thread feynmanliang
Github user feynmanliang commented on a diff in the pull request: https://github.com/apache/spark/pull/8022#discussion_r38150314 --- Diff: mllib/src/main/scala/org/apache/spark/mllib/regression/StreamingDecay.scala --- @@ -0,0 +1,116 @@ +/* + * Licensed to the Apache

[GitHub] spark pull request: [SPARK-4980] [MLlib] Add decay factors to stre...

2015-08-27 Thread feynmanliang
Github user feynmanliang commented on a diff in the pull request: https://github.com/apache/spark/pull/8022#discussion_r38150200 --- Diff: mllib/src/main/scala/org/apache/spark/mllib/regression/StreamingDecay.scala --- @@ -0,0 +1,116 @@ +/* + * Licensed to the Apache

[GitHub] spark pull request: [SPARK-9901]User guide for RowMatrix Tall-and-...

2015-08-27 Thread mengxr
Github user mengxr commented on the pull request: https://github.com/apache/spark/pull/8462#issuecomment-135553300 LGTM. Merged into master and branch-1.5. Thanks! --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your

[GitHub] spark pull request: [SPARK-9901]User guide for RowMatrix Tall-and-...

2015-08-27 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/spark/pull/8462 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is

[GitHub] spark pull request: [SPARK-9910][ML]User guide for train validatio...

2015-08-27 Thread mengxr
Github user mengxr commented on a diff in the pull request: https://github.com/apache/spark/pull/8377#discussion_r38147129 --- Diff: docs/ml-guide.md --- @@ -868,6 +868,132 @@ jsc.stop(); /div +## Example: Model Selection via Train Validation Split +In

[GitHub] spark pull request: [SPARK-9680][MLlib][Doc] StopWordsRemovers use...

2015-08-27 Thread feynmanliang
Github user feynmanliang commented on a diff in the pull request: https://github.com/apache/spark/pull/8436#discussion_r38148403 --- Diff: docs/ml-features.md --- @@ -306,16 +306,88 @@ regexTokenizer = RegexTokenizer(inputCol=sentence, outputCol=words, pattern= /div /div

[GitHub] spark pull request: [SPARK-9680][MLlib][Doc] StopWordsRemovers use...

2015-08-27 Thread feynmanliang
Github user feynmanliang commented on a diff in the pull request: https://github.com/apache/spark/pull/8436#discussion_r38148971 --- Diff: docs/ml-features.md --- @@ -306,16 +306,88 @@ regexTokenizer = RegexTokenizer(inputCol=sentence, outputCol=words, pattern= /div /div

[GitHub] spark pull request: [SPARK-4980] [MLlib] Add decay factors to stre...

2015-08-27 Thread feynmanliang
Github user feynmanliang commented on a diff in the pull request: https://github.com/apache/spark/pull/8022#discussion_r38149945 --- Diff: mllib/src/main/scala/org/apache/spark/mllib/regression/StreamingDecay.scala --- @@ -0,0 +1,116 @@ +/* + * Licensed to the Apache

[GitHub] spark pull request: [SPARK-4980] [MLlib] Add decay factors to stre...

2015-08-27 Thread feynmanliang
Github user feynmanliang commented on a diff in the pull request: https://github.com/apache/spark/pull/8022#discussion_r38149963 --- Diff: mllib/src/main/scala/org/apache/spark/mllib/regression/StreamingDecay.scala --- @@ -0,0 +1,116 @@ +/* + * Licensed to the Apache

[GitHub] spark pull request: [SPARK-4980] [MLlib] Add decay factors to stre...

2015-08-27 Thread feynmanliang
Github user feynmanliang commented on a diff in the pull request: https://github.com/apache/spark/pull/8022#discussion_r38151338 --- Diff: mllib/src/main/scala/org/apache/spark/mllib/regression/StreamingLinearRegressionWithSGD.scala --- @@ -47,6 +52,7 @@ class

[GitHub] spark pull request: [SPARK-10295] [CORE] Dynamic allocation in Mes...

2015-08-27 Thread vanzin
Github user vanzin commented on the pull request: https://github.com/apache/spark/pull/8489#issuecomment-135546210 LGTM. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled

[GitHub] spark pull request: [SPARK-10311][Streaming]Reload appId and attem...

2015-08-27 Thread vanzin
Github user vanzin commented on the pull request: https://github.com/apache/spark/pull/8477#issuecomment-135548614 I'm not familiar with how this data is used by the streaming backend, but it looks odd to be manually reloading it from a checkpoint. In client mode, AM restarts

[GitHub] spark pull request: [SPARK-9680][MLlib][Doc] StopWordsRemovers use...

2015-08-27 Thread mengxr
Github user mengxr commented on a diff in the pull request: https://github.com/apache/spark/pull/8436#discussion_r38146300 --- Diff: docs/ml-features.md --- @@ -306,16 +306,88 @@ regexTokenizer = RegexTokenizer(inputCol=sentence, outputCol=words, pattern= /div /div

[GitHub] spark pull request: [SPARK-10287] [SQL] Fixes JSONRelation refresh...

2015-08-27 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/8469#issuecomment-13478 Test FAILed. Refer to this link for build results (access rights to CI server needed):

[GitHub] spark pull request: [SPARK-9680][MLlib][Doc] StopWordsRemovers use...

2015-08-27 Thread mengxr
Github user mengxr commented on a diff in the pull request: https://github.com/apache/spark/pull/8436#discussion_r38146311 --- Diff: docs/ml-features.md --- @@ -306,16 +306,88 @@ regexTokenizer = RegexTokenizer(inputCol=sentence, outputCol=words, pattern= /div /div

[GitHub] spark pull request: [SPARK-10287] [SQL] Fixes JSONRelation refresh...

2015-08-27 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/8469#issuecomment-13418 [Test build #41705 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/41705/console) for PR 8469 at commit

[GitHub] spark pull request: [SPARK-10287] [SQL] Fixes JSONRelation refresh...

2015-08-27 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/8469#issuecomment-13477 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your

[GitHub] spark pull request: [SPARK-9680][MLlib][Doc] StopWordsRemovers use...

2015-08-27 Thread mengxr
Github user mengxr commented on a diff in the pull request: https://github.com/apache/spark/pull/8436#discussion_r38146305 --- Diff: docs/ml-features.md --- @@ -306,16 +306,88 @@ regexTokenizer = RegexTokenizer(inputCol=sentence, outputCol=words, pattern= /div /div

[GitHub] spark pull request: [SPARK-9680][MLlib][Doc] StopWordsRemovers use...

2015-08-27 Thread mengxr
Github user mengxr commented on a diff in the pull request: https://github.com/apache/spark/pull/8436#discussion_r38146617 --- Diff: mllib/src/test/java/org/apache/spark/ml/feature/JavaStopWordsRemoverSuite.java --- @@ -0,0 +1,72 @@ +/* + * Licensed to the Apache Software

[GitHub] spark pull request: [SPARK-4980] [MLlib] Add decay factors to stre...

2015-08-27 Thread feynmanliang
Github user feynmanliang commented on a diff in the pull request: https://github.com/apache/spark/pull/8022#discussion_r38149766 --- Diff: mllib/src/main/scala/org/apache/spark/mllib/regression/StreamingDecay.scala --- @@ -0,0 +1,116 @@ +/* + * Licensed to the Apache

[GitHub] spark pull request: [SPARK-4980] [MLlib] Add decay factors to stre...

2015-08-27 Thread feynmanliang
Github user feynmanliang commented on a diff in the pull request: https://github.com/apache/spark/pull/8022#discussion_r38149699 --- Diff: mllib/src/main/scala/org/apache/spark/mllib/regression/StreamingDecay.scala --- @@ -0,0 +1,116 @@ +/* + * Licensed to the Apache

[GitHub] spark pull request: [SPARK-4980] [MLlib] Add decay factors to stre...

2015-08-27 Thread feynmanliang
Github user feynmanliang commented on a diff in the pull request: https://github.com/apache/spark/pull/8022#discussion_r38150677 --- Diff: mllib/src/main/scala/org/apache/spark/mllib/regression/StreamingDecay.scala --- @@ -0,0 +1,116 @@ +/* + * Licensed to the Apache

[GitHub] spark pull request: [SPARK-8057][Core]Call TaskAttemptContext.getT...

2015-08-27 Thread JoshRosen
Github user JoshRosen commented on the pull request: https://github.com/apache/spark/pull/6599#issuecomment-135565890 I think that we should also backport this to branch-1.4. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as

[GitHub] spark pull request: [SPARK-8952] [SPARKR] - Wrap normalizePath cal...

2015-08-27 Thread lresende
Github user lresende commented on the pull request: https://github.com/apache/spark/pull/8343#issuecomment-135572901 Thanks for the comments @shivaram and @sun-rui. I have standardized in using supressWarnings for all invocations of normalizePath. --- If your project is set up for

[GitHub] spark pull request: [SPARK-8952] [SPARKR] - Wrap normalizePath cal...

2015-08-27 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/8343#issuecomment-135575531 [Test build #41709 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/41709/console) for PR 8343 at commit

[GitHub] spark pull request: [SPARK-10321] sizeInBytes in HadoopFsRelation

2015-08-27 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/8490#issuecomment-135577093 [Test build #41707 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/41707/console) for PR 8490 at commit

[GitHub] spark pull request: [SPARK-10321] sizeInBytes in HadoopFsRelation

2015-08-27 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/8490#issuecomment-135577205 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your

[GitHub] spark pull request: [SPARK-10287] [SQL] Fixes JSONRelation refresh...

2015-08-27 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/8469#issuecomment-135578927 [Test build #1698 has finished](https://amplab.cs.berkeley.edu/jenkins/job/NewSparkPullRequestBuilder/1698/console) for PR 8469 at commit

[GitHub] spark pull request: [SPARK-10295] [CORE] Dynamic allocation in Mes...

2015-08-27 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/8489#issuecomment-135581458 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] spark pull request: [SPARK-10295] [CORE] Dynamic allocation in Mes...

2015-08-27 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/8489#issuecomment-135581314 [Test build #41706 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/41706/console) for PR 8489 at commit

[GitHub] spark pull request: [SPARK-10295] [CORE] Dynamic allocation in Mes...

2015-08-27 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/8489#issuecomment-135581457 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your

[GitHub] spark pull request: [SPARK-9910][ML]User guide for train validatio...

2015-08-27 Thread mengxr
Github user mengxr commented on a diff in the pull request: https://github.com/apache/spark/pull/8377#discussion_r38157963 --- Diff: docs/ml-guide.md --- @@ -868,6 +868,132 @@ jsc.stop(); /div +## Example: Model Selection via Train Validation Split +In

[GitHub] spark pull request: [SPARK-9910][ML]User guide for train validatio...

2015-08-27 Thread mengxr
Github user mengxr commented on a diff in the pull request: https://github.com/apache/spark/pull/8377#discussion_r38157914 --- Diff: docs/ml-guide.md --- @@ -868,6 +868,132 @@ jsc.stop(); /div +## Example: Model Selection via Train Validation Split +In

[GitHub] spark pull request: [SPARK-9910][ML]User guide for train validatio...

2015-08-27 Thread mengxr
Github user mengxr commented on a diff in the pull request: https://github.com/apache/spark/pull/8377#discussion_r38157909 --- Diff: docs/ml-guide.md --- @@ -868,6 +868,132 @@ jsc.stop(); /div +## Example: Model Selection via Train Validation Split +In

[GitHub] spark pull request: [SPARK-9910][ML]User guide for train validatio...

2015-08-27 Thread mengxr
Github user mengxr commented on a diff in the pull request: https://github.com/apache/spark/pull/8377#discussion_r38157958 --- Diff: docs/ml-guide.md --- @@ -868,6 +868,132 @@ jsc.stop(); /div +## Example: Model Selection via Train Validation Split +In

[GitHub] spark pull request: [SPARK-9910][ML]User guide for train validatio...

2015-08-27 Thread mengxr
Github user mengxr commented on a diff in the pull request: https://github.com/apache/spark/pull/8377#discussion_r38157902 --- Diff: docs/ml-guide.md --- @@ -868,6 +868,132 @@ jsc.stop(); /div +## Example: Model Selection via Train Validation Split +In

[GitHub] spark pull request: [SPARK-9910][ML]User guide for train validatio...

2015-08-27 Thread mengxr
Github user mengxr commented on a diff in the pull request: https://github.com/apache/spark/pull/8377#discussion_r38157917 --- Diff: docs/ml-guide.md --- @@ -868,6 +868,132 @@ jsc.stop(); /div +## Example: Model Selection via Train Validation Split +In

[GitHub] spark pull request: [SPARK-9910][ML]User guide for train validatio...

2015-08-27 Thread mengxr
Github user mengxr commented on a diff in the pull request: https://github.com/apache/spark/pull/8377#discussion_r38157912 --- Diff: docs/ml-guide.md --- @@ -868,6 +868,132 @@ jsc.stop(); /div +## Example: Model Selection via Train Validation Split +In

[GitHub] spark pull request: [SPARK-9910][ML]User guide for train validatio...

2015-08-27 Thread mengxr
Github user mengxr commented on a diff in the pull request: https://github.com/apache/spark/pull/8377#discussion_r38157890 --- Diff: docs/ml-guide.md --- @@ -868,6 +868,132 @@ jsc.stop(); /div +## Example: Model Selection via Train Validation Split +In

[GitHub] spark pull request: SPARK-9545, SPARK-9547: Use Maven in PRB if ti...

2015-08-27 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/7878#issuecomment-135584151 [Test build #41711 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/41711/consoleFull) for PR 7878 at commit

[GitHub] spark pull request: [SPARK-8952] [SPARKR] - Wrap normalizePath cal...

2015-08-27 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/8343#issuecomment-135572688 Merged build started. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not

[GitHub] spark pull request: [SPARK-8952] [SPARKR] - Wrap normalizePath cal...

2015-08-27 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/8343#issuecomment-135572665 Merged build triggered. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not

[GitHub] spark pull request: [SPARK-9680][MLlib][Doc] StopWordsRemovers use...

2015-08-27 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/8436#issuecomment-135572593 [Test build #41708 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/41708/console) for PR 8436 at commit

[GitHub] spark pull request: [SPARK-8952] [SPARKR] - Wrap normalizePath cal...

2015-08-27 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/8343#issuecomment-135573138 [Test build #41709 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/41709/consoleFull) for PR 8343 at commit

[GitHub] spark pull request: [SPARK-9906] [ML] User guide for LogisticRegre...

2015-08-27 Thread jkbradley
Github user jkbradley commented on the pull request: https://github.com/apache/spark/pull/8197#issuecomment-135574246 merging with master and branch-1.5 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project

[GitHub] spark pull request: [SPARK-9906] [ML] User guide for LogisticRegre...

2015-08-27 Thread jkbradley
Github user jkbradley commented on the pull request: https://github.com/apache/spark/pull/8197#issuecomment-135574233 I'll go ahead and merge this and ask @feynmanliang to make any needed updates when he sends a PR for the linear regression summary docs. Thanks! --- If your project

[GitHub] spark pull request: [SPARK-8952] [SPARKR] - Wrap normalizePath cal...

2015-08-27 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/8343#issuecomment-135575627 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your

[GitHub] spark pull request: [SPARK-8952] [SPARKR] - Wrap normalizePath cal...

2015-08-27 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/8343#issuecomment-135575628 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] spark pull request: [SPARK-10321] sizeInBytes in HadoopFsRelation

2015-08-27 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/8490#issuecomment-135577206 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] spark pull request: [SPARK-10287] [SQL] Fixes JSONRelation refresh...

2015-08-27 Thread yhuai
Github user yhuai commented on the pull request: https://github.com/apache/spark/pull/8469#issuecomment-135579757 I am merging it to master and branch 1.5. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project

[GitHub] spark pull request: [SPARK-9680][MLlib][Doc] StopWordsRemovers use...

2015-08-27 Thread mengxr
Github user mengxr commented on the pull request: https://github.com/apache/spark/pull/8436#issuecomment-135579744 LGTM. Merged into master and branch-1.5. Thanks! --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your

[GitHub] spark pull request: [SPARK-10065][SQL] Avoid triple copying of var...

2015-08-27 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/8484#issuecomment-135579953 Merged build started. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not

[GitHub] spark pull request: [SPARK-9680][MLlib][Doc] StopWordsRemovers use...

2015-08-27 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/spark/pull/8436 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is

[GitHub] spark pull request: [SPARK-10065][SQL] Avoid triple copying of var...

2015-08-27 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/8484#issuecomment-135579934 Merged build triggered. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not

[GitHub] spark pull request: [SPARK-10287] [SQL] Fixes JSONRelation refresh...

2015-08-27 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/spark/pull/8469 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is

[GitHub] spark pull request: SPARK-9545, SPARK-9547: Use Maven in PRB if ti...

2015-08-27 Thread pwendell
Github user pwendell commented on the pull request: https://github.com/apache/spark/pull/7878#issuecomment-135582563 Jenkins, test this please. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not

[GitHub] spark pull request: [SPARK-9910][ML]User guide for train validatio...

2015-08-27 Thread mengxr
Github user mengxr commented on a diff in the pull request: https://github.com/apache/spark/pull/8377#discussion_r38158061 --- Diff: examples/src/main/java/org/apache/spark/examples/ml/JavaTrainValidationSplitExample.java --- @@ -0,0 +1,90 @@ +/* + * Licensed to the

[GitHub] spark pull request: [SPARK-9910][ML]User guide for train validatio...

2015-08-27 Thread mengxr
Github user mengxr commented on a diff in the pull request: https://github.com/apache/spark/pull/8377#discussion_r38158069 --- Diff: examples/src/main/scala/org/apache/spark/examples/ml/TrainValidationSplitExample.scala --- @@ -0,0 +1,81 @@ +/* + * Licensed to the Apache

[GitHub] spark pull request: [SPARK-10170] [SQL] Add DB2 JDBC dialect suppo...

2015-08-27 Thread lresende
Github user lresende commented on the pull request: https://github.com/apache/spark/pull/8393#issuecomment-135583856 LGTM --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled

[GitHub] spark pull request: [SPARK-10321] sizeInBytes in HadoopFsRelation

2015-08-27 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/spark/pull/8490 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is

[GitHub] spark pull request: [SPARK-9680][MLlib][Doc] StopWordsRemovers use...

2015-08-27 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/8436#issuecomment-135572728 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your

[GitHub] spark pull request: [SPARK-9680][MLlib][Doc] StopWordsRemovers use...

2015-08-27 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/8436#issuecomment-135572729 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] spark pull request: [SPARK-9906] [ML] User guide for LogisticRegre...

2015-08-27 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/spark/pull/8197 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is

[GitHub] spark pull request: [SPARK-10188] [Pyspark] Pyspark CrossValidator...

2015-08-27 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/8399#issuecomment-135576579 [Test build #1699 has finished](https://amplab.cs.berkeley.edu/jenkins/job/NewSparkPullRequestBuilder/1699/console) for PR 8399 at commit

[GitHub] spark pull request: [SPARK-10188] [Pyspark] Pyspark CrossValidator...

2015-08-27 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/8399#issuecomment-135576535 [Test build #1699 has started](https://amplab.cs.berkeley.edu/jenkins/job/NewSparkPullRequestBuilder/1699/consoleFull) for PR 8399 at commit

[GitHub] spark pull request: [SPARK-10065][SQL] Avoid triple copying of var...

2015-08-27 Thread viirya
Github user viirya commented on a diff in the pull request: https://github.com/apache/spark/pull/8484#discussion_r38156887 --- Diff: sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/expressions/codegen/GenerateUnsafeProjection.scala --- @@ -286,21 +264,29 @@ object

[GitHub] spark pull request: SPARK-9545, SPARK-9547: Use Maven in PRB if ti...

2015-08-27 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/7878#issuecomment-135583079 Merged build started. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not

[GitHub] spark pull request: [SPARK-10065][SQL] Avoid triple copying of var...

2015-08-27 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/8484#issuecomment-135583194 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your

[GitHub] spark pull request: [SPARK-10065][SQL] Avoid triple copying of var...

2015-08-27 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/8484#issuecomment-135583198 Test FAILed. Refer to this link for build results (access rights to CI server needed):

[GitHub] spark pull request: SPARK-9545, SPARK-9547: Use Maven in PRB if ti...

2015-08-27 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/7878#issuecomment-135583016 Merged build triggered. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not

[GitHub] spark pull request: [SPARK-10321] sizeInBytes in HadoopFsRelation

2015-08-27 Thread marmbrus
Github user marmbrus commented on the pull request: https://github.com/apache/spark/pull/8490#issuecomment-135584661 LGTM, merging to 1.4, 1.5, and master. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project

[GitHub] spark pull request: [SPARK-10170] [SQL] Add DB2 JDBC dialect suppo...

2015-08-27 Thread rxin
Github user rxin commented on the pull request: https://github.com/apache/spark/pull/8393#issuecomment-135584724 BTW - are there any way we can create a lightweight docker container with some version of DB2 for testing the JDBC connectivity to DB2? (both from a licensing pov and

[GitHub] spark pull request: [SPARK-10049][SPARKR] Support collecting data ...

2015-08-27 Thread sun-rui
Github user sun-rui commented on the pull request: https://github.com/apache/spark/pull/8458#issuecomment-135601195 @davies , @shivaram , Could you help to review it? --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If

[GitHub] spark pull request: [SPARKR] [SPARK-10328] Fix generic for na.omit

2015-08-27 Thread yu-iskw
Github user yu-iskw commented on the pull request: https://github.com/apache/spark/pull/8495#issuecomment-135621454 @shivaram All right. I am checking this on my local machine. Please give me some minutes. --- If your project is set up for it, you can reply to this email and have

[GitHub] spark pull request: [SPARKR] [SPARK-10328] Fix generic for na.omit

2015-08-27 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/8495#issuecomment-135621545 Merged build triggered. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not

<    1   2   3   4   5   6   >