[GitHub] spark issue #15122: [SPARK-17569] Make StructuredStreaming FileStreamSource ...

Github user petermaxlee commented on the issue: https://github.com/apache/spark/pull/15122 I looked into this. I think there are two ways that you can intercept any calls to HDFS. The first way is slightly hacky but pretty simple. FileSystem.addFileSystemForTesting is a

[GitHub] spark issue #15133: [SPARK-17578][Docs] Add spark.app.name default value for...

Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/15133 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #15133: [SPARK-17578][Docs] Add spark.app.name default value for...

Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/15133 **[Test build #65552 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/65552/consoleFull)** for PR 15133 at commit

[GitHub] spark issue #15133: [SPARK-17578][Docs] Add spark.app.name default value for...

Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/15133 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/65552/ Test PASSed. ---

[GitHub] spark issue #14959: [SPARK-17387][PYSPARK] Creating SparkContext() from pyth...

Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/14959 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #14959: [SPARK-17387][PYSPARK] Creating SparkContext() from pyth...

Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/14959 **[Test build #65551 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/65551/consoleFull)** for PR 14959 at commit

[GitHub] spark issue #14959: [SPARK-17387][PYSPARK] Creating SparkContext() from pyth...

Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/14959 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/65551/ Test FAILed. ---

[GitHub] spark issue #15133: [SPARK-17578][Docs] Add spark.app.name default value for...

Github user phalodi commented on the issue: https://github.com/apache/spark/pull/15133 Also change this one according to that now default value of app name is (random) for session and context

[GitHub] spark issue #15133: [SPARK-17578][Docs] Add spark.app.name default value for...

Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/15133 **[Test build #65552 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/65552/consoleFull)** for PR 15133 at commit

[GitHub] spark pull request #15090: [SPARK-17073] [SQL] generate column-level statist...

Github user wzhfy commented on a diff in the pull request: https://github.com/apache/spark/pull/15090#discussion_r79297872 --- Diff: sql/core/src/main/scala/org/apache/spark/sql/execution/SparkSqlParser.scala --- @@ -98,8 +98,12 @@ class SparkSqlAstBuilder(conf: SQLConf) extends

[GitHub] spark issue #14959: [SPARK-17387][PYSPARK] Creating SparkContext() from pyth...

Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/14959 **[Test build #65551 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/65551/consoleFull)** for PR 14959 at commit

[GitHub] spark issue #14959: [SPARK-17387][PYSPARK] Creating SparkContext() from pyth...

Github user zjffdu commented on the issue: https://github.com/apache/spark/pull/14959 @vanzin Thanks for your reviews. I just update the PR, but don't get your following statement mean. Can you explain it ? Thanks ``` Especially since the Scala SparkContext clones the original

[GitHub] spark issue #15134: [SPARK-17580][CORE]Add random UUID as app name while app...

Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/15134 **[Test build #65550 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/65550/consoleFull)** for PR 15134 at commit

[GitHub] spark issue #15133: [SPARK-17578][Docs] Add spark.app.name default value for...

Github user phalodi commented on the issue: https://github.com/apache/spark/pull/15133 @andrewor14 what is think about this https://github.com/apache/spark/pull/15134 we add random UUID of app name while creating spark context if its not define. --- If your project is set up for

[GitHub] spark pull request #15134: [SPARK-17580][CORE]Add random UUID as app name wh...

GitHub user phalodi opened a pull request: https://github.com/apache/spark/pull/15134 [SPARK-17580][CORE]Add random UUID as app name while app name not define while creating … ## What changes were proposed in this pull request? Assign Random UUID as a app name while app

[GitHub] spark issue #14971: [SPARK-17410] [SPARK-17284] Move Hive-generated Stats In...

Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/14971 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #15122: [SPARK-17569] Make StructuredStreaming FileStreamSource ...

Github user petermaxlee commented on the issue: https://github.com/apache/spark/pull/15122 Can you test this by deleting the file on purpose, and see what kind of exceptions are thrown? --- If your project is set up for it, you can reply to this email and have your reply appear on

[GitHub] spark issue #14971: [SPARK-17410] [SPARK-17284] Move Hive-generated Stats In...

Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/14971 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/65548/ Test FAILed. ---

[GitHub] spark issue #14971: [SPARK-17410] [SPARK-17284] Move Hive-generated Stats In...

Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/14971 **[Test build #65548 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/65548/consoleFull)** for PR 14971 at commit

[GitHub] spark issue #15127: [SPARK-17571][SQL] AssertOnQuery.condition should always...

Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/15127 **[Test build #65549 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/65549/consoleFull)** for PR 15127 at commit

[GitHub] spark issue #15129: [SPARK-17546] [DEPLOY] start-* scripts should use hostna...

Github user rxin commented on the issue: https://github.com/apache/spark/pull/15129 LGTM. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the

[GitHub] spark pull request #15051: [SPARK-17499][SparkR][ML][MLLib] make the default...

Github user WeichenXu123 commented on a diff in the pull request: https://github.com/apache/spark/pull/15051#discussion_r79297392 --- Diff: R/pkg/R/mllib.R --- @@ -694,8 +694,14 @@ setMethod("predict", signature(object = "KMeansModel"), #' } #' @note spark.mlp since 2.1.0

[GitHub] spark pull request #15051: [SPARK-17499][SparkR][ML][MLLib] make the default...

Github user shivaram commented on a diff in the pull request: https://github.com/apache/spark/pull/15051#discussion_r79297229 --- Diff: R/pkg/R/mllib.R --- @@ -694,8 +694,14 @@ setMethod("predict", signature(object = "KMeansModel"), #' } #' @note spark.mlp since 2.1.0

[GitHub] spark issue #15131: [SPARK-17577][SparkR] SparkR support add files to Spark ...

Github user HyukjinKwon commented on the issue: https://github.com/apache/spark/pull/15131 @shivaram Thanks for cc'ing me. I will try to look closely within today. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your

[GitHub] spark issue #13513: [SPARK-15698][SQL][Streaming] Add the ability to remove ...

Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/13513 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #13513: [SPARK-15698][SQL][Streaming] Add the ability to remove ...

Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/13513 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/65547/ Test PASSed. ---

[GitHub] spark issue #13513: [SPARK-15698][SQL][Streaming] Add the ability to remove ...

Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/13513 **[Test build #65547 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/65547/consoleFull)** for PR 13513 at commit

[GitHub] spark issue #14600: [SPARK-15899] [SQL] Fix the construction of the file pat...

Github user Praveenmail2him commented on the issue: https://github.com/apache/spark/pull/14600 Can anyone post the sample usage for this exception in Spark 2.0, I'm still facing this exception? --- If your project is set up for it, you can reply to this email and have your reply

[GitHub] spark pull request #15090: [SPARK-17073] [SQL] generate column-level statist...

Github user wzhfy commented on a diff in the pull request: https://github.com/apache/spark/pull/15090#discussion_r79296707 --- Diff: sql/core/src/main/scala/org/apache/spark/sql/execution/command/AnalyzeColumnCommand.scala --- @@ -0,0 +1,159 @@ +/* + * Licensed to the

[GitHub] spark issue #14971: [SPARK-17410] [SPARK-17284] Move Hive-generated Stats In...

Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/14971 **[Test build #65548 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/65548/consoleFull)** for PR 14971 at commit

[GitHub] spark pull request #15090: [SPARK-17073] [SQL] generate column-level statist...

Github user wzhfy commented on a diff in the pull request: https://github.com/apache/spark/pull/15090#discussion_r7929 --- Diff: sql/core/src/test/scala/org/apache/spark/sql/StatisticsSuite.scala --- @@ -101,4 +101,47 @@ class StatisticsSuite extends QueryTest with

[GitHub] spark pull request #15090: [SPARK-17073] [SQL] generate column-level statist...

Github user wzhfy commented on a diff in the pull request: https://github.com/apache/spark/pull/15090#discussion_r79296668 --- Diff: sql/core/src/main/scala/org/apache/spark/sql/internal/SQLConf.scala --- @@ -563,6 +563,13 @@ object SQLConf {

[GitHub] spark pull request #15090: [SPARK-17073] [SQL] generate column-level statist...

Github user wzhfy commented on a diff in the pull request: https://github.com/apache/spark/pull/15090#discussion_r79296634 --- Diff: sql/core/src/main/scala/org/apache/spark/sql/execution/SparkSqlParser.scala --- @@ -87,19 +87,23 @@ class SparkSqlAstBuilder(conf: SQLConf) extends

[GitHub] spark pull request #15090: [SPARK-17073] [SQL] generate column-level statist...

Github user wzhfy commented on a diff in the pull request: https://github.com/apache/spark/pull/15090#discussion_r79296629 --- Diff: sql/hive/src/test/scala/org/apache/spark/sql/hive/StatisticsColumnSuite.scala --- @@ -0,0 +1,228 @@ +/* + * Licensed to the Apache Software

[GitHub] spark issue #15051: [SPARK-17499][SparkR][ML][MLLib] make the default params...

Github user WeichenXu123 commented on the issue: https://github.com/apache/spark/pull/15051 @felixcheung yeah, in fact 0x7FFF is not ideal because itself also a valid seed. and there is another problem, in scala, seed is `long` type, but in R side, it seems there is no

[GitHub] spark pull request #15051: [SPARK-17499][SparkR][ML][MLLib] make the default...

Github user WeichenXu123 commented on a diff in the pull request: https://github.com/apache/spark/pull/15051#discussion_r79295910 --- Diff: R/pkg/R/mllib.R --- @@ -694,8 +694,14 @@ setMethod("predict", signature(object = "KMeansModel"), #' } #' @note spark.mlp since 2.1.0

[GitHub] spark issue #13513: [SPARK-15698][SQL][Streaming] Add the ability to remove ...

Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/13513 **[Test build #65547 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/65547/consoleFull)** for PR 13513 at commit

[GitHub] spark issue #14971: [SPARK-17410] [SPARK-17284] Move Hive-generated Stats In...

Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/14971 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #14971: [SPARK-17410] [SPARK-17284] Move Hive-generated Stats In...

Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/14971 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/65546/ Test FAILed. ---

[GitHub] spark issue #14971: [SPARK-17410] [SPARK-17284] Move Hive-generated Stats In...

Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/14971 **[Test build #65546 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/65546/consoleFull)** for PR 14971 at commit

[GitHub] spark issue #14643: [SPARK-17057][ML] ProbabilisticClassifierModels' predict...

Github user zhengruifeng commented on the issue: https://github.com/apache/spark/pull/14643 @srowen You can take it over. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled

[GitHub] spark issue #14971: [SPARK-17410] [SPARK-17284] Move Hive-generated Stats In...

Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/14971 **[Test build #65546 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/65546/consoleFull)** for PR 14971 at commit

[GitHub] spark issue #15051: [SPARK-17499][SparkR][ML][MLLib] make the default params...

Github user felixcheung commented on the issue: https://github.com/apache/spark/pull/15051 LGTM - just a question above and this: would 0x7FFF be a good placeholder value - is it possible to set seed to this in Scala? --- If your project is set up for it, you can reply to this

[GitHub] spark pull request #15051: [SPARK-17499][SparkR][ML][MLLib] make the default...

Github user felixcheung commented on a diff in the pull request: https://github.com/apache/spark/pull/15051#discussion_r79294205 --- Diff: R/pkg/R/mllib.R --- @@ -694,8 +694,14 @@ setMethod("predict", signature(object = "KMeansModel"), #' } #' @note spark.mlp since 2.1.0

[GitHub] spark pull request #14338: [SPARK-16701] Make parameters configurable in Blo...

Github user lovexi closed the pull request at: https://github.com/apache/spark/pull/14338 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is

[GitHub] spark issue #15093: [SPARK-17480][SQL][FOLLOWUP] Fix more instances which ca...

Github user srowen commented on the issue: https://github.com/apache/spark/pull/15093 Yep, saw that. I re-merged this, and yes during conflict resolution QuantileSummaries.scala comes up as a file added only in the master branch, but when I choose to not take the change in the IDE, I

[GitHub] spark issue #15093: [SPARK-17480][SQL][FOLLOWUP] Fix more instances which ca...

Github user tdas commented on the issue: https://github.com/apache/spark/pull/15093 I reverted already! --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so,

[GitHub] spark issue #15093: [SPARK-17480][SQL][FOLLOWUP] Fix more instances which ca...

Github user srowen commented on the issue: https://github.com/apache/spark/pull/15093 Oh weird! no idea why that happened. Yeah I'll take care of it from here. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your

[GitHub] spark issue #15093: [SPARK-17480][SQL][FOLLOWUP] Fix more instances which ca...

Github user tdas commented on the issue: https://github.com/apache/spark/pull/15093 @HyukjinKwon @srowen This PR when merged into branch-2.0 somehow created an empty file QuantileSummaries.scala that is failing the lint test as the Apache license header does not exist -

[GitHub] spark issue #15131: [SPARK-17577][SparkR] SparkR support add files to Spark ...

Github user shivaram commented on the issue: https://github.com/apache/spark/pull/15131 It looks like `addFile` isn't working on Windows because we try to convert the windows file path into a URI and that fails. Not sure what the fix is in this case. cc @HyukjinKwon who

[GitHub] spark issue #15133: [SPARK-17578][Docs] Add spark.app.name default value for...

Github user andrewor14 commented on the issue: https://github.com/apache/spark/pull/15133 Yeah `SparkSession` will be the new thing moving forward. `SparkContext` is kind of just a legacy thing. --- If your project is set up for it, you can reply to this email and have your reply

[GitHub] spark issue #15133: [SPARK-17578][Docs] Add spark.app.name default value for...

Github user phalodi commented on the issue: https://github.com/apache/spark/pull/15133 @andrewor14 So as you suggest we also change it in spark context code because right now we must set app name while creating spark context. So when we add random UUID generate for default value of

[GitHub] spark issue #15133: [SPARK-17578][Docs] Add spark.app.name default value for...

Github user andrewor14 commented on the issue: https://github.com/apache/spark/pull/15133 We should probably just make it a random UUID in all cases to be consistent. I don't know if people check whether `spark.app.name` is set, so that might be a backward compatibility concern

[GitHub] spark issue #15132: [SPARK-17510][STREAMING][KAFKA] config max rate on a per...

Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/15132 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #15132: [SPARK-17510][STREAMING][KAFKA] config max rate on a per...

Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/15132 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/65544/ Test PASSed. ---

[GitHub] spark issue #15132: [SPARK-17510][STREAMING][KAFKA] config max rate on a per...

Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/15132 **[Test build #65544 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/65544/consoleFull)** for PR 15132 at commit

[GitHub] spark pull request #15043: [SPARK-17491] Close serialization stream to fix w...

Github user asfgit closed the pull request at: https://github.com/apache/spark/pull/15043 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is

[GitHub] spark issue #15043: [SPARK-17491] Close serialization stream to fix wrong an...

Github user JoshRosen commented on the issue: https://github.com/apache/spark/pull/15043 I believe that this latest test failure is caused by a known flaky PySpark test, so I'm going to merge this now and will monitor tests afterwards. --- If your project is set up for it, you can

[GitHub] spark issue #15131: [SPARK-17577][SparkR] SparkR support add files to Spark ...

Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/15131 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #15131: [SPARK-17577][SparkR] SparkR support add files to Spark ...

Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/15131 **[Test build #65539 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/65539/consoleFull)** for PR 15131 at commit

[GitHub] spark issue #15131: [SPARK-17577][SparkR] SparkR support add files to Spark ...

Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/15131 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/65539/ Test FAILed. ---

[GitHub] spark issue #15133: [SPARK-17578][Docs] Add spark.app.name default value for...

Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/15133 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/65545/ Test PASSed. ---

[GitHub] spark issue #15133: [SPARK-17578][Docs] Add spark.app.name default value for...

Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/15133 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #15133: [SPARK-17578][Docs] Add spark.app.name default value for...

Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/15133 **[Test build #65545 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/65545/consoleFull)** for PR 15133 at commit

[GitHub] spark issue #15043: [SPARK-17491] Close serialization stream to fix wrong an...

Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/15043 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #15043: [SPARK-17491] Close serialization stream to fix wrong an...

Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/15043 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/65541/ Test FAILed. ---

[GitHub] spark issue #15043: [SPARK-17491] Close serialization stream to fix wrong an...

Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/15043 **[Test build #65541 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/65541/consoleFull)** for PR 15043 at commit

[GitHub] spark issue #15133: [SPARK-17578][Docs] Add spark.app.name default value for...

Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/15133 **[Test build #65545 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/65545/consoleFull)** for PR 15133 at commit

[GitHub] spark pull request #15133: [SPARK-17578][Docs] Add spark.app.name default va...

GitHub user phalodi opened a pull request: https://github.com/apache/spark/pull/15133 [SPARK-17578][Docs] Add spark.app.name default value for spark session ## What changes were proposed in this pull request? Modify spark.app.name configuration for spark session ##

[GitHub] spark issue #15073: [SPARK-17518] [SQL] Block Users to Specify the Internal ...

Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/15073 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/65538/ Test PASSed. ---

[GitHub] spark issue #15073: [SPARK-17518] [SQL] Block Users to Specify the Internal ...

Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/15073 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #15073: [SPARK-17518] [SQL] Block Users to Specify the Internal ...

Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/15073 **[Test build #65538 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/65538/consoleFull)** for PR 15073 at commit

[GitHub] spark issue #15051: [SPARK-17499][SparkR][ML][MLLib] make the default params...

Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/15051 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/65542/ Test PASSed. ---

[GitHub] spark issue #15051: [SPARK-17499][SparkR][ML][MLLib] make the default params...

Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/15051 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #15051: [SPARK-17499][SparkR][ML][MLLib] make the default params...

Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/15051 **[Test build #65542 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/65542/consoleFull)** for PR 15051 at commit

[GitHub] spark issue #15093: [SPARK-17480][SQL][FOLLOWUP] Fix more instances which ca...

Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/15093 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/65536/ Test PASSed. ---

[GitHub] spark issue #15093: [SPARK-17480][SQL][FOLLOWUP] Fix more instances which ca...

Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/15093 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #15093: [SPARK-17480][SQL][FOLLOWUP] Fix more instances which ca...

Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/15093 **[Test build #65536 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/65536/consoleFull)** for PR 15093 at commit

[GitHub] spark issue #14981: [SPARK-17418] Remove Kinesis artifacts from Spark releas...

Github user srowen commented on the issue: https://github.com/apache/spark/pull/14981 I am referring to http://mail-archives.apache.org/mod_mbox/www-legal-discuss/201609.mbox/ I don't think it is up to us

[GitHub] spark issue #14981: [SPARK-17418] Remove Kinesis artifacts from Spark releas...

Github user lresende commented on the issue: https://github.com/apache/spark/pull/14981 The pointer is exactly your quote on the e-mail to legal-discuss: http://www.apache.org/legal/resolved.html#prohibited says: - CAN APACHE PROJECTS RELY ON COMPONENTS UNDER

[GitHub] spark issue #15132: [SPARK-17510][STREAMING][KAFKA] config max rate on a per...

Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/15132 **[Test build #65544 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/65544/consoleFull)** for PR 15132 at commit

[GitHub] spark issue #15097: [SPARK-17540][SparkR][Spark Core] fix SparkR array serde...

Github user felixcheung commented on the issue: https://github.com/apache/spark/pull/15097 Please add tests for this? --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and

[GitHub] spark issue #15132: [SPARK-17510][STREAMING][KAFKA] config max rate on a per...

Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/15132 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #15132: [SPARK-17510][STREAMING][KAFKA] config max rate on a per...

Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/15132 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/65543/ Test FAILed. ---

[GitHub] spark issue #15132: [SPARK-17510][STREAMING][KAFKA] config max rate on a per...

Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/15132 **[Test build #65543 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/65543/consoleFull)** for PR 15132 at commit

[GitHub] spark issue #15132: [SPARK-17510][STREAMING][KAFKA] config max rate on a per...

Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/15132 **[Test build #65543 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/65543/consoleFull)** for PR 15132 at commit

[GitHub] spark issue #14981: [SPARK-17418] Remove Kinesis artifacts from Spark releas...

Github user srowen commented on the issue: https://github.com/apache/spark/pull/14981 That isn't the conclusion I took from the discussion on legal-discuss - do you have a pointer? I took that it was at best ambiguous but not obviously prohibited to distribute these because they are

[GitHub] spark pull request #15132: [SPARK-17510][STREAMING][KAFKA] config max rate o...

GitHub user koeninger opened a pull request: https://github.com/apache/spark/pull/15132 [SPARK-17510][STREAMING][KAFKA] config max rate on a per-partition basis ## What changes were proposed in this pull request? Allow configuration of max rate on a per-topicpartition

[GitHub] spark issue #14981: [SPARK-17418] Remove Kinesis artifacts from Spark releas...

Github user lresende commented on the issue: https://github.com/apache/spark/pull/14981 Yes, and this is the intent. It's ok to have these in the source release (similar to ganglia) but we don't publish them in maven repository and it becomes available only if people goes and

[GitHub] spark issue #15051: [SPARK-17499][SparkR][ML][MLLib] make the default params...

Github user WeichenXu123 commented on the issue: https://github.com/apache/spark/pull/15051 @felixcheung Now I add some test using default parameter and compare the output prediction with the result generated using scala-side code. thanks! --- If your project is set up for it,

[GitHub] spark issue #15051: [SPARK-17499][SparkR][ML][MLLib] make the default params...

Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/15051 **[Test build #65542 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/65542/consoleFull)** for PR 15051 at commit

[GitHub] spark issue #15131: [SPARK-17577][SparkR] SparkR support add files to Spark ...

Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/15131 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #15131: [SPARK-17577][SparkR] SparkR support add files to Spark ...

Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/15131 **[Test build #65540 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/65540/consoleFull)** for PR 15131 at commit

[GitHub] spark issue #15131: [SPARK-17577][SparkR] SparkR support add files to Spark ...

Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/15131 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/65540/ Test FAILed. ---

[GitHub] spark issue #15043: [SPARK-17491] Close serialization stream to fix wrong an...

Github user JoshRosen commented on the issue: https://github.com/apache/spark/pull/15043 I agree that we should add more off-heap tests, but I'd like to do it in another patch so that we can get this one merged faster to unblock the 2.0.1 RC. In terms of testing off-heap, I

[GitHub] spark issue #14981: [SPARK-17418] Remove Kinesis artifacts from Spark releas...

Github user srowen commented on the issue: https://github.com/apache/spark/pull/14981 The issue is that this also removes the non assembly artifact from the release. That does not seem to be strictly needed license wise. It is easy and tidy though. --- If your project is set up

[GitHub] spark issue #15043: [SPARK-17491] Close serialization stream to fix wrong an...

Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/15043 **[Test build #65541 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/65541/consoleFull)** for PR 15043 at commit

[GitHub] spark issue #14981: [SPARK-17418] Remove Kinesis artifacts from Spark releas...

Github user lresende commented on the issue: https://github.com/apache/spark/pull/14981 @srowen @rxin My understanding is that the mvn deploy is what takes care of actually publishing the files to maven staging repository : ` $MVN -DzincPort=$ZINC_PORT --settings

[GitHub] spark issue #15043: [SPARK-17491] Close serialization stream to fix wrong an...

Github user JoshRosen commented on the issue: https://github.com/apache/spark/pull/15043 Jenkins, retest this please. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and

[GitHub] spark issue #13324: [SPARK-15559][PYTHON][STREAMING] Add hash method for Top...

Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/13324 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/65537/ Test PASSed. ---

  1   2   3   >