[GitHub] spark issue #17737: [SPARK-20442][PYTHON][DOCS] Fill up documentations for f...

2017-04-24 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/17737 **[Test build #76093 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/76093/testReport)** for PR 17737 at commit

[GitHub] spark issue #17737: [SPARK-20442][PYTHON][DOCS] Fill up documentations for f...

2017-04-24 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/17737 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #17737: [SPARK-20442][PYTHON][DOCS] Fill up documentations for f...

2017-04-24 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/17737 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/76093/ Test PASSed. ---

[GitHub] spark issue #17736: [SPARK-20399][SQL][WIP] Can't use same regex pattern bet...

2017-04-24 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/17736 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/76094/ Test PASSed. ---

[GitHub] spark pull request #17739: [SPARK-20443][MLLIB][ML] set ALS blockify size

2017-04-24 Thread mpjlu
GitHub user mpjlu opened a pull request: https://github.com/apache/spark/pull/17739 [SPARK-20443][MLLIB][ML] set ALS blockify size ## What changes were proposed in this pull request? The blockSize of MLLIB ALS is very important for ALS performance. In our test,

[GitHub] spark issue #17736: [SPARK-20399][SQL][WIP] Can't use same regex pattern bet...

2017-04-24 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/17736 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #17222: [SPARK-19439][PYSPARK][SQL] PySpark's registerJavaFuncti...

2017-04-24 Thread holdenk
Github user holdenk commented on the issue: https://github.com/apache/spark/pull/17222 @zjffdu - how would you feel about putting the return back, and just plumbing it through as required? It seems like it would be useful to have users able to programmatically do this (I find my self

[GitHub] spark issue #17739: [SPARK-20443][MLLIB][ML] set ALS blockify size

2017-04-24 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/17739 **[Test build #76096 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/76096/testReport)** for PR 17739 at commit

[GitHub] spark issue #17737: [SPARK-20442][PYTHON][DOCS] Fill up documentations for f...

2017-04-24 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/17737 **[Test build #76092 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/76092/testReport)** for PR 17737 at commit

[GitHub] spark issue #17737: [SPARK-20442][PYTHON][DOCS] Fill up documentations for f...

2017-04-24 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/17737 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/76092/ Test PASSed. ---

[GitHub] spark issue #17737: [SPARK-20442][PYTHON][DOCS] Fill up documentations for f...

2017-04-24 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/17737 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #17736: [SPARK-20399][SQL][WIP] Can't use same regex pattern bet...

2017-04-24 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/17736 **[Test build #76094 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/76094/testReport)** for PR 17736 at commit

[GitHub] spark issue #17736: [SPARK-20399][SQL] Can't use same regex pattern between ...

2017-04-24 Thread rxin
Github user rxin commented on the issue: https://github.com/apache/spark/pull/17736 cc @hvanhovell for review ... --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and

[GitHub] spark issue #17737: [SPARK-20442][PYTHON][DOCS] Fill up documentations for f...

2017-04-24 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/17737 **[Test build #76095 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/76095/testReport)** for PR 17737 at commit

[GitHub] spark issue #17737: [SPARK-20442][PYTHON][DOCS] Fill up documentations for f...

2017-04-24 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/17737 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/76095/ Test PASSed. ---

[GitHub] spark issue #17737: [SPARK-20442][PYTHON][DOCS] Fill up documentations for f...

2017-04-24 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/17737 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #17732: Branch 2.0

2017-04-24 Thread HyukjinKwon
Github user HyukjinKwon commented on the issue: https://github.com/apache/spark/pull/17732 ping @tangchun --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so,

[GitHub] spark issue #17739: [SPARK-20443][MLLIB][ML] set ALS blockify size

2017-04-24 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/17739 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/76096/ Test FAILed. ---

[GitHub] spark issue #17739: [SPARK-20443][MLLIB][ML] set ALS blockify size

2017-04-24 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/17739 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #17503: [SPARK-3159][MLlib] Check for reducible DecisionTree

2017-04-24 Thread facaiy
Github user facaiy commented on the issue: https://github.com/apache/spark/pull/17503 @srowen Hi, could you review the PR? The PR is simple, though many code for unit test are added. Thanks. --- If your project is set up for it, you can reply to this email and have your reply appear

[GitHub] spark pull request #17730: [SPARK-20439] [SQL] Fix Catalog API listTables an...

2017-04-24 Thread gatorsmile
Github user gatorsmile commented on a diff in the pull request: https://github.com/apache/spark/pull/17730#discussion_r112879694 --- Diff: sql/core/src/main/scala/org/apache/spark/sql/internal/CatalogImpl.scala --- @@ -197,7 +211,11 @@ class CatalogImpl(sparkSession: SparkSession)

[GitHub] spark pull request #17700: [SPARK-20391][Core] Rename memory related fields ...

2017-04-24 Thread jerryshao
Github user jerryshao commented on a diff in the pull request: https://github.com/apache/spark/pull/17700#discussion_r112879836 --- Diff: core/src/main/scala/org/apache/spark/ui/exec/ExecutorsPage.scala --- @@ -114,10 +114,16 @@ private[spark] object ExecutorsPage { val

[GitHub] spark pull request #17730: [SPARK-20439] [SQL] Fix Catalog API listTables an...

2017-04-24 Thread gatorsmile
Github user gatorsmile commented on a diff in the pull request: https://github.com/apache/spark/pull/17730#discussion_r112880305 --- Diff: sql/core/src/main/scala/org/apache/spark/sql/internal/CatalogImpl.scala --- @@ -197,7 +211,11 @@ class CatalogImpl(sparkSession: SparkSession)

[GitHub] spark issue #17540: [SPARK-20213][SQL][UI] Fix DataFrameWriter operations in...

2017-04-24 Thread rdblue
Github user rdblue commented on the issue: https://github.com/apache/spark/pull/17540 @cloud-fan, the one from this PR is the correct plan to show. There are two problems affecting this query. First, the call to `withNewExecutionId` should be done where the execution is started, in

[GitHub] spark issue #17742: [Spark-20446][ML][MLLIB]Optimize MLLIB ALS recommendForA...

2017-04-24 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/17742 **[Test build #76111 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/76111/testReport)** for PR 17742 at commit

[GitHub] spark issue #17742: [Spark-20446][ML][MLLIB]Optimize MLLIB ALS recommendForA...

2017-04-24 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/17742 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/76111/ Test PASSed. ---

[GitHub] spark pull request #17737: [SPARK-20442][PYTHON][DOCS] Fill up documentation...

2017-04-24 Thread map222
Github user map222 commented on a diff in the pull request: https://github.com/apache/spark/pull/17737#discussion_r113001678 --- Diff: sql/core/src/main/scala/org/apache/spark/sql/Column.scala --- @@ -1008,7 +1009,7 @@ class Column(val expr: Expression) extends Logging { def

[GitHub] spark issue #17746: [SPARK-20449][ML] Upgrade breeze version to 0.13.1

2017-04-24 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/17746 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/76110/ Test PASSed. ---

[GitHub] spark issue #17725: [SPARK-20435][CORE] More thorough redaction of sensitive...

2017-04-24 Thread markgrover
Github user markgrover commented on the issue: https://github.com/apache/spark/pull/17725 Jenkins, retest this please. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled

[GitHub] spark issue #14731: [SPARK-17159] [streaming]: optimise check for new files ...

2017-04-24 Thread steveloughran
Github user steveloughran commented on the issue: https://github.com/apache/spark/pull/14731 Reynold, I know very much about the time of reviewers, I put 1+h a day on the hadoop codebase reviewing stuff, generally trying to review the work of non-colleagues, so as to pull in the

[GitHub] spark issue #17746: [SPARK-20449][ML] Upgrade breeze version to 0.13.1

2017-04-24 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/17746 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #17746: [SPARK-20449][ML] Upgrade breeze version to 0.13.1

2017-04-24 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/17746 **[Test build #76110 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/76110/testReport)** for PR 17746 at commit

[GitHub] spark issue #17731: [SPARK-20440][SparkR] Allow SparkR session and context t...

2017-04-24 Thread felixcheung
Github user felixcheung commented on the issue: https://github.com/apache/spark/pull/17731 great - if you have a workaround our preference would be not to change Spark for it. `.sparkREnv` and variables are not public API that we support --- If your project is set up for it, you

[GitHub] spark pull request #17686: [SPARK-20393][Webu UI] Strengthen Spark to preven...

2017-04-24 Thread n-marion
Github user n-marion commented on a diff in the pull request: https://github.com/apache/spark/pull/17686#discussion_r113017090 --- Diff: core/src/main/scala/org/apache/spark/ui/jobs/AllJobsPage.scala --- @@ -220,18 +220,20 @@ private[ui] class AllJobsPage(parent: JobsTab) extends

[GitHub] spark pull request #17686: [SPARK-20393][Webu UI] Strengthen Spark to preven...

2017-04-24 Thread n-marion
Github user n-marion commented on a diff in the pull request: https://github.com/apache/spark/pull/17686#discussion_r113017158 --- Diff: core/src/main/scala/org/apache/spark/ui/UIUtils.scala --- @@ -527,4 +528,25 @@ private[spark] object UIUtils extends Logging {

[GitHub] spark issue #17478: [SPARK-18901][ML]:Require in LR LogisticAggregator is re...

2017-04-24 Thread yanboliang
Github user yanboliang commented on the issue: https://github.com/apache/spark/pull/17478 Merged into master and branch-2.2. Thanks for all. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have

[GitHub] spark pull request #13027: [SPARK-4452][SPARK-11293][Core][BRANCH-1.6] Shuff...

2017-04-24 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/spark/pull/13027 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is

[GitHub] spark pull request #15197: [SPARK-17631] [SQL] Add HttpStreamSink for struct...

2017-04-24 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/spark/pull/15197 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is

[GitHub] spark pull request #17040: CatalogTableType constructor access modifier rend...

2017-04-24 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/spark/pull/17040 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is

[GitHub] spark pull request #17418: [SPARK-19674][SQL] Ignore driver accumulator upda...

2017-04-24 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/spark/pull/17418 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is

[GitHub] spark pull request #17478: [SPARK-18901][ML]:Require in LR LogisticAggregato...

2017-04-24 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/spark/pull/17478 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is

[GitHub] spark pull request #16146: [SPARK-18091] [SQL] [BACKPORT-1.6] Deep if expres...

2017-04-24 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/spark/pull/16146 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is

[GitHub] spark pull request #15180: FIX: AggregatedDialect does not quote identifier ...

2017-04-24 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/spark/pull/15180 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is

[GitHub] spark pull request #17625: [SPARK-9103][WIP] Add Memory Tracking UI and trac...

2017-04-24 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/spark/pull/17625 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is

[GitHub] spark pull request #17269: SPARK-19927: Support the --hivevar in the spark-s...

2017-04-24 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/spark/pull/17269 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is

[GitHub] spark pull request #12576: [SPARK-14804][Spark][Graphx] Fix Graph vertexRDD/...

2017-04-24 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/spark/pull/12576 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is

[GitHub] spark pull request #17313: [SPARK-19974][Block Manager] in-memory LRU for pa...

2017-04-24 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/spark/pull/17313 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is

[GitHub] spark pull request #17238: getRackForHost returns None if host is unknown by...

2017-04-24 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/spark/pull/17238 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is

[GitHub] spark pull request #15344: Added the PrefixSpan MLlib example based on the c...

2017-04-24 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/spark/pull/15344 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is

[GitHub] spark pull request #13761: [SPARK-12197] [SparkCore] Kryo & Avro - Support S...

2017-04-24 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/spark/pull/13761 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is

[GitHub] spark pull request #15616: [SPARK-16827][Shuffle] add disk spill bytes to Un...

2017-04-24 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/spark/pull/15616 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is

[GitHub] spark pull request #17747: [SPARK-11373] [CORE] Add metrics to the FsHistory...

2017-04-24 Thread steveloughran
GitHub user steveloughran opened a pull request: https://github.com/apache/spark/pull/17747 [SPARK-11373] [CORE] Add metrics to the FsHistoryProvider ## What changes were proposed in this pull request? This adds metrics to the history server, with the `FsHistoryProvider`

[GitHub] spark issue #17648: [SPARK-19851] Add support for EVERY and ANY (SOME) aggre...

2017-04-24 Thread rxin
Github user rxin commented on the issue: https://github.com/apache/spark/pull/17648 sgtm --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature

[GitHub] spark issue #17742: [Spark-20446][ML][MLLIB]Optimize MLLIB ALS recommendForA...

2017-04-24 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/17742 **[Test build #76111 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/76111/testReport)** for PR 17742 at commit

[GitHub] spark issue #17478: [SPARK-18901][ML]:Require in LR LogisticAggregator is re...

2017-04-24 Thread yanboliang
Github user yanboliang commented on the issue: https://github.com/apache/spark/pull/17478 @wangmiao1981 Would you mind to send a follow-up PR to address the same issue for ```LinearRegression``` and ```LinearSVC```? Thanks. --- If your project is set up for it, you can reply to this

[GitHub] spark pull request #17485: [SPARK-20163] Kill all running tasks in a stage i...

2017-04-24 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/spark/pull/17485 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is

[GitHub] spark pull request #10739: Changes to support KMeans with large feature spac...

2017-04-24 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/spark/pull/10739 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is

[GitHub] spark pull request #14006: [SPARK-13015][MLlib][DOC] Replace example code in...

2017-04-24 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/spark/pull/14006 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is

[GitHub] spark pull request #13614: [SPARK-15980] [SQL] Support Stata-like tabulation...

2017-04-24 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/spark/pull/13614 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is

[GitHub] spark pull request #15193: [SQL]RowBasedKeyValueBatch reuse valueRow too

2017-04-24 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/spark/pull/15193 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is

[GitHub] spark pull request #17551: [SPARK-20242][Web UI] Add spark.ui.stopDelay

2017-04-24 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/spark/pull/17551 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is

[GitHub] spark pull request #16993: Dynamic Batch Interval Adjustment

2017-04-24 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/spark/pull/16993 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is

[GitHub] spark pull request #17730: [SPARK-20439] [SQL] Fix Catalog API listTables an...

2017-04-24 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/spark/pull/17730 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is

[GitHub] spark pull request #15447: [SPARK-14804][Graphx] Graph vertexRDD/EdgeRDD che...

2017-04-24 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/spark/pull/15447 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is

[GitHub] spark pull request #16638: [SPARK-19115] [SQL] Supporting Create External Ta...

2017-04-24 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/spark/pull/16638 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is

[GitHub] spark pull request #14473: [SPARK-16495] [MLlib]Add ADMM optimizer in mllib ...

2017-04-24 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/spark/pull/14473 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is

[GitHub] spark pull request #17734: [BUILD] Close stale PRs

2017-04-24 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/spark/pull/17734 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is

[GitHub] spark pull request #14804: [MINOR][Web UI] Correctly convert bytes in web UI

2017-04-24 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/spark/pull/14804 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is

[GitHub] spark pull request #13259: [SPARK-15480][UI][Streaming]show missed InputInfo...

2017-04-24 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/spark/pull/13259 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is

[GitHub] spark pull request #11785: [SPARK-11319][SQL] Making StructField's nullable ...

2017-04-24 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/spark/pull/11785 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is

[GitHub] spark pull request #17746: [SPARK-20449][ML] Upgrade breeze version to 0.13....

2017-04-24 Thread dbtsai
Github user dbtsai commented on a diff in the pull request: https://github.com/apache/spark/pull/17746#discussion_r112999875 --- Diff: R/pkg/inst/tests/testthat/test_mllib_classification.R --- @@ -288,18 +288,18 @@ test_that("spark.mlp", { c(0, 0, 0, 0, 0, 5, 5, 5, 5, 5,

[GitHub] spark pull request #17737: [SPARK-20442][PYTHON][DOCS] Fill up documentation...

2017-04-24 Thread map222
Github user map222 commented on a diff in the pull request: https://github.com/apache/spark/pull/17737#discussion_r113001853 --- Diff: python/pyspark/sql/column.py --- @@ -288,8 +324,16 @@ def __iter__(self): >>> df.filter(df.name.endswith('ice$')).collect() []

[GitHub] spark issue #17739: [SPARK-20443][MLLIB][ML] set ALS blockify size

2017-04-24 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/17739 **[Test build #76108 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/76108/testReport)** for PR 17739 at commit

[GitHub] spark issue #17748: [SPARK-19812] YARN shuffle service fails to relocate rec...

2017-04-24 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/17748 **[Test build #76115 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/76115/testReport)** for PR 17748 at commit

[GitHub] spark pull request #17748: [SPARK-19812] YARN shuffle service fails to reloc...

2017-04-24 Thread tgravescs
GitHub user tgravescs opened a pull request: https://github.com/apache/spark/pull/17748 [SPARK-19812] YARN shuffle service fails to relocate recovery DB acro… …ss NFS directories ## What changes were proposed in this pull request? Change from using java

[GitHub] spark issue #17694: [SPARK-12717][PYSPARK] Resolving race condition with pys...

2017-04-24 Thread jsoltren
Github user jsoltren commented on the issue: https://github.com/apache/spark/pull/17694 This seems reasonable to me. There are some typos in the PR description. I think you meant "pickled" instead of "picked" in a few places. Using threading.Lock seems okay here from

[GitHub] spark issue #17748: [SPARK-19812] YARN shuffle service fails to relocate rec...

2017-04-24 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/17748 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #17748: [SPARK-19812] YARN shuffle service fails to relocate rec...

2017-04-24 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/17748 **[Test build #76115 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/76115/testReport)** for PR 17748 at commit

[GitHub] spark issue #17748: [SPARK-19812] YARN shuffle service fails to relocate rec...

2017-04-24 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/17748 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/76115/ Test PASSed. ---

[GitHub] spark issue #17730: [SPARK-20439] [SQL] Fix Catalog API listTables and getTa...

2017-04-24 Thread sameeragarwal
Github user sameeragarwal commented on the issue: https://github.com/apache/spark/pull/17730 should we backport this to earlier releases too? --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have

[GitHub] spark issue #17729: [SPARK-20438][R] SparkR wrappers for split and repeat

2017-04-24 Thread felixcheung
Github user felixcheung commented on the issue: https://github.com/apache/spark/pull/17729 merged to master --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes

[GitHub] spark pull request #15125: [SPARK-5484][GraphX] Periodically do checkpoint i...

2017-04-24 Thread felixcheung
Github user felixcheung commented on a diff in the pull request: https://github.com/apache/spark/pull/15125#discussion_r113016353 --- Diff: docs/graphx-programming-guide.md --- @@ -709,7 +709,8 @@ messages remaining. The following is the type signature of the [Pregel

[GitHub] spark pull request #12004: [SPARK-7481] [build] Add spark-cloud module to pu...

2017-04-24 Thread steveloughran
Github user steveloughran closed the pull request at: https://github.com/apache/spark/pull/12004 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the

[GitHub] spark issue #17721: [SPARK-20013][SQL]merge renameTable to alterTable in Ext...

2017-04-24 Thread hvanhovell
Github user hvanhovell commented on the issue: https://github.com/apache/spark/pull/17721 @windpiger could you make sure that the freshly added events still work after this change. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub

[GitHub] spark pull request #15125: [SPARK-5484][GraphX] Periodically do checkpoint i...

2017-04-24 Thread dding3
Github user dding3 commented on a diff in the pull request: https://github.com/apache/spark/pull/15125#discussion_r113021061 --- Diff: docs/graphx-programming-guide.md --- @@ -709,7 +709,8 @@ messages remaining. The following is the type signature of the [Pregel

[GitHub] spark issue #17746: [SPARK-20449][ML] Upgrade breeze version to 0.13.1

2017-04-24 Thread yanboliang
Github user yanboliang commented on the issue: https://github.com/apache/spark/pull/17746 cc @dbtsai --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or

[GitHub] spark issue #17747: [SPARK-11373] [CORE] Add metrics to the FsHistoryProvide...

2017-04-24 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/17747 **[Test build #76112 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/76112/testReport)** for PR 17747 at commit

[GitHub] spark pull request #17677: [SPARK-20379][core] Allow reading SSL-related pas...

2017-04-24 Thread vanzin
Github user vanzin closed the pull request at: https://github.com/apache/spark/pull/17677 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is

[GitHub] spark issue #17677: [SPARK-20379][core] Allow reading SSL-related passwords ...

2017-04-24 Thread vanzin
Github user vanzin commented on the issue: https://github.com/apache/spark/pull/17677 This is not needed, actually, see bug. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #17742: [Spark-20446][ML][MLLIB]Optimize MLLIB ALS recommendForA...

2017-04-24 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/17742 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #17725: [SPARK-20435][CORE] More thorough redaction of sensitive...

2017-04-24 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/17725 **[Test build #76114 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/76114/testReport)** for PR 17725 at commit

[GitHub] spark pull request #17729: [SPARK-20438][R] SparkR wrappers for split and re...

2017-04-24 Thread felixcheung
Github user felixcheung commented on a diff in the pull request: https://github.com/apache/spark/pull/17729#discussion_r113012910 --- Diff: R/pkg/R/functions.R --- @@ -3745,3 +3745,55 @@ setMethod("collect_set", jc <- callJStatic("org.apache.spark.sql.functions",

[GitHub] spark pull request #17645: [SPARK-20348] [ML] Support squared hinge loss (L2...

2017-04-24 Thread yanboliang
Github user yanboliang commented on a diff in the pull request: https://github.com/apache/spark/pull/17645#discussion_r112984129 --- Diff: mllib/src/main/scala/org/apache/spark/ml/classification/LinearSVC.scala --- @@ -42,15 +44,35 @@ import org.apache.spark.sql.functions.{col,

[GitHub] spark issue #17658: [SPARK-20355] Add per application spark version on the h...

2017-04-24 Thread redsanket
Github user redsanket commented on the issue: https://github.com/apache/spark/pull/17658 Jenkins, test this please --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and

[GitHub] spark pull request #17728: [SPARK-20437][R] R wrappers for rollup and cube

2017-04-24 Thread felixcheung
Github user felixcheung commented on a diff in the pull request: https://github.com/apache/spark/pull/17728#discussion_r113011650 --- Diff: R/pkg/R/DataFrame.R --- @@ -3642,3 +3642,58 @@ setMethod("checkpoint", df <- callJMethod(x@sdf, "checkpoint",

[GitHub] spark issue #9571: [SPARK-11373] [CORE] Add metrics to the History Server an...

2017-04-24 Thread steveloughran
Github user steveloughran commented on the issue: https://github.com/apache/spark/pull/9571 I'm going to close this PR and start one based on a reapplication of this patch onto master; gets rid of all the merge pain and is intended to be more minimal. The latest comments of this one

[GitHub] spark issue #17747: [SPARK-11373] [CORE] Add metrics to the FsHistoryProvide...

2017-04-24 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/17747 **[Test build #76112 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/76112/testReport)** for PR 17747 at commit

[GitHub] spark issue #17747: [SPARK-11373] [CORE] Add metrics to the FsHistoryProvide...

2017-04-24 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/17747 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/76112/ Test FAILed. ---

[GitHub] spark issue #17747: [SPARK-11373] [CORE] Add metrics to the FsHistoryProvide...

2017-04-24 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/17747 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #14731: [SPARK-17159] [streaming]: optimise check for new files ...

2017-04-24 Thread rxin
Github user rxin commented on the issue: https://github.com/apache/spark/pull/14731 Steve I think the main point is you should also respect the time of reviewers. The way most of your pull requests manifest have been suboptimal: they often start with a very early WIP (which is not

  1   2   3   4   >