[GitHub] spark pull request #17081: [SPARK-18726][SQL]resolveRelation for FileFormat ...

2017-03-02 Thread windpiger
Github user windpiger commented on a diff in the pull request: https://github.com/apache/spark/pull/17081#discussion_r104075579 --- Diff: sql/core/src/main/scala/org/apache/spark/sql/execution/datasources/DataSource.scala --- @@ -106,6 +106,7 @@ case class DataSource( *

[GitHub] spark issue #17061: [SPARK-13446] [SQL] Support reading data from Hive 2.0.1...

2017-03-02 Thread gatorsmile
Github user gatorsmile commented on the issue: https://github.com/apache/spark/pull/17061 Thank you! @vanzin --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes

[GitHub] spark issue #17062: [SPARK-17495] [SQL] Support date, timestamp and interval...

2017-03-02 Thread gatorsmile
Github user gatorsmile commented on the issue: https://github.com/apache/spark/pull/17062 Will review it tonight. Thanks! --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled

[GitHub] spark pull request #17081: [SPARK-18726][SQL]resolveRelation for FileFormat ...

2017-03-02 Thread gatorsmile
Github user gatorsmile commented on a diff in the pull request: https://github.com/apache/spark/pull/17081#discussion_r104073970 --- Diff: sql/core/src/main/scala/org/apache/spark/sql/execution/datasources/DataSource.scala --- @@ -106,6 +106,7 @@ case class DataSource( *

[GitHub] spark pull request #17141: [SPARK-19800][SS][WIP] Implement one kind of stre...

2017-03-02 Thread uncleGen
Github user uncleGen commented on a diff in the pull request: https://github.com/apache/spark/pull/17141#discussion_r104073813 --- Diff: sql/core/src/test/scala/org/apache/spark/sql/streaming/ReservoirSampleSuit.scala --- @@ -0,0 +1,134 @@ +/* + * Licensed to the Apache

[GitHub] spark pull request #17141: [SPARK-19800][SS][WIP] Implement one kind of stre...

2017-03-02 Thread uncleGen
Github user uncleGen commented on a diff in the pull request: https://github.com/apache/spark/pull/17141#discussion_r104073535 --- Diff: sql/core/src/main/scala/org/apache/spark/sql/execution/streaming/statefulOperators.scala --- @@ -397,3 +402,110 @@ object

[GitHub] spark pull request #17141: [SPARK-19800][SS][WIP] Implement one kind of stre...

2017-03-02 Thread uncleGen
Github user uncleGen commented on a diff in the pull request: https://github.com/apache/spark/pull/17141#discussion_r104073674 --- Diff: sql/core/src/main/scala/org/apache/spark/sql/execution/streaming/statefulOperators.scala --- @@ -397,3 +402,110 @@ object

[GitHub] spark pull request #17141: [SPARK-19800][SS][WIP] Implement one kind of stre...

2017-03-02 Thread uncleGen
Github user uncleGen commented on a diff in the pull request: https://github.com/apache/spark/pull/17141#discussion_r104073607 --- Diff: sql/core/src/main/scala/org/apache/spark/sql/execution/streaming/statefulOperators.scala --- @@ -397,3 +402,110 @@ object

[GitHub] spark pull request #17141: [SPARK-19800][SS][WIP] Implement one kind of stre...

2017-03-02 Thread uncleGen
Github user uncleGen commented on a diff in the pull request: https://github.com/apache/spark/pull/17141#discussion_r104073516 --- Diff: sql/core/src/main/scala/org/apache/spark/sql/execution/streaming/statefulOperators.scala --- @@ -397,3 +402,110 @@ object

[GitHub] spark pull request #17141: [SPARK-19800][SS][WIP] Implement one kind of stre...

2017-03-02 Thread uncleGen
Github user uncleGen commented on a diff in the pull request: https://github.com/apache/spark/pull/17141#discussion_r104073290 --- Diff: sql/core/src/main/scala/org/apache/spark/sql/execution/streaming/statefulOperators.scala --- @@ -397,3 +402,110 @@ object

[GitHub] spark issue #17076: [SPARK-19745][ML] SVCAggregator captures coefficients in...

2017-03-02 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/17076 Build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled

[GitHub] spark issue #17076: [SPARK-19745][ML] SVCAggregator captures coefficients in...

2017-03-02 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/17076 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/73792/ Test FAILed. ---

[GitHub] spark issue #17076: [SPARK-19745][ML] SVCAggregator captures coefficients in...

2017-03-02 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/17076 **[Test build #73792 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/73792/testReport)** for PR 17076 at commit

[GitHub] spark issue #15666: [SPARK-11421] [Core][Python][R] Added ability for addJar...

2017-03-02 Thread felixcheung
Github user felixcheung commented on the issue: https://github.com/apache/spark/pull/15666 It looks like a syntax error ``` inst/tests/testthat/test_context.R:170:79: error: unexpected '{' test_that("add jar should work and allow usage of the jar on the driver node" {

[GitHub] spark issue #17141: [SPARK-19800][SS][WIP] Implement one kind of streaming s...

2017-03-02 Thread uncleGen
Github user uncleGen commented on the issue: https://github.com/apache/spark/pull/17141 cc @zsxwing and @tdas --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes

[GitHub] spark issue #17076: [SPARK-19745][ML] SVCAggregator captures coefficients in...

2017-03-02 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/17076 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/73794/ Test PASSed. ---

[GitHub] spark issue #17076: [SPARK-19745][ML] SVCAggregator captures coefficients in...

2017-03-02 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/17076 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #17076: [SPARK-19745][ML] SVCAggregator captures coefficients in...

2017-03-02 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/17076 **[Test build #73794 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/73794/testReport)** for PR 17076 at commit

[GitHub] spark issue #17080: [SPARK-19739][CORE] propagate S3 session token to cluser

2017-03-02 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/17080 **[Test build #73797 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/73797/testReport)** for PR 17080 at commit

[GitHub] spark pull request #17080: [SPARK-19739][CORE] propagate S3 session token to...

2017-03-02 Thread uncleGen
Github user uncleGen commented on a diff in the pull request: https://github.com/apache/spark/pull/17080#discussion_r104070946 --- Diff: core/src/main/scala/org/apache/spark/deploy/SparkHadoopUtil.scala --- @@ -82,17 +82,25 @@ class SparkHadoopUtil extends Logging { //

[GitHub] spark issue #17083: [SPARK-19750][UI][branch-2.1] Fix redirect issue from ht...

2017-03-02 Thread jerryshao
Github user jerryshao commented on the issue: https://github.com/apache/spark/pull/17083 OK, Thanks @vanzin . --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes

[GitHub] spark pull request #17083: [SPARK-19750][UI][branch-2.1] Fix redirect issue ...

2017-03-02 Thread jerryshao
Github user jerryshao closed the pull request at: https://github.com/apache/spark/pull/17083 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is

[GitHub] spark issue #17083: [SPARK-19750][UI][branch-2.1] Fix redirect issue from ht...

2017-03-02 Thread vanzin
Github user vanzin commented on the issue: https://github.com/apache/spark/pull/17083 @jerryshao I think you'll need to manually close the PR. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have

[GitHub] spark issue #16867: [SPARK-16929] Improve performance when check speculatabl...

2017-03-02 Thread kayousterhout
Github user kayousterhout commented on the issue: https://github.com/apache/spark/pull/16867 Also, thanks for doing the timing measurements! --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have

[GitHub] spark issue #17083: [SPARK-19750][UI][branch-2.1] Fix redirect issue from ht...

2017-03-02 Thread vanzin
Github user vanzin commented on the issue: https://github.com/apache/spark/pull/17083 Merging to 2.1 / 2.0. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes

[GitHub] spark pull request #17083: [SPARK-19750][UI][branch-2.1] Fix redirect issue ...

2017-03-02 Thread vanzin
Github user vanzin commented on a diff in the pull request: https://github.com/apache/spark/pull/17083#discussion_r104070712 --- Diff: core/src/main/scala/org/apache/spark/ui/JettyUtils.scala --- @@ -330,7 +330,7 @@ private[spark] object JettyUtils extends Logging {

[GitHub] spark issue #16867: [SPARK-16929] Improve performance when check speculatabl...

2017-03-02 Thread kayousterhout
Github user kayousterhout commented on the issue: https://github.com/apache/spark/pull/16867 I'm a little on the fence about this because of the added complexity, but it does seem to be a significant time improvement. Did you consider implementing this as a median heap (see the last

[GitHub] spark issue #17141: [SPARK-19800][SS][WIP] Implement one kind of streaming s...

2017-03-02 Thread uncleGen
Github user uncleGen commented on the issue: https://github.com/apache/spark/pull/17141 @srowen There are some unsupported `operator` for Structured Streaming. You can view here:

[GitHub] spark issue #16970: [SPARK-19497][SS]Implement streaming deduplication

2017-03-02 Thread uncleGen
Github user uncleGen commented on the issue: https://github.com/apache/spark/pull/16970 @zsxwing Thanks, I am missing it. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled

[GitHub] spark issue #17081: [SPARK-18726][SQL]resolveRelation for FileFormat DataSou...

2017-03-02 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/17081 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #17081: [SPARK-18726][SQL]resolveRelation for FileFormat DataSou...

2017-03-02 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/17081 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/73791/ Test PASSed. ---

[GitHub] spark issue #17081: [SPARK-18726][SQL]resolveRelation for FileFormat DataSou...

2017-03-02 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/17081 **[Test build #73791 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/73791/testReport)** for PR 17081 at commit

[GitHub] spark issue #15505: [SPARK-18890][CORE] Move task serialization from the Tas...

2017-03-02 Thread kayousterhout
Github user kayousterhout commented on the issue: https://github.com/apache/spark/pull/15505 @witgo I don't think the ~1.5% improvement in runtime merits the added complexity of this change. I could be convinced to merge this if it simplified the code or the ability to reason about

[GitHub] spark issue #16970: [SPARK-19497][SS]Implement streaming deduplication

2017-03-02 Thread lw-lin
Github user lw-lin commented on the issue: https://github.com/apache/spark/pull/16970 @uncleGen I think `requiredChildDistribution = ClusteredDistribution(keyExpressions) :: Nil` (please see

[GitHub] spark issue #17074: [SPARK-18646][REPL] Set parent classloader as null for E...

2017-03-02 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/17074 **[Test build #73796 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/73796/testReport)** for PR 17074 at commit

[GitHub] spark issue #17074: [SPARK-18646][REPL] Set parent classloader as null for E...

2017-03-02 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/17074 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/73796/ Test FAILed. ---

[GitHub] spark issue #17074: [SPARK-18646][REPL] Set parent classloader as null for E...

2017-03-02 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/17074 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark pull request #16639: [SPARK-19276][CORE] Fetch Failure handling robust...

2017-03-02 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/spark/pull/16639 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is

[GitHub] spark issue #17076: [SPARK-19745][ML] SVCAggregator captures coefficients in...

2017-03-02 Thread imatiach-msft
Github user imatiach-msft commented on the issue: https://github.com/apache/spark/pull/17076 I took another brief look, the updates look great, thank you --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project

[GitHub] spark issue #17074: [SPARK-18646][REPL] Set parent classloader as null for E...

2017-03-02 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/17074 **[Test build #73796 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/73796/testReport)** for PR 17074 at commit

[GitHub] spark pull request #17133: [SPARK-19793] Use clock.getTimeMillis when mark t...

2017-03-02 Thread jinxing64
Github user jinxing64 commented on a diff in the pull request: https://github.com/apache/spark/pull/17133#discussion_r104066996 --- Diff: core/src/main/scala/org/apache/spark/scheduler/TaskSetManager.scala --- @@ -695,7 +695,8 @@ private[spark] class TaskSetManager( def

[GitHub] spark issue #16639: [SPARK-19276][CORE] Fetch Failure handling robust to use...

2017-03-02 Thread kayousterhout
Github user kayousterhout commented on the issue: https://github.com/apache/spark/pull/16639 I merged this into master. Thanks @squito! --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this

[GitHub] spark issue #17074: [SPARK-18646][REPL] Set parent classloader as null for E...

2017-03-02 Thread vanzin
Github user vanzin commented on the issue: https://github.com/apache/spark/pull/17074 ok to test --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the

[GitHub] spark issue #17133: [SPARK-19793] Use clock.getTimeMillis when mark task as ...

2017-03-02 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/17133 **[Test build #73795 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/73795/testReport)** for PR 17133 at commit

[GitHub] spark issue #17076: [SPARK-19745][ML] SVCAggregator captures coefficients in...

2017-03-02 Thread sethah
Github user sethah commented on the issue: https://github.com/apache/spark/pull/17076 Updated. Well I was able to verify that adding the lazy val does make the task binary broadcast variable smaller - i.e. it does not vary with the size of the features. We could potentially test this

[GitHub] spark issue #17076: [SPARK-19745][ML] SVCAggregator captures coefficients in...

2017-03-02 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/17076 **[Test build #73794 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/73794/testReport)** for PR 17076 at commit

[GitHub] spark issue #17081: [SPARK-18726][SQL]resolveRelation for FileFormat DataSou...

2017-03-02 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/17081 **[Test build #73793 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/73793/testReport)** for PR 17081 at commit

[GitHub] spark pull request #17081: [SPARK-18726][SQL]resolveRelation for FileFormat ...

2017-03-02 Thread windpiger
Github user windpiger commented on a diff in the pull request: https://github.com/apache/spark/pull/17081#discussion_r104065615 --- Diff: sql/core/src/main/scala/org/apache/spark/sql/execution/datasources/DataSource.scala --- @@ -109,7 +109,9 @@ case class DataSource( *

[GitHub] spark issue #17076: [SPARK-19745][ML] SVCAggregator captures coefficients in...

2017-03-02 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/17076 **[Test build #73792 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/73792/testReport)** for PR 17076 at commit

[GitHub] spark issue #17061: [SPARK-13446] [SQL] Support reading data from Hive 2.0.1...

2017-03-02 Thread vanzin
Github user vanzin commented on the issue: https://github.com/apache/spark/pull/17061 LGTM. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the

[GitHub] spark pull request #17083: [SPARK-19750][UI][branch-2.1] Fix redirect issue ...

2017-03-02 Thread jerryshao
Github user jerryshao commented on a diff in the pull request: https://github.com/apache/spark/pull/17083#discussion_r104064675 --- Diff: core/src/main/scala/org/apache/spark/ui/JettyUtils.scala --- @@ -330,7 +330,7 @@ private[spark] object JettyUtils extends Logging {

[GitHub] spark issue #17081: [SPARK-18726][SQL][FOLLOW-UP]resolveRelation for FileFor...

2017-03-02 Thread gatorsmile
Github user gatorsmile commented on the issue: https://github.com/apache/spark/pull/17081 Please remove `[FOLLOW-UP]` from the PR title. Thanks! --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not

[GitHub] spark pull request #17142: [SPARK-18699][SQL][FOLLOWUP] Add explanation in C...

2017-03-02 Thread HyukjinKwon
Github user HyukjinKwon commented on a diff in the pull request: https://github.com/apache/spark/pull/17142#discussion_r104063545 --- Diff: sql/core/src/main/scala/org/apache/spark/sql/execution/datasources/csv/UnivocityParser.scala --- @@ -54,39 +54,77 @@ private[csv] class

[GitHub] spark pull request #17081: [SPARK-18726][SQL][FOLLOW-UP]resolveRelation for ...

2017-03-02 Thread gatorsmile
Github user gatorsmile commented on a diff in the pull request: https://github.com/apache/spark/pull/17081#discussion_r104063471 --- Diff: sql/core/src/main/scala/org/apache/spark/sql/execution/datasources/DataSource.scala --- @@ -109,7 +109,9 @@ case class DataSource( *

[GitHub] spark pull request #17140: [SPARK-19796][CORE] Fix serialization of long pro...

2017-03-02 Thread kayousterhout
Github user kayousterhout commented on a diff in the pull request: https://github.com/apache/spark/pull/17140#discussion_r104063441 --- Diff: core/src/main/scala/org/apache/spark/scheduler/TaskDescription.scala --- @@ -86,7 +86,10 @@ private[spark] object TaskDescription {

[GitHub] spark pull request #16954: [SPARK-18874][SQL] First phase: Deferring the cor...

2017-03-02 Thread gatorsmile
Github user gatorsmile commented on a diff in the pull request: https://github.com/apache/spark/pull/16954#discussion_r104063308 --- Diff: sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/analysis/Analyzer.scala --- @@ -21,12 +21,13 @@ import scala.annotation.tailrec

[GitHub] spark pull request #17080: [SPARK-19739][CORE] propagate S3 session token to...

2017-03-02 Thread vanzin
Github user vanzin commented on a diff in the pull request: https://github.com/apache/spark/pull/17080#discussion_r104063068 --- Diff: core/src/main/scala/org/apache/spark/deploy/SparkHadoopUtil.scala --- @@ -82,17 +82,25 @@ class SparkHadoopUtil extends Logging { // the

[GitHub] spark pull request #17142: [SPARK-18699][SQL][FOLLOWUP] Add explanation in C...

2017-03-02 Thread maropu
Github user maropu commented on a diff in the pull request: https://github.com/apache/spark/pull/17142#discussion_r104062715 --- Diff: sql/core/src/main/scala/org/apache/spark/sql/execution/datasources/csv/UnivocityParser.scala --- @@ -54,39 +54,77 @@ private[csv] class

[GitHub] spark pull request #17140: [SPARK-19796][CORE] Fix serialization of long pro...

2017-03-02 Thread vanzin
Github user vanzin commented on a diff in the pull request: https://github.com/apache/spark/pull/17140#discussion_r104062543 --- Diff: core/src/main/scala/org/apache/spark/scheduler/TaskDescription.scala --- @@ -86,7 +86,10 @@ private[spark] object TaskDescription {

[GitHub] spark pull request #16959: [SPARK-19631][CORE] OutputCommitCoordinator shoul...

2017-03-02 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/spark/pull/16959 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is

[GitHub] spark issue #16959: [SPARK-19631][CORE] OutputCommitCoordinator should not a...

2017-03-02 Thread kayousterhout
Github user kayousterhout commented on the issue: https://github.com/apache/spark/pull/16959 LGTM -- I merged this into master --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #17143: [SPARK-19801][BUILD] Remove JDK7 from Travis CI

2017-03-02 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/17143 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/73788/ Test PASSed. ---

[GitHub] spark issue #17143: [SPARK-19801][BUILD] Remove JDK7 from Travis CI

2017-03-02 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/17143 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #17143: [SPARK-19801][BUILD] Remove JDK7 from Travis CI

2017-03-02 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/17143 **[Test build #73788 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/73788/testReport)** for PR 17143 at commit

[GitHub] spark issue #16954: [SPARK-18874][SQL] First phase: Deferring the correlated...

2017-03-02 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/16954 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #16954: [SPARK-18874][SQL] First phase: Deferring the correlated...

2017-03-02 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/16954 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/73789/ Test PASSed. ---

[GitHub] spark issue #16954: [SPARK-18874][SQL] First phase: Deferring the correlated...

2017-03-02 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/16954 **[Test build #73789 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/73789/testReport)** for PR 16954 at commit

[GitHub] spark issue #17081: [SPARK-18726][SQL][FOLLOW-UP]resolveRelation for FileFor...

2017-03-02 Thread windpiger
Github user windpiger commented on the issue: https://github.com/apache/spark/pull/17081 oh...sorry , I don't know when I close it... --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this

[GitHub] spark issue #17130: [SPARK-19791] [ML] Add doc and example for fpgrowth

2017-03-02 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/17130 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/73790/ Test PASSed. ---

[GitHub] spark issue #17130: [SPARK-19791] [ML] Add doc and example for fpgrowth

2017-03-02 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/17130 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #17130: [SPARK-19791] [ML] Add doc and example for fpgrowth

2017-03-02 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/17130 **[Test build #73790 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/73790/testReport)** for PR 17130 at commit

[GitHub] spark issue #17081: [SPARK-18726][SQL][FOLLOW-UP]resolveRelation for FileFor...

2017-03-02 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/17081 **[Test build #73791 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/73791/testReport)** for PR 17081 at commit

[GitHub] spark pull request #17081: [SPARK-18726][SQL][FOLLOW-UP]resolveRelation for ...

2017-03-02 Thread windpiger
GitHub user windpiger reopened a pull request: https://github.com/apache/spark/pull/17081 [SPARK-18726][SQL][FOLLOW-UP]resolveRelation for FileFormat DataSource don't need to listFiles twice ## What changes were proposed in this pull request? Currently when we

[GitHub] spark issue #11601: [SPARK-13568] [ML] Create feature transformer to impute ...

2017-03-02 Thread hhbyyh
Github user hhbyyh commented on the issue: https://github.com/apache/spark/pull/11601 Thanks a lot for making a pass @MLnick. The last update mainly focus on the interface and behavior change. I'll make a pass and also address your comments. --- If your project is set up for it,

[GitHub] spark issue #17130: [SPARK-19791] [ML] Add doc and example for fpgrowth

2017-03-02 Thread hhbyyh
Github user hhbyyh commented on the issue: https://github.com/apache/spark/pull/17130 ping @jkbradley since we're changing the FPGrowth `transform`. Sean made a great suggestion to simplify `transform` code. --- If your project is set up for it, you can reply to this email and

[GitHub] spark issue #17130: [SPARK-19791] [ML] Add doc and example for fpgrowth

2017-03-02 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/17130 **[Test build #73790 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/73790/testReport)** for PR 17130 at commit

[GitHub] spark issue #15666: [SPARK-11421] [Core][Python][R] Added ability for addJar...

2017-03-02 Thread holdenk
Github user holdenk commented on the issue: https://github.com/apache/spark/pull/15666 So now the R style checks out of alignment (sorry) - if you have a chance to look at those it would be great. --- If your project is set up for it, you can reply to this email and have your reply

[GitHub] spark pull request #17130: [SPARK-19791] [ML] Add doc and example for fpgrow...

2017-03-02 Thread hhbyyh
Github user hhbyyh commented on a diff in the pull request: https://github.com/apache/spark/pull/17130#discussion_r104039923 --- Diff: examples/src/main/scala/org/apache/spark/examples/ml/FPGrowthExample.scala --- @@ -0,0 +1,71 @@ +/* + * Licensed to the Apache Software

[GitHub] spark issue #17044: [SPARK-19718][SS]Handle more interrupt cases properly fo...

2017-03-02 Thread vanzin
Github user vanzin commented on the issue: https://github.com/apache/spark/pull/17044 @zsxwing I'm not the right person to review this, but can we get the ball rolling on this fix? This test is really flaky and constantly causes PR builders to fail. --- If your project is set up

[GitHub] spark issue #16954: [SPARK-18874][SQL] First phase: Deferring the correlated...

2017-03-02 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/16954 **[Test build #73789 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/73789/testReport)** for PR 16954 at commit

[GitHub] spark pull request #17090: [Spark-19535][ML] RecommendForAllUsers RecommendF...

2017-03-02 Thread sueann
Github user sueann commented on a diff in the pull request: https://github.com/apache/spark/pull/17090#discussion_r104036563 --- Diff: mllib/src/test/scala/org/apache/spark/ml/recommendation/ALSSuite.scala --- @@ -594,6 +595,95 @@ class ALSSuite

[GitHub] spark pull request #17130: [SPARK-19791] [ML] Add doc and example for fpgrow...

2017-03-02 Thread hhbyyh
Github user hhbyyh commented on a diff in the pull request: https://github.com/apache/spark/pull/17130#discussion_r104036137 --- Diff: mllib/src/main/scala/org/apache/spark/ml/fpm/FPGrowth.scala --- @@ -56,8 +56,8 @@ private[fpm] trait FPGrowthParams extends Params with

[GitHub] spark issue #16959: [SPARK-19631][CORE] OutputCommitCoordinator should not a...

2017-03-02 Thread ash211
Github user ash211 commented on the issue: https://github.com/apache/spark/pull/16959 Any last changes before merging? --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled

[GitHub] spark issue #17143: [SPARK-19801][BUILD] Remove JDK7 from Travis CI

2017-03-02 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/17143 **[Test build #73788 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/73788/testReport)** for PR 17143 at commit

[GitHub] spark issue #17143: [SPARK-19801][BUILD] Remove JDK7 from Travis CI

2017-03-02 Thread dongjoon-hyun
Github user dongjoon-hyun commented on the issue: https://github.com/apache/spark/pull/17143 Retest this please --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and

[GitHub] spark issue #17143: [SPARK-19801][BUILD] Remove JDK7 from Travis CI

2017-03-02 Thread dongjoon-hyun
Github user dongjoon-hyun commented on the issue: https://github.com/apache/spark/pull/17143 The only failure is irrelevant to this PR. ``` [info] KafkaSourceStressForDontFailOnDataLossSuite: [info] - stress test for failOnDataLoss=false *** FAILED *** (1 minute, 2

[GitHub] spark issue #17143: [SPARK-19801][BUILD] Remove JDK7 from Travis CI

2017-03-02 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/17143 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #17143: [SPARK-19801][BUILD] Remove JDK7 from Travis CI

2017-03-02 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/17143 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/73785/ Test FAILed. ---

[GitHub] spark issue #17143: [SPARK-19801][BUILD] Remove JDK7 from Travis CI

2017-03-02 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/17143 **[Test build #73785 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/73785/testReport)** for PR 17143 at commit

[GitHub] spark pull request #17091: [SPARK-19757][CORE] Executor with task scheduled ...

2017-03-02 Thread vanzin
Github user vanzin commented on a diff in the pull request: https://github.com/apache/spark/pull/17091#discussion_r104028425 --- Diff: core/src/main/scala/org/apache/spark/scheduler/cluster/CoarseGrainedSchedulerBackend.scala --- @@ -222,12 +222,17 @@ class

[GitHub] spark issue #17090: [Spark-19535][ML] RecommendForAllUsers RecommendForAllIt...

2017-03-02 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/17090 **[Test build #73787 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/73787/testReport)** for PR 17090 at commit

[GitHub] spark issue #17090: [Spark-19535][ML] RecommendForAllUsers RecommendForAllIt...

2017-03-02 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/17090 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #17090: [Spark-19535][ML] RecommendForAllUsers RecommendForAllIt...

2017-03-02 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/17090 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/73787/ Test PASSed. ---

[GitHub] spark issue #16639: [SPARK-19276][CORE] Fetch Failure handling robust to use...

2017-03-02 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/16639 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/73784/ Test PASSed. ---

[GitHub] spark issue #16639: [SPARK-19276][CORE] Fetch Failure handling robust to use...

2017-03-02 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/16639 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #16639: [SPARK-19276][CORE] Fetch Failure handling robust to use...

2017-03-02 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/16639 **[Test build #73784 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/73784/testReport)** for PR 16639 at commit

[GitHub] spark pull request #17140: [SPARK-19796][CORE] Fix serialization of long pro...

2017-03-02 Thread kayousterhout
Github user kayousterhout commented on a diff in the pull request: https://github.com/apache/spark/pull/17140#discussion_r104018967 --- Diff: core/src/main/scala/org/apache/spark/scheduler/TaskDescription.scala --- @@ -86,7 +86,10 @@ private[spark] object TaskDescription {

[GitHub] spark issue #17090: [Spark-19535][ML] RecommendForAllUsers RecommendForAllIt...

2017-03-02 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/17090 **[Test build #73787 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/73787/testReport)** for PR 17090 at commit

[GitHub] spark pull request #17140: [SPARK-19796][CORE] Fix serialization of long pro...

2017-03-02 Thread kayousterhout
Github user kayousterhout commented on a diff in the pull request: https://github.com/apache/spark/pull/17140#discussion_r104016148 --- Diff: core/src/main/scala/org/apache/spark/scheduler/TaskDescription.scala --- @@ -86,7 +86,10 @@ private[spark] object TaskDescription {

[GitHub] spark pull request #17140: [SPARK-19796][CORE] Fix serialization of long pro...

2017-03-02 Thread kayousterhout
Github user kayousterhout commented on a diff in the pull request: https://github.com/apache/spark/pull/17140#discussion_r104015455 --- Diff: core/src/main/scala/org/apache/spark/scheduler/TaskDescription.scala --- @@ -86,7 +86,10 @@ private[spark] object TaskDescription {

<    1   2   3   4   5   6   7   >