[GitHub] spark issue #17018: [SPARK-19684] [DOCS] Remove developer info from docs.

2017-02-21 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/17018 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #17018: [SPARK-19684] [DOCS] Remove developer info from docs.

2017-02-21 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/17018 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/73237/ Test PASSed. ---

[GitHub] spark issue #17018: [SPARK-19684] [DOCS] Remove developer info from docs.

2017-02-21 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/17018 **[Test build #73237 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/73237/testReport)** for PR 17018 at commit

[GitHub] spark pull request #16979: [SPARK-19617][SS]Fix the race condition when star...

2017-02-21 Thread zsxwing
Github user zsxwing commented on a diff in the pull request: https://github.com/apache/spark/pull/16979#discussion_r102335119 --- Diff: sql/core/src/main/scala/org/apache/spark/sql/execution/streaming/HDFSMetadataLog.scala --- @@ -63,8 +63,34 @@ class HDFSMetadataLog[T <: AnyRef

[GitHub] spark issue #17018: [SPARK-19684] [DOCS] Remove developer info from docs.

2017-02-21 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/17018 **[Test build #73237 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/73237/testReport)** for PR 17018 at commit

[GitHub] spark issue #17015: [SPARK-19678][SQL] remove MetastoreRelation

2017-02-21 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/17015 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #17015: [SPARK-19678][SQL] remove MetastoreRelation

2017-02-21 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/17015 **[Test build #73235 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/73235/testReport)** for PR 17015 at commit

[GitHub] spark issue #17015: [SPARK-19678][SQL] remove MetastoreRelation

2017-02-21 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/17015 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/73235/ Test FAILed. ---

[GitHub] spark pull request #17018: [SPARK-19684] [DOCS] Remove developer info from d...

2017-02-21 Thread kayousterhout
GitHub user kayousterhout opened a pull request: https://github.com/apache/spark/pull/17018 [SPARK-19684] [DOCS] Remove developer info from docs. This commit moves developer-specific information from the release- specific documentation in this repo to the developer tools page on

[GitHub] spark pull request #15770: [SPARK-15784][ML]:Add Power Iteration Clustering ...

2017-02-21 Thread wangmiao1981
Github user wangmiao1981 commented on a diff in the pull request: https://github.com/apache/spark/pull/15770#discussion_r102330772 --- Diff: mllib/src/main/scala/org/apache/spark/ml/clustering/PowerIterationClustering.scala --- @@ -0,0 +1,182 @@ +/* + * Licensed to the

[GitHub] spark issue #16978: [SPARK-19652][UI] Do auth checks for REST API access.

2017-02-21 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/16978 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #16978: [SPARK-19652][UI] Do auth checks for REST API access.

2017-02-21 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/16978 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/73229/ Test PASSed. ---

[GitHub] spark issue #16867: [SPARK-16929] Improve performance when check speculatabl...

2017-02-21 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/16867 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #16867: [SPARK-16929] Improve performance when check speculatabl...

2017-02-21 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/16867 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/73230/ Test PASSed. ---

[GitHub] spark issue #16978: [SPARK-19652][UI] Do auth checks for REST API access.

2017-02-21 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/16978 **[Test build #73229 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/73229/testReport)** for PR 16978 at commit

[GitHub] spark issue #17002: [SPARK-19669][SQL] Open up visibility for sharedState, s...

2017-02-21 Thread gatorsmile
Github user gatorsmile commented on the issue: https://github.com/apache/spark/pull/17002 Yeah. Will be more careful in the future. Sorry for that. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not

[GitHub] spark issue #16715: [Spark-18080][ML][PYTHON] Python API & Examples for Loca...

2017-02-21 Thread e-m-m
Github user e-m-m commented on the issue: https://github.com/apache/spark/pull/16715 Wow, thanks for the quick answer, @Yunni! Sounds great. I'll definitely be using it. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well.

[GitHub] spark issue #16499: [SPARK-17204][CORE] Fix replicated off heap storage

2017-02-21 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/16499 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/73226/ Test PASSed. ---

[GitHub] spark issue #16499: [SPARK-17204][CORE] Fix replicated off heap storage

2017-02-21 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/16499 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #16499: [SPARK-17204][CORE] Fix replicated off heap storage

2017-02-21 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/16499 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/73223/ Test PASSed. ---

[GitHub] spark issue #16499: [SPARK-17204][CORE] Fix replicated off heap storage

2017-02-21 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/16499 Build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled

[GitHub] spark issue #16499: [SPARK-17204][CORE] Fix replicated off heap storage

2017-02-21 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/16499 **[Test build #73226 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/73226/testReport)** for PR 16499 at commit

[GitHub] spark issue #16499: [SPARK-17204][CORE] Fix replicated off heap storage

2017-02-21 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/16499 **[Test build #73223 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/73223/testReport)** for PR 16499 at commit

[GitHub] spark pull request #16991: [SPARK-19594][Structured Streaming] StreamingQuer...

2017-02-21 Thread zsxwing
Github user zsxwing commented on a diff in the pull request: https://github.com/apache/spark/pull/16991#discussion_r102324213 --- Diff: sql/core/src/main/scala/org/apache/spark/sql/execution/streaming/StreamingQueryListenerBus.scala --- @@ -70,6 +70,10 @@ class

[GitHub] spark issue #16715: [Spark-18080][ML][PYTHON] Python API & Examples for Loca...

2017-02-21 Thread Yunni
Github user Yunni commented on the issue: https://github.com/apache/spark/pull/16715 Hi @e-m-m, I think the Python API will be included in Spark 2.2. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does

[GitHub] spark issue #16744: [SPARK-19405][STREAMING] Support for cross-account Kines...

2017-02-21 Thread budde
Github user budde commented on the issue: https://github.com/apache/spark/pull/16744 @brkyvz Anyone I can ping to help get this merged? The PR is going on a month old at this point and I know that lack of STS support is an issue that several interested parties would like to see get

[GitHub] spark issue #16970: [SPARK-19497][SS]Implement streaming deduplication

2017-02-21 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/16970 **[Test build #73236 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/73236/testReport)** for PR 16970 at commit

[GitHub] spark issue #16715: [Spark-18080][ML][PYTHON] Python API & Examples for Loca...

2017-02-21 Thread e-m-m
Github user e-m-m commented on the issue: https://github.com/apache/spark/pull/16715 Hey, super excited about this feature! Was actually thinking of writing this, myself, until I saw this. What version of Spark is this slated to hit the Python API? Thanks :) --- If your project is

[GitHub] spark issue #16989: [SPARK-19659] Fetch big blocks to disk when shuffle-read...

2017-02-21 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/16989 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/73224/ Test PASSed. ---

[GitHub] spark issue #16989: [SPARK-19659] Fetch big blocks to disk when shuffle-read...

2017-02-21 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/16989 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #16989: [SPARK-19659] Fetch big blocks to disk when shuffle-read...

2017-02-21 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/16989 **[Test build #73224 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/73224/testReport)** for PR 16989 at commit

[GitHub] spark issue #16715: [Spark-18080][ML][PYTHON] Python API & Examples for Loca...

2017-02-21 Thread eric-mccaleb
Github user eric-mccaleb commented on the issue: https://github.com/apache/spark/pull/16715 Hey, super excited about this feature! Was actually thinking of writing this, myself, until I saw this. What version of Spark is this slated to hit the Python API? Thanks :) --- If your

[GitHub] spark issue #16715: [Spark-18080][ML][PYTHON] Python API & Examples for Loca...

2017-02-21 Thread eric-mccaleb
Github user eric-mccaleb commented on the issue: https://github.com/apache/spark/pull/16715 Hey, super excited about this feature! Was actually thinking of writing this, myself, until I saw this. What version of Spark is this slated to hit the Python API? Thanks :) --- If your

[GitHub] spark issue #16905: [SPARK-19567][CORE][SCHEDULER] Support some Schedulable ...

2017-02-21 Thread erenavsarogullari
Github user erenavsarogullari commented on the issue: https://github.com/apache/spark/pull/16905 Many thanks @kayousterhout and @markhamstra. Also minor scala style issue is fixed with new patch. --- If your project is set up for it, you can reply to this email and have your

[GitHub] spark issue #16987: [SPARK-19633][SS] FileSource read from FileSink

2017-02-21 Thread marmbrus
Github user marmbrus commented on the issue: https://github.com/apache/spark/pull/16987 Thanks for working on this, however I'm not sure if we want to go with this approach. In Spark 2.2, I think we should consider deprecating the manifest files and instead use deterministic file

[GitHub] spark issue #17015: [SPARK-19678][SQL] remove MetastoreRelation

2017-02-21 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/17015 **[Test build #73235 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/73235/testReport)** for PR 17015 at commit

[GitHub] spark issue #17015: [SPARK-19678][SQL] remove MetastoreRelation

2017-02-21 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/17015 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #17015: [SPARK-19678][SQL] remove MetastoreRelation

2017-02-21 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/17015 **[Test build #73234 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/73234/testReport)** for PR 17015 at commit

[GitHub] spark issue #17015: [SPARK-19678][SQL] remove MetastoreRelation

2017-02-21 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/17015 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/73234/ Test FAILed. ---

[GitHub] spark issue #17015: [SPARK-19678][SQL] remove MetastoreRelation

2017-02-21 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/17015 **[Test build #73234 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/73234/testReport)** for PR 17015 at commit

[GitHub] spark issue #17015: [SPARK-19678][SQL] remove MetastoreRelation

2017-02-21 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/17015 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #17015: [SPARK-19678][SQL] remove MetastoreRelation

2017-02-21 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/17015 **[Test build #73233 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/73233/testReport)** for PR 17015 at commit

[GitHub] spark issue #17015: [SPARK-19678][SQL] remove MetastoreRelation

2017-02-21 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/17015 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/73233/ Test FAILed. ---

[GitHub] spark issue #17015: [SPARK-19678][SQL] remove MetastoreRelation

2017-02-21 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/17015 **[Test build #73233 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/73233/testReport)** for PR 17015 at commit

[GitHub] spark issue #16905: [SPARK-19567][CORE][SCHEDULER] Support some Schedulable ...

2017-02-21 Thread shaneknapp
Github user shaneknapp commented on the issue: https://github.com/apache/spark/pull/16905 nope, he's not in the admin list. i'll add him now. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have

[GitHub] spark issue #16905: [SPARK-19567][CORE][SCHEDULER] Support some Schedulable ...

2017-02-21 Thread markhamstra
Github user markhamstra commented on the issue: https://github.com/apache/spark/pull/16905 Thanks, Shane & Kay! --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and

[GitHub] spark issue #16905: [SPARK-19567][CORE][SCHEDULER] Support some Schedulable ...

2017-02-21 Thread kayousterhout
Github user kayousterhout commented on the issue: https://github.com/apache/spark/pull/16905 Awesome thanks Shane! --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and

[GitHub] spark issue #16905: [SPARK-19567][CORE][SCHEDULER] Support some Schedulable ...

2017-02-21 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/16905 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/73232/ Test FAILed. ---

[GitHub] spark issue #16905: [SPARK-19567][CORE][SCHEDULER] Support some Schedulable ...

2017-02-21 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/16905 **[Test build #73232 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/73232/testReport)** for PR 16905 at commit

[GitHub] spark issue #16905: [SPARK-19567][CORE][SCHEDULER] Support some Schedulable ...

2017-02-21 Thread kayousterhout
Github user kayousterhout commented on the issue: https://github.com/apache/spark/pull/16905 @shaneknapp is @markhamstra on the Jenkins whitelist? Wanted to double check since his attempt to trigger the build above didn't work --- If your project is set up for it, you can reply to

[GitHub] spark issue #16905: [SPARK-19567][CORE][SCHEDULER] Support some Schedulable ...

2017-02-21 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/16905 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #16977: [SPARK-19651][CORE] ParallelCollectionRDD.collect should...

2017-02-21 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/16977 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/73222/ Test FAILed. ---

[GitHub] spark issue #16977: [SPARK-19651][CORE] ParallelCollectionRDD.collect should...

2017-02-21 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/16977 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #16977: [SPARK-19651][CORE] ParallelCollectionRDD.collect should...

2017-02-21 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/16977 **[Test build #73222 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/73222/testReport)** for PR 16977 at commit

[GitHub] spark issue #16905: [SPARK-19567][CORE][SCHEDULER] Support some Schedulable ...

2017-02-21 Thread kayousterhout
Github user kayousterhout commented on the issue: https://github.com/apache/spark/pull/16905 @erenavsarogullari the reason this was happening on past PRs is that Imran and I weren't on the Jenkins whitelist (which neither of us realized -- and has since been fixed). I think Mark is

[GitHub] spark issue #16905: [SPARK-19567][CORE][SCHEDULER] Support some Schedulable ...

2017-02-21 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/16905 **[Test build #73232 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/73232/testReport)** for PR 16905 at commit

[GitHub] spark issue #16905: [SPARK-19567][CORE][SCHEDULER] Support some Schedulable ...

2017-02-21 Thread kayousterhout
Github user kayousterhout commented on the issue: https://github.com/apache/spark/pull/16905 Jenkins test this please --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and

[GitHub] spark issue #17017: [SPARK-19682][SparkR] Issue warning (or error) when subs...

2017-02-21 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/17017 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/73231/ Test FAILed. ---

[GitHub] spark issue #10405: [SPARK-12339] [WebUI] Added a null check that was remove...

2017-02-21 Thread Naresh523
Github user Naresh523 commented on the issue: https://github.com/apache/spark/pull/10405 I'm seeing similar logs errors [1] on spark v1.6.0. [1] https://issues.apache.org/jira/browse/SPARK-12339 --- If your project is set up for it, you can reply to this email and have your

[GitHub] spark issue #17017: [SPARK-19682][SparkR] Issue warning (or error) when subs...

2017-02-21 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/17017 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #17017: [SPARK-19682][SparkR] Issue warning (or error) when subs...

2017-02-21 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/17017 **[Test build #73231 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/73231/testReport)** for PR 17017 at commit

[GitHub] spark pull request #15770: [SPARK-15784][ML]:Add Power Iteration Clustering ...

2017-02-21 Thread wangmiao1981
Github user wangmiao1981 commented on a diff in the pull request: https://github.com/apache/spark/pull/15770#discussion_r102308292 --- Diff: mllib/src/main/scala/org/apache/spark/ml/clustering/PowerIterationClustering.scala --- @@ -0,0 +1,182 @@ +/* + * Licensed to the

[GitHub] spark issue #16905: [SPARK-19567][CORE][SCHEDULER] Support some Schedulable ...

2017-02-21 Thread erenavsarogullari
Github user erenavsarogullari commented on the issue: https://github.com/apache/spark/pull/16905 Thanks @markhamstra. I encounter the same problem in my every PR and tech-ops team helps to trigger Jenkins. Problem may be related with Github Jenkins PR Builder plugin.

[GitHub] spark issue #16944: [SPARK-19611][SQL] Introduce configurable table schema i...

2017-02-21 Thread budde
Github user budde commented on the issue: https://github.com/apache/spark/pull/16944 Pinging participants from #16797 once more to get any feedback on the new proposal: @gatorsmile, @viirya, @ericl, @mallman and @cloud-fan --- If your project is set up for it, you can reply to this

[GitHub] spark issue #16945: [SPARK-19616][SparkR]:weightCol and aggregationDepth sho...

2017-02-21 Thread wangmiao1981
Github user wangmiao1981 commented on the issue: https://github.com/apache/spark/pull/16945 @felixcheung I have made suggested changes. Thanks! --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not

[GitHub] spark issue #16970: [SPARK-19497][SS]Implement streaming deduplication

2017-02-21 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/16970 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #16970: [SPARK-19497][SS]Implement streaming deduplication

2017-02-21 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/16970 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/73225/ Test FAILed. ---

[GitHub] spark issue #16970: [SPARK-19497][SS]Implement streaming deduplication

2017-02-21 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/16970 **[Test build #73225 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/73225/testReport)** for PR 16970 at commit

[GitHub] spark pull request #17015: [SPARK-19678][SQL] remove MetastoreRelation

2017-02-21 Thread gatorsmile
Github user gatorsmile commented on a diff in the pull request: https://github.com/apache/spark/pull/17015#discussion_r102303660 --- Diff: sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/catalog/interface.scala --- @@ -349,36 +350,42 @@ object CatalogTypes {

[GitHub] spark issue #17017: [SPARK-19682][SparkR] Issue warning (or error) when subs...

2017-02-21 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/17017 **[Test build #73231 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/73231/testReport)** for PR 17017 at commit

[GitHub] spark pull request #17015: [SPARK-19678][SQL] remove MetastoreRelation

2017-02-21 Thread cloud-fan
Github user cloud-fan commented on a diff in the pull request: https://github.com/apache/spark/pull/17015#discussion_r102302366 --- Diff: sql/hive/src/main/scala/org/apache/spark/sql/hive/execution/HiveTableScanExec.scala --- @@ -138,27 +153,35 @@ case class HiveTableScanExec(

[GitHub] spark issue #16896: [SPARK-19561][Python] cast TimestampType.toInternal outp...

2017-02-21 Thread JasonMWhite
Github user JasonMWhite commented on the issue: https://github.com/apache/spark/pull/16896 Ping @davies --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or

[GitHub] spark pull request #17004: [SPARK-19670] [SQL] [TEST] Enable Bucketed Table ...

2017-02-21 Thread gatorsmile
Github user gatorsmile commented on a diff in the pull request: https://github.com/apache/spark/pull/17004#discussion_r102300022 --- Diff: sql/core/src/test/scala/org/apache/spark/sql/sources/BucketedWriteSuite.scala --- @@ -20,19 +20,29 @@ package org.apache.spark.sql.sources

[GitHub] spark pull request #16608: [SPARK-13721][SQL] Support outer generators in Da...

2017-02-21 Thread gatorsmile
Github user gatorsmile commented on a diff in the pull request: https://github.com/apache/spark/pull/16608#discussion_r102299867 --- Diff: sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/analysis/FunctionRegistry.scala --- @@ -163,9 +163,11 @@ object FunctionRegistry {

[GitHub] spark issue #16978: [SPARK-19652][UI] Do auth checks for REST API access.

2017-02-21 Thread squito
Github user squito commented on the issue: https://github.com/apache/spark/pull/16978 lgtm assuming tests pass --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes

[GitHub] spark issue #17004: [SPARK-19670] [SQL] [TEST] Enable Bucketed Table Reading...

2017-02-21 Thread tejasapatil
Github user tejasapatil commented on the issue: https://github.com/apache/spark/pull/17004 LGTM with a minor nit --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and

[GitHub] spark pull request #17004: [SPARK-19670] [SQL] [TEST] Enable Bucketed Table ...

2017-02-21 Thread tejasapatil
Github user tejasapatil commented on a diff in the pull request: https://github.com/apache/spark/pull/17004#discussion_r102298105 --- Diff: sql/core/src/test/scala/org/apache/spark/sql/sources/BucketedWriteSuite.scala --- @@ -20,19 +20,29 @@ package org.apache.spark.sql.sources

[GitHub] spark issue #17017: [SPARK-19682][SparkR] Issue warning (or error) when subs...

2017-02-21 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/17017 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #16938: [SPARK-19583][SQL]CTAS for data source table with a crea...

2017-02-21 Thread tejasapatil
Github user tejasapatil commented on the issue: https://github.com/apache/spark/pull/16938 @windpiger : - what does `throw exception(...)` mean ? Operation is supported OR not ? it might throw exception but the operation itself might have happened. - for 2nd point, you said

[GitHub] spark issue #16867: [SPARK-16929] Improve performance when check speculatabl...

2017-02-21 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/16867 **[Test build #73230 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/73230/testReport)** for PR 16867 at commit

[GitHub] spark issue #16978: [SPARK-19652][UI] Do auth checks for REST API access.

2017-02-21 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/16978 **[Test build #73229 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/73229/testReport)** for PR 16978 at commit

[GitHub] spark issue #17017: [SPARK-19682][SparkR] Issue warning (or error) when subs...

2017-02-21 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/17017 **[Test build #73228 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/73228/testReport)** for PR 17017 at commit

[GitHub] spark issue #17017: [SPARK-19682][SparkR] Issue warning (or error) when subs...

2017-02-21 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/17017 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/73228/ Test FAILed. ---

[GitHub] spark issue #16946: [SPARK-19554][UI,YARN] Allow SHS URL to be used for trac...

2017-02-21 Thread vanzin
Github user vanzin commented on the issue: https://github.com/apache/spark/pull/16946 trying to get some eyes on this: @squito --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #16867: [SPARK-16929] Improve performance when check speculatabl...

2017-02-21 Thread squito
Github user squito commented on the issue: https://github.com/apache/spark/pull/16867 Jenkins, ok to test --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so,

[GitHub] spark pull request #16867: [SPARK-16929] Improve performance when check spec...

2017-02-21 Thread squito
Github user squito commented on a diff in the pull request: https://github.com/apache/spark/pull/16867#discussion_r102292628 --- Diff: core/src/main/scala/org/apache/spark/scheduler/TaskSetManager.scala --- @@ -137,6 +137,12 @@ private[spark] class TaskSetManager( // Task

[GitHub] spark issue #17017: [SPARK-19682][SparkR] Issue warning (or error) when subs...

2017-02-21 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/17017 **[Test build #73228 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/73228/testReport)** for PR 17017 at commit

[GitHub] spark pull request #16867: [SPARK-16929] Improve performance when check spec...

2017-02-21 Thread squito
Github user squito commented on a diff in the pull request: https://github.com/apache/spark/pull/16867#discussion_r102292835 --- Diff: core/src/main/scala/org/apache/spark/scheduler/TaskSetManager.scala --- @@ -911,14 +916,14 @@ private[spark] class TaskSetManager(

[GitHub] spark pull request #16867: [SPARK-16929] Improve performance when check spec...

2017-02-21 Thread squito
Github user squito commented on a diff in the pull request: https://github.com/apache/spark/pull/16867#discussion_r102293021 --- Diff: core/src/main/scala/org/apache/spark/scheduler/TaskSetManager.scala --- @@ -911,14 +916,14 @@ private[spark] class TaskSetManager(

[GitHub] spark pull request #15125: [SPARK-5484][GraphX] Periodically do checkpoint i...

2017-02-21 Thread dding3
Github user dding3 commented on a diff in the pull request: https://github.com/apache/spark/pull/15125#discussion_r102294384 --- Diff: docs/graphx-programming-guide.md --- @@ -708,7 +708,9 @@ messages remaining. > messaging function. These constraints allow additional

[GitHub] spark pull request #16499: [SPARK-17204][CORE] Fix replicated off heap stora...

2017-02-21 Thread sameeragarwal
Github user sameeragarwal commented on a diff in the pull request: https://github.com/apache/spark/pull/16499#discussion_r102289626 --- Diff: core/src/main/scala/org/apache/spark/storage/BlockManager.scala --- @@ -1018,7 +1025,9 @@ private[spark] class BlockManager(

[GitHub] spark pull request #16499: [SPARK-17204][CORE] Fix replicated off heap stora...

2017-02-21 Thread mallman
Github user mallman commented on a diff in the pull request: https://github.com/apache/spark/pull/16499#discussion_r102293681 --- Diff: core/src/main/scala/org/apache/spark/storage/BlockManager.scala --- @@ -317,6 +317,9 @@ private[spark] class BlockManager( /**

[GitHub] spark pull request #16499: [SPARK-17204][CORE] Fix replicated off heap stora...

2017-02-21 Thread mallman
Github user mallman commented on a diff in the pull request: https://github.com/apache/spark/pull/16499#discussion_r102293219 --- Diff: core/src/main/scala/org/apache/spark/storage/BlockManager.scala --- @@ -843,7 +852,15 @@ private[spark] class BlockManager(

[GitHub] spark pull request #15125: [SPARK-5484][GraphX] Periodically do checkpoint i...

2017-02-21 Thread mallman
Github user mallman commented on a diff in the pull request: https://github.com/apache/spark/pull/15125#discussion_r102292537 --- Diff: graphx/src/main/scala/org/apache/spark/graphx/Pregel.scala --- @@ -122,27 +125,39 @@ object Pregel extends Logging {

[GitHub] spark issue #17017: [SPARK-19682][SparkR] Issue warning (or error) when subs...

2017-02-21 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/17017 **[Test build #73227 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/73227/testReport)** for PR 17017 at commit

[GitHub] spark issue #17017: [SPARK-19682][SparkR] Issue warning (or error) when subs...

2017-02-21 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/17017 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/73227/ Test FAILed. ---

[GitHub] spark issue #17017: [SPARK-19682][SparkR] Issue warning (or error) when subs...

2017-02-21 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/17017 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #17017: [SPARK-19682][SparkR] Issue warning (or error) when subs...

2017-02-21 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/17017 **[Test build #73227 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/73227/testReport)** for PR 17017 at commit

[GitHub] spark issue #17017: [SPARK-19682][SparkR] Issue warning (or error) when subs...

2017-02-21 Thread actuaryzhang
Github user actuaryzhang commented on the issue: https://github.com/apache/spark/pull/17017 @felixcheung Simple example to illustrate this ``` df <- suppressWarnings(createDataFrame(iris)) df[[1:2]] ``` Instead of issuing warning and taking the first element,

[GitHub] spark pull request #15125: [SPARK-5484][GraphX] Periodically do checkpoint i...

2017-02-21 Thread mallman
Github user mallman commented on a diff in the pull request: https://github.com/apache/spark/pull/15125#discussion_r102290972 --- Diff: docs/graphx-programming-guide.md --- @@ -708,7 +708,9 @@ messages remaining. > messaging function. These constraints allow additional

<    1   2   3   4   5   6   >