[jira] [Assigned] (SPARK-16691) move BucketSpec to catalyst module and use it in CatalogTable

2016-07-23 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16691?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-16691: Assignee: Apache Spark (was: Wenchen Fan) > move BucketSpec to catalyst module and use

[jira] [Commented] (SPARK-16691) move BucketSpec to catalyst module and use it in CatalogTable

2016-07-23 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16691?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15390947#comment-15390947 ] Apache Spark commented on SPARK-16691: -- User 'cloud-fan' has created a pull request for this issue:

[jira] [Assigned] (SPARK-16691) move BucketSpec to catalyst module and use it in CatalogTable

2016-07-23 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16691?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-16691: Assignee: Wenchen Fan (was: Apache Spark) > move BucketSpec to catalyst module and use

[jira] [Commented] (SPARK-16693) Remove R deprecated methods

2016-07-23 Thread Mark Hamstra (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16693?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15390865#comment-15390865 ] Mark Hamstra commented on SPARK-16693: -- The 2.1.0 release is the very earliest that we can allow

[jira] [Commented] (SPARK-16693) Remove R deprecated methods

2016-07-23 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16693?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15390857#comment-15390857 ] Apache Spark commented on SPARK-16693: -- User 'felixcheung' has created a pull request for this

[jira] [Assigned] (SPARK-16693) Remove R deprecated methods

2016-07-23 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16693?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-16693: Assignee: (was: Apache Spark) > Remove R deprecated methods >

[jira] [Assigned] (SPARK-16693) Remove R deprecated methods

2016-07-23 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16693?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-16693: Assignee: Apache Spark > Remove R deprecated methods > --- > >

[jira] [Created] (SPARK-16693) Remove R deprecated methods

2016-07-23 Thread Felix Cheung (JIRA)
Felix Cheung created SPARK-16693: Summary: Remove R deprecated methods Key: SPARK-16693 URL: https://issues.apache.org/jira/browse/SPARK-16693 Project: Spark Issue Type: Bug

[jira] [Commented] (SPARK-16611) Expose several hidden DataFrame/RDD functions

2016-07-23 Thread Felix Cheung (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16611?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15390856#comment-15390856 ] Felix Cheung commented on SPARK-16611: -- where are we on this? I'm working on removing the RDD

[jira] [Resolved] (SPARK-8871) Add maximal frequent itemsets filter in Spark MLib FPGrowth

2016-07-23 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8871?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-8871. -- Resolution: Duplicate > Add maximal frequent itemsets filter in Spark MLib FPGrowth >

[jira] [Commented] (SPARK-8871) Add maximal frequent itemsets filter in Spark MLib FPGrowth

2016-07-23 Thread Jonathan Svirsky (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8871?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15390841#comment-15390841 ] Jonathan Svirsky commented on SPARK-8871: - Hi Sean, You are right. The main idea under the

[jira] [Commented] (SPARK-8871) Add maximal frequent itemsets filter in Spark MLib FPGrowth

2016-07-23 Thread Jonathan Svirsky (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8871?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15390840#comment-15390840 ] Jonathan Svirsky commented on SPARK-8871: - An item set is maximal if it is frequent, but none of

[jira] [Commented] (SPARK-13979) Killed executor is respawned without AWS keys in standalone spark cluster

2016-07-23 Thread Mitesh (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13979?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15390833#comment-15390833 ] Mitesh commented on SPARK-13979: Yeah that sounds like it. We worked around it by adding

[jira] [Commented] (SPARK-13979) Killed executor is respawned without AWS keys in standalone spark cluster

2016-07-23 Thread Luciano Resende (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13979?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15390831#comment-15390831 ] Luciano Resende commented on SPARK-13979: - This scenario usually happens when you pass specific

[jira] [Updated] (SPARK-16690) rename SQLTestUtils.withTempTable to withTempView

2016-07-23 Thread Reynold Xin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16690?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin updated SPARK-16690: Fix Version/s: 2.0.1 > rename SQLTestUtils.withTempTable to withTempView >

[jira] [Resolved] (SPARK-16380) Update SQL examples and programming guide for Python language binding

2016-07-23 Thread Reynold Xin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16380?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin resolved SPARK-16380. - Resolution: Fixed Fix Version/s: 2.1.0 2.0.1 > Update SQL examples and

[jira] [Resolved] (SPARK-16690) rename SQLTestUtils.withTempTable to withTempView

2016-07-23 Thread Reynold Xin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16690?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin resolved SPARK-16690. - Resolution: Fixed Fix Version/s: 2.1.0 > rename SQLTestUtils.withTempTable to

[jira] [Comment Edited] (SPARK-16441) Spark application hang when dynamic allocation is enabled

2016-07-23 Thread cen yuhai (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16441?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15390615#comment-15390615 ] cen yuhai edited comment on SPARK-16441 at 7/23/16 4:09 PM: Applications

[jira] [Resolved] (SPARK-16662) The HiveContext deprecate warning in python always shown even if do not use HiveContext

2016-07-23 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16662?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-16662. --- Resolution: Fixed Fix Version/s: 2.1.0 Issue resolved by pull request 14301

[jira] [Updated] (SPARK-16662) The HiveContext deprecate warning in python always shown even if do not use HiveContext

2016-07-23 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16662?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-16662: -- Assignee: Weichen Xu Affects Version/s: (was: 2.0.1) (was:

[jira] [Updated] (SPARK-16561) Potential numerial problem in MultivariateOnlineSummarizer min/max

2016-07-23 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16561?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-16561: -- Assignee: Weichen Xu > Potential numerial problem in MultivariateOnlineSummarizer min/max >

[jira] [Updated] (SPARK-16561) Potential numerial problem in MultivariateOnlineSummarizer min/max

2016-07-23 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16561?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-16561: -- Affects Version/s: (was: 2.0.1) (was: 2.1.0) > Potential numerial

[jira] [Resolved] (SPARK-16561) Potential numerial problem in MultivariateOnlineSummarizer min/max

2016-07-23 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16561?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-16561. --- Resolution: Fixed Fix Version/s: 2.1.0 Issue resolved by pull request 14216

[jira] [Commented] (SPARK-16688) OpenHashSet.MAX_CAPACITY is always based on Int even when using Long

2016-07-23 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16688?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15390659#comment-15390659 ] Sean Owen commented on SPARK-16688: --- I don't think that's a design goal, no. This is an internal Spark

[jira] [Assigned] (SPARK-16686) Dataset.sample with seed: result seems to depend on downstream usage

2016-07-23 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16686?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-16686: Assignee: Apache Spark > Dataset.sample with seed: result seems to depend on downstream

[jira] [Assigned] (SPARK-16686) Dataset.sample with seed: result seems to depend on downstream usage

2016-07-23 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16686?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-16686: Assignee: (was: Apache Spark) > Dataset.sample with seed: result seems to depend on

[jira] [Commented] (SPARK-16686) Dataset.sample with seed: result seems to depend on downstream usage

2016-07-23 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16686?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15390650#comment-15390650 ] Apache Spark commented on SPARK-16686: -- User 'viirya' has created a pull request for this issue:

[jira] [Commented] (SPARK-11976) Support "." character in DataFrame column name

2016-07-23 Thread rerngvit yanggratoke (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11976?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15390635#comment-15390635 ] rerngvit yanggratoke commented on SPARK-11976: -- We need to have support in the Spark Core

[jira] [Commented] (SPARK-16441) Spark application hang when dynamic allocation is enabled

2016-07-23 Thread cen yuhai (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16441?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15390615#comment-15390615 ] cen yuhai commented on SPARK-16441: --- Some applications which runs a long time like spark thriftServer

[jira] [Comment Edited] (SPARK-16441) Spark application hang when dynamic allocation is enabled

2016-07-23 Thread cen yuhai (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16441?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15390602#comment-15390602 ] cen yuhai edited comment on SPARK-16441 at 7/23/16 7:49 AM: No, it is a

[jira] [Commented] (SPARK-16441) Spark application hang when dynamic allocation is enabled

2016-07-23 Thread cen yuhai (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16441?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15390602#comment-15390602 ] cen yuhai commented on SPARK-16441: --- No, it is a complicated problem. I also find that when some

[jira] [Comment Edited] (SPARK-16441) Spark application hang when dynamic allocation is enabled

2016-07-23 Thread cen yuhai (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16441?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15390602#comment-15390602 ] cen yuhai edited comment on SPARK-16441 at 7/23/16 7:49 AM: No, it is a

[jira] [Assigned] (SPARK-3181) Add Robust Regression Algorithm with Huber Estimator

2016-07-23 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-3181?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-3181: --- Assignee: Yanbo Liang (was: Apache Spark) > Add Robust Regression Algorithm with Huber

[jira] [Commented] (SPARK-3181) Add Robust Regression Algorithm with Huber Estimator

2016-07-23 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-3181?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15390588#comment-15390588 ] Apache Spark commented on SPARK-3181: - User 'yanboliang' has created a pull request for this issue:

[jira] [Assigned] (SPARK-3181) Add Robust Regression Algorithm with Huber Estimator

2016-07-23 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-3181?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-3181: --- Assignee: Apache Spark (was: Yanbo Liang) > Add Robust Regression Algorithm with Huber

[jira] [Commented] (SPARK-2183) Avoid loading/shuffling data twice in self-join query

2016-07-23 Thread Emma Tang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-2183?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15390586#comment-15390586 ] Emma Tang commented on SPARK-2183: -- [~khussein] You're right, it does not load from source (s3) the

[jira] [Assigned] (SPARK-16692) multilabel classification to DataFrame, ML

2016-07-23 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16692?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-16692: Assignee: Apache Spark > multilabel classification to DataFrame, ML >

[jira] [Assigned] (SPARK-16692) multilabel classification to DataFrame, ML

2016-07-23 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16692?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-16692: Assignee: (was: Apache Spark) > multilabel classification to DataFrame, ML >

[jira] [Commented] (SPARK-16692) multilabel classification to DataFrame, ML

2016-07-23 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16692?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15390576#comment-15390576 ] Apache Spark commented on SPARK-16692: -- User 'liwzhi' has created a pull request for this issue: