[jira] [Assigned] (SPARK-15672) R programming guide update

2016-06-14 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15672?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-15672: Assignee: Apache Spark > R programming guide update > -- > >

[jira] [Commented] (SPARK-15672) R programming guide update

2016-06-14 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15672?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15329236#comment-15329236 ] Apache Spark commented on SPARK-15672: -- User 'vectorijk' has created a pull request

[jira] [Commented] (SPARK-15919) DStream "saveAsTextFile" doesn't update the prefix after each checkpoint

2016-06-14 Thread Aamir Abbas (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15919?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15329212#comment-15329212 ] Aamir Abbas commented on SPARK-15919: - Thank you for the response. If I generate new

[jira] [Updated] (SPARK-15941) Netty RPC implementation ignores the executor bind address

2016-06-14 Thread Marco Capuccini (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15941?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Marco Capuccini updated SPARK-15941: Summary: Netty RPC implementation ignores the executor bind address (was: Spark executor a

[jira] [Created] (SPARK-15941) Spark executor address always bind to IP address when using Netty RPC implementation

2016-06-14 Thread Marco Capuccini (JIRA)
Marco Capuccini created SPARK-15941: --- Summary: Spark executor address always bind to IP address when using Netty RPC implementation Key: SPARK-15941 URL: https://issues.apache.org/jira/browse/SPARK-15941

[jira] [Commented] (SPARK-15919) DStream "saveAsTextFile" doesn't update the prefix after each checkpoint

2016-06-14 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15919?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15329209#comment-15329209 ] Sean Owen commented on SPARK-15919: --- This is still wrong because you establish the path

[jira] [Comment Edited] (SPARK-15919) DStream "saveAsTextFile" doesn't update the prefix after each checkpoint

2016-06-14 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15919?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15329201#comment-15329201 ] Sean Owen edited comment on SPARK-15919 at 6/14/16 9:54 AM: H

[jira] [Comment Edited] (SPARK-15919) DStream "saveAsTextFile" doesn't update the prefix after each checkpoint

2016-06-14 Thread Aamir Abbas (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15919?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15329201#comment-15329201 ] Aamir Abbas edited comment on SPARK-15919 at 6/14/16 9:49 AM: -

[jira] [Commented] (SPARK-15919) DStream "saveAsTextFile" doesn't update the prefix after each checkpoint

2016-06-14 Thread Aamir Abbas (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15919?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15329201#comment-15329201 ] Aamir Abbas commented on SPARK-15919: - Here's the updated code, after using foreachRD

[jira] [Commented] (SPARK-15937) Spark declares a succeeding job to be failed in yarn-cluster mode if the job takes very small time (~ < 10 seconds) to finish

2016-06-14 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15937?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15329108#comment-15329108 ] Apache Spark commented on SPARK-15937: -- User 'subrotosanyal' has created a pull requ

[jira] [Resolved] (SPARK-15936) CLONE - Add class weights to Random Forest

2016-06-14 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15936?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-15936. --- Resolution: Duplicate > CLONE - Add class weights to Random Forest >

[jira] [Commented] (SPARK-15930) Add Row count property to FPGrowth model

2016-06-14 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15930?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15329087#comment-15329087 ] Sean Owen commented on SPARK-15930: --- Yes, you already have that information, but I can

[jira] [Resolved] (SPARK-15940) Simultaneous multiple spark context with different kerberos FID credentials from within one id

2016-06-14 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15940?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-15940. --- Resolution: Not A Problem Multiple Spark contexts are not supported. > Simultaneous multiple spark c

[jira] [Closed] (SPARK-15919) DStream "saveAsTextFile" doesn't update the prefix after each checkpoint

2016-06-14 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15919?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen closed SPARK-15919. - > DStream "saveAsTextFile" doesn't update the prefix after each checkpoint >

[jira] [Commented] (SPARK-15930) Add Row count property to FPGrowth model

2016-06-14 Thread Jeff Zhang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15930?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15329074#comment-15329074 ] Jeff Zhang commented on SPARK-15930: I see, I guess you are trying to get the total n

[jira] [Commented] (SPARK-15930) Add Row count property to FPGrowth model

2016-06-14 Thread yuhao yang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15930?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15329072#comment-15329072 ] yuhao yang commented on SPARK-15930: We need the size of input dataset to calculate r

[jira] [Resolved] (SPARK-15919) DStream "saveAsTextFile" doesn't update the prefix after each checkpoint

2016-06-14 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15919?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-15919. --- Resolution: Not A Problem Do _not_ reopen this JIRA. You would only do so if the conversation has me

[jira] [Commented] (SPARK-15930) Add Row count property to FPGrowth model

2016-06-14 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15930?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15329063#comment-15329063 ] Sean Owen commented on SPARK-15930: --- The sum of all frequencies from freqItemSets is no

[jira] [Commented] (SPARK-15930) Add Row count property to FPGrowth model

2016-06-14 Thread Jeff Zhang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15930?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15329059#comment-15329059 ] Jeff Zhang commented on SPARK-15930: Don't we can get the count from freqItemsets in

[jira] [Commented] (SPARK-15802) SparkSQL connection fail using shell command "bin/beeline -u "jdbc:hive2://*.*.*.*:10000/default""

2016-06-14 Thread marymwu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15802?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15329051#comment-15329051 ] marymwu commented on SPARK-15802: - We still have a question. How to use "binary" protocol

[jira] [Commented] (SPARK-12177) Update KafkaDStreams to new Kafka 0.10 Consumer API

2016-06-14 Thread Ismael Juma (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12177?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15329044#comment-15329044 ] Ismael Juma commented on SPARK-12177: - {quote} b) the real benefit is security - I am

[jira] [Reopened] (SPARK-15919) DStream "saveAsTextFile" doesn't update the prefix after each checkpoint

2016-06-14 Thread Aamir Abbas (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15919?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Aamir Abbas reopened SPARK-15919: - I tried the solution you mentioned. It didn't work. I applied foreachRDD, and added a random number

[jira] [Commented] (SPARK-15930) Add Row count property to FPGrowth model

2016-06-14 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15930?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15329025#comment-15329025 ] Sean Owen commented on SPARK-15930: --- What's the use case for this? the FP growth output

[jira] [Commented] (SPARK-15345) SparkSession's conf doesn't take effect when there's already an existing SparkContext

2016-06-14 Thread Piotr Milanowski (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15345?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15329023#comment-15329023 ] Piotr Milanowski commented on SPARK-15345: -- [~hvanhovell] Thanks, I corrected it

[jira] [Assigned] (SPARK-15939) Clarify ml.linalg usage

2016-06-14 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15939?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-15939: Assignee: (was: Apache Spark) > Clarify ml.linalg usage > --- > >

[jira] [Assigned] (SPARK-15939) Clarify ml.linalg usage

2016-06-14 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15939?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-15939: Assignee: Apache Spark > Clarify ml.linalg usage > --- > >

[jira] [Commented] (SPARK-15939) Clarify ml.linalg usage

2016-06-14 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15939?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15329024#comment-15329024 ] Apache Spark commented on SPARK-15939: -- User 'zhengruifeng' has created a pull reque

[jira] [Updated] (SPARK-15939) Clarify ml.linalg usage

2016-06-14 Thread zhengruifeng (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15939?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] zhengruifeng updated SPARK-15939: - Description: 1, update comments in {{pyspark.ml}} that it use {{ml.linalg}} not {{mllib.linalg}}

[jira] [Created] (SPARK-15940) Simultaneous multiple spark context with different kerberos FID credentials from within one id

2016-06-14 Thread Partha Pratim Ghosh (JIRA)
Partha Pratim Ghosh created SPARK-15940: --- Summary: Simultaneous multiple spark context with different kerberos FID credentials from within one id Key: SPARK-15940 URL: https://issues.apache.org/jira/browse/S

[jira] [Updated] (SPARK-15939) Clarify ml.linalg usage

2016-06-14 Thread zhengruifeng (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15939?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] zhengruifeng updated SPARK-15939: - Description: 1, update comments in {{pyspark.ml}} that it use {ml.linalg} not {mllib.linalg} 2, r

[jira] [Comment Edited] (SPARK-15345) SparkSession's conf doesn't take effect when there's already an existing SparkContext

2016-06-14 Thread Piotr Milanowski (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15345?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15327152#comment-15327152 ] Piotr Milanowski edited comment on SPARK-15345 at 6/14/16 7:34 AM:

[jira] [Created] (SPARK-15939) Clarify ml.linalg usage

2016-06-14 Thread zhengruifeng (JIRA)
zhengruifeng created SPARK-15939: Summary: Clarify ml.linalg usage Key: SPARK-15939 URL: https://issues.apache.org/jira/browse/SPARK-15939 Project: Spark Issue Type: Improvement Com

[jira] [Comment Edited] (SPARK-15345) SparkSession's conf doesn't take effect when there's already an existing SparkContext

2016-06-14 Thread Piotr Milanowski (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15345?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15327152#comment-15327152 ] Piotr Milanowski edited comment on SPARK-15345 at 6/14/16 7:32 AM:

[jira] [Assigned] (SPARK-15938) Adding "support" property to MLlib Association Rule

2016-06-14 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15938?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-15938: Assignee: Apache Spark > Adding "support" property to MLlib Association Rule > ---

[jira] [Assigned] (SPARK-15938) Adding "support" property to MLlib Association Rule

2016-06-14 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15938?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-15938: Assignee: (was: Apache Spark) > Adding "support" property to MLlib Association Rule >

[jira] [Commented] (SPARK-15938) Adding "support" property to MLlib Association Rule

2016-06-14 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15938?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15329009#comment-15329009 ] Apache Spark commented on SPARK-15938: -- User 'hhbyyh' has created a pull request for

[jira] [Created] (SPARK-15938) Adding "support" property to MLlib Association Rule

2016-06-14 Thread yuhao yang (JIRA)
yuhao yang created SPARK-15938: -- Summary: Adding "support" property to MLlib Association Rule Key: SPARK-15938 URL: https://issues.apache.org/jira/browse/SPARK-15938 Project: Spark Issue Type: I

[jira] [Updated] (SPARK-15937) Spark declares a succeeding job to be failed in yarn-cluster mode if the job takes very small time (~ < 10 seconds) to finish

2016-06-14 Thread Subroto Sanyal (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15937?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Subroto Sanyal updated SPARK-15937: --- Description: h5. Problem: Spark Job fails in yarn-cluster mode if the job takes less time tha

[jira] [Updated] (SPARK-15937) Spark declares a succeeding job to be failed in yarn-cluster mode if the job takes very small time (~ < 10 seconds) to finish

2016-06-14 Thread Subroto Sanyal (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15937?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Subroto Sanyal updated SPARK-15937: --- Priority: Critical (was: Major) > Spark declares a succeeding job to be failed in yarn-clust

<    1   2   3