[jira] [Commented] (SPARK-18125) Spark generated code causes CompileException when groupByKey, reduceGroups and map(_._2) are used

2016-10-31 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-18125?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15621681#comment-15621681 ] Apache Spark commented on SPARK-18125: -- User 'viirya' has created a pull request for

[jira] [Assigned] (SPARK-18125) Spark generated code causes CompileException when groupByKey, reduceGroups and map(_._2) are used

2016-10-31 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-18125?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-18125: Assignee: Apache Spark > Spark generated code causes CompileException when groupByKey, red

[jira] [Assigned] (SPARK-18125) Spark generated code causes CompileException when groupByKey, reduceGroups and map(_._2) are used

2016-10-31 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-18125?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-18125: Assignee: (was: Apache Spark) > Spark generated code causes CompileException when grou

[jira] [Commented] (SPARK-18112) Spark2.x does not support read data from Hive 2.x metastore

2016-10-31 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-18112?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15621678#comment-15621678 ] Sean Owen commented on SPARK-18112: --- Yes, this may be an instance where Hive 2 will hav

[jira] [Commented] (SPARK-18177) Add missing 'subsamplingRate' of pyspark GBTClassifier

2016-10-31 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-18177?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15621651#comment-15621651 ] Apache Spark commented on SPARK-18177: -- User 'zhengruifeng' has created a pull reque

[jira] [Assigned] (SPARK-18177) Add missing 'subsamplingRate' of pyspark GBTClassifier

2016-10-31 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-18177?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-18177: Assignee: Apache Spark > Add missing 'subsamplingRate' of pyspark GBTClassifier >

[jira] [Assigned] (SPARK-18177) Add missing 'subsamplingRate' of pyspark GBTClassifier

2016-10-31 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-18177?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-18177: Assignee: (was: Apache Spark) > Add missing 'subsamplingRate' of pyspark GBTClassifier

[jira] [Created] (SPARK-18177) Add missing 'subsamplingRate' of pyspark GBTClassifier

2016-10-31 Thread zhengruifeng (JIRA)
zhengruifeng created SPARK-18177: Summary: Add missing 'subsamplingRate' of pyspark GBTClassifier Key: SPARK-18177 URL: https://issues.apache.org/jira/browse/SPARK-18177 Project: Spark Issue

[jira] [Updated] (SPARK-18160) SparkContext.addFile doesn't work in yarn-cluster mode

2016-10-31 Thread Jeff Zhang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-18160?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jeff Zhang updated SPARK-18160: --- Description: The following command will fails for spark 2.0 {noformat} bin/spark-submit --class org.a

[jira] [Commented] (SPARK-17935) Add KafkaForeachWriter in external kafka-0.8.0 for structured streaming module

2016-10-31 Thread zhangxinyu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-17935?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15621603#comment-15621603 ] zhangxinyu commented on SPARK-17935: Could you please take a look at current kafka si

[jira] [Comment Edited] (SPARK-17935) Add KafkaForeachWriter in external kafka-0.8.0 for structured streaming module

2016-10-31 Thread zhangxinyu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-17935?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15601778#comment-15601778 ] zhangxinyu edited comment on SPARK-17935 at 10/31/16 8:25 AM: -

[jira] [Updated] (SPARK-18160) SparkContext.addFile doesn't work in yarn-cluster mode

2016-10-31 Thread Jeff Zhang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-18160?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jeff Zhang updated SPARK-18160: --- Description: The following command will fails for spark 2.0 {noformat} bin/spark-submit --class org.a

[jira] [Updated] (SPARK-18160) SparkContext.addFile doesn't work in yarn-cluster mode

2016-10-31 Thread Jeff Zhang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-18160?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jeff Zhang updated SPARK-18160: --- Description: {noformat} bin/spark-submit --class org.apache.spark.examples.SparkPi --master yarn-clu

[jira] [Comment Edited] (SPARK-17935) Add KafkaForeachWriter in external kafka-0.8.0 for structured streaming module

2016-10-31 Thread zhangxinyu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-17935?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15601778#comment-15601778 ] zhangxinyu edited comment on SPARK-17935 at 10/31/16 8:04 AM: -

[jira] [Comment Edited] (SPARK-17935) Add KafkaForeachWriter in external kafka-0.8.0 for structured streaming module

2016-10-31 Thread zhangxinyu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-17935?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15601778#comment-15601778 ] zhangxinyu edited comment on SPARK-17935 at 10/31/16 8:03 AM: -

[jira] [Comment Edited] (SPARK-17935) Add KafkaForeachWriter in external kafka-0.8.0 for structured streaming module

2016-10-31 Thread zhangxinyu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-17935?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15601778#comment-15601778 ] zhangxinyu edited comment on SPARK-17935 at 10/31/16 7:59 AM: -

[jira] [Comment Edited] (SPARK-17935) Add KafkaForeachWriter in external kafka-0.8.0 for structured streaming module

2016-10-31 Thread zhangxinyu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-17935?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15601778#comment-15601778 ] zhangxinyu edited comment on SPARK-17935 at 10/31/16 7:54 AM: -

[jira] [Comment Edited] (SPARK-17935) Add KafkaForeachWriter in external kafka-0.8.0 for structured streaming module

2016-10-31 Thread zhangxinyu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-17935?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15601778#comment-15601778 ] zhangxinyu edited comment on SPARK-17935 at 10/31/16 7:53 AM: -

[jira] [Commented] (SPARK-17935) Add KafkaForeachWriter in external kafka-0.8.0 for structured streaming module

2016-10-31 Thread zhangxinyu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-17935?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15621541#comment-15621541 ] zhangxinyu commented on SPARK-17935: Thanks Cody Koeninger! Here is my opinion: * Ka

<    1   2