[jira] [Commented] (SPARK-11381) Replace example code in mllib-linear-methods.md using include_example

2015-10-29 Thread Pravin Gadakh (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11381?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14980419#comment-14980419 ] Pravin Gadakh commented on SPARK-11381: --- We should make this jira dependent upon [

[jira] [Updated] (SPARK-11322) Keep full stack track in captured exception in PySpark

2015-10-29 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11322?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-11322: -- Assignee: Liang-Chi Hsieh > Keep full stack track in captured exception in PySpark > --

[jira] [Updated] (SPARK-11370) fix a bug in GroupedIterator and create unit test for it

2015-10-29 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11370?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-11370: -- Assignee: Wenchen Fan > fix a bug in GroupedIterator and create unit test for it >

[jira] [Updated] (SPARK-11303) sample (without replacement) + filter returns wrong results in DataFrame

2015-10-29 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11303?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-11303: -- Assignee: Yanbo Liang > sample (without replacement) + filter returns wrong results in DataFrame >

[jira] [Updated] (SPARK-11379) ExpressionEncoder can't handle top level primitive type correctly

2015-10-29 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11379?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-11379: -- Assignee: Wenchen Fan > ExpressionEncoder can't handle top level primitive type correctly > ---

[jira] [Updated] (SPARK-11270) Add improved equality testing for TopicAndPartition from the Kafka Streaming API

2015-10-29 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11270?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-11270: -- Assignee: Nick Evans > Add improved equality testing for TopicAndPartition from the Kafka Streaming >

[jira] [Commented] (SPARK-11326) Split networking in standalone mode

2015-10-29 Thread Jacek Lewandowski (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11326?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14980383#comment-14980383 ] Jacek Lewandowski commented on SPARK-11326: --- [~vanzin] I'll really appreciate i

[jira] [Updated] (SPARK-11326) Split networking in standalone mode

2015-10-29 Thread Jacek Lewandowski (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11326?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jacek Lewandowski updated SPARK-11326: -- Description: h3.The idea Currently, in standalone mode, all components, for all networ

[jira] [Commented] (SPARK-11330) Filter operation on StringType after groupBy PERSISTED brings no results

2015-10-29 Thread Saif Addin Ellafi (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11330?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14980372#comment-14980372 ] Saif Addin Ellafi commented on SPARK-11330: --- Thank you. I cannot test master ri

[jira] [Updated] (SPARK-11401) PMML export for Logistic Regression Multiclass Classification

2015-10-29 Thread Vincenzo Selvaggio (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11401?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vincenzo Selvaggio updated SPARK-11401: --- Description: tvmanikandan requested on https://github.com/apache/spark/pull/3062 mul

[jira] [Assigned] (SPARK-11383) Replace example code in mllib-naive-bayes.md/mllib-isotonic-regression.md using include_example

2015-10-29 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11383?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-11383: Assignee: Apache Spark > Replace example code in mllib-naive-bayes.md/mllib-isotonic-regre

[jira] [Commented] (SPARK-11383) Replace example code in mllib-naive-bayes.md/mllib-isotonic-regression.md using include_example

2015-10-29 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11383?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14980320#comment-14980320 ] Apache Spark commented on SPARK-11383: -- User 'rishabhbhardwaj' has created a pull re

[jira] [Created] (SPARK-11401) PMML export for Logistic Regression Multiclass Classification

2015-10-29 Thread Vincenzo Selvaggio (JIRA)
Vincenzo Selvaggio created SPARK-11401: -- Summary: PMML export for Logistic Regression Multiclass Classification Key: SPARK-11401 URL: https://issues.apache.org/jira/browse/SPARK-11401 Project: Sp

[jira] [Assigned] (SPARK-11383) Replace example code in mllib-naive-bayes.md/mllib-isotonic-regression.md using include_example

2015-10-29 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11383?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-11383: Assignee: (was: Apache Spark) > Replace example code in mllib-naive-bayes.md/mllib-iso

[jira] [Updated] (SPARK-7970) Optimize code for SQL queries fired on Union of RDDs (closure cleaner)

2015-10-29 Thread Andrew Or (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7970?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or updated SPARK-7970: - Assignee: Nitin Goyal Target Version/s: 1.6.0 > Optimize code for SQL queries fired on Union o

[jira] [Updated] (SPARK-10986) ClassNotFoundException when running on Client mode, with a Mesos master.

2015-10-29 Thread Andrew Or (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10986?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or updated SPARK-10986: -- Affects Version/s: 1.5.2 Target Version/s: 1.6.0 > ClassNotFoundException when running on Client m

[jira] [Updated] (SPARK-8582) Optimize checkpointing to avoid computing an RDD twice

2015-10-29 Thread Andrew Or (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8582?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or updated SPARK-8582: - Assignee: Shixiong Zhu Target Version/s: 1.6.0 (was: ) > Optimize checkpointing to avoid comp

[jira] [Commented] (SPARK-2089) With YARN, preferredNodeLocalityData isn't honored

2015-10-29 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-2089?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14980278#comment-14980278 ] Steve Loughran commented on SPARK-2089: --- Bear in mind that if you start specifying l

[jira] [Resolved] (SPARK-11370) fix a bug in GroupedIterator and create unit test for it

2015-10-29 Thread Michael Armbrust (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11370?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Armbrust resolved SPARK-11370. -- Resolution: Fixed Fix Version/s: 1.6.0 Issue resolved by pull request 9330 [http

[jira] [Resolved] (SPARK-11379) ExpressionEncoder can't handle top level primitive type correctly

2015-10-29 Thread Michael Armbrust (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11379?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Armbrust resolved SPARK-11379. -- Resolution: Fixed Fix Version/s: 1.6.0 Issue resolved by pull request 9337 [http

[jira] [Commented] (SPARK-10792) Spark + YARN – executor is not re-created

2015-10-29 Thread Adrian Tanase (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10792?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14980179#comment-14980179 ] Adrian Tanase commented on SPARK-10792: --- Forgot to report back, seems to be fixed.

[jira] [Commented] (SPARK-11331) Kryo serializer broken with StringTypes

2015-10-29 Thread JIRA
[ https://issues.apache.org/jira/browse/SPARK-11331?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14980101#comment-14980101 ] Maciej Bryński commented on SPARK-11331: Same when using from PySpark. > Kryo

[jira] [Commented] (SPARK-10749) Support multiple roles with Spark Mesos dispatcher

2015-10-29 Thread Lei Xu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10749?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14980054#comment-14980054 ] Lei Xu commented on SPARK-10749: join this thread for any update. > Support multiple rol

[jira] [Assigned] (SPARK-10849) Allow user to specify database column type for data frame fields when writing data to jdbc data sources.

2015-10-29 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10849?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-10849: Assignee: (was: Apache Spark) > Allow user to specify database column type for data fr

[jira] [Commented] (SPARK-10849) Allow user to specify database column type for data frame fields when writing data to jdbc data sources.

2015-10-29 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10849?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14980044#comment-14980044 ] Apache Spark commented on SPARK-10849: -- User 'sureshthalamati' has created a pull re

[jira] [Assigned] (SPARK-10849) Allow user to specify database column type for data frame fields when writing data to jdbc data sources.

2015-10-29 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10849?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-10849: Assignee: Apache Spark > Allow user to specify database column type for data frame fields

[jira] [Commented] (SPARK-6284) Support framework authentication and role in Mesos framework

2015-10-29 Thread Lei Xu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6284?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14980038#comment-14980038 ] Lei Xu commented on SPARK-6284: --- join this thread. We have the same problems. Mesos 0.25.0

[jira] [Updated] (SPARK-11115) Host verification is not correct for IPv6

2015-10-29 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-5: -- Labels: starter (was: ) > Host verification is not correct for IPv6 >

[jira] [Commented] (SPARK-11115) Host verification is not correct for IPv6

2015-10-29 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14980037#comment-14980037 ] Sean Owen commented on SPARK-5: --- [~tomdz] do you want to fix this check or remove i

[jira] [Commented] (SPARK-11193) Spark 1.5+ Kinesis Streaming - ClassCastException when starting KinesisReceiver

2015-10-29 Thread JIRA
[ https://issues.apache.org/jira/browse/SPARK-11193?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=1497#comment-1497 ] Jean-Baptiste Onofré commented on SPARK-11193: -- Interesting comment from Fab

[jira] [Updated] (SPARK-11103) Parquet filters push-down may cause exception when schema merging is turned on

2015-10-29 Thread Cheng Lian (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11103?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Cheng Lian updated SPARK-11103: --- Summary: Parquet filters push-down may cause exception when schema merging is turned on (was: Filter

[jira] [Commented] (SPARK-11103) Filter applied on Merged Parquet shema with new column fail with (java.lang.IllegalArgumentException: Column [column_name] was not found in schema!)

2015-10-29 Thread Cheng Lian (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11103?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14979950#comment-14979950 ] Cheng Lian commented on SPARK-11103: [~rxin] I think this should be a blocker for 1.5

[jira] [Updated] (SPARK-11103) Filter applied on Merged Parquet shema with new column fail with (java.lang.IllegalArgumentException: Column [column_name] was not found in schema!)

2015-10-29 Thread Cheng Lian (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11103?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Cheng Lian updated SPARK-11103: --- Priority: Blocker (was: Major) > Filter applied on Merged Parquet shema with new column fail with >

[jira] [Updated] (SPARK-11103) Filter applied on Merged Parquet shema with new column fail with (java.lang.IllegalArgumentException: Column [column_name] was not found in schema!)

2015-10-29 Thread Cheng Lian (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11103?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Cheng Lian updated SPARK-11103: --- Target Version/s: 1.5.2, 1.6.0 (was: 1.5.3, 1.6.0) > Filter applied on Merged Parquet shema with new

<    1   2   3