[jira] [Commented] (SPARK-6568) spark-shell.cmd --jars option does not accept the jar that has space in its path

2015-03-30 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6568?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14386552#comment-14386552 ] Steve Loughran commented on SPARK-6568: --- Can you show the full stack trace? > spark

[jira] [Resolved] (SPARK-5836) Highlight in Spark documentation that by default Spark does not delete its temporary files

2015-03-30 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5836?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-5836. -- Resolution: Fixed Fix Version/s: 1.4.0 1.3.1 Assignee: Ilya Ganelin >

[jira] [Updated] (SPARK-5750) Document that ordering of elements in shuffled partitions is not deterministic across runs

2015-03-30 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5750?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-5750: - Priority: Minor (was: Major) > Document that ordering of elements in shuffled partitions is not > determ

[jira] [Updated] (SPARK-5836) Highlight in Spark documentation that by default Spark does not delete its temporary files

2015-03-30 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5836?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-5836: - Priority: Minor (was: Major) > Highlight in Spark documentation that by default Spark does not delete its

[jira] [Commented] (SPARK-3441) Explain in docs that repartitionAndSortWithinPartitions enacts Hadoop style shuffle

2015-03-30 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-3441?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14386541#comment-14386541 ] Sean Owen commented on SPARK-3441: -- This is mentioned in the change for https://github.co

[jira] [Commented] (SPARK-6605) Same transformation in DStream leads to different result

2015-03-30 Thread SaintBacchus (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6605?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14386540#comment-14386540 ] SaintBacchus commented on SPARK-6605: - Hi [~srowen], my test code is this : {code:titl

[jira] [Resolved] (SPARK-5750) Document that ordering of elements in shuffled partitions is not deterministic across runs

2015-03-30 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5750?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-5750. -- Resolution: Fixed Fix Version/s: 1.4.0 1.3.1 Assignee: Ilya Ganelin R

[jira] [Updated] (SPARK-6603) SQLContext.registerFunction -> SQLContext.udf.register

2015-03-30 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6603?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-6603: - Component/s: SQL > SQLContext.registerFunction -> SQLContext.udf.register > --

[jira] [Updated] (SPARK-6596) fix the instruction on building scaladoc

2015-03-30 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6596?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-6596: - Priority: Trivial (was: Major) Assignee: Nan Zhu > fix the instruction on building scaladoc > --

[jira] [Resolved] (SPARK-6596) fix the instruction on building scaladoc

2015-03-30 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6596?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-6596. -- Resolution: Fixed Fix Version/s: 1.4.0 Issue resolved by pull request 5253 [https://github.com/ap

[jira] [Commented] (SPARK-6605) Same transformation in DStream leads to different result

2015-03-30 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6605?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14386510#comment-14386510 ] Sean Owen commented on SPARK-6605: -- What other implementation are you referring to? I can

[jira] [Commented] (SPARK-6401) Unable to load a old API input format in Spark streaming

2015-03-30 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6401?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14386499#comment-14386499 ] Sean Owen commented on SPARK-6401: -- Since it's technically an API change to streaming I'd

[jira] [Commented] (SPARK-6401) Unable to load a old API input format in Spark streaming

2015-03-30 Thread Thomas F. (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6401?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14386491#comment-14386491 ] Thomas F. commented on SPARK-6401: -- How do we proceed for this issue ? As we already hav

[jira] [Commented] (SPARK-6528) IDF transformer

2015-03-30 Thread Xusen Yin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6528?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14386460#comment-14386460 ] Xusen Yin commented on SPARK-6528: -- [~josephkb] Pls assign it to me. > IDF transformer >

[jira] [Commented] (SPARK-6258) Python MLlib API missing items: Clustering

2015-03-30 Thread Hrishikesh (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6258?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14386394#comment-14386394 ] Hrishikesh commented on SPARK-6258: --- Hi [~josephkb] I am a newbie to spark and I would l

[jira] [Resolved] (SPARK-6594) Spark Streaming can't receive data from kafka

2015-03-30 Thread Saisai Shao (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6594?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Saisai Shao resolved SPARK-6594. Resolution: Not a Problem > Spark Streaming can't receive data from kafka >

[jira] [Comment Edited] (SPARK-6594) Spark Streaming can't receive data from kafka

2015-03-30 Thread q79969786 (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6594?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14386380#comment-14386380 ] q79969786 edited comment on SPARK-6594 at 3/30/15 8:25 AM: --- than

[jira] [Commented] (SPARK-6594) Spark Streaming can't receive data from kafka

2015-03-30 Thread q79969786 (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6594?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14386380#comment-14386380 ] q79969786 commented on SPARK-6594: -- thanks, it worked after reboot kafka > Spark Streami

[jira] [Comment Edited] (SPARK-5895) Add VectorSlicer

2015-03-30 Thread Xusen Yin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5895?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14386365#comment-14386365 ] Xusen Yin edited comment on SPARK-5895 at 3/30/15 8:14 AM: --- I ha

[jira] [Commented] (SPARK-5895) Add VectorSlicer

2015-03-30 Thread Xusen Yin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5895?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14386365#comment-14386365 ] Xusen Yin commented on SPARK-5895: -- I have another concern here. We can not reveal each

[jira] [Assigned] (SPARK-6606) Accumulator deserialized twice because the NarrowCoGroupSplitDep contains rdd object.

2015-03-30 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6606?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-6606: --- Assignee: (was: Apache Spark) > Accumulator deserialized twice because the NarrowCoGroupS

[jira] [Commented] (SPARK-6606) Accumulator deserialized twice because the NarrowCoGroupSplitDep contains rdd object.

2015-03-30 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6606?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14386355#comment-14386355 ] Apache Spark commented on SPARK-6606: - User 'suyanNone' has created a pull request for

[jira] [Assigned] (SPARK-6606) Accumulator deserialized twice because the NarrowCoGroupSplitDep contains rdd object.

2015-03-30 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6606?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-6606: --- Assignee: Apache Spark > Accumulator deserialized twice because the NarrowCoGroupSplitDep con

[jira] [Created] (SPARK-6606) Accumulator deserialized twice because the NarrowCoGroupSplitDep contains rdd object.

2015-03-30 Thread SuYan (JIRA)
SuYan created SPARK-6606: Summary: Accumulator deserialized twice because the NarrowCoGroupSplitDep contains rdd object. Key: SPARK-6606 URL: https://issues.apache.org/jira/browse/SPARK-6606 Project: Spark

[jira] [Commented] (SPARK-5894) Add PolynomialMapper

2015-03-30 Thread Xusen Yin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5894?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14386346#comment-14386346 ] Xusen Yin commented on SPARK-5894: -- [~mengxr] [~josephkb] Do you have time to check it? T

[jira] [Commented] (SPARK-6605) Same transformation in DStream leads to different result

2015-03-30 Thread SaintBacchus (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6605?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14386324#comment-14386324 ] SaintBacchus commented on SPARK-6605: - Hi, [~tdas] can you have a look at this problem

[jira] [Created] (SPARK-6605) Same transformation in DStream leads to different result

2015-03-30 Thread SaintBacchus (JIRA)
SaintBacchus created SPARK-6605: --- Summary: Same transformation in DStream leads to different result Key: SPARK-6605 URL: https://issues.apache.org/jira/browse/SPARK-6605 Project: Spark Issue Ty

[jira] [Commented] (SPARK-6594) Spark Streaming can't receive data from kafka

2015-03-30 Thread Saisai Shao (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6594?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14386313#comment-14386313 ] Saisai Shao commented on SPARK-6594: Hi [~q79969786], would you please paste more warn

[jira] [Commented] (SPARK-5895) Add VectorSlicer

2015-03-30 Thread Xusen Yin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5895?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14386296#comment-14386296 ] Xusen Yin commented on SPARK-5895: -- Is it possible to select by type or value? Like in Pa

<    1   2   3