[jira] [Commented] (SPARK-18125) Spark generated code causes CompileException when groupByKey, reduceGroups and map(_._2) are used

2016-10-27 Thread Ray Qiu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-18125?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15613099#comment-15613099 ] Ray Qiu commented on SPARK-18125: - Move to Priority Critical unless a workaround is identified. This is

[jira] [Updated] (SPARK-18125) Spark generated code causes CompileException when groupByKey, reduceGroups and map(_._2) are used

2016-10-27 Thread Ray Qiu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-18125?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ray Qiu updated SPARK-18125: Priority: Critical (was: Major) > Spark generated code causes CompileException when groupByKey,

[jira] [Issue Comment Deleted] (SPARK-18125) Spark generated code causes CompileException when groupByKey, reduceGroups and map(_._2) are used

2016-10-27 Thread Ray Qiu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-18125?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ray Qiu updated SPARK-18125: Comment: was deleted (was: Same thing works fine in 2.0.0 -- Regards, Ray ) > Spark generated code

[jira] [Comment Edited] (SPARK-18125) Spark generated code causes CompileException when groupByKey, reduceGroups and map(_._2) are used

2016-10-27 Thread Ray Qiu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-18125?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15613682#comment-15613682 ] Ray Qiu edited comment on SPARK-18125 at 10/27/16 11:54 PM: Try this in

[jira] [Comment Edited] (SPARK-18125) Spark generated code causes CompileException when groupByKey, reduceGroups and map(_._2) are used

2016-10-27 Thread Ray Qiu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-18125?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15613682#comment-15613682 ] Ray Qiu edited comment on SPARK-18125 at 10/27/16 11:54 PM: Try this in

[jira] [Commented] (SPARK-18125) Spark generated code causes CompileException when groupByKey, reduceGroups and map(_._2) are used

2016-10-27 Thread Ray Qiu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-18125?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15613682#comment-15613682 ] Ray Qiu commented on SPARK-18125: - Try this in spark-shell: case class Route(src: String, dest: String,

[jira] [Commented] (SPARK-18125) Spark generated code causes CompileException when groupByKey, reduceGroups and map(_._2) are used

2016-10-27 Thread Ray Qiu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-18125?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15613704#comment-15613704 ] Ray Qiu commented on SPARK-18125: - Same thing works fine in 2.0.0 -- Regards, Ray > Spark

[jira] [Created] (SPARK-18125) Spark generated code causes CompileException when groupByKey, reduceGroups and map(_._2) are used

2016-10-26 Thread Ray Qiu (JIRA)
Ray Qiu created SPARK-18125: --- Summary: Spark generated code causes CompileException when groupByKey, reduceGroups and map(_._2) are used Key: SPARK-18125 URL: https://issues.apache.org/jira/browse/SPARK-18125

[jira] [Commented] (SPARK-19977) Scheduler Delay (in UI Advanced Metrics) for a task gradually increases from 5 ms to 30 seconds in Spark Streaming application

2017-03-16 Thread Ray Qiu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-19977?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15928164#comment-15928164 ] Ray Qiu commented on SPARK-19977: - Not really. Many of the batches are empty RDDs, and the scheduler

[jira] [Comment Edited] (SPARK-19977) Scheduler Delay (in UI Advanced Metrics) for a task gradually increases from 5 ms to 30 seconds in Spark Streaming application

2017-03-16 Thread Ray Qiu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-19977?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15928196#comment-15928196 ] Ray Qiu edited comment on SPARK-19977 at 3/16/17 2:45 PM: -- One thing to add is

[jira] [Commented] (SPARK-19977) Scheduler Delay (in UI Advanced Metrics) for a task gradually increases from 5 ms to 30 seconds in Spark Streaming application

2017-03-16 Thread Ray Qiu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-19977?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15928196#comment-15928196 ] Ray Qiu commented on SPARK-19977: - One thing to add is that the same application will not have this issue

[jira] [Comment Edited] (SPARK-19977) Scheduler Delay (in UI Advanced Metrics) for a task gradually increases from 5 ms to 30 seconds in Spark Streaming application

2017-03-16 Thread Ray Qiu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-19977?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15928164#comment-15928164 ] Ray Qiu edited comment on SPARK-19977 at 3/16/17 2:28 PM: -- Not really. Many of

[jira] [Comment Edited] (SPARK-19977) Scheduler Delay (in UI Advanced Metrics) for a task gradually increases from 5 ms to 30 seconds in Spark Streaming application

2017-03-16 Thread Ray Qiu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-19977?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15928196#comment-15928196 ] Ray Qiu edited comment on SPARK-19977 at 3/16/17 2:45 PM: -- One thing to add is

[jira] [Created] (SPARK-19977) Scheduler Delay (in UI Advanced Metrics) for a task gradually increases from 5 ms to 30 seconds in Spatk Streaming application

2017-03-16 Thread Ray Qiu (JIRA)
Ray Qiu created SPARK-19977: --- Summary: Scheduler Delay (in UI Advanced Metrics) for a task gradually increases from 5 ms to 30 seconds in Spatk Streaming application Key: SPARK-19977 URL:

[jira] [Updated] (SPARK-19977) Scheduler Delay (in UI Advanced Metrics) for a task gradually increases from 5 ms to 30 seconds in Spark Streaming application

2017-03-16 Thread Ray Qiu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-19977?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ray Qiu updated SPARK-19977: Summary: Scheduler Delay (in UI Advanced Metrics) for a task gradually increases from 5 ms to 30 seconds