[
https://issues.apache.org/jira/browse/SPARK-3583?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Patrick Wendell resolved SPARK-3583.
------------------------------------
Resolution: Invalid
Hi there, can you start on the user list rather than on JIRA? We use JIRA to
track well described bugs once we've pinpointed issues. Thanks!
> Spark run slow after unexpected repartition
> -------------------------------------------
>
> Key: SPARK-3583
> URL: https://issues.apache.org/jira/browse/SPARK-3583
> Project: Spark
> Issue Type: Bug
> Affects Versions: 0.9.1
> Reporter: ShiShu
> Labels: easyfix
> Attachments: spark_q_001.jpg, spark_q_004.jpg, spark_q_005.jpg,
> spark_q_006.jpg
>
>
> Hi dear all~
> My spark application sometimes runs much slower than it use to be, so I
> wonder why would this happen.
> I find out that after a repartition stage of stage 17, all tasks go to one
> executor. But in my code, I only use repartition at the very beginning.
> In my application, before stage 17, every stage run sucessfully within 1
> minute, but after stage 17, it cost more than 10 minutes for every stage.
> Normally my application runs succcessfully and will finish within 9 minites.
> My spark version is 0.9.1, and my program is writen by scala.
> I take some screenshots but don't know how to post it, pls tell me if you
> need.
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
