[jira] [Created] (SPARK-27734) Add memory based thresholds for shuffle spill

2019-05-15 Thread Adrian Muraru (JIRA)
Adrian Muraru created SPARK-27734: - Summary: Add memory based thresholds for shuffle spill Key: SPARK-27734 URL: https://issues.apache.org/jira/browse/SPARK-27734 Project: Spark Issue Type: I

[jira] [Updated] (SPARK-27610) Yarn external shuffle service fails to start when spark.shuffle.io.mode=EPOLL

2019-04-30 Thread Adrian Muraru (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-27610?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Adrian Muraru updated SPARK-27610: -- Description: Enabling netty epoll mode in yarn shuffle service ({{spark.shuffle.io.mode=EPOLL

[jira] [Created] (SPARK-27610) Yarn external shuffle service fails to start when spark.shuffle.io.mode=EPOLL

2019-04-30 Thread Adrian Muraru (JIRA)
Adrian Muraru created SPARK-27610: - Summary: Yarn external shuffle service fails to start when spark.shuffle.io.mode=EPOLL Key: SPARK-27610 URL: https://issues.apache.org/jira/browse/SPARK-27610 Proje

[jira] [Commented] (SPARK-27530) FetchFailedException: Received a zero-size buffer for block shuffle

2019-04-28 Thread Adrian Muraru (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-27530?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16828783#comment-16828783 ] Adrian Muraru commented on SPARK-27530: --- I can confirm SPARK-27216 fixes this issu

[jira] [Updated] (SPARK-27530) FetchFailedException: Received a zero-size buffer for block shuffle

2019-04-24 Thread Adrian Muraru (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-27530?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Adrian Muraru updated SPARK-27530: -- Description: I'm getting this in a large shuffle: {code:java} org.apache.spark.shuffle.FetchFa

[jira] [Updated] (SPARK-27530) FetchFailedException: Received a zero-size buffer for block shuffle

2019-04-20 Thread Adrian Muraru (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-27530?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Adrian Muraru updated SPARK-27530: -- Description: I'm getting this in a large shuffle: org.apache.spark.shuffle.FetchFailedExcepti

[jira] [Created] (SPARK-27530) FetchFailedException: Received a zero-size buffer for block shuffle

2019-04-20 Thread Adrian Muraru (JIRA)
Adrian Muraru created SPARK-27530: - Summary: FetchFailedException: Received a zero-size buffer for block shuffle Key: SPARK-27530 URL: https://issues.apache.org/jira/browse/SPARK-27530 Project: Spark