[jira] [Comment Edited] (SPARK-18105) LZ4 failed to decompress a stream of shuffled data

[ https://issues.apache.org/jira/browse/SPARK-18105?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17333000#comment-17333000 ] Anthony edited comment on SPARK-18105 at 4/27/21, 7:26 AM: --- We are seeing

[jira] [Commented] (SPARK-18105) LZ4 failed to decompress a stream of shuffled data

[ https://issues.apache.org/jira/browse/SPARK-18105?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17333000#comment-17333000 ] Anthony commented on SPARK-18105: - We are seeing similar issues with Spark 3.0.1 as well. Not exactly

[jira] [Commented] (SPARK-23970) pyspark - simple filter/select doesn't use all tasks when coalesce is set

[ https://issues.apache.org/jira/browse/SPARK-23970?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16438188#comment-16438188 ] Matthew Anthony commented on SPARK-23970: - Understood but this isnhorribly inefficient. In the

[jira] [Updated] (SPARK-23970) pyspark - simple filter/select doesn't use all tasks when coalesce is set

[ https://issues.apache.org/jira/browse/SPARK-23970?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Matthew Anthony updated SPARK-23970: Description: Running in (py)spark 2.2.  Marking this as PySpark, but have not confirmed

[jira] [Updated] (SPARK-23970) pyspark - simple filter/select doesn't use all tasks when coalesce is set

[ https://issues.apache.org/jira/browse/SPARK-23970?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Matthew Anthony updated SPARK-23970: Description: Running in (py)spark 2.2.  Marking this as PySpark, but have not confirmed

[jira] [Created] (SPARK-23970) pyspark - simple filter/select doesn't use all tasks when coalesce is set

Matthew Anthony created SPARK-23970: --- Summary: pyspark - simple filter/select doesn't use all tasks when coalesce is set Key: SPARK-23970 URL: https://issues.apache.org/jira/browse/SPARK-23970