[jira] [Commented] (SPARK-27186) Optimize SortShuffleWriter writing process
[ https://issues.apache.org/jira/browse/SPARK-27186?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16796671#comment-16796671 ] Apache Spark commented on SPARK-27186: -- User 'AngersZh' has created a pull request for this issue: https://github.com/apache/spark/pull/24124 > Optimize SortShuffleWriter writing process > -- > > Key: SPARK-27186 > URL: https://issues.apache.org/jira/browse/SPARK-27186 > Project: Spark > Issue Type: Improvement > Components: Shuffle >Affects Versions: 3.0.0 >Reporter: wangjiaochun >Priority: Minor > > If the SortShuffleWriter.write method records is empty, it should be return > directly and no need to keep running,refer to the process of > BypassMergeSortShuffleWriter.write. Here are the benefits of create Instance > ExternalSorter and tmp file. -- This message was sent by Atlassian JIRA (v7.6.3#76005) - To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org For additional commands, e-mail: issues-h...@spark.apache.org
[jira] [Commented] (SPARK-27186) Optimize SortShuffleWriter writing process
[ https://issues.apache.org/jira/browse/SPARK-27186?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16794881#comment-16794881 ] Yuming Wang commented on SPARK-27186: - Please avoid to set {{Fix Version/s}} which is usually reserved for committers. > Optimize SortShuffleWriter writing process > -- > > Key: SPARK-27186 > URL: https://issues.apache.org/jira/browse/SPARK-27186 > Project: Spark > Issue Type: Improvement > Components: Shuffle >Affects Versions: 3.0.0 >Reporter: wangjiaochun >Priority: Minor > Fix For: 3.0.0 > > > If the SortShuffleWriter.write method records is empty, it should be return > directly and no need to keep running,refer to the process of > BypassMergeSortShuffleWriter.write. Here are the benefits of create Instance > ExternalSorter and tmp file. -- This message was sent by Atlassian JIRA (v7.6.3#76005) - To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org For additional commands, e-mail: issues-h...@spark.apache.org