Saisai Shao created SPARK-19306:
-----------------------------------
Summary: Fix inconsistent state in DiskBlockObjectWrite when
exception occurred
Key: SPARK-19306
URL: https://issues.apache.org/jira/browse/SPARK-19306
Project: Spark
Issue Type: Bug
Components: Spark Core
Affects Versions: 2.1.0
Reporter: Saisai Shao
Priority: Minor
In {{DiskBlockObjectWriter}}, when some errors happened during writing, it will
call {{revertPartialWritesAndClose}}, if this method again failed due to some
hardware issues like out of disk, it will throw exception without resetting the
state of this writer, also skipping the revert. So here propose to fix this
issue to offer user a chance to recover from such issue.
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
