Liang-Chi Hsieh created SPARK-4741:
--------------------------------------
Summary: Do not destroy and re-create FileInputStream
Key: SPARK-4741
URL: https://issues.apache.org/jira/browse/SPARK-4741
Project: Spark
Issue Type: Improvement
Reporter: Liang-Chi Hsieh
Priority: Minor
The FileInputStream in DiskMapIterator is destroyed and recreate after each
batch reading. However, since we can change the reading position on that
stream, it is no need and inefficient to destroy and recreate it every time.
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
