Thomas Graves created SPARK-15178:
-------------------------------------
Summary: Remove LazyFileRegion
Key: SPARK-15178
URL: https://issues.apache.org/jira/browse/SPARK-15178
Project: Spark
Issue Type: Improvement
Components: Shuffle
Affects Versions: 1.6.1
Reporter: Thomas Graves
LazyFileRegion was created so we didn't create a file descriptor before having
to send the file. see https://issues.apache.org/jira/browse/SPARK-4307. The
change has been pushed back into Netty to support the same things under the
DefaultFileRegion.
https://github.com/netty/netty/issues/3129
https://github.com/netty/netty/commit/a4450b76d9c786f8b7f76e230938b0200a7188be
It looks like that went into 4.0.25.Final. I believe at the time we created
LazyFileRegion we were on 4.0.23.Final and we are now using 4.0.29.Final so we
should be able to use the netty class directly.
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
