Steve Loughran created HADOOP-18287:
---------------------------------------
Summary: Provide a shim library for modern FS APIs
Key: HADOOP-18287
URL: https://issues.apache.org/jira/browse/HADOOP-18287
Project: Hadoop Common
Issue Type: New Feature
Components: fs
Affects Versions: 3.3.0
Reporter: Steve Loughran
Add a shim library to give libraries and applications built against hadoop 3.2
access to APIs and features in later versions, especially those delivering
higher performance in cloud deployments. This will give them the ability to
invoke those APIs when available, so gain from the work everyone has done. Key
APIs are:
* openFile
* ByteBufferPositionedReadable
* Vectored IO
The library will either downgrade gracefully to existing code (openFile) or
simply thrown UnsupportedException when invoked -but offer probes for every
operation before invocation.
This module will compile against hadoop 3.2.0; it will be tested against that
and later releases.
We can and should release this on a different schedule; though ideally we
should issue releases in sync with new hadoop releases adding new supported API
calls.
For that reason I think we could consider having separate git repository for
it. Verifying that the shim works against hadoop PRs could actually become one
of our regression tests -indeed, it should become one.
--
This message was sent by Atlassian Jira
(v8.20.7#820007)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
