snvijaya opened a new pull request #3309: URL: https://github.com/apache/hadoop/pull/3309
This commit provides an option to enable store access on read path over an Azure specific protocol. To enable the feature, config "fs.azure.fastpath.enable"needs to be turned on. This will only work on Azure VMs and hence will be disabled by default. With feature on, read requests will switch from HttpConnection to FastpathConnection. This will route the requests to APIs exposed by a new dependent artifact azure-storage-fastpath. Feature flow: ABFS InputStream needs to cache a session token that it fetches from store backend, renew it close to its expiry and use it as an input to the API calls of artifact azure-storage-fastpath. On init, the inputStream needs to call upon the Open API to fetch file handle and use for the successive read calls. On inputStream close, the file handle created earlier needs to be closed too. To unit test and inject failures, mock child classes of AzureBlobFileSystemStore, AbfsClient, AbfsRestOperation, AbfsInputStream are created in tests which mimic the instances/field values to test the feature even though the config is off. Existing test methods that do valid read tests are triggered seperately over mockFastpath mode to isolate test results from the existing tests. The dependent artifact azure-storage-fastpath is a published artifact to public maven repository. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: common-issues-unsubscr...@hadoop.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org --------------------------------------------------------------------- To unsubscribe, e-mail: common-issues-unsubscr...@hadoop.apache.org For additional commands, e-mail: common-issues-h...@hadoop.apache.org
