steveloughran opened a new pull request, #7151:
URL: https://github.com/apache/hadoop/pull/7151
S3AInputStream.finalizer() to
- abort any active HTTP connection.
- warn if there was one
- warning to include: path, and stack+thread ID of creation.
The warning message is logged at WARN to log
org.apache.hadoop.fs.s3a.connection.leaks
set to a lower log level to hide these messages
This is a best-effort recovery from stream leaks.
Cleanup will *only* take place during GC; it is easy to run out of
connections without running out of memory.
### How was this patch tested?
New ITest.
### For code changes:
- [X] Does the title or this PR starts with the corresponding JIRA issue id
(e.g. 'HADOOP-17799. Your PR title ...')?
- [X] Object storage: have the integration tests been executed and the
endpoint declared according to the connector-specific documentation?
- [ ] If adding new dependencies to the code, are these dependencies
licensed in a way that is compatible for inclusion under [ASF
2.0](http://www.apache.org/legal/resolved.html#category-a)?
- [ ] If applicable, have you updated the `LICENSE`, `LICENSE-binary`,
`NOTICE-binary` files?
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: [email protected]
For queries about this service, please contact Infrastructure at:
[email protected]
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
