Shawn Smith created CRUNCH-53:
---------------------------------
Summary: AvroFileReaderFactory does not close input files
Key: CRUNCH-53
URL: https://issues.apache.org/jira/browse/CRUNCH-53
Project: Crunch
Issue Type: Bug
Components: IO
Reporter: Shawn Smith
Priority: Minor
The AvroFileReaderFactory read() method does not close its DataFileReader.
With the Hadoop NativeS3FileSystem this can lead to the following warning:
org.jets3t.service.impl.rest.httpclient.HttpMethodReleaseInputStream:
Successfully released HttpMethod in finalize(). You were lucky this time...
Please ensure S3 response data streams are always fully consumed or closed.
WARN [2012-08-28 19:26:16,035]
org.jets3t.service.impl.rest.httpclient.HttpMethodReleaseInputStream:
Attempting to release HttpMethod in finalize() as its response data stream has
gone out of scope. This attempt will not always succeed and cannot be relied
upon! Please ensure S3 response data streams are always fully consumed or
closed to avoid HTTP connection starvation.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira
