DataFileWriter.appendTo leads to intermittent IOException during write()
------------------------------------------------------------------------
Key: AVRO-524
URL: https://issues.apache.org/jira/browse/AVRO-524
Project: Avro
Issue Type: Bug
Components: java
Reporter: Thiruvalluvan M. G.
Assignee: Thiruvalluvan M. G.
Fix For: 1.4.0
To append to a data file, we first open the file as RandomAccessFile in
read-write mode, read some information such sync, seek to the end of the file
and then use its FileDescriptor to create a FileOutputStream. Sharing a
FileDescriptor this way could lead to problem if one of its containers is
garbage-collected while the other is still in use. Please see:
http://bugs.sun.com/bugdatabase/view_bug.do?bug_id=6322678. The bug got fixed
in Java 7 (b06). In our case, RandomAccessFile sometimes gets garbage-collected
leading to write errors. If the Java unit-tests are run multiple times, this
occurs about 25% of the time on my Windows machine and about 50% on my Ubuntu
Linux box.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
