On Mon, 2016-06-27 at 13:24 +0000, Rajendran, Prabaharan wrote:
> I am trying to index a text file about 4.2 GB in size. [...]
> 
> SimplePostTool: FATAL: IOException while posting data: java.io.IOException: 
> too many bytes written

SimplePostTool uses 
HttpUrlConnection.setFixedLengthStreamingMode(file_size)
where file_size is an integer.

Unfortunately there is no check for overflow (which happens with files >
2GB), so there is no sane error message up front and you only get the
error you pasted after some bytes has been sent. With a 4.2GB input
file, I would guess after about 200MB (4.2GB % 2GB).


Long story short: Keep your posts below 2GB.

- Toke Eskildsen, State and University Library, Denmark


Reply via email to