Why solr 4.0 use FSIndexOutput to write file, otherwise MMap/NIO

2013-06-28 Thread Jeffery Wang

I have checked the FSDirectory, it will create MMapDirectory or 
NIOFSDirectory for Directory.
This two directory only supply IndexInput extend for read file (MMapIndexInput 
extends ByteBufferIndexInput),
why not there is not MMap/NIO IndexOutput extend for file write. It only use 
FSIndexOutput for file write(FSIndexOutput extends BufferedIndexOutput).

Does FSIndexOutput wirte file very slow than MMap/NIO? How to improve the IO 
write performance.

Thanks,
__
Jeffery Wang
Application Service - Backend
Morningstar (Shenzhen) Ltd.
Morningstar. Illuminating investing worldwide.
+86 755 3311 0220 Office
+86 130 7782 2813 Mobile
jeffery.w...@morningstar.commailto:jeffery.w...@morningstar.com
This e-mail contains privileged and confidential information and is intended 
only for the use of the person(s) named above. Any dissemination, distribution 
or duplication of this communication without prior written consent from 
Morningstar is strictly prohibited. If you received this message in error 
please contact the sender immediately and delete the materials from any 
computer.



Re: Why solr 4.0 use FSIndexOutput to write file, otherwise MMap/NIO

2013-06-28 Thread Michael McCandless
Output is quite a bit simpler than input because all we do is write a
single stream of bytes with no seeking (append only), and it's done
with only one thread, so I don't think there'd be much to gain by
using the newer IO APIs for writing...

Mike McCandless

http://blog.mikemccandless.com

On Fri, Jun 28, 2013 at 2:23 AM, Jeffery Wang
jeffery.w...@morningstar.com wrote:

 I have checked the FSDirectory, it will create MMapDirectory or 
 NIOFSDirectory for Directory.
 This two directory only supply IndexInput extend for read file 
 (MMapIndexInput extends ByteBufferIndexInput),
 why not there is not MMap/NIO IndexOutput extend for file write. It only use 
 FSIndexOutput for file write(FSIndexOutput extends BufferedIndexOutput).

 Does FSIndexOutput wirte file very slow than MMap/NIO? How to improve the IO 
 write performance.

 Thanks,
 __
 Jeffery Wang
 Application Service - Backend
 Morningstar (Shenzhen) Ltd.
 Morningstar. Illuminating investing worldwide.
 +86 755 3311 0220 Office
 +86 130 7782 2813 Mobile
 jeffery.w...@morningstar.commailto:jeffery.w...@morningstar.com
 This e-mail contains privileged and confidential information and is intended 
 only for the use of the person(s) named above. Any dissemination, 
 distribution or duplication of this communication without prior written 
 consent from Morningstar is strictly prohibited. If you received this message 
 in error please contact the sender immediately and delete the materials from 
 any computer.