Larry,
My best guess is that you would have to modify the
org.apache.hadoop.fs.LocalFileSystem class to use the MMap. Right now
it uses channels which can be extremely fast as well. I don't think
this functionality works right out the box in Nutch. It does look like
it works out of the box in Lucene though. I would take a look at the
lucene javadocs for FSDirectory and MMapDirectory as well as the Nutch
javadocs for FsDirectory and LocalFileSystem. The NIO book from Oreilly
is also a good resource on Memory Mapping in java.
Dennis
Hi Dennis, I have given more consideration to your suggestion and it looks
quite sound, did a search on it on the web but didn't have a great deal of
luck in locating any information on how to actually use it in this situation
(for searching an index), could you perhaps give me a few pointers or
perhaps a link or two with some good documentation on FSDirectory.
Thanks in advance.
Larry
--
View this message in context:
http://www.nabble.com/Swap-with-Nutch-t1434922.html#a3942795
Sent from the Nutch - Dev forum at Nabble.com.
-------------------------------------------------------
This SF.Net email is sponsored by xPML, a groundbreaking scripting language
that extends applications into web and mobile media. Attend the live webcast
and join the prime developer group breaking into this new coding territory!
http://sel.as-us.falkag.net/sel?cmd=lnk&kid=110944&bid=241720&dat=121642
_______________________________________________
Nutch-developers mailing list
[email protected]
https://lists.sourceforge.net/lists/listinfo/nutch-developers
