Dear Moses,
I've added support for native reading from more compression formats,
namely bz2 and xz. If you have the libraries and headers, then Moses
master will read these formats for KenLM reading ARPA files, phrase and
chart in-memory tables, and MERT score and feature data. For these
readers (based on FilePiece), the format is detected using magic bytes
and no attention is paid to file name. Other readers based on
InputFileStream support gzip if the file extension is .gz.
As this involves new libraries, I may have broken something but tried
not to.
Kenneth
_______________________________________________
Moses-support mailing list
[email protected]
http://mailman.mit.edu/mailman/listinfo/moses-support
