Jacob Nordfalk <[email protected]>
writes:

> 2015-06-01 19:39 GMT+02:00 Xavi Ivars
> <[email protected]>:
>
>     It works really well!
>     
>     
>     What would be awesome is if could also use null-flushed modes: it
>     would help finding issues that are only reproducible when using -z
>     (tagger-related usually).
>     
>     
>     
>
> Xavi, I have just no idea about -z, so I need to know more to be able
> to help you, like:
>
> - which pair and mode, for example?

-z can be used with any pair, except those that use hfst-proc (it's fine
if they use lt-proc with a file that originally came from hfst though)
or lrx-proc (at least I think there's still a bug there).

You "enable" it by putting the -z argument first in any programs in the
mode, so

lt-proc -w -e nob-nno.automorf.bin |
cg-proc -w nob-nno.rlx.bin |
apertium-tagger -g $2 nob-nno.prob |
apertium-pretransfer|
lt-proc -b nob-nno.autobil.bin |
apertium-transfer -b apertium-nno-nob.nob-nno.t1x  nob-nno.t1x.bin |
apertium-interchunk apertium-nno-nob.nob-nno.t2x  nob-nno.t2x.bin |
apertium-postchunk apertium-nno-nob.nob-nno.t3x  nob-nno.t3x.bin |
lt-proc $1 nob-nno.autogen.bin

becomes

lt-proc -z -w -e nob-nno.automorf.bin |
cg-proc -z -w nob-nno.rlx.bin |
apertium-tagger -z -g $2 nob-nno.prob |
apertium-pretransfer-z |
lt-proc -z -b nob-nno.autobil.bin |
apertium-transfer -z -b apertium-nno-nob.nob-nno.t1x  nob-nno.t1x.bin |
apertium-interchunk -z apertium-nno-nob.nob-nno.t2x  nob-nno.t2x.bin |
apertium-postchunk -z apertium-nno-nob.nob-nno.t3x  nob-nno.t3x.bin |
lt-proc -z $1 nob-nno.autogen.bin 

See http://wiki.apertium.org/wiki/NUL_flushing on how to test it.

> - what it the use case here, for example, what kind of error is it
> that the developer makes, and can't see ?

I'd guess this is more for core tool developers than language pair
developers. At least I can't think of why a language pair developer
should ever need to worry about it (so to me it seems outside the scope
of apertium-viewer, though maybe there's a use case I haven't thought
of).


-Kevin

Attachment: signature.asc
Description: PGP signature

------------------------------------------------------------------------------
_______________________________________________
Apertium-stuff mailing list
[email protected]
https://lists.sourceforge.net/lists/listinfo/apertium-stuff

Reply via email to