ok. i just did a clean install of RandLM on a 64 bit machine, running Suse. here is my test:
> ./buildlm -struct BloomMap -falsepos 8 -values 8 -output-prefix model < ../src/README > this produces the expected results, so it must be that somehow there is a difference in either your Unix version or else in tools such as cat etc. so, which version of cat do you have? this is what i have here: cat --version cat (GNU coreutils) 6.11 Copyright (C) 2008 Free Software Foundation, Inc. License GPLv3+: GNU GPL version 3 or later <http://gnu.org/licenses/gpl.html> This is free software: you are free to change and redistribute it. There is NO WARRANTY, to the extent permitted by law. Written by Torbjorn Granlund and Richard M. Stallman. Miles 2009/2/19 Miles Osborne <[email protected]>: > what happens when you run this? > > Miles > > 2009/2/19 Michael Zuckerman <[email protected]>: >> Hi, >> >> I am using sort (GNU coreutils) 6.10. >> Here is the full STDERR output, with the command I ran: >> $ ../bin/buildlm -struct BloomMap -falsepos 8 -values 8 -output-prefix model >> -input-type corpus < ../../europarl.lower.token.en 2> errors >> User defined parameter settings: >> falsepos 8 >> input-type corpus >> output-prefix model >> struct BloomMap >> values 8 >> Default values set in PipelineTool: >> order 3 >> tmp-dir /tmp >> input-path ___stdin___ >> working-mem 100 >> output-dir . >> add-bos-eos 1 >> seed 0 >> Default values set in Builder: >> falseneg 0 >> misassign 1 >> count-cut-off 1 >> memory 0 >> maxcount 35 >> output-type randlm >> smoothing-param 0.4 >> Derived parameters settings: >> estimator batch >> smoothing StupidBackoff >> Pipeline converting data from corpus to counts >> output path = ./model.tokens >> output path = ./model.tokens.sorted >> output path = ./model.counts.sorted >> cat ./model.tokens | cat | sort --compress-program=cat -T /tmp -S 100M -k 1 >> -k 2 -k 3 -k 4 | cat > ./model.tokens.sorted >> cat: invalid option -- d >> Try `cat --help' for more information. >> cat: invalid option -- d >> Try `cat --help' for more information. >> cat: invalid option -- d >> Try `cat --help' for more information. >> cat: invalid option -- d >> Try `cat --help' for more information. >> cat: invalid option -- d >> Try `cat --help' for more information. >> cat: invalid option -- d >> Try `cat --help' for more information. >> cat: invalid option -- d >> Try `cat --help' for more information. >> cat: invalid option -- d >> Try `cat --help' for more information. >> cat: invalid option -- d >> Try `cat --help' for more information. >> cat: invalid option -- d >> Try `cat --help' for more information. >> cat: invalid option -- d >> Try `cat --help' for more information. >> cat: invalid option -- d >> Try `cat --help' for more information. >> cat: invalid option -- d >> Try `cat --help' for more information. >> cat: invalid option -- d >> Try `cat --help' for more information. >> cat: invalid option -- d >> Try `cat --help' for more information. >> cat: invalid option -- d >> Try `cat --help' for more information. >> cat: invalid option -- d >> Try `cat --help' for more information. >> cat: invalid option -- d >> Try `cat --help' for more information. >> cat: invalid option -- d >> Try `cat --help' for more information. >> cat: invalid option -- d >> Try `cat --help' for more information. >> cat: invalid option -- d >> Try `cat --help' for more information. >> cat: invalid option -- d >> Try `cat --help' for more information. >> cat: invalid option -- d >> Try `cat --help' for more information. >> cat: invalid option -- d >> Try `cat --help' for more information. >> cat: invalid option -- d >> Try `cat --help' for more information. >> cat: invalid option -- d >> Try `cat --help' for more information. >> cat: invalid option -- d >> Try `cat --help' for more information. >> cat: invalid option -- d >> Try `cat --help' for more information. >> cat: invalid option -- d >> Try `cat --help' for more information. >> cat: invalid option -- d >> Try `cat --help' for more information. >> cat: invalid option -- d >> Try `cat --help' for more information. >> cat: invalid option -- d >> Try `cat --help' for more information. >> cat: invalid option -- d >> Try `cat --help' for more information. >> cat: invalid option -- d >> Try `cat --help' for more information. >> cat: invalid option -- d >> Try `cat --help' for more information. >> cat: invalid option -- d >> Try `cat --help' for more information. >> cat: invalid option -- d >> Try `cat --help' for more information. >> cat: invalid option -- d >> Try `cat --help' for more information. >> rm ./model.tokens >> buildlm: RandLMStats.cpp:312: virtual bool randlm::CountStats::observe(const >> randlm::Word*, randlm::Value, int): Assertion `len > 0' failed. >> >> Thanks, >> Michael. >> >> On Thu, Feb 19, 2009 at 4:06 PM, Miles Osborne <[email protected]> wrote: >>> >>> can you post the full STDERR output, along with the command you ran. >>> >>> also, which version of sort are you using? >>> >>> sort --version >>> >>> Miles >>> >>> >>> 2009/2/19 Michael Zuckerman <[email protected]>: >>> > Hi, >>> > >>> > We are trying to run RandLM on our files. We use the command: >>> > $ ./buildlm -struct BloomMap -falsepos 8 -values 8 -output-prefix model >>> > -input-type corpus < ../../europarl.lower.token.en >>> > >>> > And we get the following errors: >>> > cat: invalid option -- d >>> > Try `cat --help' for more information. >>> > rm ./model.tokens >>> > buildlm: RandLMStats.cpp:312: virtual bool >>> > randlm::CountStats::observe(const >>> > randlm::Word*, randlm::Value, int): Assertion `len > 0' failed. >>> > Aborted >>> > >>> > Are you familiar with these errors ? Do you have an idea about how to >>> > solve >>> > them ? >>> > >>> > Thanks, >>> > Michael. >>> > >>> > _______________________________________________ >>> > Moses-support mailing list >>> > [email protected] >>> > http://mailman.mit.edu/mailman/listinfo/moses-support >>> > >>> > >>> >>> >>> >>> -- >>> The University of Edinburgh is a charitable body, registered in >>> Scotland, with registration number SC005336. >> >> > > > > -- > The University of Edinburgh is a charitable body, registered in > Scotland, with registration number SC005336. > -- The University of Edinburgh is a charitable body, registered in Scotland, with registration number SC005336. _______________________________________________ Moses-support mailing list [email protected] http://mailman.mit.edu/mailman/listinfo/moses-support
