Hi, all,
I was used to moses20080711, but now I'm trying the latest version.
Here are some problems I come up with.
1. Installing
./regenerate-makefiles.sh
Calling /usr/bin/aclocal...
Calling /usr/bin/autoconf...
Calling /usr/bin/automake...
Calling /usr/bin/libtoolize
libtoolize: `config.guess' exists: use `--force' to overwrite
libtoolize: `config.sub' exists: use `--force' to overwrite
libtoolize: `ltmain.sh' exists: use `--force' to overwrite
You should now be able to configure and build:
./configure [--with-srilm=/path/to/srilm] [--with-irstlm=/path/to/irstlm]
[--with-randlm=/path/to/randlm] [--without-kenlm] [--with-synlm]
[--with-xmlrpc-c=/path/to/xmlrpc-c-config]
make -j 4
I tried to use -force but it seems useless. The information doesn't change.
When doing ./regenerate-makefiles.sh in moses20080711, it's OK.
Does it matter?
2. mert-moses.pl
I added --hierarchical --glue-grammar, deleted --reordering
msd-bidirectional-fe \, the extraction seems correct.
I come up with something like "extractor not found", so I modified
mert-moses.pl: line296 to $mertdir = "$SCRIPTS_ROOTDIR/../../../mert";
Then
${mosesScript}/training/mert-moses.pl \
"${dataDir}/${devSet}/dev.src" \
"${dataDir}/${devSet}/dev.ref" \
"${decoder}" \
"${extractini}" \
--working-dir "${mertDir}" \
--decoder-flags "-v 0" \
--no-filter-phrase-table
--no-filter-phrase-table is used to avoid filtering rule table. Or should I
just switch my $___FILTER_PHRASE_TABLE in mert-moses.pl to 0 ?
What should I do if I want to filter hierarchical phrase table in
mert-moses.pl? if seems the filtering is only for phrase-based model.
Here are the output information:
Using SCRIPTS_ROOTDIR:
/home/lxh/1moses-latest/mosesdecoder/trunk/scripts/target/scripts-20110628-1
353
Assuming
--mertdir=/home/lxh/1moses-latest/mosesdecoder/trunk/scripts/target/scripts-
20110628-1353/../../../mert
Executing: mkdir -p /home/lxh/1moses-test-HPB/0615-mert
run 1 start at Wed Jun 29 11:21:00 CST 2011
Parsing --decoder-flags: |-v 0|
Saving new config to: ./run1.moses.ini
Saved: ./run1.moses.ini
(1) run decoder to produce n-best lists
params = -v 0
Normalizing lambdas: -1 0.5000 0.20 0.20 0.20 0.20 0.20 1.0
DECODER_CFG = -w %.6f -lm %.6f -tm %.6f %.6f %.6f %.6f %.6f %.6f
values = -0.285714285714286 0.142857142857143 0.0571428571428571
0.0571428571428571 0.0571428571428571 0.0571428571428571 0.0571428571428571
0.285714285714286
decoder_config = -w -0.285714 -lm 0.142857 -tm 0.057143 0.057143 0.057143
0.057143 0.057143 0.285714
Executing:
/home/lxh/1moses-latest/mosesdecoder/trunk/moses-chart-cmd/src/moses_chart
-v 0 -config /home/lxh/1moses-test-HPB/0615-train/model/moses.ini
-inputtype 0 -w -0.285714 -lm 0.142857 -tm 0.057143 0.057143 0.057143
0.057143 0.057143 0.285714 -n-best-list run1.best100.out 100 -input-file
/home/lxh/1moses-test-HPB/x/dev/dev.src > run1.out
/home/lxh/1moses-test-HPB/x/patent.title.10w.o5.gz: line 34: warning:
non-zero probability for <unk> in closed-vocabulary LM
Start loading new format pt model : [0.000] seconds
moses_chart: Phrase.cpp:236: void
Moses::Phrase::CreateFromStringNewFormat(Moses::FactorDirection, const
std::vector<long unsigned int, std::allocator<long unsigned int> >&, const
std::string&, const std::string&, Moses::Word&): Assertion `nextPos !=
string::npos' failed.
Aborted
Exit code: 134
The decoder died. CONFIG WAS -w -0.285714 -lm 0.142857 -tm 0.057143 0.057143
0.057143 0.057143 0.057143 0.285714
I believe this must be some simple mistakes, maybe I've used wrong
parameters, but I can't find the answer.
Anyone can help?
----------------------------------------------------
Best wishes!
Xianhua Li
_______________________________________________
Moses-support mailing list
[email protected]
http://mailman.mit.edu/mailman/listinfo/moses-support
