Re: [Moses-support] Building the server with bjam

2011-11-30 Thread Kenneth Heafield
Hi, If xmlrpc-c is installed in standard paths including the abyss server option, then the following command should return zero when run from bash: g++ -include xmlrpc-c/base.hpp -lxmlrpc_server_abyss++ -x c++ - 'int main() {}' and server will be compiled automatically. Otherwise, it expects a

[Moses-support] add new feature into decoder

2011-11-30 Thread Hoai-Thu Vuong
Hi everyone, currently, I want to add new feature into moses decoder with chart decoding, I did as document, but I found that not work, the value of total score and element of score in ScoreComponent doesn't change. I used GetScoreBreakDown() and print all value in vector, then I saw that value

Re: [Moses-support] Removing duplicates when merging nbest lists for MERT

2011-11-30 Thread Barry Haddow
Hi Thomas Yes, you're correct, mert doesn't remove duplicates in the nbest lists. It's something that we intended to do (and probably mentioned in the mert paper) but somehow never got around to it. As Lane pointed out, you have to be careful to do the duplicate removal correctly. You can

Re: [Moses-support] add new feature into decoder

2011-11-30 Thread Barry Haddow
Hi Thu Have you verified that your feature is being called, and inserting values into the feature vector? What do you mean when you say that element of score in ScoreComponent doesn't change ? Do you mean that your new feature has value 0? Or is it missing? To add a feature to moses chart

Re: [Moses-support] Building the server with bjam

2011-11-30 Thread KTamas
Hi This is what I get: g++ -include xmlrpc-c/base.hpp -lxmlrpc_server_abyss++ -x c++ - 'int main() {}' /usr/lib/gcc/x86_64-linux-gnu/4.4.3/../../../../lib/libxmlrpc_server_abyss++.so: undefined reference to `xmlrpc_c::registryPtr::get() const'

Re: [Moses-support] Building the server with bjam

2011-11-30 Thread Kenneth Heafield
Fair enough. I've rewritten the test. Does it work now? This library is harder to link against than SRILM. . . Kenneth On 11/30/11 12:19, Kádár Tamás (KTamas) wrote: Hi This is what I get: g++ -include xmlrpc-c/base.hpp -lxmlrpc_server_abyss++ -x c++ - 'int main() {}'

Re: [Moses-support] Building the server with bjam

2011-11-30 Thread KTamas
Yup, that fixed it for me, just compiled a fresh moses and the server is compiled and working. Thanks a lot! It's great to see an open-source software with such an awesome community and support. Best regards, Tamas On Wed, Nov 30, 2011 at 1:53 PM, Kenneth Heafield mo...@kheafield.com wrote:

[Moses-support] Scripts that are not installed

2011-11-30 Thread Kenneth Heafield
Dear Moses, The following files exist in scripts or are compiled in scripts but were not installed by the pre-existing Makefile. The Jamfile currently just installs the same files when passed --install-scripts. Should these files be added? Kenneth Directories: regression-testing,

Re: [Moses-support] Removing duplicates when merging nbest lists for MERT

2011-11-30 Thread Thomas Schoenemann
Hi! Well, it doesn't have to be the same target translation, just the exact same score vector (and the same feature vector, of course). I agree that MERT is working correctly, my mail was always about the efficiency. In my experiments MERT took the major part of the running time, and I believe

Re: [Moses-support] Scripts that are not installed

2011-11-30 Thread John Morgan
The script merge_alignment.py should be in the scripts directory too to run with mgiza. On 11/30/11, Kenneth Heafield mo...@kheafield.com wrote: Dear Moses, The following files exist in scripts or are compiled in scripts but were not installed by the pre-existing Makefile. The Jamfile

Re: [Moses-support] Scripts that are not installed

2011-11-30 Thread Kenneth Heafield
On the basis that the released files set probably wasn't maintained, I went ahead and threw most everything in. It now covers everything except these directories: tests, regression-testing, other, bin (generated by bjam) and these source files:

Re: [Moses-support] Scripts that are not installed

2011-11-30 Thread Barry Haddow
Hi John This script is part of mgiza, rather than moses, so it should be copied to the --with-giza directory, along with mgizapp cheers - Barry On Wednesday 30 Nov 2011 19:51:18 John Morgan wrote: The script merge_alignment.py should be in the scripts directory too to run with mgiza. On

Re: [Moses-support] Scripts that are not installed

2011-11-30 Thread Kenneth Heafield
I'd prefer to handle GIZA++ like any other dependency: installed in a read-only directory. On 11/30/11 20:46, Barry Haddow wrote: Hi John This script is part of mgiza, rather than moses, so it should be copied to the --with-giza directory, along with mgizapp cheers - Barry On

Re: [Moses-support] --mgiza vs. --parallel

2011-11-30 Thread KTamas
Er, no. As far as I can observe, --parallel parallelizes some tasks that are possible into 2 threads, one for e2f, one for f2e. For step 2, giza++, it starts two threads, one for e2f and one for f2e. Then _that_ is parallelized by mgiza into whatever number of processes I tell it to (the original

Re: [Moses-support] --mgiza vs. --parallel

2011-11-30 Thread Barry Haddow
Hi Tamas The behaviour seems reasonable to me. The flag --parallel tells train-model.perl to run processes simultaneously if possible, so it will run giza in both directions at the same time. The --mgiza-cpus is just for mgiza. Why not just specify 4 cpus for mgiza, if you only have 8 in

Re: [Moses-support] --mgiza vs. --parallel

2011-11-30 Thread Kenneth Heafield
Seems the right way would be to account for the number of CPUs used by a process. But then you've starting writing PBS. Wrap the mgiza command with flock? On 11/30/11 22:19, Barry Haddow wrote: Hi Tamas The behaviour seems reasonable to me. The flag --parallel tells train-model.perl to

Re: [Moses-support] add new feature into decoder

2011-11-30 Thread Hieu Hoang
Hi thu Can u send me your code via personal mail and I'll try and see what's wrong Best if its on GitHub so I can just pull it Hieu Sent from my flying horse On 30 Nov 2011, at 06:52 PM, Hoai-Thu Vuong thuv...@gmail.com wrote: my feature has value 0, I did exactly as the manual, but the

[Moses-support] creating LM with IRST toolkit

2011-11-30 Thread Hieu Hoang
hi all can anyone tell me if creating LM with the IRST toolkit is integrated into the EMS yet? if not, is this the entirety of what has to be run? cat $CORPUSFILE | $IRSTLM/bin/add-start-end.sh | gzip -c temp/monolingual.setagged.gz $IRSTLM/bin/build-lm.sh -t stat4 -i gunzip -c

Re: [Moses-support] creating LM with IRST toolkit

2011-11-30 Thread Nicola Bertoldi
Hi Hieu On Dec 1, 2011, at 8:34 AM, Hieu Hoang wrote: hi all can anyone tell me if creating LM with the IRST toolkit is integrated into the EMS yet? I let anyone else to answer this point. if not, is this the entirety of what has to be run? cat $CORPUSFILE |