I'm updating to the newest moses trunk thread, 3981. This command line
worked with rev 3675 but now fails:
./configure --with-srilm=/opt/lib/srilm \
--with-irstlm=/opt/lib/irstlm \
--with-randlm=/opt/lib/randlm \
--enable-threads \
--with-xmlrpc-c \
--with-boost-thread
Configure reports the boost libraries are installed but then fails (see
configure output below). Has there been a change that obsoletes the
--with-boost-thread option?
Without the --with-boost-thread option, configure still finds the boost
libraries and completes without error. However, "make -j 2" starts with
the following output and hangs. Both CPUs peg 100%, RAM reaches +90%
quickly and swap file usage grows. It's still running, but I expect it
will crash.
Other details:
OS: Ubuntu 10.04 server
Build environment: apt-get install linux-headers-`uname -r`
build-essential zlib1g-dev automake libtool libboost-all-dev
libxmlrpc-c3-dev
SRILM release 1.5.12
IRSTLM release 5.60.03
RANDLM release 0.20
Thanks,
Tom
user@host:~$ make -j 2
(CDPATH="${ZSH_VERSION+.}:" && cd . && /bin/bash
/opt/src/mosesdecoder/missing --run autoheader)
rm -f stamp-h1
touch config.h.in
cd . && /bin/bash ./config.status config.h
config.status: creating config.h
config.status: config.h is unchanged
make all-recursive
make[1]: Entering directory `/opt/src/mosesdecoder'
Making all in kenlm
make[2]: Entering directory `/opt/src/mosesdecoder/kenlm'
/bin/bash ../libtool --tag=CXX --mode=compile g++ -DHAVE_CONFIG_H
-I. -I.. -W -Wall -ffor-scope -D_FILE_OFFSET_BITS=64 -D_LARGE_FILES
-pthread -DTRACE_ENABLE=1 -DWITH_THREADS -I/opt/lib/srilm/include
-I/opt/lib/irstlm/include -I/opt/src/mosesdecoder/kenlm
-I/opt/lib/randlm/include -g -O2 -MT lm_exception.lo -MD -MP -MF
.deps/lm_exception.Tpo -c -o lm_exception.lo `test -f
'lm/lm_exception.cc' || echo './'`lm/lm_exception.cc
/bin/bash ../libtool --tag=CXX --mode=compile g++ -DHAVE_CONFIG_H
-I. -I.. -W -Wall -ffor-scope -D_FILE_OFFSET_BITS=64 -D_LARGE_FILES
-pthread -DTRACE_ENABLE=1 -DWITH_THREADS -I/opt/lib/srilm/include
-I/opt/lib/irstlm/include -I/opt/src/mosesdecoder/kenlm
-I/opt/lib/randlm/include -g -O2 -MT config.lo -MD -MP -MF
.deps/config.Tpo -c -o config.lo `test -f 'lm/config.cc' || echo
'./'`lm/config.cc
config.log:
.
.
.
checking for XMLRPC-C... ok
configure: trace enabled (default)
configure: Using Boost library
checking for Boost headers version >= 103600... yes
checking for Boost's header version... 1_40
configure: Building threaded moses
checking for the flags needed to use pthreads... -pthread
checking for the toolset name used by Boost for g++... gcc44 -gcc
checking boost/thread.hpp usability... yes
checking boost/thread.hpp presence... yes
checking for boost/thread.hpp... yes
checking for the Boost thread library... yes
.
.
.
configure: WARNING: unrecognized options: --with-boost-thread
On Sat, 12 Mar 2011 15:01:14 +0100, Alexander Fraser
<[email protected]> wrote:
> Hi Barry,
>
> I got everything to work, thanks again.
>
> In case this is useful to someone else... I made two false
> assumptions:
>
> 1) RandLM 0.20 supports multi-threading by default. This is not true,
> you first need to uncomment two lines in the Makefile (this is
> documented in the README in src/ ). If you don't do this, and you
> build a multi-threaded version of Moses against the single-threaded
> randlm, then the build succeeds (and you can get a usage by running
> the binary with no arguments), but when you try to run a regression
> test, it dumps core.
>
> 2) The regression tests fail with no external LMs because of some
> problem. This is also not true, the regression tests require you to
> configure with SRILM. (For some reason I thought they now worked with
> KenLM)
>
> Cheers, Alex
>
>
> On Sat, Mar 12, 2011 at 12:49 PM, Barry Haddow <[email protected]>
> wrote:
>> Hi Alex
>>
>> Good to hear you got boost working. However moses shouldn't dump
>> core, and the
>> current svn version passes all regression tests for me.
>>
>> Can you get a stack trace from the core file? You may have to do a
>> non-
>> optimised build to get something sensible (run export CXXFLAGS=-g
>> before
>> ./configure, I think),
>>
>> cheers - Barry
>>
>> On Saturday 12 Mar 2011 11:39:56 Alexander Fraser wrote:
>>> Hi Barry,
>>>
>>> Thanks for the reminder to check config.log, it was picking up
>>> /home/users6/fraser/include/boost-1_34_1_AMF_DISABLED_THIS rather
>>> than
>>> /home/users6/fraser/include/boost.
>>>
>>> It now compiles, and you can get a usage. (I had to upgrade IRSTLM
>>> from 5.50.02 (which there is currently a warning message about) to
>>> 5.60.1 to compile (I got 5.60.01 from the IRSTLM home page,
>>> sourceforge offers 5.50.01); I also no longer need the
>>> LD_LIBRARY_PATH).
>>>
>>> However, it dumps core as soon as you try to do anything (e.g., the
>>> regression tests on both chart and phrase decoders).
>>>
>>> I tried a fresh checkout, with *no* configure flags (i.e., no
>>> external
>>> language models, no boost). This also dumps core. Let me know if
>>> you
>>> can not repeat this, and thanks for your help!
>>>
>>> Cheers, Alex
>>>
>>> On Fri, Mar 11, 2011 at 7:09 PM, Barry Haddow
>>> <[email protected]> wrote:
>>> > Hi Alex
>>> >
>>> > The boost macro was recently changed to this one
>>> > https://github.com/tsuna/boost.m4
>>> > which seems to work better in most circumstances.
>>> >
>>> > Do you have boost installed in /home/users6/fraser (with lib and
>>> > include), or just compiled there? Is its version > 1.36? Can you
>>> send me
>>> > your config.log?
>>> >
>>> > best regards - Barry
>>> >
>>> > On Friday 11 March 2011 17:46, Alexander Fraser wrote:
>>> >> Hi Folks,
>>> >>
>>> >> There seems to be some brokenness in configure for version 3926.
>>> I
>>> >> have boost 1.45 installed in my home directory, and the check
>>> fails:
>>> >>
>>> >> % ./regenerate-makefiles.sh
>>> >> % ./configure
>>> --with-srilm=/home/users6/fraser/statmt/srilm-1.5.7
>>> >> --with-irstlm=/home/users6/fraser/statmt/irstlm-5.50.02
>>> >> --with-randlm=/home/users6/fraser/statmt/randlm-v0.20
>>> --enable-threads
>>> >> --with-boost=/home/users6/fraser
>>> --with-boost-thread=boost_thread
>>> >> ...
>>> >> configure: WARNING: unrecognized options: --with-boost-thread
>>> >> ...
>>> >> configure: Using Boost library
>>> >> checking for Boost headers version >= 103600... no
>>> >> configure: error: cannot find Boost headers version >= 103600
>>> >>
>>> >>
>>> >> It works fine in version 3725:
>>> >>
>>> >> % ./regenerate-makefiles.sh
>>> >> % ./configure
>>> --with-srilm=/home/users6/fraser/statmt/srilm-1.5.7
>>> >> --with-irstlm=/home/users6/fraser/statmt/irstlm-5.50.02
>>> >> --with-randlm=/home/users6/fraser/statmt/randlm-v0.20
>>> --enable-threads
>>> >> --with-boost=/home/users6/fraser
>>> --with-boost-thread=boost_thread
>>> >> ...
>>> >> % make -j 4
>>> >> ...
>>> >> % export LD_LIBRARY_PATH=/home/users6/fraser/lib
>>> >> % moses-cmd/src/moses
>>> >> (prints usage)
>>> >>
>>> >>
>>> >> Thanks!!
>>> >>
>>> >> Cheers, Alex
>>> >> _______________________________________________
>>> >> Moses-support mailing list
>>> >> [email protected]
>>> >> http://mailman.mit.edu/mailman/listinfo/moses-support
>>> >
>>> > --
>>> > The University of Edinburgh is a charitable body, registered in
>>> > Scotland, with registration number SC005336.
>>>
>>
>>
> _______________________________________________
> Moses-support mailing list
> [email protected]
> http://mailman.mit.edu/mailman/listinfo/moses-support
_______________________________________________
Moses-support mailing list
[email protected]
http://mailman.mit.edu/mailman/listinfo/moses-support
