Thanks Ken. It's possible I have other problems on this host. So, if you can't reproduce I'll have to rebuild.
@Others: regarding configure's WARNING: unrecognized options: --with-boost-thread, is this option still required? Tom On Thu, 19 May 2011 23:05:53 -0400, Kenneth Heafield <[email protected]> wrote: > Hmmm. . . looks like it's crashing on lm/lm_exception.cc and > lm/config.cc which are mine. But the compiler should throw you an > error > instead of taking infinite memory. See if I can reproduce. > > On 05/19/11 22:58, [email protected] wrote: >> I'm updating to the newest moses trunk thread, 3981. This command >> line >> worked with rev 3675 but now fails: >> >> ./configure --with-srilm=/opt/lib/srilm \ >> --with-irstlm=/opt/lib/irstlm \ >> --with-randlm=/opt/lib/randlm \ >> --enable-threads \ >> --with-xmlrpc-c \ >> --with-boost-thread >> >> Configure reports the boost libraries are installed but then fails >> (see >> configure output below). Has there been a change that obsoletes the >> --with-boost-thread option? >> >> Without the --with-boost-thread option, configure still finds the >> boost >> libraries and completes without error. However, "make -j 2" starts >> with >> the following output and hangs. Both CPUs peg 100%, RAM reaches >> +90% >> quickly and swap file usage grows. It's still running, but I expect >> it >> will crash. >> >> Other details: >> OS: Ubuntu 10.04 server >> Build environment: apt-get install linux-headers-`uname -r` >> build-essential zlib1g-dev automake libtool libboost-all-dev >> libxmlrpc-c3-dev >> SRILM release 1.5.12 >> IRSTLM release 5.60.03 >> RANDLM release 0.20 >> >> Thanks, >> Tom >> >> user@host:~$ make -j 2 >> (CDPATH="${ZSH_VERSION+.}:" && cd . && /bin/bash >> /opt/src/mosesdecoder/missing --run autoheader) >> rm -f stamp-h1 >> touch config.h.in >> cd . && /bin/bash ./config.status config.h >> config.status: creating config.h >> config.status: config.h is unchanged >> make all-recursive >> make[1]: Entering directory `/opt/src/mosesdecoder' >> Making all in kenlm >> make[2]: Entering directory `/opt/src/mosesdecoder/kenlm' >> /bin/bash ../libtool --tag=CXX --mode=compile g++ >> -DHAVE_CONFIG_H >> -I. -I.. -W -Wall -ffor-scope -D_FILE_OFFSET_BITS=64 >> -D_LARGE_FILES >> -pthread -DTRACE_ENABLE=1 -DWITH_THREADS -I/opt/lib/srilm/include >> -I/opt/lib/irstlm/include -I/opt/src/mosesdecoder/kenlm >> -I/opt/lib/randlm/include -g -O2 -MT lm_exception.lo -MD -MP -MF >> .deps/lm_exception.Tpo -c -o lm_exception.lo `test -f >> 'lm/lm_exception.cc' || echo './'`lm/lm_exception.cc >> /bin/bash ../libtool --tag=CXX --mode=compile g++ >> -DHAVE_CONFIG_H >> -I. -I.. -W -Wall -ffor-scope -D_FILE_OFFSET_BITS=64 >> -D_LARGE_FILES >> -pthread -DTRACE_ENABLE=1 -DWITH_THREADS -I/opt/lib/srilm/include >> -I/opt/lib/irstlm/include -I/opt/src/mosesdecoder/kenlm >> -I/opt/lib/randlm/include -g -O2 -MT config.lo -MD -MP -MF >> .deps/config.Tpo -c -o config.lo `test -f 'lm/config.cc' || echo >> './'`lm/config.cc >> >> >> config.log: >> . >> . >> . >> checking for XMLRPC-C... ok >> configure: trace enabled (default) >> configure: Using Boost library >> checking for Boost headers version >= 103600... yes >> checking for Boost's header version... 1_40 >> configure: Building threaded moses >> checking for the flags needed to use pthreads... -pthread >> checking for the toolset name used by Boost for g++... gcc44 -gcc >> checking boost/thread.hpp usability... yes >> checking boost/thread.hpp presence... yes >> checking for boost/thread.hpp... yes >> checking for the Boost thread library... yes >> . >> . >> . >> configure: WARNING: unrecognized options: --with-boost-thread >> >> >> >> On Sat, 12 Mar 2011 15:01:14 +0100, Alexander Fraser >> <[email protected]> wrote: >>> Hi Barry, >>> >>> I got everything to work, thanks again. >>> >>> In case this is useful to someone else... I made two false >>> assumptions: >>> >>> 1) RandLM 0.20 supports multi-threading by default. This is not >>> true, >>> you first need to uncomment two lines in the Makefile (this is >>> documented in the README in src/ ). If you don't do this, and you >>> build a multi-threaded version of Moses against the single-threaded >>> randlm, then the build succeeds (and you can get a usage by running >>> the binary with no arguments), but when you try to run a regression >>> test, it dumps core. >>> >>> 2) The regression tests fail with no external LMs because of some >>> problem. This is also not true, the regression tests require you to >>> configure with SRILM. (For some reason I thought they now worked >>> with >>> KenLM) >>> >>> Cheers, Alex >>> >>> >>> On Sat, Mar 12, 2011 at 12:49 PM, Barry Haddow >>> <[email protected]> >>> wrote: >>>> Hi Alex >>>> >>>> Good to hear you got boost working. However moses shouldn't dump >>>> core, and the >>>> current svn version passes all regression tests for me. >>>> >>>> Can you get a stack trace from the core file? You may have to do a >>>> non- >>>> optimised build to get something sensible (run export CXXFLAGS=-g >>>> before >>>> ./configure, I think), >>>> >>>> cheers - Barry >>>> >>>> On Saturday 12 Mar 2011 11:39:56 Alexander Fraser wrote: >>>>> Hi Barry, >>>>> >>>>> Thanks for the reminder to check config.log, it was picking up >>>>> /home/users6/fraser/include/boost-1_34_1_AMF_DISABLED_THIS rather >>>>> than >>>>> /home/users6/fraser/include/boost. >>>>> >>>>> It now compiles, and you can get a usage. (I had to upgrade >>>>> IRSTLM >>>>> from 5.50.02 (which there is currently a warning message about) >>>>> to >>>>> 5.60.1 to compile (I got 5.60.01 from the IRSTLM home page, >>>>> sourceforge offers 5.50.01); I also no longer need the >>>>> LD_LIBRARY_PATH). >>>>> >>>>> However, it dumps core as soon as you try to do anything (e.g., >>>>> the >>>>> regression tests on both chart and phrase decoders). >>>>> >>>>> I tried a fresh checkout, with *no* configure flags (i.e., no >>>>> external >>>>> language models, no boost). This also dumps core. Let me know if >>>>> you >>>>> can not repeat this, and thanks for your help! >>>>> >>>>> Cheers, Alex >>>>> >>>>> On Fri, Mar 11, 2011 at 7:09 PM, Barry Haddow >>>>> <[email protected]> wrote: >>>>>> Hi Alex >>>>>> >>>>>> The boost macro was recently changed to this one >>>>>> https://github.com/tsuna/boost.m4 >>>>>> which seems to work better in most circumstances. >>>>>> >>>>>> Do you have boost installed in /home/users6/fraser (with lib and >>>>>> include), or just compiled there? Is its version > 1.36? Can you >>>>> send me >>>>>> your config.log? >>>>>> >>>>>> best regards - Barry >>>>>> >>>>>> On Friday 11 March 2011 17:46, Alexander Fraser wrote: >>>>>>> Hi Folks, >>>>>>> >>>>>>> There seems to be some brokenness in configure for version >>>>>>> 3926. >>>>> I >>>>>>> have boost 1.45 installed in my home directory, and the check >>>>> fails: >>>>>>> >>>>>>> % ./regenerate-makefiles.sh >>>>>>> % ./configure >>>>> --with-srilm=/home/users6/fraser/statmt/srilm-1.5.7 >>>>>>> --with-irstlm=/home/users6/fraser/statmt/irstlm-5.50.02 >>>>>>> --with-randlm=/home/users6/fraser/statmt/randlm-v0.20 >>>>> --enable-threads >>>>>>> --with-boost=/home/users6/fraser >>>>> --with-boost-thread=boost_thread >>>>>>> ... >>>>>>> configure: WARNING: unrecognized options: --with-boost-thread >>>>>>> ... >>>>>>> configure: Using Boost library >>>>>>> checking for Boost headers version >= 103600... no >>>>>>> configure: error: cannot find Boost headers version >= 103600 >>>>>>> >>>>>>> >>>>>>> It works fine in version 3725: >>>>>>> >>>>>>> % ./regenerate-makefiles.sh >>>>>>> % ./configure >>>>> --with-srilm=/home/users6/fraser/statmt/srilm-1.5.7 >>>>>>> --with-irstlm=/home/users6/fraser/statmt/irstlm-5.50.02 >>>>>>> --with-randlm=/home/users6/fraser/statmt/randlm-v0.20 >>>>> --enable-threads >>>>>>> --with-boost=/home/users6/fraser >>>>> --with-boost-thread=boost_thread >>>>>>> ... >>>>>>> % make -j 4 >>>>>>> ... >>>>>>> % export LD_LIBRARY_PATH=/home/users6/fraser/lib >>>>>>> % moses-cmd/src/moses >>>>>>> (prints usage) >>>>>>> >>>>>>> >>>>>>> Thanks!! >>>>>>> >>>>>>> Cheers, Alex >>>>>>> _______________________________________________ >>>>>>> Moses-support mailing list >>>>>>> [email protected] >>>>>>> http://mailman.mit.edu/mailman/listinfo/moses-support >>>>>> >>>>>> -- >>>>>> The University of Edinburgh is a charitable body, registered in >>>>>> Scotland, with registration number SC005336. >>>>> >>>> >>>> >>> _______________________________________________ >>> Moses-support mailing list >>> [email protected] >>> http://mailman.mit.edu/mailman/listinfo/moses-support >> >> _______________________________________________ >> Moses-support mailing list >> [email protected] >> http://mailman.mit.edu/mailman/listinfo/moses-support > _______________________________________________ > Moses-support mailing list > [email protected] > http://mailman.mit.edu/mailman/listinfo/moses-support _______________________________________________ Moses-support mailing list [email protected] http://mailman.mit.edu/mailman/listinfo/moses-support
