Re: [Moses-support] Erratic IRSTLM compile failures
the problem was due to missing dependencies and occurred only with parallel compilation (make -jN). the revision 409 solves the problem. best regards, Nicola Bertoldi On May 24, 2011, at 4:09 AM, Tom Hoar wrote: We're updating DoMY with the newest Moses components. Our IRLSTM installation script includes this: cpus=`grep -c ^processor /proc/cpuinfo` export MACHTYPE=`uname -m` export LC_ALL=C export IRSTLM=/usr/src/irstlm ./regenerate-makefiles.sh $log ./configure --prefix=$IRSTLM --enable-caching $log make -j $cpus $log make -j $cpus install $log In testing our installation scripts, we rebuild a clean system from a new copy of the original svn source many times. We are using the newest svn rev 406 although the problem also happened with svn 405. The problem is, make -j $cpus fails intermittently, about 1 of 3 or 4 times. All references to 'ld' and 'libtool' in the configure log report everything is okay. The error occurs using make with/without -j. Details below. Thanks Tom Build environment: Ubuntu 10.04 LTS Server, 64-bit libtool version: ltmain.sh (GNU libtool) 2.2.6b g++ version: g++ (Ubuntu 4.4.3-4ubuntu5) 4.4.3 Successful make log output: mv -f .deps/tlm.Tpo .deps/tlm.Po /bin/bash ../libtool --tag=CXX --mode=link g++ -isystem/usr/include -W -Wall -ffor-scope -D_FILE_OFFSET_BITS=64 -D_LARGE_FILES -DMYCODESIZE=3-o dict dict.o -lirstlm -lz libtool: link: ranlib .libs/libirstlm.a libtool: link: g++ -isystem/usr/include -W -Wall -ffor-scope -D_FILE_OFFSET_BITS=64 -D_LARGE_FILES -DMYCODESIZE=3 -o dict dict.o -lirstlm -lz libtool: link: ( cd .libs rm -f libirstlm.la ln -s ../libirstlm.la libirstlm.la ) make[2]: Leaving directory `/usr/src/irstlm/src' make[1]: Leaving directory `/usr/src/irstlm' Failed make log output: mv -f .deps/tlm.Tpo .deps/tlm.Po /bin/bash ../libtool --tag=CXX --mode=link g++ -isystem/usr/include -W -Wall -ffor-scope -D_FILE_OFFSET_BITS=64 -D_LARGE_FILES -DMYCODESIZE=3-o dict dict.o -lirstlm -lz libtool: link: ranlib .libs/libirstlm.a libtool: link: g++ -isystem/usr/include -W -Wall -ffor-scope -D_FILE_OFFSET_BITS=64 -D_LARGE_FILES -DMYCODESIZE=3 -o dict dict.o -lirstlm -lz /usr/bin/ld: cannot find -lirstlm collect2: ld returned 1 exit status make[2]: *** [dict] Error 1 make[2]: *** Waiting for unfinished jobs libtool: link: ( cd .libs rm -f libirstlm.la ln -s ../libirstlm.la libirstlm.la ) make[2]: Leaving directory `/usr/src/irstlm/src' make[1]: *** [all-recursive] Error 1 make[1]: Leaving directory `/usr/src/irstlm' make: *** [all] Error 2 ___ Moses-support mailing list Moses-support@mit.edumailto:Moses-support@mit.edu http://mailman.mit.edu/mailman/listinfo/moses-support ___ Moses-support mailing list Moses-support@mit.edu http://mailman.mit.edu/mailman/listinfo/moses-support
Re: [Moses-support] Erratic IRSTLM compile failures
Nonetheless, after 10 install/reinstalls, this update seems to have fixed the problem on all three platforms. Before, it would have failed 2-3 times out of 10. Thanks, Tom On Tue, 24 May 2011 14:28:23 +0700, Tom Hoar tah...@precisiontranslationtools.com wrote: Hmm... I'll try the new update, but I had the same problem when forcing -j1 and without the -j option. Get back to you soon. Tom On Tue, 24 May 2011 07:17:22 +, Nicola Bertoldi berto...@fbk.eu wrote: the problem was due to missing dependencies and occurred only with parallel compilation (make -jN). the revision 409 solves the problem. best regards, Nicola Bertoldi On May 24, 2011, at 4:09 AM, Tom Hoar wrote: We're updating DoMY with the newest Moses components. Our IRLSTM installation script includes this: cpus=`grep -c ^processor /proc/cpuinfo` export MACHTYPE=`uname -m` export LC_ALL=C export IRSTLM=/usr/src/irstlm ./regenerate-makefiles.sh $log ./configure --prefix=$IRSTLM --enable-caching $log make -j $cpus $log make -j $cpus install $log In testing our installation scripts, we rebuild a clean system from a new copy of the original svn source many times. We are using the newest svn rev 406 although the problem also happened with svn 405. The problem is, make -j $cpus fails intermittently, about 1 of 3 or 4 times. All references to 'ld' and 'libtool' in the configure log report everything is okay. The error occurs using make with/without -j. Details below. Thanks Tom Build environment: Ubuntu 10.04 LTS Server, 64-bit libtool version: ltmain.sh (GNU libtool) 2.2.6b g++ version: g++ (Ubuntu 4.4.3-4ubuntu5) 4.4.3 Successful make log output: mv -f .deps/tlm.Tpo .deps/tlm.Po /bin/bash ../libtool --tag=CXX --mode=link g++ -isystem/usr/include -W -Wall -ffor-scope -D_FILE_OFFSET_BITS=64 -D_LARGE_FILES -DMYCODESIZE=3-o dict dict.o -lirstlm -lz libtool: link: ranlib .libs/libirstlm.a libtool: link: g++ -isystem/usr/include -W -Wall -ffor-scope -D_FILE_OFFSET_BITS=64 -D_LARGE_FILES -DMYCODESIZE=3 -o dict dict.o -lirstlm -lz libtool: link: ( cd .libs rm -f libirstlm.la ln -s ../libirstlm.la libirstlm.la ) make[2]: Leaving directory `/usr/src/irstlm/src' make[1]: Leaving directory `/usr/src/irstlm' Failed make log output: mv -f .deps/tlm.Tpo .deps/tlm.Po /bin/bash ../libtool --tag=CXX --mode=link g++ -isystem/usr/include -W -Wall -ffor-scope -D_FILE_OFFSET_BITS=64 -D_LARGE_FILES -DMYCODESIZE=3-o dict dict.o -lirstlm -lz libtool: link: ranlib .libs/libirstlm.a libtool: link: g++ -isystem/usr/include -W -Wall -ffor-scope -D_FILE_OFFSET_BITS=64 -D_LARGE_FILES -DMYCODESIZE=3 -o dict dict.o -lirstlm -lz /usr/bin/ld: cannot find -lirstlm collect2: ld returned 1 exit status make[2]: *** [dict] Error 1 make[2]: *** Waiting for unfinished jobs libtool: link: ( cd .libs rm -f libirstlm.la ln -s ../libirstlm.la libirstlm.la ) make[2]: Leaving directory `/usr/src/irstlm/src' make[1]: *** [all-recursive] Error 1 make[1]: Leaving directory `/usr/src/irstlm' make: *** [all] Error 2 ___ Moses-support mailing list Moses-support@mit.edumailto:Moses-support@mit.edu http://mailman.mit.edu/mailman/listinfo/moses-support ___ Moses-support mailing list Moses-support@mit.edu http://mailman.mit.edu/mailman/listinfo/moses-support
Re: [Moses-support] Erratic IRSTLM compile failures
Note: I reverted to the irstlm-5.60.02.tgz tarball and the problem disappeared. I'll use this revision for now. Tom On Tue, 24 May 2011 09:09:49 +0700, Tom Hoar wrote: We're updating DoMY with the newest Moses components. Our IRLSTM installation script includes this: cpus=`grep -c ^processor /proc/cpuinfo` export MACHTYPE=`uname -m` export LC_ALL=C export IRSTLM=/usr/src/irstlm ./regenerate-makefiles.sh $log ./configure --prefix=$IRSTLM --enable-caching $log make -j $cpus $log make -j $cpus install $log In testing our installation scripts, we rebuild a clean system from a new copy of the original svn source many times. We are using the newest svn rev 406 although the problem also happened with svn 405. The problem is, make -j $cpus fails intermittently, about 1 of 3 or 4 times. All references to 'ld' and 'libtool' in the configure log report everything is okay. The error occurs using make with/without -j. Details below. Thanks Tom Build environment: Ubuntu 10.04 LTS Server, 64-bit libtool version: ltmain.sh (GNU libtool) 2.2.6b g++ version: g++ (Ubuntu 4.4.3-4ubuntu5) 4.4.3 Successful make log output: mv -f .deps/tlm.Tpo .deps/tlm.Po /bin/bash ../libtool --tag=CXX --mode=link g++ -isystem/usr/include -W -Wall -ffor-scope -D_FILE_OFFSET_BITS=64 -D_LARGE_FILES -DMYCODESIZE=3 -o dict dict.o -lirstlm -lz libtool: link: ranlib .libs/libirstlm.a libtool: link: g++ -isystem/usr/include -W -Wall -ffor-scope -D_FILE_OFFSET_BITS=64 -D_LARGE_FILES -DMYCODESIZE=3 -o dict dict.o -lirstlm -lz libtool: link: ( cd .libs rm -f libirstlm.la ln -s ../libirstlm.la libirstlm.la ) make[2]: Leaving directory `/usr/src/irstlm/src' make[1]: Leaving directory `/usr/src/irstlm' Failed make log output: mv -f .deps/tlm.Tpo .deps/tlm.Po /bin/bash ../libtool --tag=CXX --mode=link g++ -isystem/usr/include -W -Wall -ffor-scope -D_FILE_OFFSET_BITS=64 -D_LARGE_FILES -DMYCODESIZE=3 -o dict dict.o -lirstlm -lz libtool: link: ranlib .libs/libirstlm.a libtool: link: g++ -isystem/usr/include -W -Wall -ffor-scope -D_FILE_OFFSET_BITS=64 -D_LARGE_FILES -DMYCODESIZE=3 -o dict dict.o -lirstlm -lz /usr/bin/ld: cannot find -lirstlm collect2: ld returned 1 exit status make[2]: *** [dict] Error 1 make[2]: *** Waiting for unfinished jobs libtool: link: ( cd .libs rm -f libirstlm.la ln -s ../libirstlm.la libirstlm.la ) make[2]: Leaving directory `/usr/src/irstlm/src' make[1]: *** [all-recursive] Error 1 make[1]: Leaving directory `/usr/src/irstlm' make: *** [all] Error 2 ___ Moses-support mailing list Moses-support@mit.edu http://mailman.mit.edu/mailman/listinfo/moses-support
