Hi Nitin,
I thought I’d give a go on an 8GB machine. I spun up a VM, 8GB memory, 2cpu, no swap space. $ ulimit -s 10240 Trafodion built fine for me, no problems. Did you check dmesg to see if there were any kernel messages? --Steve *From:* Hans Zeller [mailto:hans.zel...@esgyn.com] *Sent:* Thursday, March 3, 2016 11:21 AM *To:* dev <dev@trafodion.incubator.apache.org> *Cc:* Steve Varnau <steve.var...@esgyn.com> *Subject:* Re: Error building Trafodion Hi Nitin, if you want to have an environment where the build is likely to succeed, you can try this Amazon AMI: https://aws.amazon.com/marketplace/pp/B018RBMFG0/ref=srh_res_product_title?ie=UTF8&sr=0-3&qid=1457026427523 This has a full Trafodion source tree installed, you can make code changes, build and debug. Hans On Thu, Mar 3, 2016 at 11:02 AM, Nitin Lamba <ni...@ampool.io> wrote: Thanks Steve, Update #5: Still no luck. Tried to do a clean setup and build but g++ failed at a different step now: ----------------------------------------------------------------- /usr/bin/g++ -DSQ_PHANDLE_VERIFIER -m64 -O0 -fshort-wchar -std=c++0x -fcheck-new -fno-strict-aliasing -msse2 -mfpmath=sse -g3 -ggdb -DNA_DEBUG_GUI -fPIC -Wno-unknown-pragmas -Wreturn-type -Wformat -Werror -DNA_LINUX -DSQ_LINUX -DNGG -D_M_DG -D_NSKFS_ -D_FULL_BUILD -DARKFS_GENERATOR -D_DP2NT_ -D_LITTLE_ENDIAN_ -DARG_PRESENT_OMIT -DNSK_USE_MSGSYS_SHELLS -D_REENTRANT -D_GLIBCXX_DEPRECATED -D_TNS_R_TARGET -D_MSC_VER -D_X86_ -DWIN32_LEAN_AND_MEAN -D_WIN32_WINNT=0x402 -DNA_ITOA_NOT_SUPPORTED -DMPI_ -DHAVE_INTTYPES_H -DHAVE_NETINET_IN_H -DNA_CMPDLL -DSQ_CPP_INTF -DSQ_NEW_PHANDLE -DUSE_NEW_PHANDLE -DSP_DIS -DNA_64BIT -D_DEBUG -DTRAF_SOFTWARE_VERS_MAJOR=2 -DTRAF_SOFTWARE_VERS_MINOR=0 -DTRAF_SOFTWARE_VERS_UPDATE=0 -I/home/nitinlamba/trafodion-build-tools/thrift-0.9.0/include -I/home/nitinlamba/trafodion-build-tools/thrift-0.9.0/include/thrift -I../sqlcomp -I/home/nitinlamba/incubator-trafodion/core/sqf/inc -I/home/nitinlamba/incubator-trafodion/core/sqf/export/include -I/usr/include -I/home/nitinlamba/trafodion-build-tools/thrift-0.9.0/include -I/home/nitinlamba/trafodion-build-tools/thrift-0.9.0/include/thrift -I/home/nitinlamba/trafodion-build-tools/apache-log4cxx-0.10.0/include -I/home/nitinlamba/trafodion-build-tools/apache-log4cxx-0.10.0/include/log4cxx -I/usr/include -I/usr/lib/jvm/java-1.7.0-openjdk.x86_64/include -I/usr/lib/jvm/java-1.7.0-openjdk.x86_64/include/linux -I../sqlci -I../arkcmp -I../comexe -I../sqlfe -I../eh -I../export -I../sqlmsg -I../sqlcomp -I../sqlcat -I../executor -I../parser -I../generator -I../exp -I../filesystem -I../optimizer -I../cli -I../nskcre -I../common -I../dml -I../arkfsindp2 -I../arkfsinopen -I../ddl -I../sort -I../catman -I../smdio -I../ustat -I../sqlshare -I../sqlmxevents -I../bin -I../langman -I../sqludr -I../udrserv -I../security -I../runtimestats -I../qmscommon -I../qms -I../porting_layer -include "/home/nitinlamba/incubator-trafodion/core/sqf/inc/seaquest/sqtypes.h" -I/home/nitinlamba/trafodion-build-tools/dest-llvm-3.2/debug/include -I/home/nitinlamba/trafodion-build-tools/dest-llvm-3.2/debug/include/llvm -I/home/nitinlamba/trafodion-build-tools/udis86-1.7.2/include -I/home/nitinlamba/incubator-trafodion/core/sqf/../dbsecurity/auth/inc -I/home/nitinlamba/incubator-trafodion/core/sqf/commonLogger -Wp,-MD,sqlcomp/linux/64bit/debug/depend/d_CmpSeabaseDDLcleanup.dep -Wp,-MT,sqlcomp/linux/64bit/debug/CmpSeabaseDDLcleanup.o -c -o sqlcomp/linux/64bit/debug/CmpSeabaseDDLcleanup.o ../sqlcomp/CmpSeabaseDDLcleanup.cpp ##(SQL) g++: Internal error: Segmentation fault (program cc1plus) ##(SQL) Please submit a full bug report. ##(SQL) See <http://bugzilla.redhat.com/bugzilla> for instructions. ##(SQL) make[4]: *** [sqlcomp/linux/64bit/debug/CmpSeabaseDDLauth.o] Error 1 ##(SQL) make[4]: *** Waiting for unfinished jobs.... ##(SQL) ----------------------------------------------------------------- The process hung for me. A quick web search on 'g++ segmentation fault' [1] suggests that maybe the stack size is limited. So I increased the limit 'ulimit -s 65532' with the same result. I then removed the limit completely 'ulimit -s unlimited' without any change in outcome. It seems I'm running into hardware or environment limitations. Does anyone know the minimum spec for the dev machine? I have an 8 GB VM that I'm running this on. Not sure what else I can do at this point - running out of ideas and patience. Will keep trying to build trafodion in my free time... Nitin [1] https://gcc.gnu.org/bugzilla/show_bug.cgi?id=49351 ________________________________________ From: Steve Varnau <steve.var...@esgyn.com> Sent: Sunday, February 28, 2016 8:54 AM To: Nitin Lamba; dev@trafodion.incubator.apache.org Subject: RE: Error building Trafodion I have seen this gcc internal error message before. It ended up to be nothing in the code, but rather the OS decided the process was taking too much memory and killed it. In my case, cgroups was misconfigured to limit the user to 10% of memory. The dmesg command or /var/log messages showed that the OS was doing it. --Steve > -----Original Message----- > From: Nitin Lamba [mailto:ni...@ampool.io] > Sent: Sunday, February 28, 2016 8:06 AM > To: Steve Varnau <steve.var...@esgyn.com>; > dev@trafodion.incubator.apache.org > Subject: Re: Error building Trafodion > > Thanks Steve. Glad that my buggy build journey is helping uncover new issues. > > Update #4: Build is blocked for me - details below: > > Tried to install qt-devel but it failed to build thrift-0.9.0 in tools setup > (traf_tools_setup.sh). It seems this is a known issue [1] and besides, the script > uses '-without-qt' option anyway. > > So I installed qt-devel package AFTER the tools setup and re-ran 'make all'. > Now, the build fails on a different step - log excerpt below: > > ----------------------------------------------------------- > /usr/bin/g++ -DSQ_PHANDLE_VERIFIER -m64 -O0 -fshort-wchar -std=c++0x - > fcheck-new -fno-strict-aliasing -msse2 -mfpmath=sse -g3 -ggdb -fPIC -Wno- > unknown-pragmas -Wreturn-type -Wformat -Werror -DNA_LINUX -DSQ_LINUX > -DNGG -D_M_DG -D_NSKFS_ -D_FULL_BUILD -DARKFS_GENERATOR - > D_DP2NT_ -D_LITTLE_ENDIAN_ -DARG_PRESENT_OMIT - > DNSK_USE_MSGSYS_SHELLS -D_REENTRANT -D_GLIBCXX_DEPRECATED - > D_TNS_R_TARGET -D_MSC_VER -D_X86_ -DWIN32_LEAN_AND_MEAN - > D_WIN32_WINNT=0x402 -DNA_ITOA_NOT_SUPPORTED -DMPI_ - > DHAVE_INTTYPES_H -DHAVE_NETINET_IN_H -DNA_CMPDLL -DSQ_CPP_INTF - > DSQ_NEW_PHANDLE -DUSE_NEW_PHANDLE -DSP_DIS -DNA_64BIT -D_DEBUG > -I../bin -I../executor -I../runtimestats -I../porting_layer -I../qmscommon - > I/home/nitinlamba/incubator-trafodion/core/sqf/inc - > I/home/nitinlamba/incubator-trafodion/core/sqf/export/include -I/usr/include - > I/home/nitinlamba/trafodion-build-tools/thrift-0.9.0/include - > I/home/nitinlamba/trafodion-build-tools/thrift-0.9.0/include/thrift - > I/home/nitinlamba/trafodion-build-tools/apache-log4cxx-0.10.0/include - > I/home/nitinlamba/trafodion-build-tools/apache-log4cxx- > 0.10.0/include/log4cxx -I/usr/include -I/usr/lib/jvm/java-1.7.0- > openjdk.x86_64/include -I/usr/lib/jvm/java-1.7.0-openjdk.x86_64/include/linux > -I../sqlci -I../arkcmp -I../comexe -I../sqlfe -I../eh -I../export -I../sqlmsg - > I../sqlcomp -I../sqlcat -I../executor -I../parser -I../generator -I../exp - > I../filesystem -I../optimizer -I../cli -I../nskcre -I../common -I../dml -I../arkfsindp2 > -I../arkfsinopen -I../ddl -I../sort -I../catman -I../smdio -I../ustat -I../sqlshare - > I../sqlmxevents -I../bin -I../langman -I../sqludr -I../udrserv -I../security - > I../runtimestats -I../qmscommon -I../qms -I../porting_layer -include > "/home/nitinlamba/incubator-trafodion/core/sqf/inc/seaquest/sqtypes.h" - > I/home/nitinlamba/trafodion-build-tools/dest-llvm-3.2/debug/include - > I/home/nitinlamba/trafodion-build-tools/dest-llvm-3.2/debug/include/llvm - > I/home/nitinlamba/trafodion-build-tools/udis86-1.7.2/include - > I/home/nitinlamba/incubator-trafodion/core/sqf/../dbsecurity/auth/inc - > I/home/nitinlamba/incubator-trafodion/core/sqf/commonLogger -Wp,- > MD,executor/linux/64bit/debug/depend/d_stubs2.dep -Wp,- > MT,executor/linux/64bit/debug/stubs2.o -c -o > executor/linux/64bit/debug/stubs2.o ../executor/stubs2.cpp ##(SQL) > g++: Internal error: Killed (program cc1plus) ##(SQL) > Please submit a full bug report. ##(SQL) > See <http://bugzilla.redhat.com/bugzilla> for instructions. ##(SQL) > make[4]: *** [executor/linux/64bit/debug/stubs.o] Error 1 ##(SQL) > make[4]: *** Waiting for unfinished jobs.... ##(SQL) > make[4]: Leaving directory `/home/nitinlamba/incubator- > trafodion/core/sql/nskgmake' ##(SQL) > make[3]: *** [all] Error 2 ##(SQL) > make[3]: Leaving directory `/home/nitinlamba/incubator- > trafodion/core/sqf/sql' ##(SQL) > make[2]: *** [make_sql] Error 2 > make[2]: Leaving directory `/home/nitinlamba/incubator-trafodion/core/sqf' > make[1]: *** [foundation] Error 2 > make[1]: Leaving directory `/home/nitinlamba/incubator-trafodion/core' > make: *** [all] Error 2 > ----------------------------------------------------------- > > No idea why g++ doesn't like this. Any ideas? > > Nitin > [1] http://stackoverflow.com/questions/18218848/unable-to-compile-thrift-0-9- > 0-on-centos6-4 > > ________________________________________ > From: Steve Varnau <steve.var...@esgyn.com> > Sent: Saturday, February 27, 2016 12:08 PM > To: Nitin Lamba; dev@trafodion.incubator.apache.org > Subject: RE: Error building Trafodion > > The qt-devel package should be optional, just as the QT_TOOLKIT variable > need not be pointing to anything. It is for a an optional query-debugger > tool. I'd say that is a makefile bug that tries to call qmake > unconditionally. > > Likewise, it is news to me that build does not work on Centos 6.7 (gcc > 4.8). That seems like a bug as well. > > --Steve > > > > -----Original Message----- > > From: Nitin Lamba [mailto:ni...@ampool.io] > > Sent: Saturday, February 27, 2016 8:37 AM > > To: dev@trafodion.incubator.apache.org > > Cc: Steve Varnau <steve.var...@esgyn.com> > > Subject: Re: Error building Trafodion > > > > Update #3: > > > > Tried with CentOS 6.6; gcc seems to be the correct version: > > $ gcc --version > > gcc (GCC) 4.4.7 20120313 (Red Hat 4.4.7-16) > > > > 'make all' moved further but failed due to 'qmake' not available - log > excerpt > > below: > > > > ----------------------------------------------------------------- > > /usr/bin/g++ -DSQ_PHANDLE_VERIFIER -m64 -O0 -fshort-wchar -std=c++0x - > > fcheck-new -fno-strict-aliasing -msse2 -mfpmath=sse -g3 -ggdb -fPIC > -Wno- > > unknown-pragmas -Wreturn-type -Wformat -Werror -shared -o > > ../lib/linux/64bit/debug/libclitest.so -L../lib/linux/64bit/debug - > > L/home/nitinlamba/incubator-trafodion/core/sqf/export/lib64d - > > L/home/nitinlamba/incubator-trafodion/core/sqf/export/lib64d > > clitest/linux/64bit/debug/blobtest.o > clitest/linux/64bit/debug/vers_libclitest.o > > clitest/linux/64bit/debug/mpisetup.o -L /usr/lib/jvm/java-1.7.0- > > openjdk.x86_64/jre/lib/amd64/server -ljvm -lhdfs -lthrift -lcurl > -llog4cxx > > ##(SQL) > > cd ../SqlCompilerDebugger && . ./mk.sh; \ ##(SQL) > > cp -f $PWD/libSqlCompilerDebugger.so > > ../lib/linux/64bit/debug/libSqlCompilerDebugger.so; ##(SQL) > > ./mk.sh: line 28: qmake: command not found ##(SQL) > > make[5]: warning: jobserver unavailable: using -j1. Add `+' to parent > make > > rule. ##(SQL) > > make[5]: *** No targets specified and no makefile found. > Stop. ##(SQL) > > cp: cannot stat `/home/nitinlamba/incubator- > > trafodion/core/sql/SqlCompilerDebugger/libSqlCompilerDebugger.so': No > such > > file or directory ##(SQL) > > make[4]: *** [cmpdbg_qt_build] Error 1 ##(SQL) > > > > ----------------------------------------------------------------- > > A quick check on the web suggests that package 'qt-devel' should be > installed - > > this is missing from the wiki page as a dependency [1]. > > > > Frankly, this is too much of a trial and error for a new developer to > get started. > > The instructions should be updated for all of these gotchas (CentOS 6. X, > gcc, > > qmake, ...). > > > > I'll keep digging... > > Nitin > > [1] > > > https://cwiki.apache.org/confluence/display/TRAFODION/Create+Build+Environ > > ment > > > > ________________________________________ > > From: Liu, Ming (Ming) <ming....@esgyn.cn> > > Sent: Friday, February 26, 2016 9:27 PM > > To: dev@trafodion.incubator.apache.org > > Cc: Steve Varnau > > Subject: Re: Error building Trafodion > > > > I tried CentOS 6.4 , 6.5 and 6.6 before, just not 6.7... > > So sorry for not clear before, you need CentOS 6.6 or older version. The > > problem is the GCC version. In the error message below, it seems the GCC > you > > are using is 4.8.2, some Trafodion modules not compatible with GCC 4.8. > You > > have to use a lower version. GCC 4.4.7 is what I am using without issue, > and my > > workstation is CentOS 6.6. > > > > It should be possible to install GCC 4.4 on newer CentOS versions, but > maybe > > need to change some C/C++ rumtime lib as well. You may need to build the > > toolchain from gcc source code in order to get a complete gcc 4.4. I > will try it > > asap. > > > > Thanks, > > Ming > > > > -----邮件原件----- > > 发件人: Nitin Lamba [mailto:ni...@ampool.io] > > 发送时间: 2016年2月27日 13:14 > > 收件人: dev@trafodion.incubator.apache.org > > 抄送: Steve Varnau <steve.var...@esgyn.com> > > 主题: Re: Error building Trafodion > > > > Update: > > > > Started with CentOS 6.7 (Final) but ran into a different issue in the > same > > module (undefined reference to certain functions) - log excerpt below: > > > > Linux-x86_64/64/dbg/ldapconfignode.o: In function > `std::basic_string<char, > > std::char_traits<char>, std::allocator<char> >* std::__copy_move<true, > false, > > std::random_access_iterator_tag>::__copy_m<std::basic_string<char, > > std::char_traits<char>, std::allocator<char> >*, std::basic_string<char, > > std::char_traits<char>, std::allocator<char> >*>(std::basic_string<char, > > std::char_traits<char>, std::allocator<char> >*, std::basic_string<char, > > std::char_traits<char>, std::allocator<char> >*, std::basic_string<char, > > std::char_traits<char>, std::allocator<char> >*)': ##(Security) > > /usr/include/c++/4.8.2/bits/stl_algobase.h:354: undefined reference to > > `std::basic_string<char, std::char_traits<char>, std::allocator<char> > > >::operator=(std::basic_string<char, std::char_traits<char>, > std::allocator<char> > > >&&)' ##(Security) > > Linux-x86_64/64/dbg/ldapconfignode.o: In function > > `_ZN9__gnu_cxx13new_allocatorISsE9constructISsJSsEEEvPT_DpOT0_': > > ##(Security) > > /usr/include/c++/4.8.2/ext/new_allocator.h:120: undefined reference to > > `std::basic_string<char, std::char_traits<char>, std::allocator<char> > > >::basic_string(std::basic_string<char, std::char_traits<char>, > > std::allocator<char> >&&)' ##(Security) > > Linux-x86_64/64/dbg/ldapconfignode.o: In function > > `_ZSt10_ConstructISsJSsEEvPT_DpOT0_': ##(Security) > > /usr/include/c++/4.8.2/bits/stl_construct.h:75: undefined reference to > > `std::basic_string<char, std::char_traits<char>, std::allocator<char> > > >::basic_string(std::basic_string<char, std::char_traits<char>, > > std::allocator<char> >&&)' ##(Security) > > Linux-x86_64/64/dbg/ldapcheck.o: In function > > `AuthEvents::AuthEvents(AuthEvents&&)': ##(Security) > > /home/nitinlamba/incubator- > > trafodion/core/dbsecurity/auth/src/ldapcheck.cpp:50: undefined reference > to > > `std::basic_string<char, std::char_traits<char>, std::allocator<char> > > >::basic_string(std::basic_string<char, std::char_traits<char>, > > std::allocator<char> >&&)' ##(Security) > > /home/nitinlamba/incubator- > > trafodion/core/dbsecurity/auth/src/ldapcheck.cpp:50: undefined reference > to > > `std::basic_string<char, std::char_traits<char>, std::allocator<char> > > >::basic_string(std::basic_string<char, std::char_traits<char>, > > std::allocator<char> >&&)' ##(Security) > > collect2: ld returned 1 exit status ##(Security) > > > > Any ideas? > > > > Nitin > > > > ________________________________________ > > From: Nitin Lamba <ni...@ampool.io> > > Sent: Friday, February 26, 2016 7:37 PM > > To: dev@trafodion.incubator.apache.org > > Cc: Steve Varnau > > Subject: Re: Error building Trafodion > > > > Thanks Ming! Will try with CentOS 6. > > > > Nitin > > > > ________________________________________ > > From: Liu, Ming (Ming) <ming....@esgyn.cn> > > Sent: Friday, February 26, 2016 7:32 PM > > To: dev@trafodion.incubator.apache.org > > Cc: Steve Varnau > > Subject: 答复: Error building Trafodion > > > > Hi, Nitin, > > > > I run into same error last week when I tried to use CentOS 7 as my > > Development machine. The default GCC on CentOS 7 is GCC4.8, it seems > > incompatible. > > For this particular issue, I modified the Makefile under > > incubator-trafodion/core/dbsecurity/auth/Makefile > > to add '-llber' into LINK_OPTIONS > > And pass this error. > > I have no idea why current building workstation not meet this link > error, I have > > no theory here :-) I have another CentOS 6.5 workstation, same codebase, > but > > not meet this build error. It is still a mystery for me. Need time to > investigate > > more. > > > > But if I you are using GCC 4.8, the building will meet few more errors > after > > solving this issue. I fixed a few, but still some more are there, and > not able to > > proceed too much up to now. So I think if you are using gcc 4.8, please > consider > > to use an older version. CentOS 6.5 ship with GCC 4.4, which is fine. > > > > In sum, if you are not using CentOS 6, please use CentOS 6.x as > development > > workstation will save you a lot of time, it is well tested. > > > > Thanks, > > Ming > > > > -----邮件原件----- > > 发件人: Nitin Lamba [mailto:ni...@ampool.io] > > 发送时间: 2016年2月27日 11:00 > > 收件人: dev@trafodion.incubator.apache.org > > 抄送: Steve Varnau <steve.var...@esgyn.com> > > 主题: Error building Trafodion > > > > Hi, > > > > > > I tried to build Trafodion by following the instructions on the wiki > [1], [2] using > > 'make all'. However, I ran into an error compiling 'auth' within > dbsecurity - log > > excerpt below: > > > > > > [... SNIPPET ...] > > > > cd auth; make ##(Security) > > > > make[3]: Entering directory `/home/nitinlamba/incubator- > > trafodion/core/dbsecurity/auth' ##(Security) > > > > /usr/bin/g++ -DSQ_PHANDLE_VERIFIER -fPIC -g -m64 -DNA_LINUX - > > DNA_64BIT -o /home/nitinlamba/incubator- > > trafodion/core/sqf/export/bin64/ldapcheck -I. -I./inc -I ../shared/inc > -I > > /home/nitinlamba/incubator-trafodion/core/sqf/../sql/cli -I > > /home/nitinlamba/incubator-trafodion/core/sqf/../sql/common -I > > /home/nitinlamba/incubator-trafodion/core/sqf/../sql/executor -I > > /home/nitinlamba/incubator-trafodion/core/sqf/../sql/export -I > > /home/nitinlamba/incubator-trafodion/core/sqf/../sql/porting_layer -I > > /home/nitinlamba/incubator-trafodion/core/sqf/export/include -I > > ../../sql/common -L/home/nitinlamba/incubator- > > trafodion/core/sqf/export/lib64 -lldap -lssl Linux- > > x86_64/64/rls/ldapconfignode.o Linux-x86_64/64/rls/versldapcheck.o > Linux- > > x86_64/64/rls/ldapcheck.o Linux-x86_64/64/rls/ldapconfigfile.o > ##(Security) > > > > /usr/bin/ld: > /usr/lib/gcc/x86_64-redhat-linux/4.8.5/../../../../lib64/libldap.so: > > undefined reference to symbol 'ber_set_option' ##(Security) > > > > /usr/bin/ld: note: 'ber_set_option' is defined in DSO > /lib64/liblber-2.4.so.2 so > > try adding it to the linker command line ##(Security) > > > > /lib64/liblber-2.4.so.2: could not read symbols: Invalid operation > ##(Security) > > > > collect2: error: ld returned 1 exit status ##(Security) > > > > make[3]: *** [/home/nitinlamba/incubator- > > trafodion/core/sqf/export/bin64/ldapcheck] Error 1 ##(Security) > > > > make[3]: Leaving directory `/home/nitinlamba/incubator- > > trafodion/core/dbsecurity/auth' ##(Security) > > > > make[2]: *** [auth] Error 2 ##(Security) > > > > make[2]: Leaving directory `/home/nitinlamba/incubator- > > trafodion/core/dbsecurity' ##(Security) > > > > make[1]: *** [dbsecurity] Error 2 > > > > > > Any ideas what I could be doing wrong? > > > > > > Thanks, > > > > Nitin > > > > > > [1] > > > https://cwiki.apache.org/confluence/display/TRAFODION/Create+Build+Environ > > ment > > > > [2] https://cwiki.apache.org/confluence/display/TRAFODION/Build+Source
