I was wondering if you did setup them up before building if it fixed the
build issue.
Roberta
-----Original Message-----
From: Gunnar Tapper [mailto:[email protected]]
Sent: Monday, March 7, 2016 6:07 PM
To: [email protected]
Subject: Re: Parallel Make Failures
Do I set these variables before running the tools setup?
On Mon, Mar 7, 2016 at 6:55 PM, Roberta Marton <[email protected]>
wrote:
> When I was testing release 1.3 last year, I remember getting a similar
> issue. Thrift was installed but something in the make was not working
> correctly.
> To get around the problem temporarily, I manually exported the
> THRIFT_INC_DIR and THRIFT_LIB_DIR:
>
> export THRIFT_LIB_DIR=<location>
> export THRIFT_INC_DIR=<location>
>
> The build then succeeded.
> There were several later changes made in the setup files that
> eventually did not require this workaround.
>
> If you manually set these envvars, does the build work?
>
> Roberta
>
> -----Original Message-----
> From: Gunnar Tapper [mailto:[email protected]]
> Sent: Monday, March 7, 2016 5:28 PM
> To: [email protected]
> Subject: Re: Parallel Make Failures
>
> I created a new VM and did a new git clone. As stated, include and lib
> are not built for Thrift. Also, it seems to me that the qmake change
> might be broken. See below.
>
> [centos@trafbuild ~]$ cd incubator-trafodion/ [centos@trafbuild
> incubator-trafodion]$ source ./env.sh
>
> If you are ready to build Trafodion, perform one of the following
> options:
>
> make all (Build Trafodion, DCS, and REST) OR
> make package (Build Trafodion, DCS, REST, and Client drivers)
> OR
> make package-all (Build Trafodion, DCS, REST, Client drivers,
> and
> Tests)
>
> If Trafodion has been built and you want test:
>
> Execute the install_local_hadoop script which performs a single
> node
> install using a popular Hadoop distribution
>
> cd /home/centos/incubator-trafodion/core/sqf/sql/scripts
> install_local_hadoop [-p <port option>]
> install_traf_components
> configure Trafodion and start the processes
> HAVE FUN!
>
> You can also choose to install_local_hadoop before building Trafodion.
>
> [centos@trafbuild incubator-trafodion]$ make all -j 1 Building all
> Trafodion components cd core && make all
> make[1]: Entering directory `/home/centos/incubator-trafodion/core'
> ./bldenvchk.sh;
> *** Warning: QT_TOOLKIT does not point to an existing directory.
> *** Warning: SQL Compiler Debugger will not be built.
> *** Error: THRIFT_LIB_DIR directory not found:
> //home/centos/trafodion-build-tools/thrift-0.9.0/lib
> *** Error: THRIFT_INC_DIR directory not found:
> //home/centos/trafodion-build-tools/thrift-0.9.0/include
> make[1]: *** [sqroot] Error 1
> make[1]: Leaving directory `/home/centos/incubator-trafodion/core'
> make: *** [all] Error 2
>
> [centos@trafbuild incubator-trafodion]$ echo $QT_TOOLKIT
>
> [centos@trafbuild incubator-trafodion]$ ls
> ~/trafodion-build-tools/thrift-0.9.0/
> bin
>
>
> On Mon, Mar 7, 2016 at 3:16 PM, Steve Varnau <[email protected]>
> wrote:
>
> > The traf_tools_setup.sh script has not changed in the in the last
> > few days.
> > I hope that the download location for thrift have not changed. The
> > only thing I can see that has been changing is the wiki instructions
> > for setting up the environment.
> >
> > I see at least one thing wrong on wiki. For instance, it says that
> > CentOS
> > 6.7 won't work. That is not correct. There was a mistaken
> > impression that
> > 6.7 has newer gcc. Not true.
> >
> > With the very latest code (as of this morning), the qt-devel and
> > qt-config should no longer be needed.
> >
> > --Steve
> >
> >
> > > -----Original Message-----
> > > From: Gunnar Tapper [mailto:[email protected]]
> > > Sent: Monday, March 7, 2016 2:03 PM
> > > To: [email protected]
> > > Subject: Re: Parallel Make Failures
> > >
> > > Alas, things are getting worse rather than better... :(
> > >
> > > I create a new VM, installed all required packages, did a git
> > > clone of trafodion, and then I ran install/traf_tools_setup.sh.
> > > Now, Thrift isn't building the include and lib folders. I run the
> > > exact same command on the version that I downloaded last Thursday
> > > and that works just fine.
> > >
> > > Did anything change that I should be aware of?
> > >
> > > Gunnar
> > >
> > > On Mon, Mar 7, 2016 at 12:17 PM, Gunnar Tapper
> > > <[email protected]>
> > > wrote:
> > >
> > > > Well, today, the build doesn't work at all regardless of what -j
> > > > or -l options I use. It constantly fails on:
> > > >
> > > > Generating C++ code from yacc file ../sqlci/sqlci_yacc.y
> > > > ##(SQL)
> > > > ../sqlci/sqlci_yacc.y: warning: 1 reduce/reduce conflict
> > > > [-Wconflicts-rr]
> > > > ##(SQL)
> > > > /home/centos/traf-tools/bison_3_linux/bin/bison:
> > > > /home/centos/trafodion//bison_3_linux/share/bison/m4sugar/m4sugar.m4:
> > > > cannot open: No such file or directory ##(SQL)
> > > > mv: cannot stat `sqlcilib/linux/64bit/debug/sqlci_yacc.cpp': No
> > > > such file or directory ##(SQL)
> > > > sed: can't read sqlcilib/linux/64bit/debug/sqlci_yacc.cpp.tmp:
> > > > No
> such
> > > > file or directory ##(SQL)
> > > > sed: can't read sqlcilib/linux/64bit/debug/sqlci_yacc.hpp: No
> > > > such file or
> > > > directory ##(SQL)
> > > > rm: cannot remove `sqlcilib/linux/64bit/debug/sqlci_yacc.hpp':
> > > > No
> such
> > > > file or directory ##(SQL)
> > > > rm: cannot remove `sqlcilib/linux/64bit/debug/sqlci_yacc.cpp.tmp':
> > > > No such
> > > > file or directory ##(SQL)
> > > > make[4]: *** [sqlcilib/linux/64bit/debug/sqlci_yacc.h] Error 1
> > > > ##(SQL)
> > > > make[4]: Leaving directory
> > > > `/home/centos/incubator-trafodion/core/sql/nskgmake' ##(SQL)
> > > > make[3]: *** [all] Error 2 ##(SQL)
> > > > make[3]: Leaving directory
> > > > `/home/centos/incubator-trafodion/core/sqf/sql'
> > > > ##(SQL)
> > > > make[2]: *** [make_sql] Error 2
> > > > make[2]: Leaving directory
> `/home/centos/incubator-trafodion/core/sqf'
> > > > make[1]: *** [foundation] Error 2
> > > > make[1]: Leaving directory `/home/centos/incubator-trafodion/core'
> > > > make: *** [all] Error 2
> > > >
> > > >
> > > > On Mon, Mar 7, 2016 at 12:05 PM, Amanda Moran
> > > <[email protected]>
> > > > wrote:
> > > >
> > > >> On redhat 7.1 this command still works:
> > > >>
> > > >> [ec2-user@ip-10-0-0-175 ~]$ cat /etc/redhat-release Red Hat
> > > >> Enterprise Linux Server release 7.1 (Maipo)
> > > >>
> > > >> [ec2-user@ip-10-0-0-175 ~]$ grep processor /proc/cpuinfo | wc
> > > >> -l
> > > >> 4
> > > >>
> > > >>
> > > >> On Mon, Mar 7, 2016 at 9:56 AM, Steve Varnau
> > > >> <[email protected]>
> > > >> wrote:
> > > >>
> > > >> > > It seems that the parallel make fails on 8 GB machines.
> > > >> >
> > > >> > I think your first sentence overstates the determinism of the
> > problem
> > > >> > a
> > > >> > bit.
> > > >> > I ran a normal, default build on 8GB machine last week and
> > > >> > had no
> > > >> problem.
> > > >> > There must be an environmental problem, but I don't think we
> > > >> > fully understand it yet.
> > > >> >
> > > >> > The aggressiveness of the make parallelism is set in
> > > >> core/sqf/sqenvcom.sh.
> > > >> > It sets the parallel factor based on how many CPUs are on
> > > >> > your
> > > >> > machine:
> > > >> >
> > > >> > # Set default build parallelism # Can be overridden on make
> > > >> > commandline cpucnt=$(grep processor /proc/cpuinfo | wc -l)
> > > >> > # no number means unlimited, and will swamp the system
> > > >> > export MAKEFLAGS="-j$cpucnt"
> > > >> >
> > > >> > If that calculation is wrong, maybe that could cause a problem.
> > > >> >
> > > >> > --Steve
> > > >> >
> > > >> >
> > > >> > > -----Original Message-----
> > > >> > > From: Gunnar Tapper [mailto:[email protected]]
> > > >> > > Sent: Monday, March 7, 2016 9:35 AM
> > > >> > > To: [email protected]
> > > >> > > Subject: Parallel Make Failures
> > > >> > >
> > > >> > > Hi,
> > > >> > >
> > > >> > > It seems that the parallel make fails on 8 GB machines. At
> > > >> > > least,
> > > >> Nitin
> > > >> > > and
> > > >> > > I both ran into make failures that did not appear when
> > > >> > > running serial make.
> > > >> > > I've also seen similar failures when building the code on
> > > >> > > 12 GB
> > > >> machines.
> > > >> > >
> > > >> > > Based on previous discussions, the Trafodion Contributor
> > > >> > > Guide
> > > >> recommends
> > > >> > > rerunning make a few times if running issues.
> > > >> > >
> > > >> > > I most wonder if there's a way to reduce the aggressiveness
> > > >> > > of the
> > > >> make
> > > >> > in
> > > >> > > general. Could we, for example, come up with a table that
> > > >> > > correlates system size to define the -l option or something
> > > >> > > similar?
> > > >> > >
> > > >> > > --
> > > >> > > Thanks,
> > > >> > >
> > > >> > > Gunnar
> > > >> > > *If you think you can you can, if you think you can't
> > > >> > > you're
> > > >> > > right.*
> > > >> >
> > > >>
> > > >>
> > > >>
> > > >> --
> > > >> Thanks,
> > > >>
> > > >> Amanda Moran
> > > >>
> > > >
> > > >
> > > >
> > > > --
> > > > Thanks,
> > > >
> > > > Gunnar
> > > > *If you think you can you can, if you think you can't you're
> > > > right.*
> > > >
> > >
> > >
> > >
> > > --
> > > Thanks,
> > >
> > > Gunnar
> > > *If you think you can you can, if you think you can't you're
> > > right.*
> >
>
>
>
> --
> Thanks,
>
> Gunnar
> *If you think you can you can, if you think you can't you're right.*
>
--
Thanks,
Gunnar
*If you think you can you can, if you think you can't you're right.*
