Re: poudriere: setting up jail failes

2014-08-11 Thread Julian Elischer

On 8/9/14, 2:43 AM, Bryan Drewery wrote:

On 8/8/2014 11:46 AM, Matthias Apitz wrote:

Hello,

I'm setting up a jail with poudriere(8) to compile my ports; after some
hours it is crashing with:

# poudriere jail -c -j freebsd-head -m svn+http -v head ; date

[...]

mtree: illegal option -- N
usage: mtree [-LPUcdeinqruxw] [-f spec] [-f spec] [-K key] [-k key] [-p
path] [-s seed]
 [-X excludes]
*** Error code 1

[...]


The host where poudriere is running is:

# uname -a
FreeBSD vm-tiny-r255948 10.0-ALPHA4 FreeBSD 10.0-ALPHA4 #1: Fri Oct 18
12:10:57 CEST 2013 g...@aurora.sisis.de:/usr/obj/usr/src/sys/GENERIC
i386

i.e. a CURRENT from Oct 2013 (r255948). Does this mean I should update
the host where poudriere is running before?

Yes. For you it is fixed in stable/10 r257460 (which was in before 10.0
release) which added -N to mtree. There was a lot of polish at the end
of 10.0 so you should probably upgrade to at least 10.0 either way.

It could be that older releases building 10 and head for Poudriere may
be an issue still. I'll have to test more. Specifically the call of
'make distrib-dirs DB_FROM_SRC=1' seemingly not using the itools version
of mtree.

Also note that running a head jail on a 10.0 system is not really
supported. You may run into many weird issues building packages. It's
supported to have your host be newer than the jails but not the other
way around.

Regards,
Bryan Drewery

I had to do
cd /usr/src/{mumble}/mtree; make ; make install
before  I could upgrade from where I was in the current branch to 
where I wanted to get the 10 branch.

similar for install.



___
freebsd-current@freebsd.org mailing list
http://lists.freebsd.org/mailman/listinfo/freebsd-current
To unsubscribe, send any mail to freebsd-current-unsubscr...@freebsd.org


Re: poudriere: setting up jail failes

2014-08-11 Thread Bryan Drewery
On 8/9/2014 1:50 PM, Matthias Apitz wrote:
 El día Friday, August 08, 2014 a las 02:27:40PM -0500, Bryan Drewery escribió:
 
 On 8/8/2014 1:57 PM, Matthias Apitz wrote:
 And, btw., why is poudriere removing all the jail when an error occures?
 Wouldn't it be better to let it there to have a look into and remove it
 on the next run?

 Yes I agree this should probably change. I'll evaluate it after the 3.1
 release which is the major focus right now. The jail command has a lot
 of issues with building and error handling.
 
 I have updated last night the host to 'head' and poudriere itself to
 poudriere-devel-3.0.99.20140801. Compiling the ports in the jail makes
 progress, as always with some hick-ups in the ports itself.
 
 I have one fundamental question, maybe a missunderstanding of poudriere:
 
 When I run 'poudriere options ...' it is not using the toolchain in the
 jail:
 
 # uname -a
 FreeBSD vm-tiny-r269739 11.0-CURRENT FreeBSD 11.0-CURRENT #0 r269739: Sat Aug 
  9 07:07:40 CEST 2014 guru@vm-tiny-r269739:/usr/obj/usr/src/sys/GENERIC  
 i386
 $ 
 
 # poudriere version
 3.1-pre
 # poudriere options -c -j freebsd-head -p ports-head x11/kde4
 
 brings up the Options menu of x11/kde4 and when you look
 with ps, it uses /usr/local/bin/dialog4ports for this:
 
 # ps ax | fgrep dialog
 92303  3  I+ 0:00,00 /usr/local/bin/dialog4ports
 
 when I terminate the dialog, it seems that the pkg-* tools
 are used (which ofc are not installed on the host):
 
 === Setting user-specified options for kde-4.12.5 and dependencies
 /usr/local/sbin/pkg-static: not found
 make[1]: /usr/local/poudriere/ports/ports-head/Mk/bsd.openssl.mk line 99: 
 warning: Couldn't read shell's output for /usr/local/sbin/pkg-static  which 
 -qo /usr/local/lib/libcrypto.so || :
 /usr/local/sbin/pkg-static: not found
 
 What I'm doing wrong or have understand wrong?
 
 Thanks
 
   matthias
 

It is known, please see
https://fossil.etoilebsd.net/poudriere/tktview?name=40060873f3

-- 
Regards,
Bryan Drewery



signature.asc
Description: OpenPGP digital signature


Re: poudriere: setting up jail failes

2014-08-11 Thread Matthias Apitz
El día Monday, August 11, 2014 a las 12:14:39PM -0500, Bryan Drewery escribió:

  when I terminate the dialog, it seems that the pkg-* tools
  are used (which ofc are not installed on the host):
  
  === Setting user-specified options for kde-4.12.5 and dependencies
  /usr/local/sbin/pkg-static: not found
  make[1]: /usr/local/poudriere/ports/ports-head/Mk/bsd.openssl.mk line 99: 
  warning: Couldn't read shell's output for /usr/local/sbin/pkg-static  
  which -qo /usr/local/lib/libcrypto.so || :
  /usr/local/sbin/pkg-static: not found
  
  What I'm doing wrong or have understand wrong?
  
  Thanks
  
  matthias
  
 
 It is known, please see
 https://fossil.etoilebsd.net/poudriere/tktview?name=40060873f3

I'm not sure, after reading the ticket, if it is the same issue.
My concern is: why 'poudriere options ...' is awaiting some tools in
the hosts /usr/local/sbin/pkg-* to configure the options. If the
existance of /usr/local/sbin/pkg-* is a prerequired port to make
poudriere happy, it should pull the port in or at least mention this is
the man page. My host still has the old pkg_* tools installed.

Am I more clear now?

Thanks

matthias
-- 
Matthias Apitz   |  /\   ASCII Ribbon Campaign:
E-mail: g...@unixarea.de |  \ /   - No HTML/RTF in E-mail
WWW: http://www.unixarea.de/ |   X- No proprietary attachments
phone: +49-170-4527211   |  / \   - Respect for open standards
 | en.wikipedia.org/wiki/ASCII_Ribbon_Campaign
___
freebsd-current@freebsd.org mailing list
http://lists.freebsd.org/mailman/listinfo/freebsd-current
To unsubscribe, send any mail to freebsd-current-unsubscr...@freebsd.org

Re: poudriere: setting up jail failes

2014-08-09 Thread Matthias Apitz
El día Friday, August 08, 2014 a las 02:27:40PM -0500, Bryan Drewery escribió:

 On 8/8/2014 1:57 PM, Matthias Apitz wrote:
  And, btw., why is poudriere removing all the jail when an error occures?
  Wouldn't it be better to let it there to have a look into and remove it
  on the next run?
 
 Yes I agree this should probably change. I'll evaluate it after the 3.1
 release which is the major focus right now. The jail command has a lot
 of issues with building and error handling.

I have updated last night the host to 'head' and poudriere itself to
poudriere-devel-3.0.99.20140801. Compiling the ports in the jail makes
progress, as always with some hick-ups in the ports itself.

I have one fundamental question, maybe a missunderstanding of poudriere:

When I run 'poudriere options ...' it is not using the toolchain in the
jail:

# uname -a
FreeBSD vm-tiny-r269739 11.0-CURRENT FreeBSD 11.0-CURRENT #0 r269739: Sat Aug  
9 07:07:40 CEST 2014 guru@vm-tiny-r269739:/usr/obj/usr/src/sys/GENERIC  i386
$ 

# poudriere version
3.1-pre
# poudriere options -c -j freebsd-head -p ports-head x11/kde4

brings up the Options menu of x11/kde4 and when you look
with ps, it uses /usr/local/bin/dialog4ports for this:

# ps ax | fgrep dialog
92303  3  I+ 0:00,00 /usr/local/bin/dialog4ports

when I terminate the dialog, it seems that the pkg-* tools
are used (which ofc are not installed on the host):

=== Setting user-specified options for kde-4.12.5 and dependencies
/usr/local/sbin/pkg-static: not found
make[1]: /usr/local/poudriere/ports/ports-head/Mk/bsd.openssl.mk line 99: 
warning: Couldn't read shell's output for /usr/local/sbin/pkg-static  which 
-qo /usr/local/lib/libcrypto.so || :
/usr/local/sbin/pkg-static: not found

What I'm doing wrong or have understand wrong?

Thanks

matthias

-- 
Matthias Apitz   |  /\   ASCII Ribbon Campaign:
E-mail: g...@unixarea.de |  \ /   - No HTML/RTF in E-mail
WWW: http://www.unixarea.de/ |   X- No proprietary attachments
phone: +49-170-4527211   |  / \   - Respect for open standards
 | en.wikipedia.org/wiki/ASCII_Ribbon_Campaign
___
freebsd-current@freebsd.org mailing list
http://lists.freebsd.org/mailman/listinfo/freebsd-current
To unsubscribe, send any mail to freebsd-current-unsubscr...@freebsd.org

Re: poudriere: setting up jail failes

2014-08-08 Thread Bryan Drewery
On 8/8/2014 11:46 AM, Matthias Apitz wrote:
 
 Hello,
 
 I'm setting up a jail with poudriere(8) to compile my ports; after some
 hours it is crashing with:
 
 # poudriere jail -c -j freebsd-head -m svn+http -v head ; date
[...]
 mtree: illegal option -- N
 usage: mtree [-LPUcdeinqruxw] [-f spec] [-f spec] [-K key] [-k key] [-p
 path] [-s seed]
 [-X excludes]
 *** Error code 1
[...]

 The host where poudriere is running is:
 
 # uname -a
 FreeBSD vm-tiny-r255948 10.0-ALPHA4 FreeBSD 10.0-ALPHA4 #1: Fri Oct 18
 12:10:57 CEST 2013 g...@aurora.sisis.de:/usr/obj/usr/src/sys/GENERIC
 i386
 
 i.e. a CURRENT from Oct 2013 (r255948). Does this mean I should update
 the host where poudriere is running before?

Yes. For you it is fixed in stable/10 r257460 (which was in before 10.0
release) which added -N to mtree. There was a lot of polish at the end
of 10.0 so you should probably upgrade to at least 10.0 either way.

It could be that older releases building 10 and head for Poudriere may
be an issue still. I'll have to test more. Specifically the call of
'make distrib-dirs DB_FROM_SRC=1' seemingly not using the itools version
of mtree.

Also note that running a head jail on a 10.0 system is not really
supported. You may run into many weird issues building packages. It's
supported to have your host be newer than the jails but not the other
way around.

Regards,
Bryan Drewery



signature.asc
Description: OpenPGP digital signature


Re: poudriere: setting up jail failes

2014-08-08 Thread Matthias Apitz
El día Friday, August 08, 2014 a las 07:12:15PM +0200, Kurt Jaeger escribió:

 Hi!
 
  The host where poudriere is running is:
  
  # uname -a
  FreeBSD vm-tiny-r255948 10.0-ALPHA4 FreeBSD 10.0-ALPHA4 #1: Fri Oct 18
  12:10:57 CEST 2013 g...@aurora.sisis.de:/usr/obj/usr/src/sys/GENERIC
  i386
  
  i.e. a CURRENT from Oct 2013 (r255948). Does this mean I should update
  the host where poudriere is running before?
 
 Yes. Go for 10.0-REL p7, then retry.

Can you explain, why?

If one looks at the code which is executed in the jail, it looks like this
(for better readability I have changed the colons ':' in the PATH by
newlines):

PATH=/usr/obj/usr/local/poudriere/jails/freebsd-head/usr/src/tmp/legacy/usr/sbin
/usr/obj/usr/local/poudriere/jails/freebsd-head/usr/src/tmp/legacy/usr/bin
/usr/obj/usr/local/poudriere/jails/freebsd-head/usr/src/tmp/legacy/usr/games
/usr/obj/usr/local/poudriere/jails/freebsd-head/usr/src/tmp/legacy/bin
/usr/obj/usr/local/poudriere/jails/freebsd-head/usr/src/tmp/usr/sbin
/usr/obj/usr/local/poudriere/jails/freebsd-head/usr/src/tmp/usr/bin
/usr/obj/usr/local/poudriere/jails/freebsd-head/usr/src/tmp/usr/games
/usr/obj/usr/local/poudriere/jails/freebsd-head/usr/src/tmp/legacy/usr/sbin
/usr/obj/usr/local/poudriere/jails/freebsd-head/usr/src/tmp/legacy/usr/bin
/usr/obj/usr/local/poudriere/jails/freebsd-head/usr/src/tmp/legacy/usr/games
/usr/obj/usr/local/poudriere/jails/freebsd-head/usr/src/tmp/legacy/bin
/usr/obj/usr/local/poudriere/jails/freebsd-head/usr/src/tmp/usr/sbin
/usr/obj/usr/local/poudriere/jails/freebsd-head/usr/src/tmp/usr/bin
/usr/obj/usr/local/poudriere/jails/freebsd-head/usr/src/tmp/usr/games
/tmp/install.l1aks4sC
make LOCAL_MTREE= distrib-dirs
mtree -N /usr/local/poudriere/jails/freebsd-head/usr/src/etc -deU -f
/usr/local/poudriere/jails/freebsd-head/usr/src/etc/mtree/BSD.root.dist
-p /usr/local/poudriere/jails/freebsd-head/
mtree: illegal option -- N
usage: mtree [-LPUcdeinqruxw] [-f spec] [-f spec] [-K key] [-k key] [-p path] 
[-s seed] [-X excludes]
*** Error code 1

i.e. the tool 'mtree' is run from a hardcoded PATH from inside the jail
which was just compiled. Why the 'mtree' from a Makefile in CURRENT is
called with the -N flag, or why the 'mtree' from CURRENT does not
understand the -N flag?

I do not have a SVN checked out CURRENT to look into at the moment, but
I think either the Makefile or mtree is broken in CURRENT.

And, btw., why is poudriere removing all the jail when an error occures?
Wouldn't it be better to let it there to have a look into and remove it
on the next run?

 
 -- 
  6 years to go !

6 years to go to where or what?

Thanks

matthias

-- 
Matthias Apitz   |  /\   ASCII Ribbon Campaign:
E-mail: g...@unixarea.de |  \ /   - No HTML/RTF in E-mail
WWW: http://www.unixarea.de/ |   X- No proprietary attachments
phone: +49-170-4527211   |  / \   - Respect for open standards
 | en.wikipedia.org/wiki/ASCII_Ribbon_Campaign
___
freebsd-current@freebsd.org mailing list
http://lists.freebsd.org/mailman/listinfo/freebsd-current
To unsubscribe, send any mail to freebsd-current-unsubscr...@freebsd.org

Re: poudriere: setting up jail failes

2014-08-08 Thread Matthias Apitz
El día Friday, August 08, 2014 a las 01:43:51PM -0500, Bryan Drewery escribió:

 Yes. For you it is fixed in stable/10 r257460 (which was in before 10.0
 release) which added -N to mtree. There was a lot of polish at the end
 of 10.0 so you should probably upgrade to at least 10.0 either way.
 
 It could be that older releases building 10 and head for Poudriere may
 be an issue still. I'll have to test more. Specifically the call of
 'make distrib-dirs DB_FROM_SRC=1' seemingly not using the itools version
 of mtree.

This is perhaps the problem.

 Also note that running a head jail on a 10.0 system is not really
 supported. You may run into many weird issues building packages. It's
 supported to have your host be newer than the jails but not the other
 way around.

Hmm? The poudriere has the '-m svn' flag for creating jails. If one uses
this flag, the jail will always be newer than the host. If this is an
issue (which I do not understand if things are done in a jail, using the
toolchain of the jail) then this flag should be deleted from
poudriere, IMHO.

Thanks

matthias
-- 
Matthias Apitz   |  /\   ASCII Ribbon Campaign:
E-mail: g...@unixarea.de |  \ /   - No HTML/RTF in E-mail
WWW: http://www.unixarea.de/ |   X- No proprietary attachments
phone: +49-170-4527211   |  / \   - Respect for open standards
 | en.wikipedia.org/wiki/ASCII_Ribbon_Campaign
___
freebsd-current@freebsd.org mailing list
http://lists.freebsd.org/mailman/listinfo/freebsd-current
To unsubscribe, send any mail to freebsd-current-unsubscr...@freebsd.org

Re: poudriere: setting up jail failes

2014-08-08 Thread Kurt Jaeger
Hi!

   i.e. a CURRENT from Oct 2013 (r255948). Does this mean I should update
   the host where poudriere is running before?
  
  Yes. Go for 10.0-REL p7, then retry.
 
 Can you explain, why?

bdrewery@ knows much more about it than I do 8-)

I only know that it helps to use a recent system if one tries to
debug issues 8-} And: It takes time for others to help if one tries to use
some -ALPHA to do recent things...

-- 
p...@opsec.eu+49 171 3101372 6 years to go !
___
freebsd-current@freebsd.org mailing list
http://lists.freebsd.org/mailman/listinfo/freebsd-current
To unsubscribe, send any mail to freebsd-current-unsubscr...@freebsd.org


Re: poudriere: setting up jail failes

2014-08-08 Thread Bryan Drewery
On 8/8/2014 2:11 PM, Matthias Apitz wrote:
 El día Friday, August 08, 2014 a las 01:43:51PM -0500, Bryan Drewery escribió:
 
 Yes. For you it is fixed in stable/10 r257460 (which was in before 10.0
 release) which added -N to mtree. There was a lot of polish at the end
 of 10.0 so you should probably upgrade to at least 10.0 either way.

 It could be that older releases building 10 and head for Poudriere may
 be an issue still. I'll have to test more. Specifically the call of
 'make distrib-dirs DB_FROM_SRC=1' seemingly not using the itools version
 of mtree.
 
 This is perhaps the problem.
 
 Also note that running a head jail on a 10.0 system is not really
 supported. You may run into many weird issues building packages. It's
 supported to have your host be newer than the jails but not the other
 way around.
 
 Hmm? The poudriere has the '-m svn' flag for creating jails. If one uses
 this flag, the jail will always be newer than the host. If this is an
 issue (which I do not understand if things are done in a jail, using the
 toolchain of the jail) then this flag should be deleted from
 poudriere, IMHO.
 
 Thanks
 
   matthias
 

The use of -v head from a 10.0 system is the issue. Once you start a
build poudriere yells loudly that it is not supported. Major release
jumps are not supported. You can usually get away with a head host using
a head jail that is a few weeks newer as long as KBI does not change.
Doing major releases though can get into trouble with unknown syscalls
and different sized structs and capabilities. FreeBSD only tries to be
backwards-compatible with its interfaces (among major releases), not
guaranteed to be forward or even backwards compatible with head from
yesterday.

-- 
Regards,
Bryan Drewery



signature.asc
Description: OpenPGP digital signature


Re: poudriere: setting up jail failes

2014-08-08 Thread Bryan Drewery
On 8/8/2014 1:57 PM, Matthias Apitz wrote:
 And, btw., why is poudriere removing all the jail when an error occures?
 Wouldn't it be better to let it there to have a look into and remove it
 on the next run?

Yes I agree this should probably change. I'll evaluate it after the 3.1
release which is the major focus right now. The jail command has a lot
of issues with building and error handling.

-- 
Regards,
Bryan Drewery



signature.asc
Description: OpenPGP digital signature


Re: poudriere: setting up jail failes

2014-08-08 Thread Matthias Apitz
El día Friday, August 08, 2014 a las 02:24:18PM -0500, Bryan Drewery escribió:

 The use of -v head from a 10.0 system is the issue. Once you start a
 build poudriere yells loudly that it is not supported. Major release
 jumps are not supported. You can usually get away with a head host using
 a head jail that is a few weeks newer as long as KBI does not change.
 ...

OK, thanks. I will update the host to head and try again.

Btw: I did not saw any loud yells of poudriere. Maybe, because I went away from
the desk when poudriere was doing the SVN checkout and when I came back
it was already nicely compiling. Maybe it should ask a question like:
Do your really want that new jail on your old system? And wait for the
answer :-)


Thanks for your time.

matthias
-- 
Matthias Apitz   |  /\   ASCII Ribbon Campaign:
E-mail: g...@unixarea.de |  \ /   - No HTML/RTF in E-mail
WWW: http://www.unixarea.de/ |   X- No proprietary attachments
phone: +49-170-4527211   |  / \   - Respect for open standards
 | en.wikipedia.org/wiki/ASCII_Ribbon_Campaign
___
freebsd-current@freebsd.org mailing list
http://lists.freebsd.org/mailman/listinfo/freebsd-current
To unsubscribe, send any mail to freebsd-current-unsubscr...@freebsd.org

Re: poudriere: setting up jail failes

2014-08-08 Thread Bryan Drewery
On 8/8/2014 2:42 PM, Matthias Apitz wrote:
 El día Friday, August 08, 2014 a las 02:24:18PM -0500, Bryan Drewery escribió:
 
 The use of -v head from a 10.0 system is the issue. Once you start a
 build poudriere yells loudly that it is not supported. Major release
 jumps are not supported. You can usually get away with a head host using
 a head jail that is a few weeks newer as long as KBI does not change.
 ...
 
 OK, thanks. I will update the host to head and try again.
 
 Btw: I did not saw any loud yells of poudriere. Maybe, because I went away 
 from
 the desk when poudriere was doing the SVN checkout and when I came back
 it was already nicely compiling. Maybe it should ask a question like:
 Do your really want that new jail on your old system? And wait for the
 answer :-)
 
 
 Thanks for your time.
 
   matthias
 

Only in 'bulk', not 'jail'. There's also a securelevel blocker in 'bulk'
that is not in 'jail'. Some of these need to move to 'jail' to warn
earlier, yes.

-- 
Regards,
Bryan Drewery



signature.asc
Description: OpenPGP digital signature