Re: RFC: How to improve Ubuntu support

2014-11-20 Thread Moritz Struebe
Hey Thomas

Am 2014-11-13 um 10:57 schrieb Moritz Struebe:
  conf/sources.list
 I was hoping to fix this using classes.
 conf/sources.list/jessie
 conf/sources.list/wheezy
 conf/sources.list/squeeze
 conf/sources.list/trusty

Based on our phone call yesterday I looked into this and I'm afraid we
will have to go with /etc/os-release
Using $ID_$VERSION_ID will leave us with ubuntu_14.04 and debian_7 etc.
But I think that's sill better than doing adjustments during the
package-build as it makes cross-building very simple.

Morty


-- 
Dipl.-Ing. Moritz 'Morty' Strübe (Wissenschaftlicher Mitarbeiter)
Lehrstuhl für Informatik 4 (Verteilte Systeme und Betriebssysteme)
Friedrich-Alexander-Universität Erlangen-Nürnberg
Martensstr. 1
91058 Erlangen

Tel   : +49 9131 85-25419
Fax   : +49 9131 85-28732
eMail : stru...@cs.fau.de
WWW   : https://www4.cs.fau.de/~morty





smime.p7s
Description: S/MIME Cryptographic Signature


dracut in ubuntu (Was: RFC: How to improve Ubuntu support)

2014-11-17 Thread Moritz Struebe
Am 2014-11-17 um 09:12 schrieb Thomas Lange:
 On Mon, 17 Nov 2014 08:49:30 +0100, Moritz Struebe 
 moritz.stru...@cs.fau.de said:
  What it recent?
  
 http://packages.ubuntu.com/search?keywords=dracutsearchon=namessuite=allsection=all
 0.40+1-1 is currently available in Debian.
 https://packages.qa.debian.org/d/dracut.html


Hmm, but only in testing. And vivid is there, too:
https://launchpad.net/dracut
So, for Ubuntu I see two options. Add a ppa or contact Harald Hoyer [1].
But's that's probably something you should do.

Morty


[1] https://launchpad.net/~harald-redhat

-- 
Dipl.-Ing. Moritz 'Morty' Strübe (Wissenschaftlicher Mitarbeiter)
Lehrstuhl für Informatik 4 (Verteilte Systeme und Betriebssysteme)
Friedrich-Alexander-Universität Erlangen-Nürnberg
Martensstr. 1
91058 Erlangen

Tel   : +49 9131 85-25419
Fax   : +49 9131 85-28732
eMail : stru...@cs.fau.de
WWW   : https://www4.cs.fau.de/~morty





smime.p7s
Description: S/MIME Cryptographic Signature


Re: dracut in ubuntu (Was: RFC: How to improve Ubuntu support)

2014-11-17 Thread Thomas Lange
 On Mon, 17 Nov 2014 10:13:51 +0100, Moritz Struebe 
 moritz.stru...@cs.fau.de said:

 Hmm, but only in testing. And vivid is there, too:
 https://launchpad.net/dracut
 So, for Ubuntu I see two options. Add a ppa or contact Harald Hoyer [1].
 But's that's probably something you should do.

I would guess, that 040+1-1 would make it automatically into Ubuntu
vivid, but I'm not sure how this works in Ubuntu.

-- 
regards Thomas


RE: RFC: How to improve Ubuntu support

2014-11-13 Thread Robert Markula
On Thu, 06 Nov 2014 10:16:30 +0100, Moritz Struebe  
Moritz.Struebe at informatik.uni-erlangen.de said:

 * Improve the example configuration
 I see two ways of doing this. First make a second example Ubuntu or
 just add all the necessary changes in comments. As one should look
 through the configuration anyway this might be the solution that is
 easiest to maintain.
We already have a package_config/UBUNTU in FAI. Is this not
sufficient? Sure the repository URLs are different for Ubuntu, but
this should be done in the FAI package for Ubuntu.



Yes, your are right. I was thinking this through while reading [4] and
somehow my brain went down the wrong road - our own config, which I
inherited, is too far away from that example


Just to chime in...

I think Moritz' proposal on getting current FAI packages into the  
Ubuntu repositories is a great idea. FAI is a nightmare to configure  
on Ubuntu, there are so many quirks and pitfalls there and the  
documentation required to get it running is spread widely. A working  
out-of-the-box solution would be such an improvement for everyone.


In the Wiki page [4] you mentioned I tried to stick as closely as  
possible to the stock FAI configuration. All changes from the stock  
FAI configuration are documented cleanly with appropriate classes  
wherever possible. This eases transition and future upgrades. In fact,  
I'm using FAI since quite a few years now over multiple upgrades and  
this system has proven to be robust and scalable.


I'd recommend this path for the Ubuntu FAI packages as well in order  
to facilitate upgrades for the maintainer on one hand and make it  
easier for the users to work with this package on the other hand -  
keeping closely in sync with the official documentation, examples on  
the Wiki and the mailing lists. Introducing a whole new configuration  
just for Ubuntu would somewhat 'break' this compatibility.


What else would be great would be a Ubuntu-specific readme in the  
fai-server packages that gives a quick step-by-step-guide on how to  
get everything up and running (take 'fai-setup -vl' as an example).


Cheers,

Robert


[4] http://wiki.fai-project.org/wiki/Installing_Ubuntu_Linux_with_FAI


Re: RFC: How to improve Ubuntu support

2014-11-13 Thread Moritz Struebe
Hey.

Am 2014-11-13 um 09:59 schrieb Robert Markula:

 In the Wiki page [4] you mentioned I tried to stick as closely as
 possible to the stock FAI configuration. All changes from the stock
 FAI configuration are documented cleanly with appropriate classes
 wherever possible. This eases transition and future upgrades.

The problem with that page that I see is that the _changes_ are actually
not documented. It's rather a replace the contents of file X with Y. A
replace line X with Y or remove XY, would IMO be more helpful.

 In fact, I'm using FAI since quite a few years now over multiple
 upgrades and this system has proven to be robust and scalable.

Actually this is because the config was kept quite stable.


 I'd recommend this path for the Ubuntu FAI packages as well in order
 to facilitate upgrades for the maintainer on one hand and make it
 easier for the users to work with this package on the other hand -
 keeping closely in sync with the official documentation, examples on
 the Wiki and the mailing lists. Introducing a whole new configuration
 just for Ubuntu would somewhat 'break' this compatibility.

I strongly disagree. As I already said, it's currently a replace X with
Z. This could be simplified with copy example_ubuntu to . And I'm
not suggesting anything that isn't already there - at least in some way.



 What else would be great would be a Ubuntu-specific readme in the
 fai-server packages that gives a quick step-by-step-guide on how to
 get everything up and running (take 'fai-setup -vl' as an example). 

Ideally there shouldn't be any difference

Morty

-- 
Dipl.-Ing. Moritz 'Morty' Struebe (Wissenschaftlicher Mitarbeiter)
Lehrstuhl für Informatik 4 (Verteilte Systeme und Betriebssysteme)
Friedrich-Alexander-Universität Erlangen-Nürnberg
Martensstr. 1
91058 Erlangen

Tel   : +49 9131 85-25419
Fax   : +49 9131 85-28732
eMail : stru...@informatik.uni-erlangen.de
WWW   : https://www4.cs.fau.de/~morty





smime.p7s
Description: S/MIME Cryptographic Signature


Re: RFC: How to improve Ubuntu support

2014-11-13 Thread Robert Markula

Quoting Moritz Struebe moritz.stru...@informatik.uni-erlangen.de:


Am 2014-11-13 um 09:59 schrieb Robert Markula:


In the Wiki page [4] you mentioned I tried to stick as closely as
possible to the stock FAI configuration. All changes from the stock
FAI configuration are documented cleanly with appropriate classes
wherever possible. This eases transition and future upgrades.


The problem with that page that I see is that the _changes_ are actually
not documented. It's rather a replace the contents of file X with Y. A
replace line X with Y or remove XY, would IMO be more helpful.


Correct. Upon writing the Wiki page I initially had done exactly what  
you proposed - replace line X with Y. The result was that it made  
the wiki page awefully cumbersome to read. So I did stick with the  
current schema which focuses on getting things done quickly so the  
reader can mainly use copy and paste.


But my proposal was not about the writing of a wiki page, but on how  
the FAI config space could be modified. And there you can see that no  
existing classes are modified or even touched, instead additional  
classes, namely 'UBUNTU' and 'OS_UBUNTU_1404_AMD64' are introduced to  
cleanly separate the Ubuntu-specific changes.


The modification of the fai config files like '/etc/fai/fai.conf' is a  
different pair of shoes actually. But even this should stick as  
closely to the original as possible - and upon preparing the wiki it  
took me quite some time to find a solution which minimized the impact  
of the changes on the default config as much as possible.



In fact, I'm using FAI since quite a few years now over multiple
upgrades and this system has proven to be robust and scalable.


Actually this is because the config was kept quite stable.


Yes and no. On one hand, the FAI config *did* change over the years,  
and on the other hand Ubuntu as a distribution changed as well - the  
required configuration changes in order to make a specific Ubuntu  
release work did change with almost every Ubuntu release.



I'd recommend this path for the Ubuntu FAI packages as well in order
to facilitate upgrades for the maintainer on one hand and make it
easier for the users to work with this package on the other hand -
keeping closely in sync with the official documentation, examples on
the Wiki and the mailing lists. Introducing a whole new configuration
just for Ubuntu would somewhat 'break' this compatibility.


I strongly disagree. As I already said, it's currently a replace X with
Z. This could be simplified with copy example_ubuntu to . And I'm
not suggesting anything that isn't already there - at least in some way.


I strongly disagree to your disagreement :-) And I disagree to your  
proposal to create a completely separate example_ubuntu config for the  
reasons I mentioned in my earlier post. Why not use the existing  
configuration and just add the Ubuntu-specific changes in a  
non-intrusive way? Using classes is a very elegant way to do this.  
This could even be included in the default FAI config examples from  
Thomas without any harm.



What else would be great would be a Ubuntu-specific readme in the
fai-server packages that gives a quick step-by-step-guide on how to
get everything up and running (take 'fai-setup -vl' as an example).


Ideally there shouldn't be any difference


Absolutely! E.g. things would be much easier if dracut was supported  
on Ubuntu. But that's just a matter of time IMO.
And that brings me back to my initial statement: Keeping as close as  
possible to the stock FAI configuration would make the switch to  
dracut a breeze - just remove the Ubuntu-specific initramfs-related  
changes and you're set.


Reading your comments from other posts I get the impression that we  
intend the same things but just name them differently.


Cheers,

Robert


Re: RFC: How to improve Ubuntu support

2014-11-07 Thread Thomas Lange
 On Thu, 06 Nov 2014 10:16:30 +0100, Moritz Struebe 
 moritz.stru...@informatik.uni-erlangen.de said:

 I think we can take care of almost all issues at packaging time as
 described in [3].
Nice link. I didn't know that this was possible.
What are the current diffs in the packaging files for Ubuntu?

 The only real adjustments required by the PPA are
 adding the PPA's URL and it's key to config and nfsroot.
IMO this will be only a few lines of diffs. How do you like to handle
those diffs in git?


I love to see an up-to-date FAI release for every Ubuntu LTS, maybe
for every release. I prefer having this in universe instead of a
PPA. But maybe we start with the PPA if this is easier for you.

-- 
regards Thomas


Re: RFC: How to improve Ubuntu support

2014-11-07 Thread Moritz Struebe
Am 2014-11-07 um 13:23 schrieb Thomas Lange:
 On Thu, 06 Nov 2014 10:16:30 +0100, Moritz Struebe 
 moritz.stru...@informatik.uni-erlangen.de said:
  I think we can take care of almost all issues at packaging time as
  described in [3].
 Nice link. I didn't know that this was possible.
 What are the current diffs in the packaging files for Ubuntu?

For my PPA none and the packages build and install just fine - the only
one I haven't installed yet is fai-quickstart. If I find some time I'll
move them to the official PPA.



  The only real adjustments required by the PPA are
  adding the PPA's URL and it's key to config and nfsroot.
 IMO this will be only a few lines of diffs. How do you like to handle
 those diffs in git?

Generally I'd like to avoid a second repo and rather use the techniques
described in [3]. And if that is not sufficient rather add a
configuration file that is adjusted before building.

If I find some time I'll also look into my apt-get madison* +
apt-add-repository idea. It would also allow to automatically add 
http://fai-project.org/download  to the sources.list. Something like
apt-cache madison fai-client | head -n 1 | awk -F '|' '{print $3}' |
xargs apt-add-repository


* I had that wrong in my last mail



 I love to see an up-to-date FAI release for every Ubuntu LTS, maybe
 for every release. I prefer having this in universe instead of a
 PPA. But maybe we start with the PPA if this is easier for you.


Yes way PPA is easier. But once we got it working smoothly there, I
don't think it's a big issue to get it into universe. :)

Morty

-- 
Dipl.-Ing. Moritz 'Morty' Struebe (Wissenschaftlicher Mitarbeiter)
Lehrstuhl für Informatik 4 (Verteilte Systeme und Betriebssysteme)
Friedrich-Alexander-Universität Erlangen-Nürnberg
Martensstr. 1
91058 Erlangen

Tel   : +49 9131 85-25419
Fax   : +49 9131 85-28732
eMail : stru...@informatik.uni-erlangen.de
WWW   : https://www4.cs.fau.de/~morty





smime.p7s
Description: S/MIME Cryptographic Signature


Re: RFC: How to improve Ubuntu support

2014-11-07 Thread Thomas Lange
 On Fri, 07 Nov 2014 17:44:32 +0100, Moritz Struebe 
 moritz.stru...@informatik.uni-erlangen.de said:

 What are the current diffs in the packaging files for Ubuntu?

 For my PPA none and the packages build and install just fine - the only
But isn't it much more comfortable, if the Ubuntu version of FAI
already include the Ubuntu URLs? We did this in the past for the old
Ubuntu versions. I would like to give the Ubuntu users a FAI package,
that is ready-to-go, without the need of changing the configs too
much. Or without the need for changing them at all.

If we like to do this, how could be handle this in the build process
or in the git tree? First let's make a list of files of the FAI
sources, which may be different to those in Debian.

I guess it's:
conf/nfsroot.conf
conf/sources.list
examples/simple/files/etc/.../FAISERVER

Any diffs in conf/NFSROOT?
More files?
-- 
regards Thomas


Re: RFC: How to improve Ubuntu support

2014-11-07 Thread Thomas Lange
 On Fri, 07 Nov 2014 17:44:32 +0100, Moritz Struebe 
 moritz.stru...@informatik.uni-erlangen.de said:

 described in [3]. And if that is not sufficient rather add a
 configuration file that is adjusted before building.
What about a ubuntu/patches subdir, which contains the patches needed
for building the Ubuntu version? I there something that is used by
other Ubuntu packages, which have only small diffs to the Debian version?
-- 
regards Thomas


Re: RFC: How to improve Ubuntu support

2014-11-06 Thread Moritz Struebe
Am 2014-11-05 um 18:55 schrieb Thomas Lange:
 On Tue, 04 Nov 2014 09:37:28 +0100, Moritz Struebe 
 moritz.stru...@informatik.uni-erlangen.de said:
  Currently I see the following ways of improving things:

  * Get the FAI-Project at launchpad[1] up to date.
 Nice. I will contact someone, that can give you write access to the
 launchpad page.

Oh, I already have access.. ;)


  I can do this, but it would be nice to have that extra branch with
  releases to automate the process (see my other mail)
 But creating a branch called release is not enough IMO. You'll have to
 apply some patches to make a release for Ubuntu. For e.g. package and 
 repository
 names are different. How do you want to handle the diffs between the
 original FAI sources and the Ubuntu version of FAI?

Well, actually it isn't that bad. Currently I'm building nightlies from
the official trunk [1] and have an extra release branch in my own repo
for my release-ppa [2]. The latter is in productive use. We are not
using the server-package though, as we have our own tftp/nfs server.
I think we can take care of almost all issues at packaging time as
described in [3]. The only real adjustments required by the PPA are
adding the PPA's URL and it's key to config and nfsroot. And using some
dpkg madison + apt-add-repository - magic this should be possible in
a generic way, too - even for your own repo.



  * Improve the example configuration
  I see two ways of doing this. First make a second example Ubuntu or
  just add all the necessary changes in comments. As one should look
  through the configuration anyway this might be the solution that is
  easiest to maintain.
 We already have a package_config/UBUNTU in FAI. Is this not
 sufficient? Sure the repository URLs are different for Ubuntu, but
 this should be done in the FAI package for Ubuntu.

Yes, your are right. I was thinking this through while reading [4] and
somehow my brain went down the wrong road - our own config, which I
inherited, is too far away from that example


  * NFSROOT
  Ok, this is the one giving my the biggest headache. One solution would
  be to add an extra folder or something. IMO the nicer solution would be
  adapt the way the fai-client is working: Add a script that detects the
  right classes and use that to select the files. This would allow to not
  only manage those file on a distro-basis, but also on a release-bases.
  In the end it is possible to manage multiple nfs roots with the same
  config folder and the only file that needs to be adjusted is the
  nfsroot.conf.
 I'm not sure if I understand you correctly. Please give more details
 about your thoughts.

 Currently fai-setup and fai-make-nfsroot can be called with -C
 /etc/fai-ubuntu or something similar.
Yes, that is what we are currently doing. None the less, this can be
reduced to adjusting the path for deboostrap. From there on the
sources.list and the packages for that distro can be selected
automatically. Thus instead of passing a folder, one would only pass a
single file.

Cheers
Morty



[1] https://launchpad.net/~morty/+archive/ubuntu/fai
[2] https://launchpad.net/~morty/+archive/ubuntu/fai-release
[3]
http://raphaelhertzog.com/2010/09/27/different-dependencies-between-debian-and-ubuntu-but-common-source-package/
[4] http://wiki.fai-project.org/wiki/Installing_Ubuntu_Linux_with_FAI

-- 
Dipl.-Ing. Moritz 'Morty' Struebe (Wissenschaftlicher Mitarbeiter)
Lehrstuhl für Informatik 4 (Verteilte Systeme und Betriebssysteme)
Friedrich-Alexander-Universität Erlangen-Nürnberg
Martensstr. 1
91058 Erlangen

Tel   : +49 9131 85-25419
Fax   : +49 9131 85-28732
eMail : stru...@informatik.uni-erlangen.de
WWW   : https://www4.cs.fau.de/~morty





smime.p7s
Description: S/MIME Cryptographic Signature


Re: RFC: How to improve Ubuntu support

2014-11-05 Thread Thomas Lange
 On Tue, 04 Nov 2014 09:37:28 +0100, Moritz Struebe 
 moritz.stru...@informatik.uni-erlangen.de said:

 Currently I see the following ways of improving things:

 * Get the FAI-Project at launchpad[1] up to date.
Nice. I will contact someone, that can give you write access to the
launchpad page.

 I can do this, but it would be nice to have that extra branch with
 releases to automate the process (see my other mail)
But creating a branch called release is not enough IMO. You'll have to
apply some patches to make a release for Ubuntu. For e.g. package and repository
names are different. How do you want to handle the diffs between the
original FAI sources and the Ubuntu version of FAI?

 * Improve the example configuration
 I see two ways of doing this. First make a second example Ubuntu or
 just add all the necessary changes in comments. As one should look
 through the configuration anyway this might be the solution that is
 easiest to maintain.
We already have a package_config/UBUNTU in FAI. Is this not
sufficient? Sure the repository URLs are different for Ubuntu, but
this should be done in the FAI package for Ubuntu.

 * NFSROOT
 Ok, this is the one giving my the biggest headache. One solution would
 be to add an extra folder or something. IMO the nicer solution would be
 adapt the way the fai-client is working: Add a script that detects the
 right classes and use that to select the files. This would allow to not
 only manage those file on a distro-basis, but also on a release-bases.
 In the end it is possible to manage multiple nfs roots with the same
 config folder and the only file that needs to be adjusted is the
 nfsroot.conf.
I'm not sure if I understand you correctly. Please give more details
about your thoughts.

Currently fai-setup and fai-make-nfsroot can be called with -C
/etc/fai-ubuntu or something similar.

-- 
regards Thomas


RFC: How to improve Ubuntu support

2014-11-04 Thread Moritz Struebe
Hey there,

we are currently using FAI for our Ubuntu systems. Once everything is
set up, things run very smooth. None the less, we think that for new
users things could be a bit smoother.
Currently I see the following ways of improving things:

* Get the FAI-Project at launchpad[1] up to date.
I can do this, but it would be nice to have that extra branch with
releases to automate the process (see my other mail)

* Improve the example configuration
I see two ways of doing this. First make a second example Ubuntu or
just add all the necessary changes in comments. As one should look
through the configuration anyway this might be the solution that is
easiest to maintain.

* NFSROOT
Ok, this is the one giving my the biggest headache. One solution would
be to add an extra folder or something. IMO the nicer solution would be
adapt the way the fai-client is working: Add a script that detects the
right classes and use that to select the files. This would allow to not
only manage those file on a distro-basis, but also on a release-bases.
In the end it is possible to manage multiple nfs roots with the same
config folder and the only file that needs to be adjusted is the
nfsroot.conf.

Cheers
Morty

[1] https://launchpad.net/fai/

-- 
Dipl.-Ing. Moritz 'Morty' Struebe (Wissenschaftlicher Mitarbeiter)
Lehrstuhl für Informatik 4 (Verteilte Systeme und Betriebssysteme)
Friedrich-Alexander-Universität Erlangen-Nürnberg
Martensstr. 1
91058 Erlangen

Tel   : +49 9131 85-25419
Fax   : +49 9131 85-28732
eMail : stru...@informatik.uni-erlangen.de
WWW   : https://www4.cs.fau.de/~morty





smime.p7s
Description: S/MIME Cryptographic Signature