Re: Integrated ZFS for Gentoo - WAS Re: [gentoo-user] Optional /usr merge in Gentoo

[Marc Stürmer]

Am 02.09.2013 10:47, schrieb Joerg Schilling:


Solaris is dynamic from the beginning:


Well in my point of view it boils down to that: someone wants to use ZFS 
on Linux. Fine. This means you've got to be a good citizen and obey its 
license, of course.


It is for those legal reasons that ZFS is not included into the Linux 
kernel mainline source tree. It is also for those reasons you got to 
compile it as a module.


So somebody wants it being static into his kernel, modules being 
disabled on his machine because of security concerns. Unless he is going 
to do that stuff himself this is unlikely to ever happen.


So it boils down to those possible solutions:

a) writing that stuff himself (unlikely to happen),
b) just using the module and going to be happy (also unlikely to happen 
as it seems),
c) choosing another, native file system like Btrfs (which is still yet 
not production ready as a fast moving target) or going with something 
like XFS or Ext4 (and LVM),


or the most natural choice then, which is

d) choosing an operating system, which supports ZFS out of the box like 
FreeBSD and forget about all the rest of the problems.


I would go for d and forget about all of the rest of the problems. 
FreeBSD has been around long enough, and is stable and mature enough for 
most anything you can throw at and it is a nice, clean, well structured 
system anyway.


There's also Gentoo/FreeBSD around, but personally I would use the 
native ports system instead.

Re: [gentoo-user] Re: Install from USB stick; here's how

[Walter Dnes]

On Tue, Sep 03, 2013 at 10:13:29PM +, Grant Edwards wrote
> 
> IIRC, the last time I tried 'cp' it worked just as well as 'dd'
> 
>   cp install-x86-minimal-20121213.iso /dev/sdb

  Interesting.  I assume that /dev/sdb was not mounted.

-- 
Walter Dnes 
I don't run "desktop environments"; I run useful applications

Re: Integrated ZFS for Gentoo - WAS Re: [gentoo-user] Optional /usr merge in Gentoo

[Walter Dnes]

On Mon, Sep 02, 2013 at 10:47:35AM +0200, Joerg Schilling wrote
> Mark David Dumlao  wrote:
> > At what point does grub "present a zfs interface for the kernel to use"?
> 
> After it booted the kernel
> 
> You may not know dynamic kernels as Linux is a static kernel that
> just may load additional modules _after_ it mounted the root fs.
> 
> Solaris is dynamic from the beginning:
> 
> - no static loading at all
> 
> - no predefined data sizes - everything is allocated
> 
> - no predefined major device numbers - numbers are assigned at first load
> 
> Grub works this way:
> 
> 1)It loads /platform/i86pc/kernel/$ISADIR/unix

  Question... how does it read that file off a ZFS partition?  OK, so
ZFS code has to be installed statically into GRUB instead of statically
into the kernel.  Please stop the shell game.

  Note also that this is a Gentoo *LINUX* mailing list.  We're more
concerned about how Linux works.

-- 
Walter Dnes 
I don't run "desktop environments"; I run useful applications

Re: [gentoo-user] cupsd (localhost:631) trouble

[gottlieb]

On Tue, Sep 03 2013, Lee wrote:
>
>> On a reboot the cups main page appears in firefox (it is the plain,
>> non-qt version, which I have used successfully for years).
>>
>> However if I try to refresh the page or go to say the printer page I get
>> "Firefox can't establish a connection to the server at localhost:631."
>>
>> If I execute
>>   /etc/init.d/cupsd restart
>> I get in /var/log/messages
>>
>> Sep  3 18:28:09 newlap colord: Automatic remove of
>> HP-LaserJet-P2055dn-Gray.. from cups-HP-LaserJet-P2055dn
>> Sep  3 18:28:09 newlap colord: Profile removed: HP-LaserJet-P2055dn-Gray..
>> Sep  3 18:28:09 newlap colord: Automatic remove of
>> HP-LaserJet-P2055dn-RGB.. from cups-HP-LaserJet-P2055dn
>> Sep  3 18:28:09 newlap colord: Profile removed: HP-LaserJet-P2055dn-RGB..
>> Sep  3 18:28:09 newlap colord: device removed: cups-HP-LaserJet-P2055dn
>> Sep  3 18:28:09 newlap colord: Automatic remove of lj-Gray.. from cups-lj
>> Sep  3 18:28:09 newlap colord: Profile removed: lj-Gray..
>> Sep  3 18:28:09 newlap colord: Automatic remove of lj-RGB.. from cups-lj
>> Sep  3 18:28:09 newlap colord: Profile removed: lj-RGB..
>> Sep  3 18:28:09 newlap colord: device removed: cups-lj
>> Sep  3 18:28:09 newlap colord: Profile added: HP-LaserJet-P2055dn-Gray..
>> Sep  3 18:28:09 newlap colord: Profile added: HP-LaserJet-P2055dn-RGB..
>> Sep  3 18:28:09 newlap colord: Device added: cups-HP-LaserJet-P2055dn
>> Sep  3 18:28:09 newlap colord: Profile added: lj-Gray..
>> Sep  3 18:28:09 newlap colord: Profile added: lj-RGB..
>> Sep  3 18:28:09 newlap colord: Device added: cups-lj
>> Sep  3 18:28:10 newlap hpcups[9016]: prnt/hpcups/HPCupsFilter.cpp 724:
>> First raster data plane..
>>
>> (the last line indicates a "stuck" print job; I am having trouble
>> printing, which is why I wanted to access cups to delete the printers
>> and reinstall them).
>>
>> Any help would be appreciated.
>> thanks,
>> allan
>>
>>
> Just a shot in the dark, but have u tried printer mgmt from hp-setup
> instead of cups? There is an ASCII alternative to the qt interface included
> in hplips.
> On Sep 3, 2013 5:01 PM,  wrote:

I normally do install printers using hp-setup.  But I uses cups (web
interface) to first delete all the queues and also find the cups web
interface useful for printing.

What is the hp- command to "start over", e.g. remove all existing
queues?

I feel there must be something very wrong here.

thanks,
allan

Re: [gentoo-user] Optional /usr merge in Gentoo

[Dale]

Douglas J Hunley wrote:
>
> On Sun, Sep 1, 2013 at 10:30 AM, Tanstaafl  > wrote:
>
> Is there any reason that the creation, use and maintenance of the
> initramfs couldn't be as simple as a checkbox in the kernel
> config, so that running 'make' after the kernel was configured
> would automatically build it? Then, all I'd have to do is move it
> into /boot along with the new kernel (just like I do now), with
> *nothing* else required, and the kernel would call it, and things
> would just work (as long as it was there and I didn't forget to
> copy it to /boot).
>
>
> This exists. You can built initramfs right into the kernel. I've been
> doing it here for quite some time. You just tell the kernel either:
> * where to find a filespec so it knows what to include in the initramfs
> * what directory contains everything you want in the initramfs
>
> and then the kernel builds is and attaches it to itself during 'make'
>
> It's actually pretty trivial
>
>
> -- 
> Douglas J Hunley (doug.hun...@gmail.com )
> Twitter: @hunleyd   Web:
> douglasjhunley.com 
> G+: http://goo.gl/sajR3

I tried that a while back.  Followed a howto step by step, Gentoo one I
think, and it never worked, not even once.  Trivial, not hardly. 

Dale

:-)  :-) 

-- 
I am only responsible for what I said ... Not for what you understood or how 
you interpreted my words!

Re: [gentoo-user] Re: Need help: Filesystem (ext4) corrupted!

[meino . cramer]

Francisco Ares  [13-09-04 02:08]:
> Em 03/09/2013 13:12,  escreveu:
> >
> > William Kenworthy  [13-09-03 17:16]:
> > > On 03/09/13 11:26, meino.cra...@gmx.de wrote:
> > > > William Kenworthy  [13-09-03 05:08]:
> > > >> On 03/09/13 10:45, meino.cra...@gmx.de wrote:
> > > >>> walt  [13-09-03 04:15]:
> > >  On 09/02/2013 09:15 AM, meino.cra...@gmx.de wrote:
> > > > The rootfs and $HOME of my embedded system is stored
> > > > on a 16GB SD-card (about 5GB used, rest free). The FS
> > > > is ext4.
> > > >
> > > > Since the system hangs for unknown reasons several times
> > >  Does it hang at a predictable point, like during boot, or poweroff?
> > > 
> > >  I know almost nothing about SD cards (yet).  Do they develop bad
> > >  blocks like other storage media?  I notice fsck.ext4 has a -c flag
> > >  to check for bad blocks.
> > > 
> > > >>> No, it hangs while compiling or while updateing (eix-sync; emerge
> ...).
> > > >>>
> > > >>>
> > > >>> I did the following now:
> > > >>> I did a binary image backup with dd of the sdcard.
> > > >>> I made a backup of the all files from the bad fs with tar.
> > > >>> I say "YES" to fsck to fix what it found.
> > > >>> I made another backup of the all files from the bad fs with tar.
> > > >>> I md5summed both tar archives and found them identical.
> > > >>>
> > > >>> Now...is the conclusion correct, that the identical md5sum
> > > >>> indicate, that the fixed error of the fs only had impact to
> > > >>> already invalidated data?
> > > >>> Or whatelse could this indicate?
> > > >>>
> > > >>> Best regards,
> > > >>> mcc
> > > >>>
> > > >>> PS: What come mind just in this moment:
> > > >>> Can I ran fsck on an binary image of the fs which I made with dd
> somehow?
> > > >>>
> > > >>>
> > > >>>
> > > >>>
> > > >>>
> > > >> Have you run out of inodes? - ext 4 has had very mixed success for
> me on
> > > >> solid state.  Running out of inodes is a real problem for gentoo on
> > > >> smaller SD cards with standard settings.
> > > >>
> > > >> BillK
> > > >>
> > > >>
> > > >>
> > > > Does this error message from fsck indicate that? I am really bad in
> > > > guessing what fsck tries to cry at me ... ;)
> > > >
> > > >
> > > >>> solfire:/root>fsck.ext4 -f -p /dev/sdb2
> > > >>> rootfs: Inodes that were part of a corrupted orphan linked list
> found.
> > > >>>
> > > >>> rootfs: UNEXPECTED INCONSISTENCY; RUN fsck MANUALLY.
> > > >>> (i.e., without -a or -p options)
> > > >>> [1]18644 exit 4 fsck.ext4 -f -p /dev/sdb2
> > > >>>
> > > >>>
> > > > Is there any way to correct the settings from the default values to
> > > > more advances ones, which respect the sdcard size of 16GB *without*
> > > > blanking it...a "correction on the fly" so to say???
> > > >
> > > > And if not: Is there a way to backup the sdcard and playback the files
> > > > after reformatting it by preserving all three time stamps of the
> > > > files (atime is deactivated via fstab though) ?
> > > >
> > > > Best regards,
> > > > mcc
> > > >
> > > >
> > > >
> > > >
> > > >
> > > df -i - if you get 100% iUSE or near to it thats your problem ... I have
> > > seen that error message you give as a result of running out of inodes
> > > corrupting the FS.
> > >
> > > No, your only way out is to copy (I use rync) the files off, recreate
> > > the fs with max inodes ("man mke2fs") and rsync the files back.  Once an
> > > ext* fs has been created with a certain number of inodes its fixed until
> > > you re-format.
> > >
> > > I get it happening regularly on 4G cards when I forget and just emerge a
> > > couple of packages without cleaning up in between packages.  On 16G
> > > cards, its compiling something like glibc or gcc that uses huge numbers
> > > of inodes at times.  On a single 32G card I have, the standard settings
> > > have been fine ... so far :)
> > >
> > > Billk
> > >
> > >
> >
> > df -i gives the following:
> >
> > rootfs   971040 352208   618832   37% /
> > /dev/root971040 352208   618832   37% /
> > devtmpfs  63420434629861% /dev
> > tmpfs 63456389630671% /run
> > shm   63456  1634551% /dev/shm
> > cgroup_root   63456  6634501% /sys/fs/cgroup
> > /dev/mmcblk0p10  00 - /boot
> >
> >
> > You mentioned rsync to backup...
> >
> > I used
> >
> > sudo tar cvf  
> >
> > the rootfs has only one partition...
> >
> > Is it alos ok to use tar or is there any drawback?
> >
> > Best regards,
> > mcc
> >
> >
> >
> 
> There are some parameters for creating a better backup archive using tar,
> like --same-owner and --atime- preserve.
> 
> By the way, it would be an interesting project to export some folders on
> your home computer using nfs, tuneling it through ssh, monting it locally
> in your embedded computer, and applying an unionfs to the rootfs.  Just
> dreaming, of course.
> 
> Góod luck
> Francisco

Hi Francisco,

as

Re: [gentoo-user] cupsd (localhost:631) trouble

[Lee]

Just a shot in the dark, but have u tried printer mgmt from hp-setup
instead of cups? There is an ASCII alternative to the qt interface included
in hplips.
On Sep 3, 2013 5:01 PM,  wrote:

> On a reboot the cups main page appears in firefox (it is the plain,
> non-qt version, which I have used successfully for years).
>
> However if I try to refresh the page or go to say the printer page I get
> "Firefox can't establish a connection to the server at localhost:631."
>
> If I execute
>   /etc/init.d/cupsd restart
> I get in /var/log/messages
>
> Sep  3 18:28:09 newlap colord: Automatic remove of
> HP-LaserJet-P2055dn-Gray.. from cups-HP-LaserJet-P2055dn
> Sep  3 18:28:09 newlap colord: Profile removed: HP-LaserJet-P2055dn-Gray..
> Sep  3 18:28:09 newlap colord: Automatic remove of
> HP-LaserJet-P2055dn-RGB.. from cups-HP-LaserJet-P2055dn
> Sep  3 18:28:09 newlap colord: Profile removed: HP-LaserJet-P2055dn-RGB..
> Sep  3 18:28:09 newlap colord: device removed: cups-HP-LaserJet-P2055dn
> Sep  3 18:28:09 newlap colord: Automatic remove of lj-Gray.. from cups-lj
> Sep  3 18:28:09 newlap colord: Profile removed: lj-Gray..
> Sep  3 18:28:09 newlap colord: Automatic remove of lj-RGB.. from cups-lj
> Sep  3 18:28:09 newlap colord: Profile removed: lj-RGB..
> Sep  3 18:28:09 newlap colord: device removed: cups-lj
> Sep  3 18:28:09 newlap colord: Profile added: HP-LaserJet-P2055dn-Gray..
> Sep  3 18:28:09 newlap colord: Profile added: HP-LaserJet-P2055dn-RGB..
> Sep  3 18:28:09 newlap colord: Device added: cups-HP-LaserJet-P2055dn
> Sep  3 18:28:09 newlap colord: Profile added: lj-Gray..
> Sep  3 18:28:09 newlap colord: Profile added: lj-RGB..
> Sep  3 18:28:09 newlap colord: Device added: cups-lj
> Sep  3 18:28:10 newlap hpcups[9016]: prnt/hpcups/HPCupsFilter.cpp 724:
> First raster data plane..
>
> (the last line indicates a "stuck" print job; I am having trouble
> printing, which is why I wanted to access cups to delete the printers
> and reinstall them).
>
> Any help would be appreciated.
> thanks,
> allan
>
>

[gentoo-user] cupsd (localhost:631) trouble

[gottlieb]

On a reboot the cups main page appears in firefox (it is the plain,
non-qt version, which I have used successfully for years).

However if I try to refresh the page or go to say the printer page I get
"Firefox can't establish a connection to the server at localhost:631."

If I execute
  /etc/init.d/cupsd restart
I get in /var/log/messages

Sep  3 18:28:09 newlap colord: Automatic remove of HP-LaserJet-P2055dn-Gray.. 
from cups-HP-LaserJet-P2055dn
Sep  3 18:28:09 newlap colord: Profile removed: HP-LaserJet-P2055dn-Gray..
Sep  3 18:28:09 newlap colord: Automatic remove of HP-LaserJet-P2055dn-RGB.. 
from cups-HP-LaserJet-P2055dn
Sep  3 18:28:09 newlap colord: Profile removed: HP-LaserJet-P2055dn-RGB..
Sep  3 18:28:09 newlap colord: device removed: cups-HP-LaserJet-P2055dn
Sep  3 18:28:09 newlap colord: Automatic remove of lj-Gray.. from cups-lj
Sep  3 18:28:09 newlap colord: Profile removed: lj-Gray..
Sep  3 18:28:09 newlap colord: Automatic remove of lj-RGB.. from cups-lj
Sep  3 18:28:09 newlap colord: Profile removed: lj-RGB..
Sep  3 18:28:09 newlap colord: device removed: cups-lj
Sep  3 18:28:09 newlap colord: Profile added: HP-LaserJet-P2055dn-Gray..
Sep  3 18:28:09 newlap colord: Profile added: HP-LaserJet-P2055dn-RGB..
Sep  3 18:28:09 newlap colord: Device added: cups-HP-LaserJet-P2055dn
Sep  3 18:28:09 newlap colord: Profile added: lj-Gray..
Sep  3 18:28:09 newlap colord: Profile added: lj-RGB..
Sep  3 18:28:09 newlap colord: Device added: cups-lj
Sep  3 18:28:10 newlap hpcups[9016]: prnt/hpcups/HPCupsFilter.cpp 724: First 
raster data plane..

(the last line indicates a "stuck" print job; I am having trouble
printing, which is why I wanted to access cups to delete the printers
and reinstall them).

Any help would be appreciated.
thanks,
allan

Re: [gentoo-user] HP officejet pro 8600 printer (all-in-one)

[gottlieb]

thank you bruce and tom.

allan

Re: [gentoo-user] Re: Need help: Filesystem (ext4) corrupted!

[Francisco Ares]

Em 03/09/2013 13:12,  escreveu:
>
> William Kenworthy  [13-09-03 17:16]:
> > On 03/09/13 11:26, meino.cra...@gmx.de wrote:
> > > William Kenworthy  [13-09-03 05:08]:
> > >> On 03/09/13 10:45, meino.cra...@gmx.de wrote:
> > >>> walt  [13-09-03 04:15]:
> >  On 09/02/2013 09:15 AM, meino.cra...@gmx.de wrote:
> > > The rootfs and $HOME of my embedded system is stored
> > > on a 16GB SD-card (about 5GB used, rest free). The FS
> > > is ext4.
> > >
> > > Since the system hangs for unknown reasons several times
> >  Does it hang at a predictable point, like during boot, or poweroff?
> > 
> >  I know almost nothing about SD cards (yet).  Do they develop bad
> >  blocks like other storage media?  I notice fsck.ext4 has a -c flag
> >  to check for bad blocks.
> > 
> > >>> No, it hangs while compiling or while updateing (eix-sync; emerge
...).
> > >>>
> > >>>
> > >>> I did the following now:
> > >>> I did a binary image backup with dd of the sdcard.
> > >>> I made a backup of the all files from the bad fs with tar.
> > >>> I say "YES" to fsck to fix what it found.
> > >>> I made another backup of the all files from the bad fs with tar.
> > >>> I md5summed both tar archives and found them identical.
> > >>>
> > >>> Now...is the conclusion correct, that the identical md5sum
> > >>> indicate, that the fixed error of the fs only had impact to
> > >>> already invalidated data?
> > >>> Or whatelse could this indicate?
> > >>>
> > >>> Best regards,
> > >>> mcc
> > >>>
> > >>> PS: What come mind just in this moment:
> > >>> Can I ran fsck on an binary image of the fs which I made with dd
somehow?
> > >>>
> > >>>
> > >>>
> > >>>
> > >>>
> > >> Have you run out of inodes? - ext 4 has had very mixed success for
me on
> > >> solid state.  Running out of inodes is a real problem for gentoo on
> > >> smaller SD cards with standard settings.
> > >>
> > >> BillK
> > >>
> > >>
> > >>
> > > Does this error message from fsck indicate that? I am really bad in
> > > guessing what fsck tries to cry at me ... ;)
> > >
> > >
> > >>> solfire:/root>fsck.ext4 -f -p /dev/sdb2
> > >>> rootfs: Inodes that were part of a corrupted orphan linked list
found.
> > >>>
> > >>> rootfs: UNEXPECTED INCONSISTENCY; RUN fsck MANUALLY.
> > >>> (i.e., without -a or -p options)
> > >>> [1]18644 exit 4 fsck.ext4 -f -p /dev/sdb2
> > >>>
> > >>>
> > > Is there any way to correct the settings from the default values to
> > > more advances ones, which respect the sdcard size of 16GB *without*
> > > blanking it...a "correction on the fly" so to say???
> > >
> > > And if not: Is there a way to backup the sdcard and playback the files
> > > after reformatting it by preserving all three time stamps of the
> > > files (atime is deactivated via fstab though) ?
> > >
> > > Best regards,
> > > mcc
> > >
> > >
> > >
> > >
> > >
> > df -i - if you get 100% iUSE or near to it thats your problem ... I have
> > seen that error message you give as a result of running out of inodes
> > corrupting the FS.
> >
> > No, your only way out is to copy (I use rync) the files off, recreate
> > the fs with max inodes ("man mke2fs") and rsync the files back.  Once an
> > ext* fs has been created with a certain number of inodes its fixed until
> > you re-format.
> >
> > I get it happening regularly on 4G cards when I forget and just emerge a
> > couple of packages without cleaning up in between packages.  On 16G
> > cards, its compiling something like glibc or gcc that uses huge numbers
> > of inodes at times.  On a single 32G card I have, the standard settings
> > have been fine ... so far :)
> >
> > Billk
> >
> >
>
> df -i gives the following:
>
> rootfs   971040 352208   618832   37% /
> /dev/root971040 352208   618832   37% /
> devtmpfs  63420434629861% /dev
> tmpfs 63456389630671% /run
> shm   63456  1634551% /dev/shm
> cgroup_root   63456  6634501% /sys/fs/cgroup
> /dev/mmcblk0p10  00 - /boot
>
>
> You mentioned rsync to backup...
>
> I used
>
> sudo tar cvf  
>
> the rootfs has only one partition...
>
> Is it alos ok to use tar or is there any drawback?
>
> Best regards,
> mcc
>
>
>

There are some parameters for creating a better backup archive using tar,
like --same-owner and --atime- preserve.

By the way, it would be an interesting project to export some folders on
your home computer using nfs, tuneling it through ssh, monting it locally
in your embedded computer, and applying an unionfs to the rootfs.  Just
dreaming, of course.

Góod luck
Francisco

[gentoo-user] Re: Install from USB stick; here's how

[Grant Edwards]

On 2013-09-03, Alan McKinnon  wrote:
> On 03/09/2013 23:19, Grant Edwards wrote:
>> On 2013-09-03, Alan McKinnon  wrote:
>>> On 03/09/2013 19:05, Grant Edwards wrote:
 On 2013-01-07, Walter Dnes  wrote:

[...]

> isohybrid install-x86-minimal-20121213.iso
[...]
> * I then copied it over to a USB stick (/dev/sdb) with the command...
>
> dd bs=4M if=install-x86-minimal-20121213.iso of=/dev/sdb

[...]

 After running the isohybrid command, I compared the resulting image
 with the original.  They were identical.  I copied the image to a USB
 flash drive, and it booted just fine.

 It seems that the minimal install .iso images are already built for
 hybrid booting from either CD or a generic block device (e.g. USB
 mass-storage device).

 So what's the deal with http://wiki.gentoo.org/wiki/LiveUSB/HOWTO?

 Why isn't it just the steps below?

   1) Copy the minimal install .iso to USB mass storage device.

   2) Boot from USB mass storage device.  
>>>
>>> Copying an .iso to a USB stick does not give you a bootable USB
>>> stick.
>> 
>> It does for recent Gentoo minimial install .iso images.
>
> Now I'm confused, let's clarify. Which of these meanings of copy are you
> using:
>
> cp my_big.iso /where/i/mounted/the/stick
>
> dd if=my_big.iso of=/dev/sdb

Sorry about that.  The latter.  The actual command is shown about 32
lines up (except that my minimal install .iso was more recent)...

IIRC, the last time I tried 'cp' it worked just as well as 'dd'

  cp install-x86-minimal-20121213.iso /dev/sdb
  
The Wiki page at http://wiki.gentoo.org/wiki/LiveUSB/HOWTO shows a
rather involved process for creating a bootable USB drive from a
Gentoo minimal install .iso.  However, AFAICT, you don't have to do
any of it.  You can just write the .iso image to the usb flash drive
and then boot from it.
  
I presume that at some point in the past, the minimal install .iso
images weren't bootable from a "hard-drive", and the process on the
wiki page was needed. But since the Gentoo .iso images _are_ bootable,
why not just say so and get rid of the old recipe?

[The old recipe still works, and perhaps it's useful for generic .iso
images from elsewhere, but for a Gentoo install .iso it's a bit of a
time-waster.]

-- 
Grant Edwards   grant.b.edwardsYow! BELA LUGOSI is my
  at   co-pilot ...
  gmail.com

Re: [gentoo-user] systemd and LUKS

[Frank Steinmetzger]

On Tue, Sep 03, 2013 at 11:15:54AM -0500, Canek Peláez Valdés wrote:

> > Hey list
> > […]
> > Rebooting works until the point of mounting /home, which is a LUKS
> > container. I get the message:
> > "A start job is running for dev-mapper-home.service"
> > and eventually a timeout and prompt for root password or Ctrl-D.
> >
> > The wiki references a bug report that /etc/crypttab was ignored. Well, I
> > didn’t have one, but apparently my old crypt setup was heeded (because
> > systemd knew that I wanted sda5 mounted as home).
> 
> Mmmh. I don't use LUKS, but from what I understand, systemd generates
> the unit files necessary to mount encrypted partitions, and to do this
> it needs /etc/crypttab, in the same manner that it needs /etc/fstab to
> generate the unit files for the normal partitions.

I created a crypttab as some point, but it didn’t solve the problem.
$ cat /etc/crypttab
home/dev/sda5

> http://www.freedesktop.org/software/systemd/man/systemd-cryptsetup-generator.html

This link gave me the deciding hint -- I didn't have cryptsetup-generator in
my system, because I didn’t have the cryptsetup useflags enabled.
I rebuilt systemd and udisks and now I’m prompted for the LUKS password during
boot. \o/

Now I need to find out whether it’s feasible for me to use it. I’ll definitely
have to procure some custom unit files, e.g. for monitorix.

> > On a sidenote, for some reason, grub2 doesn’t find the kernel if I keep
> > the menuentry’s search commands which are created by grub2-mkconfig.
> > Only if I remove all the search --uuid...yadda yadda..., the entry
> > boots.
> > The boot partition (where the grub files lie) is still my normal / on
> > sda2. It then boots the systemd installation on sda7 which was detected
> > by os_prober.
> 
> Are you sure it's not under the "advanced" submenu?

The “normal” menuitem and the one under the advanced submenu are identical.

> One question: how is the /etc/fstab file in the systemd installation?

Now that you mention it -- I forgot to amend the / partition entry to point to
sda7. I have root=/dev/sda7 in the kernel cmdline, though, so I didn’t notice.

-- 
Gruß | Greetings | Qapla’
Please do not share anything from, with or about me with any Facebook service.

“Time is money” said the waiter and put the date on the bill.


signature.asc
Description: Digital signature

Re: [gentoo-user] Re: Install from USB stick; here's how

[Alan McKinnon]

On 03/09/2013 23:19, Grant Edwards wrote:
> On 2013-09-03, Alan McKinnon  wrote:
>> On 03/09/2013 19:05, Grant Edwards wrote:
>>> On 2013-01-07, Walter Dnes  wrote:
>>>
   For those of you who don't want to do the tap-dance listed at...
 http://www.gentoo.org/doc/en/liveusb.xml

 * My netbook's harddrive is normally /dev/sda, except when I boot from a
   USB stick.  The stick will become /dev/sda and the harddrive becomes
   /dev/sdb

 * My desktop's harddrive is also /dev/sda.  I took the linux minimal
   install ISO, ran isohybrid on it, with the command...

 isohybrid install-x86-minimal-20121213.iso

   If you don't have isohybrid...

 emerge sys-boot/syslinux

 * I then copied it over to a USB stick (/dev/sdb) with the command...

 dd bs=4M if=install-x86-minimal-20121213.iso of=/dev/sdb
>>>
>>> I did a 64-bit install from USB flash-drive a few days ago using the
>>> older tap-dance, and it worked fine -- except I discovered one of my
>>> "must have" apps is 32-bit only and didn't work correctly when run in
>>> 32-bit emulation mode (I don't know why).
>>>
>>> So I tried Walter's recipe yesterday to do a 32-bit install.
>>>
>>> After running the isohybrid command, I compared the resulting image
>>> with the original.  They were identical.  I copied the image to a USB
>>> flash drive, and it booted just fine.
>>>
>>> It seems that the minimal install .iso images are already built for
>>> hybrid booting from either CD or a generic block device (e.g. USB
>>> mass-storage device).
>>>
>>> So what's the deal with http://wiki.gentoo.org/wiki/LiveUSB/HOWTO?
>>>
>>> Why isn't it just the steps below?
>>>
>>>   1) Copy the minimal install .iso to USB mass storage device.
>>>
>>>   2) Boot from USB mass storage device.  
>>
>> Copying an .iso to a USB stick does not give you a bootable USB
>> stick.
> 
> It does for recent Gentoo minimial install .iso images.

Now I'm confused, let's clarify. Which of these meanings of copy are you
using:

cp my_big.iso /where/i/mounted/the/stick

dd if=my_big.iso of=/dev/sdb


If it's the first, then you have just discovered serious $COMPUTER_MAGIC
unbeknownst to me thus far :-)


> 
>> It gives you a USB stick with one large file, without bootloader, and
>> the BIOS code can't make sense of it.
> 
> All my machines seem to.
> 
>> USB mass storage devices are not CDs, you can't just dd an ISO9660
>> image to a USB stick and expect it to work
> 
> But it _does_ work.  I tried it with a couple different minimal
> install .iso files and a couple different machines.
> 


-- 
Alan McKinnon
alan.mckin...@gmail.com

[gentoo-user] Re: Install from USB stick; here's how

[Grant Edwards]

On 2013-09-03, Walter Dnes  wrote:
> On Tue, Sep 03, 2013 at 05:05:22PM +, Grant Edwards wrote
>
>> After running the isohybrid command, I compared the resulting image
>> with the original.  They were identical.  I copied the image to a USB
>> flash drive, and it booted just fine.
>> 
>> It seems that the minimal install .iso images are already built for
>> hybrid booting from either CD or a generic block device (e.g. USB
>> mass-storage device).
>> 
>> So what's the deal with http://wiki.gentoo.org/wiki/LiveUSB/HOWTO?
>> 
>> Why isn't it just the steps below?
>> 
>>   1) Copy the minimal install .iso to USB mass storage device.
>> 
>>   2) Boot from USB mass storage device.  
>
> More importantly, http://www.gentoo.org/doc/en/handbook/handbook-*
> files should have this listed.  There are a lot of machines now,
> especially notebooks, that don't have a CD and/or DVD drive.  I do
> remember asking devs for the default isohybrid feature.  I just
> downloaded a amd-64-bit install iso, to update my rescue stick.  The
> 64-bit install also worked.  Do you want me to file a bug on bugzilla in
> the documentation section?

Sure, that would be great.  I didn't do that because wasn't sure if
the .iso images worked for everybody as-is, or if the old "tap-dance"
was still required for the general case (for people with older BIOSes
or something).

-- 
Grant Edwards   grant.b.edwardsYow! I always have fun
  at   because I'm out of my
  gmail.commind!!!

[gentoo-user] Re: Install from USB stick; here's how

[Grant Edwards]

On 2013-09-03, Alan McKinnon  wrote:
> On 03/09/2013 19:05, Grant Edwards wrote:
>> On 2013-01-07, Walter Dnes  wrote:
>> 
>>>   For those of you who don't want to do the tap-dance listed at...
>>> http://www.gentoo.org/doc/en/liveusb.xml
>>>
>>> * My netbook's harddrive is normally /dev/sda, except when I boot from a
>>>   USB stick.  The stick will become /dev/sda and the harddrive becomes
>>>   /dev/sdb
>>>
>>> * My desktop's harddrive is also /dev/sda.  I took the linux minimal
>>>   install ISO, ran isohybrid on it, with the command...
>>>
>>> isohybrid install-x86-minimal-20121213.iso
>>>
>>>   If you don't have isohybrid...
>>>
>>> emerge sys-boot/syslinux
>>>
>>> * I then copied it over to a USB stick (/dev/sdb) with the command...
>>>
>>> dd bs=4M if=install-x86-minimal-20121213.iso of=/dev/sdb
>> 
>> I did a 64-bit install from USB flash-drive a few days ago using the
>> older tap-dance, and it worked fine -- except I discovered one of my
>> "must have" apps is 32-bit only and didn't work correctly when run in
>> 32-bit emulation mode (I don't know why).
>> 
>> So I tried Walter's recipe yesterday to do a 32-bit install.
>> 
>> After running the isohybrid command, I compared the resulting image
>> with the original.  They were identical.  I copied the image to a USB
>> flash drive, and it booted just fine.
>> 
>> It seems that the minimal install .iso images are already built for
>> hybrid booting from either CD or a generic block device (e.g. USB
>> mass-storage device).
>> 
>> So what's the deal with http://wiki.gentoo.org/wiki/LiveUSB/HOWTO?
>> 
>> Why isn't it just the steps below?
>> 
>>   1) Copy the minimal install .iso to USB mass storage device.
>> 
>>   2) Boot from USB mass storage device.  
>
> Copying an .iso to a USB stick does not give you a bootable USB
> stick.

It does for recent Gentoo minimial install .iso images.

> It gives you a USB stick with one large file, without bootloader, and
> the BIOS code can't make sense of it.

All my machines seem to.

> USB mass storage devices are not CDs, you can't just dd an ISO9660
> image to a USB stick and expect it to work

But it _does_ work.  I tried it with a couple different minimal
install .iso files and a couple different machines.

-- 
Grant Edwards   grant.b.edwardsYow! What's the MATTER
  at   Sid? ... Is your BEVERAGE
  gmail.comunsatisfactory?

Re: [gentoo-user] Re: Install from USB stick; here's how

[Walter Dnes]

On Tue, Sep 03, 2013 at 05:05:22PM +, Grant Edwards wrote

> After running the isohybrid command, I compared the resulting image
> with the original.  They were identical.  I copied the image to a USB
> flash drive, and it booted just fine.
> 
> It seems that the minimal install .iso images are already built for
> hybrid booting from either CD or a generic block device (e.g. USB
> mass-storage device).
> 
> So what's the deal with http://wiki.gentoo.org/wiki/LiveUSB/HOWTO?
> 
> Why isn't it just the steps below?
> 
>   1) Copy the minimal install .iso to USB mass storage device.
> 
>   2) Boot from USB mass storage device.  

  Mmore importantly, http://www.gentoo.org/doc/en/handbook/handbook-*
files should have this listed.  There are a lot of machines now,
especially notebooks, that don't have a CD and/or DVD drive.  I do
remember asking devs for the default isohybrid feature.  I just
downloaded a amd-64-bit install iso, to update my rescue stick.  The
64-bit install also worked.  Do you want me to file a bug on bugzilla in
the documentation section?

-- 
Walter Dnes 
I don't run "desktop environments"; I run useful applications

Re: [gentoo-user] Re: Install from USB stick; here's how

[Alan McKinnon]

On 03/09/2013 19:05, Grant Edwards wrote:
> On 2013-01-07, Walter Dnes  wrote:
> 
>>   For those of you who don't want to do the tap-dance listed at...
>> http://www.gentoo.org/doc/en/liveusb.xml
>>
>> * My netbook's harddrive is normally /dev/sda, except when I boot from a
>>   USB stick.  The stick will become /dev/sda and the harddrive becomes
>>   /dev/sdb
>>
>> * My desktop's harddrive is also /dev/sda.  I took the linux minimal
>>   install ISO, ran isohybrid on it, with the command...
>>
>> isohybrid install-x86-minimal-20121213.iso
>>
>>   If you don't have isohybrid...
>>
>> emerge sys-boot/syslinux
>>
>> * I then copied it over to a USB stick (/dev/sdb) with the command...
>>
>> dd bs=4M if=install-x86-minimal-20121213.iso of=/dev/sdb
> 
> I did a 64-bit install from USB flash-drive a few days ago using the
> older tap-dance, and it worked fine -- except I discovered one of my
> "must have" apps is 32-bit only and didn't work correctly when run in
> 32-bit emulation mode (I don't know why).
> 
> So I tried Walter's recipe yesterday to do a 32-bit install.
> 
> After running the isohybrid command, I compared the resulting image
> with the original.  They were identical.  I copied the image to a USB
> flash drive, and it booted just fine.
> 
> It seems that the minimal install .iso images are already built for
> hybrid booting from either CD or a generic block device (e.g. USB
> mass-storage device).
> 
> So what's the deal with http://wiki.gentoo.org/wiki/LiveUSB/HOWTO?
> 
> Why isn't it just the steps below?
> 
>   1) Copy the minimal install .iso to USB mass storage device.
> 
>   2) Boot from USB mass storage device.  

Copying an .iso to a USB stick does not give you a bootable USB stick.
It gives you a USB stick with one large file, without bootloader, and
the BIOS code can't make sense of it.

USB mass storage devices are not CDs, you can't just dd an ISO9660 image
to a USB stick and expect it to work (although files named *.img will
often work doing exactly this)

This is why unetbootin takes so long to do it's thing, it has to unpack
image files and write them file by file to the USB stick


-- 
Alan McKinnon
alan.mckin...@gmail.com

Re: [gentoo-user] Re: Need help: Filesystem (ext4) corrupted!

[Alan McKinnon]

On 03/09/2013 18:06, meino.cra...@gmx.de wrote:

> 
> The other thing is: With sdcards one have to keep an eye on 
> what part of the sdcard is written how often repeatedly, since
> sdcards tends to wear out.
> 
> I read somewhere on the internet (dont remember where...sorry) that
> Samsung has offered code  to the Linux kernel, which implements a
> special FS especially suitable and made for sdcards. 
> 
> But I dont know its name and whether it is already available in
> the kernel sources...


F2FS perhaps? It's in the mainline kernel already.

http://en.wikipedia.org/wiki/F2FS
http://www.linux.org/threads/flash-friendly-file-system-f2fs.4477/



-- 
Alan McKinnon
alan.mckin...@gmail.com

Re: [gentoo-user] kerninst (was Optional /usr merge in Gentoo)

[Canek Peláez Valdés]

On Tue, Sep 3, 2013 at 1:38 PM, Stefan G. Weichinger  wrote:
> Am 03.09.2013 18:34, schrieb Douglas J Hunley:
>> On Tue, Sep 3, 2013 at 12:19 PM, Canek Peláez Valdés wrote:
>>
>>> eclean-kernel cleans *older* versions of kernel.s The part of the
>>> script you responded to deletes the kernel, initramfs and modules
>>> which have the same version as the kernel to which /usr/src/linux
>>> points to.
>>>
>>
>> Ah, got it. I didn't grok that on the first read thru (obviously)
>
> It might be cool to combine both ... like
>
> "kerninst --just-keep-latest-kernels=2"
>
> or something ;-)

It can be done.

Regards.
-- 
Canek Peláez Valdés
Posgrado en Ciencia e Ingeniería de la Computación
Universidad Nacional Autónoma de México

Re: [gentoo-user] kerninst (was Optional /usr merge in Gentoo)

[Stefan G. Weichinger]

Am 03.09.2013 18:34, schrieb Douglas J Hunley:
> On Tue, Sep 3, 2013 at 12:19 PM, Canek Peláez Valdés wrote:
> 
>> eclean-kernel cleans *older* versions of kernel.s The part of the
>> script you responded to deletes the kernel, initramfs and modules
>> which have the same version as the kernel to which /usr/src/linux
>> points to.
>>
> 
> Ah, got it. I didn't grok that on the first read thru (obviously)

It might be cool to combine both ... like

"kerninst --just-keep-latest-kernels=2"

or something ;-)

Re: [gentoo-user] systemd and LUKS

[Michael Hampicke]

Am 03.09.2013 13:46, schrieb Frank Steinmetzger:
> Hey list
> 
> after the many discussions here about systemd I had a flash of
> objectivity (“Who cares if people rant about Lennart, the concept seems
> sound and I don’t care about separate /usr”). So I wanted to try systemd
> on my netbook.
> 
> I cloned the / partition from sda2 to sda7 and chrooted into it. In
> there I followed the systemd Gentoo wiki¹, i.e. I configured the kernel,
> installed systemd, added "-consolekit systemd" to my use flags, rebuilt
> world with --new-use and added init=/usr/lib/systemd/systemd to the
> kernel cmdline.
> 
> Rebooting works until the point of mounting /home, which is a LUKS
> container. I get the message:
> "A start job is running for dev-mapper-home.service"
> and eventually a timeout and prompt for root password or Ctrl-D.

When it show "A start job is running for dev-mapper-home.service" you
can enter the password for the luks volume. Just type in a few letters,
you will see them displayed as 

I too run systemd + luks - this is my config:



$ cat /etc/crypttab

# 
tank/dev/sdb2   noneluks



$ grep tank /etc/fstab
#/dev/mapper/tank   /home   ext4noatime,nofail  0 2


Also make sure to compile systemd with USE="cryptsetup"



signature.asc
Description: OpenPGP digital signature

Re: [gentoo-user] kerninst (was Optional /usr merge in Gentoo)

[Douglas J Hunley]

On Tue, Sep 3, 2013 at 12:19 PM, Canek Peláez Valdés wrote:

> eclean-kernel cleans *older* versions of kernel.s The part of the
> script you responded to deletes the kernel, initramfs and modules
> which have the same version as the kernel to which /usr/src/linux
> points to.
>

Ah, got it. I didn't grok that on the first read thru (obviously)


-- 
Douglas J Hunley (doug.hun...@gmail.com)
Twitter: @hunleyd   Web:
douglasjhunley.com
G+: http://goo.gl/sajR3

[gentoo-user] Re: Install from USB stick; here's how

[Grant Edwards]

On 2013-01-07, Walter Dnes  wrote:

>   For those of you who don't want to do the tap-dance listed at...
> http://www.gentoo.org/doc/en/liveusb.xml
>
> * My netbook's harddrive is normally /dev/sda, except when I boot from a
>   USB stick.  The stick will become /dev/sda and the harddrive becomes
>   /dev/sdb
>
> * My desktop's harddrive is also /dev/sda.  I took the linux minimal
>   install ISO, ran isohybrid on it, with the command...
>
> isohybrid install-x86-minimal-20121213.iso
>
>   If you don't have isohybrid...
>
> emerge sys-boot/syslinux
>
> * I then copied it over to a USB stick (/dev/sdb) with the command...
>
> dd bs=4M if=install-x86-minimal-20121213.iso of=/dev/sdb

I did a 64-bit install from USB flash-drive a few days ago using the
older tap-dance, and it worked fine -- except I discovered one of my
"must have" apps is 32-bit only and didn't work correctly when run in
32-bit emulation mode (I don't know why).

So I tried Walter's recipe yesterday to do a 32-bit install.

After running the isohybrid command, I compared the resulting image
with the original.  They were identical.  I copied the image to a USB
flash drive, and it booted just fine.

It seems that the minimal install .iso images are already built for
hybrid booting from either CD or a generic block device (e.g. USB
mass-storage device).

So what's the deal with http://wiki.gentoo.org/wiki/LiveUSB/HOWTO?

Why isn't it just the steps below?

  1) Copy the minimal install .iso to USB mass storage device.

  2) Boot from USB mass storage device.  


-- 
Grant Edwards   grant.b.edwardsYow! I am a traffic light,
  at   and Alan Ginzberg kidnapped
  gmail.commy laundry in 1927!

Re: [gentoo-user] systemd and LUKS

[Canek Peláez Valdés]

On Tue, Sep 3, 2013 at 6:46 AM, Frank Steinmetzger  wrote:
> Hey list
>
> after the many discussions here about systemd I had a flash of
> objectivity (“Who cares if people rant about Lennart, the concept seems
> sound and I don’t care about separate /usr”). So I wanted to try systemd
> on my netbook.
>
> I cloned the / partition from sda2 to sda7 and chrooted into it. In
> there I followed the systemd Gentoo wiki¹, i.e. I configured the kernel,
> installed systemd, added "-consolekit systemd" to my use flags, rebuilt
> world with --new-use and added init=/usr/lib/systemd/systemd to the
> kernel cmdline.
>
> Rebooting works until the point of mounting /home, which is a LUKS
> container. I get the message:
> "A start job is running for dev-mapper-home.service"
> and eventually a timeout and prompt for root password or Ctrl-D.
>
> The wiki references a bug report that /etc/crypttab was ignored. Well, I
> didn’t have one, but apparently my old crypt setup was heeded (because
> systemd knew that I wanted sda5 mounted as home).

Mmmh. I don't use LUKS, but from what I understand, systemd generates
the unit files necessary to mount encrypted partitions, and to do this
it needs /etc/crypttab, in the same manner that it needs /etc/fstab to
generate the unit files for the normal partitions.

http://www.freedesktop.org/software/systemd/man/systemd-cryptsetup-generator.html

> I tried researching the problem. One I found was a Gentoo forum thread
> about LVM. I found out that I was missing CONFIG_DM_UEVENT. But enabling
> it didn’t help either. I found files in the partition’s /dev directory,
> which hinted that DEVTMPFS_MOUNT was not set. But I don’t suppose that’s
> really a problem.

I would add it anyway.

> Does any of you have experience with this combination and would like to
> share it? Thanks.
>
> ¹ http://gentoo-en.vfose.ru/wiki/Systemd
>
>
>
> On a sidenote, for some reason, grub2 doesn’t find the kernel if I keep
> the menuentry’s search commands which are created by grub2-mkconfig.
> Only if I remove all the search --uuid...yadda yadda..., the entry
> boots.
> The boot partition (where the grub files lie) is still my normal / on
> sda2. It then boots the systemd installation on sda7 which was detected
> by os_prober.

Are you sure it's not under the "advanced" submenu?

One question: how is the /etc/fstab file in the systemd installation?

Regards.
-- 
Canek Peláez Valdés
Posgrado en Ciencia e Ingeniería de la Computación
Universidad Nacional Autónoma de México

Re: [gentoo-user] Can't ping remote system

[Mick]

On Tuesday 03 Sep 2013 07:12:05 Alan McKinnon wrote:
> On 01/09/2013 20:50, Grant wrote:
> >> My laptop can't ping my remote system but it can ping others
> >> (google.com, yahoo.com, etc).  I've tried disabling my firewall
> >> on both ends with '/etc/init.d/shorewall stop && shorewall
> >> clear'.  Could my AT&T business ADSL connection on the remote
> >> system be blocking inbound pings?
> > 
> > I did 'traceroute -w 30 -I ip-address' several times and the last IP
> > displayed is always the same.  I looked it up and it's an AT&T IP
> > supposedly located about 1500 miles from my machine which is also on
> > an AT&T connection.  Does this tell me anything?
>  
>  Yes, it tells you that all hops up to that point at least respond to
>  the kinds of icmp packets traceroute uses. The first hop that fails to
>  answer isn't answering.
>  
>  You are looking for possible reasons why icmp might not be working out
>  properly - that router is your first suspect. Admittedly, it might be
>  blocking traceroute pings and still allow the responses you seek, but
>  you have to start somewhere :-)
> >>> 
> >>> So the culprit is the first IP that should appear in the list but
> >>> doesn't?  If so, how is that helpful since it's not displayed?
> >> 
> >> This is where it gets tricky. You identify the last router in the list
> >> for which you have an address or name, and contact the NOC team for that
> >> organization. Ask them for the next hop in routing for the destination
> >> address you are trying to ping and hope that they will be kind enough to
> >> help you out.
> > 
> > Oh man that's funny.  Really?  Let's say they do pass along the info.
> > Then I hunt down contact info for the culprit router based on its IP
> > and tell them their stuff isn't working and hope they fix it?
> > Actually, since the last IP displayed is from AT&T and my server's ISP
> > is AT&T, I suppose it's extremely likely that the culprit is either an
> > AT&T router somewhere or my own server and I could find out by calling
> > AT&T.
> 
> Well, I did try to convey a sense of what it sometimes takes to deal
> with such things. Usually your ISP deals with it for you and you'd be
> amazed how often they pick up the phone to do exactly what I described.
> 
> But I think this is getting OT to your actual problem. AT&T's routers
> are probably not the cause, it only came up because of issues with
> pinging things, and that is not what you are trying to solve.

+1 on Alan's hunch.  I have not used Squid to comment on the specifics and 
also Grant stated that another proxy gave him similar symptoms.  From my 
limited knowledge a proxy could be stalling because of cache configuration 
problems, like running out fs space, or inodes and also running out of memory 
if it has to process simultaneous requests from too many clients at a time.  
If the problem also manifests when the clients are within the same subnet, 
then this is unlikely to be a network issue.

If all other causes are eliminated then a network related problem could be 
associated with TCP Window Scaling - but this would primarily show up on the 
transmission of larger files.  This is why I initially asked if the problem 
shows up on video/audio downloads rather than small web pages.

It's probably OT describing this problem here (Google can do it much better) 
but a quick test would show if this solves the problem:

echo 0 > /proc.sys/net/ipv4/tcp_default_window_scaling

Please check the man page because this key may have changed over time and 
indeed it may not be a problem in later kernels who may have been coded so as 
to compensate for dodgy routers.  This will slow down the connection because a 
smaller window size will be used, but there shouldn't be a problem of 
oversized packets being dropped by a misconfigured router on the way.  Shout 
if you need more detail.
-- 
Regards,
Mick


signature.asc
Description: This is a digitally signed message part.

Re: [gentoo-user] kerninst (was Optional /usr merge in Gentoo)

[Canek Peláez Valdés]

On Tue, Sep 3, 2013 at 10:01 AM, Douglas J Hunley  wrote:
>
> On Sun, Sep 1, 2013 at 1:30 PM, Canek Peláez Valdés 
> wrote:
>>
>> • If /usr/src/linux points to /usr/src/linux-3.10.10, then the script
>> deletes /boot vmlinuz-3.10.10, /boot/initrd-3.10.10 *and*
>> /lib/modules/3.10.10.
>
>
> Why not call 'eclean-kernel' instead of reinventing here?

Oh, I didn't knew about eclean-kernel until you mentioned it. But the
script does something completely different to eclean-kernel (If I
understood correctly by reading its home page).

eclean-kernel cleans *older* versions of kernel.s The part of the
script you responded to deletes the kernel, initramfs and modules
which have the same version as the kernel to which /usr/src/linux
points to.

Regards.
-- 
Canek Peláez Valdés
Posgrado en Ciencia e Ingeniería de la Computación
Universidad Nacional Autónoma de México

Re: [gentoo-user] Re: Need help: Filesystem (ext4) corrupted!

[meino . cramer]

William Kenworthy  [13-09-03 17:16]:
> On 03/09/13 11:26, meino.cra...@gmx.de wrote:
> > William Kenworthy  [13-09-03 05:08]:
> >> On 03/09/13 10:45, meino.cra...@gmx.de wrote:
> >>> walt  [13-09-03 04:15]:
>  On 09/02/2013 09:15 AM, meino.cra...@gmx.de wrote:
> > The rootfs and $HOME of my embedded system is stored 
> > on a 16GB SD-card (about 5GB used, rest free). The FS
> > is ext4.
> >
> > Since the system hangs for unknown reasons several times
>  Does it hang at a predictable point, like during boot, or poweroff?
> 
>  I know almost nothing about SD cards (yet).  Do they develop bad
>  blocks like other storage media?  I notice fsck.ext4 has a -c flag
>  to check for bad blocks.  
> 
> >>> No, it hangs while compiling or while updateing (eix-sync; emerge ...).
> >>>
> >>>
> >>> I did the following now:
> >>> I did a binary image backup with dd of the sdcard.
> >>> I made a backup of the all files from the bad fs with tar.
> >>> I say "YES" to fsck to fix what it found.
> >>> I made another backup of the all files from the bad fs with tar.
> >>> I md5summed both tar archives and found them identical.
> >>>
> >>> Now...is the conclusion correct, that the identical md5sum
> >>> indicate, that the fixed error of the fs only had impact to
> >>> already invalidated data?
> >>> Or whatelse could this indicate?
> >>>
> >>> Best regards,
> >>> mcc
> >>>
> >>> PS: What come mind just in this moment:
> >>> Can I ran fsck on an binary image of the fs which I made with dd somehow?
> >>>
> >>>
> >>>
> >>>
> >>>
> >> Have you run out of inodes? - ext 4 has had very mixed success for me on
> >> solid state.  Running out of inodes is a real problem for gentoo on
> >> smaller SD cards with standard settings.
> >>
> >> BillK
> >>
> >>
> >>
> > Does this error message from fsck indicate that? I am really bad in
> > guessing what fsck tries to cry at me ... ;)
> >
> >
> >>> solfire:/root>fsck.ext4 -f -p /dev/sdb2
> >>> rootfs: Inodes that were part of a corrupted orphan linked list found.
> >>>
> >>> rootfs: UNEXPECTED INCONSISTENCY; RUN fsck MANUALLY.
> >>> (i.e., without -a or -p options)
> >>> [1]18644 exit 4 fsck.ext4 -f -p /dev/sdb2
> >>>
> >>>
> > Is there any way to correct the settings from the default values to
> > more advances ones, which respect the sdcard size of 16GB *without*
> > blanking it...a "correction on the fly" so to say???
> >
> > And if not: Is there a way to backup the sdcard and playback the files
> > after reformatting it by preserving all three time stamps of the
> > files (atime is deactivated via fstab though) ?
> >
> > Best regards,
> > mcc
> >
> >
> >
> >
> >
> df -i - if you get 100% iUSE or near to it thats your problem ... I have
> seen that error message you give as a result of running out of inodes
> corrupting the FS.
> 
> No, your only way out is to copy (I use rync) the files off, recreate
> the fs with max inodes ("man mke2fs") and rsync the files back.  Once an
> ext* fs has been created with a certain number of inodes its fixed until
> you re-format.
> 
> I get it happening regularly on 4G cards when I forget and just emerge a
> couple of packages without cleaning up in between packages.  On 16G
> cards, its compiling something like glibc or gcc that uses huge numbers
> of inodes at times.  On a single 32G card I have, the standard settings
> have been fine ... so far :)
> 
> Billk
> 
> 

df -i gives the following:

rootfs   971040 352208   618832   37% /
/dev/root971040 352208   618832   37% /
devtmpfs  63420434629861% /dev
tmpfs 63456389630671% /run
shm   63456  1634551% /dev/shm
cgroup_root   63456  6634501% /sys/fs/cgroup
/dev/mmcblk0p10  00 - /boot


You mentioned rsync to backup...

I used 

sudo tar cvf  

the rootfs has only one partition...

Is it alos ok to use tar or is there any drawback?

Best regards,
mcc

Re: [gentoo-user] Re: Need help: Filesystem (ext4) corrupted!

[meino . cramer]

Francisco Ares  [13-09-03 17:23]:
> 2013/9/3 William Kenworthy 
> 
> > On 03/09/13 11:26, meino.cra...@gmx.de wrote:
> > > William Kenworthy  [13-09-03 05:08]:
> > >> On 03/09/13 10:45, meino.cra...@gmx.de wrote:
> > >>> walt  [13-09-03 04:15]:
> >  On 09/02/2013 09:15 AM, meino.cra...@gmx.de wrote:
> > > The rootfs and $HOME of my embedded system is stored
> > > on a 16GB SD-card (about 5GB used, rest free). The FS
> > > is ext4.
> > >
> > > Since the system hangs for unknown reasons several times
> >  Does it hang at a predictable point, like during boot, or poweroff?
> > 
> >  I know almost nothing about SD cards (yet).  Do they develop bad
> >  blocks like other storage media?  I notice fsck.ext4 has a -c flag
> >  to check for bad blocks.
> > 
> > >>> No, it hangs while compiling or while updateing (eix-sync; emerge ...).
> > >>>
> > >>>
> > >>> I did the following now:
> > >>> I did a binary image backup with dd of the sdcard.
> > >>> I made a backup of the all files from the bad fs with tar.
> > >>> I say "YES" to fsck to fix what it found.
> > >>> I made another backup of the all files from the bad fs with tar.
> > >>> I md5summed both tar archives and found them identical.
> > >>>
> > >>> Now...is the conclusion correct, that the identical md5sum
> > >>> indicate, that the fixed error of the fs only had impact to
> > >>> already invalidated data?
> > >>> Or whatelse could this indicate?
> > >>>
> > >>> Best regards,
> > >>> mcc
> > >>>
> > >>> PS: What come mind just in this moment:
> > >>> Can I ran fsck on an binary image of the fs which I made with dd
> > somehow?
> > >>>
> > >>>
> > >>>
> > >>>
> > >>>
> > >> Have you run out of inodes? - ext 4 has had very mixed success for me on
> > >> solid state.  Running out of inodes is a real problem for gentoo on
> > >> smaller SD cards with standard settings.
> > >>
> > >> BillK
> > >>
> > >>
> > >>
> > > Does this error message from fsck indicate that? I am really bad in
> > > guessing what fsck tries to cry at me ... ;)
> > >
> > >
> > >>> solfire:/root>fsck.ext4 -f -p /dev/sdb2
> > >>> rootfs: Inodes that were part of a corrupted orphan linked list
> > found.
> > >>>
> > >>> rootfs: UNEXPECTED INCONSISTENCY; RUN fsck MANUALLY.
> > >>> (i.e., without -a or -p options)
> > >>> [1]18644 exit 4 fsck.ext4 -f -p /dev/sdb2
> > >>>
> > >>>
> > > Is there any way to correct the settings from the default values to
> > > more advances ones, which respect the sdcard size of 16GB *without*
> > > blanking it...a "correction on the fly" so to say???
> > >
> > > And if not: Is there a way to backup the sdcard and playback the files
> > > after reformatting it by preserving all three time stamps of the
> > > files (atime is deactivated via fstab though) ?
> > >
> > > Best regards,
> > > mcc
> > >
> > >
> > >
> > >
> > >
> > df -i - if you get 100% iUSE or near to it thats your problem ... I have
> > seen that error message you give as a result of running out of inodes
> > corrupting the FS.
> >
> > No, your only way out is to copy (I use rync) the files off, recreate
> > the fs with max inodes ("man mke2fs") and rsync the files back.  Once an
> > ext* fs has been created with a certain number of inodes its fixed until
> > you re-format.
> >
> > I get it happening regularly on 4G cards when I forget and just emerge a
> > couple of packages without cleaning up in between packages.  On 16G
> > cards, its compiling something like glibc or gcc that uses huge numbers
> > of inodes at times.  On a single 32G card I have, the standard settings
> > have been fine ... so far :)
> >
> > Billk
> >
> >
> >
> Just my  2 cents: while updating I think it would it be a good practice to
> have some sort of external storage (even networked) and do a unionfs with
> the working file system.  Some folders inside /usr use to keep almost half
> (more, sometimes) of all files in my systems (like "/usr/portage" ,
> "/usr/src" and "/usr/include" , which are not needed while not under system
> maintenance).
> 
> Francisco

Hi Francisco,

GOOD point!
Only one thing "forbids" this:
I often commute between two places. I bought this little embedded
computer to do try this or that with it at both places. I have
internet access at both places but only at home there is my PC
with Gentoo Linux.
I dont want to miss Gentoo-hacking ;) at one of the places... :)

Best regards,
mcc

Re: [gentoo-user] Re: Need help: Filesystem (ext4) corrupted!

[meino . cramer]

Pandu Poluan  [13-09-03 17:16]:
> On Sep 3, 2013 10:51 AM, "William Kenworthy"  wrote:
> >
> > On 03/09/13 11:26, meino.cra...@gmx.de wrote:
> > > William Kenworthy  [13-09-03 05:08]:
> 
> --snip--
> 
> > >> Have you run out of inodes? - ext 4 has had very mixed success for me
> on
> > >> solid state.  Running out of inodes is a real problem for gentoo on
> > >> smaller SD cards with standard settings.
> > >>
> > >> BillK
> > >>
> > >>
> > >>
> > > Does this error message from fsck indicate that? I am really bad in
> > > guessing what fsck tries to cry at me ... ;)
> > >
> > >
> > >>> solfire:/root>fsck.ext4 -f -p /dev/sdb2
> > >>> rootfs: Inodes that were part of a corrupted orphan linked list
> found.
> > >>>
> > >>> rootfs: UNEXPECTED INCONSISTENCY; RUN fsck MANUALLY.
> > >>> (i.e., without -a or -p options)
> > >>> [1]18644 exit 4 fsck.ext4 -f -p /dev/sdb2
> > >>>
> > >>>
> > > Is there any way to correct the settings from the default values to
> > > more advances ones, which respect the sdcard size of 16GB *without*
> > > blanking it...a "correction on the fly" so to say???
> > >
> > > And if not: Is there a way to backup the sdcard and playback the files
> > > after reformatting it by preserving all three time stamps of the
> > > files (atime is deactivated via fstab though) ?
> > >
> > > Best regards,
> > > mcc
> > >
> > >
> > >
> > >
> > >
> > df -i - if you get 100% iUSE or near to it thats your problem ... I have
> > seen that error message you give as a result of running out of inodes
> > corrupting the FS.
> >
> > No, your only way out is to copy (I use rync) the files off, recreate
> > the fs with max inodes ("man mke2fs") and rsync the files back.  Once an
> > ext* fs has been created with a certain number of inodes its fixed until
> > you re-format.
> >
> > I get it happening regularly on 4G cards when I forget and just emerge a
> > couple of packages without cleaning up in between packages.  On 16G
> > cards, its compiling something like glibc or gcc that uses huge numbers
> > of inodes at times.  On a single 32G card I have, the standard settings
> > have been fine ... so far :)
> >
> > Billk
> >
> >
> 
> While you're considering of formatting the flash disk, consider also
> whether ext3/4 is suitable.
> 
> When I first use Gentoo, I got bitten by inode exhaustion several times, so
> I used an inode-less fs (reiserfs, to be precise).
> 
> I have no idea if reiserfs is suitable for a flash disk, though.
> 
> Rgds,
> --

Hi Pandu,

ext3/4 is what is recommended by www.beagleboard.org/Robert
Nelson/Angstrom Linux...but I have to confess that took this
as simply "given".

The other thing is: With sdcards one have to keep an eye on 
what part of the sdcard is written how often repeatedly, since
sdcards tends to wear out.

I read somewhere on the internet (dont remember where...sorry) that
Samsung has offered code  to the Linux kernel, which implements a
special FS especially suitable and made for sdcards. 

But I dont know its name and whether it is already available in
the kernel sources...

Best regards,
mcc

Re: [gentoo-user] Optional /usr merge in Gentoo

[Douglas J Hunley]

On Sun, Sep 1, 2013 at 10:30 AM, Tanstaafl wrote:

> Is there any reason that the creation, use and maintenance of the
> initramfs couldn't be as simple as a checkbox in the kernel config, so that
> running 'make' after the kernel was configured would automatically build
> it? Then, all I'd have to do is move it into /boot along with the new
> kernel (just like I do now), with *nothing* else required, and the kernel
> would call it, and things would just work (as long as it was there and I
> didn't forget to copy it to /boot).


This exists. You can built initramfs right into the kernel. I've been doing
it here for quite some time. You just tell the kernel either:
* where to find a filespec so it knows what to include in the initramfs
* what directory contains everything you want in the initramfs

and then the kernel builds is and attaches it to itself during 'make'

It's actually pretty trivial


-- 
Douglas J Hunley (doug.hun...@gmail.com)
Twitter: @hunleyd   Web:
douglasjhunley.com
G+: http://goo.gl/sajR3

Re: [gentoo-user] kerninst (was Optional /usr merge in Gentoo)

[Douglas J Hunley]

On Sun, Sep 1, 2013 at 1:30 PM, Canek Peláez Valdés wrote:

> • If /usr/src/linux points to /usr/src/linux-3.10.10, then the script
> deletes /boot vmlinuz-3.10.10, /boot/initrd-3.10.10 *and*
> /lib/modules/3.10.10.
>

Why not call 'eclean-kernel' instead of reinventing here?


-- 
Douglas J Hunley (doug.hun...@gmail.com)
Twitter: @hunleyd   Web:
douglasjhunley.com
G+: http://goo.gl/sajR3

Re: [gentoo-user] Re: Need help: Filesystem (ext4) corrupted!

[Francisco Ares]

2013/9/3 William Kenworthy 

> On 03/09/13 11:26, meino.cra...@gmx.de wrote:
> > William Kenworthy  [13-09-03 05:08]:
> >> On 03/09/13 10:45, meino.cra...@gmx.de wrote:
> >>> walt  [13-09-03 04:15]:
>  On 09/02/2013 09:15 AM, meino.cra...@gmx.de wrote:
> > The rootfs and $HOME of my embedded system is stored
> > on a 16GB SD-card (about 5GB used, rest free). The FS
> > is ext4.
> >
> > Since the system hangs for unknown reasons several times
>  Does it hang at a predictable point, like during boot, or poweroff?
> 
>  I know almost nothing about SD cards (yet).  Do they develop bad
>  blocks like other storage media?  I notice fsck.ext4 has a -c flag
>  to check for bad blocks.
> 
> >>> No, it hangs while compiling or while updateing (eix-sync; emerge ...).
> >>>
> >>>
> >>> I did the following now:
> >>> I did a binary image backup with dd of the sdcard.
> >>> I made a backup of the all files from the bad fs with tar.
> >>> I say "YES" to fsck to fix what it found.
> >>> I made another backup of the all files from the bad fs with tar.
> >>> I md5summed both tar archives and found them identical.
> >>>
> >>> Now...is the conclusion correct, that the identical md5sum
> >>> indicate, that the fixed error of the fs only had impact to
> >>> already invalidated data?
> >>> Or whatelse could this indicate?
> >>>
> >>> Best regards,
> >>> mcc
> >>>
> >>> PS: What come mind just in this moment:
> >>> Can I ran fsck on an binary image of the fs which I made with dd
> somehow?
> >>>
> >>>
> >>>
> >>>
> >>>
> >> Have you run out of inodes? - ext 4 has had very mixed success for me on
> >> solid state.  Running out of inodes is a real problem for gentoo on
> >> smaller SD cards with standard settings.
> >>
> >> BillK
> >>
> >>
> >>
> > Does this error message from fsck indicate that? I am really bad in
> > guessing what fsck tries to cry at me ... ;)
> >
> >
> >>> solfire:/root>fsck.ext4 -f -p /dev/sdb2
> >>> rootfs: Inodes that were part of a corrupted orphan linked list
> found.
> >>>
> >>> rootfs: UNEXPECTED INCONSISTENCY; RUN fsck MANUALLY.
> >>> (i.e., without -a or -p options)
> >>> [1]18644 exit 4 fsck.ext4 -f -p /dev/sdb2
> >>>
> >>>
> > Is there any way to correct the settings from the default values to
> > more advances ones, which respect the sdcard size of 16GB *without*
> > blanking it...a "correction on the fly" so to say???
> >
> > And if not: Is there a way to backup the sdcard and playback the files
> > after reformatting it by preserving all three time stamps of the
> > files (atime is deactivated via fstab though) ?
> >
> > Best regards,
> > mcc
> >
> >
> >
> >
> >
> df -i - if you get 100% iUSE or near to it thats your problem ... I have
> seen that error message you give as a result of running out of inodes
> corrupting the FS.
>
> No, your only way out is to copy (I use rync) the files off, recreate
> the fs with max inodes ("man mke2fs") and rsync the files back.  Once an
> ext* fs has been created with a certain number of inodes its fixed until
> you re-format.
>
> I get it happening regularly on 4G cards when I forget and just emerge a
> couple of packages without cleaning up in between packages.  On 16G
> cards, its compiling something like glibc or gcc that uses huge numbers
> of inodes at times.  On a single 32G card I have, the standard settings
> have been fine ... so far :)
>
> Billk
>
>
>
Just my  2 cents: while updating I think it would it be a good practice to
have some sort of external storage (even networked) and do a unionfs with
the working file system.  Some folders inside /usr use to keep almost half
(more, sometimes) of all files in my systems (like "/usr/portage" ,
"/usr/src" and "/usr/include" , which are not needed while not under system
maintenance).

Francisco

Re: [gentoo-user] systemd and LUKS

[Stefan G. Weichinger]

Am 03.09.2013 14:32, schrieb Stefan G. Weichinger:

> I use a crypted /home on my thinkpad ... with systemd.
> I only have problems with the encrypted swap but /home works fine.
> 
> But I think my /home gets mounted when I login ... pam_mount ... would
> have to check if it's mounted and available earlier. I will check asap
> in the next hours.

Yes. I don't have /home in fstab or crypttab ... gets mounted via
pam_mount at login of my user.

This might be "wrong" or not the way systemd is capable of ... but it
works for me so far (and did it with openrc as well).

Stefan

Re: [gentoo-user] systemd and LUKS

[Stefan G. Weichinger]

Am 03.09.2013 13:46, schrieb Frank Steinmetzger:
> Hey list
> 
> after the many discussions here about systemd I had a flash of 
> objectivity (“Who cares if people rant about Lennart, the concept
> seems sound and I don’t care about separate /usr”). So I wanted to
> try systemd on my netbook.
> 
> I cloned the / partition from sda2 to sda7 and chrooted into it.
> In there I followed the systemd Gentoo wiki¹, i.e. I configured the
> kernel, installed systemd, added "-consolekit systemd" to my use
> flags, rebuilt world with --new-use and added
> init=/usr/lib/systemd/systemd to the kernel cmdline.
> 
> Rebooting works until the point of mounting /home, which is a LUKS 
> container. I get the message: "A start job is running for
> dev-mapper-home.service" and eventually a timeout and prompt for
> root password or Ctrl-D.
> 
> The wiki references a bug report that /etc/crypttab was ignored.
> Well, I didn’t have one, but apparently my old crypt setup was
> heeded (because systemd knew that I wanted sda5 mounted as home).
> 
> I tried researching the problem. One I found was a Gentoo forum
> thread about LVM. I found out that I was missing CONFIG_DM_UEVENT.
> But enabling it didn’t help either. I found files in the
> partition’s /dev directory, which hinted that DEVTMPFS_MOUNT was
> not set. But I don’t suppose that’s really a problem.
> 
> Does any of you have experience with this combination and would
> like to share it? Thanks.
> 
> ¹ http://gentoo-en.vfose.ru/wiki/Systemd

I use a crypted /home on my thinkpad ... with systemd.
I only have problems with the encrypted swap but /home works fine.

But I think my /home gets mounted when I login ... pam_mount ... would
have to check if it's mounted and available earlier. I will check asap
in the next hours.

Stefan

[gentoo-user] systemd and LUKS

[Frank Steinmetzger]

Hey list

after the many discussions here about systemd I had a flash of
objectivity (“Who cares if people rant about Lennart, the concept seems
sound and I don’t care about separate /usr”). So I wanted to try systemd
on my netbook.

I cloned the / partition from sda2 to sda7 and chrooted into it. In
there I followed the systemd Gentoo wiki¹, i.e. I configured the kernel,
installed systemd, added "-consolekit systemd" to my use flags, rebuilt
world with --new-use and added init=/usr/lib/systemd/systemd to the
kernel cmdline.

Rebooting works until the point of mounting /home, which is a LUKS
container. I get the message:
"A start job is running for dev-mapper-home.service"
and eventually a timeout and prompt for root password or Ctrl-D.

The wiki references a bug report that /etc/crypttab was ignored. Well, I
didn’t have one, but apparently my old crypt setup was heeded (because
systemd knew that I wanted sda5 mounted as home).

I tried researching the problem. One I found was a Gentoo forum thread
about LVM. I found out that I was missing CONFIG_DM_UEVENT. But enabling
it didn’t help either. I found files in the partition’s /dev directory,
which hinted that DEVTMPFS_MOUNT was not set. But I don’t suppose that’s
really a problem.

Does any of you have experience with this combination and would like to
share it? Thanks.

¹ http://gentoo-en.vfose.ru/wiki/Systemd



On a sidenote, for some reason, grub2 doesn’t find the kernel if I keep
the menuentry’s search commands which are created by grub2-mkconfig.
Only if I remove all the search --uuid...yadda yadda..., the entry
boots.
The boot partition (where the grub files lie) is still my normal / on
sda2. It then boots the systemd installation on sda7 which was detected
by os_prober.
-- 
Gruß | Greetings | Qapla’
Please do not share anything from, with or about me with any Facebook service.

For some, it’s just Windows,
but for others, it’s the longest batch file in the world.


signature.asc
Description: Digital signature