Re: [gentoo-user] Re: tools to clean up /usr/portage/packages?

2012-03-03 Thread Mark Knecht
On Mon, Feb 27, 2012 at 3:18 PM, Paul Hartman
paul.hartman+gen...@gmail.com wrote:
 On Mon, Feb 27, 2012 at 4:49 PM, Nikos Chantziaras rea...@arcor.de wrote:
 On 28/02/12 00:41, Mark Knecht wrote:

 Are there any tools that will:

 1) Ensure that for every installed packages there is a corresponding
 tbz2 file in /usr/portage/packages?

 2) Remove any older versions in /usr/portage/packages prior to me
 running a backup?


 I think app-portage/gentoolkit can help with its eclean tool
 (specifically, eclean-pkg).

 man eclean should get you started.

 And as an example of savings... I run eclean once in a while, but not
 automated. I just ran it and got these results:

 [   14.8 G ] Total space from 1673 files were freed in the distfiles directory

 I guess I should use it more frequently. ;)


Hey Paul,
   I have absolutely no recollection of turning on buildpkg on my
wife's machine, but doing updates tonight I noticed it was there and
did a quick cleanup. While I didn't beat you, I came closer than I
would have guessed just an hour ago! ;-)

Cheers,
Mark

k2 ~ # eclean-pkg -d
SNIP
 ===
 [   12.1 G ] Total space from 3793 files were freed in the packages directory
k2 ~ #



Re: [gentoo-user] Re: tools to clean up /usr/portage/packages?

2012-02-28 Thread Neil Bothwick
On Mon, 27 Feb 2012 16:45:16 -0800, Mark Knecht wrote:

 QUESTION: As for ensuring that every package actually has a
 corresponding tbz2 file in the packages directory, would
 
 emerge -ek @world
 
 install everything from packages except in the case of something not
 existing in which case it would build and store it?


Yes. And you can check that everything has a package by adding -p to that
command and grepping for ebuild. You could probably also use -eKp and
check for an error.


-- 
Neil Bothwick

CW music backward: get yer dog, wife, job, truck, kids, and sobriety
back.


signature.asc
Description: PGP signature


Re: [gentoo-user] Re: tools to clean up /usr/portage/packages?

2012-02-28 Thread Mark Knecht
On Tue, Feb 28, 2012 at 2:40 AM, Neil Bothwick n...@digimed.co.uk wrote:
 On Mon, 27 Feb 2012 16:45:16 -0800, Mark Knecht wrote:

 QUESTION: As for ensuring that every package actually has a
 corresponding tbz2 file in the packages directory, would

 emerge -ek @world

 install everything from packages except in the case of something not
 existing in which case it would build and store it?


 Yes. And you can check that everything has a package by adding -p to that
 command and grepping for ebuild. You could probably also use -eKp and
 check for an error.


 --
 Neil Bothwick

Yep, I especially like the -epK version. Very clear what's missing.

Thanks!



[gentoo-user] Re: tools to clean up /usr/portage/packages?

2012-02-27 Thread Nikos Chantziaras

On 28/02/12 00:41, Mark Knecht wrote:

Are there any tools that will:

1) Ensure that for every installed packages there is a corresponding
tbz2 file in /usr/portage/packages?

2) Remove any older versions in /usr/portage/packages prior to me
running a backup?


I think app-portage/gentoolkit can help with its eclean tool 
(specifically, eclean-pkg).


man eclean should get you started.




Re: [gentoo-user] Re: tools to clean up /usr/portage/packages?

2012-02-27 Thread Mark Knecht
On Mon, Feb 27, 2012 at 2:49 PM, Nikos Chantziaras rea...@arcor.de wrote:
 On 28/02/12 00:41, Mark Knecht wrote:

 Are there any tools that will:

 1) Ensure that for every installed packages there is a corresponding
 tbz2 file in /usr/portage/packages?

 2) Remove any older versions in /usr/portage/packages prior to me
 running a backup?


 I think app-portage/gentoolkit can help with its eclean tool
 (specifically, eclean-pkg).

 man eclean should get you started.



Thanks Nikos. That does seem to get me into the right space. I'm not
sure I'm understanding all the counts yet though. emerge suggest 992
packages. My simple count of existing packages is 994. eclean-pkg
wants to remove only 1. I had expected it to remove 2.

What might I be doing wrong here?

Also, this is raising an additional question for me. What's the
difference between buildpkg and buildsyspkg. man emerge doesn't talk
about the latter as best I can tell.

Thanks,
Mark

c2stable ~ # emerge -pve @world
SNIP

Total: 992 packages (992 reinstalls), Size of downloads: 0 kB
Fetch Restriction: 1 package
c2stable ~ #

c2stable ~ # ls -alR /usr/portage/packages | grep tbz2 | wc
9948946   66857
c2stable ~ #

c2stable ~ # eclean-pkg -p
 * Building file list for packages cleaning...
 * Here are the binary packages that would be deleted:
 [   23.1 K ] media-libs/libdiscid-0.1.1
 ===
 [   23.1 K ] Total space from 1 files would be freed in the packages directory
c2stable ~ #



Re: [gentoo-user] Re: tools to clean up /usr/portage/packages?

2012-02-27 Thread Paul Hartman
On Mon, Feb 27, 2012 at 4:49 PM, Nikos Chantziaras rea...@arcor.de wrote:
 On 28/02/12 00:41, Mark Knecht wrote:

 Are there any tools that will:

 1) Ensure that for every installed packages there is a corresponding
 tbz2 file in /usr/portage/packages?

 2) Remove any older versions in /usr/portage/packages prior to me
 running a backup?


 I think app-portage/gentoolkit can help with its eclean tool
 (specifically, eclean-pkg).

 man eclean should get you started.

And as an example of savings... I run eclean once in a while, but not
automated. I just ran it and got these results:

[   14.8 G ] Total space from 1673 files were freed in the distfiles directory

I guess I should use it more frequently. ;)



Re: [gentoo-user] Re: tools to clean up /usr/portage/packages?

2012-02-27 Thread Mark Knecht
On Mon, Feb 27, 2012 at 3:18 PM, Paul Hartman
paul.hartman+gen...@gmail.com wrote:
 On Mon, Feb 27, 2012 at 4:49 PM, Nikos Chantziaras rea...@arcor.de wrote:
 On 28/02/12 00:41, Mark Knecht wrote:

 Are there any tools that will:

 1) Ensure that for every installed packages there is a corresponding
 tbz2 file in /usr/portage/packages?

 2) Remove any older versions in /usr/portage/packages prior to me
 running a backup?


 I think app-portage/gentoolkit can help with its eclean tool
 (specifically, eclean-pkg).

 man eclean should get you started.

 And as an example of savings... I run eclean once in a while, but not
 automated. I just ran it and got these results:

 [   14.8 G ] Total space from 1673 files were freed in the distfiles directory

 I guess I should use it more frequently. ;)


15GB is a nice clean up!

I don't think I'd want to run it automatically, at least not often. If
it automatically deleted things that work in favor of newly built but
untested packages that would defeat the purpose in my mind.

As basically nothing but a home user I'm trying after 12 years to
piece together some sort of a backup strategy here, including how to
do a restore if a drive died, etc. I'll ask some questions about that
later, but likely it should be it's own thread.

Cheers,
Mark

- Mark



Re: [gentoo-user] Re: tools to clean up /usr/portage/packages?

2012-02-27 Thread Neil Bothwick
On Mon, 27 Feb 2012 15:15:18 -0800, Mark Knecht wrote:

 Also, this is raising an additional question for me. What's the
 difference between buildpkg and buildsyspkg. man emerge doesn't talk
 about the latter as best I can tell.

buildpkg builds packages for all installs, buildsyspkg only for packages
in the system set. man make.conf explains the FEATURES options.


-- 
Neil Bothwick

Wow! That lightning sounds clo..it! NO CARRIER


signature.asc
Description: PGP signature


Re: [gentoo-user] Re: tools to clean up /usr/portage/packages?

2012-02-27 Thread Mark Knecht
On Mon, Feb 27, 2012 at 3:42 PM, Neil Bothwick n...@digimed.co.uk wrote:
 On Mon, 27 Feb 2012 15:15:18 -0800, Mark Knecht wrote:

 Also, this is raising an additional question for me. What's the
 difference between buildpkg and buildsyspkg. man emerge doesn't talk
 about the latter as best I can tell.

 buildpkg builds packages for all installs, buildsyspkg only for packages
 in the system set. man make.conf explains the FEATURES options.


 --
 Neil Bothwick

Thanks Neil!

- Mark



Re: [gentoo-user] Re: tools to clean up /usr/portage/packages?

2012-02-27 Thread Paul Hartman
On Mon, Feb 27, 2012 at 5:30 PM, Mark Knecht markkne...@gmail.com wrote:
 On Mon, Feb 27, 2012 at 3:18 PM, Paul Hartman
 paul.hartman+gen...@gmail.com wrote:
 On Mon, Feb 27, 2012 at 4:49 PM, Nikos Chantziaras rea...@arcor.de wrote:
 On 28/02/12 00:41, Mark Knecht wrote:

 Are there any tools that will:

 1) Ensure that for every installed packages there is a corresponding
 tbz2 file in /usr/portage/packages?

 2) Remove any older versions in /usr/portage/packages prior to me
 running a backup?


 I think app-portage/gentoolkit can help with its eclean tool
 (specifically, eclean-pkg).

 man eclean should get you started.

 And as an example of savings... I run eclean once in a while, but not
 automated. I just ran it and got these results:

 [   14.8 G ] Total space from 1673 files were freed in the distfiles 
 directory

 I guess I should use it more frequently. ;)


 15GB is a nice clean up!

 I don't think I'd want to run it automatically, at least not often. If
 it automatically deleted things that work in favor of newly built but
 untested packages that would defeat the purpose in my mind.

 As basically nothing but a home user I'm trying after 12 years to
 piece together some sort of a backup strategy here, including how to
 do a restore if a drive died, etc. I'll ask some questions about that
 later, but likely it should be it's own thread.

 Cheers,
 Mark

You can probably just exclude /usr/portage from your backup entirely,
since it'll be restored with an emerge --sync (or webrsync) and any
distfiles can be downloaded again if they are needed.



Re: [gentoo-user] Re: tools to clean up /usr/portage/packages?

2012-02-27 Thread Mark Knecht
On Mon, Feb 27, 2012 at 3:48 PM, Paul Hartman
paul.hartman+gen...@gmail.com wrote:
 On Mon, Feb 27, 2012 at 5:30 PM, Mark Knecht markkne...@gmail.com wrote:
 On Mon, Feb 27, 2012 at 3:18 PM, Paul Hartman
 paul.hartman+gen...@gmail.com wrote:
 On Mon, Feb 27, 2012 at 4:49 PM, Nikos Chantziaras rea...@arcor.de wrote:
 On 28/02/12 00:41, Mark Knecht wrote:

 Are there any tools that will:

 1) Ensure that for every installed packages there is a corresponding
 tbz2 file in /usr/portage/packages?

 2) Remove any older versions in /usr/portage/packages prior to me
 running a backup?


 I think app-portage/gentoolkit can help with its eclean tool
 (specifically, eclean-pkg).

 man eclean should get you started.

 And as an example of savings... I run eclean once in a while, but not
 automated. I just ran it and got these results:

 [   14.8 G ] Total space from 1673 files were freed in the distfiles 
 directory

 I guess I should use it more frequently. ;)


 15GB is a nice clean up!

 I don't think I'd want to run it automatically, at least not often. If
 it automatically deleted things that work in favor of newly built but
 untested packages that would defeat the purpose in my mind.

 As basically nothing but a home user I'm trying after 12 years to
 piece together some sort of a backup strategy here, including how to
 do a restore if a drive died, etc. I'll ask some questions about that
 later, but likely it should be it's own thread.

 Cheers,
 Mark

 You can probably just exclude /usr/portage from your backup entirely,
 since it'll be restored with an emerge --sync (or webrsync) and any
 distfiles can be downloaded again if they are needed.


Agreed.

My server has about 400GB to back up. Roughly 360GB is virtual
machines which get backed up daily already so I have that handled.

Of the other 40GB it seems that (excluding portage, /var and a few
other things) I need to back up about 24GB which I think can be backed
up live. I'm not really worried about restoring the exact state of the
machine in one pass. This isn't a business, etc. I just want to get
back fairly quickly to where I was before the presumed failure. I
figure if I get:

/home
/boot
/usr/src
/etc
/var/lib/portage

and maybe one or two more, then a restore would hopefully be something
like doing a quick install as per the Gentoo docs and then laying this
stuff on top and doing an emerge -ke @world.

Or at least that's what I'm trying to puzzle together.

I'm planning on trying it with an additional hard drive as a test.
I'll have to modify fstab as the main system is a 5 drive RAID6
monster and for testing I just want a single drive to verify that it
works.

QUESTION: As for ensuring that every package actually has a
corresponding tbz2 file in the packages directory, would

emerge -ek @world

install everything from packages except in the case of something not
existing in which case it would build and store it?

Thanks,
Mark