Re: pkg does not update the repo catalogue

2015-12-07 Thread Matthew Seaman
On 12/07/15 11:42, Matthias Apitz wrote:
> Maybe I wasn't clear enough. I copied only the packages to the new
> system (my netbook) some weeks ago, and created the catalogue with
> 
> # pkg repo /usr/PKGDIR.20150726
> 
> and installed the packages; Today I built 8 packages more, copied them
> over too and was (may be in error) expecting to add these 8 new packages to
> the catalogue with 'pkg update -f'
> 
> Seems that I just have to reuse 'pkg repo '

Yeah.  That would explain what you were seeing.  Yes, you do have to
rebuild the repo catalogue on your repo server when you change the repo
contents.

Running 'pkg update -f' or similar won't cause pkg(8) to be run on the
repo side -- the repo is a read-only source of static content[*] as far
as the client pkg(8) can interact with it.

Cheers,

Matthew

[*] Well, except possibly for the repo.conf HTTP mirroring scheme which
is intended to allow load balancing amongst a set of repo servers by --
possibly dynamically -- generating a list of the available servers in
preference order.




signature.asc
Description: OpenPGP digital signature


Re: pkg does not update the repo catalogue

2015-12-07 Thread Baptiste Daroussin
On Mon, Dec 07, 2015 at 01:25:09PM +0100, olli hauer wrote:
> On 2015-12-07 09:50, Matthias Apitz wrote:
> > 
> > Hello,
> > 
> > This is with 11-CURRENT and ports from July this year; I have the
> > packages which I build with poudriere on some other host in a dir
> > /usr/PKGDIR.20150726 and added 8 new packages there, the total number is
> > now 1691:
> > 
> > # ls *.txz | egrep -v 'packagesite.txz|meta.txz|digests.txz' | wc -l 
> > 1691
> > 
> > My repo definition is:
> > 
> > # cat /usr/local/etc/pkg/repos/myrepo.conf
> >FreeBSD: {
> >url: "file:/usr/PKGDIR.20150726",
> >enabled: true,
> >}
> > 
> > When I now want to update the 8 new packages to the repo catalogue, they
> > are not added (i.e. the number stays with 1683 and I also can not
> > install them with 'pkg instal ...'):
> > 
> > # pkg -v
> > 1.5.5
> > # pkg -R /usr/local/etc/pkg/repos/ update -f
> > Updating FreeBSD repository catalogue...
> > Fetching meta.txz: 100%260 B   0.3kB/s00:01
> > Fetching packagesite.txz: 100%  382 KiB 391.6kB/s00:01
> > Processing entries: 100%
> > FreeBSD repository update completed. 1683 packages processed.
> > 
> > What I'm missing here?
> > 
> > Thanks
> > 
> > matthias
> 
> Hi Matthias,
> 
> I see some possible issues.
> 
> - repo has same name as the official one (FreeBSD, see `cat 
> /etc/pkg/FreeBSD.conf')
> - file:/$path should be file:///$path

pkg should have yelled about that, I will fix that.

> - repo catalog was not updated with command `pkg repo'
> - REPO_AUTOUPDATE = true/false (in pkg.conf)
> 
> Does your repo match the output of the command
> $ pkg -vv (all below Repositories:)
> 
> 

Best regards,
Bapt


signature.asc
Description: PGP signature


Re: pkg does not update the repo catalogue

2015-12-07 Thread olli hauer
On 2015-12-07 09:50, Matthias Apitz wrote:
> 
> Hello,
> 
> This is with 11-CURRENT and ports from July this year; I have the
> packages which I build with poudriere on some other host in a dir
> /usr/PKGDIR.20150726 and added 8 new packages there, the total number is
> now 1691:
> 
> # ls *.txz | egrep -v 'packagesite.txz|meta.txz|digests.txz' | wc -l 
> 1691
> 
> My repo definition is:
> 
> # cat /usr/local/etc/pkg/repos/myrepo.conf
>FreeBSD: {
>url: "file:/usr/PKGDIR.20150726",
>enabled: true,
>}
> 
> When I now want to update the 8 new packages to the repo catalogue, they
> are not added (i.e. the number stays with 1683 and I also can not
> install them with 'pkg instal ...'):
> 
> # pkg -v
> 1.5.5
> # pkg -R /usr/local/etc/pkg/repos/ update -f
> Updating FreeBSD repository catalogue...
> Fetching meta.txz: 100%260 B   0.3kB/s00:01
> Fetching packagesite.txz: 100%  382 KiB 391.6kB/s00:01
> Processing entries: 100%
> FreeBSD repository update completed. 1683 packages processed.
> 
> What I'm missing here?
> 
> Thanks
> 
>   matthias

Hi Matthias,

I see some possible issues.

- repo has same name as the official one (FreeBSD, see `cat 
/etc/pkg/FreeBSD.conf')
- file:/$path should be file:///$path
- repo catalog was not updated with command `pkg repo'
- REPO_AUTOUPDATE = true/false (in pkg.conf)

Does your repo match the output of the command
$ pkg -vv (all below Repositories:)



-- 
olli
___
freebsd-current@freebsd.org mailing list
https://lists.freebsd.org/mailman/listinfo/freebsd-current
To unsubscribe, send any mail to "freebsd-current-unsubscr...@freebsd.org"


Re: pkg does not update the repo catalogue

2015-12-07 Thread Matthias Apitz
El día Monday, December 07, 2015 a las 11:31:40AM +, Matthew Seaman 
escribió:

> H  it seems fairly clear to me that the 8 new packages aren't in
> the repo catalogue that you're downloading.  You built the repo using
> poudriere?  Poudriere does some fun'n'games with symbolic links to
> achieve an atomic repo update, which means there is actually a history
> of previous versions of the repo kept.  You'll see a directory structure
> like this:
> 
> ...

Maybe I wasn't clear enough. I copied only the packages to the new
system (my netbook) some weeks ago, and created the catalogue with

# pkg repo /usr/PKGDIR.20150726

and installed the packages; Today I built 8 packages more, copied them
over too and was (may be in error) expecting to add these 8 new packages to
the catalogue with 'pkg update -f'

Seems that I just have to reuse 'pkg repo '

Thanks for your hints.

matthias
-- 
Matthias Apitz, ✉ g...@unixarea.de, 🌐 http://www.unixarea.de/  ☎ 
+49-176-38902045
___
freebsd-current@freebsd.org mailing list
https://lists.freebsd.org/mailman/listinfo/freebsd-current
To unsubscribe, send any mail to "freebsd-current-unsubscr...@freebsd.org"

Re: pkg does not update the repo catalogue

2015-12-07 Thread Matthew Seaman
On 12/07/15 11:04, Matthias Apitz wrote:
> Now 'pkg -vv' shows only myrepo; the 'pkg upgrade -f' ended up with
> reinstallation of all ~1000 packages;

Ooops.  'pkg upgrade -f' says 'reinstall everything' -- which was an
error on my part. I meant to type 'pkg update -f' which only refreshes
the repo catalogues.  Apologies.

> but all this did not solved the problem;
> 
>> > If changing the repo tag doesn't fix the problem, try turning on some
>> > debugging output:
>> > 
>> >env DEBUG_LEVEL=4 pkg update -f
> The output of STDERR is here: http://www.unixarea.de/pkg-stderr.txt
> (4 MByte, 100.000 lines)

H  it seems fairly clear to me that the 8 new packages aren't in
the repo catalogue that you're downloading.  You built the repo using
poudriere?  Poudriere does some fun'n'games with symbolic links to
achieve an atomic repo update, which means there is actually a history
of previous versions of the repo kept.  You'll see a directory structure
like this:

% ls -la
total 159
drwxr-xr-x  102 root  wheel  108 Dec  7 00:19 ./
drwxr-xr-x9 root  wheel   15 Aug  4 11:39 ../
lrwxr-xr-x1 root  wheel   16 Dec  7 00:19 .latest@ -> .real_1449447572
[...]
drwxr-xr-x4 root  wheel8 Dec  5 01:27 .real_1449278821/
drwxr-xr-x4 root  wheel8 Dec  6 00:55 .real_1449363354/
drwxr-xr-x4 root  wheel8 Dec  7 00:19 .real_1449447572/
lrwxr-xr-x1 root  wheel   11 Dec 19  2014 All@ -> .latest/All
lrwxr-xr-x1 root  wheel   14 Dec 19  2014 Latest@ -> .latest/Latest
lrwxr-xr-x1 root  wheel   19 Dec 19  2014 digests.txz@ ->
.latest/digests.txz
lrwxr-xr-x1 root  wheel   16 Dec 19  2014 meta.txz@ -> .latest/meta.txz
lrwxr-xr-x1 root  wheel   23 Dec 19  2014 packagesite.txz@ ->
.latest/packagesite.txz

Does the .latest symlink point at the .real_$TIMESTAMP you're expecting?

Cheers,

Matthew





signature.asc
Description: OpenPGP digital signature


Re: pkg does not update the repo catalogue

2015-12-07 Thread Matthias Apitz
El día Monday, December 07, 2015 a las 10:14:24AM +, Matthew Seaman 
escribió:

> On 12/07/15 08:50, Matthias Apitz wrote:
> > 
> > Hello,
> > 
> > This is with 11-CURRENT and ports from July this year; I have the
> > packages which I build with poudriere on some other host in a dir
> > /usr/PKGDIR.20150726 and added 8 new packages there, the total number is
> > now 1691:
> > 
> > # ls *.txz | egrep -v 'packagesite.txz|meta.txz|digests.txz' | wc -l 
> > 1691
> > 
> > My repo definition is:
> > 
> > # cat /usr/local/etc/pkg/repos/myrepo.conf
> >FreeBSD: {
> >url: "file:/usr/PKGDIR.20150726",
> >enabled: true,
> >}
> 
> There's no need to label your custom repo as 'FreeBSD' -- in fact, it's
> probably better for you to use a distinct name, as the repo.conf files
> accumulate for the same repo tag.  In this case you've possibly
> inadvertently got pkg checking the pkg signatures against the default
> FreeBSD repository keys, which isn't going to work for locally built
> packages.
> 
> Just change the tag in the repo.conf to 'myrepo' and then check what
> pkg(8) sees overall by running 'pkg -vv'.  You'll need to do a pkg
> upgrade -f after that.
> 
> If you don't want to use the standard FreeBSD repo at all then you can
> add a /usr/local/etc/repos/FreeBSD.conf containing
> 
> FreeBSD: { enabled: no }

I did both: renamed the entry to myrepo and added a new file:

# ls -l /usr/local/etc/pkg/repos/
total 8
-rw-r--r--  1 root  wheel   26  7 dic 11:30 FreeBSD.conf
-rw-r--r--  1 root  wheel  114  7 dic 11:21 myrepo.conf

# cat /usr/local/etc/pkg/repos/*

FreeBSD: { enabled: no }

   myrepo: {
   url: "file:/usr/PKGDIR.20150726",
   enabled: true,
   }

Now 'pkg -vv' shows only myrepo; the 'pkg upgrade -f' ended up with
reinstallation of all ~1000 packages;

but all this did not solved the problem;

> If changing the repo tag doesn't fix the problem, try turning on some
> debugging output:
> 
>env DEBUG_LEVEL=4 pkg update -f

The output of STDERR is here: http://www.unixarea.de/pkg-stderr.txt
(4 MByte, 100.000 lines)

Thanks

matthias

-- 
Matthias Apitz, ✉ g...@unixarea.de, 🌐 http://www.unixarea.de/  ☎ 
+49-176-38902045
___
freebsd-current@freebsd.org mailing list
https://lists.freebsd.org/mailman/listinfo/freebsd-current
To unsubscribe, send any mail to "freebsd-current-unsubscr...@freebsd.org"

Re: pkg does not update the repo catalogue

2015-12-07 Thread Matthew Seaman
On 12/07/15 08:50, Matthias Apitz wrote:
> 
> Hello,
> 
> This is with 11-CURRENT and ports from July this year; I have the
> packages which I build with poudriere on some other host in a dir
> /usr/PKGDIR.20150726 and added 8 new packages there, the total number is
> now 1691:
> 
> # ls *.txz | egrep -v 'packagesite.txz|meta.txz|digests.txz' | wc -l 
> 1691
> 
> My repo definition is:
> 
> # cat /usr/local/etc/pkg/repos/myrepo.conf
>FreeBSD: {
>url: "file:/usr/PKGDIR.20150726",
>enabled: true,
>}

There's no need to label your custom repo as 'FreeBSD' -- in fact, it's
probably better for you to use a distinct name, as the repo.conf files
accumulate for the same repo tag.  In this case you've possibly
inadvertently got pkg checking the pkg signatures against the default
FreeBSD repository keys, which isn't going to work for locally built
packages.

Just change the tag in the repo.conf to 'myrepo' and then check what
pkg(8) sees overall by running 'pkg -vv'.  You'll need to do a pkg
upgrade -f after that.

If you don't want to use the standard FreeBSD repo at all then you can
add a /usr/local/etc/repos/FreeBSD.conf containing

FreeBSD: { enabled: no }

> When I now want to update the 8 new packages to the repo catalogue, they
> are not added (i.e. the number stays with 1683 and I also can not
> install them with 'pkg instal ...'):
> 
> # pkg -v
> 1.5.5
> # pkg -R /usr/local/etc/pkg/repos/ update -f
> Updating FreeBSD repository catalogue...
> Fetching meta.txz: 100%260 B   0.3kB/s00:01
> Fetching packagesite.txz: 100%  382 KiB 391.6kB/s00:01
> Processing entries: 100%
> FreeBSD repository update completed. 1683 packages processed.
> 
> What I'm missing here?

If changing the repo tag doesn't fix the problem, try turning on some
debugging output:

   env DEBUG_LEVEL=4 pkg update -f

Cheers,

Matthew




signature.asc
Description: OpenPGP digital signature


pkg does not update the repo catalogue

2015-12-07 Thread Matthias Apitz

Hello,

This is with 11-CURRENT and ports from July this year; I have the
packages which I build with poudriere on some other host in a dir
/usr/PKGDIR.20150726 and added 8 new packages there, the total number is
now 1691:

# ls *.txz | egrep -v 'packagesite.txz|meta.txz|digests.txz' | wc -l 
1691

My repo definition is:

# cat /usr/local/etc/pkg/repos/myrepo.conf
   FreeBSD: {
   url: "file:/usr/PKGDIR.20150726",
   enabled: true,
   }

When I now want to update the 8 new packages to the repo catalogue, they
are not added (i.e. the number stays with 1683 and I also can not
install them with 'pkg instal ...'):

# pkg -v
1.5.5
# pkg -R /usr/local/etc/pkg/repos/ update -f
Updating FreeBSD repository catalogue...
Fetching meta.txz: 100%260 B   0.3kB/s00:01
Fetching packagesite.txz: 100%  382 KiB 391.6kB/s00:01
Processing entries: 100%
FreeBSD repository update completed. 1683 packages processed.

What I'm missing here?

Thanks

matthias

-- 
Matthias Apitz, ✉ g...@unixarea.de, 🌐 http://www.unixarea.de/  ☎ 
+49-176-38902045
___
freebsd-current@freebsd.org mailing list
https://lists.freebsd.org/mailman/listinfo/freebsd-current
To unsubscribe, send any mail to "freebsd-current-unsubscr...@freebsd.org"