Re: daily (weekly?) builds of d-i manual

[Holger Wansing]

Hi,

Holger Wansing  wrote:
> REMARK 1:
> With my holgerw account, I was able to upload the output files of the manual
> (html, pdf, txt), the log files and the html files for the webpage 
> successfully
> to alioth, but later there were errors when trying to set some permission 
> bits:
> 
> rsyncing files to alioth...
> rsync: failed to set permissions on 
> "/srv/alioth.debian.org/chroot/home/groups/d-i/htdocs/manual/da.mips": 
> Operation not permitted (1)
> rsync: failed to set permissions on 
> "/srv/alioth.debian.org/chroot/home/groups/d-i/htdocs/manual/da.mips/images": 
> Operation not permitted (1)
> rsync error: some files/attrs were not transferred (see previous errors) 
> (code 23) at main.c(1183) [sender=3.1.1]
> Unexpected error 23 while rsync of './da.mips'
> 
> This only appears with danish language files, so that's probably not a problem
> with infrastructure (that was my first thought). 
> I will try to investigate further...
> 
> 
> REMARK 2:
> Regarding statistics: apparently there is some problem with the calculation of
> the statistics for po-based languages: po-based languages are converted into 
> xml 
> files within the build process; then the system sees that xml files and 
> generates 
> xml statistics for them, so there are po and xml statistics for all po-based 
> languages.
> This needs to be investigated further!
> 
> 
[...]
> 
> REMARK 4:
> I have some problem with ssh-agent, I have to insert password for ssh key
> several times within the above process, that needs some more improvement.

I have managed to solve above problems in the meantime.
Especially the po-based languages are no longer included in xml statistics.

So, http://d-i.alioth.debian.org/manual/ is back in business :-))

(Joe Dalton as danish translator in CC, since he has reported this problem
with statistics some weeks ago. Thanks)


Holger


-- 

Created with Sylpheed 3.5.0 under
D E B I A N   L I N U X   8 . 0   " J E S S I E " .

Registered Linux User #311290 - https://linuxcounter.net/

Re: daily (weekly?) builds of d-i manual

[Baptiste Jammet]

Bonjour, 

Dixit Holger Wansing, le 15/12/2016 :

>Today, I performed a "non-local" build, which means files have been
>uploaded to alioth, and https://d-i.alioth.debian.org/manual/ has been
>updated. 
>
>Yeah!!!
>
>I intend to build the manual periodically again now.
>Not daily, as the svn repo may indicate, but something like once per
>week.

Great, thanks a lot !

Baptiste


pgpZWsBFs9IPi.pgp
Description: OpenPGP digital signature

Re: daily (weekly?) builds of d-i manual

[Holger Wansing]

Hi,

Holger Wansing  wrote:
> I have to correct myself: the output files (html, pdf, txt) were only uploaded
> for English, all the other languages still have the old files in place (manual
> for Jessie).
> So above failure for Danish is just the first one, that was tried, and the
> whole process was aborted. Thus no languages uploaded.
> 
> Long story short: it seems to me there is a problem with missing permissions 
> for
> my login holgerw.
> Alioth admins: could you look into my permissions for the debian-installer /
> d-i manual project?

Alioth admins:

I got it running now:
apparently it was a problem with some left-over from the past; I deleted
all the old directories by hand before a new build run, and now it works.

Sorry for the noise


Holger


-- 

Created with Sylpheed 3.5.0 under
D E B I A N   L I N U X   8 . 0   " J E S S I E " .

Registered Linux User #311290 - https://linuxcounter.net/

Re: daily (weekly?) builds of d-i manual

[Holger Wansing]

Hi,

Holger Wansing  wrote:
> 
> REMARK 1:
> With my holgerw account, I was able to upload the output files of the manual
> (html, pdf, txt), the log files and the html files for the webpage 
> successfully
> to alioth, but later there were errors when trying to set some permission 
> bits:
> 
> rsyncing files to alioth...
> rsync: failed to set permissions on 
> "/srv/alioth.debian.org/chroot/home/groups/d-i/htdocs/manual/da.mips": 
> Operation not permitted (1)
> rsync: failed to set permissions on 
> "/srv/alioth.debian.org/chroot/home/groups/d-i/htdocs/manual/da.mips/images": 
> Operation not permitted (1)
> rsync error: some files/attrs were not transferred (see previous errors) 
> (code 23) at main.c(1183) [sender=3.1.1]
> Unexpected error 23 while rsync of './da.mips'
> 
> This only appears with danish language files, so that's probably not a problem
> with infrastructure (that was my first thought). 
> I will try to investigate further...

I have to correct myself: the output files (html, pdf, txt) were only uploaded
for English, all the other languages still have the old files in place (manual
for Jessie).
So above failure for Danish is just the first one, that was tried, and the
whole process was aborted. Thus no languages uploaded.

Long story short: it seems to me there is a problem with missing permissions for
my login holgerw.
Alioth admins: could you look into my permissions for the debian-installer /
d-i manual project?


Thanks
Holger


-- 

Created with Sylpheed 3.5.0 under
D E B I A N   L I N U X   8 . 0   " J E S S I E " .

Registered Linux User #311290 - https://linuxcounter.net/

daily (weekly?) builds of d-i manual

[Holger Wansing]

Hi,

Philipp has pointed us to the 
https://anonscm.debian.org/viewvc/d-i/trunk/scripts/manual-daily/
repository, which contains a build system for the d-i manual.
Thanks for that hint!


I would have thought, that this runs on a dsa machine, but apparently this
has never (?) been the case.
Ok, no problem. I have a spare machine here, which could do that job perfectly
fine, so that could do.

I have worked on this, to get the manual build locally, which seems to work
so far, with some modifications (some glitches remain, but I will come back to 
that later).

Today, I performed a "non-local" build, which means files have been uploaded
to alioth, and https://d-i.alioth.debian.org/manual/ has been updated. 

Yeah!!!

I intend to build the manual periodically again now.
Not daily, as the svn repo may indicate, but something like once per week.
There are some remarks, though:



REMARK 1:
With my holgerw account, I was able to upload the output files of the manual
(html, pdf, txt), the log files and the html files for the webpage successfully
to alioth, but later there were errors when trying to set some permission bits:

rsyncing files to alioth...
rsync: failed to set permissions on 
"/srv/alioth.debian.org/chroot/home/groups/d-i/htdocs/manual/da.mips": 
Operation not permitted (1)
rsync: failed to set permissions on 
"/srv/alioth.debian.org/chroot/home/groups/d-i/htdocs/manual/da.mips/images": 
Operation not permitted (1)
rsync error: some files/attrs were not transferred (see previous errors) (code 
23) at main.c(1183) [sender=3.1.1]
Unexpected error 23 while rsync of './da.mips'

This only appears with danish language files, so that's probably not a problem
with infrastructure (that was my first thought). 
I will try to investigate further...



REMARK 2:
Regarding statistics: apparently there is some problem with the calculation of
the statistics for po-based languages: po-based languages are converted into 
xml 
files within the build process; then the system sees that xml files and 
generates 
xml statistics for them, so there are po and xml statistics for all po-based 
languages.
This needs to be investigated further!



REMARK 3:
Addionally, within the process, updated po and pot files have been committed to
svn repo. That are the commits from today with "[SILENT_COMMIT] Update of POT 
and PO files for the manual" as commit message.
So be prepared for SILENT_COMMIT commits again in the future :-)



REMARK 4:
I have some problem with ssh-agent, I have to insert password for ssh key
several times within the above process, that needs some more improvement.




Regards
Holger


-- 

Created with Sylpheed 3.5.0 under
D E B I A N   L I N U X   8 . 0   " J E S S I E " .

Registered Linux User #311290 - https://linuxcounter.net/