Bug#876819: Info received (Bug#876819: Debian mirror ftp.heikorichter.name: out-of-date)

[Heiko Richter]

-BEGIN PGP SIGNED MESSAGE-
Hash: SHA256

And indeed I read it and tested it carefully before setting the
options. Everything worked fine with the old version I had before.
Something changed with this version making it not accept the -h option
anymore.

I only have three other options set in $RSYNC_EXTRA (which is above
the warning you mentioned) and they seem to work fine:
RSYNC_EXTRA="-z --exclude .~tmp~/ --safe-links"

Heiko
-BEGIN PGP SIGNATURE-
Version: GnuPG v2

iQIcBAEBCAAGBQJZ453oAAoJECKEz6pWghImC9EP/1bYPfNNDwLaJxPNG/ckgQEO
bLqhKNXvHHJy8ACrA9wkHlnoX3b83esPzLFI91dEv8bz773BJv4I/MS5tOkGFgHZ
sxw87XYxmUW/vgGlg0EUraXHh8dMFmngXIezsvHZjFcS8nrlm/keh5lcr3+7h7Fg
AveWcp+GsyZ4Iyjp1h/gGfxOqH8wmJBcPcImd7h2c8rV3x2EPRdYwX4FldXKpfX9
aLzKIbj0t7wWaF1BsfQ9xRVrr8V//YxNCvLsLAQcigjYpNnJHg2q2ZE9bR/lZFY0
RrM+lh/qDCzeIa/C+lxKs2Ng5Izzz6B5amJRS6YKw2vhOIJzQzbgY6bWjkYd3uGr
GzkXwVbMx3CjAS570ufaY81x/6Vkt+sAACDLdb89lHw7Dbz7XbIB6DsVJ4yCv2Ph
HLQgcR7kZ/Y2sWyZi8/hBPSWSmsa2WX0OCpEfDNVqrRdfp1par/MmBR+DqmsL8Te
/XLH5/raC4P3RACXgVzZi947y0HmBTSj8B6r4+q1SYPQZ8uvUz+FUjI/v9DwVNZy
XGalt+hDJttymwdpgznaTTREwiaYI707zxe9zZ34ERMxfSWIrRsgFVujATkZ5KhU
YE8Fil1NMAGkb18b2oTUtvupJ9hpvJ8mTxJBCSFHk9gSqooIOos0ZQ5SXfYA+bDM
E8wtxSFxIs37Sgmv40j0
=RiG2
-END PGP SIGNATURE-

Bug#876819: Info received (Bug#876819: Debian mirror ftp.heikorichter.name: out-of-date)

[Bastian Blank]

Hi Heiko

On Sun, Oct 15, 2017 at 07:16:24PM +0200, Heiko Richter wrote:
> You are indeed right, I set -h to receive human-readable numerals
> within the in logs. Just removed it and everything ran fine.

Okay.  There is a reason why this part of the example config is prefixed
with:

| ## BE VERY CAREFUL WHEN YOU CHANGE THE RSYNC_OPTIONS! BETTER DON'T!

> The trace file should be correct from now on (mirror content always
> has been).

Okay.

Bastian

-- 
Actual war is a very messy business.  Very, very messy business.
-- Kirk, "A Taste of Armageddon", stardate 3193.0

Bug#876819: Info received (Bug#876819: Debian mirror ftp.heikorichter.name: out-of-date)

[Bastian Blank]

Hi Peter

On Sun, Oct 15, 2017 at 05:00:51PM +, Peter Palfrader wrote:
> On Sun, 15 Oct 2017, Heiko Richter wrote:
> > Going through the logs I noticed ftpsync breakes after the second
> > stage. As I haven't changed anything it seems to be a bug in the
> > newest version of the ftpsync script.
> > 
> > Here are the logs:
> > Oct 15 16:18:28 www ftpsync[39220]: Back from rsync with returncode 0
> > /home/debian/bin/ftpsync: line 601: 211.95M: syntax error: invalid
> > arithmetic operator (error token is ".95M")
> > Oct 15 16:18:29 www ftpsync[39220]: Mirrorsync done
> 
> My line 601 of ftpsync version 20170920 does not contain mathematical
> operators.

Actually it does.  Line 601 contains:
| total=$(( total + bytes ))

> Also, any idea where .95M comes from?

>From rsync, with options we don't set.

Bastian

-- 
Those who hate and fight must stop themselves -- otherwise it is not stopped.
-- Spock, "Day of the Dove", stardate unknown

Bug#876819: Info received (Bug#876819: Debian mirror ftp.heikorichter.name: out-of-date)

[Heiko Richter]

-BEGIN PGP SIGNED MESSAGE-
Hash: SHA256

I did not change anything in the script, just set the options in the
configuration file.

Line 601 in version 20170920 contains the following mathematical
operation:
  total=$(( total + bytes ))

You are indeed right, I set -h to receive human-readable numerals
within the in logs. Just removed it and everything ran fine.

The trace file should be correct from now on (mirror content always
has been).

Heiko
-BEGIN PGP SIGNATURE-
Version: GnuPG v2

iQIcBAEBCAAGBQJZ45fnAAoJECKEz6pWghImaaoP/3e6xxk0C6wGRZ5JeDut97Eb
humwYpmff8excs5+ysczQWgkU/rO6MlXOV9H8b5HHn7ki6TuWxkT4gqnASL8U6Nx
62O5oWxPQ8chFbnEveZ5opufrnqlFGEyYQ+ORqwQDBH28lcCUbFf7Os2K22A5jDh
EgsWkZPsiuM8HEs2k9+Eo3OGXzJiwgsoD+LXK2tpIagFLl5ZzOpCbwhNLTR5ha+A
DKmj4bEcYuO/3g2xdzxHxYJI1SKWsVmdvKG3kpHCGALawWAewq2vllil0/2Skv8y
YiOQ/npqT9tCbcTxaNbSLuERGlininih8yxGEf2IhZwDPl3k6+49Iq4hy87wO1Yr
Z/SRGHNWfry1wwSgobn1+GIx2inMQGq8MqM56DeGBWIA5UiHL0gO2v1T8bvXbNfj
Oxto1C4GwfbLC+3nGfpyqcangocZoPYwrMNJYx67WR/I73R64xaSksUhzNH+BNnQ
GZrFTgX7QybY9DEVq0LBPt2Hes+ZBEE5lJdDISotAdLYXT8gb5MRoOKIdW5f8pTx
xNDv8OHwC/dMIHplztmrnhJE/j27On4kMzwrOkiSHt5hCW2v3QHlmnYCl7bkVdui
hFMD2J22JyupDxeyPmCJPXqycNiIxEnWwisCnfoXY1nUZ/BVDuMuGC+gJHx9hcmr
/U8UGDoN6M5HqGlTh6uQ
=LZoP
-END PGP SIGNATURE-

Bug#876819: Info received (Bug#876819: Debian mirror ftp.heikorichter.name: out-of-date)

[Bastian Blank]

Hi Heiko

On Sun, Oct 15, 2017 at 04:28:59PM +0200, Heiko Richter wrote:
> Going through the logs I noticed ftpsync breakes after the second
> stage. As I haven't changed anything it seems to be a bug in the
> newest version of the ftpsync script.

Did you change anything on the script?

> Here are the logs:
> Oct 15 16:18:28 www ftpsync[39220]: Back from rsync with returncode 0
> /home/debian/bin/ftpsync: line 601: 211.95M: syntax error: invalid
> arithmetic operator (error token is ".95M")

I see.  The problem is: rsync only generates this output format if it
gets a at least one "-h" parameter.  None are set in the options we use
by default.

But I'm fixing this anyway.

Regards,
Bastian

-- 
Many Myths are based on truth
-- Spock, "The Way to Eden",  stardate 5832.3

Bug#876819: Info received (Bug#876819: Debian mirror ftp.heikorichter.name: out-of-date)

[Peter Palfrader]

On Sun, 15 Oct 2017, Heiko Richter wrote:

> Going through the logs I noticed ftpsync breakes after the second
> stage. As I haven't changed anything it seems to be a bug in the
> newest version of the ftpsync script.
> 
> Here are the logs:
> Oct 15 16:18:28 www ftpsync[39220]: Back from rsync with returncode 0
> /home/debian/bin/ftpsync: line 601: 211.95M: syntax error: invalid
> arithmetic operator (error token is ".95M")
> Oct 15 16:18:29 www ftpsync[39220]: Mirrorsync done

My line 601 of ftpsync version 20170920 does not contain mathematical
operators.  Also, any idea where .95M comes from?

-- 
|  .''`.   ** Debian **
  Peter Palfrader   | : :' :  The  universal
 https://www.palfrader.org/ | `. `'  Operating System
|   `-https://www.debian.org/

Bug#876819: Info received (Bug#876819: Debian mirror ftp.heikorichter.name: out-of-date)

[Heiko Richter]

-BEGIN PGP SIGNED MESSAGE-
Hash: SHA256

Going through the logs I noticed ftpsync breakes after the second
stage. As I haven't changed anything it seems to be a bug in the
newest version of the ftpsync script.

Here are the logs:
Oct 15 16:18:28 www ftpsync[39220]: Back from rsync with returncode 0
/home/debian/bin/ftpsync: line 601: 211.95M: syntax error: invalid
arithmetic operator (error token is ".95M")
Oct 15 16:18:29 www ftpsync[39220]: Mirrorsync done

Heiko
-BEGIN PGP SIGNATURE-
Version: GnuPG v2

iQIcBAEBCAAGBQJZ43CmAAoJECKEz6pWghImoLYP/ipradDfEysd8ZgNKkcF2M+k
YXiNjGy0BYBh0WtZeT/DR498aSzOKzTXUX9Iau+D3SX5nCAJXsusIoZhyImJMj7x
PVUbOqOrOpUo1ah6/AoHZ8WYz6erLSo5SZud1iG1St60JD5DRpb7SPcfBO08zH2Y
1849Rq+PVkaDBEzyMiRouOOsXrU5+cTZWA99P0V0ZvCFVfu9tSixB1sc0iKmEz9R
KFRQuyqdNY1zVGhKlRRAnSK5SG1JBscU5KuJbWxpFOT3Wj9NvGkR1rma5RrKsK60
Ua5pQ/kFX5uA/qntHttUusq3MmzfffaIhxhjmfIQtUZW4haKvtJ1mg8YjKFSwYp1
4dTLVpRxaeBhUfU8sFoSE8Gw3XTOvQBcRfWd2MaN43JFIHbcJM/qHIIyspp6YAuV
ij7QumZWDFVLfmHywgbmXvgCQfDGP0XowcaFS6C8zsOLgGNL5/5c8eGgo7mGOxaE
OUUBu4A259LMNMniLiALTrnvxyEALeg5cGySdcAUGGJEHpBDRFLbuFjtyo8KQuI3
TBhJaQDIgplc3CrTu5Vf3erdqkuDdZ7YzSLa+6ZaR4m0qH+OLoXCOl724GGZRxnF
E88EPZhMW82TQu+MP0RmBGnkt8c7/+Jy2DWyBQTcNMI44lZJgFnqZ/0FI4pC+Dzw
kThoR+NK5Rn3jTDQVDW9
=NRqs
-END PGP SIGNATURE-

Bug#876819: Debian mirror ftp.heikorichter.name: out-of-date

[Heiko Richter]

-BEGIN PGP SIGNED MESSAGE-
Hash: SHA256

Everything is in order with my mirror except that the new ftpsync
creates a different trace file.

old filename: ftp.heikorichter.name
new filename: ftp.heikorichter.name.new

Obviously the new ftpsync version only updates the new file and leaves
the old in place while you mirror probe just checks the old one.

I just ran rsync manually and there are no differences between my
mirror and upstream debian.inf.tu-dresden.de.

Heiko
-BEGIN PGP SIGNATURE-
Version: GnuPG v2

iQIcBAEBCAAGBQJZ428CAAoJECKEz6pWghImiI8P/iIXesZj1xRUAjf2XWGuVYPU
Vdn4bw1VgzbN7CWrWTL30kI3Z/vrznIALNBlj3t+TkIDZsMjPk+89x8FfyDm55z2
kuBnipm3uBWMLG+1H9bnomW06U5LFMUo8Y/6cl2nwkLEsntRvC6kWHaeFaWMRcUC
Ke4EszuWS8ACHKnbl5oJkWGPvalJoLh0mbKPjdwOotKkUHN299Lj/HTr4VSDtana
adrr3DkFEzkDgid7mIDwg8J6gwG/amMR5Dv7N4tvGT3xyHKcEB+HHSHf9ohcGbVg
O4JaQ8dstguNTgrao5UOIQGhAagXKRN1ITYJnYoNmJSYZ7pkqOPfvUxvTmRVAcz7
iMb7wv1Ywhsiu5FloXOYZo6sdxDyMhe6Pmh4tIUBaMe9oRNSakpcl9OWIgd/X14C
hj8BwxayEZ0S4Hts93vtsgfccaUGBva0pOSk/no5mrQkl25ET4hbU1Fqz5pvPoMV
nZTOR9dwj/yedLJLud4izswcw074T7U+dxptrvS/UrzIh0Z6mUwLFZceQ5FK649o
LYmMOGDWXl7Gm/6JZ2kUFbHwbaSVPAT0UbTDem+y4p9aF1eT2geZMlhii9LEDxYL
iyOTjpoIIXCraAMT3Ut/6d1u0tCMvgSueiCPcOLENo5+o8aJeqeU2wAbRhj5LP+Y
Risf9vdE9b+rb4KK1qau
=VK8A
-END PGP SIGNATURE-

Bug#876819: Debian mirror ftp.heikorichter.name: out-of-date

[Peter Palfrader]

ping.

On Tue, 10 Oct 2017, Peter Palfrader wrote:

> On Tue, 26 Sep 2017, Heiko Richter wrote:
> 
> > Just found the error and fixed it. ftpsync is running right now, so the
> > mirror should be in sync again shortly.
> 
> According to 
> https://mirror-master.debian.org/status/mirror-info/ftp.heikorichter.name.html
> your mirror hasn't successfully finished a run in over a week.
> 
> Please investigate.
> -- 
> |  .''`.   ** Debian **
>   Peter Palfrader   | : :' :  The  universal
>  https://www.palfrader.org/ | `. `'  Operating System
> |   `-https://www.debian.org/
> 

-- 
|  .''`.   ** Debian **
  Peter Palfrader   | : :' :  The  universal
 https://www.palfrader.org/ | `. `'  Operating System
|   `-https://www.debian.org/

Bug#876819: Debian mirror ftp.heikorichter.name: out-of-date

[Peter Palfrader]

On Tue, 26 Sep 2017, Heiko Richter wrote:

> Just found the error and fixed it. ftpsync is running right now, so the
> mirror should be in sync again shortly.

According to 
https://mirror-master.debian.org/status/mirror-info/ftp.heikorichter.name.html
your mirror hasn't successfully finished a run in over a week.

Please investigate.
-- 
|  .''`.   ** Debian **
  Peter Palfrader   | : :' :  The  universal
 https://www.palfrader.org/ | `. `'  Operating System
|   `-https://www.debian.org/

Bug#876819: Debian mirror ftp.heikorichter.name: out-of-date

[Heiko Richter]

-BEGIN PGP SIGNED MESSAGE-
Hash: SHA256

Hi!

Just found the error and fixed it. ftpsync is running right now, so the
mirror should be in sync again shortly.

Heiko


Am 26.09.2017 um 10:37 schrieb Peter Palfrader:
> Package: mirrors
> User: mirr...@packages.debian.org
> Usertags: mirror-problem may-auto-close
> Control: submitter -1 mirr...@debian.org
> 
> Hi,
> 
> I was checking some things in the Debian mirror universe and noticed
> a problem with your mirror:
> 
> 
> o Your mirror is out of date by almost a week
>   Status: https://mirror-master.debian.org/status/mirror-info/ftp.heik
orichter.name.html
> 
> o we recommend mirrors not sync directly from service aliases such as
>   ftp..debian.org (only http is guaranteed to be available at
>   ftp..d.o sites).  Maybe change your config to sync from
>   the site currently backing the ftp..debian.org service you sync
>   from?
> 
> Peter
> 
-BEGIN PGP SIGNATURE-
Version: GnuPG v2

iQIcBAEBCAAGBQJZysRSAAoJECKEz6pWghImcU4QAJPI0m7/EhZv1IO39CbSniK6
y3Y7hroIcdnWAcvRHw/buNvbBjfouMshbNpiEX+YmF9+VLJo3aHYIrW0ii1TNyjj
tL0SAdoMmdBlY4rvJ6VbM7MFSFifHDSgRAfH7JbmE30wdvJAOPLvqENVO1534q5q
tugnGV7GaJv1Lv71JRDQOOyVdw3IzfP4fdSTg0ST+QctdsTV5j/qtF3TMDZ4XRct
fP+x/opb8DGv3fEQXlDhFwfIDPfkxZeuzcbYQK/mtxOyWoHRf7a/y+XJAh+o2Shv
SCpyykiSo6mZdGAKTb8SjcKzhHTdcGCp6HKqpLZ56XXt3vcAF0cIzvPnBFCqUXOI
4lld/aDyL+wDynnJn4x7+eOdMmxo8GKJ7TXBqH4POrRTAi0LASHMHHHxYnByTf+E
8u+j1ikAdx+FKtXfpodHJO7Gg3gXwjOiYF6RhXL7AHkbTyzY0yo3A21Hl4XbD/+U
KRVfYOje/JVQc8/h5qpqYwmidoPsoVC/pjJyMUBPrME9xmzjTTQznDK5C2Ih5pK6
BBSpkkijDfMlnO121Acb+erpfyW4Jbm6qOezBLX3OWXPU4X6212S/IdE4aLvXrxX
adLt/idzZDwXdr18DVvJQUpK+BWEBc/a+OEjPSOKPp4bK6pXVJEBMNaY6Oj0vYBE
50LtiNiymMiXtcYJJtmG
=5fhb
-END PGP SIGNATURE-

Bug#876819: Debian mirror ftp.heikorichter.name: out-of-date

[Heiko Richter]

Hi,

Thank you for your message. Strangely neither cron nor ftpmirror did not send 
me any notices or errors.

I will look into it immediately. 

Heiko





Am 26. September 2017 10:37:14 MESZ schrieb Peter Palfrader :
>Package: mirrors
>User: mirr...@packages.debian.org
>Usertags: mirror-problem may-auto-close
>Control: submitter -1 mirr...@debian.org
>
>Hi,
>
>I was checking some things in the Debian mirror universe and noticed
>a problem with your mirror:
>
>
>o Your mirror is out of date by almost a week
>Status:
>https://mirror-master.debian.org/status/mirror-info/ftp.heikorichter.name.html
>
>o we recommend mirrors not sync directly from service aliases such as
>  ftp..debian.org (only http is guaranteed to be available at
>  ftp..d.o sites).  Maybe change your config to sync from
>  the site currently backing the ftp..debian.org service you sync
>  from?
>
>Peter

Bug#876819: Debian mirror ftp.heikorichter.name: out-of-date

[Peter Palfrader]

Package: mirrors
User: mirr...@packages.debian.org
Usertags: mirror-problem may-auto-close
Control: submitter -1 mirr...@debian.org

Hi,

I was checking some things in the Debian mirror universe and noticed
a problem with your mirror:


o Your mirror is out of date by almost a week
  Status: 
https://mirror-master.debian.org/status/mirror-info/ftp.heikorichter.name.html

o we recommend mirrors not sync directly from service aliases such as
  ftp..debian.org (only http is guaranteed to be available at
  ftp..d.o sites).  Maybe change your config to sync from
  the site currently backing the ftp..debian.org service you sync
  from?

Peter
-- 
|  .''`.   ** Debian **
  Peter Palfrader   | : :' :  The  universal
 https://www.palfrader.org/ | `. `'  Operating System
|   `-https://www.debian.org/