Re: scallywag / cygport not pulling lzip
On 2021-01-08 12:11, Achim Gratz wrote: Brian Inglis writes: Do we know what the frequency weighted difference is on bandwidth of packages actually downloaded? Not that I know of, as everything goes through mirrors. But I happen to have a complete Cygwin mirror on disk at the moment plus another one that only has the packages for my install and that's a fairly large installation, but without a desktop environment: 30G /mnt/mirror/cygwin 149G/mnt/fullmirror/cygwin So you can probably assume that only about 20% of the files are frequently accessed (likely significantly less since most folks would not install the debuginfo or source packages that are included in the above figure). I am more concerned with mirror providers (and also the lack of them) especially those with limited resources, and those in marginal locations and circumstances, for whom download time and charges may override other considerations, and perhaps prevent them (or many) from accessing or taking full advantage of available software. We could save way more space than that by de-duplicating the noarch parts into their own archives as I have already demonstrated before. The last time I did that I was cutting out around 30GiB IIRC. I doubt the unarchiving time difference is more than a blip in the total time required to *download* *AND* install any package, greatly outweighed by the download time difference, unless you are on a big pipe to a nearby mirror. It is not, with a typical VDSL connection I'd be able to download faster than I can install on a more typical machine, I need only about 5MiB/s to saturate the filesystem for small files and around 20…40MiB/s for large ones (to an NVMe drive, a spinning disk or some of the slower SSD can't sustain that). But that point is somewhat moot since setup will always mirror to disk first and that's not easy to change since we read the file twice: once for the SHA512 check (which can use up to around 300MiB/s input bandwidth somewhat higher in peaks and then the actual installation). Some setup phase stats from my own most recent upgrade of about 130MB of downloads, and stats since 2013 (nearly 8 years) since I last cleared setup.log: $ cyg-setup-phase-times.awk /var/log/setup.log.full sv 00:04:26 dl 00:01:28 pr 00:00:02 ui 00:00:36 ex 00:03:35 pi 00:07:12 $ cyg-setup-phase-times.awk /var/log/setup.log sv 04:32:46 dl 02:31:27 pr 00:16:08 ui 00:51:10 ex 06:06:49 pi 00:00:41 phases are: sv - solve formerly Adding required packages - high times are interaction delays dl - download pr - preremove ui - uninstall ex - extract pi - postinstall so your comments about extracts are validated, taking about 3 times as long as downloads even on a currently 2MByte/s medium speed cable modem link to a nearby (7.5km direct, 11km drive, 15 hop 10ms round trip) university campus mirror in recent years. -- Take care. Thanks, Brian Inglis, Calgary, Alberta, Canada This email may be disturbing to some readers as it contains too much technical detail. Reader discretion is advised. [Data in binary units and prefixes, physical quantities in SI.]
Re: perl 5.32
On 1/10/2021 7:42 AM, Achim Gratz wrote: Achim Gratz writes: The Perl 5.32 test repository is now up at: root=http://cygwin.stromeko.net/ $root/perl-5.32 Additionally the perl-5.32-RC1 is now available in this repo as a test package (perl-5.32.1-0.1). The distributions are all unchanged. I installed it on my test installation and rebuilt biber. No problems. Ken
Re: python update status
On 11.01.2021 16:04, Doug Henderson via Cygwin-apps wrote: On Sun, 10 Jan 2021 at 21:13, Marco Atzeri via wrote: Hi All, I am working on the next round of python pakages update. My highest priority update for Cygwin Python is for Python 3.9, followed by a test version of Python 3.10 when the RC release appears. I am writing all my code for Python 3.9 so without a Cygwin Python 3.9, I have lost the ability to test my apps with Cygwin. I write a lot of console apps, some Flask sites and a few Tkinter apps. Hi Doug, 3.9 can be added I have the Python 3.10 alpha release installed on Win10 to check for breaking changes. I have PYTHINDEVMODE permanently set in my environment, as the overhead is not noticeable. I have absolutely no desire to run Python 2 code. neither I, but we have a lot of code still around that need to be moved to 3.X https://sourceware.org/pipermail/cygwin-apps/2021-January/040897.html and it is not the only one. Only recently I succeded to build postgresql with Python 3.x but the solution I found is very puzzling https://sourceware.org/pipermail/cygwin/2021-January/247211.html As seems you have more experiance than me with Python, can you look on it ? All the ARCH packages seem affected. I am more or less patching all the ARCH source packages to overcome the problem but it seems to me more a workaround than a real understanding of why __declspec(dllexport) is not working as expected for Python modules. Regards Marco
Re: python update status
On Sun, 10 Jan 2021 at 21:13, Marco Atzeri via Cygwin-apps < cygwin-apps@cygwin.com> wrote: > Hi All, > > I am working on the next round of python pakages update. > > My highest priority update for Cygwin Python is for Python 3.9, followed by a test version of Python 3.10 when the RC release appears. I am writing all my code for Python 3.9 so without a Cygwin Python 3.9, I have lost the ability to test my apps with Cygwin. I write a lot of console apps, some Flask sites and a few Tkinter apps. I have the Python 3.10 alpha release installed on Win10 to check for breaking changes. I have PYTHINDEVMODE permanently set in my environment, as the overhead is not noticeable. I have absolutely no desire to run Python 2 code. I use "python -m pip ..." to install third party extensions, both pure Python and those requiring compilation. When this fails, I notify the maintainer or offer a fix to help improve the package's portability. I don't find the Cygwin packages built from pure Python packages to be of much value, unless they track the latest upstream updates very closely. As a result, I find that I end up with a lot of incomplete Cygwin Python packages where I have updated the package using pip. I'm retired now, but I always asked for local admin or sudo for the 20 odd years when I was a contractor. Doug -- Doug Henderson, Calgary, Alberta, Canada - from gmail.com
