Re: fetch timeout

On Jul 26, 2022, at 11:25, Mark Brethen wrote: > > The mp curl no longer downloads from the target website, wias-berlin.de; web > download still works. The only changes were an Xcode update and reinstalling > commandlinetools and macports for big sur. You'll have to talk to the administrators

Re: fetch timeout

The mp curl no longer downloads from the target website, wias-berlin.de; web download still works. The only changes were an Xcode update and reinstalling commandlinetools and macports for big sur. Mark Brethen mark.bret...@gmail.com > On Jul 22, 2022, at 3:34 PM, Ryan Schmidt wrote: > > On

Re: fetch timeout

On Jul 15, 2022, at 09:55, Chris Jones wrote: > On 15/07/2022 3:49 pm, Mark Brethen wrote: >> -rw-r--r--1 root wheel 346545 Jan 1 2020 cert.pem > > The above could be your problem, as that is very old, 2.5 years or so now. It > actually pre-dates the public release of macOS 11, which

Re: fetch timeout

On Wed, Jul 20, 2022 at 11:48 AM Christopher Jones wrote: > On 20 Jul 2022, at 6:32 pm, Dave Allured - NOAA Affiliate via macports-dev > wrote: > > On Wed, Jul 20, 2022 at 2:30 AM Christopher Jones < > jon...@hep.phy.cam.ac.uk> wrote: > >> On 20 Jul 2022, at 1:13 am, Dave Allured - NOAA

Re: fetch timeout

> On 20 Jul 2022, at 6:32 pm, Dave Allured - NOAA Affiliate via macports-dev > wrote: > > On Wed, Jul 20, 2022 at 2:30 AM Christopher Jones > wrote: >> On 20 Jul 2022, at 1:13 am, Dave Allured - NOAA Affiliate via macports-dev >>

Re: fetch timeout

On 2022-7-21 03:32 , Dave Allured - NOAA Affiliate via macports-dev wrote: On Wed, Jul 20, 2022 at 2:30 AM Christopher Jones mailto:jon...@hep.phy.cam.ac.uk>> wrote: On 20 Jul 2022, at 1:13 am, Dave Allured - NOAA Affiliate via macports-dev mailto:macports-dev@lists.macports.org>>

Re: fetch timeout

On Wed, Jul 20, 2022 at 2:30 AM Christopher Jones wrote: > On 20 Jul 2022, at 1:13 am, Dave Allured - NOAA Affiliate via macports-dev > wrote: > > Hmmm. If port curl is already installed and active, then why would > subsequent port fetches prefer /usr/bin/curl? Is this a search path issue? >

Re: fetch timeout

> On 20 Jul 2022, at 1:13 am, Dave Allured - NOAA Affiliate via macports-dev > wrote: > > Hmmm. If port curl is already installed and active, then why would > subsequent port fetches prefer /usr/bin/curl? Is this a search path issue? No. port does not rely on finding ‘curl’, from PATH. It

Re: fetch timeout

On 2022-7-20 10:25 , Mark Brethen wrote: port is setup to use apple’s curl/openssl. Important clarification: it uses *libcurl*, not the curl executable. - Josh

Re: fetch timeout

Dave Allured - NOAA Affiliate via macports-dev wrote: > Several of us have now reproduced the SSL problem. I see two things in > common: > (1) Older curl/SSL versions bundled into older MacOS versions, such as > Catalina. > (2) The target website, wias-berlin.de. > > I suspect

Re: fetch timeout

Then I think it would help to change base, so that Apple’s curl/openssl is only used initially. If and when the curl port becomes installed and active, use that for subsequent port installs. This is similar to the way that other support tools are already managed inside Macports. This is a

Re: fetch timeout

port is setup to use apple’s curl/openssl. Mark Brethen mark.bret...@gmail.com > On Jul 19, 2022, at 7:13 PM, Dave Allured - NOAA Affiliate via macports-dev > wrote: > > Hmmm. If port curl is already installed and active, then why would > subsequent port fetches prefer /usr/bin/curl? Is

Re: fetch timeout

Hmmm. If port curl is already installed and active, then why would subsequent port fetches prefer /usr/bin/curl? Is this a search path issue? On Tue, Jul 19, 2022 at 6:00 PM Mark Brethen wrote: > tetgen has dependency on cmake which depends on curl. If it's possible to > check the machine

Re: fetch timeout

tetgen has dependency on cmake which depends on curl. If it's possible to check the machine and os version, could override fetch under those specific cases. I’ll also contact the host, but I suspect it’s a bug in openssl: routines:CONNECT_CR_KEY_EXCH:sslv3 alert handshake

Re: fetch timeout

Several of us have now reproduced the SSL problem. I see two things in common: (1) Older curl/SSL versions bundled into older MacOS versions, such as Catalina. (2) The target website, wias-berlin.de. I suspect wias-berlin.de is misconfigured somehow. Mark, consider showing this problem to

Re: fetch timeout

Big Sur installs the same version curl/openssl and it does not work on intel. It does work on an M1, which is surprising. ~ $ /usr/bin/curl --version curl 7.64.1 (x86_64-apple-darwin20.0) libcurl/7.64.1 (SecureTransport) LibreSSL/2.8.3 zlib/1.2.11 nghttp2/1.41.0 Release-Date: 2019-03-27

Re: fetch timeout

Here is another one. Catalina 10.15.7. Macports curl works normally. System curl does not. I am not sure whether my laptop has the latest versions of stuff. It is remotely managed by corporate. Was "security updated" within last two months, I think. mac839:~/temp/curl/berlin/2.usr 25> \ ?

Re: fetch timeout

Apparently not. > Last login: Tue Jul 19 12:56:44 on console > palter@Catalina ~ % /usr/bin/curl --version > curl 7.64.1 (x86_64-apple-darwin19.0) libcurl/7.64.1 (SecureTransport) > LibreSSL/2.8.3 zlib/1.2.11 nghttp2/1.39.2 > Release-Date: 2019-03-27 > Protocols: dict file ftp ftps gopher http

Re: fetch timeout

Anyone else confirm system curl works with this host on intel mac with catalina or big sur? Mark > On Jul 19, 2022, at 11:49 AM, Mark Brethen wrote: > > Yes, I have mp curl as well. Unfortunately, port uses Apple’s curl/openssl. > Only work around is to override fetch and use mp. > > Mark

Re: fetch timeout

Yes, I have mp curl as well. Unfortunately, port uses Apple’s curl/openssl. Only work around is to override fetch and use mp. Mark Brethen mark.bret...@gmail.com > On Jul 19, 2022, at 11:42 AM, Nils Breunese wrote: > > Mark Brethen wrote: > >> What version of curl/libressl? > > > I have

Re: fetch timeout

I tried it on my spouse’s intel MacBook— confirmed it works on MacOS version 10.13.6 (LibreSSL 2.2.7). And yes, I extracted the file this time! Mark Brethen mark.bret...@gmail.com > On Jul 19, 2022, at 11:34 AM, Mark Brethen wrote: > > What version of curl/libressl? > > Mark Brethen >

Re: fetch timeout

Mark Brethen wrote: > What version of curl/libressl? I have curl and openssl installed from MacPorts: ❯ port installed | egrep 'curl|openssl' curl @7.84.0_0+http2+ssl (active) curl-ca-bundle @7.84.0_0 (active) openssl @3_6 (active) openssl3 @3.0.5_0+legacy (active) openssl11

Re: fetch timeout

What version of curl/libressl? Mark Brethen mark.bret...@gmail.com > On Jul 19, 2022, at 11:31 AM, Nils Breunese wrote: > > Mark Brethen wrote: > >> it has the file name and extensions but you’re right, it’s not a compressed >> file. > > The -O flag will write whatever body gets returned

Re: fetch timeout

Mark Brethen wrote: > it has the file name and extensions but you’re right, it’s not a compressed > file. The -O flag will write whatever body gets returned by the server into a file with the same name as the 'file name’ part of the URL, regardless of whether the HTTP status code of the

Re: fetch timeout

it has the file name and extensions but you’re right, it’s not a compressed file. I tried two different intel-based Macs with clean installs of Catalina and Big Sur (both use LibreSSL 2.8.3 btw) and was able to repeat that error. However, it works correctly on an M1 installed with Big Sur.

Re: fetch timeout

It doesn’t look like the .tar.gz file downloaded successfully, it looks like the HTML for the 301 redirect was downloaded. Nils. > Op 19 jul. 2022 om 17:20 heeft Mark Brethen het > volgende geschreven: > > Understood. Using HTTP instead of HTTPS doesn’t invoke SSL/TLS. If you look > at the

Re: fetch timeout

Understood. Using HTTP instead of HTTPS doesn’t invoke SSL/TLS. If you look at the command line output (not port), that error didn’t occur and the file downloaded successfully. I was curious what the fetch curl command looked like vs the command line? Sent from my iPhone > On Jul 19, 2022, at

Re: fetch timeout

This depends on your definition of succeeding. The request to the HTTP URL returns a 301 redirect, which is not necessarily a ‘success’ status code. This response points to the HTTPS URL and the TLS/SSL error only occurs when requesting that URL. Nils. > Op 19 jul. 2022 om 11:58 heeft Mark

Re: fetch timeout

Please tell me why fetch still fails when /usr/bin/curl succeeds in terminal? :notice:fetch ---> Attempting to fetch tetgen1.5.1.tar.gz from http://wias-berlin.de/software/tetgen/1.5/src/ :debug:fetch Fetching distfile failed: error:14008410:SSL routines:CONNECT_CR_KEY_EXCH:sslv3 alert

Re: fetch timeout

HTTPS uses TLS (SSL) to encrypt normal HTTP requests and responses. Use HTTP instead: ~ $ cd Downloads Downloads $ /usr/bin/curl -vO http://wias-berlin.de/software/tetgen/1.5/src/tetgen1.5.1.tar.gz % Total% Received % Xferd Average Speed TimeTime Time Current

Re: fetch timeout

It’s more likely that curl 7.64.1 succeeds to connect while openssl 2.8.3 fails with alert number 40 (see below). It might be related to the server which has several virtual hosts. openssl 3.0.5 (mp) seems to handle it fine compared to openssl 2.8.3. Downloads $ openssl version OpenSSL 3.0.5 5

Re: fetch timeout

There is something fundementally different between the OS 11 install on the intel MacBook vs the M1 iMac. I even wiped clean the MacBook and reinstalled OS 11 and created a new admin account — no third party software installed. Apple's curl failed as before. I compared Macport’s curl/openssl

Re: fetch timeout

> On 17 Jul 2022, at 7:12 pm, Mark Brethen wrote: > > It’s interesting that curl fails from my older MacBook Air, but passes on the > M1 iMac, both with OS 11 installed. Even after a clean reinstall. I suspect > it’s something about Apple’s openssl. Browsers don’t seem to mind the >

Re: fetch timeout

It’s interesting that curl fails from my older MacBook Air, but passes on the M1 iMac, both with OS 11 installed. Even after a clean reinstall. I suspect it’s something about Apple’s openssl. Browsers don’t seem to mind the certificate. As a work around, I’d like to add something like this:

Re: fetch timeout

I think I’m getting to the root of the problem. I tried to obtain the SSL certificate from the host server using openssl. Downloads $ echo | openssl s_client -servername wias-berlin.de -connect wias-berlin.de:443 |\ sed -ne

Re: fetch timeout

The system curl should be ignoring everything under /opt/local so i doubt that is it. Beats me to, but at least you have two systems now to compare… > On 15 Jul 2022, at 7:45 pm, Mark Brethen wrote: > > Maybe it’s openssl in /opt/local/bin? On the MacBook Air: > > ports $ which openssl >

Re: fetch timeout

Maybe it’s openssl in /opt/local/bin? On the MacBook Air: ports $ which openssl /opt/local/bin/openssl ports $ openssl version OpenSSL 3.0.5 5 Jul 2022 (Library: OpenSSL 3.0.5 5 Jul 2022) The iMac has /opt/local/bin/openssl 1.1.1 /usr/bin/openssl is libressl 2.8.3 for both. Mark Brethen

Re: fetch timeout

Heck if I know what’s wrong. Everything being equal, curl on the iMac works, but on the MacBook Air it does not. Both have the same OS, same curl version at /usr/bin, same cert.pem. Mark Brethen mark.bret...@gmail.com > On Jul 15, 2022, at 11:42 AM, Mark Brethen wrote: > > On the MacBook

Re: fetch timeout

On the MacBook Air openssl is able to get the certificate Downloads $ openssl s_client -connect wias-berlin.de:443 CONNECTED(0005) depth=3 C = DE, O = T-Systems Enterprise Services GmbH, OU = T-Systems Trust Center, CN = T-TeleSec GlobalRoot Class 2 verify return:1 depth=2 C = DE, O = Verein

Re: fetch timeout

On the Imac (OS 11.6.7): -rw-r--r-- 1 root wheel 346545 Jan 1 2020 cert.pem ~ $ /usr/bin/curl --version curl 7.64.1 (x86_64-apple-darwin20.0) libcurl/7.64.1 (SecureTransport) LibreSSL/2.8.3 zlib/1.2.11 nghttp2/1.41.0 Release-Date: 2019-03-27 Protocols: dict file ftp ftps gopher http https

Re: fetch timeout

On 15/07/2022 4:16 pm, Mark Brethen wrote: cert.perm has the same date very surprised ... and. does the curl fetch also fail ? Mark Brethen mark.bret...@gmail.com On Jul 15, 2022, at 10:11 AM, Chris Jones wrote: On 15/07/2022 4:08 pm, Mark Brethen wrote: I checked big sur

Re: fetch timeout

cert.perm has the same date Mark Brethen mark.bret...@gmail.com > On Jul 15, 2022, at 10:11 AM, Chris Jones wrote: > > > > On 15/07/2022 4:08 pm, Mark Brethen wrote: >> I checked big sur on my iMac, which came installed with big sur. It also has >> version 7.64.1. > > how old is the

Re: fetch timeout

On 15/07/2022 4:08 pm, Mark Brethen wrote: I checked big sur on my iMac, which came installed with big sur. It also has version 7.64.1. I’m surprised macports is using the native curl. Apple is notorious for not updating to the latest versions of software with each new OS.

Re: fetch timeout

On 15/07/2022 4:08 pm, Mark Brethen wrote: I checked big sur on my iMac, which came installed with big sur. It also has version 7.64.1. how old is the cert.pem file though ? Does the fetch using /usr/bin/curl work there or not ? I’m surprised macports is using the native curl. Apple is

Re: fetch timeout

I checked big sur on my iMac, which came installed with big sur. It also has version 7.64.1. I’m surprised macports is using the native curl. Apple is notorious for not updating to the latest versions of software with each new OS. Mark Brethen mark.bret...@gmail.com > On Jul 15, 2022, at

Re: fetch timeout

On 15/07/2022 3:49 pm, Mark Brethen wrote: -rw-r--r--    1 root  wheel  346545 Jan  1  2020 cert.pem The above could be your problem, as that is very old, 2.5 years or so now. It actually pre-dates the public release of macOS 11, which wasn't until November that year, which makes it quite

Re: fetch timeout

-rw-r--r--1 root wheel 346545 Jan 1 2020 cert.pem ~ $ /usr/bin/curl --version curl 7.64.1 (x86_64-apple-darwin20.0) libcurl/7.64.1 (SecureTransport) LibreSSL/2.8.3 zlib/1.2.11 nghttp2/1.41.0 Release-Date: 2019-03-27 Protocols: dict file ftp ftps gopher http https imap imaps ldap ldaps

Re: fetch timeout

What about the system certificate trust policy? I don’t know what the default setting is. Mark Brethen mark.bret...@gmail.com > On Jul 15, 2022, at 9:30 AM, Mark Brethen wrote: > > I was trying to say that I skipped versions and upgraded from high sierra to > big sur. As to the version,

Re: fetch timeout

On 15/07/2022 3:30 pm, Mark Brethen wrote: I was trying to say that I skipped versions and upgraded from high sierra to big sur. Ah ha. So I read something completely different from "Other than updating the system from High Sierra, nothing else"... Indeed it looks like you are on macOS

Re: fetch timeout

I was trying to say that I skipped versions and upgraded from high sierra to big sur. As to the version, is it 10.16 or 11? System profiler says this: System Software Overview: System Version: macOS 11.6.7 (20G630) Kernel Version: Darwin 20.6.0 Boot Volume: Macintosh HD

Re: fetch timeout

On 15/07/2022 3:20 pm, Mark Brethen wrote: I have big sur installed (In the ‘About This Mac’ it lists ‘Version11.6.7') Sorry but you are being damn confusing. Why did you then mention 'High Sierra' as your OS below If you truly do have macOS11 installed, fully up to date, then I am

Re: fetch timeout

I have big sur installed (In the ‘About This Mac’ it lists ‘Version11.6.7') Mark Brethen mark.bret...@gmail.com > On Jul 15, 2022, at 9:14 AM, Chris Jones wrote: > > > > On 15/07/2022 3:08 pm, Mark Brethen wrote: >> ~ $ /usr/bin/curl -L -v -o tetgen1.5.1.tar.gz >>

Re: fetch timeout

On 15/07/2022 3:08 pm, Mark Brethen wrote: ~ $ /usr/bin/curl -L -v -o tetgen1.5.1.tar.gz https://wias-berlin.de/software/tetgen/1.5/src/tetgen1.5.1.tar.gz   % Total    % Received % Xferd  Average Speed   Time    Time    

Re: fetch timeout

~ $ /usr/bin/curl -L -v -o tetgen1.5.1.tar.gz https://wias-berlin.de/software/tetgen/1.5/src/tetgen1.5.1.tar.gz % Total% Received % Xferd Average Speed TimeTime Time Current Dload Upload Total SpentLeft Speed 0 00 00

Re: fetch timeout

On 15/07/2022 2:53 pm, Mark Brethen wrote: Indeed, I get the same error ~ $ /usr/bin/curl -L -o tetgen1.5.1.tar.gz https://wias-berlin.de/software/tetgen/1.5/src/tetgen1.5.1.tar.gz   % Total    % Received % Xferd  Average

Re: fetch timeout

Indeed, I get the same error ~ $ /usr/bin/curl -L -o tetgen1.5.1.tar.gz https://wias-berlin.de/software/tetgen/1.5/src/tetgen1.5.1.tar.gz % Total% Received % Xferd Average Speed TimeTime Time Current Dload Upload Total SpentLeft Speed

Re: fetch timeout

On 15/07/2022 2:49 pm, Chris Jones wrote: :debug:fetch Fetching distfile failed: error:14008410:SSL routines:CONNECT_CR_KEY_EXCH:sslv3 alert handshake failure that is your problem. Can you reproduce the above by using the system curl (which is effectively) what macports uses

Re: fetch timeout

:debug:fetch Fetching distfile failed: error:14008410:SSL routines:CONNECT_CR_KEY_EXCH:sslv3 alert handshake failure that is your problem. Can you reproduce the above by using the system curl (which is effectively) what macports uses /usr/bin/curl -L -o tetgen1.5.1.tar.gz

Re: fetch timeout

apologies, just saw the attachments.. On 15/07/2022 2:44 pm, Chris Jones wrote: That is not what I asked... You shouldn't have to override the fetch phase. I think you are probably looking in the wrong place for your issue, but without seeing the portfile and the exact error you get no

Re: fetch timeout

That is not what I asked... You shouldn't have to override the fetch phase. I think you are probably looking in the wrong place for your issue, but without seeing the portfile and the exact error you get no one is going to be able to help you that much... On 15/07/2022 2:39 pm, Mark

Re: fetch timeout

Portfile Description: Binary data main.log Description: Binary data Overriding fetch in the portfile does work. Mark Brethen mark.bret...@gmail.com > On Jul 15, 2022, at 8:26 AM, Chris Jones wrote: > > > OK, so next please post the portfile you are testing, and exactly what you > get

Re: fetch timeout

OK, so next please post the portfile you are testing, and exactly what you get from the fetch phase when you run > sudo port -d fetch xyz On 15/07/2022 2:12 pm, Mark Brethen wrote: macOS 11.6.7 Mark Brethen mark.bret...@gmail.com On Jul 15, 2022, at 8:10

Re: fetch timeout

macOS 11.6.7 Mark Brethen mark.bret...@gmail.com > On Jul 15, 2022, at 8:10 AM, Mark Brethen wrote: > > ~ $ which curl > /opt/local/bin/curl > > Mark Brethen > mark.bret...@gmail.com > > > >> On Jul 15, 2022, at 8:09 AM, Chris Jones >

Re: fetch timeout

~ $ which curl /opt/local/bin/curl Mark Brethen mark.bret...@gmail.com > On Jul 15, 2022, at 8:09 AM, Chris Jones wrote: > > > what curl are you using ? System of macports version ? > > What OS are you on ? > > On 15/07/2022 2:01 pm, Mark Brethen wrote: >> Have to follow a redirected

Re: fetch timeout

what curl are you using ? System of macports version ? What OS are you on ? On 15/07/2022 2:01 pm, Mark Brethen wrote: Have to follow a redirected file. This worked in terminal: ~ $ curl -L -o tetgen1.5.1.tar.gz http://www.tetgen.org/1.5/src/tetgen1.5.1.tar.gz

Re: fetch timeout

Have to follow a redirected file. This worked in terminal: ~ $ curl -L -o tetgen1.5.1.tar.gz http://www.tetgen.org/1.5/src/tetgen1.5.1.tar.gz % Total% Received % Xferd Average Speed TimeTime Time Current Dload Upload Total SpentLeft

Re: fetch timeout

The next logical question is what agent do I use? Is there a Macports user agent? Mark Brethen mark.bret...@gmail.com > On Jul 14, 2022, at 8:19 PM, Joshua Root wrote: > > fetch.user_agent

Re: fetch timeout

On 2022-7-15 05:50 , Mark Brethen wrote: Can the timeout be set for fetch? Reason I ask is the download URL works from a browser but not using 'port fetch’. The timeouts are currently hardcoded: If port