Re: [weewx-user] Re: We have finally put the last nail on the coffin for Wunderfixer?

Leon Shaner Wed, 22 May 2019 13:20:55 -0700

I'm still working on this.

CURL is telling me they are not only using https, but also TLSv1.2.

Here is a transcript, in case one of y'all beats me to the fix. =D

--
You received this message because you are subscribed to the Google Groups "weewx-user" group.
To unsubscribe from this group and stop receiving emails from it, send an email to [email protected].
To view this discussion on the web visit https://groups.google.com/d/msgid/weewx-user/DA01E425-B99A-4959-8FB2-B564A61B3E77%40isylum.org.
For more options, visit https://groups.google.com/d/optout.

$ curl -L -v 
"https://www.wunderground.com/weatherstation/WXDailyHistory.asp?ID=SOMESTATION&month=5&day=22&year=2019&format=1";


  % Total    % Received % Xferd  Average Speed   Time    Time     Time  Current
                                 Dload  Upload   Total   Spent    Left  Speed

  0     0    0     0    0     0      0      0 --:--:-- --:--:-- --:--:--     0* 
  Trying 23.7.182.137...
* TCP_NODELAY set
* Connected to www.wunderground.com (23.7.182.137) port 443 (#0)
* ALPN, offering h2
* ALPN, offering http/1.1
* Cipher selection: ALL:!EXPORT:!EXPORT40:!EXPORT56:!aNULL:!LOW:!RC4:@STRENGTH
* successfully set certificate verify locations:
*   CAfile: /etc/ssl/certs/ca-certificates.crt
  CApath: /etc/ssl/certs
* TLSv1.2 (OUT), TLS header, Certificate Status (22):
} [5 bytes data]
* TLSv1.2 (OUT), TLS handshake, Client hello (1):
} [512 bytes data]
* TLSv1.2 (IN), TLS handshake, Server hello (2):
{ [102 bytes data]
* TLSv1.2 (IN), TLS handshake, Certificate (11):
{ [2527 bytes data]
* TLSv1.2 (IN), TLS handshake, Server key exchange (12):
{ [148 bytes data]
* TLSv1.2 (IN), TLS handshake, Server finished (14):
{ [4 bytes data]
* TLSv1.2 (OUT), TLS handshake, Client key exchange (16):
} [70 bytes data]
* TLSv1.2 (OUT), TLS change cipher, Client hello (1):
} [1 bytes data]
* TLSv1.2 (OUT), TLS handshake, Finished (20):
} [16 bytes data]

  0     0    0     0    0     0      0      0 --:--:-- --:--:-- --:--:--     0* 
TLSv1.2 (IN), TLS change cipher, Client hello (1):
{ [1 bytes data]
* TLSv1.2 (IN), TLS handshake, Finished (20):
{ [16 bytes data]
* SSL connection using TLSv1.2 / ECDHE-ECDSA-AES256-GCM-SHA384
* ALPN, server accepted to use h2
* Server certificate:
*  subject: C=US; ST=Georgia; L=Atlanta; O=TWC Product and Technology, LLC; 
OU=Digital; CN=www.weather.com
*  start date: Sep 25 00:00:00 2018 GMT
*  expire date: Nov 24 12:00:00 2019 GMT
*  subjectAltName: host "www.wunderground.com" matched cert's 
"*.wunderground.com"
*  issuer: C=US; O=DigiCert Inc; CN=DigiCert ECC Secure Server CA
*  SSL certificate verify ok.
* Using HTTP2, server supports multi-use
* Connection state changed (HTTP/2 confirmed)
* Copying HTTP/2 data in stream buffer to connection buffer after upgrade: len=0
} [5 bytes data]
* Using Stream ID: 1 (easy handle 0x6cea8)
} [5 bytes data]
> GET 
> /weatherstation/WXDailyHistory.asp?ID=SOMESTATION&month=5&day=22&year=2019&format=1
>  HTTP/1.1
> Host: www.wunderground.com
> User-Agent: curl/7.52.1
> Accept: */*
> 
{ [5 bytes data]
* Connection state changed (MAX_CONCURRENT_STREAMS updated)!
} [5 bytes data]

  0     0    0     0    0     0      0      0 --:--:--  0:00:02 --:--:--     0
  0     0    0     0    0     0      0      0 --:--:--  0:00:03 --:--:--     0
  0     0    0     0    0     0      0      0 --:--:--  0:00:04 --:--:--     0
  0     0    0     0    0     0      0      0 --:--:--  0:00:05 --:--:--     0< 
HTTP/2 200 
< server: Apache/2.2.15 (CentOS)
< pragma: no-cache
< access-control-allow-origin: http://www.wunderground.com
< access-control-allow-credentials: true
< x-creationtime: 4.786
< content-type: text/html; charset=UTF-8
< cache-control: private, no-cache, must-revalidate
< expires: Wed, 22 May 2019 19:35:18 GMT
< date: Wed, 22 May 2019 19:35:18 GMT
< content-length: 19032
< set-cookie: DT=1558553713:13369:ip-10-226-235-63; path=/; expires=Fri, 
01-Jan-2020 00:00:00 GMT; domain=.wunderground.com
< set-cookie: 
Prefs=FAVS:1|WXSN:1|PWSOBS:1|WPHO:1|PHOT:1|RADC:0|RADALL:0|HIST0:NULL|GIFT:1|PHOTOTHUMBS:50|;
 path=/; expires=Fri, 01-Jan-2020 00:00:00 GMT; domain=.wunderground.com
< set-cookie: speedpin=4G; expires=Wed, 22-May-2019 20:05:18 GMT; path=/; 
domain=.wunderground.com; secure
< set-cookie: 
ci=TWC-Connection-Speed=4G&TWC-Locale-Group=US&TWC-Device-Class=desktop&X-Origin-Hint=dna&TWC-Network-Type=wifi&TWC-GeoIP-Country=US&TWC-GeoIP-Lat=42.3055&TWC-GeoIP-Long=-83.1724&Akamai-Connection-Speed=1000+&TWC-Privacy=exempt;
 path=/; domain=.wunderground.com; secure
< property-id: drupal-prod
< x-requestsource: AkamaiProdProxy
< twc-privacy: exempt
< twc-geoip-latlong: 42.3055,-83.1724
< twc-geoip-country: US
< twc-device-class: desktop
< twc-locale-group: US
< twc-connection-speed: 4G
< x-requestsource: AkamaiDefaultDNA
< 
{ [105 bytes data]

Time,TemperatureF,DewpointF,PressureIn,WindDirection,WindDirectionDegrees,WindSpeedMPH,WindSpeedGustMPH,Humidity,HourlyPrecipIn,Conditions,Clouds,dailyrainin,SoftwareType,DateUTC<br>
2019-05-22 
00:04:59,54,42.5,29.41,ENE,61,2.5,5.1,65,0,,,0,weewx-4.0.0a4,2019-05-22 
04:04:59,
<br>
2019-05-22 
00:09:59,54,42.5,29.41,ENE,61,2.5,6.3,65,0,,,0,weewx-4.0.0a4,2019-05-22 
04:09:59,
<br>
2019-05-22 
00:15:00,53.8,42.3,29.41,East,80,2.5,2.9,65,0,,,0,weewx-4.0.0a4,2019-05-22 
04:15:00,
<br>
2019-05-22 
00:19:59,53.8,42.7,29.40,East,80,2.5,2.5,66,0,,,0,weewx-4.0.0a4,2019-05-22 
04:19:59,
<br>
2019-05-22 
00:25:00,53.6,42.5,29.40,ENE,72,2.9,5.4,66,0,,,0,weewx-4.0.0a4,2019-05-22 
04:25:00,
<br>
2019-05-22 
00:29:59,53.4,42.3,29.40,ENE,72,2.9,0,66,0,,,0,weewx-4.0.0a4,2019-05-22 
04:29:59,
<br>
2019-05-22 
00:34:59,53.4,42.7,29.40,ENE,78,2.9,3.1,67,0,,,0,weewx-4.0.0a4,2019-05-22 
04:34:59,
<br>
2019-05-22 
00:39:59,53.4,42.7,29.40,ENE,78,2.9,0,67,0,,,0,weewx-4.0.0a4,2019-05-22 
04:39:59,
<br>
2019-05-22 
00:45:00,53.4,42.7,29.40,ENE,75,2,2.5,67,0,,,0,weewx-4.0.0a4,2019-05-22 
04:45:00,
<br>
2019-05-22 
00:50:00,53.2,42.6,29.41,ENE,75,2,3.1,67,0,,,0,weewx-4.0.0a4,2019-05-22 
04:50:00,
<br>
2019-05-22 
00:54:59,53.2,43,29.41,East,79,1.8,2.5,68,0,,,0,weewx-4.0.0a4,2019-05-22 
04:54:59,
<br>
2019-05-22 
00:59:59,53.2,43,29.41,East,79,1.8,2.5,68,0,,,0,weewx-4.0.0a4,2019-05-22 
04:59:59,
<br>
2019-05-22 
01:04:59,53.2,43.3,29.39,ENE,69,2.5,1.8,69,0,,,0,weewx-4.0.0a4,2019-05-22 
05:04:59,
<br>
2019-05-22 
01:10:00,53.1,43.2,29.39,ENE,69,2.5,1.8,69,0,,,0,weewx-4.0.0a4,2019-05-22 
05:10:00,
<br>
2019-05-22 
01:15:00,53.1,43.5,29.39,ENE,74,1.8,0,70,0,,,0,weewx-4.0.0a4,2019-05-22 
05:15:00,
<br>
2019-05-22 
01:20:00,53.1,43.5,29.39,ENE,74,1.8,0,70,0,,,0,weewx-4.0.0a4,2019-05-22 
05:20:00,
<br>
2019-05-22 
01:24:59,52.9,43.7,29.39,East,79,1.3,2,71,0,,,0,weewx-4.0.0a4,2019-05-22 
05:24:59,
<br>
2019-05-22 
01:29:59,52.9,43.7,29.39,East,79,1.3,2.9,71,0,,,0,weewx-4.0.0a4,2019-05-22 
05:29:59,
<br>
2019-05-22 
01:34:59,52.9,44.1,29.38,ENE,71,1.8,2.5,72,0,,,0,weewx-4.0.0a4,2019-05-22 
05:34:59,
<br>
2019-05-22 
01:40:00,52.9,44.1,29.38,ENE,71,1.8,2,72,0,,,0,weewx-4.0.0a4,2019-05-22 
05:40:00,
<br>
2019-05-22 
01:45:00,52.9,44.5,29.38,ENE,66,1.3,0,73,0,,,0,weewx-4.0.0a4,2019-05-22 
05:45:00,
<br>
2019-05-22 
01:50:00,52.7,44.3,29.37,ENE,66,1.3,4,73,0,,,0,weewx-4.0.0a4,2019-05-22 
05:50:00,
<br>
2019-05-22 
01:55:00,52.7,44.6,29.37,ENE,60,1.8,3.1,74,0,,,0,weewx-4.0.0a4,2019-05-22 
05:55:00,
<br>
2019-05-22 
01:59:59,52.7,44.6,29.37,ENE,60,1.8,2,74,0,,,0,weewx-4.0.0a4,2019-05-22 
05:59:59,
<br>
2019-05-22 
02:05:00,52.7,45,29.36,ENE,61,2,3.1,75,0,,,0,weewx-4.0.0a4,2019-05-22 06:05:00,
<br>
2019-05-22 
02:10:00,52.5,44.8,29.36,ENE,61,2,0,75,0,,,0,weewx-4.0.0a4,2019-05-22 06:10:00,
<br>
2019-05-22 
02:15:00,52.7,45.3,29.36,ENE,67,2,0,76,0,,,0,weewx-4.0.0a4,2019-05-22 06:15:00,
<br>
2019-05-22 
02:20:00,52.7,45.3,29.36,ENE,67,2,2,76,0,,,0,weewx-4.0.0a4,2019-05-22 06:20:00,
<br>
2019-05-22 
02:25:00,52.7,45.3,29.36,NE,56,1.3,0,76,0,,,0,weewx-4.0.0a4,2019-05-22 06:25:00,
<br>
2019-05-22 
02:30:00,52.7,45.7,29.36,NE,56,1.3,1.8,77,0,,,0,weewx-4.0.0a4,2019-05-22 
06:30:00,
<br>
2019-05-22 
02:34:59,52.9,45.9,29.36,ENE,63,1.8,2,77,0,,,0,weewx-4.0.0a4,2019-05-22 
06:34:59,
<br>
2019-05-22 
02:39:59,52.9,46.2,29.36,ENE,63,1.8,2,78,0,,,0,weewx-4.0.0a4,2019-05-22 
06:39:59,
<br>
2019-05-22 
02:44:59,52.9,46.2,29.36,ENE,63,1.8,2,78,0,,,0,weewx-4.0.0a4,2019-05-22 
06:44:59,
<br>
2019-05-22 
02:50:00,53.1,46.4,29.35,ENE,63,1.8,1.3,78,0,,,0,weewx-4.0.0a4,2019-05-22 
06:50:00,
<br>
2019-05-22 
02:54:59,53.1,46.4,29.35,ENE,68,2.5,3.1,78,0,,,0,weewx-4.0.0a4,2019-05-22 
06:54:59,
<br>
2019-05-22 
03:00:00,53.2,46.6,29.35,ENE,68,2.5,4,78,0,,,0,weewx-4.0.0a4,2019-05-22 
07:00:00,
<br>
2019-05-22 
03:05:00,53.2,46.6,29.35,ENE,70,2.5,2.9,78,0,,,0,weewx-4.0.0a4,2019-05-22 
07:05:00,
<br>
2019-05-22 
03:09:59,53.4,47.1,29.35,ENE,70,2.5,1.3,79,0,,,0,weewx-4.0.0a4,2019-05-22 
07:09:59,
<br>
2019-05-22 
03:14:59,53.4,47.1,29.35,East,79,2,2,79,0,,,0,weewx-4.0.0a4,2019-05-22 07:14:59,
<br>
2019-05-22 
03:20:00,53.6,47.2,29.35,East,79,2,0,79,0,,,0,weewx-4.0.0a4,2019-05-22 07:20:00,
<br>
2019-05-22 
03:24:59,53.8,47.4,29.35,East,83,1.8,2.5,79,0,,,0,weewx-4.0.0a4,2019-05-22 
07:24:59,
<br>
2019-05-22 
03:29:59,54,47.6,29.35,East,83,1.8,2,79,0,,,0,weewx-4.0.0a4,2019-05-22 07:29:59,
<br>
2019-05-22 
03:34:59,54,47.3,29.36,East,99,1.8,4.7,78,0,,,0,weewx-4.0.0a4,2019-05-22 
07:34:59,
<br>
2019-05-22 
03:39:59,54.1,47.1,29.36,East,99,1.8,5.1,77,0,,,0,weewx-4.0.0a4,2019-05-22 
07:39:59,
<br>
2019-05-22 
03:44:59,54.1,47.1,29.36,ESE,103,1.3,0,77,0,,,0,weewx-4.0.0a4,2019-05-22 
07:44:59,
<br>
2019-05-22 
03:50:00,54.3,46.6,29.36,ESE,103,1.3,4,75,0,,,0,weewx-4.0.0a4,2019-05-22 
07:50:00,
<br>
2019-05-22 
03:54:59,54.5,46,29.36,ESE,107,1.8,0,73,0,,,0,weewx-4.0.0a4,2019-05-22 07:54:59,
<br>
2019-05-22 
04:00:00,54.7,45.5,29.36,ESE,107,1.8,8.5,71,0,,,0,weewx-4.0.0a4,2019-05-22 
08:00:00,
<br>
2019-05-22 
04:04:59,54.9,45.3,29.36,ESE,109,2.5,4,70,0,,,0,weewx-4.0.0a4,2019-05-22 
08:04:59,
<br>
2019-05-22 
04:10:00,55,45.1,29.36,ESE,109,2.5,2.5,69,0,,,0,weewx-4.0.0a4,2019-05-22 
08:10:00,
<br>
2019-05-22 
04:14:59,55.2,44.8,29.36,ESE,106,3.1,0,68,0,,,0,weewx-4.0.0a4,2019-05-22 
08:14:59,
<br>
2019-05-22 
04:19:59,55.4,44.2,29.36,ESE,106,3.1,5.1,66,0,,,0,weewx-4.0.0a4,2019-05-22 
08:19:59,
<br>
2019-05-22 
04:24:59,55.6,44.4,29.36,ESE,103,2.5,2.9,66,0,,,0,weewx-4.0.0a4,2019-05-22 
08:24:59,
<br>
2019-05-22 
04:29:59,55.8,44.6,29.36,ESE,103,2.5,2.9,66,0,,,0,weewx-4.0.0a4,2019-05-22 
08:29:59,
<br>
2019-05-22 
04:34:59,55.8,44.2,29.35,ESE,105,3.1,4.3,65,0,,,0,weewx-4.0.0a4,2019-05-22 
08:34:59,
<br>
2019-05-22 
04:39:59,55.8,43.8,29.35,ESE,105,3.1,2,64,0,,,0,weewx-4.0.0a4,2019-05-22 
08:39:59,
<br>
2019-05-22 
04:44:59,55.9,43.9,29.35,East,97,4,4,64,0,,,0,weewx-4.0.0a4,2019-05-22 08:44:59,
<br>
2019-05-22 
04:49:59,56.1,44.1,29.35,East,97,4,4.3,64,0,,,0,weewx-4.0.0a4,2019-05-22 
08:49:59,
<br>
2019-05-22 
04:54:59,56.1,44.5,29.35,East,93,5.1,0,65,0,,,0,weewx-4.0.0a4,2019-05-22 
08:54:59,
<br>
2019-05-22 
05:00:00,56.1,44.1,29.35,East,93,5.1,3.6,64,0,,,0,weewx-4.0.0a4,2019-05-22 
09:00:00,
<br>
2019-05-22 
05:05:00,56.1,43.7,29.36,East,96,2.5,2.9,63,0,,,0,weewx-4.0.0a4,2019-05-22 
09:05:00,
<br>
2019-05-22 
05:09:59,56.1,43.7,29.36,East,96,2.5,3.6,63,0,,,0,weewx-4.0.0a4,2019-05-22 
09:09:59,
<br>
2019-05-22 
05:14:59,56.1,43.3,29.36,ESE,109,3.6,4.3,62,0,,,0,weewx-4.0.0a4,2019-05-22 
09:14:59,
<br>
2019-05-22 
05:19:59,56.3,43.4,29.35,ESE,109,3.6,3.6,62,0,,,0,weewx-4.0.0a4,2019-05-22 
09:19:59,
<br>
2019-05-22 
05:24:59,56.1,43.3,29.35,East,99,4,4,62,0,,,0,weewx-4.0.0a4,2019-05-22 09:24:59,
<br>
2019-05-22 
05:30:00,56.1,43.3,29.35,East,99,4,4,62,0,,,0,weewx-4.0.0a4,2019-05-22 09:30:00,
<br>
2019-05-22 
05:34:59,56.3,43.4,29.34,East,99,4.7,4.3,62,0,,,0,weewx-4.0.0a4,2019-05-22 
09:34:59,
<br>
2019-05-22 
05:39:59,56.3,43.4,29.34,East,99,4.7,2.5,62,0,,,0,weewx-4.0.0a4,2019-05-22 
09:39:59,
<br>
2019-05-22 
05:45:00,56.3,43.4,29.34,ESE,103,4,4.3,62,0,,,0,weewx-4.0.0a4,2019-05-22 
09:45:00,
<br>
2019-05-22 
05:50:00,56.3,43,29.31,ESE,103,4,5.1,61,0,,,0,weewx-4.0.0a4,2019-05-22 09:50:00,
<br>
2019-05-22 
05:54:59,56.3,43,29.31,East,100,4,4,61,0,,,0,weewx-4.0.0a4,2019-05-22 09:54:59,
<br>
2019-05-22 
05:59:59,56.3,43,29.31,East,100,4,2.5,61,0,,,0,weewx-4.0.0a4,2019-05-22 
09:59:59,
<br>
2019-05-22 
06:05:00,56.3,43.4,29.32,East,94,4.3,1.8,62,0,,,0,weewx-4.0.0a4,2019-05-22 
10:05:00,
<br>
2019-05-22 
06:10:00,56.3,43.4,29.32,East,94,4.3,2.5,62,0,,,0,weewx-4.0.0a4,2019-05-22 
10:10:00,
<br>
2019-05-22 
06:14:59,56.3,43.4,29.32,East,94,4.3,4.7,62,0,,,0,weewx-4.0.0a4,2019-05-22 
10:14:59,
<br>
2019-05-22 
06:20:00,56.1,43.3,29.33,East,94,4.3,4.3,62,0,,,0,weewx-4.0.0a4,2019-05-22 
10:20:00,
<br>
2019-05-22 
06:25:00,56.1,43.7,29.33,East,90,4,6.3,63,0,,,0,weewx-4.0.0a4,2019-05-22 
10:25:00,
<br>
2019-05-22 
06:29:59,56.1,43.7,29.33,East,90,4,4.3,63,0,,,0,weewx-4.0.0a4,2019-05-22 
10:29:59,
<br>
2019-05-22 
06:34:59,55.9,43.5,29.33,East,90,3.6,3.1,63,0,,,0,weewx-4.0.0a4,2019-05-22 
10:34:59,
<br>
2019-05-22 
06:39:59,55.9,43.5,29.33,East,90,3.6,2,63,0,,,0,weewx-4.0.0a4,2019-05-22 
10:39:59,
<br>
2019-05-22 
06:45:00,55.9,43.5,29.33,East,90,4,3.1,63,0,,,0,weewx-4.0.0a4,2019-05-22 
10:45:00,
<br>
2019-05-22 
06:50:00,55.9,43.9,29.33,East,90,4,5.1,64,0,,,0,weewx-4.0.0a4,2019-05-22 
10:50:00,
<br>
2019-05-22 
06:54:59,55.9,43.9,29.33,East,92,3.1,1.8,64,0,,,0,weewx-4.0.0a4,2019-05-22 
10:54:59,
<br>
2019-05-22 
06:59:59,55.9,43.5,29.33,East,92,3.1,2.9,63,0,,,0,weewx-4.0.0a4,2019-05-22 
10:59:59,
<br>
2019-05-22 
07:04:59,55.9,43.9,29.36,ESE,110,2.5,4,64,0,,,0,weewx-4.0.0a4,2019-05-22 
11:04:59,
<br>
2019-05-22 
07:09:59,55.9,43.9,29.36,ESE,110,2.5,2.9,64,0,,,0,weewx-4.0.0a4,2019-05-22 
11:09:59,
<br>
2019-05-22 
07:14:59,55.9,43.5,29.36,ESE,115,2,2,63,0,,,0,weewx-4.0.0a4,2019-05-22 11:14:59,
<br>
2019-05-22 
07:19:59,55.9,43.9,29.34,ESE,115,2,5.4,64,0,,,0,weewx-4.0.0a4,2019-05-22 
11:19:59,
<br>
2019-05-22 
07:25:00,55.9,44.3,29.34,East,99,3.1,4.7,65,0,,,0,weewx-4.0.0a4,2019-05-22 
11:25:00,
<br>
2019-05-22 
07:29:59,55.9,44.3,29.34,East,99,3.1,2.5,65,0,,,0,weewx-4.0.0a4,2019-05-22 
11:29:59,
<br>
2019-05-22 
07:34:59,55.9,44.3,29.33,East,91,4,3.1,65,0,,,0,weewx-4.0.0a4,2019-05-22 
11:34:59,
<br>
2019-05-22 
07:39:59,55.9,44.3,29.33,East,91,4,5.1,65,0,,,0,weewx-4.0.0a4,2019-05-22 
11:39:59,
<br>
2019-05-22 
07:45:00,55.9,44.3,29.33,East,86,4,4.3,65,0,,,0,weewx-4.0.0a4,2019-05-22 
11:45:00,
<br>
2019-05-22 
07:49:59,55.9,44.3,29.34,East,86,4,3.1,65,0,,,0,weewx-4.0.0a4,2019-05-22 
11:49:59,
<br>
2019-05-22 
07:54:59,56.1,44.5,29.34,East,100,3.6,4,65,0,,,0,weewx-4.0.0a4,2019-05-22 
11:54:59,
<br>
2019-05-22 
08:00:00,56.1,44.9,29.34,East,100,3.6,4.7,66,0,,,0,weewx-4.0.0a4,2019-05-22 
12:00:00,
<br>
2019-05-22 
08:04:59,56.1,44.5,29.35,East,96,3.6,5.4,65,0,,,0,weewx-4.0.0a4,2019-05-22 
12:04:59,
<br>
2019-05-22 
08:09:59,56.1,44.5,29.35,East,96,3.6,5.8,65,0,,,0,weewx-4.0.0a4,2019-05-22 
12:09:59,
<br>
2019-05-22 
08:14:59,56.1,44.9,29.35,East,80,3.6,9.6,66,0,,,0,weewx-4.0.0a4,2019-05-22 
12:14:59,
<br>
2019-05-22 
08:19:59,56.1,44.9,29.31,East,80,3.6,3.6,66,0,,,0,weewx-4.0.0a4,2019-05-22 
12:19:59,
<br>
2019-05-22 
08:25:00,56.1,44.9,29.31,East,85,5.1,0,66,0,,,0,weewx-4.0.0a4,2019-05-22 
12:25:00,
<br>
2019-05-22 
08:29:59,56.1,44.9,29.31,East,85,5.1,5.4,66,0,,,0,weewx-4.0.0a4,2019-05-22 
12:29:59,
<br>
2019-05-22 
08:34:59,56.1,44.9,29.36,East,95,2.9,3.6,66,0,,,0,weewx-4.0.0a4,2019-05-22 
12:34:59,
<br>
2019-05-22 
08:40:00,56.1,45.3,29.36,East,95,2.9,2,67,0,,,0,weewx-4.0.0a4,2019-05-22 
12:40:00,
<br>
2019-05-22 
08:44:59,56.1,46.1,29.36,SE,131,2.9,3.1,69,0,,,0,weewx-4.0.0a4,2019-05-22 
12:44:59,
<br>
2019-05-22 
08:49:59,56.1,46.1,29.34,SE,131,2.9,1.8,69,0,,,0,weewx-4.0.0a4,2019-05-22 
12:49:59,
<br>
2019-05-22 
08:54:59,55.9,46.3,29.34,East,95,3.1,2,70,0,,,0,weewx-4.0.0a4,2019-05-22 
12:54:59,
<br>
2019-05-22 
08:59:59,55.8,46.1,29.34,East,95,3.1,0,70,0,,,0,weewx-4.0.0a4,2019-05-22 
12:59:59,
<br>
2019-05-22 
09:04:59,55.8,46.1,29.33,East,100,2.9,2.5,70,0,,,0,weewx-4.0.0a4,2019-05-22 
13:04:59,
<br>
2019-05-22 
09:09:59,55.8,46.9,29.33,East,100,2.9,4,72,0,,,0,weewx-4.0.0a4,2019-05-22 
13:09:59,
<br>
2019-05-22 
09:14:59,55.8,46.1,29.33,East,98,2.5,4.3,70,0,,,0,weewx-4.0.0a4,2019-05-22 
13:14:59,
<br>
2019-05-22 
09:19:59,55.8,46.1,29.33,East,98,2.5,2.9,70,0,,,0,weewx-4.0.0a4,2019-05-22 
13:19:59,
<br>
2019-05-22 
09:24:59,55.8,46.1,29.33,ESE,108,2.9,2.9,70,0,,,0,weewx-4.0.0a4,2019-05-22 
13:24:59,
<br>
2019-05-22 
09:29:59,55.9,45.9,29.33,ESE,108,2.9,5.1,69,0,,,0,weewx-4.0.0a4,2019-05-22 
13:29:59,
<br>
2019-05-22 
09:34:59,55.9,45.9,29.33,ESE,115,2.9,4,69,0,,,0,weewx-4.0.0a4,2019-05-22 
13:34:59,
<br>
2019-05-22 
09:39:59,56.1,46.1,29.33,ESE,115,2.9,4.7,69,0,,,0,weewx-4.0.0a4,2019-05-22 
13:39:59,
<br>
2019-05-22 
09:44:59,55.9,46.7,29.33,ESE,120,3.6,4,71,0,,,0,weewx-4.0.0a4,2019-05-22 
13:44:59,
<br>
2019-05-22 
09:50:00,55.9,47,29.33,ESE,120,3.6,0,72,0,,,0,weewx-4.0.0a4,2019-05-22 13:50:00,
<br>
2019-05-22 
09:55:00,55.9,47.8,29.33,ESE,113,2.9,2.9,74,0,,,0,weewx-4.0.0a4,2019-05-22 
13:55:00,
<br>
2019-05-22 
09:59:59,55.8,47.6,29.33,ESE,113,2.9,2.5,74,0,,,0,weewx-4.0.0a4,2019-05-22 
13:59:59,
<br>
2019-05-22 
10:05:00,55.6,48.1,29.32,ESE,112,2,2.9,76,0,,,0,weewx-4.0.0a4,2019-05-22 
14:05:00,
<br>
2019-05-22 
10:10:00,55.4,48.7,29.32,ESE,112,2,5.1,78,0.01,,,0.01,weewx-4.0.0a4,2019-05-22 
14:10:00,
<br>
2019-05-22 
10:15:00,55.2,48.5,29.32,East,96,2.9,1.8,78,0.01,,,0.01,weewx-4.0.0a4,2019-05-22
 14:15:00,
<br>
2019-05-22 
10:20:00,54.9,48.8,29.33,East,96,2.9,2.5,80,0.02,,,0.02,weewx-4.0.0a4,2019-05-22
 14:20:00,
<br>
2019-05-22 
10:24:59,54.5,48.8,29.33,ESE,109,2.5,0,81,0.02,,,0.02,weewx-4.0.0a4,2019-05-22 
14:24:59,
<br>
2019-05-22 
10:30:00,54.1,49.4,29.33,ESE,109,2.5,3.1,84,0.03,,,0.03,weewx-4.0.0a4,2019-05-22
 14:30:00,
<br>
2019-05-22 
10:34:59,53.8,49.4,29.33,ESE,122,1.8,2.5,85,0.04,,,0.04,weewx-4.0.0a4,2019-05-22
 14:34:59,
<br>
2019-05-22 
10:40:00,53.4,49.3,29.33,ESE,122,1.8,2.5,86,0.05,,,0.05,weewx-4.0.0a4,2019-05-22
 14:40:00,
<br>
2019-05-22 
10:45:00,53.1,49.3,29.33,ENE,67,2.5,0,87,0.06,,,0.06,weewx-4.0.0a4,2019-05-22 
14:45:00,
<br>
2019-05-22 
10:49:59,52.5,49.4,29.33,ENE,67,2.5,3.1,89,0.07,,,0.07,weewx-4.0.0a4,2019-05-22 
14:49:59,
<br>
2019-05-22 
10:54:59,52.3,49.2,29.33,ESE,110,2,4,89,0.07,,,0.07,weewx-4.0.0a4,2019-05-22 
14:54:59,
<br>
2019-05-22 
10:59:59,52.2,49.3,29.33,ESE,110,2,3.1,90,0.08,,,0.08,weewx-4.0.0a4,2019-05-22 
14:59:59,
<br>
2019-05-22 
11:04:59,52,49.4,29.29,East,95,4,5.1,91,0.09,,,0.09,weewx-4.0.0a4,2019-05-22 
15:04:59,
<br>
2019-05-22 
11:10:00,52,49.7,29.29,East,95,4,4.7,92,0.08,,,0.09,weewx-4.0.0a4,2019-05-22 
15:10:00,
<br>
2019-05-22 
11:14:59,52,50,29.29,ESE,107,4,0,93,0.08,,,0.09,weewx-4.0.0a4,2019-05-22 
15:14:59,
<br>
2019-05-22 
11:19:59,52.2,50.2,29.32,ESE,107,4,0,93,0.08,,,0.1,weewx-4.0.0a4,2019-05-22 
15:19:59,
<br>
2019-05-22 
11:24:59,52.2,50.2,29.32,East,93,2,5.8,93,0.08,,,0.1,weewx-4.0.0a4,2019-05-22 
15:24:59,
<br>
2019-05-22 
11:29:59,52.3,50.4,29.32,East,93,2,0,93,0.08,,,0.11,weewx-4.0.0a4,2019-05-22 
15:29:59,
<br>
2019-05-22 
11:34:59,52.5,50.8,29.31,East,89,2.5,3.6,94,0.07,,,0.11,weewx-4.0.0a4,2019-05-22
 15:34:59,
<br>
2019-05-22 
11:40:00,52.7,51,29.31,East,89,2.5,4.3,94,0.06,,,0.11,weewx-4.0.0a4,2019-05-22 
15:40:00,
<br>
2019-05-22 
11:44:59,52.9,50.9,29.31,East,101,2.9,2.9,93,0.06,,,0.12,weewx-4.0.0a4,2019-05-22
 15:44:59,
<br>
2019-05-22 
11:49:59,52.9,50.9,29.31,East,101,2.9,3.6,93,0.05,,,0.12,weewx-4.0.0a4,2019-05-22
 15:49:59,
<br>
2019-05-22 
11:54:59,52.9,50.9,29.31,East,89,3.6,4.7,93,0.05,,,0.12,weewx-4.0.0a4,2019-05-22
 15:54:59,
<br>
2019-05-22 
11:59:59,53.1,51.1,29.31,East,89,3.6,2.5,93,0.05,,,0.13,weewx-4.0.0a4,2019-05-22
 15:59:59,
<br>
2019-05-22 
12:05:00,53.1,51.4,29.30,East,100,3.6,2.5,94,0.04,,,0.13,weewx-4.0.0a4,2019-05-22
 16:05:00,
<br>
2019-05-22 
12:09:59,53.4,51.7,29.30,East,100,3.6,3.6,94,0.04,,,0.13,weewx-4.0.0a4,2019-05-22
 16:09:59,
<br>
2019-05-22 
12:14:59,53.4,51.2,29.30,ESE,113,3.6,6.9,92,0.04,,,0.13,weewx-4.0.0a4,2019-05-22
 16:14:59,
<br>
2019-05-22 
12:20:00,53.6,51.6,29.30,ESE,113,3.6,0,93,0.03,,,0.13,weewx-4.0.0a4,2019-05-22 
16:20:00,
<br>
2019-05-22 
12:24:59,53.8,52.1,29.30,ESE,108,2.9,1.8,94,0.05,,,0.15,weewx-4.0.0a4,2019-05-22
 16:24:59,
<br>
2019-05-22 
12:29:59,54.1,52.2,29.30,ESE,108,2.9,3.6,93,0.04,,,0.15,weewx-4.0.0a4,2019-05-22
 16:29:59,
<br>
2019-05-22 
12:34:59,54.1,52.2,29.30,East,96,2.9,1.8,93,0.04,,,0.15,weewx-4.0.0a4,2019-05-22
 16:34:59,
<br>
2019-05-22 
12:39:59,54.1,51.9,29.30,East,96,2.9,5.8,92,0.04,,,0.15,weewx-4.0.0a4,2019-05-22
 16:39:59,
<br>
2019-05-22 
12:45:00,54,51.4,29.30,East,101,2.9,5.4,91,0.03,,,0.15,weewx-4.0.0a4,2019-05-22 
16:45:00,
<br>
2019-05-22 
12:49:59,54,51.7,29.29,East,101,2.9,3.6,92,0.04,,,0.16,weewx-4.0.0a4,2019-05-22 
16:49:59,
<br>
2019-05-22 
12:54:59,54,51.7,29.29,ESE,108,4,5.4,92,0.04,,,0.16,weewx-4.0.0a4,2019-05-22 
16:54:59,
<br>
2019-05-22 
13:00:00,54.1,51.9,29.29,ESE,108,4,7.4,92,0.03,,,0.16,weewx-4.0.0a4,2019-05-22 
17:00:00,
<br>
2019-05-22 
13:05:00,54.3,51.7,29.28,ESE,110,3.6,2.5,91,0.03,,,0.16,weewx-4.0.0a4,2019-05-22
 17:05:00,
<br>
2019-05-22 
13:09:59,54.5,52.2,29.28,ESE,110,3.6,4.3,92,0.03,,,0.16,weewx-4.0.0a4,2019-05-22
 17:09:59,
<br>
2019-05-22 
13:14:59,54.7,52.4,29.28,SE,132,3.6,1.8,92,0.03,,,0.16,weewx-4.0.0a4,2019-05-22 
17:14:59,
<br>
2019-05-22 
13:19:59,55,52.8,29.27,SE,132,3.6,5.1,92,0.03,,,0.16,weewx-4.0.0a4,2019-05-22 
17:19:59,
<br>
2019-05-22 13:24:59,55,52.2,29.27,ESE,111,3.1,5.1,90,0.0
100 19032  100 19032    0     0   3165      0  0:00:06  0:00:06 --:--:--  3757* 
Curl_http_done: called premature == 0

100 19032  100 19032    0     0   3162      0  0:00:06  0:00:06 --:--:--  4796
* Connection #0 to host www.wunderground.com left intact
1,,,0.16,weewx-4.0.0a4,2019-05-22 17:24:59,
<br>
2019-05-22 
13:30:00,55.2,52.6,29.27,ESE,111,3.1,0,91,0.02,,,0.17,weewx-4.0.0a4,2019-05-22 
17:30:00,
<br>
2019-05-22 
13:34:59,55.6,53,29.30,SE,135,2.9,4.7,91,0.02,,,0.17,weewx-4.0.0a4,2019-05-22 
17:34:59,
<br>
2019-05-22 
13:39:59,55.6,52.7,29.30,SE,135,2.9,4,90,0.02,,,0.17,weewx-4.0.0a4,2019-05-22 
17:39:59,
<br>
2019-05-22 
13:44:59,55.6,52.7,29.30,SSE,157,2.5,1.3,90,0.02,,,0.17,weewx-4.0.0a4,2019-05-22
 17:44:59,
<br>
2019-05-22 
13:50:00,55.6,52.7,29.31,SSE,157,2.5,0,90,0.01,,,0.17,weewx-4.0.0a4,2019-05-22 
17:50:00,
<br>
2019-05-22 
13:54:59,55.8,53.5,29.31,SSE,156,1.8,0,92,0.01,,,0.17,weewx-4.0.0a4,2019-05-22 
17:54:59,
<br>
2019-05-22 
13:59:59,56.1,53.8,29.31,SSE,156,1.8,0,92,0.01,,,0.17,weewx-4.0.0a4,2019-05-22 
17:59:59,
<br>
2019-05-22 
14:04:59,56.7,54.4,29.29,North,,0,0,92,0.01,,,0.17,weewx-4.0.0a4,2019-05-22 
18:04:59,
<br>
2019-05-22 
14:10:00,57,54.4,29.29,North,,0,2,91,0.01,,,0.17,weewx-4.0.0a4,2019-05-22 
18:10:00,
<br>
2019-05-22 
14:14:59,57.7,54.2,29.29,East,87,1.8,2.9,88,0.01,,,0.17,weewx-4.0.0a4,2019-05-22
 18:14:59,
<br>
2019-05-22 
14:19:59,58.3,54.7,29.29,East,87,1.8,3.1,88,0.01,,,0.17,weewx-4.0.0a4,2019-05-22
 18:19:59,
<br>
2019-05-22 
14:24:59,58.6,54.5,29.29,SE,128,2,1.8,86,0.01,,,0.17,weewx-4.0.0a4,2019-05-22 
18:24:59,
<br>
2019-05-22 
14:29:59,59.4,55.8,29.29,SE,128,2,3.1,88,0,,,0.17,weewx-4.0.0a4,2019-05-22 
18:29:59,
<br>
2019-05-22 
14:35:00,60.1,55.9,29.29,SSE,161,2,4,86,0,,,0.17,weewx-4.0.0a4,2019-05-22 
18:35:00,
<br>
2019-05-22 
14:39:59,61,55.8,29.29,SSE,161,2,2,83,0,,,0.17,weewx-4.0.0a4,2019-05-22 
18:39:59,
<br>
2019-05-22 
14:45:00,61.5,55.3,29.29,SSE,151,2,3.1,80,0,,,0.17,weewx-4.0.0a4,2019-05-22 
18:45:00,
<br>
2019-05-22 
14:49:59,61.7,55.1,29.29,SSE,151,2,3.6,79,0,,,0.17,weewx-4.0.0a4,2019-05-22 
18:49:59,
<br>
2019-05-22 
14:55:00,61.9,55.6,29.29,SE,144,2.5,3.6,80,0,,,0.17,weewx-4.0.0a4,2019-05-22 
18:55:00,
<br>
2019-05-22 
14:59:59,62.1,54.8,29.29,SE,144,2.5,2.9,77,0.01,,,0.18,weewx-4.0.0a4,2019-05-22 
18:59:59,
<br>
2019-05-22 
15:04:59,62.4,55.5,29.28,SE,126,2.9,1.8,78,0.01,,,0.18,weewx-4.0.0a4,2019-05-22 
19:04:59,
<br>
2019-05-22 
15:09:59,62.8,55.8,29.28,SE,126,2.9,3.6,78,0.01,,,0.18,weewx-4.0.0a4,2019-05-22 
19:09:59,
<br>
2019-05-22 
15:14:59,63.3,56,29.28,SE,138,2.9,1.8,77,0.01,,,0.18,weewx-4.0.0a4,2019-05-22 
19:14:59,
<br>
2019-05-22 
15:20:00,64,56,29.28,SE,138,2.9,5.8,75,0.01,,,0.18,weewx-4.0.0a4,2019-05-22 
19:20:00,
<br>
2019-05-22 
15:24:59,64.6,56.1,29.28,SSE,156,2.5,3.6,74,0.01,,,0.18,weewx-4.0.0a4,2019-05-22
 19:24:59,
<br>
2019-05-22 
15:30:00,65.1,56.2,29.28,SSE,156,2.5,3.6,73,0.01,,,0.18,weewx-4.0.0a4,2019-05-22
 19:30:00,
<br>

Working from here:

https://docs.python.org/2/library/ssl.html

So far I have tried this, to no avail.

Really just doing the "import ssl" and using https in the URL, and adding context=ssl_context to the urllib.request.

A snippet of that looks as follows, but still getting 403 forbidden. :-(

# For new WU interface which uses SSL and TLSv1.2

import ssl

...

_url = "https://www.wunderground.com/weatherstation/WXDailyHistory.asp?ID=%s" \

"&month=%d&day=%d&year=%d&format=1" % (self.station, dayRequested_tt[1],

dayRequested_tt[2], dayRequested_tt[0])

# specify TLSv1.2 and SSLv2, but not SSLv3

ssl_context = ssl.SSLContext(ssl.PROTOCOL_TLSv1_2)

ssl_context.options |= ssl.PROTOCOL_SSLv23

ssl_context.options |= ssl.OP_NO_SSLv3

try :

# Hit the weather underground site:

_wudata = urllib.request.urlopen(_url, context=ssl_context)

Regards,

\Leon

Leon Shaner :: Dearborn, Michigan (iPad Pro)

On May 22, 2019, at 2:42 PM, Leon Shaner <[email protected]> wrote:

Jarom,

CURL is pretty sophisticated in its ability to emulate browser state in pretty much any way but _javascript_. When it worked this morning, I saw some cookies were involved.
It may well be that the python way isn't handling that part.
I don't know enough about how python fetches pages to work that out, but I am very familiar with CURL, so if I can find a path that works consistently, then I'll go back to the python to see about how to implement same.

I was getting 404's in the browser even, when I looked at it earlier.

I'll keep working on it, but not too hard, so as to not get on their radar in any unwanted sort of way. ;-)

Regards,
\Leon
--
Leon Shaner :: Dearborn, Michigan (iPad Pro)

On May 22, 2019, at 2:04 PM, Jarom Hatch <[email protected]> wrote:

Interesting, using curl sometimes I can it fine, but wunderfixer is always getting a 403 Forbidden, as if it is actively being blocked... When it doesn't work in curl I get `HTTP/1.1 404 Not Found` and when it does work I get `HTTP/1.1 200 OK`. Curl never gets a 403 error.

On Wednesday, May 22, 2019 at 11:48:08 AM UTC-6, Jarom Hatch wrote:
I was able to get it to work twice in my web browser, but as you said, it is sporadic. I don't ever recall them using Akamai before so that may very well be a contributing factor.

I wonder if we can find out the origin address and see what happens if we can bypass Akamai...

On Wednesday, May 22, 2019 at 7:35:18 AM UTC-6, Leon Shaner wrote:
For one thing, the URL of this form:

http://www.wunderground.com/weatherstation/WXDailyHistory.asp?ID=SOMESTATION&month=5&day=22&year=2019&format=1

Is now redirecting to one using HTTPS:

https://www.wunderground.com/weatherstation/WXDailyHistory.asp?ID=SOMESTATION&month=5&day=22&year=2019&format=1

Also, the redirect itself takes an excruciatingly long time.
So I just changed the URL to https directly...

The first time I tried any of the above using CURL this morning it worked, but then after that I started getting:

An error occurred while processing your request.
Reference #30.6f451160.1558531514.16ced4f6
It looks as if they've put some kind of Akamai proxy in the middle, which is fine for static content, but not so fine for a query of this nature. Strange that it worked for me the very first time. It's almost as if the Akamai "farm" has lost some "state" information and not all nodes have the same content, so if you get stuck going through a bad node you get a bogus response.

Attached is a transcript of a failed attempt. I put SOMESTATION there only after the fact. The actual query was for my actual station, which used to work.

--
You received this message because you are subscribed to the Google Groups "weewx-user" group.
To unsubscribe from this group and stop receiving emails from it, send an email to [email protected].
To view this discussion on the web visit https://groups.google.com/d/msgid/weewx-user/07ac6f86-ae4d-4854-8398-ce4ab8d846c1%40googlegroups.com.
For more options, visit https://groups.google.com/d/optout.

Re: [weewx-user] Re: We have finally put the last nail on the coffin for Wunderfixer?

Reply via email to