[
https://issues.apache.org/jira/browse/HTTPCLIENT-2006?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16897161#comment-16897161
]
Oleg Kalnichevski commented on HTTPCLIENT-2006:
-----------------------------------------------
Same behavior with HttpClient 4.5.9. It is certainly not specific to HttpClient
5.0 and looks like a server side issue to me.
Oleg
{noformat}
[DEBUG] RequestAddCookies - CookieSpec selected: default
[DEBUG] RequestAuthCache - Auth cache not set in the context
[DEBUG] PoolingHttpClientConnectionManager - Connection request: [route:
{s}->https://www.popsugar.com:443][total kept alive: 0; route allocated: 0 of
100; total allocated: 0 of 200]
[DEBUG] PoolingHttpClientConnectionManager - Connection leased: [id: 0][route:
{s}->https://www.popsugar.com:443][total kept alive: 0; route allocated: 1 of
100; total allocated: 1 of 200]
[DEBUG] MainClientExec - Opening connection {s}->https://www.popsugar.com:443
[DEBUG] DefaultHttpClientConnectionOperator - Connecting to
www.popsugar.com/13.224.96.25:443
[DEBUG] SSLConnectionSocketFactory - Connecting socket to
www.popsugar.com/13.224.96.25:443 with timeout 0
[DEBUG] SSLConnectionSocketFactory - Enabled protocols: [TLSv1, TLSv1.1,
TLSv1.2]
[DEBUG] SSLConnectionSocketFactory - Enabled cipher
suites:[TLS_ECDHE_ECDSA_WITH_AES_256_CBC_SHA384,
TLS_ECDHE_RSA_WITH_AES_256_CBC_SHA384, TLS_RSA_WITH_AES_256_CBC_SHA256,
TLS_ECDH_ECDSA_WITH_AES_256_CBC_SHA384, TLS_ECDH_RSA_WITH_AES_256_CBC_SHA384,
TLS_DHE_RSA_WITH_AES_256_CBC_SHA256, TLS_DHE_DSS_WITH_AES_256_CBC_SHA256,
TLS_ECDHE_ECDSA_WITH_AES_256_CBC_SHA, TLS_ECDHE_RSA_WITH_AES_256_CBC_SHA,
TLS_RSA_WITH_AES_256_CBC_SHA, TLS_ECDH_ECDSA_WITH_AES_256_CBC_SHA,
TLS_ECDH_RSA_WITH_AES_256_CBC_SHA, TLS_DHE_RSA_WITH_AES_256_CBC_SHA,
TLS_DHE_DSS_WITH_AES_256_CBC_SHA, TLS_ECDHE_ECDSA_WITH_AES_128_CBC_SHA256,
TLS_ECDHE_RSA_WITH_AES_128_CBC_SHA256, TLS_RSA_WITH_AES_128_CBC_SHA256,
TLS_ECDH_ECDSA_WITH_AES_128_CBC_SHA256, TLS_ECDH_RSA_WITH_AES_128_CBC_SHA256,
TLS_DHE_RSA_WITH_AES_128_CBC_SHA256, TLS_DHE_DSS_WITH_AES_128_CBC_SHA256,
TLS_ECDHE_ECDSA_WITH_AES_128_CBC_SHA, TLS_ECDHE_RSA_WITH_AES_128_CBC_SHA,
TLS_RSA_WITH_AES_128_CBC_SHA, TLS_ECDH_ECDSA_WITH_AES_128_CBC_SHA,
TLS_ECDH_RSA_WITH_AES_128_CBC_SHA, TLS_DHE_RSA_WITH_AES_128_CBC_SHA,
TLS_DHE_DSS_WITH_AES_128_CBC_SHA, TLS_ECDHE_ECDSA_WITH_AES_256_GCM_SHA384,
TLS_ECDHE_ECDSA_WITH_AES_128_GCM_SHA256, TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384,
TLS_RSA_WITH_AES_256_GCM_SHA384, TLS_ECDH_ECDSA_WITH_AES_256_GCM_SHA384,
TLS_ECDH_RSA_WITH_AES_256_GCM_SHA384, TLS_DHE_RSA_WITH_AES_256_GCM_SHA384,
TLS_DHE_DSS_WITH_AES_256_GCM_SHA384, TLS_ECDHE_RSA_WITH_AES_128_GCM_SHA256,
TLS_RSA_WITH_AES_128_GCM_SHA256, TLS_ECDH_ECDSA_WITH_AES_128_GCM_SHA256,
TLS_ECDH_RSA_WITH_AES_128_GCM_SHA256, TLS_DHE_RSA_WITH_AES_128_GCM_SHA256,
TLS_DHE_DSS_WITH_AES_128_GCM_SHA256, TLS_EMPTY_RENEGOTIATION_INFO_SCSV]
[DEBUG] SSLConnectionSocketFactory - Starting handshake
[DEBUG] SSLConnectionSocketFactory - Secure session established
[DEBUG] SSLConnectionSocketFactory - negotiated protocol: TLSv1.2
[DEBUG] SSLConnectionSocketFactory - negotiated cipher suite:
TLS_ECDHE_RSA_WITH_AES_128_GCM_SHA256
[DEBUG] SSLConnectionSocketFactory - peer principal: CN=*.popsugar.com
[DEBUG] SSLConnectionSocketFactory - peer alternative names: [*.popsugar.com,
*.popsu.gr, popsu.gr, popsugar.com, *.popsugar.co.uk, popsugar.co.uk,
*.popsugar.com.au, popsugar.com.au, *.popsugar.fr, popsugar.fr, *.popsugar.de,
popsugar.de, *.popsugar.tv, popsugar.tv]
[DEBUG] SSLConnectionSocketFactory - issuer principal: CN=Amazon, OU=Server CA
1B, O=Amazon, C=US
[DEBUG] DefaultHttpClientConnectionOperator - Connection established
192.168.8.105:60662<->13.224.96.25:443
[DEBUG] MainClientExec - Executing request GET / HTTP/1.1
[DEBUG] MainClientExec - Target auth state: UNCHALLENGED
[DEBUG] MainClientExec - Proxy auth state: UNCHALLENGED
[DEBUG] headers - http-outgoing-0 >> GET / HTTP/1.1
[DEBUG] headers - http-outgoing-0 >> Host: www.popsugar.com
[DEBUG] headers - http-outgoing-0 >> Connection: Keep-Alive
[DEBUG] headers - http-outgoing-0 >> User-Agent: Apache-HttpClient/4.5.9
(Java/1.8.0_181)
[DEBUG] headers - http-outgoing-0 >> Accept-Encoding: gzip,deflate
[DEBUG] headers - http-outgoing-0 << HTTP/1.1 307 Temporary Redirect
[DEBUG] headers - http-outgoing-0 << Content-Type: text/html; charset=UTF-8
[DEBUG] headers - http-outgoing-0 << Transfer-Encoding: chunked
[DEBUG] headers - http-outgoing-0 << Connection: keep-alive
[DEBUG] headers - http-outgoing-0 << Date: Wed, 31 Jul 2019 13:01:35 GMT
[DEBUG] headers - http-outgoing-0 << Server: nginx/1.14.1
[DEBUG] headers - http-outgoing-0 << X-Powered-By: PHP/7.2.18
[DEBUG] headers - http-outgoing-0 << Set-Cookie:
PHPSESSID=17670bb8f5f53a46cf3fee878dc28be8; expires=Fri, 23-Aug-2019 16:34:55
GMT; Max-Age=2000000; path=/
[DEBUG] headers - http-outgoing-0 << Set-Cookie: client_locale=CH; expires=Thu,
01-Aug-2019 13:01:35 GMT; Max-Age=86400; path=/
[DEBUG] headers - http-outgoing-0 << P3P: CP="CAO DSP COR CUR ADM DEV TAI PSA
PSD IVA IVD CONi HIS OUR DELi SAMi IND UNI INT CNT"
[DEBUG] headers - http-outgoing-0 << X-POPSUGAR-Server-Name:
sugarprodweb31.sugarops.com
[DEBUG] headers - http-outgoing-0 << Location: https://www.popsugar.co.uk/
[DEBUG] headers - http-outgoing-0 << Set-Cookie:
ss1=0%7C1566578095%7CAHKtrCJgOn9gYBDnlWL%2FpPLvqOyjlbHKCYVfLKp9BUsc%2FV1LkCV8gW2dnm1RjD4lsFNTtJlgs8q83T%2FUSQ5u%2ByzRA0arMIZ3euEm0Xj7GoteWvLZjMq%2BoiC9hAu%2FoU6KpSL4Bht00zhG7oIM5G4yuj0gG5ct8iR5yOQ%2BX6V4xh017N9lMu7c8Lm8bUVN1dD0%2BLeZuFhx6JuY5TrBa2AFxQ%3D%3D%7C4cb3e4a920a8fc9ca462a366aaa190d85ea0137b;
expires=Fri, 23-Aug-2019 16:34:55 GMT; Max-Age=2000000; path=/
[DEBUG] headers - http-outgoing-0 << Content-Encoding: gzip
[DEBUG] headers - http-outgoing-0 << Vary: Accept-Encoding
[DEBUG] headers - http-outgoing-0 << X-Cache: Miss from cloudfront
[DEBUG] headers - http-outgoing-0 << Via: 1.1
449f2b51e83bf8ba5fa5e65ce60bc277.cloudfront.net (CloudFront)
[DEBUG] headers - http-outgoing-0 << X-Amz-Cf-Pop: ZRH50-C1
[DEBUG] headers - http-outgoing-0 << X-Amz-Cf-Id:
DG_Zoe-mzQKiyscXyL_mAdHlcFCHRemx6AMhZnEJ5P4CoQE3M1xJCA==
[DEBUG] MainClientExec - Connection can be kept alive indefinitely
[DEBUG] ResponseProcessCookies - Cookie accepted
[PHPSESSID="17670bb8f5f53a46cf3fee878dc28be8", version:0,
domain:www.popsugar.com, path:/, expiry:Fri Aug 23 18:34:55 CEST 2019]
[DEBUG] ResponseProcessCookies - Cookie accepted [client_locale="CH",
version:0, domain:www.popsugar.com, path:/, expiry:Thu Aug 01 15:01:35 CEST
2019]
[DEBUG] ResponseProcessCookies - Cookie accepted
[ss1="0%7C1566578095%7CAHKtrCJgOn9gYBDnlWL%2FpPLvqOyjlbHKCYVfLKp9BUsc%2FV1LkCV8gW2dnm1RjD4lsFNTtJlgs8q83T%...",
version:0, domain:www.popsugar.com, path:/, expiry:Fri Aug 23 18:34:55 CEST
2019]
[DEBUG] DefaultRedirectStrategy - Redirect requested to location
'https://www.popsugar.co.uk/'
[DEBUG] RedirectExec - Resetting target auth state
[DEBUG] RedirectExec - Redirecting to 'https://www.popsugar.co.uk/' via
{s}->https://www.popsugar.co.uk:443
[DEBUG] PoolingHttpClientConnectionManager - Connection [id: 0][route:
{s}->https://www.popsugar.com:443] can be kept alive indefinitely
[DEBUG] DefaultManagedHttpClientConnection - http-outgoing-0: set socket
timeout to 0
[DEBUG] PoolingHttpClientConnectionManager - Connection released: [id:
0][route: {s}->https://www.popsugar.com:443][total kept alive: 1; route
allocated: 1 of 100; total allocated: 1 of 200]
[DEBUG] RequestAddCookies - CookieSpec selected: default
[DEBUG] RequestAuthCache - Auth cache not set in the context
[DEBUG] PoolingHttpClientConnectionManager - Connection request: [route:
{s}->https://www.popsugar.co.uk:443][total kept alive: 1; route allocated: 0 of
100; total allocated: 1 of 200]
[DEBUG] PoolingHttpClientConnectionManager - Connection leased: [id: 1][route:
{s}->https://www.popsugar.co.uk:443][total kept alive: 1; route allocated: 1 of
100; total allocated: 2 of 200]
[DEBUG] MainClientExec - Opening connection {s}->https://www.popsugar.co.uk:443
[DEBUG] DefaultHttpClientConnectionOperator - Connecting to
www.popsugar.co.uk/13.224.96.11:443
[DEBUG] SSLConnectionSocketFactory - Connecting socket to
www.popsugar.co.uk/13.224.96.11:443 with timeout 0
[DEBUG] SSLConnectionSocketFactory - Enabled protocols: [TLSv1, TLSv1.1,
TLSv1.2]
[DEBUG] SSLConnectionSocketFactory - Enabled cipher
suites:[TLS_ECDHE_ECDSA_WITH_AES_256_CBC_SHA384,
TLS_ECDHE_RSA_WITH_AES_256_CBC_SHA384, TLS_RSA_WITH_AES_256_CBC_SHA256,
TLS_ECDH_ECDSA_WITH_AES_256_CBC_SHA384, TLS_ECDH_RSA_WITH_AES_256_CBC_SHA384,
TLS_DHE_RSA_WITH_AES_256_CBC_SHA256, TLS_DHE_DSS_WITH_AES_256_CBC_SHA256,
TLS_ECDHE_ECDSA_WITH_AES_256_CBC_SHA, TLS_ECDHE_RSA_WITH_AES_256_CBC_SHA,
TLS_RSA_WITH_AES_256_CBC_SHA, TLS_ECDH_ECDSA_WITH_AES_256_CBC_SHA,
TLS_ECDH_RSA_WITH_AES_256_CBC_SHA, TLS_DHE_RSA_WITH_AES_256_CBC_SHA,
TLS_DHE_DSS_WITH_AES_256_CBC_SHA, TLS_ECDHE_ECDSA_WITH_AES_128_CBC_SHA256,
TLS_ECDHE_RSA_WITH_AES_128_CBC_SHA256, TLS_RSA_WITH_AES_128_CBC_SHA256,
TLS_ECDH_ECDSA_WITH_AES_128_CBC_SHA256, TLS_ECDH_RSA_WITH_AES_128_CBC_SHA256,
TLS_DHE_RSA_WITH_AES_128_CBC_SHA256, TLS_DHE_DSS_WITH_AES_128_CBC_SHA256,
TLS_ECDHE_ECDSA_WITH_AES_128_CBC_SHA, TLS_ECDHE_RSA_WITH_AES_128_CBC_SHA,
TLS_RSA_WITH_AES_128_CBC_SHA, TLS_ECDH_ECDSA_WITH_AES_128_CBC_SHA,
TLS_ECDH_RSA_WITH_AES_128_CBC_SHA, TLS_DHE_RSA_WITH_AES_128_CBC_SHA,
TLS_DHE_DSS_WITH_AES_128_CBC_SHA, TLS_ECDHE_ECDSA_WITH_AES_256_GCM_SHA384,
TLS_ECDHE_ECDSA_WITH_AES_128_GCM_SHA256, TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384,
TLS_RSA_WITH_AES_256_GCM_SHA384, TLS_ECDH_ECDSA_WITH_AES_256_GCM_SHA384,
TLS_ECDH_RSA_WITH_AES_256_GCM_SHA384, TLS_DHE_RSA_WITH_AES_256_GCM_SHA384,
TLS_DHE_DSS_WITH_AES_256_GCM_SHA384, TLS_ECDHE_RSA_WITH_AES_128_GCM_SHA256,
TLS_RSA_WITH_AES_128_GCM_SHA256, TLS_ECDH_ECDSA_WITH_AES_128_GCM_SHA256,
TLS_ECDH_RSA_WITH_AES_128_GCM_SHA256, TLS_DHE_RSA_WITH_AES_128_GCM_SHA256,
TLS_DHE_DSS_WITH_AES_128_GCM_SHA256, TLS_EMPTY_RENEGOTIATION_INFO_SCSV]
[DEBUG] SSLConnectionSocketFactory - Starting handshake
[DEBUG] SSLConnectionSocketFactory - Secure session established
[DEBUG] SSLConnectionSocketFactory - negotiated protocol: TLSv1.2
[DEBUG] SSLConnectionSocketFactory - negotiated cipher suite:
TLS_ECDHE_RSA_WITH_AES_128_GCM_SHA256
[DEBUG] SSLConnectionSocketFactory - peer principal: CN=*.popsugar.com
[DEBUG] SSLConnectionSocketFactory - peer alternative names: [*.popsugar.com,
*.popsu.gr, popsu.gr, popsugar.com, *.popsugar.co.uk, popsugar.co.uk,
*.popsugar.com.au, popsugar.com.au, *.popsugar.fr, popsugar.fr, *.popsugar.de,
popsugar.de, *.popsugar.tv, popsugar.tv]
[DEBUG] SSLConnectionSocketFactory - issuer principal: CN=Amazon, OU=Server CA
1B, O=Amazon, C=US
[DEBUG] DefaultHttpClientConnectionOperator - Connection established
192.168.8.105:60412<->13.224.96.11:443
[DEBUG] MainClientExec - Executing request GET / HTTP/1.1
[DEBUG] MainClientExec - Target auth state: UNCHALLENGED
[DEBUG] MainClientExec - Proxy auth state: UNCHALLENGED
[DEBUG] headers - http-outgoing-1 >> GET / HTTP/1.1
[DEBUG] headers - http-outgoing-1 >> Host: www.popsugar.co.uk
[DEBUG] headers - http-outgoing-1 >> Connection: Keep-Alive
[DEBUG] headers - http-outgoing-1 >> User-Agent: Apache-HttpClient/4.5.9
(Java/1.8.0_181)
[DEBUG] headers - http-outgoing-1 >> Accept-Encoding: gzip,deflate
[DEBUG] headers - http-outgoing-1 << HTTP/1.1 307 Temporary Redirect
[DEBUG] headers - http-outgoing-1 << Content-Type: text/html; charset=UTF-8
[DEBUG] headers - http-outgoing-1 << Transfer-Encoding: chunked
[DEBUG] headers - http-outgoing-1 << Connection: keep-alive
[DEBUG] headers - http-outgoing-1 << Date: Wed, 31 Jul 2019 13:01:36 GMT
[DEBUG] headers - http-outgoing-1 << Server: nginx/1.14.1
[DEBUG] headers - http-outgoing-1 << X-Powered-By: PHP/7.2.18
[DEBUG] headers - http-outgoing-1 << Set-Cookie:
PHPSESSID=7641c9a03933635c1fab0c60d5a22574; expires=Fri, 23-Aug-2019 16:34:56
GMT; Max-Age=2000000; path=/
[DEBUG] headers - http-outgoing-1 << Set-Cookie: client_locale=CH; expires=Thu,
01-Aug-2019 13:01:36 GMT; Max-Age=86400; path=/
[DEBUG] headers - http-outgoing-1 << P3P: CP="CAO DSP COR CUR ADM DEV TAI PSA
PSD IVA IVD CONi HIS OUR DELi SAMi IND UNI INT CNT"
[DEBUG] headers - http-outgoing-1 << X-POPSUGAR-Server-Name:
sugarprodweb31.sugarops.com
[DEBUG] headers - http-outgoing-1 << Location:
https://www.popsugar.co.uk/gdpr-consent?destination=https%3A%2F%2Fwww.popsugar.co.uk%2F
[DEBUG] headers - http-outgoing-1 << Set-Cookie:
ss1=0%7C1566578096%7CzhOkOVZFcEfdVrOsBr4GXEPTl1l3i4AZobqiC0ieNqsCbJbgY8Pi%2Fb%2BAlka9yRF5FMefr9%2BAndVwGUhHm6Qzd5joXHJKJVToYd55xpUpAldaR0%2FcYUEzB%2Fu7Ke%2FqPFe8ioSHvAiP%2BISR75HyDLb2oXVrkKZBLZ2XEhgbMOZKeVrtfzpcZ4DJcS0DUXrXdWwBHqw6%2Bgjrel9yrNRKb%2FrWQA%3D%3D%7C75b6b9c693533a3190573beaca6b14bed470a0a3;
expires=Fri, 23-Aug-2019 16:34:56 GMT; Max-Age=2000000; path=/
[DEBUG] headers - http-outgoing-1 << Content-Encoding: gzip
[DEBUG] headers - http-outgoing-1 << Vary: Accept-Encoding
[DEBUG] headers - http-outgoing-1 << X-Cache: Miss from cloudfront
[DEBUG] headers - http-outgoing-1 << Via: 1.1
666ff4ad81b3b60af3d2241160893ee3.cloudfront.net (CloudFront)
[DEBUG] headers - http-outgoing-1 << X-Amz-Cf-Pop: ZRH50-C1
[DEBUG] headers - http-outgoing-1 << X-Amz-Cf-Id:
uhtsTJ9e-9bxPlmX6-QLx8J9yWnX_c_oFr66GqtpI7txUY7ivH3poQ==
[DEBUG] MainClientExec - Connection can be kept alive indefinitely
[DEBUG] ResponseProcessCookies - Cookie accepted
[PHPSESSID="7641c9a03933635c1fab0c60d5a22574", version:0,
domain:www.popsugar.co.uk, path:/, expiry:Fri Aug 23 18:34:56 CEST 2019]
[DEBUG] ResponseProcessCookies - Cookie accepted [client_locale="CH",
version:0, domain:www.popsugar.co.uk, path:/, expiry:Thu Aug 01 15:01:36 CEST
2019]
[DEBUG] ResponseProcessCookies - Cookie accepted
[ss1="0%7C1566578096%7CzhOkOVZFcEfdVrOsBr4GXEPTl1l3i4AZobqiC0ieNqsCbJbgY8Pi%2Fb%2BAlka9yRF5FMefr9%2BAndVwG...",
version:0, domain:www.popsugar.co.uk, path:/, expiry:Fri Aug 23 18:34:56 CEST
2019]
[DEBUG] DefaultRedirectStrategy - Redirect requested to location
'https://www.popsugar.co.uk/gdpr-consent?destination=https%3A%2F%2Fwww.popsugar.co.uk%2F'
[DEBUG] RedirectExec - Resetting target auth state
[DEBUG] RedirectExec - Redirecting to
'https://www.popsugar.co.uk/gdpr-consent?destination=https%3A%2F%2Fwww.popsugar.co.uk%2F'
via {s}->https://www.popsugar.co.uk:443
[DEBUG] PoolingHttpClientConnectionManager - Connection [id: 1][route:
{s}->https://www.popsugar.co.uk:443] can be kept alive indefinitely
[DEBUG] DefaultManagedHttpClientConnection - http-outgoing-1: set socket
timeout to 0
[DEBUG] PoolingHttpClientConnectionManager - Connection released: [id:
1][route: {s}->https://www.popsugar.co.uk:443][total kept alive: 2; route
allocated: 1 of 100; total allocated: 2 of 200]
[DEBUG] RequestAddCookies - CookieSpec selected: default
[DEBUG] RequestAddCookies - Cookie [version: 0][name: PHPSESSID][value:
7641c9a03933635c1fab0c60d5a22574][domain: www.popsugar.co.uk][path: /][expiry:
Fri Aug 23 18:34:56 CEST 2019] match
[(secure)www.popsugar.co.uk:443/gdpr-consent]
[DEBUG] RequestAddCookies - Cookie [version: 0][name: client_locale][value:
CH][domain: www.popsugar.co.uk][path: /][expiry: Thu Aug 01 15:01:36 CEST 2019]
match [(secure)www.popsugar.co.uk:443/gdpr-consent]
[DEBUG] RequestAddCookies - Cookie [version: 0][name: ss1][value:
0%7C1566578096%7CzhOkOVZFcEfdVrOsBr4GXEPTl1l3i4AZobqiC0ieNqsCbJbgY8Pi%2Fb%2BAlka9yRF5FMefr9%2BAndVwGUhHm6Qzd5joXHJKJVToYd55xpUpAldaR0%2FcYUEzB%2Fu7Ke%2FqPFe8ioSHvAiP%2BISR75HyDLb2oXVrkKZBLZ2XEhgbMOZKeVrtfzpcZ4DJcS0DUXrXdWwBHqw6%2Bgjrel9yrNRKb%2FrWQA%3D%3D%7C75b6b9c693533a3190573beaca6b14bed470a0a3][domain:
www.popsugar.co.uk][path: /][expiry: Fri Aug 23 18:34:56 CEST 2019] match
[(secure)www.popsugar.co.uk:443/gdpr-consent]
[DEBUG] RequestAuthCache - Auth cache not set in the context
[DEBUG] PoolingHttpClientConnectionManager - Connection request: [route:
{s}->https://www.popsugar.co.uk:443][total kept alive: 2; route allocated: 1 of
100; total allocated: 2 of 200]
[DEBUG] PoolingHttpClientConnectionManager - Connection leased: [id: 1][route:
{s}->https://www.popsugar.co.uk:443][total kept alive: 1; route allocated: 1 of
100; total allocated: 2 of 200]
[DEBUG] DefaultManagedHttpClientConnection - http-outgoing-1: set socket
timeout to 0
[DEBUG] MainClientExec - Executing request GET
/gdpr-consent?destination=https%3A%2F%2Fwww.popsugar.co.uk%2F HTTP/1.1
[DEBUG] MainClientExec - Target auth state: UNCHALLENGED
[DEBUG] MainClientExec - Proxy auth state: UNCHALLENGED
[DEBUG] headers - http-outgoing-1 >> GET
/gdpr-consent?destination=https%3A%2F%2Fwww.popsugar.co.uk%2F HTTP/1.1
[DEBUG] headers - http-outgoing-1 >> Host: www.popsugar.co.uk
[DEBUG] headers - http-outgoing-1 >> Connection: Keep-Alive
[DEBUG] headers - http-outgoing-1 >> User-Agent: Apache-HttpClient/4.5.9
(Java/1.8.0_181)
[DEBUG] headers - http-outgoing-1 >> Cookie:
PHPSESSID=7641c9a03933635c1fab0c60d5a22574; client_locale=CH;
ss1=0%7C1566578096%7CzhOkOVZFcEfdVrOsBr4GXEPTl1l3i4AZobqiC0ieNqsCbJbgY8Pi%2Fb%2BAlka9yRF5FMefr9%2BAndVwGUhHm6Qzd5joXHJKJVToYd55xpUpAldaR0%2FcYUEzB%2Fu7Ke%2FqPFe8ioSHvAiP%2BISR75HyDLb2oXVrkKZBLZ2XEhgbMOZKeVrtfzpcZ4DJcS0DUXrXdWwBHqw6%2Bgjrel9yrNRKb%2FrWQA%3D%3D%7C75b6b9c693533a3190573beaca6b14bed470a0a3
[DEBUG] headers - http-outgoing-1 >> Accept-Encoding: gzip,deflate
[DEBUG] headers - http-outgoing-1 << HTTP/1.1 403 Forbidden
[DEBUG] headers - http-outgoing-1 << Content-Type: text/html; charset=UTF-8
[DEBUG] headers - http-outgoing-1 << Transfer-Encoding: chunked
[DEBUG] headers - http-outgoing-1 << Connection: keep-alive
[DEBUG] headers - http-outgoing-1 << Date: Wed, 31 Jul 2019 13:01:36 GMT
[DEBUG] headers - http-outgoing-1 << Server: nginx/1.14.1
[DEBUG] headers - http-outgoing-1 << X-Powered-By: PHP/7.2.18
[DEBUG] headers - http-outgoing-1 << Set-Cookie:
ss1=0%7C1566578096%7CzhOkOVZFcEfdVrOsBr4GXEPTl1l3i4AZobqiC0ieNqsCbJbgY8Pi%2Fb%2BAlka9yRF5FMefr9%2BAndVwGUhHm6Qzd5joXHJKJVToYd55xpUpAldaR0%2FcYUEzB%2Fu7Ke%2FqPFe8ioSHvAiP%2BISR75HyDLb2oXVrkKZBLZ2XEhgbMOZKeVrtfzpcZ4DJcS0DUXrXdWwBHqw6%2Bgjrel9yrNRKb%2FrWQA%3D%3D%7C75b6b9c693533a3190573beaca6b14bed470a0a3;
expires=Fri, 23-Aug-2019 16:34:56 GMT; Max-Age=2000000; path=/
[DEBUG] headers - http-outgoing-1 << Content-Encoding: gzip
[DEBUG] headers - http-outgoing-1 << Vary: Accept-Encoding
[DEBUG] headers - http-outgoing-1 << X-Cache: Error from cloudfront
[DEBUG] headers - http-outgoing-1 << Via: 1.1
666ff4ad81b3b60af3d2241160893ee3.cloudfront.net (CloudFront)
[DEBUG] headers - http-outgoing-1 << X-Amz-Cf-Pop: ZRH50-C1
[DEBUG] headers - http-outgoing-1 << X-Amz-Cf-Id:
s_Bna8UZWmZ0aBarI-AM3v1bZsTz0_V6dQZzLuZTukd2kiZJm-y2uQ==
[DEBUG] MainClientExec - Connection can be kept alive indefinitely
[DEBUG] ResponseProcessCookies - Cookie accepted
[ss1="0%7C1566578096%7CzhOkOVZFcEfdVrOsBr4GXEPTl1l3i4AZobqiC0ieNqsCbJbgY8Pi%2Fb%2BAlka9yRF5FMefr9%2BAndVwG...",
version:0, domain:www.popsugar.co.uk, path:/, expiry:Fri Aug 23 18:34:56 CEST
2019]
[DEBUG] PoolingHttpClientConnectionManager - Connection [id: 1][route:
{s}->https://www.popsugar.co.uk:443] can be kept alive indefinitely
[DEBUG] DefaultManagedHttpClientConnection - http-outgoing-1: set socket
timeout to 0
[DEBUG] PoolingHttpClientConnectionManager - Connection released: [id:
1][route: {s}->https://www.popsugar.co.uk:443][total kept alive: 2; route
allocated: 1 of 100; total allocated: 2 of 200]
Exception in thread "main" org.apache.http.client.HttpResponseException: status
code: 403, reason phrase: Forbidden
{noformat}
> HttpClient 5.0-beta5 gets 403 error for URL, works in HttpClient 4/Curl/Wget
> etc
> --------------------------------------------------------------------------------
>
> Key: HTTPCLIENT-2006
> URL: https://issues.apache.org/jira/browse/HTTPCLIENT-2006
> Project: HttpComponents HttpClient
> Issue Type: Bug
> Components: HttpClient (classic)
> Affects Versions: 5.0 Beta5
> Environment: Java 12/MacOS 10.14.6
> Reporter: Andrew Parks
> Priority: Major
>
> When testing an upgrade from HttpClient 4.5.9 to HttpClient 5.0-beta5, I
> tried the following code on a large number of URLs:
> {{System.out.println(Request.Get("https://www.popsugar.com";).execute().returnContent());}}
> It worked fine for other sites, but for some reason, the PopSugar web site
> returns a 403 error. The same web site does not have a problem when
> HttpClient 4.5.9 is used to do exactly the same thing. There is also no
> problem when tested with curl, wget, or a regular browser. Changing user
> agents does not make a difference.
> I have verified that the PopSugar web site supports HTTP/2. Perhaps there is
> a protocol incompatibility.
--
This message was sent by Atlassian JIRA
(v7.6.14#76016)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
