On Thu, 2018-12-20 at 10:04 +0000, Khare, Aparna wrote: > Hi Oleg, > > Actually we cannot move from HttpClient 4.1.3 can we get this fixed > here ...or if there is a workaround.. >
Of course, there is. Just back-port content decompression code from 4.5 to 4.1. Oleg > Thanks, > Aparna > > -----Original Message----- > From: Oleg Kalnichevski <ol...@apache.org> > Sent: Thursday, December 20, 2018 3:18 PM > To: Khare, Aparna <aparna.kh...@sap.com>; HttpClient User Discussion > <httpclient-users@hc.apache.org> > Subject: Re: Issue with deflate Content-Encode httpClient 4.1.3 > > On Thu, 2018-12-20 at 08:20 +0000, Khare, Aparna wrote: > > Hi Oleg, > > > > https://httpbin.davecheney.com/deflate > > > > I'm trying to do an GET the response for the above url. > > > > if (response.getEntity() != null) { > > InputStream inStream = response.getEntity().getContent(); > > > > if (inStream != null) { > > try { > > ByteArrayOutputStream outStream = new > > ByteArrayOutputStream(); > > int value = inStream.read(); > > while (value != -1) { > > outStream.write(value); > > value = inStream.read(); > > } > > response = outStream.toByteArray(); > > } > > } > > Finally this data is required to be parsed on UI where we are using > > > > Both deflated content and gZip data is malformed once the response > > is > > returned ..(Encoding issue) > > > > How can I get this fixed. > > > > Thanks, > > Aparna > > > > Works with HttpClient 4.5 > > Oleg > > [DEBUG] RequestAddCookies - CookieSpec selected: default > [DEBUG] RequestAuthCache - Auth cache not set in the context > [DEBUG] PoolingHttpClientConnectionManager - Connection request: > [route: {s}->https://httpbin.davecheney.com:443][total kept alive: 0; > route allocated: 0 of 2; total allocated: 0 of 20] > [DEBUG] PoolingHttpClientConnectionManager - Connection leased: [id: > 0][route: {s}->https://httpbin.davecheney.com:443][total kept alive: > 0; route allocated: 1 of 2; total allocated: 1 of 20] > [DEBUG] MainClientExec - Opening connection {s}-> > https://httpbin.davecheney.com:443 > [DEBUG] DefaultHttpClientConnectionOperator - Connecting to > httpbin.davecheney.com/35.189.26.87:443 > [DEBUG] SSLConnectionSocketFactory - Connecting socket to > httpbin.davecheney.com/35.189.26.87:443 with timeout 0 > [DEBUG] SSLConnectionSocketFactory - Enabled protocols: [TLSv1, > TLSv1.1, TLSv1.2] > [DEBUG] SSLConnectionSocketFactory - Enabled cipher > suites:[TLS_ECDHE_ECDSA_WITH_AES_256_CBC_SHA384, > TLS_ECDHE_RSA_WITH_AES_256_CBC_SHA384, > TLS_RSA_WITH_AES_256_CBC_SHA256, > TLS_ECDH_ECDSA_WITH_AES_256_CBC_SHA384, > TLS_ECDH_RSA_WITH_AES_256_CBC_SHA384, > TLS_DHE_RSA_WITH_AES_256_CBC_SHA256, > TLS_DHE_DSS_WITH_AES_256_CBC_SHA256, > TLS_ECDHE_ECDSA_WITH_AES_256_CBC_SHA, > TLS_ECDHE_RSA_WITH_AES_256_CBC_SHA, TLS_RSA_WITH_AES_256_CBC_SHA, > TLS_ECDH_ECDSA_WITH_AES_256_CBC_SHA, > TLS_ECDH_RSA_WITH_AES_256_CBC_SHA, TLS_DHE_RSA_WITH_AES_256_CBC_SHA, > TLS_DHE_DSS_WITH_AES_256_CBC_SHA, > TLS_ECDHE_ECDSA_WITH_AES_128_CBC_SHA256, > TLS_ECDHE_RSA_WITH_AES_128_CBC_SHA256, > TLS_RSA_WITH_AES_128_CBC_SHA256, > TLS_ECDH_ECDSA_WITH_AES_128_CBC_SHA256, > TLS_ECDH_RSA_WITH_AES_128_CBC_SHA256, > TLS_DHE_RSA_WITH_AES_128_CBC_SHA256, > TLS_DHE_DSS_WITH_AES_128_CBC_SHA256, > TLS_ECDHE_ECDSA_WITH_AES_128_CBC_SHA, > TLS_ECDHE_RSA_WITH_AES_128_CBC_SHA, TLS_RSA_WITH_AES_128_CBC_SHA, > TLS_ECDH_ECDSA_WITH_AES_128_CBC_SHA, > TLS_ECDH_RSA_WITH_AES_128_CBC_SHA, TLS_DHE_RSA_WITH_AES_128_CBC_SHA, > TLS_DHE_DSS_WITH_AES_128_CBC_SHA, > TLS_ECDHE_ECDSA_WITH_AES_256_GCM_SHA384, > TLS_ECDHE_ECDSA_WITH_AES_128_GCM_SHA256, > TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384, > TLS_RSA_WITH_AES_256_GCM_SHA384, > TLS_ECDH_ECDSA_WITH_AES_256_GCM_SHA384, > TLS_ECDH_RSA_WITH_AES_256_GCM_SHA384, > TLS_DHE_RSA_WITH_AES_256_GCM_SHA384, > TLS_DHE_DSS_WITH_AES_256_GCM_SHA384, > TLS_ECDHE_RSA_WITH_AES_128_GCM_SHA256, > TLS_RSA_WITH_AES_128_GCM_SHA256, > TLS_ECDH_ECDSA_WITH_AES_128_GCM_SHA256, > TLS_ECDH_RSA_WITH_AES_128_GCM_SHA256, > TLS_DHE_RSA_WITH_AES_128_GCM_SHA256, > TLS_DHE_DSS_WITH_AES_128_GCM_SHA256, > TLS_EMPTY_RENEGOTIATION_INFO_SCSV] > [DEBUG] SSLConnectionSocketFactory - Starting handshake > [DEBUG] SSLConnectionSocketFactory - Secure session established > [DEBUG] SSLConnectionSocketFactory - negotiated protocol: TLSv1.2 > [DEBUG] SSLConnectionSocketFactory - negotiated cipher suite: > TLS_ECDHE_RSA_WITH_AES_128_GCM_SHA256 > [DEBUG] SSLConnectionSocketFactory - peer principal: > CN=httpbin.davecheney.com > [DEBUG] SSLConnectionSocketFactory - peer alternative names: > [httpbin.davecheney.com] > [DEBUG] SSLConnectionSocketFactory - issuer principal: CN=Let's > Encrypt Authority X3, O=Let's Encrypt, C=US > [DEBUG] DefaultHttpClientConnectionOperator - Connection established > 192.168.43.142:57358<->35.189.26.87:443 > [DEBUG] MainClientExec - Executing request GET /deflate HTTP/1.1 > [DEBUG] MainClientExec - Target auth state: UNCHALLENGED > [DEBUG] MainClientExec - Proxy auth state: UNCHALLENGED > [DEBUG] headers - http-outgoing-0 >> GET /deflate HTTP/1.1 > [DEBUG] headers - http-outgoing-0 >> Host: httpbin.davecheney.com > [DEBUG] headers - http-outgoing-0 >> Connection: Keep-Alive > [DEBUG] headers - http-outgoing-0 >> User-Agent: Apache- > HttpClient/4.5.6 (Java/1.8.0_181) > [DEBUG] headers - http-outgoing-0 >> Accept-Encoding: gzip,deflate > [DEBUG] wire - http-outgoing-0 >> "GET /deflate HTTP/1.1[\r][\n]" > [DEBUG] wire - http-outgoing-0 >> "Host: > httpbin.davecheney.com[\r][\n]" > [DEBUG] wire - http-outgoing-0 >> "Connection: Keep-Alive[\r][\n]" > [DEBUG] wire - http-outgoing-0 >> "User-Agent: Apache- > HttpClient/4.5.6 (Java/1.8.0_181)[\r][\n]" > [DEBUG] wire - http-outgoing-0 >> "Accept-Encoding: > gzip,deflate[\r][\n]" > [DEBUG] wire - http-outgoing-0 >> "[\r][\n]" > [DEBUG] wire - http-outgoing-0 << "HTTP/1.1 200 OK[\r][\n]" > [DEBUG] wire - http-outgoing-0 << "server: envoy[\r][\n]" > [DEBUG] wire - http-outgoing-0 << "date: Thu, 20 Dec 2018 09:46:40 > GMT[\r][\n]" > [DEBUG] wire - http-outgoing-0 << "content-type: > application/json[\r][\n]" > [DEBUG] wire - http-outgoing-0 << "content-length: 280[\r][\n]" > [DEBUG] wire - http-outgoing-0 << "content-encoding: deflate[\r][\n]" > [DEBUG] wire - http-outgoing-0 << "access-control-allow-origin: > *[\r][\n]" > [DEBUG] wire - http-outgoing-0 << "access-control-allow-credentials: > true[\r][\n]" > [DEBUG] wire - http-outgoing-0 << "x-envoy-upstream-service-time: > 3[\r][\n]" > [DEBUG] wire - http-outgoing-0 << "[\r][\n]" > [DEBUG] wire - http-outgoing-0 << > "x[0x9c]e[0x90]Ok[0x2]1[0x10][0xc5][0xef]~[0x8a]%[0xa7][0x16][0x9c][0 > x98]d[0xfd][0xb3][0xf4][0xb6][0x88]TK{[0x11][0xb][0xde]J6;[0xdd][\r][ > 0xac][0xc9][0xba][0x1b][0xa5]V[0xfc][0xee][0x9d]h[0x91]B[0x8f][0xf3][ > 0xe6][0xf7][0x86]7[0xef]<H[0x12]V[0xe2]g[0xa3][0x3][0x96][0xec])[0x9] > [0xdd][0x1][0x87]I[0x14]k[0xd4]%v=ig[0x1a]I[0xc8][0x8d][0xc1]6[0xc0][ > 0xc2][0x19]_ZW[0xd1][0x82]U[0xdf][0xb6][0x1d][0xfe][0xba][0xd9][0xd5] > F[0xdc][0xdc][0xbb][0x80].[0xc0]+[0xba]*[0xd4][0x11][0x13][0xf7][0xdd > ][0xd2][0xf7]!*u[0x8]ma[0x1d]/[0xf5][0x11]M[0x8d][0xe]O[0xdc][0xf8][0 > xdd][0x1d]{[0xef][0xb1][0x83][0xbc][0xa2]+[0x11][0xce][M[0xc],[0xc9]3 > o,[0x89][0xa3]1[0x9f][0xf0]i[0xf2][0xf0][0xa2][0x8f]z$y[0xc6][0xc5][0 > x87][0xcc][0xe4][0xe3][0xdd][0xbe][0xa5][0x90]G[0x82][0xc5]W[0x8b][0 > x86][0xfe][0x82][0xf5][0x1e]6v[0x87][0xfe][0x10][0xe0]- > ~[0xc4][0xe4]D[0x8][0xf1][0x8f]_Q[0xf0][0xce][0xe9]&[0x12][0xb1][0x88 > ]?[0xc0][0x1a][0xf7][0x7][0xec][0x3][0xac]bI,K[0xb3]YVd[0x8]jVh[0x18] > [0x97]r[0x6][0x5][\n]" > [DEBUG] wire - http-outgoing-0 << > "[0x5]*E[0xa3][0xc6]jjR%[0x19]Y/[0xb7]*w[0x18]j5>/6[0xb7][0xa3][0xcc > ]w[0xb6][0xb2][0xee][0x9a]Ep9Q\[0xf0][0x94][\r].[0x83][0x1f][0x86][0x > f6]mW" > [DEBUG] headers - http-outgoing-0 << HTTP/1.1 200 OK > [DEBUG] headers - http-outgoing-0 << server: envoy > [DEBUG] headers - http-outgoing-0 << date: Thu, 20 Dec 2018 09:46:40 > GMT > [DEBUG] headers - http-outgoing-0 << content-type: application/json > [DEBUG] headers - http-outgoing-0 << content-length: 280 > [DEBUG] headers - http-outgoing-0 << content-encoding: deflate > [DEBUG] headers - http-outgoing-0 << access-control-allow-origin: * > [DEBUG] headers - http-outgoing-0 << access-control-allow- > credentials: true > [DEBUG] headers - http-outgoing-0 << x-envoy-upstream-service-time: 3 > [DEBUG] MainClientExec - Connection can be kept alive indefinitely > [DEBUG] PoolingHttpClientConnectionManager - Connection [id: > 0][route: {s}->https://httpbin.davecheney.com:443] can be kept alive > indefinitely > [DEBUG] DefaultManagedHttpClientConnection - http-outgoing-0: set > socket timeout to 0 > [DEBUG] PoolingHttpClientConnectionManager - Connection released: > [id: 0][route: {s}->https://httpbin.davecheney.com:443][total kept > alive: 1; route allocated: 1 of 2; total allocated: 1 of 20] > { > "deflated": true, > "headers": { > "Accept-Encoding": "gzip,deflate", > "Content-Length": "0", > "Host": "httpbin.davecheney.com", > "User-Agent": "Apache-HttpClient/4.5.6 (Java/1.8.0_181)", > "X-Envoy-Expected-Rq-Timeout-Ms": "15000", > "X-Envoy-Internal": "true", > "X-Request-Id": "83878b8e-27ba-4d17-be02-23ec2426c321" > }, > "method": "GET", > "origin": "10.152.0.3" > } > > > > > > > > > > > > } > > > > > > > > > > -----Original Message----- > > From: Oleg Kalnichevski <ol...@apache.org> > > Sent: Wednesday, December 19, 2018 7:15 PM > > To: HttpClient User Discussion <httpclient-users@hc.apache.org> > > Subject: Re: Issue with deflate Content-Encode httpClient 4.1.3 > > > > On Wed, 2018-12-19 at 13:39 +0000, Khare, Aparna wrote: > > > Thank Oleg but if that is the case do I still need to send type > > > cast > > > to GzipDecompressingEntity..without casting to > > > GzipDecompressingEntity Im not getting byte[] some encoding issue > > > with the response content > > > > > > > > > > > > I have seen that when I get the response content as InputStream > > > and > > > convert it to > > > > > > > > > > > > try { > > > > > > ByteArrayOutputStream outStream = new > > > ByteArrayOutputStream(); > > > > > > int value = inStream.read(); > > > > > > while (value != -1) { > > > > > > outStream.write(value); > > > > > > value = inStream.read(); > > > > > > } > > > > > > response = outStream.toByteArray(); > > > > > > > > > > > > } > > > > > > > > > > > > It is not sending the byte[] properly.. > > > > > > > > > > I am sorry I do not understand. > > > > Oleg > > > > > > > > > > -----Original Message----- > > > From: Oleg Kalnichevski <ol...@apache.org> > > > Sent: Wednesday, December 19, 2018 3:47 PM > > > To: HttpClient User Discussion <httpclient-users@hc.apache.org> > > > Subject: Re: Issue with deflate Content-Encode httpClient 4.1.3 > > > > > > > > > > > > On Wed, 2018-12-19 at 07:41 +0000, Khare, Aparna wrote: > > > > > > > Dear All, > > > > > > > > We have some constraints in moving to new httpclient and we are > > > > using > > > > 4.1.3. Any help is appreciated. gzipContent works but deflated > > > > is > > > > not > > > > working. > > > > > > > > if (response.getEntity() != null) { > > > > HttpEntity entity = response.getEntity(); > > > > Header contentEncodingHeader = > > > > entity.getContentEncoding(); > > > > > > > > if (contentEncodingHeader != null) { > > > > HeaderElement[] encodings > > > > =contentEncodingHeader.getElements(); > > > > for (int i = 0; i < encodings.length; i++) { > > > > if > > > > (encodings[i].getName().equalsIgnoreCase("gzip")) { > > > > entity = new > > > > GzipDecompressingEntity(entity); > > > > break; > > > > } else > > > > if(encodings[i].getName().equalsIgnoreCase("deflate")) { > > > > entity = new > > > > DeflateDecompressingEntity(entity); > > > > break; > > > > } > > > > } > > > > } > > > > > > > > And we use the below mechanism to set the params in the > > > > httpclient > > > > .. > > > > I have read that I need to disable the compressions. But I > > > > could > > > > not > > > > find how can I set that.. > > > > > > > > > > > > > > > > HttpClient 4.1 does not support automatic content decompression. > > > You > > > do > > > > > > not need to disable it. > > > > > > > > > > > > Oleg > > > > > > > > > > > > > > > > > > > rsClient = new DefaultHttpClient(); > > > > rsClient.getParams().setParameter(CoreProtocolPNames.USER_AGENT > > > > , > > > > TESTCONSOLE); > > > > rsClient.getParams().setParameter(ClientPNames.HANDLE_REDIR > > > > EC > > > > TS > > > > , > > > > false); > > > > > > > > Thanks, > > > > Aparna > > > > > > > > > > > > > > > > > > > > > > ----------------------------------------------------------------- > > > ---- > > > > > > To unsubscribe, e-mail: > > > httpclient-users-unsubscr...@hc.apache.org< > > > ma > > > ilto:httpclient-users-unsubscr...@hc.apache.org> > > > > > > For additional commands, e-mail: > > > httpclient-users-h...@hc.apache.org< > > > mailto:httpclient-users-h...@hc.apache.org> > > > > > > > > > > > > ----------------------------------------------------------------- > > ---- > > To unsubscribe, e-mail: httpclient-users-unsubscr...@hc.apache.org > > For additional commands, e-mail: > > httpclient-users-h...@hc.apache.org > > > > > --------------------------------------------------------------------- > To unsubscribe, e-mail: httpclient-users-unsubscr...@hc.apache.org > For additional commands, e-mail: httpclient-users-h...@hc.apache.org > --------------------------------------------------------------------- To unsubscribe, e-mail: httpclient-users-unsubscr...@hc.apache.org For additional commands, e-mail: httpclient-users-h...@hc.apache.org
