[jira] [Commented] (KNOX-754) curl requests fail when dealing with special characters
[ https://issues.apache.org/jira/browse/KNOX-754?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16052852#comment-16052852 ] ASF subversion and git services commented on KNOX-754: -- Commit 537690745cb4fc88d5083367d37f2a71de03e2e9 in knox's branch refs/heads/master from [~lmccay] [ https://git-wip-us.apache.org/repos/asf?p=knox.git;h=5376907 ] Revert "KNOX-754 scope change to just the Location header" This reverts commit 2d77f09f86134f4b665a7bbae2d7c04461e114fc. > curl requests fail when dealing with special characters > --- > > Key: KNOX-754 > URL: https://issues.apache.org/jira/browse/KNOX-754 > Project: Apache Knox > Issue Type: Bug > Components: ClientDSL, Server >Affects Versions: 0.9.1 > Environment: Apache Knox 0.9.1, Apache Hadoop 2.7.2 >Reporter: Alexandre Linte >Assignee: Sumit Gupta >Priority: Critical > Fix For: 0.10.0 > > Attachments: KNOX_754.patch > > > Since Knox 0.9.1, Knox can't work with files which contain special characters > as : é, ù, ü, è, etc... This is reproducible at 100%. It was working well > with Knox 0.7.0 so it's a regression. > This happens when doing a GET or a PUT of a file of this type, and more > particularly at the "location" process of the request. You can find an > example below: > {noformat} > [shfs3453@spark01 Pig]$ curl -Iikv -u shfs3453 -X GET > 'https://knox-gateway.fr/gateway/bigdata/webhdfs/v1/user/shfs3453/WORK/datasets/test_électronique_embarqué.pdf?OP=OPEN' > Enter host password for user 'shfs3453': > * About to connect() to knox-gateway port 443 (#0) > * Trying 10.117.41.12... connected > * Connected to knox-gateway (10.117.41.12) port 443 (#0) > * Initializing NSS with certpath: sql:/etc/pki/nssdb > * warning: ignoring value of ssl.verifyhost > * skipping SSL peer certificate verification > * SSL connection using TLS_ECDHE_RSA_WITH_AES_256_CBC_SHA > * Server certificate: > * subject: > E=@*,CN=knox-gateway,OU=*,O=,L=*,ST=*,C=*** > * start date: Nov 07 11:33:05 2014 GMT > * expire date: Nov 06 11:33:05 2019 GMT > * common name: knox-gateway > * issuer: CN=***,OU=***,OU=,O=**,C=*** > * Server auth using Basic with user 'shfs3453' > > GET > > /gateway/bigdata/webhdfs/v1/user/shfs3453/WORK/datasets/test_électronique_embarqué.pdf?OP=OPEN > > HTTP/1.1 > > Authorization: Basic c2hmczM0NTM6UGIxOTkxMTAh > > User-Agent: curl/7.19.7 (x86_64-redhat-linux-gnu) libcurl/7.19.7 NSS/3.19.1 > > Basic ECC zlib/1.2.3 libidn/1.18 libssh2/1.4.2 > > Host: knox-gateway > > Accept: */* > > > < HTTP/1.1 307 Temporary Redirect > HTTP/1.1 307 Temporary Redirect > < Date: Wed, 05 Oct 2016 07:19:55 GMT > Date: Wed, 05 Oct 2016 07:19:55 GMT > < Set-Cookie: > JSESSIONID=4zv7v1911q5vvcg6r1tqxe77;Path=/gateway/bigdata;Secure;HttpOnly > Set-Cookie: > JSESSIONID=4zv7v1911q5vvcg6r1tqxe77;Path=/gateway/bigdata;Secure;HttpOnly > < Expires: Thu, 01 Jan 1970 00:00:00 GMT > Expires: Thu, 01 Jan 1970 00:00:00 GMT > < Set-Cookie: rememberMe=deleteMe; Path=/gateway/bigdata; Max-Age=0; > Expires=Tue, 04-Oct-2016 07:19:56 GMT > Set-Cookie: rememberMe=deleteMe; Path=/gateway/bigdata; Max-Age=0; > Expires=Tue, 04-Oct-2016 07:19:56 GMT > < Cache-Control: no-cache > Cache-Control: no-cache > < Expires: Wed, 05 Oct 2016 07:19:56 GMT > Expires: Wed, 05 Oct 2016 07:19:56 GMT > < Date: Wed, 05 Oct 2016 07:19:56 GMT > Date: Wed, 05 Oct 2016 07:19:56 GMT > < Pragma: no-cache > Pragma: no-cache > < Expires: Wed, 05 Oct 2016 07:19:56 GMT > Expires: Wed, 05 Oct 2016 07:19:56 GMT > < Date: Wed, 05 Oct 2016 07:19:56 GMT > Date: Wed, 05 Oct 2016 07:19:56 GMT > < Pragma: no-cache > Pragma: no-cache > < Location: > https://knox-gateway/gateway/bigdata/webhdfs/data/v1/webhdfs/v1/user/shfs3453/WORK/datasets/test_▒lectronique_embarqu▒.pdf?_=CBEAl_jkRL_c3Tzm7hoXMR1KPge4OClEqM4hfs3eslFzfdY5CBbrfaMzOa--NXb08Xjw2O11CkOtyUX5kXwh2IgZmxjw_TNHqQUvVAfFkeXiMDiBXxpbhulsVx3o_NLn9pCLsp09xJ9r1utCHrueYOAvuxY_ksQWuHld2WWGEPyWRubcgb4e6xO2F4jo96NSZhuAP8iarY5LiCtTydLPBXcEbbD146jLD7S83Mhij4VS5sO1asESNH5y8_5Z2PvLcZE11WiTS9alu-9AUqXNixw1t9Y5Em6xDle7s8-oiF3nPVM80RIdbJel4LoeCZuB2zgddLaJAYx5tSb03-QGNzupOPQ5UQ0_7ybPwmAsgiFfFNuvMbj9sKgxLg > Location: > https://knox-gateway/gateway/bigdata/webhdfs/data/v1/webhdfs/v1/user/shfs3453/WORK/datasets/test_▒lectronique_embarqu▒.pdf?_=CBEAl_jkRL_c3Tzm7hoXMR1KPge4OClEqM4hfs3eslFzfdY5CBbrfaMzOa--NXb08Xjw2O11CkOtyUX5kXwh2IgZmxjw_TNHqQUvVAfFkeXiMDiBXxpbhulsVx3o_NLn9pCLsp09xJ9r1utCHrueYOAvuxY_ksQWuHld2WWGEPyWRubcgb4e6xO2F4jo96NSZhuAP8iarY5LiCtTydLPBXcEbbD146jLD7S83Mhij4VS5sO1asESNH5y8_5Z2PvLcZE11WiTS9alu-9AUqXNixw1t9Y5Em6xDle7s8-oiF3nPVM80RIdbJel4LoeCZuB2zgddLaJAYx5tSb03-QGNzupOPQ5UQ0_7ybPwmAsgiFfFNuvMbj9sKgxLg > <
[jira] [Commented] (KNOX-754) curl requests fail when dealing with special characters
[ https://issues.apache.org/jira/browse/KNOX-754?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15582658#comment-15582658 ] ASF subversion and git services commented on KNOX-754: -- Commit 667825e340067ce05a784832f0d1dffcd0132cb4 in knox's branch refs/heads/v0.9.0 from [~sumit.gupta] [ https://git-wip-us.apache.org/repos/asf?p=knox.git;h=667825e ] KNOX-754 scope change to just the Location header > curl requests fail when dealing with special characters > --- > > Key: KNOX-754 > URL: https://issues.apache.org/jira/browse/KNOX-754 > Project: Apache Knox > Issue Type: Bug > Components: ClientDSL, Server >Affects Versions: 0.9.1 > Environment: Apache Knox 0.9.1, Apache Hadoop 2.7.2 >Reporter: Alexandre Linte >Assignee: Sumit Gupta >Priority: Critical > Fix For: 0.10.0 > > Attachments: KNOX_754.patch > > > Since Knox 0.9.1, Knox can't work with files which contain special characters > as : é, ù, ü, è, etc... This is reproducible at 100%. It was working well > with Knox 0.7.0 so it's a regression. > This happens when doing a GET or a PUT of a file of this type, and more > particularly at the "location" process of the request. You can find an > example below: > {noformat} > [shfs3453@spark01 Pig]$ curl -Iikv -u shfs3453 -X GET > 'https://knox-gateway.fr/gateway/bigdata/webhdfs/v1/user/shfs3453/WORK/datasets/test_électronique_embarqué.pdf?OP=OPEN' > Enter host password for user 'shfs3453': > * About to connect() to knox-gateway port 443 (#0) > * Trying 10.117.41.12... connected > * Connected to knox-gateway (10.117.41.12) port 443 (#0) > * Initializing NSS with certpath: sql:/etc/pki/nssdb > * warning: ignoring value of ssl.verifyhost > * skipping SSL peer certificate verification > * SSL connection using TLS_ECDHE_RSA_WITH_AES_256_CBC_SHA > * Server certificate: > * subject: > E=@*,CN=knox-gateway,OU=*,O=,L=*,ST=*,C=*** > * start date: Nov 07 11:33:05 2014 GMT > * expire date: Nov 06 11:33:05 2019 GMT > * common name: knox-gateway > * issuer: CN=***,OU=***,OU=,O=**,C=*** > * Server auth using Basic with user 'shfs3453' > > GET > > /gateway/bigdata/webhdfs/v1/user/shfs3453/WORK/datasets/test_électronique_embarqué.pdf?OP=OPEN > > HTTP/1.1 > > Authorization: Basic c2hmczM0NTM6UGIxOTkxMTAh > > User-Agent: curl/7.19.7 (x86_64-redhat-linux-gnu) libcurl/7.19.7 NSS/3.19.1 > > Basic ECC zlib/1.2.3 libidn/1.18 libssh2/1.4.2 > > Host: knox-gateway > > Accept: */* > > > < HTTP/1.1 307 Temporary Redirect > HTTP/1.1 307 Temporary Redirect > < Date: Wed, 05 Oct 2016 07:19:55 GMT > Date: Wed, 05 Oct 2016 07:19:55 GMT > < Set-Cookie: > JSESSIONID=4zv7v1911q5vvcg6r1tqxe77;Path=/gateway/bigdata;Secure;HttpOnly > Set-Cookie: > JSESSIONID=4zv7v1911q5vvcg6r1tqxe77;Path=/gateway/bigdata;Secure;HttpOnly > < Expires: Thu, 01 Jan 1970 00:00:00 GMT > Expires: Thu, 01 Jan 1970 00:00:00 GMT > < Set-Cookie: rememberMe=deleteMe; Path=/gateway/bigdata; Max-Age=0; > Expires=Tue, 04-Oct-2016 07:19:56 GMT > Set-Cookie: rememberMe=deleteMe; Path=/gateway/bigdata; Max-Age=0; > Expires=Tue, 04-Oct-2016 07:19:56 GMT > < Cache-Control: no-cache > Cache-Control: no-cache > < Expires: Wed, 05 Oct 2016 07:19:56 GMT > Expires: Wed, 05 Oct 2016 07:19:56 GMT > < Date: Wed, 05 Oct 2016 07:19:56 GMT > Date: Wed, 05 Oct 2016 07:19:56 GMT > < Pragma: no-cache > Pragma: no-cache > < Expires: Wed, 05 Oct 2016 07:19:56 GMT > Expires: Wed, 05 Oct 2016 07:19:56 GMT > < Date: Wed, 05 Oct 2016 07:19:56 GMT > Date: Wed, 05 Oct 2016 07:19:56 GMT > < Pragma: no-cache > Pragma: no-cache > < Location: > https://knox-gateway/gateway/bigdata/webhdfs/data/v1/webhdfs/v1/user/shfs3453/WORK/datasets/test_▒lectronique_embarqu▒.pdf?_=CBEAl_jkRL_c3Tzm7hoXMR1KPge4OClEqM4hfs3eslFzfdY5CBbrfaMzOa--NXb08Xjw2O11CkOtyUX5kXwh2IgZmxjw_TNHqQUvVAfFkeXiMDiBXxpbhulsVx3o_NLn9pCLsp09xJ9r1utCHrueYOAvuxY_ksQWuHld2WWGEPyWRubcgb4e6xO2F4jo96NSZhuAP8iarY5LiCtTydLPBXcEbbD146jLD7S83Mhij4VS5sO1asESNH5y8_5Z2PvLcZE11WiTS9alu-9AUqXNixw1t9Y5Em6xDle7s8-oiF3nPVM80RIdbJel4LoeCZuB2zgddLaJAYx5tSb03-QGNzupOPQ5UQ0_7ybPwmAsgiFfFNuvMbj9sKgxLg > Location: > https://knox-gateway/gateway/bigdata/webhdfs/data/v1/webhdfs/v1/user/shfs3453/WORK/datasets/test_▒lectronique_embarqu▒.pdf?_=CBEAl_jkRL_c3Tzm7hoXMR1KPge4OClEqM4hfs3eslFzfdY5CBbrfaMzOa--NXb08Xjw2O11CkOtyUX5kXwh2IgZmxjw_TNHqQUvVAfFkeXiMDiBXxpbhulsVx3o_NLn9pCLsp09xJ9r1utCHrueYOAvuxY_ksQWuHld2WWGEPyWRubcgb4e6xO2F4jo96NSZhuAP8iarY5LiCtTydLPBXcEbbD146jLD7S83Mhij4VS5sO1asESNH5y8_5Z2PvLcZE11WiTS9alu-9AUqXNixw1t9Y5Em6xDle7s8-oiF3nPVM80RIdbJel4LoeCZuB2zgddLaJAYx5tSb03-QGNzupOPQ5UQ0_7ybPwmAsgiFfFNuvMbj9sKgxLg > < Content-Type: application/octet-stream > Content-Type:
[jira] [Commented] (KNOX-754) curl requests fail when dealing with special characters
[ https://issues.apache.org/jira/browse/KNOX-754?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15582619#comment-15582619 ] ASF subversion and git services commented on KNOX-754: -- Commit 2d77f09f86134f4b665a7bbae2d7c04461e114fc in knox's branch refs/heads/master from [~sumit.gupta] [ https://git-wip-us.apache.org/repos/asf?p=knox.git;h=2d77f09 ] KNOX-754 scope change to just the Location header > curl requests fail when dealing with special characters > --- > > Key: KNOX-754 > URL: https://issues.apache.org/jira/browse/KNOX-754 > Project: Apache Knox > Issue Type: Bug > Components: ClientDSL, Server >Affects Versions: 0.9.1 > Environment: Apache Knox 0.9.1, Apache Hadoop 2.7.2 >Reporter: Alexandre Linte >Assignee: Sumit Gupta >Priority: Critical > Fix For: 0.10.0 > > Attachments: KNOX_754.patch > > > Since Knox 0.9.1, Knox can't work with files which contain special characters > as : é, ù, ü, è, etc... This is reproducible at 100%. It was working well > with Knox 0.7.0 so it's a regression. > This happens when doing a GET or a PUT of a file of this type, and more > particularly at the "location" process of the request. You can find an > example below: > {noformat} > [shfs3453@spark01 Pig]$ curl -Iikv -u shfs3453 -X GET > 'https://knox-gateway.fr/gateway/bigdata/webhdfs/v1/user/shfs3453/WORK/datasets/test_électronique_embarqué.pdf?OP=OPEN' > Enter host password for user 'shfs3453': > * About to connect() to knox-gateway port 443 (#0) > * Trying 10.117.41.12... connected > * Connected to knox-gateway (10.117.41.12) port 443 (#0) > * Initializing NSS with certpath: sql:/etc/pki/nssdb > * warning: ignoring value of ssl.verifyhost > * skipping SSL peer certificate verification > * SSL connection using TLS_ECDHE_RSA_WITH_AES_256_CBC_SHA > * Server certificate: > * subject: > E=@*,CN=knox-gateway,OU=*,O=,L=*,ST=*,C=*** > * start date: Nov 07 11:33:05 2014 GMT > * expire date: Nov 06 11:33:05 2019 GMT > * common name: knox-gateway > * issuer: CN=***,OU=***,OU=,O=**,C=*** > * Server auth using Basic with user 'shfs3453' > > GET > > /gateway/bigdata/webhdfs/v1/user/shfs3453/WORK/datasets/test_électronique_embarqué.pdf?OP=OPEN > > HTTP/1.1 > > Authorization: Basic c2hmczM0NTM6UGIxOTkxMTAh > > User-Agent: curl/7.19.7 (x86_64-redhat-linux-gnu) libcurl/7.19.7 NSS/3.19.1 > > Basic ECC zlib/1.2.3 libidn/1.18 libssh2/1.4.2 > > Host: knox-gateway > > Accept: */* > > > < HTTP/1.1 307 Temporary Redirect > HTTP/1.1 307 Temporary Redirect > < Date: Wed, 05 Oct 2016 07:19:55 GMT > Date: Wed, 05 Oct 2016 07:19:55 GMT > < Set-Cookie: > JSESSIONID=4zv7v1911q5vvcg6r1tqxe77;Path=/gateway/bigdata;Secure;HttpOnly > Set-Cookie: > JSESSIONID=4zv7v1911q5vvcg6r1tqxe77;Path=/gateway/bigdata;Secure;HttpOnly > < Expires: Thu, 01 Jan 1970 00:00:00 GMT > Expires: Thu, 01 Jan 1970 00:00:00 GMT > < Set-Cookie: rememberMe=deleteMe; Path=/gateway/bigdata; Max-Age=0; > Expires=Tue, 04-Oct-2016 07:19:56 GMT > Set-Cookie: rememberMe=deleteMe; Path=/gateway/bigdata; Max-Age=0; > Expires=Tue, 04-Oct-2016 07:19:56 GMT > < Cache-Control: no-cache > Cache-Control: no-cache > < Expires: Wed, 05 Oct 2016 07:19:56 GMT > Expires: Wed, 05 Oct 2016 07:19:56 GMT > < Date: Wed, 05 Oct 2016 07:19:56 GMT > Date: Wed, 05 Oct 2016 07:19:56 GMT > < Pragma: no-cache > Pragma: no-cache > < Expires: Wed, 05 Oct 2016 07:19:56 GMT > Expires: Wed, 05 Oct 2016 07:19:56 GMT > < Date: Wed, 05 Oct 2016 07:19:56 GMT > Date: Wed, 05 Oct 2016 07:19:56 GMT > < Pragma: no-cache > Pragma: no-cache > < Location: > https://knox-gateway/gateway/bigdata/webhdfs/data/v1/webhdfs/v1/user/shfs3453/WORK/datasets/test_▒lectronique_embarqu▒.pdf?_=CBEAl_jkRL_c3Tzm7hoXMR1KPge4OClEqM4hfs3eslFzfdY5CBbrfaMzOa--NXb08Xjw2O11CkOtyUX5kXwh2IgZmxjw_TNHqQUvVAfFkeXiMDiBXxpbhulsVx3o_NLn9pCLsp09xJ9r1utCHrueYOAvuxY_ksQWuHld2WWGEPyWRubcgb4e6xO2F4jo96NSZhuAP8iarY5LiCtTydLPBXcEbbD146jLD7S83Mhij4VS5sO1asESNH5y8_5Z2PvLcZE11WiTS9alu-9AUqXNixw1t9Y5Em6xDle7s8-oiF3nPVM80RIdbJel4LoeCZuB2zgddLaJAYx5tSb03-QGNzupOPQ5UQ0_7ybPwmAsgiFfFNuvMbj9sKgxLg > Location: > https://knox-gateway/gateway/bigdata/webhdfs/data/v1/webhdfs/v1/user/shfs3453/WORK/datasets/test_▒lectronique_embarqu▒.pdf?_=CBEAl_jkRL_c3Tzm7hoXMR1KPge4OClEqM4hfs3eslFzfdY5CBbrfaMzOa--NXb08Xjw2O11CkOtyUX5kXwh2IgZmxjw_TNHqQUvVAfFkeXiMDiBXxpbhulsVx3o_NLn9pCLsp09xJ9r1utCHrueYOAvuxY_ksQWuHld2WWGEPyWRubcgb4e6xO2F4jo96NSZhuAP8iarY5LiCtTydLPBXcEbbD146jLD7S83Mhij4VS5sO1asESNH5y8_5Z2PvLcZE11WiTS9alu-9AUqXNixw1t9Y5Em6xDle7s8-oiF3nPVM80RIdbJel4LoeCZuB2zgddLaJAYx5tSb03-QGNzupOPQ5UQ0_7ybPwmAsgiFfFNuvMbj9sKgxLg > < Content-Type: application/octet-stream > Content-Type:
[jira] [Commented] (KNOX-754) curl requests fail when dealing with special characters
[ https://issues.apache.org/jira/browse/KNOX-754?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15582526#comment-15582526 ] Sumit Gupta commented on KNOX-754: -- Hey [~BigDataOrange], sorry I took time to come back to this. I think your issue may lie in the change to "hadoop-version" in the pom files. While we are somewhat dated in our dependency we know that works well for our build at this time. This dependency does not reflect the version we can run against, it is just the library we needed to build and have not needed to update that yet. Please try this again without changing that value. > curl requests fail when dealing with special characters > --- > > Key: KNOX-754 > URL: https://issues.apache.org/jira/browse/KNOX-754 > Project: Apache Knox > Issue Type: Bug > Components: ClientDSL, Server >Affects Versions: 0.9.1 > Environment: Apache Knox 0.9.1, Apache Hadoop 2.7.2 >Reporter: Alexandre Linte >Assignee: Sumit Gupta >Priority: Critical > Fix For: 0.10.0 > > Attachments: KNOX_754.patch > > > Since Knox 0.9.1, Knox can't work with files which contain special characters > as : é, ù, ü, è, etc... This is reproducible at 100%. It was working well > with Knox 0.7.0 so it's a regression. > This happens when doing a GET or a PUT of a file of this type, and more > particularly at the "location" process of the request. You can find an > example below: > {noformat} > [shfs3453@spark01 Pig]$ curl -Iikv -u shfs3453 -X GET > 'https://knox-gateway.fr/gateway/bigdata/webhdfs/v1/user/shfs3453/WORK/datasets/test_électronique_embarqué.pdf?OP=OPEN' > Enter host password for user 'shfs3453': > * About to connect() to knox-gateway port 443 (#0) > * Trying 10.117.41.12... connected > * Connected to knox-gateway (10.117.41.12) port 443 (#0) > * Initializing NSS with certpath: sql:/etc/pki/nssdb > * warning: ignoring value of ssl.verifyhost > * skipping SSL peer certificate verification > * SSL connection using TLS_ECDHE_RSA_WITH_AES_256_CBC_SHA > * Server certificate: > * subject: > E=@*,CN=knox-gateway,OU=*,O=,L=*,ST=*,C=*** > * start date: Nov 07 11:33:05 2014 GMT > * expire date: Nov 06 11:33:05 2019 GMT > * common name: knox-gateway > * issuer: CN=***,OU=***,OU=,O=**,C=*** > * Server auth using Basic with user 'shfs3453' > > GET > > /gateway/bigdata/webhdfs/v1/user/shfs3453/WORK/datasets/test_électronique_embarqué.pdf?OP=OPEN > > HTTP/1.1 > > Authorization: Basic c2hmczM0NTM6UGIxOTkxMTAh > > User-Agent: curl/7.19.7 (x86_64-redhat-linux-gnu) libcurl/7.19.7 NSS/3.19.1 > > Basic ECC zlib/1.2.3 libidn/1.18 libssh2/1.4.2 > > Host: knox-gateway > > Accept: */* > > > < HTTP/1.1 307 Temporary Redirect > HTTP/1.1 307 Temporary Redirect > < Date: Wed, 05 Oct 2016 07:19:55 GMT > Date: Wed, 05 Oct 2016 07:19:55 GMT > < Set-Cookie: > JSESSIONID=4zv7v1911q5vvcg6r1tqxe77;Path=/gateway/bigdata;Secure;HttpOnly > Set-Cookie: > JSESSIONID=4zv7v1911q5vvcg6r1tqxe77;Path=/gateway/bigdata;Secure;HttpOnly > < Expires: Thu, 01 Jan 1970 00:00:00 GMT > Expires: Thu, 01 Jan 1970 00:00:00 GMT > < Set-Cookie: rememberMe=deleteMe; Path=/gateway/bigdata; Max-Age=0; > Expires=Tue, 04-Oct-2016 07:19:56 GMT > Set-Cookie: rememberMe=deleteMe; Path=/gateway/bigdata; Max-Age=0; > Expires=Tue, 04-Oct-2016 07:19:56 GMT > < Cache-Control: no-cache > Cache-Control: no-cache > < Expires: Wed, 05 Oct 2016 07:19:56 GMT > Expires: Wed, 05 Oct 2016 07:19:56 GMT > < Date: Wed, 05 Oct 2016 07:19:56 GMT > Date: Wed, 05 Oct 2016 07:19:56 GMT > < Pragma: no-cache > Pragma: no-cache > < Expires: Wed, 05 Oct 2016 07:19:56 GMT > Expires: Wed, 05 Oct 2016 07:19:56 GMT > < Date: Wed, 05 Oct 2016 07:19:56 GMT > Date: Wed, 05 Oct 2016 07:19:56 GMT > < Pragma: no-cache > Pragma: no-cache > < Location: > https://knox-gateway/gateway/bigdata/webhdfs/data/v1/webhdfs/v1/user/shfs3453/WORK/datasets/test_▒lectronique_embarqu▒.pdf?_=CBEAl_jkRL_c3Tzm7hoXMR1KPge4OClEqM4hfs3eslFzfdY5CBbrfaMzOa--NXb08Xjw2O11CkOtyUX5kXwh2IgZmxjw_TNHqQUvVAfFkeXiMDiBXxpbhulsVx3o_NLn9pCLsp09xJ9r1utCHrueYOAvuxY_ksQWuHld2WWGEPyWRubcgb4e6xO2F4jo96NSZhuAP8iarY5LiCtTydLPBXcEbbD146jLD7S83Mhij4VS5sO1asESNH5y8_5Z2PvLcZE11WiTS9alu-9AUqXNixw1t9Y5Em6xDle7s8-oiF3nPVM80RIdbJel4LoeCZuB2zgddLaJAYx5tSb03-QGNzupOPQ5UQ0_7ybPwmAsgiFfFNuvMbj9sKgxLg > Location: >
[jira] [Commented] (KNOX-754) curl requests fail when dealing with special characters
[ https://issues.apache.org/jira/browse/KNOX-754?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15572193#comment-15572193 ] Alexandre Linte commented on KNOX-754: -- I recompiled Knox from the sources (stable release), not from the master branch. This might be the cause. I'm using Java 1.7 and Ant 1.9. > curl requests fail when dealing with special characters > --- > > Key: KNOX-754 > URL: https://issues.apache.org/jira/browse/KNOX-754 > Project: Apache Knox > Issue Type: Bug > Components: ClientDSL, Server >Affects Versions: 0.9.1 > Environment: Apache Knox 0.9.1, Apache Hadoop 2.7.2 >Reporter: Alexandre Linte >Assignee: Sumit Gupta >Priority: Critical > Fix For: 0.10.0 > > Attachments: KNOX_754.patch > > > Since Knox 0.9.1, Knox can't work with files which contain special characters > as : é, ù, ü, è, etc... This is reproducible at 100%. It was working well > with Knox 0.7.0 so it's a regression. > This happens when doing a GET or a PUT of a file of this type, and more > particularly at the "location" process of the request. You can find an > example below: > {noformat} > [shfs3453@spark01 Pig]$ curl -Iikv -u shfs3453 -X GET > 'https://knox-gateway.fr/gateway/bigdata/webhdfs/v1/user/shfs3453/WORK/datasets/test_électronique_embarqué.pdf?OP=OPEN' > Enter host password for user 'shfs3453': > * About to connect() to knox-gateway port 443 (#0) > * Trying 10.117.41.12... connected > * Connected to knox-gateway (10.117.41.12) port 443 (#0) > * Initializing NSS with certpath: sql:/etc/pki/nssdb > * warning: ignoring value of ssl.verifyhost > * skipping SSL peer certificate verification > * SSL connection using TLS_ECDHE_RSA_WITH_AES_256_CBC_SHA > * Server certificate: > * subject: > E=@*,CN=knox-gateway,OU=*,O=,L=*,ST=*,C=*** > * start date: Nov 07 11:33:05 2014 GMT > * expire date: Nov 06 11:33:05 2019 GMT > * common name: knox-gateway > * issuer: CN=***,OU=***,OU=,O=**,C=*** > * Server auth using Basic with user 'shfs3453' > > GET > > /gateway/bigdata/webhdfs/v1/user/shfs3453/WORK/datasets/test_électronique_embarqué.pdf?OP=OPEN > > HTTP/1.1 > > Authorization: Basic c2hmczM0NTM6UGIxOTkxMTAh > > User-Agent: curl/7.19.7 (x86_64-redhat-linux-gnu) libcurl/7.19.7 NSS/3.19.1 > > Basic ECC zlib/1.2.3 libidn/1.18 libssh2/1.4.2 > > Host: knox-gateway > > Accept: */* > > > < HTTP/1.1 307 Temporary Redirect > HTTP/1.1 307 Temporary Redirect > < Date: Wed, 05 Oct 2016 07:19:55 GMT > Date: Wed, 05 Oct 2016 07:19:55 GMT > < Set-Cookie: > JSESSIONID=4zv7v1911q5vvcg6r1tqxe77;Path=/gateway/bigdata;Secure;HttpOnly > Set-Cookie: > JSESSIONID=4zv7v1911q5vvcg6r1tqxe77;Path=/gateway/bigdata;Secure;HttpOnly > < Expires: Thu, 01 Jan 1970 00:00:00 GMT > Expires: Thu, 01 Jan 1970 00:00:00 GMT > < Set-Cookie: rememberMe=deleteMe; Path=/gateway/bigdata; Max-Age=0; > Expires=Tue, 04-Oct-2016 07:19:56 GMT > Set-Cookie: rememberMe=deleteMe; Path=/gateway/bigdata; Max-Age=0; > Expires=Tue, 04-Oct-2016 07:19:56 GMT > < Cache-Control: no-cache > Cache-Control: no-cache > < Expires: Wed, 05 Oct 2016 07:19:56 GMT > Expires: Wed, 05 Oct 2016 07:19:56 GMT > < Date: Wed, 05 Oct 2016 07:19:56 GMT > Date: Wed, 05 Oct 2016 07:19:56 GMT > < Pragma: no-cache > Pragma: no-cache > < Expires: Wed, 05 Oct 2016 07:19:56 GMT > Expires: Wed, 05 Oct 2016 07:19:56 GMT > < Date: Wed, 05 Oct 2016 07:19:56 GMT > Date: Wed, 05 Oct 2016 07:19:56 GMT > < Pragma: no-cache > Pragma: no-cache > < Location: > https://knox-gateway/gateway/bigdata/webhdfs/data/v1/webhdfs/v1/user/shfs3453/WORK/datasets/test_▒lectronique_embarqu▒.pdf?_=CBEAl_jkRL_c3Tzm7hoXMR1KPge4OClEqM4hfs3eslFzfdY5CBbrfaMzOa--NXb08Xjw2O11CkOtyUX5kXwh2IgZmxjw_TNHqQUvVAfFkeXiMDiBXxpbhulsVx3o_NLn9pCLsp09xJ9r1utCHrueYOAvuxY_ksQWuHld2WWGEPyWRubcgb4e6xO2F4jo96NSZhuAP8iarY5LiCtTydLPBXcEbbD146jLD7S83Mhij4VS5sO1asESNH5y8_5Z2PvLcZE11WiTS9alu-9AUqXNixw1t9Y5Em6xDle7s8-oiF3nPVM80RIdbJel4LoeCZuB2zgddLaJAYx5tSb03-QGNzupOPQ5UQ0_7ybPwmAsgiFfFNuvMbj9sKgxLg > Location: > https://knox-gateway/gateway/bigdata/webhdfs/data/v1/webhdfs/v1/user/shfs3453/WORK/datasets/test_▒lectronique_embarqu▒.pdf?_=CBEAl_jkRL_c3Tzm7hoXMR1KPge4OClEqM4hfs3eslFzfdY5CBbrfaMzOa--NXb08Xjw2O11CkOtyUX5kXwh2IgZmxjw_TNHqQUvVAfFkeXiMDiBXxpbhulsVx3o_NLn9pCLsp09xJ9r1utCHrueYOAvuxY_ksQWuHld2WWGEPyWRubcgb4e6xO2F4jo96NSZhuAP8iarY5LiCtTydLPBXcEbbD146jLD7S83Mhij4VS5sO1asESNH5y8_5Z2PvLcZE11WiTS9alu-9AUqXNixw1t9Y5Em6xDle7s8-oiF3nPVM80RIdbJel4LoeCZuB2zgddLaJAYx5tSb03-QGNzupOPQ5UQ0_7ybPwmAsgiFfFNuvMbj9sKgxLg > < Content-Type: application/octet-stream > Content-Type: application/octet-stream > < Server: Jetty(6.1.26) > Server: Jetty(6.1.26) > < Content-Length: 0 > Content-Length: 0 > < > *
[jira] [Commented] (KNOX-754) curl requests fail when dealing with special characters
[ https://issues.apache.org/jira/browse/KNOX-754?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15572232#comment-15572232 ] Alexandre Linte commented on KNOX-754: -- The sources I used are those: http://apache.mirrors.ovh.net/ftp.apache.org/dist/knox/0.9.1/knox-0.9.1-src.zip First I updated the pom.xml to set "hadoop-version" to 2.7.2 which is currently my Hadoop version. Then I edited the file "UrlRewriteResponse.java" to make the patch effective and finally recompiled with "ant release". > curl requests fail when dealing with special characters > --- > > Key: KNOX-754 > URL: https://issues.apache.org/jira/browse/KNOX-754 > Project: Apache Knox > Issue Type: Bug > Components: ClientDSL, Server >Affects Versions: 0.9.1 > Environment: Apache Knox 0.9.1, Apache Hadoop 2.7.2 >Reporter: Alexandre Linte >Assignee: Sumit Gupta >Priority: Critical > Fix For: 0.10.0 > > Attachments: KNOX_754.patch > > > Since Knox 0.9.1, Knox can't work with files which contain special characters > as : é, ù, ü, è, etc... This is reproducible at 100%. It was working well > with Knox 0.7.0 so it's a regression. > This happens when doing a GET or a PUT of a file of this type, and more > particularly at the "location" process of the request. You can find an > example below: > {noformat} > [shfs3453@spark01 Pig]$ curl -Iikv -u shfs3453 -X GET > 'https://knox-gateway.fr/gateway/bigdata/webhdfs/v1/user/shfs3453/WORK/datasets/test_électronique_embarqué.pdf?OP=OPEN' > Enter host password for user 'shfs3453': > * About to connect() to knox-gateway port 443 (#0) > * Trying 10.117.41.12... connected > * Connected to knox-gateway (10.117.41.12) port 443 (#0) > * Initializing NSS with certpath: sql:/etc/pki/nssdb > * warning: ignoring value of ssl.verifyhost > * skipping SSL peer certificate verification > * SSL connection using TLS_ECDHE_RSA_WITH_AES_256_CBC_SHA > * Server certificate: > * subject: > E=@*,CN=knox-gateway,OU=*,O=,L=*,ST=*,C=*** > * start date: Nov 07 11:33:05 2014 GMT > * expire date: Nov 06 11:33:05 2019 GMT > * common name: knox-gateway > * issuer: CN=***,OU=***,OU=,O=**,C=*** > * Server auth using Basic with user 'shfs3453' > > GET > > /gateway/bigdata/webhdfs/v1/user/shfs3453/WORK/datasets/test_électronique_embarqué.pdf?OP=OPEN > > HTTP/1.1 > > Authorization: Basic c2hmczM0NTM6UGIxOTkxMTAh > > User-Agent: curl/7.19.7 (x86_64-redhat-linux-gnu) libcurl/7.19.7 NSS/3.19.1 > > Basic ECC zlib/1.2.3 libidn/1.18 libssh2/1.4.2 > > Host: knox-gateway > > Accept: */* > > > < HTTP/1.1 307 Temporary Redirect > HTTP/1.1 307 Temporary Redirect > < Date: Wed, 05 Oct 2016 07:19:55 GMT > Date: Wed, 05 Oct 2016 07:19:55 GMT > < Set-Cookie: > JSESSIONID=4zv7v1911q5vvcg6r1tqxe77;Path=/gateway/bigdata;Secure;HttpOnly > Set-Cookie: > JSESSIONID=4zv7v1911q5vvcg6r1tqxe77;Path=/gateway/bigdata;Secure;HttpOnly > < Expires: Thu, 01 Jan 1970 00:00:00 GMT > Expires: Thu, 01 Jan 1970 00:00:00 GMT > < Set-Cookie: rememberMe=deleteMe; Path=/gateway/bigdata; Max-Age=0; > Expires=Tue, 04-Oct-2016 07:19:56 GMT > Set-Cookie: rememberMe=deleteMe; Path=/gateway/bigdata; Max-Age=0; > Expires=Tue, 04-Oct-2016 07:19:56 GMT > < Cache-Control: no-cache > Cache-Control: no-cache > < Expires: Wed, 05 Oct 2016 07:19:56 GMT > Expires: Wed, 05 Oct 2016 07:19:56 GMT > < Date: Wed, 05 Oct 2016 07:19:56 GMT > Date: Wed, 05 Oct 2016 07:19:56 GMT > < Pragma: no-cache > Pragma: no-cache > < Expires: Wed, 05 Oct 2016 07:19:56 GMT > Expires: Wed, 05 Oct 2016 07:19:56 GMT > < Date: Wed, 05 Oct 2016 07:19:56 GMT > Date: Wed, 05 Oct 2016 07:19:56 GMT > < Pragma: no-cache > Pragma: no-cache > < Location: > https://knox-gateway/gateway/bigdata/webhdfs/data/v1/webhdfs/v1/user/shfs3453/WORK/datasets/test_▒lectronique_embarqu▒.pdf?_=CBEAl_jkRL_c3Tzm7hoXMR1KPge4OClEqM4hfs3eslFzfdY5CBbrfaMzOa--NXb08Xjw2O11CkOtyUX5kXwh2IgZmxjw_TNHqQUvVAfFkeXiMDiBXxpbhulsVx3o_NLn9pCLsp09xJ9r1utCHrueYOAvuxY_ksQWuHld2WWGEPyWRubcgb4e6xO2F4jo96NSZhuAP8iarY5LiCtTydLPBXcEbbD146jLD7S83Mhij4VS5sO1asESNH5y8_5Z2PvLcZE11WiTS9alu-9AUqXNixw1t9Y5Em6xDle7s8-oiF3nPVM80RIdbJel4LoeCZuB2zgddLaJAYx5tSb03-QGNzupOPQ5UQ0_7ybPwmAsgiFfFNuvMbj9sKgxLg > Location: >
[jira] [Commented] (KNOX-754) curl requests fail when dealing with special characters
[ https://issues.apache.org/jira/browse/KNOX-754?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15572210#comment-15572210 ] Sumit Gupta commented on KNOX-754: -- Thanks for that clarification. Just so that I can try to reproduce this, which exact stable release did you use? > curl requests fail when dealing with special characters > --- > > Key: KNOX-754 > URL: https://issues.apache.org/jira/browse/KNOX-754 > Project: Apache Knox > Issue Type: Bug > Components: ClientDSL, Server >Affects Versions: 0.9.1 > Environment: Apache Knox 0.9.1, Apache Hadoop 2.7.2 >Reporter: Alexandre Linte >Assignee: Sumit Gupta >Priority: Critical > Fix For: 0.10.0 > > Attachments: KNOX_754.patch > > > Since Knox 0.9.1, Knox can't work with files which contain special characters > as : é, ù, ü, è, etc... This is reproducible at 100%. It was working well > with Knox 0.7.0 so it's a regression. > This happens when doing a GET or a PUT of a file of this type, and more > particularly at the "location" process of the request. You can find an > example below: > {noformat} > [shfs3453@spark01 Pig]$ curl -Iikv -u shfs3453 -X GET > 'https://knox-gateway.fr/gateway/bigdata/webhdfs/v1/user/shfs3453/WORK/datasets/test_électronique_embarqué.pdf?OP=OPEN' > Enter host password for user 'shfs3453': > * About to connect() to knox-gateway port 443 (#0) > * Trying 10.117.41.12... connected > * Connected to knox-gateway (10.117.41.12) port 443 (#0) > * Initializing NSS with certpath: sql:/etc/pki/nssdb > * warning: ignoring value of ssl.verifyhost > * skipping SSL peer certificate verification > * SSL connection using TLS_ECDHE_RSA_WITH_AES_256_CBC_SHA > * Server certificate: > * subject: > E=@*,CN=knox-gateway,OU=*,O=,L=*,ST=*,C=*** > * start date: Nov 07 11:33:05 2014 GMT > * expire date: Nov 06 11:33:05 2019 GMT > * common name: knox-gateway > * issuer: CN=***,OU=***,OU=,O=**,C=*** > * Server auth using Basic with user 'shfs3453' > > GET > > /gateway/bigdata/webhdfs/v1/user/shfs3453/WORK/datasets/test_électronique_embarqué.pdf?OP=OPEN > > HTTP/1.1 > > Authorization: Basic c2hmczM0NTM6UGIxOTkxMTAh > > User-Agent: curl/7.19.7 (x86_64-redhat-linux-gnu) libcurl/7.19.7 NSS/3.19.1 > > Basic ECC zlib/1.2.3 libidn/1.18 libssh2/1.4.2 > > Host: knox-gateway > > Accept: */* > > > < HTTP/1.1 307 Temporary Redirect > HTTP/1.1 307 Temporary Redirect > < Date: Wed, 05 Oct 2016 07:19:55 GMT > Date: Wed, 05 Oct 2016 07:19:55 GMT > < Set-Cookie: > JSESSIONID=4zv7v1911q5vvcg6r1tqxe77;Path=/gateway/bigdata;Secure;HttpOnly > Set-Cookie: > JSESSIONID=4zv7v1911q5vvcg6r1tqxe77;Path=/gateway/bigdata;Secure;HttpOnly > < Expires: Thu, 01 Jan 1970 00:00:00 GMT > Expires: Thu, 01 Jan 1970 00:00:00 GMT > < Set-Cookie: rememberMe=deleteMe; Path=/gateway/bigdata; Max-Age=0; > Expires=Tue, 04-Oct-2016 07:19:56 GMT > Set-Cookie: rememberMe=deleteMe; Path=/gateway/bigdata; Max-Age=0; > Expires=Tue, 04-Oct-2016 07:19:56 GMT > < Cache-Control: no-cache > Cache-Control: no-cache > < Expires: Wed, 05 Oct 2016 07:19:56 GMT > Expires: Wed, 05 Oct 2016 07:19:56 GMT > < Date: Wed, 05 Oct 2016 07:19:56 GMT > Date: Wed, 05 Oct 2016 07:19:56 GMT > < Pragma: no-cache > Pragma: no-cache > < Expires: Wed, 05 Oct 2016 07:19:56 GMT > Expires: Wed, 05 Oct 2016 07:19:56 GMT > < Date: Wed, 05 Oct 2016 07:19:56 GMT > Date: Wed, 05 Oct 2016 07:19:56 GMT > < Pragma: no-cache > Pragma: no-cache > < Location: > https://knox-gateway/gateway/bigdata/webhdfs/data/v1/webhdfs/v1/user/shfs3453/WORK/datasets/test_▒lectronique_embarqu▒.pdf?_=CBEAl_jkRL_c3Tzm7hoXMR1KPge4OClEqM4hfs3eslFzfdY5CBbrfaMzOa--NXb08Xjw2O11CkOtyUX5kXwh2IgZmxjw_TNHqQUvVAfFkeXiMDiBXxpbhulsVx3o_NLn9pCLsp09xJ9r1utCHrueYOAvuxY_ksQWuHld2WWGEPyWRubcgb4e6xO2F4jo96NSZhuAP8iarY5LiCtTydLPBXcEbbD146jLD7S83Mhij4VS5sO1asESNH5y8_5Z2PvLcZE11WiTS9alu-9AUqXNixw1t9Y5Em6xDle7s8-oiF3nPVM80RIdbJel4LoeCZuB2zgddLaJAYx5tSb03-QGNzupOPQ5UQ0_7ybPwmAsgiFfFNuvMbj9sKgxLg > Location: > https://knox-gateway/gateway/bigdata/webhdfs/data/v1/webhdfs/v1/user/shfs3453/WORK/datasets/test_▒lectronique_embarqu▒.pdf?_=CBEAl_jkRL_c3Tzm7hoXMR1KPge4OClEqM4hfs3eslFzfdY5CBbrfaMzOa--NXb08Xjw2O11CkOtyUX5kXwh2IgZmxjw_TNHqQUvVAfFkeXiMDiBXxpbhulsVx3o_NLn9pCLsp09xJ9r1utCHrueYOAvuxY_ksQWuHld2WWGEPyWRubcgb4e6xO2F4jo96NSZhuAP8iarY5LiCtTydLPBXcEbbD146jLD7S83Mhij4VS5sO1asESNH5y8_5Z2PvLcZE11WiTS9alu-9AUqXNixw1t9Y5Em6xDle7s8-oiF3nPVM80RIdbJel4LoeCZuB2zgddLaJAYx5tSb03-QGNzupOPQ5UQ0_7ybPwmAsgiFfFNuvMbj9sKgxLg > < Content-Type: application/octet-stream > Content-Type: application/octet-stream > < Server: Jetty(6.1.26) > Server: Jetty(6.1.26) > < Content-Length: 0 > Content-Length: 0 > < > * Connection #0 to host knox-gateway
[jira] [Commented] (KNOX-754) curl requests fail when dealing with special characters
[ https://issues.apache.org/jira/browse/KNOX-754?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15571595#comment-15571595 ] Sumit Gupta commented on KNOX-754: -- Thanks for bringing this up, however I don't see this issue. Did you apply the patch to master branch and build it? Also what JDK are you on? > curl requests fail when dealing with special characters > --- > > Key: KNOX-754 > URL: https://issues.apache.org/jira/browse/KNOX-754 > Project: Apache Knox > Issue Type: Bug > Components: ClientDSL, Server >Affects Versions: 0.9.1 > Environment: Apache Knox 0.9.1, Apache Hadoop 2.7.2 >Reporter: Alexandre Linte >Assignee: Sumit Gupta >Priority: Critical > Fix For: 0.10.0 > > Attachments: KNOX_754.patch > > > Since Knox 0.9.1, Knox can't work with files which contain special characters > as : é, ù, ü, è, etc... This is reproducible at 100%. It was working well > with Knox 0.7.0 so it's a regression. > This happens when doing a GET or a PUT of a file of this type, and more > particularly at the "location" process of the request. You can find an > example below: > {noformat} > [shfs3453@spark01 Pig]$ curl -Iikv -u shfs3453 -X GET > 'https://knox-gateway.fr/gateway/bigdata/webhdfs/v1/user/shfs3453/WORK/datasets/test_électronique_embarqué.pdf?OP=OPEN' > Enter host password for user 'shfs3453': > * About to connect() to knox-gateway port 443 (#0) > * Trying 10.117.41.12... connected > * Connected to knox-gateway (10.117.41.12) port 443 (#0) > * Initializing NSS with certpath: sql:/etc/pki/nssdb > * warning: ignoring value of ssl.verifyhost > * skipping SSL peer certificate verification > * SSL connection using TLS_ECDHE_RSA_WITH_AES_256_CBC_SHA > * Server certificate: > * subject: > E=@*,CN=knox-gateway,OU=*,O=,L=*,ST=*,C=*** > * start date: Nov 07 11:33:05 2014 GMT > * expire date: Nov 06 11:33:05 2019 GMT > * common name: knox-gateway > * issuer: CN=***,OU=***,OU=,O=**,C=*** > * Server auth using Basic with user 'shfs3453' > > GET > > /gateway/bigdata/webhdfs/v1/user/shfs3453/WORK/datasets/test_électronique_embarqué.pdf?OP=OPEN > > HTTP/1.1 > > Authorization: Basic c2hmczM0NTM6UGIxOTkxMTAh > > User-Agent: curl/7.19.7 (x86_64-redhat-linux-gnu) libcurl/7.19.7 NSS/3.19.1 > > Basic ECC zlib/1.2.3 libidn/1.18 libssh2/1.4.2 > > Host: knox-gateway > > Accept: */* > > > < HTTP/1.1 307 Temporary Redirect > HTTP/1.1 307 Temporary Redirect > < Date: Wed, 05 Oct 2016 07:19:55 GMT > Date: Wed, 05 Oct 2016 07:19:55 GMT > < Set-Cookie: > JSESSIONID=4zv7v1911q5vvcg6r1tqxe77;Path=/gateway/bigdata;Secure;HttpOnly > Set-Cookie: > JSESSIONID=4zv7v1911q5vvcg6r1tqxe77;Path=/gateway/bigdata;Secure;HttpOnly > < Expires: Thu, 01 Jan 1970 00:00:00 GMT > Expires: Thu, 01 Jan 1970 00:00:00 GMT > < Set-Cookie: rememberMe=deleteMe; Path=/gateway/bigdata; Max-Age=0; > Expires=Tue, 04-Oct-2016 07:19:56 GMT > Set-Cookie: rememberMe=deleteMe; Path=/gateway/bigdata; Max-Age=0; > Expires=Tue, 04-Oct-2016 07:19:56 GMT > < Cache-Control: no-cache > Cache-Control: no-cache > < Expires: Wed, 05 Oct 2016 07:19:56 GMT > Expires: Wed, 05 Oct 2016 07:19:56 GMT > < Date: Wed, 05 Oct 2016 07:19:56 GMT > Date: Wed, 05 Oct 2016 07:19:56 GMT > < Pragma: no-cache > Pragma: no-cache > < Expires: Wed, 05 Oct 2016 07:19:56 GMT > Expires: Wed, 05 Oct 2016 07:19:56 GMT > < Date: Wed, 05 Oct 2016 07:19:56 GMT > Date: Wed, 05 Oct 2016 07:19:56 GMT > < Pragma: no-cache > Pragma: no-cache > < Location: > https://knox-gateway/gateway/bigdata/webhdfs/data/v1/webhdfs/v1/user/shfs3453/WORK/datasets/test_▒lectronique_embarqu▒.pdf?_=CBEAl_jkRL_c3Tzm7hoXMR1KPge4OClEqM4hfs3eslFzfdY5CBbrfaMzOa--NXb08Xjw2O11CkOtyUX5kXwh2IgZmxjw_TNHqQUvVAfFkeXiMDiBXxpbhulsVx3o_NLn9pCLsp09xJ9r1utCHrueYOAvuxY_ksQWuHld2WWGEPyWRubcgb4e6xO2F4jo96NSZhuAP8iarY5LiCtTydLPBXcEbbD146jLD7S83Mhij4VS5sO1asESNH5y8_5Z2PvLcZE11WiTS9alu-9AUqXNixw1t9Y5Em6xDle7s8-oiF3nPVM80RIdbJel4LoeCZuB2zgddLaJAYx5tSb03-QGNzupOPQ5UQ0_7ybPwmAsgiFfFNuvMbj9sKgxLg > Location: > https://knox-gateway/gateway/bigdata/webhdfs/data/v1/webhdfs/v1/user/shfs3453/WORK/datasets/test_▒lectronique_embarqu▒.pdf?_=CBEAl_jkRL_c3Tzm7hoXMR1KPge4OClEqM4hfs3eslFzfdY5CBbrfaMzOa--NXb08Xjw2O11CkOtyUX5kXwh2IgZmxjw_TNHqQUvVAfFkeXiMDiBXxpbhulsVx3o_NLn9pCLsp09xJ9r1utCHrueYOAvuxY_ksQWuHld2WWGEPyWRubcgb4e6xO2F4jo96NSZhuAP8iarY5LiCtTydLPBXcEbbD146jLD7S83Mhij4VS5sO1asESNH5y8_5Z2PvLcZE11WiTS9alu-9AUqXNixw1t9Y5Em6xDle7s8-oiF3nPVM80RIdbJel4LoeCZuB2zgddLaJAYx5tSb03-QGNzupOPQ5UQ0_7ybPwmAsgiFfFNuvMbj9sKgxLg > < Content-Type: application/octet-stream > Content-Type: application/octet-stream > < Server: Jetty(6.1.26) > Server: Jetty(6.1.26) > < Content-Length: 0 > Content-Length: 0 > < > * Connection
[jira] [Commented] (KNOX-754) curl requests fail when dealing with special characters
[ https://issues.apache.org/jira/browse/KNOX-754?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15571246#comment-15571246 ] Alexandre Linte commented on KNOX-754: -- I'm not 100% sure if it's related to the patch, but now when Knox starts I have the following errors is the logs: {noformat} Oct 13 10:20:50 localhost java.lang.IncompatibleClassChangeError: org/eclipse/jetty/annotations/AnnotationParser$MyClassVisitor Oct 13 10:20:50 localhost at org.eclipse.jetty.annotations.AnnotationParser.scanClass(AnnotationParser.java:974) Oct 13 10:20:50 localhost at org.eclipse.jetty.annotations.AnnotationParser.parseJarEntry(AnnotationParser.java:956) Oct 13 10:20:50 localhost at org.eclipse.jetty.annotations.AnnotationParser.parseJar(AnnotationParser.java:909) Oct 13 10:20:50 localhost at org.eclipse.jetty.annotations.AnnotationParser.parse(AnnotationParser.java:831) Oct 13 10:20:50 localhost at org.eclipse.jetty.annotations.AnnotationConfiguration$ParserTask.call(AnnotationConfiguration.java:164) Oct 13 10:20:50 localhost at org.eclipse.jetty.annotations.AnnotationConfiguration$1.run(AnnotationConfiguration.java:549) Oct 13 10:20:50 localhost at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:635) Oct 13 10:20:50 localhost at org.eclipse.jetty.util.thread.QueuedThreadPool$3.run(QueuedThreadPool.java:555) Oct 13 10:20:50 localhost at java.lang.Thread.run(Thread.java:745) Oct 13 10:20:50 knox-gateway.fr knox WARN - org.eclipse.jetty.util.thread.QueuedThreadPool Oct 13 10:20:50 localhost java.lang.IncompatibleClassChangeError: class org.eclipse.jetty.annotations.AnnotationParser$MyClassVisitor has interface org.objectweb.asm.ClassVisitor as super class Oct 13 10:20:50 localhost at java.lang.ClassLoader.defineClass1(Native Method) Oct 13 10:20:50 localhost at java.lang.ClassLoader.defineClass(ClassLoader.java:803) Oct 13 10:20:50 localhost at java.security.SecureClassLoader.defineClass(SecureClassLoader.java:142) Oct 13 10:20:50 localhost at java.net.URLClassLoader.defineClass(URLClassLoader.java:449) Oct 13 10:20:50 localhost at java.net.URLClassLoader.access$100(URLClassLoader.java:71) Oct 13 10:20:50 localhost at java.net.URLClassLoader$1.run(URLClassLoader.java:361) Oct 13 10:20:50 localhost at java.net.URLClassLoader$1.run(URLClassLoader.java:355) Oct 13 10:20:50 localhost at java.security.AccessController.doPrivileged(Native Method) Oct 13 10:20:50 localhost at java.net.URLClassLoader.findClass(URLClassLoader.java:354) Oct 13 10:20:50 localhost at java.lang.ClassLoader.loadClass(ClassLoader.java:425) Oct 13 10:20:50 localhost at java.lang.ClassLoader.loadClass(ClassLoader.java:358) Oct 13 10:20:50 localhost at org.eclipse.jetty.annotations.AnnotationParser.scanClass(AnnotationParser.java:974) Oct 13 10:20:50 localhost at org.eclipse.jetty.annotations.AnnotationParser.parseJarEntry(AnnotationParser.java:956) Oct 13 10:20:50 localhost at org.eclipse.jetty.annotations.AnnotationParser.parseJar(AnnotationParser.java:909) Oct 13 10:20:50 localhost at org.eclipse.jetty.annotations.AnnotationParser.parse(AnnotationParser.java:831) Oct 13 10:20:50 localhost at org.eclipse.jetty.annotations.AnnotationConfiguration$ParserTask.call(AnnotationConfiguration.java:164) Oct 13 10:20:50 localhost at org.eclipse.jetty.annotations.AnnotationConfiguration$1.run(AnnotationConfiguration.java:549) Oct 13 10:20:50 localhost at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:635) Oct 13 10:20:50 localhost at org.eclipse.jetty.util.thread.QueuedThreadPool$3.run(QueuedThreadPool.java:555) Oct 13 10:20:50 localhost at java.lang.Thread.run(Thread.java:745) Oct 13 10:20:50 knox-gateway.fr knox WARN - org.eclipse.jetty.util.thread.QueuedThreadPool Oct 13 10:20:50 localhost java.lang.IncompatibleClassChangeError: org/eclipse/jetty/annotations/AnnotationParser$MyClassVisitor Oct 13 10:20:50 localhost at org.eclipse.jetty.annotations.AnnotationParser.scanClass(AnnotationParser.java:974) Oct 13 10:20:50 localhost at org.eclipse.jetty.annotations.AnnotationParser.parseJarEntry(AnnotationParser.java:956) Oct 13 10:20:50 localhost at org.eclipse.jetty.annotations.AnnotationParser.parseJar(AnnotationParser.java:909) Oct 13 10:20:50 localhost at org.eclipse.jetty.annotations.AnnotationParser.parse(AnnotationParser.java:831) Oct 13 10:20:50 localhost at org.eclipse.jetty.annotations.AnnotationConfiguration$ParserTask.call(AnnotationConfiguration.java:164) Oct 13 10:20:50 localhost at org.eclipse.jetty.annotations.AnnotationConfiguration$1.run(AnnotationConfiguration.java:549) Oct 13 10:20:50 localhost at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:635) Oct 13 10:20:50 localhost at
[jira] [Commented] (KNOX-754) curl requests fail when dealing with special characters
[ https://issues.apache.org/jira/browse/KNOX-754?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15568661#comment-15568661 ] ASF subversion and git services commented on KNOX-754: -- Commit a124909eb4dcefb0fa285a6f9f3a87ca5b9bd14c in knox's branch refs/heads/v0.9.0 from [~sumit.gupta] [ https://git-wip-us.apache.org/repos/asf?p=knox.git;h=a124909 ] KNOX-754 encoding response headers > curl requests fail when dealing with special characters > --- > > Key: KNOX-754 > URL: https://issues.apache.org/jira/browse/KNOX-754 > Project: Apache Knox > Issue Type: Bug > Components: ClientDSL, Server >Affects Versions: 0.9.1 > Environment: Apache Knox 0.9.1, Apache Hadoop 2.7.2 >Reporter: Alexandre Linte >Assignee: Sumit Gupta >Priority: Critical > Fix For: 0.10.0 > > Attachments: KNOX_754.patch > > > Since Knox 0.9.1, Knox can't work with files which contain special characters > as : é, ù, ü, è, etc... This is reproducible at 100%. It was working well > with Knox 0.7.0 so it's a regression. > This happens when doing a GET or a PUT of a file of this type, and more > particularly at the "location" process of the request. You can find an > example below: > {noformat} > [shfs3453@spark01 Pig]$ curl -Iikv -u shfs3453 -X GET > 'https://knox-gateway.fr/gateway/bigdata/webhdfs/v1/user/shfs3453/WORK/datasets/test_électronique_embarqué.pdf?OP=OPEN' > Enter host password for user 'shfs3453': > * About to connect() to knox-gateway port 443 (#0) > * Trying 10.117.41.12... connected > * Connected to knox-gateway (10.117.41.12) port 443 (#0) > * Initializing NSS with certpath: sql:/etc/pki/nssdb > * warning: ignoring value of ssl.verifyhost > * skipping SSL peer certificate verification > * SSL connection using TLS_ECDHE_RSA_WITH_AES_256_CBC_SHA > * Server certificate: > * subject: > E=@*,CN=knox-gateway,OU=*,O=,L=*,ST=*,C=*** > * start date: Nov 07 11:33:05 2014 GMT > * expire date: Nov 06 11:33:05 2019 GMT > * common name: knox-gateway > * issuer: CN=***,OU=***,OU=,O=**,C=*** > * Server auth using Basic with user 'shfs3453' > > GET > > /gateway/bigdata/webhdfs/v1/user/shfs3453/WORK/datasets/test_électronique_embarqué.pdf?OP=OPEN > > HTTP/1.1 > > Authorization: Basic c2hmczM0NTM6UGIxOTkxMTAh > > User-Agent: curl/7.19.7 (x86_64-redhat-linux-gnu) libcurl/7.19.7 NSS/3.19.1 > > Basic ECC zlib/1.2.3 libidn/1.18 libssh2/1.4.2 > > Host: knox-gateway > > Accept: */* > > > < HTTP/1.1 307 Temporary Redirect > HTTP/1.1 307 Temporary Redirect > < Date: Wed, 05 Oct 2016 07:19:55 GMT > Date: Wed, 05 Oct 2016 07:19:55 GMT > < Set-Cookie: > JSESSIONID=4zv7v1911q5vvcg6r1tqxe77;Path=/gateway/bigdata;Secure;HttpOnly > Set-Cookie: > JSESSIONID=4zv7v1911q5vvcg6r1tqxe77;Path=/gateway/bigdata;Secure;HttpOnly > < Expires: Thu, 01 Jan 1970 00:00:00 GMT > Expires: Thu, 01 Jan 1970 00:00:00 GMT > < Set-Cookie: rememberMe=deleteMe; Path=/gateway/bigdata; Max-Age=0; > Expires=Tue, 04-Oct-2016 07:19:56 GMT > Set-Cookie: rememberMe=deleteMe; Path=/gateway/bigdata; Max-Age=0; > Expires=Tue, 04-Oct-2016 07:19:56 GMT > < Cache-Control: no-cache > Cache-Control: no-cache > < Expires: Wed, 05 Oct 2016 07:19:56 GMT > Expires: Wed, 05 Oct 2016 07:19:56 GMT > < Date: Wed, 05 Oct 2016 07:19:56 GMT > Date: Wed, 05 Oct 2016 07:19:56 GMT > < Pragma: no-cache > Pragma: no-cache > < Expires: Wed, 05 Oct 2016 07:19:56 GMT > Expires: Wed, 05 Oct 2016 07:19:56 GMT > < Date: Wed, 05 Oct 2016 07:19:56 GMT > Date: Wed, 05 Oct 2016 07:19:56 GMT > < Pragma: no-cache > Pragma: no-cache > < Location: > https://knox-gateway/gateway/bigdata/webhdfs/data/v1/webhdfs/v1/user/shfs3453/WORK/datasets/test_▒lectronique_embarqu▒.pdf?_=CBEAl_jkRL_c3Tzm7hoXMR1KPge4OClEqM4hfs3eslFzfdY5CBbrfaMzOa--NXb08Xjw2O11CkOtyUX5kXwh2IgZmxjw_TNHqQUvVAfFkeXiMDiBXxpbhulsVx3o_NLn9pCLsp09xJ9r1utCHrueYOAvuxY_ksQWuHld2WWGEPyWRubcgb4e6xO2F4jo96NSZhuAP8iarY5LiCtTydLPBXcEbbD146jLD7S83Mhij4VS5sO1asESNH5y8_5Z2PvLcZE11WiTS9alu-9AUqXNixw1t9Y5Em6xDle7s8-oiF3nPVM80RIdbJel4LoeCZuB2zgddLaJAYx5tSb03-QGNzupOPQ5UQ0_7ybPwmAsgiFfFNuvMbj9sKgxLg > Location: > https://knox-gateway/gateway/bigdata/webhdfs/data/v1/webhdfs/v1/user/shfs3453/WORK/datasets/test_▒lectronique_embarqu▒.pdf?_=CBEAl_jkRL_c3Tzm7hoXMR1KPge4OClEqM4hfs3eslFzfdY5CBbrfaMzOa--NXb08Xjw2O11CkOtyUX5kXwh2IgZmxjw_TNHqQUvVAfFkeXiMDiBXxpbhulsVx3o_NLn9pCLsp09xJ9r1utCHrueYOAvuxY_ksQWuHld2WWGEPyWRubcgb4e6xO2F4jo96NSZhuAP8iarY5LiCtTydLPBXcEbbD146jLD7S83Mhij4VS5sO1asESNH5y8_5Z2PvLcZE11WiTS9alu-9AUqXNixw1t9Y5Em6xDle7s8-oiF3nPVM80RIdbJel4LoeCZuB2zgddLaJAYx5tSb03-QGNzupOPQ5UQ0_7ybPwmAsgiFfFNuvMbj9sKgxLg > < Content-Type: application/octet-stream > Content-Type: application/octet-stream > <
[jira] [Commented] (KNOX-754) curl requests fail when dealing with special characters
[ https://issues.apache.org/jira/browse/KNOX-754?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15568658#comment-15568658 ] ASF subversion and git services commented on KNOX-754: -- Commit ce9aa244163a8db709722eb786f4fb45ec59e7fd in knox's branch refs/heads/master from [~sumit.gupta] [ https://git-wip-us.apache.org/repos/asf?p=knox.git;h=ce9aa24 ] KNOX-754 encoding response headers > curl requests fail when dealing with special characters > --- > > Key: KNOX-754 > URL: https://issues.apache.org/jira/browse/KNOX-754 > Project: Apache Knox > Issue Type: Bug > Components: ClientDSL, Server >Affects Versions: 0.9.1 > Environment: Apache Knox 0.9.1, Apache Hadoop 2.7.2 >Reporter: Alexandre Linte >Assignee: Sumit Gupta >Priority: Critical > Fix For: 0.10.0 > > Attachments: KNOX_754.patch > > > Since Knox 0.9.1, Knox can't work with files which contain special characters > as : é, ù, ü, è, etc... This is reproducible at 100%. It was working well > with Knox 0.7.0 so it's a regression. > This happens when doing a GET or a PUT of a file of this type, and more > particularly at the "location" process of the request. You can find an > example below: > {noformat} > [shfs3453@spark01 Pig]$ curl -Iikv -u shfs3453 -X GET > 'https://knox-gateway.fr/gateway/bigdata/webhdfs/v1/user/shfs3453/WORK/datasets/test_électronique_embarqué.pdf?OP=OPEN' > Enter host password for user 'shfs3453': > * About to connect() to knox-gateway port 443 (#0) > * Trying 10.117.41.12... connected > * Connected to knox-gateway (10.117.41.12) port 443 (#0) > * Initializing NSS with certpath: sql:/etc/pki/nssdb > * warning: ignoring value of ssl.verifyhost > * skipping SSL peer certificate verification > * SSL connection using TLS_ECDHE_RSA_WITH_AES_256_CBC_SHA > * Server certificate: > * subject: > E=@*,CN=knox-gateway,OU=*,O=,L=*,ST=*,C=*** > * start date: Nov 07 11:33:05 2014 GMT > * expire date: Nov 06 11:33:05 2019 GMT > * common name: knox-gateway > * issuer: CN=***,OU=***,OU=,O=**,C=*** > * Server auth using Basic with user 'shfs3453' > > GET > > /gateway/bigdata/webhdfs/v1/user/shfs3453/WORK/datasets/test_électronique_embarqué.pdf?OP=OPEN > > HTTP/1.1 > > Authorization: Basic c2hmczM0NTM6UGIxOTkxMTAh > > User-Agent: curl/7.19.7 (x86_64-redhat-linux-gnu) libcurl/7.19.7 NSS/3.19.1 > > Basic ECC zlib/1.2.3 libidn/1.18 libssh2/1.4.2 > > Host: knox-gateway > > Accept: */* > > > < HTTP/1.1 307 Temporary Redirect > HTTP/1.1 307 Temporary Redirect > < Date: Wed, 05 Oct 2016 07:19:55 GMT > Date: Wed, 05 Oct 2016 07:19:55 GMT > < Set-Cookie: > JSESSIONID=4zv7v1911q5vvcg6r1tqxe77;Path=/gateway/bigdata;Secure;HttpOnly > Set-Cookie: > JSESSIONID=4zv7v1911q5vvcg6r1tqxe77;Path=/gateway/bigdata;Secure;HttpOnly > < Expires: Thu, 01 Jan 1970 00:00:00 GMT > Expires: Thu, 01 Jan 1970 00:00:00 GMT > < Set-Cookie: rememberMe=deleteMe; Path=/gateway/bigdata; Max-Age=0; > Expires=Tue, 04-Oct-2016 07:19:56 GMT > Set-Cookie: rememberMe=deleteMe; Path=/gateway/bigdata; Max-Age=0; > Expires=Tue, 04-Oct-2016 07:19:56 GMT > < Cache-Control: no-cache > Cache-Control: no-cache > < Expires: Wed, 05 Oct 2016 07:19:56 GMT > Expires: Wed, 05 Oct 2016 07:19:56 GMT > < Date: Wed, 05 Oct 2016 07:19:56 GMT > Date: Wed, 05 Oct 2016 07:19:56 GMT > < Pragma: no-cache > Pragma: no-cache > < Expires: Wed, 05 Oct 2016 07:19:56 GMT > Expires: Wed, 05 Oct 2016 07:19:56 GMT > < Date: Wed, 05 Oct 2016 07:19:56 GMT > Date: Wed, 05 Oct 2016 07:19:56 GMT > < Pragma: no-cache > Pragma: no-cache > < Location: > https://knox-gateway/gateway/bigdata/webhdfs/data/v1/webhdfs/v1/user/shfs3453/WORK/datasets/test_▒lectronique_embarqu▒.pdf?_=CBEAl_jkRL_c3Tzm7hoXMR1KPge4OClEqM4hfs3eslFzfdY5CBbrfaMzOa--NXb08Xjw2O11CkOtyUX5kXwh2IgZmxjw_TNHqQUvVAfFkeXiMDiBXxpbhulsVx3o_NLn9pCLsp09xJ9r1utCHrueYOAvuxY_ksQWuHld2WWGEPyWRubcgb4e6xO2F4jo96NSZhuAP8iarY5LiCtTydLPBXcEbbD146jLD7S83Mhij4VS5sO1asESNH5y8_5Z2PvLcZE11WiTS9alu-9AUqXNixw1t9Y5Em6xDle7s8-oiF3nPVM80RIdbJel4LoeCZuB2zgddLaJAYx5tSb03-QGNzupOPQ5UQ0_7ybPwmAsgiFfFNuvMbj9sKgxLg > Location: > https://knox-gateway/gateway/bigdata/webhdfs/data/v1/webhdfs/v1/user/shfs3453/WORK/datasets/test_▒lectronique_embarqu▒.pdf?_=CBEAl_jkRL_c3Tzm7hoXMR1KPge4OClEqM4hfs3eslFzfdY5CBbrfaMzOa--NXb08Xjw2O11CkOtyUX5kXwh2IgZmxjw_TNHqQUvVAfFkeXiMDiBXxpbhulsVx3o_NLn9pCLsp09xJ9r1utCHrueYOAvuxY_ksQWuHld2WWGEPyWRubcgb4e6xO2F4jo96NSZhuAP8iarY5LiCtTydLPBXcEbbD146jLD7S83Mhij4VS5sO1asESNH5y8_5Z2PvLcZE11WiTS9alu-9AUqXNixw1t9Y5Em6xDle7s8-oiF3nPVM80RIdbJel4LoeCZuB2zgddLaJAYx5tSb03-QGNzupOPQ5UQ0_7ybPwmAsgiFfFNuvMbj9sKgxLg > < Content-Type: application/octet-stream > Content-Type: application/octet-stream > <
[jira] [Commented] (KNOX-754) curl requests fail when dealing with special characters
[ https://issues.apache.org/jira/browse/KNOX-754?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15568403#comment-15568403 ] Sumit Gupta commented on KNOX-754: -- Awesome! Thanks for testing this [~BigDataOrange]. I also have a test now and can push it to master which will make it available in 0.10.0. We should discuss on the dev forum whether this is worth a 0.9.2 release as well. > curl requests fail when dealing with special characters > --- > > Key: KNOX-754 > URL: https://issues.apache.org/jira/browse/KNOX-754 > Project: Apache Knox > Issue Type: Bug > Components: ClientDSL, Server >Affects Versions: 0.9.1 > Environment: Apache Knox 0.9.1, Apache Hadoop 2.7.2 >Reporter: Alexandre Linte >Assignee: Sumit Gupta >Priority: Critical > Fix For: 0.10.0 > > Attachments: KNOX_754.patch > > > Since Knox 0.9.1, Knox can't work with files which contain special characters > as : é, ù, ü, è, etc... This is reproducible at 100%. It was working well > with Knox 0.7.0 so it's a regression. > This happens when doing a GET or a PUT of a file of this type, and more > particularly at the "location" process of the request. You can find an > example below: > {noformat} > [shfs3453@spark01 Pig]$ curl -Iikv -u shfs3453 -X GET > 'https://knox-gateway.fr/gateway/bigdata/webhdfs/v1/user/shfs3453/WORK/datasets/test_électronique_embarqué.pdf?OP=OPEN' > Enter host password for user 'shfs3453': > * About to connect() to knox-gateway port 443 (#0) > * Trying 10.117.41.12... connected > * Connected to knox-gateway (10.117.41.12) port 443 (#0) > * Initializing NSS with certpath: sql:/etc/pki/nssdb > * warning: ignoring value of ssl.verifyhost > * skipping SSL peer certificate verification > * SSL connection using TLS_ECDHE_RSA_WITH_AES_256_CBC_SHA > * Server certificate: > * subject: > E=@*,CN=knox-gateway,OU=*,O=,L=*,ST=*,C=*** > * start date: Nov 07 11:33:05 2014 GMT > * expire date: Nov 06 11:33:05 2019 GMT > * common name: knox-gateway > * issuer: CN=***,OU=***,OU=,O=**,C=*** > * Server auth using Basic with user 'shfs3453' > > GET > > /gateway/bigdata/webhdfs/v1/user/shfs3453/WORK/datasets/test_électronique_embarqué.pdf?OP=OPEN > > HTTP/1.1 > > Authorization: Basic c2hmczM0NTM6UGIxOTkxMTAh > > User-Agent: curl/7.19.7 (x86_64-redhat-linux-gnu) libcurl/7.19.7 NSS/3.19.1 > > Basic ECC zlib/1.2.3 libidn/1.18 libssh2/1.4.2 > > Host: knox-gateway > > Accept: */* > > > < HTTP/1.1 307 Temporary Redirect > HTTP/1.1 307 Temporary Redirect > < Date: Wed, 05 Oct 2016 07:19:55 GMT > Date: Wed, 05 Oct 2016 07:19:55 GMT > < Set-Cookie: > JSESSIONID=4zv7v1911q5vvcg6r1tqxe77;Path=/gateway/bigdata;Secure;HttpOnly > Set-Cookie: > JSESSIONID=4zv7v1911q5vvcg6r1tqxe77;Path=/gateway/bigdata;Secure;HttpOnly > < Expires: Thu, 01 Jan 1970 00:00:00 GMT > Expires: Thu, 01 Jan 1970 00:00:00 GMT > < Set-Cookie: rememberMe=deleteMe; Path=/gateway/bigdata; Max-Age=0; > Expires=Tue, 04-Oct-2016 07:19:56 GMT > Set-Cookie: rememberMe=deleteMe; Path=/gateway/bigdata; Max-Age=0; > Expires=Tue, 04-Oct-2016 07:19:56 GMT > < Cache-Control: no-cache > Cache-Control: no-cache > < Expires: Wed, 05 Oct 2016 07:19:56 GMT > Expires: Wed, 05 Oct 2016 07:19:56 GMT > < Date: Wed, 05 Oct 2016 07:19:56 GMT > Date: Wed, 05 Oct 2016 07:19:56 GMT > < Pragma: no-cache > Pragma: no-cache > < Expires: Wed, 05 Oct 2016 07:19:56 GMT > Expires: Wed, 05 Oct 2016 07:19:56 GMT > < Date: Wed, 05 Oct 2016 07:19:56 GMT > Date: Wed, 05 Oct 2016 07:19:56 GMT > < Pragma: no-cache > Pragma: no-cache > < Location: > https://knox-gateway/gateway/bigdata/webhdfs/data/v1/webhdfs/v1/user/shfs3453/WORK/datasets/test_▒lectronique_embarqu▒.pdf?_=CBEAl_jkRL_c3Tzm7hoXMR1KPge4OClEqM4hfs3eslFzfdY5CBbrfaMzOa--NXb08Xjw2O11CkOtyUX5kXwh2IgZmxjw_TNHqQUvVAfFkeXiMDiBXxpbhulsVx3o_NLn9pCLsp09xJ9r1utCHrueYOAvuxY_ksQWuHld2WWGEPyWRubcgb4e6xO2F4jo96NSZhuAP8iarY5LiCtTydLPBXcEbbD146jLD7S83Mhij4VS5sO1asESNH5y8_5Z2PvLcZE11WiTS9alu-9AUqXNixw1t9Y5Em6xDle7s8-oiF3nPVM80RIdbJel4LoeCZuB2zgddLaJAYx5tSb03-QGNzupOPQ5UQ0_7ybPwmAsgiFfFNuvMbj9sKgxLg > Location: > https://knox-gateway/gateway/bigdata/webhdfs/data/v1/webhdfs/v1/user/shfs3453/WORK/datasets/test_▒lectronique_embarqu▒.pdf?_=CBEAl_jkRL_c3Tzm7hoXMR1KPge4OClEqM4hfs3eslFzfdY5CBbrfaMzOa--NXb08Xjw2O11CkOtyUX5kXwh2IgZmxjw_TNHqQUvVAfFkeXiMDiBXxpbhulsVx3o_NLn9pCLsp09xJ9r1utCHrueYOAvuxY_ksQWuHld2WWGEPyWRubcgb4e6xO2F4jo96NSZhuAP8iarY5LiCtTydLPBXcEbbD146jLD7S83Mhij4VS5sO1asESNH5y8_5Z2PvLcZE11WiTS9alu-9AUqXNixw1t9Y5Em6xDle7s8-oiF3nPVM80RIdbJel4LoeCZuB2zgddLaJAYx5tSb03-QGNzupOPQ5UQ0_7ybPwmAsgiFfFNuvMbj9sKgxLg > < Content-Type: application/octet-stream > Content-Type: application/octet-stream > < Server: Jetty(6.1.26) >
[jira] [Commented] (KNOX-754) curl requests fail when dealing with special characters
[ https://issues.apache.org/jira/browse/KNOX-754?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15568193#comment-15568193 ] Alexandre Linte commented on KNOX-754: -- Tested a couple of minutes ago. The patch works correctly. You can find the logs below. curl from a remote host: {noformat} [shfs3453@spark01 workspace]$ curl -i -v -k -L -u shfs3453:Admin123- -X GET 'https://knox-gateway.fr/gateway/bigdata/webhdfs/v1/user/shfs3453/WORK/datasets/test_électronique_embarqué.pdf?OP=OPEN' * About to connect() to knox-gateway.fr port 443 (#0) * Trying 10.117.41.12... connected * Connected to knox-gateway.fr (10.117.41.12) port 443 (#0) * Initializing NSS with certpath: sql:/etc/pki/nssdb * warning: ignoring value of ssl.verifyhost * skipping SSL peer certificate verification * SSL connection using TLS_ECDHE_RSA_WITH_AES_256_CBC_SHA * Server certificate: * subject: E=*@***,CN=knox-gateway,OU=*,O=*,L=*,ST=*,C=*** * start date: Nov 07 11:33:05 2014 GMT * expire date: Nov 06 11:33:05 2019 GMT * common name: knox-gateway * issuer: CN=*,OU=**,OU=**,O=**,C=*** * Server auth using Basic with user 'shfs3453' > GET > /gateway/bigdata/webhdfs/v1/user/shfs3453/WORK/datasets/test_électronique_embarqué.pdf?OP=OPEN > HTTP/1.1 > Authorization: Basic c2hmczM0NTM6QWRtaW4xMjMt > User-Agent: curl/7.19.7 (x86_64-redhat-linux-gnu) libcurl/7.19.7 NSS/3.19.1 > Basic ECC zlib/1.2.3 libidn/1.18 libssh2/1.4.2 > Host: knox-gateway.fr:8443 > Accept: */* > < HTTP/1.1 307 Temporary Redirect HTTP/1.1 307 Temporary Redirect < Date: Wed, 12 Oct 2016 09:01:47 GMT Date: Wed, 12 Oct 2016 09:01:47 GMT < Set-Cookie: JSESSIONID=1lceolt5mzmm278zl70llhqnz;Path=/gateway/bigdata;Secure;HttpOnly Set-Cookie: JSESSIONID=1lceolt5mzmm278zl70llhqnz;Path=/gateway/bigdata;Secure;HttpOnly < Expires: Thu, 01 Jan 1970 00:00:00 GMT Expires: Thu, 01 Jan 1970 00:00:00 GMT < Set-Cookie: rememberMe=deleteMe; Path=/gateway/bigdata; Max-Age=0; Expires=Tue, 11-Oct-2016 09:01:47 GMT Set-Cookie: rememberMe=deleteMe; Path=/gateway/bigdata; Max-Age=0; Expires=Tue, 11-Oct-2016 09:01:47 GMT < Cache-Control: no-cache Cache-Control: no-cache < Expires: Wed%2C+12+Oct+2016+09:01%3A47+GMT Expires: Wed%2C+12+Oct+2016+09:01%3A47+GMT < Date: Wed%2C+12+Oct+2016+09:01%3A47+GMT Date: Wed%2C+12+Oct+2016+09:01%3A47+GMT < Pragma: no-cache Pragma: no-cache < Expires: Wed%2C+12+Oct+2016+09:01%3A47+GMT Expires: Wed%2C+12+Oct+2016+09:01%3A47+GMT < Date: Wed%2C+12+Oct+2016+09:01%3A47+GMT Date: Wed%2C+12+Oct+2016+09:01%3A47+GMT < Pragma: no-cache Pragma: no-cache < Location: https://knox-gateway.fr/gateway/bigdata/webhdfs/data/v1/webhdfs/v1/user/shfs3453/WORK/datasets/test_%C3%A9lectronique_embarqu%C3%A9.pdf?_=CBEAbPFmf9WKgIEjGXvkJoqCuROjTnb5b3MkTlWy_S5Gi258W-yhf_nGVt8uVfnxW5MJnQtHOSw_L3GBeR8wyFvZ3DjZAFOgpyK-K1UzfbLvDN-tVNr4COm4SV4fOW9ILNDqQbZ7nGndVDhW_qAjbXPJ0PY734VJIVgU0j-m59w8aibU58wPcVIdsTyg6h_xfzWr1yFc0KPDiNL4Mk3iCbrHsfI1VLqj7-Eb6PVKnMarfK3VzHzwHsgfPtv4bpJfgxbAxVxzh8qZs-QuUD5ya0KMp8xXVZ4UtJlCvsKTP0ZdhE-aqC7QawECzNVN3Zw_0EfhGqknJblBjVObusal8NUYNvV_DO-VXw8SEVB1rvwQbxoUlgKbH6L7og Location: https://knox-gateway.fr/gateway/bigdata/webhdfs/data/v1/webhdfs/v1/user/shfs3453/WORK/datasets/test_%C3%A9lectronique_embarqu%C3%A9.pdf?_=CBEAbPFmf9WKgIEjGXvkJoqCuROjTnb5b3MkTlWy_S5Gi258W-yhf_nGVt8uVfnxW5MJnQtHOSw_L3GBeR8wyFvZ3DjZAFOgpyK-K1UzfbLvDN-tVNr4COm4SV4fOW9ILNDqQbZ7nGndVDhW_qAjbXPJ0PY734VJIVgU0j-m59w8aibU58wPcVIdsTyg6h_xfzWr1yFc0KPDiNL4Mk3iCbrHsfI1VLqj7-Eb6PVKnMarfK3VzHzwHsgfPtv4bpJfgxbAxVxzh8qZs-QuUD5ya0KMp8xXVZ4UtJlCvsKTP0ZdhE-aqC7QawECzNVN3Zw_0EfhGqknJblBjVObusal8NUYNvV_DO-VXw8SEVB1rvwQbxoUlgKbH6L7og < Content-Type: application/octet-stream Content-Type: application/octet-stream < Server: Jetty%286.1.26%29 Server: Jetty%286.1.26%29 < Content-Length: 0 Content-Length: 0 < * Connection #0 to host knox-gateway.fr left intact * Issue another request to this URL: 'https://knox-gateway.fr/gateway/bigdata/webhdfs/data/v1/webhdfs/v1/user/shfs3453/WORK/datasets/test_%C3%A9lectronique_embarqu%C3%A9.pdf?_=CBEAbPFmf9WKgIEjGXvkJoqCuROjTnb5b3MkTlWy_S5Gi258W-yhf_nGVt8uVfnxW5MJnQtHOSw_L3GBeR8wyFvZ3DjZAFOgpyK-K1UzfbLvDN-tVNr4COm4SV4fOW9ILNDqQbZ7nGndVDhW_qAjbXPJ0PY734VJIVgU0j-m59w8aibU58wPcVIdsTyg6h_xfzWr1yFc0KPDiNL4Mk3iCbrHsfI1VLqj7-Eb6PVKnMarfK3VzHzwHsgfPtv4bpJfgxbAxVxzh8qZs-QuUD5ya0KMp8xXVZ4UtJlCvsKTP0ZdhE-aqC7QawECzNVN3Zw_0EfhGqknJblBjVObusal8NUYNvV_DO-VXw8SEVB1rvwQbxoUlgKbH6L7og' * About to connect() to knox-gateway.fr port 443 (#1) * Trying knox-gateway.fr... connected * Connected to knox-gateway.fr (knox-gateway.fr) port 443 (#1) * warning: ignoring value of ssl.verifyhost * skipping SSL peer certificate verification * SSL connection using TLS_ECDHE_RSA_WITH_AES_256_CBC_SHA * Server certificate: * subject: E=@,CN=**,OU=**,O=**,L=**,ST=,C=*** *
[jira] [Commented] (KNOX-754) curl requests fail when dealing with special characters
[ https://issues.apache.org/jira/browse/KNOX-754?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15567986#comment-15567986 ] Alexandre Linte commented on KNOX-754: -- Hi [~sumit.gupta], I'm going to test the patch today. I'll let you know if it works. > curl requests fail when dealing with special characters > --- > > Key: KNOX-754 > URL: https://issues.apache.org/jira/browse/KNOX-754 > Project: Apache Knox > Issue Type: Bug > Components: ClientDSL, Server >Affects Versions: 0.9.1 > Environment: Apache Knox 0.9.1, Apache Hadoop 2.7.2 >Reporter: Alexandre Linte >Assignee: Sumit Gupta >Priority: Critical > Fix For: 0.10.0 > > Attachments: KNOX_754.patch > > > Since Knox 0.9.1, Knox can't work with files which contain special characters > as : é, ù, ü, è, etc... This is reproducible at 100%. It was working well > with Knox 0.7.0 so it's a regression. > This happens when doing a GET or a PUT of a file of this type, and more > particularly at the "location" process of the request. You can find an > example below: > {noformat} > [shfs3453@spark01 Pig]$ curl -Iikv -u shfs3453 -X GET > 'https://knox-gateway.fr/gateway/bigdata/webhdfs/v1/user/shfs3453/WORK/datasets/test_électronique_embarqué.pdf?OP=OPEN' > Enter host password for user 'shfs3453': > * About to connect() to knox-gateway port 443 (#0) > * Trying 10.117.41.12... connected > * Connected to knox-gateway (10.117.41.12) port 443 (#0) > * Initializing NSS with certpath: sql:/etc/pki/nssdb > * warning: ignoring value of ssl.verifyhost > * skipping SSL peer certificate verification > * SSL connection using TLS_ECDHE_RSA_WITH_AES_256_CBC_SHA > * Server certificate: > * subject: > E=@*,CN=knox-gateway,OU=*,O=,L=*,ST=*,C=*** > * start date: Nov 07 11:33:05 2014 GMT > * expire date: Nov 06 11:33:05 2019 GMT > * common name: knox-gateway > * issuer: CN=***,OU=***,OU=,O=**,C=*** > * Server auth using Basic with user 'shfs3453' > > GET > > /gateway/bigdata/webhdfs/v1/user/shfs3453/WORK/datasets/test_électronique_embarqué.pdf?OP=OPEN > > HTTP/1.1 > > Authorization: Basic c2hmczM0NTM6UGIxOTkxMTAh > > User-Agent: curl/7.19.7 (x86_64-redhat-linux-gnu) libcurl/7.19.7 NSS/3.19.1 > > Basic ECC zlib/1.2.3 libidn/1.18 libssh2/1.4.2 > > Host: knox-gateway > > Accept: */* > > > < HTTP/1.1 307 Temporary Redirect > HTTP/1.1 307 Temporary Redirect > < Date: Wed, 05 Oct 2016 07:19:55 GMT > Date: Wed, 05 Oct 2016 07:19:55 GMT > < Set-Cookie: > JSESSIONID=4zv7v1911q5vvcg6r1tqxe77;Path=/gateway/bigdata;Secure;HttpOnly > Set-Cookie: > JSESSIONID=4zv7v1911q5vvcg6r1tqxe77;Path=/gateway/bigdata;Secure;HttpOnly > < Expires: Thu, 01 Jan 1970 00:00:00 GMT > Expires: Thu, 01 Jan 1970 00:00:00 GMT > < Set-Cookie: rememberMe=deleteMe; Path=/gateway/bigdata; Max-Age=0; > Expires=Tue, 04-Oct-2016 07:19:56 GMT > Set-Cookie: rememberMe=deleteMe; Path=/gateway/bigdata; Max-Age=0; > Expires=Tue, 04-Oct-2016 07:19:56 GMT > < Cache-Control: no-cache > Cache-Control: no-cache > < Expires: Wed, 05 Oct 2016 07:19:56 GMT > Expires: Wed, 05 Oct 2016 07:19:56 GMT > < Date: Wed, 05 Oct 2016 07:19:56 GMT > Date: Wed, 05 Oct 2016 07:19:56 GMT > < Pragma: no-cache > Pragma: no-cache > < Expires: Wed, 05 Oct 2016 07:19:56 GMT > Expires: Wed, 05 Oct 2016 07:19:56 GMT > < Date: Wed, 05 Oct 2016 07:19:56 GMT > Date: Wed, 05 Oct 2016 07:19:56 GMT > < Pragma: no-cache > Pragma: no-cache > < Location: > https://knox-gateway/gateway/bigdata/webhdfs/data/v1/webhdfs/v1/user/shfs3453/WORK/datasets/test_▒lectronique_embarqu▒.pdf?_=CBEAl_jkRL_c3Tzm7hoXMR1KPge4OClEqM4hfs3eslFzfdY5CBbrfaMzOa--NXb08Xjw2O11CkOtyUX5kXwh2IgZmxjw_TNHqQUvVAfFkeXiMDiBXxpbhulsVx3o_NLn9pCLsp09xJ9r1utCHrueYOAvuxY_ksQWuHld2WWGEPyWRubcgb4e6xO2F4jo96NSZhuAP8iarY5LiCtTydLPBXcEbbD146jLD7S83Mhij4VS5sO1asESNH5y8_5Z2PvLcZE11WiTS9alu-9AUqXNixw1t9Y5Em6xDle7s8-oiF3nPVM80RIdbJel4LoeCZuB2zgddLaJAYx5tSb03-QGNzupOPQ5UQ0_7ybPwmAsgiFfFNuvMbj9sKgxLg > Location: > https://knox-gateway/gateway/bigdata/webhdfs/data/v1/webhdfs/v1/user/shfs3453/WORK/datasets/test_▒lectronique_embarqu▒.pdf?_=CBEAl_jkRL_c3Tzm7hoXMR1KPge4OClEqM4hfs3eslFzfdY5CBbrfaMzOa--NXb08Xjw2O11CkOtyUX5kXwh2IgZmxjw_TNHqQUvVAfFkeXiMDiBXxpbhulsVx3o_NLn9pCLsp09xJ9r1utCHrueYOAvuxY_ksQWuHld2WWGEPyWRubcgb4e6xO2F4jo96NSZhuAP8iarY5LiCtTydLPBXcEbbD146jLD7S83Mhij4VS5sO1asESNH5y8_5Z2PvLcZE11WiTS9alu-9AUqXNixw1t9Y5Em6xDle7s8-oiF3nPVM80RIdbJel4LoeCZuB2zgddLaJAYx5tSb03-QGNzupOPQ5UQ0_7ybPwmAsgiFfFNuvMbj9sKgxLg > < Content-Type: application/octet-stream > Content-Type: application/octet-stream > < Server: Jetty(6.1.26) > Server: Jetty(6.1.26) > < Content-Length: 0 > Content-Length: 0 > < > * Connection #0 to host knox-gateway left intact > * Issue
[jira] [Commented] (KNOX-754) curl requests fail when dealing with special characters
[ https://issues.apache.org/jira/browse/KNOX-754?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15567958#comment-15567958 ] Alexandre Linte commented on KNOX-754: -- Hello [~lmccay], sorry for the delay. When you say "from client side as well", you mean the user that requests Knox from a remote host, right? If this is the case, yes all my tests were done as a remote client and not from localhost. I also think it's a rewrite issue on server side. > curl requests fail when dealing with special characters > --- > > Key: KNOX-754 > URL: https://issues.apache.org/jira/browse/KNOX-754 > Project: Apache Knox > Issue Type: Bug > Components: ClientDSL, Server >Affects Versions: 0.9.1 > Environment: Apache Knox 0.9.1, Apache Hadoop 2.7.2 >Reporter: Alexandre Linte >Assignee: Sumit Gupta >Priority: Critical > Fix For: 0.10.0 > > Attachments: KNOX_754.patch > > > Since Knox 0.9.1, Knox can't work with files which contain special characters > as : é, ù, ü, è, etc... This is reproducible at 100%. It was working well > with Knox 0.7.0 so it's a regression. > This happens when doing a GET or a PUT of a file of this type, and more > particularly at the "location" process of the request. You can find an > example below: > {noformat} > [shfs3453@spark01 Pig]$ curl -Iikv -u shfs3453 -X GET > 'https://knox-gateway.fr/gateway/bigdata/webhdfs/v1/user/shfs3453/WORK/datasets/test_électronique_embarqué.pdf?OP=OPEN' > Enter host password for user 'shfs3453': > * About to connect() to knox-gateway port 443 (#0) > * Trying 10.117.41.12... connected > * Connected to knox-gateway (10.117.41.12) port 443 (#0) > * Initializing NSS with certpath: sql:/etc/pki/nssdb > * warning: ignoring value of ssl.verifyhost > * skipping SSL peer certificate verification > * SSL connection using TLS_ECDHE_RSA_WITH_AES_256_CBC_SHA > * Server certificate: > * subject: > E=@*,CN=knox-gateway,OU=*,O=,L=*,ST=*,C=*** > * start date: Nov 07 11:33:05 2014 GMT > * expire date: Nov 06 11:33:05 2019 GMT > * common name: knox-gateway > * issuer: CN=***,OU=***,OU=,O=**,C=*** > * Server auth using Basic with user 'shfs3453' > > GET > > /gateway/bigdata/webhdfs/v1/user/shfs3453/WORK/datasets/test_électronique_embarqué.pdf?OP=OPEN > > HTTP/1.1 > > Authorization: Basic c2hmczM0NTM6UGIxOTkxMTAh > > User-Agent: curl/7.19.7 (x86_64-redhat-linux-gnu) libcurl/7.19.7 NSS/3.19.1 > > Basic ECC zlib/1.2.3 libidn/1.18 libssh2/1.4.2 > > Host: knox-gateway > > Accept: */* > > > < HTTP/1.1 307 Temporary Redirect > HTTP/1.1 307 Temporary Redirect > < Date: Wed, 05 Oct 2016 07:19:55 GMT > Date: Wed, 05 Oct 2016 07:19:55 GMT > < Set-Cookie: > JSESSIONID=4zv7v1911q5vvcg6r1tqxe77;Path=/gateway/bigdata;Secure;HttpOnly > Set-Cookie: > JSESSIONID=4zv7v1911q5vvcg6r1tqxe77;Path=/gateway/bigdata;Secure;HttpOnly > < Expires: Thu, 01 Jan 1970 00:00:00 GMT > Expires: Thu, 01 Jan 1970 00:00:00 GMT > < Set-Cookie: rememberMe=deleteMe; Path=/gateway/bigdata; Max-Age=0; > Expires=Tue, 04-Oct-2016 07:19:56 GMT > Set-Cookie: rememberMe=deleteMe; Path=/gateway/bigdata; Max-Age=0; > Expires=Tue, 04-Oct-2016 07:19:56 GMT > < Cache-Control: no-cache > Cache-Control: no-cache > < Expires: Wed, 05 Oct 2016 07:19:56 GMT > Expires: Wed, 05 Oct 2016 07:19:56 GMT > < Date: Wed, 05 Oct 2016 07:19:56 GMT > Date: Wed, 05 Oct 2016 07:19:56 GMT > < Pragma: no-cache > Pragma: no-cache > < Expires: Wed, 05 Oct 2016 07:19:56 GMT > Expires: Wed, 05 Oct 2016 07:19:56 GMT > < Date: Wed, 05 Oct 2016 07:19:56 GMT > Date: Wed, 05 Oct 2016 07:19:56 GMT > < Pragma: no-cache > Pragma: no-cache > < Location: > https://knox-gateway/gateway/bigdata/webhdfs/data/v1/webhdfs/v1/user/shfs3453/WORK/datasets/test_▒lectronique_embarqu▒.pdf?_=CBEAl_jkRL_c3Tzm7hoXMR1KPge4OClEqM4hfs3eslFzfdY5CBbrfaMzOa--NXb08Xjw2O11CkOtyUX5kXwh2IgZmxjw_TNHqQUvVAfFkeXiMDiBXxpbhulsVx3o_NLn9pCLsp09xJ9r1utCHrueYOAvuxY_ksQWuHld2WWGEPyWRubcgb4e6xO2F4jo96NSZhuAP8iarY5LiCtTydLPBXcEbbD146jLD7S83Mhij4VS5sO1asESNH5y8_5Z2PvLcZE11WiTS9alu-9AUqXNixw1t9Y5Em6xDle7s8-oiF3nPVM80RIdbJel4LoeCZuB2zgddLaJAYx5tSb03-QGNzupOPQ5UQ0_7ybPwmAsgiFfFNuvMbj9sKgxLg > Location: > https://knox-gateway/gateway/bigdata/webhdfs/data/v1/webhdfs/v1/user/shfs3453/WORK/datasets/test_▒lectronique_embarqu▒.pdf?_=CBEAl_jkRL_c3Tzm7hoXMR1KPge4OClEqM4hfs3eslFzfdY5CBbrfaMzOa--NXb08Xjw2O11CkOtyUX5kXwh2IgZmxjw_TNHqQUvVAfFkeXiMDiBXxpbhulsVx3o_NLn9pCLsp09xJ9r1utCHrueYOAvuxY_ksQWuHld2WWGEPyWRubcgb4e6xO2F4jo96NSZhuAP8iarY5LiCtTydLPBXcEbbD146jLD7S83Mhij4VS5sO1asESNH5y8_5Z2PvLcZE11WiTS9alu-9AUqXNixw1t9Y5Em6xDle7s8-oiF3nPVM80RIdbJel4LoeCZuB2zgddLaJAYx5tSb03-QGNzupOPQ5UQ0_7ybPwmAsgiFfFNuvMbj9sKgxLg > < Content-Type:
[jira] [Commented] (KNOX-754) curl requests fail when dealing with special characters
[ https://issues.apache.org/jira/browse/KNOX-754?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15552829#comment-15552829 ] Larry McCay commented on KNOX-754: -- [~BigDataOrange] - I notice that you added ClientDSL as one of the components. Did you happen to observe some issue with special characters from the client side as well? My suspicion is that this is a rewrite issue wrt Location header on the server side. > curl requests fail when dealing with special characters > --- > > Key: KNOX-754 > URL: https://issues.apache.org/jira/browse/KNOX-754 > Project: Apache Knox > Issue Type: Bug > Components: ClientDSL, Server >Affects Versions: 0.9.1 > Environment: Apache Knox 0.9.1, Apache Hadoop 2.7.2 >Reporter: Alexandre Linte >Priority: Critical > Fix For: 0.10.0 > > > Since Knox 0.9.1, Knox can't work with files which contain special characters > as : é, ù, ü, è, etc... This is reproducible at 100%. It was working well > with Knox 0.7.0 so it's a regression. > This happens when doing a GET or a PUT of a file of this type, and more > particularly at the "location" process of the request. You can find an > example below: > {noformat} > [shfs3453@spark01 Pig]$ curl -Iikv -u shfs3453 -X GET > 'https://knox-gateway.fr/gateway/bigdata/webhdfs/v1/user/shfs3453/WORK/datasets/test_électronique_embarqué.pdf?OP=OPEN' > Enter host password for user 'shfs3453': > * About to connect() to knox-gateway port 443 (#0) > * Trying 10.117.41.12... connected > * Connected to knox-gateway (10.117.41.12) port 443 (#0) > * Initializing NSS with certpath: sql:/etc/pki/nssdb > * warning: ignoring value of ssl.verifyhost > * skipping SSL peer certificate verification > * SSL connection using TLS_ECDHE_RSA_WITH_AES_256_CBC_SHA > * Server certificate: > * subject: > E=@*,CN=knox-gateway,OU=*,O=,L=*,ST=*,C=*** > * start date: Nov 07 11:33:05 2014 GMT > * expire date: Nov 06 11:33:05 2019 GMT > * common name: knox-gateway > * issuer: CN=***,OU=***,OU=,O=**,C=*** > * Server auth using Basic with user 'shfs3453' > > GET > > /gateway/bigdata/webhdfs/v1/user/shfs3453/WORK/datasets/test_électronique_embarqué.pdf?OP=OPEN > > HTTP/1.1 > > Authorization: Basic c2hmczM0NTM6UGIxOTkxMTAh > > User-Agent: curl/7.19.7 (x86_64-redhat-linux-gnu) libcurl/7.19.7 NSS/3.19.1 > > Basic ECC zlib/1.2.3 libidn/1.18 libssh2/1.4.2 > > Host: knox-gateway > > Accept: */* > > > < HTTP/1.1 307 Temporary Redirect > HTTP/1.1 307 Temporary Redirect > < Date: Wed, 05 Oct 2016 07:19:55 GMT > Date: Wed, 05 Oct 2016 07:19:55 GMT > < Set-Cookie: > JSESSIONID=4zv7v1911q5vvcg6r1tqxe77;Path=/gateway/bigdata;Secure;HttpOnly > Set-Cookie: > JSESSIONID=4zv7v1911q5vvcg6r1tqxe77;Path=/gateway/bigdata;Secure;HttpOnly > < Expires: Thu, 01 Jan 1970 00:00:00 GMT > Expires: Thu, 01 Jan 1970 00:00:00 GMT > < Set-Cookie: rememberMe=deleteMe; Path=/gateway/bigdata; Max-Age=0; > Expires=Tue, 04-Oct-2016 07:19:56 GMT > Set-Cookie: rememberMe=deleteMe; Path=/gateway/bigdata; Max-Age=0; > Expires=Tue, 04-Oct-2016 07:19:56 GMT > < Cache-Control: no-cache > Cache-Control: no-cache > < Expires: Wed, 05 Oct 2016 07:19:56 GMT > Expires: Wed, 05 Oct 2016 07:19:56 GMT > < Date: Wed, 05 Oct 2016 07:19:56 GMT > Date: Wed, 05 Oct 2016 07:19:56 GMT > < Pragma: no-cache > Pragma: no-cache > < Expires: Wed, 05 Oct 2016 07:19:56 GMT > Expires: Wed, 05 Oct 2016 07:19:56 GMT > < Date: Wed, 05 Oct 2016 07:19:56 GMT > Date: Wed, 05 Oct 2016 07:19:56 GMT > < Pragma: no-cache > Pragma: no-cache > < Location: > https://knox-gateway/gateway/bigdata/webhdfs/data/v1/webhdfs/v1/user/shfs3453/WORK/datasets/test_▒lectronique_embarqu▒.pdf?_=CBEAl_jkRL_c3Tzm7hoXMR1KPge4OClEqM4hfs3eslFzfdY5CBbrfaMzOa--NXb08Xjw2O11CkOtyUX5kXwh2IgZmxjw_TNHqQUvVAfFkeXiMDiBXxpbhulsVx3o_NLn9pCLsp09xJ9r1utCHrueYOAvuxY_ksQWuHld2WWGEPyWRubcgb4e6xO2F4jo96NSZhuAP8iarY5LiCtTydLPBXcEbbD146jLD7S83Mhij4VS5sO1asESNH5y8_5Z2PvLcZE11WiTS9alu-9AUqXNixw1t9Y5Em6xDle7s8-oiF3nPVM80RIdbJel4LoeCZuB2zgddLaJAYx5tSb03-QGNzupOPQ5UQ0_7ybPwmAsgiFfFNuvMbj9sKgxLg > Location: > https://knox-gateway/gateway/bigdata/webhdfs/data/v1/webhdfs/v1/user/shfs3453/WORK/datasets/test_▒lectronique_embarqu▒.pdf?_=CBEAl_jkRL_c3Tzm7hoXMR1KPge4OClEqM4hfs3eslFzfdY5CBbrfaMzOa--NXb08Xjw2O11CkOtyUX5kXwh2IgZmxjw_TNHqQUvVAfFkeXiMDiBXxpbhulsVx3o_NLn9pCLsp09xJ9r1utCHrueYOAvuxY_ksQWuHld2WWGEPyWRubcgb4e6xO2F4jo96NSZhuAP8iarY5LiCtTydLPBXcEbbD146jLD7S83Mhij4VS5sO1asESNH5y8_5Z2PvLcZE11WiTS9alu-9AUqXNixw1t9Y5Em6xDle7s8-oiF3nPVM80RIdbJel4LoeCZuB2zgddLaJAYx5tSb03-QGNzupOPQ5UQ0_7ybPwmAsgiFfFNuvMbj9sKgxLg > < Content-Type: application/octet-stream > Content-Type: application/octet-stream > < Server: Jetty(6.1.26) > Server: Jetty(6.1.26) > < Content-Length:
[jira] [Commented] (KNOX-754) curl requests fail when dealing with special characters
[ https://issues.apache.org/jira/browse/KNOX-754?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15551157#comment-15551157 ] Alexandre Linte commented on KNOX-754: -- Hi [~lmccay], Yes you're right, special characters are in the file name, so visible in the URL. I tried to access to my file directly through webHDFS instead of Knox and I can successfully get its content: {noformat} [shfs3453@spark01 ~]$ curl -i -L --negotiate -u : "http://namenode01:50070/webhdfs/v1/user/shfs3453/WORK/datasets/test_électronique_embarqué.pdf?op=OPEN; HTTP/1.1 401 Authentication required Cache-Control: must-revalidate,no-cache,no-store Date: Thu, 06 Oct 2016 06:44:26 GMT Pragma: no-cache Date: Thu, 06 Oct 2016 06:44:26 GMT Pragma: no-cache WWW-Authenticate: Negotiate Set-Cookie: hadoop.auth=; Path=/; Expires=Thu, 01-Jan-1970 00:00:00 GMT; HttpOnly Content-Type: text/html; charset=iso-8859-1 Content-Length: 1462 Server: Jetty(6.1.26) HTTP/1.1 307 TEMPORARY_REDIRECT Cache-Control: no-cache Expires: Thu, 06 Oct 2016 06:44:26 GMT Date: Thu, 06 Oct 2016 06:44:26 GMT Pragma: no-cache Expires: Thu, 06 Oct 2016 06:44:26 GMT Date: Thu, 06 Oct 2016 06:44:26 GMT Pragma: no-cache Set-Cookie: hadoop.auth="u=shfs3453=shfs3453@SANDBOX=kerberos=1475772266290=utA8s/id27FTN6tREF647hQKYjg="; Path=/; Expires=Thu, 06-Oct-2016 16:44:26 GMT; HttpOnly Content-Type: application/octet-stream Location: http://datanode01:1006/webhdfs/v1/user/shfs3453/WORK/datasets/test_%C3%A9lectronique_embarqu%C3%A9.pdf?op=OPEN=KAAIc2hmczM0NTMIc2hmczM0NTMAigFXmLxmNYoBV7zI6jWOL0uOBfgUWpLKkGUukx6cuEuOJdZQsKMxlZASV0VCSERGUyBkZWxlZ2F0aW9uEzE5Mi4xNjguMjAwLjIzOjgwMjA=sandbox=0 Content-Length: 0 Server: Jetty(6.1.26) HTTP/1.1 200 OK Access-Control-Allow-Methods: GET Access-Control-Allow-Origin: * Content-Type: application/octet-stream Connection: close Content-Length: 6 hello {noformat} As you can see, the same GET operation fails with Knox. You can find below the DEBUG logs when doing the curl request through Knox: {noformat} Oct 6 09:18:21 knox01 knox DEBUG - org.apache.hadoop.gatewayReceived request: GET /webhdfs/v1/user/shfs3453/WORK/datasets/test_électronique_embarqué.pdf Oct 6 09:18:21 localhost 16/10/06 09:18:21 ||c8a33790-ea9f-442a-ac8c-6b1d8589ab87|audit|WEBHDFSaccess|uri|/gateway/bigdata/webhdfs/v1/user/shfs3453/WORK/datasets/test_électronique_embarqué.pdf?OP=OPEN|unavailable|Request method: GET Oct 6 09:18:21 knox01 knox INFO - org.apache.hadoop.gatewayComputed userDn: cn=shfs3453,ou=users,ou=kerberos,dc=rouen,dc=francetelecom.fr using dnTemplate for principal: shfs3453 Oct 6 09:18:21 localhost 16/10/06 09:18:21 ||c8a33790-ea9f-442a-ac8c-6b1d8589ab87|audit|WEBHDFS|shfs3453|||authentication|uri|/gateway/bigdata/webhdfs/v1/user/shfs3453/WORK/datasets/test_électronique_embarqué.pdf?OP=OPEN|success| Oct 6 09:18:21 localhost 16/10/06 09:18:21 ||c8a33790-ea9f-442a-ac8c-6b1d8589ab87|audit|WEBHDFS|shfs3453|||authentication|uri|/gateway/bigdata/webhdfs/v1/user/shfs3453/WORK/datasets/test_électronique_embarqué.pdf?OP=OPEN|success|Groups: [] Oct 6 09:18:21 knox01 knox DEBUG - org.apache.hadoop.gatewayRewrote URL: https://knox01:8443/gateway/bigdata/webhdfs/v1/user/shfs3453/WORK/datasets/test_électronique_embarqué.pdf?OP=OPEN, direction: IN via explicit rule: WEBHDFS/webhdfs/inbound/namenode/file to URL: http://namenode01:50070/webhdfs/v1/user/shfs3453/WORK/datasets/test_électronique_embarqué.pdf?OP=OPEN Oct 6 09:18:21 knox01 knox DEBUG - org.apache.hadoop.gatewayDispatch request: GET http://namenode01:50070/webhdfs/v1/user/shfs3453/WORK/datasets/test_%C3%A9lectronique_embarqu%C3%A9.pdf?doAs=shfs3453=OPEN Oct 6 09:18:21 localhost 16/10/06 09:18:21 ||c8a33790-ea9f-442a-ac8c-6b1d8589ab87|audit|WEBHDFS|shfs3453|||dispatch|uri|http://namenode01:50070/webhdfs/v1/user/shfs3453/WORK/datasets/test_%C3%A9lectronique_embarqu%C3%A9.pdf?doAs=shfs3453=OPEN|unavailable|Request method: GET Oct 6 09:18:21 knox01 knox DEBUG - org.apache.hadoop.gatewayDispatch response status: 307 Oct 6 09:18:21 localhost 16/10/06 09:18:21 ||c8a33790-ea9f-442a-ac8c-6b1d8589ab87|audit|WEBHDFS|shfs3453|||dispatch|uri|http://namenode01:50070/webhdfs/v1/user/shfs3453/WORK/datasets/test_%C3%A9lectronique_embarqu%C3%A9.pdf?doAs=shfs3453=OPEN|success|Response status: 307 Oct 6 09:18:21 knox01 knox DEBUG - org.apache.hadoop.gatewayRewrote URL: http://datanode05:1006/webhdfs/v1/user/shfs3453/WORK/datasets/test_électronique_embarqué.pdf?op=OPEN=KAAIc2hmczM0NTMEa25veARrbm94igFXmNt1TIoBV7zn-UyOL1GOBfgU_4Rrb_m7FUvmXc1StZhxQz_uw7cSV0VCSERGUyBkZWxlZ2F0aW9uEzE5Mi4xNjguMjAwLjIzOjgwMjA=sandbox=0, direction: OUT via explicit rule: WEBHDFS/webhdfs/outbound/namenode/headers/location to URL: https://... Oct 6 09:18:21 localhost ...10.170.45.30:
[jira] [Commented] (KNOX-754) curl requests fail when dealing with special characters
[ https://issues.apache.org/jira/browse/KNOX-754?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15548400#comment-15548400 ] Larry McCay commented on KNOX-754: -- Yikes - [~BigDataOrange]! I just said that I knew of no incompatibilities between 0.7.0 and 0.9.1. Just to clarify, you mean special characters within the URL not within files themselves - correct? Have you by chance tried it direct to WebHDFS instead of through Knox to see if it is reproducible without going through the gateway? We can turn on wire level DEBUG in gateway-log4j.properties to see the traffic between gateway and webhdfs as well. > curl requests fail when dealing with special characters > --- > > Key: KNOX-754 > URL: https://issues.apache.org/jira/browse/KNOX-754 > Project: Apache Knox > Issue Type: Bug > Components: ClientDSL, Server >Affects Versions: 0.9.1 > Environment: Apache Knox 0.9.1, Apache Hadoop 2.7.2 >Reporter: Alexandre Linte >Priority: Critical > > Since Knox 0.9.1, Knox can't work with files which contain special characters > as : é, ù, ü, è, etc... This is reproducible at 100%. It was working well > with Knox 0.7.0 so it's a regression. > This happens when doing a GET or a PUT of a file of this type, and more > particularly at the "location" process of the request. You can find an > example below: > {noformat} > [shfs3453@uabigspark01 Pig]$ curl -Iikv -u shfs3453 -X GET > 'https://knox-gateway.fr/gateway/bigdata/webhdfs/v1/user/shfs3453/WORK/datasets/test_électronique_embarqué.pdf?OP=OPEN' > Enter host password for user 'shfs3453': > * About to connect() to knox-gateway port 443 (#0) > * Trying 10.117.41.12... connected > * Connected to knox-gateway (10.117.41.12) port 443 (#0) > * Initializing NSS with certpath: sql:/etc/pki/nssdb > * warning: ignoring value of ssl.verifyhost > * skipping SSL peer certificate verification > * SSL connection using TLS_ECDHE_RSA_WITH_AES_256_CBC_SHA > * Server certificate: > * subject: > E=@*,CN=knox-gateway,OU=*,O=,L=*,ST=*,C=*** > * start date: Nov 07 11:33:05 2014 GMT > * expire date: Nov 06 11:33:05 2019 GMT > * common name: knox-gateway > * issuer: CN=***,OU=***,OU=,O=**,C=*** > * Server auth using Basic with user 'shfs3453' > > GET > > /gateway/bigdata/webhdfs/v1/user/shfs3453/WORK/datasets/test_électronique_embarqué.pdf?OP=OPEN > > HTTP/1.1 > > Authorization: Basic c2hmczM0NTM6UGIxOTkxMTAh > > User-Agent: curl/7.19.7 (x86_64-redhat-linux-gnu) libcurl/7.19.7 NSS/3.19.1 > > Basic ECC zlib/1.2.3 libidn/1.18 libssh2/1.4.2 > > Host: knox-gateway > > Accept: */* > > > < HTTP/1.1 307 Temporary Redirect > HTTP/1.1 307 Temporary Redirect > < Date: Wed, 05 Oct 2016 07:19:55 GMT > Date: Wed, 05 Oct 2016 07:19:55 GMT > < Set-Cookie: > JSESSIONID=4zv7v1911q5vvcg6r1tqxe77;Path=/gateway/bigdata;Secure;HttpOnly > Set-Cookie: > JSESSIONID=4zv7v1911q5vvcg6r1tqxe77;Path=/gateway/bigdata;Secure;HttpOnly > < Expires: Thu, 01 Jan 1970 00:00:00 GMT > Expires: Thu, 01 Jan 1970 00:00:00 GMT > < Set-Cookie: rememberMe=deleteMe; Path=/gateway/bigdata; Max-Age=0; > Expires=Tue, 04-Oct-2016 07:19:56 GMT > Set-Cookie: rememberMe=deleteMe; Path=/gateway/bigdata; Max-Age=0; > Expires=Tue, 04-Oct-2016 07:19:56 GMT > < Cache-Control: no-cache > Cache-Control: no-cache > < Expires: Wed, 05 Oct 2016 07:19:56 GMT > Expires: Wed, 05 Oct 2016 07:19:56 GMT > < Date: Wed, 05 Oct 2016 07:19:56 GMT > Date: Wed, 05 Oct 2016 07:19:56 GMT > < Pragma: no-cache > Pragma: no-cache > < Expires: Wed, 05 Oct 2016 07:19:56 GMT > Expires: Wed, 05 Oct 2016 07:19:56 GMT > < Date: Wed, 05 Oct 2016 07:19:56 GMT > Date: Wed, 05 Oct 2016 07:19:56 GMT > < Pragma: no-cache > Pragma: no-cache > < Location: > https://knox-gateway/gateway/bigdata/webhdfs/data/v1/webhdfs/v1/user/shfs3453/WORK/datasets/test_▒lectronique_embarqu▒.pdf?_=CBEAl_jkRL_c3Tzm7hoXMR1KPge4OClEqM4hfs3eslFzfdY5CBbrfaMzOa--NXb08Xjw2O11CkOtyUX5kXwh2IgZmxjw_TNHqQUvVAfFkeXiMDiBXxpbhulsVx3o_NLn9pCLsp09xJ9r1utCHrueYOAvuxY_ksQWuHld2WWGEPyWRubcgb4e6xO2F4jo96NSZhuAP8iarY5LiCtTydLPBXcEbbD146jLD7S83Mhij4VS5sO1asESNH5y8_5Z2PvLcZE11WiTS9alu-9AUqXNixw1t9Y5Em6xDle7s8-oiF3nPVM80RIdbJel4LoeCZuB2zgddLaJAYx5tSb03-QGNzupOPQ5UQ0_7ybPwmAsgiFfFNuvMbj9sKgxLg > Location: >