[
https://issues.apache.org/jira/browse/HADOOP-16258?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Yuya Ebihara updated HADOOP-16258:
----------------------------------
Description:
Recently, we upgraded hadoop library from 2.7.7 to 3.2.0. When we call
FileSystem.listLocatedStatus with location
'webhdfs://hadoop-master:50070/user/hive/warehouse/test_part/dt=1', the
internal calls are
* 2.7.7
[http://hadoop-master:50070/webhdfs/v1/user/hive/warehouse/test_part/dt=1?op=LISTSTATUS&user.name=xxx|http://hadoop-master:50070/webhdfs/v1/user/hive/warehouse/test_part/dt=1?op=LISTSTATUS&user.name=xxx%27,]
* 3.2.0
[http://hadoop-master:50070/webhdfs/v1/user/hive/warehouse/test_part/dt%253D1?op=LISTSTATUS&user.name=xxx]'
As a result, it returns RemoteException with FileNotFoundException.
{code:java}
{"RemoteException":{"exception":"FileNotFoundException","javaClassName":"java.io.FileNotFoundException","message":"File
/user/hive/warehouse/test_part/dt%3D1 does not exist."}}
{code}
Could you please tell me whether it's a bug and the way to avoid it?
was:
Recently, we upgraded hadoop library from 2.7.7 to 3.2.0. When we call
FileSystem.listLocatedStatus with location
'webhdfs://hadoop-master:50070/user/hive/warehouse/test_part/dt=1', the
internal calls are
* 2.7.7
[http://hadoop-master:50070/webhdfs/v1/user/hive/warehouse/test_part/dt=1?op=LISTSTATUS&user.name=xxx|http://hadoop-master:50070/webhdfs/v1/user/hive/warehouse/test_part/dt=1?op=LISTSTATUS&user.name=xxx%27,]
* 3.2.0
[http://hadoop-master:50070/webhdfs/v1/user/hive/warehouse/test_part/dt%253D1?op=LISTSTATUS&user.name=xxx]'
As a result, it returns RemoteException.
{code:java}
{"RemoteException":{"exception":"FileNotFoundException","javaClassName":"java.io.FileNotFoundException","message":"File
/user/hive/warehouse/test_part/dt%3D1 does not exist."}}
{code}
Could you please tell me whether it's a bug and the way to avoid it?
> FileSystem.listLocatedStatus for path including '=' encodes it and returns
> FileNotFoundException
> ------------------------------------------------------------------------------------------------
>
> Key: HADOOP-16258
> URL: https://issues.apache.org/jira/browse/HADOOP-16258
> Project: Hadoop Common
> Issue Type: Bug
> Components: fs
> Reporter: Yuya Ebihara
> Priority: Minor
>
> Recently, we upgraded hadoop library from 2.7.7 to 3.2.0. When we call
> FileSystem.listLocatedStatus with location
> 'webhdfs://hadoop-master:50070/user/hive/warehouse/test_part/dt=1', the
> internal calls are
> * 2.7.7
> [http://hadoop-master:50070/webhdfs/v1/user/hive/warehouse/test_part/dt=1?op=LISTSTATUS&user.name=xxx|http://hadoop-master:50070/webhdfs/v1/user/hive/warehouse/test_part/dt=1?op=LISTSTATUS&user.name=xxx%27,]
> * 3.2.0
> [http://hadoop-master:50070/webhdfs/v1/user/hive/warehouse/test_part/dt%253D1?op=LISTSTATUS&user.name=xxx]'
> As a result, it returns RemoteException with FileNotFoundException.
> {code:java}
> {"RemoteException":{"exception":"FileNotFoundException","javaClassName":"java.io.FileNotFoundException","message":"File
> /user/hive/warehouse/test_part/dt%3D1 does not exist."}}
> {code}
> Could you please tell me whether it's a bug and the way to avoid it?
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
