[ 
https://issues.apache.org/jira/browse/HDFS-14665?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16906961#comment-16906961
 ] 

Siyao Meng commented on HDFS-14665:
-----------------------------------

Thanks for reviewing/committing [~jojochuang]!

Rebased on branch-3.1, PR: https://github.com/apache/hadoop/pull/1291

> HttpFS: LISTSTATUS response is missing HDFS-specific fields
> -----------------------------------------------------------
>
>                 Key: HDFS-14665
>                 URL: https://issues.apache.org/jira/browse/HDFS-14665
>             Project: Hadoop HDFS
>          Issue Type: Improvement
>          Components: httpfs
>            Reporter: Siyao Meng
>            Assignee: Siyao Meng
>            Priority: Major
>             Fix For: 3.3.0, 3.2.1
>
>
> WebHDFS:
> {code:java}
> GET /webhdfs/v1/tmp/?op=LISTSTATUS&user.name=hdfs HTTP/1.1
> {code}
> {code}
> {
>   "FileStatuses": {
>     "FileStatus": [
> ...
>       {
>         "accessTime": 0,
>         "blockSize": 0,
>         "childrenNum": 0,
>         "fileId": 16395,
>         "group": "hadoop",
>         "length": 0,
>         "modificationTime": 1563893395614,
>         "owner": "mapred",
>         "pathSuffix": "logs",
>         "permission": "1777",
>         "replication": 0,
>         "storagePolicy": 0,
>         "type": "DIRECTORY"
>       }
>     ]
>   }
> }
> {code}
> HttpFS:
> {code:java}
> GET /webhdfs/v1/tmp/?op=LISTSTATUS&user.name=hdfs HTTP/1.1
> {code}
> {code}
> {
>   "FileStatuses": {
>     "FileStatus": [
> ...
>       {
>         "pathSuffix": "logs",
>         "type": "DIRECTORY",
>         "length": 0,
>         "owner": "mapred",
>         "group": "hadoop",
>         "permission": "1777",
>         "accessTime": 0,
>         "modificationTime": 1563893395614,
>         "blockSize": 0,
>         "replication": 0
>       }
>     ]
>   }
> }
> {code}
> You can see the same LISTSTATUS request to HttpFS is missing 3 fields:
> {code}
> "childrenNum" (should only be none 0 for directories)
> "fileId"
> "storagePolicy"
> {code}
> The same applies to LISTSTATUS_BATCH, which might be using the same 
> underlying calls to compose the response.
> Root cause:
> [toJsonInner|https://github.com/apache/hadoop/blob/17e8cf501b384af93726e4f2e6f5e28c6e3a8f65/hadoop-hdfs-project/hadoop-hdfs-httpfs/src/main/java/org/apache/hadoop/fs/http/server/FSOperations.java#L120]
>  didn't serialize the HDFS-specific keys from FileStatus.
> Also may file another Jira to align the order of the keys in the responses.



--
This message was sent by Atlassian JIRA
(v7.6.14#76016)

---------------------------------------------------------------------
To unsubscribe, e-mail: hdfs-issues-unsubscr...@hadoop.apache.org
For additional commands, e-mail: hdfs-issues-h...@hadoop.apache.org

Reply via email to