[
https://issues.apache.org/jira/browse/KNOX-2240?focusedWorklogId=407758&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-407758
]
ASF GitHub Bot logged work on KNOX-2240:
----------------------------------------
Author: ASF GitHub Bot
Created on: 23/Mar/20 08:20
Start Date: 23/Mar/20 08:20
Worklog Time Spent: 10m
Work Description: smolnar82 commented on pull request #296: KNOX-2240 -
KnoxShell Custom Command for WEBHDFS Use
URL: https://github.com/apache/knox/pull/296#discussion_r396274308
##########
File path:
gateway-util-common/src/test/java/org/apache/knox/gateway/util/JsonUtilsTest.java
##########
@@ -54,4 +55,46 @@ public void testGetMapFromString() {
assertEquals("Bearer", map.get("token_type"));
assertEquals("1364487943100", map.get("expires_in"));
}
+
+ @Test
+ public void testFileStatusesAsMap() {
+ String json = "{\n" +
+ " \"FileStatuses\":{\n" +
+ " \"FileStatus\":[\n" +
+ " {\n" +
+ " \"accessTime\":0,\n" +
+ " \"blockSize\":0,\n" +
+ " \"childrenNum\":3,\n" +
+ " \"fileId\":16389,\n" +
+ " \"group\":\"supergroup\",\n" +
+ " \"length\":0,\n" +
+ " \"modificationTime\":1581578495905,\n" +
+ " \"owner\":\"hdfs\",\n" +
+ " \"pathSuffix\":\"tmp\",\n" +
+ " \"permission\":\"1777\",\n" +
+ " \"replication\":0,\n" +
+ " \"storagePolicy\":0,\n" +
+ " \"type\":\"DIRECTORY\"\n" +
+ " },\n" +
+ " {\n" +
+ " \"accessTime\":0,\n" +
+ " \"blockSize\":0,\n" +
+ " \"childrenNum\":658,\n" +
+ " \"fileId\":16386,\n" +
+ " \"group\":\"supergroup\",\n" +
+ " \"length\":0,\n" +
+ " \"modificationTime\":1581578527580,\n" +
+ " \"owner\":\"hdfs\",\n" +
+ " \"pathSuffix\":\"user\",\n" +
+ " \"permission\":\"755\",\n" +
+ " \"replication\":0,\n" +
+ " \"storagePolicy\":0,\n" +
+ " \"type\":\"DIRECTORY\"\n" +
+ " } \n" +
+ " ]\n" +
+ " }\n" +
+ "}";
+ Map<String,HashMap<String, ArrayList<HashMap<String, String>>>> map =
JsonUtils.getFileStatusesAsMap(json);
+ assertNotNull(map);
+ }
Review comment:
nit: some more asserts to place here to see if the generated map has the
proper content?
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
[email protected]
Issue Time Tracking
-------------------
Worklog Id: (was: 407758)
Time Spent: 1h (was: 50m)
> KnoxShell Custom Command for WEBHDFS Use
> ----------------------------------------
>
> Key: KNOX-2240
> URL: https://issues.apache.org/jira/browse/KNOX-2240
> Project: Apache Knox
> Issue Type: Improvement
> Components: KnoxShell
> Reporter: Larry McCay
> Assignee: Larry McCay
> Priority: Major
> Fix For: 1.4.0
>
> Time Spent: 1h
> Remaining Estimate: 0h
>
> I'd like to extend the KnoxShell environment to have a Custom Command for
> interacting with Hadoop FileSystems that support the WebHDFS REST API. We
> will wrap the use of the KnoxShell HDFS classes for posix like commands in
> the shell environment.
> In order to interact with multiple webhdfs filesystems we introduce the
> notion of mounting a webhdfs service from a Knox topology URL. For instance,
> see the following mount command to mount such a service to a mount point:
> {code}
> :fs mount https://knoxhost.example.com/topology/cdp-proxy-api retail
> {code}
> The above mounts a Hadoop filesystem to a mount point called "retail".
> Given this mounted filesystem we are able to interact with it through the
> mountpoint as the root.
> {code}
> :fs ls /retail/user/lmccay
> {code}
> The above will list the contents of my home directory from the mounted
> filesystem as well as return the listing as a KnoxShellTable that can be
> sorted, selected, filtered, etc as any other KnoxShellTable.
> Additional commands
> {code}
> :fs mkdir /retail/user/lmccay/tmp 755
> :fs cat /retail/user/lmccay/tmp/README
> :fs put /home/lmccay/README /retail/user/lmccay/tmp/README
> :fs get /retail/user/lmccay/tmp/README /home/lmccay/README
> :fs rename /retail/user/lmccay/tmp/README /retail/user/lmccay/tmp/README2
> :fs rm /retail/user/lmccay/tmp/README
> {code}
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
