[ 
https://issues.apache.org/jira/browse/HDFS-9084?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15153958#comment-15153958
 ] 

Tsuyoshi Ozawa commented on HDFS-9084:
--------------------------------------

[~raviprak] thank you for the very neat feature! It works well with small files 
or directories. I'm also okay to postpone the trimming down of columns to 
another JIRA.

I think, however, we have one problem. If the number of directories increases, 
the Web UI gets slow down because the client-side rendering take CPU time. I 
had an experiment as follows:

{code}
$ cat /dev/urandom | tr -dc 'a-zA-Z0-9' | fold -w 16  | head -n 150000 > 
lists.txt
$ cat lists.txt | hdfs dfs -mkdir 
<It takes 50 sec to render the result>
{code}

This can be happens when Hive create lots partition. My suggestion is to create 
upper limit of the entries to be rendered like Google's search result. What do 
you think?

> Pagination, sorting and filtering of files/directories in the HDFS Web UI
> -------------------------------------------------------------------------
>
>                 Key: HDFS-9084
>                 URL: https://issues.apache.org/jira/browse/HDFS-9084
>             Project: Hadoop HDFS
>          Issue Type: Sub-task
>    Affects Versions: 2.4.0
>            Reporter: Ravi Prakash
>            Assignee: Ravi Prakash
>         Attachments: HDFS-9084.01.patch, HDFS-9084.02.patch
>
>
> We should paginate directories with a large number of children. 
> Simultaneously, we can allow searching, sorting and filtering in those columns



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Reply via email to