[
https://issues.apache.org/jira/browse/HDFS-9084?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15153958#comment-15153958
]
Tsuyoshi Ozawa commented on HDFS-9084:
--------------------------------------
[~raviprak] thank you for the very neat feature! It works well with small files
or directories. I'm also okay to postpone the trimming down of columns to
another JIRA.
I think, however, we have one problem. If the number of directories increases,
the Web UI gets slow down because the client-side rendering take CPU time. I
had an experiment as follows:
{code}
$ cat /dev/urandom | tr -dc 'a-zA-Z0-9' | fold -w 16 | head -n 150000 >
lists.txt
$ cat lists.txt | hdfs dfs -mkdir
<It takes 50 sec to render the result>
{code}
This can be happens when Hive create lots partition. My suggestion is to create
upper limit of the entries to be rendered like Google's search result. What do
you think?
> Pagination, sorting and filtering of files/directories in the HDFS Web UI
> -------------------------------------------------------------------------
>
> Key: HDFS-9084
> URL: https://issues.apache.org/jira/browse/HDFS-9084
> Project: Hadoop HDFS
> Issue Type: Sub-task
> Affects Versions: 2.4.0
> Reporter: Ravi Prakash
> Assignee: Ravi Prakash
> Attachments: HDFS-9084.01.patch, HDFS-9084.02.patch
>
>
> We should paginate directories with a large number of children.
> Simultaneously, we can allow searching, sorting and filtering in those columns
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)