[
https://issues.apache.org/jira/browse/HDFS-9084?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15153958#comment-15153958
]
Tsuyoshi Ozawa edited comment on HDFS-9084 at 2/19/16 9:13 AM:
---------------------------------------------------------------
[~raviprak] thank you for the very neat feature! It works well with small
numbers of files and directories. I'm also okay to postpone the trimming down
of columns to another JIRA.
I think, however, we have one problem. If the number of directories increases,
the Web UI gets slow down because the client-side rendering take CPU time. I
had an experiment as follows:
{code}
$ cat /dev/urandom | tr -dc 'a-zA-Z0-9' | fold -w 16 | head -n 150000 >
lists.txt
$ cat lists.txt | hdfs dfs -mkdir
<It takes 50 sec to render the result>
{code}
This can be happens when Hive creates lots partition. My suggestion is to
create configuration value for the upper limit of the entries to be rendered
like Google's search result. What do you think?
was (Author: ozawa):
[~raviprak] thank you for the very neat feature! It works well with small
numbers of files and directories. I'm also okay to postpone the trimming down
of columns to another JIRA.
I think, however, we have one problem. If the number of directories increases,
the Web UI gets slow down because the client-side rendering take CPU time. I
had an experiment as follows:
{code}
$ cat /dev/urandom | tr -dc 'a-zA-Z0-9' | fold -w 16 | head -n 150000 >
lists.txt
$ cat lists.txt | hdfs dfs -mkdir
<It takes 50 sec to render the result>
{code}
This can be happens when Hive create lots partition. My suggestion is to create
upper limit of the entries to be rendered like Google's search result. What do
you think?
> Pagination, sorting and filtering of files/directories in the HDFS Web UI
> -------------------------------------------------------------------------
>
> Key: HDFS-9084
> URL: https://issues.apache.org/jira/browse/HDFS-9084
> Project: Hadoop HDFS
> Issue Type: Sub-task
> Affects Versions: 2.4.0
> Reporter: Ravi Prakash
> Assignee: Ravi Prakash
> Attachments: HDFS-9084.01.patch, HDFS-9084.02.patch
>
>
> We should paginate directories with a large number of children.
> Simultaneously, we can allow searching, sorting and filtering in those columns
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
