Re: directory scan issue

2011-03-29 Thread Rita
Thankyou. Switching to ext4 On Tue, Mar 29, 2011 at 8:23 AM, Eric wrote: > Rita, another issue I've seen is that when you have lots of XFS filesystems > that are heavily used, the Linux kernel will at some point crash. So the XFS > driver seems to have problems that only appear with large volume

Re: directory scan issue

2011-03-29 Thread Eric
Rita, another issue I've seen is that when you have lots of XFS filesystems that are heavily used, the Linux kernel will at some point crash. So the XFS driver seems to have problems that only appear with large volumes of data. I will switch to EXT4 soon because of this. 2011/3/29 Rita > Thanks

Re: directory scan issue

2011-03-29 Thread Rita
Thanks with ext4 i created 2 16TB volumes and they are seen. I think it maybe a issue with XFS. On Mon, Mar 28, 2011 at 3:50 PM, Todd Lipcon wrote: > On Fri, Mar 25, 2011 at 9:06 PM, Rita wrote: > >> Using 0.21 >> >> When I have a filesystem (XFS) with 1TB it detects the datanode detects it >

Re: directory scan issue

2011-03-28 Thread Todd Lipcon
On Fri, Mar 25, 2011 at 9:06 PM, Rita wrote: > Using 0.21 > > When I have a filesystem (XFS) with 1TB it detects the datanode detects it > immediately. When I create 3 identical file systems all 3TB are visible > immediately. > > If I create a 6TB filesystem (XFS) and I add it to dfs.data.dir and

directory scan issue

2011-03-25 Thread Rita
Using 0.21 When I have a filesystem (XFS) with 1TB it detects the datanode detects it immediately. When I create 3 identical file systems all 3TB are visible immediately. If I create a 6TB filesystem (XFS) and I add it to dfs.data.dir and I restart the datanode, "hdfs dfsadmin -report" does not s