Re: [zfs-discuss] bug moving files between two zfs filesystems (too many open files)
On Tue, Nov 29, 2011 at 10:25 AM, casper@oracle.com wrote: I think the too many open files is a generic error message about running out of file descriptors. You should check your shell ulimit information. Yeah, but mv shouldn't run out of file descriptors or should be handle to deal with that. Are we moving a tree of files? Recently I had some very weird experiences with running out of FD's while patching Solaris 10 U8 boxes with zones using Live Upgrade. Of the 4 very similar systems, two servers required using raising the FD's ridiculously high (IMO) for the zones using projmod. In this case, the running zones (not the snapshots being patched) were idle. The other two servers required me to change /etc/system in the running zones, reboot them, and then use LU to clone them before the patching would work. I raised the projmod limit to 2 million, and it still wouldn't work. In this case the running zones were doing real work. Ostensibly, aside from the 2 where the zones were doing real work, these servers were identical--built at the same time using jumpstart, zones built by cloning a dummy zone and applying changes via a script, same production application installed, and other changes made on 4 of them, etc. Based on this experience, I don't believe FD limit enforcements are not consistently implemented throughout the OS. I've not yet submitted an SR about it due to some unrelated non-technical issues that I've had to deal with. =Nadine= ___ zfs-discuss mailing list zfs-discuss@opensolaris.org http://mail.opensolaris.org/mailman/listinfo/zfs-discuss
[zfs-discuss] bug moving files between two zfs filesystems (too many open files)
Hello Has anyone else come across a bug moving files between two zfs file systems? I used mv /my/zfs/filesystem/files /my/zfs/otherfilesystem and got the error too many open files. This is on Solaris 11 ___ zfs-discuss mailing list zfs-discuss@opensolaris.org http://mail.opensolaris.org/mailman/listinfo/zfs-discuss
Re: [zfs-discuss] bug moving files between two zfs filesystems (too many open files)
I think the too many open files is a generic error message about running out of file descriptors. You should check your shell ulimit information. On 11/29/11 09:28, sol wrote: Hello Has anyone else come across a bug moving files between two zfs file systems? I used mv /my/zfs/filesystem/files /my/zfs/otherfilesystem and got the error too many open files. This is on Solaris 11 ___ zfs-discuss mailing list zfs-discuss@opensolaris.org http://mail.opensolaris.org/mailman/listinfo/zfs-discuss ___ zfs-discuss mailing list zfs-discuss@opensolaris.org http://mail.opensolaris.org/mailman/listinfo/zfs-discuss
Re: [zfs-discuss] bug moving files between two zfs filesystems (too many open files)
I think the too many open files is a generic error message about running out of file descriptors. You should check your shell ulimit information. Yeah, but mv shouldn't run out of file descriptors or should be handle to deal with that. Are we moving a tree of files? Casper ___ zfs-discuss mailing list zfs-discuss@opensolaris.org http://mail.opensolaris.org/mailman/listinfo/zfs-discuss
Re: [zfs-discuss] bug moving files between two zfs filesystems (too many open files)
Yep, that's not filesystem issue, it's a kernel VFS level. Sent from my iPad On Nov 29, 2011, at 10:17 PM, Cindy Swearingen cindy.swearin...@oracle.com wrote: I think the too many open files is a generic error message about running out of file descriptors. You should check your shell ulimit information. On 11/29/11 09:28, sol wrote: Hello Has anyone else come across a bug moving files between two zfs file systems? I used mv /my/zfs/filesystem/files /my/zfs/otherfilesystem and got the error too many open files. This is on Solaris 11 ___ zfs-discuss mailing list zfs-discuss@opensolaris.org http://mail.opensolaris.org/mailman/listinfo/zfs-discuss ___ zfs-discuss mailing list zfs-discuss@opensolaris.org http://mail.opensolaris.org/mailman/listinfo/zfs-discuss ___ zfs-discuss mailing list zfs-discuss@opensolaris.org http://mail.opensolaris.org/mailman/listinfo/zfs-discuss
Re: [zfs-discuss] bug moving files between two zfs filesystems (too many open files)
On Tue, Nov 29, 2011 at 12:17 PM, Cindy Swearingen cindy.swearin...@oracle.com wrote: I think the too many open files is a generic error message about running out of file descriptors. You should check your shell ulimit information. Also, see how many open files you have: echo /proc/self/fd/* It'd be quite weird though to have a very low fd limit or a very large number of file descriptors open in the shell. That said, as Casper says, utilities like mv(1) should be able to cope with reasonably small fd limits (i.e., not as small as 3, but perhaps as small as 10). Nico -- ___ zfs-discuss mailing list zfs-discuss@opensolaris.org http://mail.opensolaris.org/mailman/listinfo/zfs-discuss
Re: [zfs-discuss] bug moving files between two zfs filesystems (too many open files)
Yes, it's moving a tree of files, and the shell ulimit is the default (which I think is 256). It happened twice recently in normal use but not when I tried to replicate it (standard test response ;-)) Anyway it only happened moving between zfs filesystems in Solaris 11, I've never seen it before, which is why I posted here first. But if it's a problem elsewhere in Solaris I should move the discussion... although any ideas are welcome! From: casper@oracle.com casper@oracle.com I think the too many open files is a generic error message about running out of file descriptors. You should check your shell ulimit information. Yeah, but mv shouldn't run out of file descriptors or should be handle to deal with that. Are we moving a tree of files? ___ zfs-discuss mailing list zfs-discuss@opensolaris.org http://mail.opensolaris.org/mailman/listinfo/zfs-discuss
Re: [zfs-discuss] bug moving files between two zfs filesystems (too many open files)
On Tue, 29 Nov 2011, sol wrote: Yes, it's moving a tree of files, and the shell ulimit is the default (which I think is 256). It happened twice recently in normal use but not when I tried to replicate it (standard test response ;-)) Is it possible that 'mv' is multi-threaded in Solaris 11? Bob -- Bob Friesenhahn bfrie...@simple.dallas.tx.us, http://www.simplesystems.org/users/bfriesen/ GraphicsMagick Maintainer,http://www.GraphicsMagick.org/ ___ zfs-discuss mailing list zfs-discuss@opensolaris.org http://mail.opensolaris.org/mailman/listinfo/zfs-discuss
