zfs discuss - Nov 2011 - bug moving files between two zfs filesystems (too many open files)

Hello

Has anyone else come across a bug moving files between two zfs file systems?

I used "mv /my/zfs/filesystem/files /my/zfs/otherfilesystem" and got
the error "too many open files".

This is on Solaris 11
-------------- next part --------------
An HTML attachment was scrubbed...
URL:
<http://mail.opensolaris.org/pipermail/zfs-discuss/attachments/20111129/dd243f4e/attachment.html>

I think the "too many open files" is a generic error message about 
running out of file descriptors. You should check your shell ulimit
information.

On 11/29/11 09:28, sol wrote:
> Hello
>
> Has anyone else come across a bug moving files between two zfs file
systems?
>
> I used "mv /my/zfs/filesystem/files /my/zfs/otherfilesystem" and
got the
> error "too many open files".
>
> This is on Solaris 11
>
>
>
> _______________________________________________
> zfs-discuss mailing list
> zfs-discuss at opensolaris.org
> http://mail.opensolaris.org/mailman/listinfo/zfs-discuss

>I think the "too many open files" is a generic error message about
>running out of file descriptors. You should check your shell ulimit
>information.

Yeah, but mv shouldn''t run out of file descriptors or should be
handle to deal with that.

Are we moving a tree of files?

Casper

Yep, that''s not filesystem issue, it''s a kernel VFS level.

Sent from my iPad

On Nov 29, 2011, at 10:17 PM, Cindy Swearingen <cindy.swearingen at
oracle.com> wrote:
> I think the "too many open files" is a generic error message
about running out of file descriptors. You should check your shell ulimit
> information.
> 
> On 11/29/11 09:28, sol wrote:
>> Hello
>> 
>> Has anyone else come across a bug moving files between two zfs file
systems?
>> 
>> I used "mv /my/zfs/filesystem/files /my/zfs/otherfilesystem"
and got the
>> error "too many open files".
>> 
>> This is on Solaris 11
>> 
>> 
>> 
>> _______________________________________________
>> zfs-discuss mailing list
>> zfs-discuss at opensolaris.org
>> http://mail.opensolaris.org/mailman/listinfo/zfs-discuss
> _______________________________________________
> zfs-discuss mailing list
> zfs-discuss at opensolaris.org
> http://mail.opensolaris.org/mailman/listinfo/zfs-discuss

On Tue, Nov 29, 2011 at 12:17 PM, Cindy Swearingen
<cindy.swearingen at oracle.com> wrote:
> I think the "too many open files" is a generic error message
about running
> out of file descriptors. You should check your shell ulimit
> information.
Also, see how many open files you have: echo /proc/self/fd/*

It''d be quite weird though to have a very low fd limit or a very large
number of file descriptors open in the shell.

That said, as Casper says, utilities like mv(1) should be able to cope
with reasonably small fd limits (i.e., not as small as 3, but perhaps
as small as 10).

Nico
--

Yes, it''s moving a tree of files, and the shell ulimit is the default
(which I think is 256).


It happened twice recently in normal use but not when I tried to replicate it
(standard test response ;-))


Anyway it only happened moving between zfs filesystems in Solaris 11,
I''ve never seen it before, which is why I posted here first. But if
it''s a problem elsewhere in Solaris I should move the discussion...
although any ideas are welcome!



>________________________________
> From: "Casper.Dik at oracle.com" <Casper.Dik at oracle.com>
>>I think the "too many open files" is a generic error message
about?
>>running out of file descriptors. You should check your shell ulimit
>>information.
>
>Yeah, but mv shouldn''t run out of file descriptors or should be
>handle to deal with that.
>
>Are we moving a tree of files?
>
-------------- next part --------------
An HTML attachment was scrubbed...
URL:
<http://mail.opensolaris.org/pipermail/zfs-discuss/attachments/20111129/d92bca1e/attachment.html>

On Tue, 29 Nov 2011, sol wrote:
> Yes, it''s moving a tree of files, and the shell ulimit is the
default (which I think is 256).
> 
> It happened twice recently in normal use but not when I tried to replicate
it (standard test response ;-))
Is it possible that ''mv'' is multi-threaded in Solaris 11?

Bob
-- 
Bob Friesenhahn
bfriesen at simple.dallas.tx.us, http://www.simplesystems.org/users/bfriesen/
GraphicsMagick Maintainer,    http://www.GraphicsMagick.org/

On Tue, Nov 29, 2011 at 10:25 AM,  <Casper.Dik at oracle.com>
wrote:
>
>>I think the "too many open files" is a generic error message
about
>>running out of file descriptors. You should check your shell ulimit
>>information.
>
>
> Yeah, but mv shouldn''t run out of file descriptors or should be
> handle to deal with that.
>
> Are we moving a tree of files?
Recently I had some very weird experiences with running out of FD''s
while patching Solaris 10 U8 boxes with zones using Live Upgrade.  Of
the 4 very similar systems, two servers required using raising the
FD''s ridiculously high (IMO) for the zones using projmod. In this
case, the running zones (not the snapshots being patched) were idle.
The other two servers required me to change /etc/system in the running
zones, reboot them, and then use LU to clone them before the patching
would work.  I raised the projmod limit to 2 million, and it still
wouldn''t work.  In this case the running zones were doing "real
work".

Ostensibly, aside from the 2 where the zones were doing "real work",
these servers were identical--built at the same time using jumpstart,
zones built by cloning a dummy zone and applying changes via a script,
same production application installed, and other changes made on 4 of
them, etc.

Based on this experience, I don''t believe FD limit enforcements are
not consistently implemented throughout the OS.  I''ve not yet
submitted an SR about it due to some unrelated non-technical issues
that I''ve had to deal with.

=Nadine=