zfs discuss - Sep 2008 - Max vol size and number of files in production

Hi,

My problem is one of my customer wants to change his Exanet Systems to ZFS, but
SUN told him that there is real limitation with ZFS :
Customer env :
Incoming Data
FS SIZE : 50 TB, with at least 100 Thousand files write  per day, around 20
Millions files.
Consulting Data
FS Size : 200 TB with at least 300 Millions Files

Sun told him over 10 millions files ZFS should not be the right solution.
Do you have POC or explanation to this limitations regarding the spec of ZFS.
Best regards
--
This message posted from opensolaris.org

The issue is EXANET isn''t really holding "300 million files"
in one dataset
like you''re talking about doing with zfs.  It''s a clustered
approach with a
single namespace.

Reality is you can do what the customer wants to do, but you''d be
leveraging
something like pnfs which I don''t think is quite production ready yet.

I''m sure there are others on this list much better versed in PNFS than
myself that can speak to that solution.

--Tim



On Thu, Sep 4, 2008 at 12:59 PM, Jean Luc Berrier <jlberrier at free.fr>
wrote:
> Hi,
>
> My problem is one of my customer wants to change his Exanet Systems to ZFS,
> but SUN told him that there is real limitation with ZFS :
> Customer env :
> Incoming Data
> FS SIZE : 50 TB, with at least 100 Thousand files write  per day, around 20
> Millions files.
> Consulting Data
> FS Size : 200 TB with at least 300 Millions Files
>
> Sun told him over 10 millions files ZFS should not be the right solution.
> Do you have POC or explanation to this limitations regarding the spec of
> ZFS.
> Best regards
> --
> This message posted from opensolaris.org
> _______________________________________________
> zfs-discuss mailing list
> zfs-discuss at opensolaris.org
> http://mail.opensolaris.org/mailman/listinfo/zfs-discuss
>
-------------- next part --------------
An HTML attachment was scrubbed...
URL:
<http://mail.opensolaris.org/pipermail/zfs-discuss/attachments/20080904/926d6855/attachment.html>

On Thu, Sep 4, 2008 at 6:59 PM, Jean Luc Berrier <jlberrier at free.fr>
wrote:
> Hi,
>
> My problem is one of my customer wants to change his Exanet Systems to ZFS,
but SUN told him that there is real limitation with ZFS :
> Customer env :
> Incoming Data
> FS SIZE : 50 TB, with at least 100 Thousand files write  per day, around 20
Millions files.
> Consulting Data
> FS Size : 200 TB with at least 300 Millions Files
>
> Sun told him over 10 millions files ZFS should not be the right solution.
> Do you have POC or explanation to this limitations regarding the spec of
ZFS.
I''m not sure why 10 million files would be a problem. I''ve got
several
production filesystems with 30 million files in them, and they work just
fine (and we expect to grow well above the sizes and numbers you give above).
I''ve got plenty of ufs filesystems with 10-20 million files in them.

Backing that up would be a problem, but I can''t see zfs having issues.

-- 
-Peter Tribble
http://www.petertribble.co.uk/ - http://ptribble.blogspot.com/