Does anyone have any tuning tips for a Subversion repository on ZFS? The repository will mainly be storing binary (MS Office documents). It looks like a vanilla, uncompressed file system is the best bet. Ian
On Wed, Aug 27, 2008 at 3:29 PM, Ian Collins <ian at ianshome.com> wrote:> > Does anyone have any tuning tips for a Subversion repository on ZFS? The > repository will mainly be storing binary (MS Office documents). > > It looks like a vanilla, uncompressed file system is the best bet. > > Ian > _______________________________________________ > zfs-discuss mailing list > zfs-discuss at opensolaris.org > http://mail.opensolaris.org/mailman/listinfo/zfs-discuss >I believe this is called sharepoint :D I think the biggest deal/question will be: how many files? How big is the pool? Do they all need to be on the same pool, or can you split it up. The biggest issue performance wise you''ll see with zfs is from millions of tiny files. That would also determine tuning. I guess the other question would be how much ram? What sort of backend storage? FC/SATA/SAS? Internal, coming off a SAN? I''m assuming the files won''t get hit very hard if they''re just office documents, but you may have a special use-case :) --Tim -------------- next part -------------- An HTML attachment was scrubbed... URL: <http://mail.opensolaris.org/pipermail/zfs-discuss/attachments/20080827/3b3a0f1b/attachment.html>
Tim writes:> On Wed, Aug 27, 2008 at 3:29 PM, Ian Collins <ian at ianshome.com> wrote: > >> >> Does anyone have any tuning tips for a Subversion repository on ZFS? The >> repository will mainly be storing binary (MS Office documents). >> >> It looks like a vanilla, uncompressed file system is the best bet. >> > > I believe this is called sharepoint :DDon''t mention that abomination!> I think the biggest deal/question > will be: how many files? How big is the pool? Do they all need to be on > the same pool, or can you split it up. The biggest issue performance wise > you''ll see with zfs is from millions of tiny files. That would also > determine tuning. >I''m setting up a trial for one project, there are about 3000 files, 1GB of data. Office files and small are orthogonal concepts!> I guess the other question would be how much ram? What sort of backend > storage? FC/SATA/SAS? Internal, coming off a SAN? I''m assuming the files > won''t get hit very hard if they''re just office documents, but you may have a > special use-case :) >The data''s on a Thumper, 16GB of RAM. Most of the load will probably be generating deltas on commits. Ian
On 27-Aug-08, at 5:47 PM, Ian Collins wrote:> Tim writes: > >> On Wed, Aug 27, 2008 at 3:29 PM, Ian Collins <ian at ianshome.com> >> wrote: >> >>> >>> Does anyone have any tuning tips for a Subversion repository on >>> ZFS? The >>> repository will mainly be storing binary (MS Office documents). >>> >>> It looks like a vanilla, uncompressed file system is the best bet. >>> >> >> I believe this is called sharepoint :D > > Don''t mention that abomination!Amen.> >> I think the biggest deal/question >> will be: how many files? How big is the pool? Do they all need >> to be on >> the same pool, or can you split it up. The biggest issue >> performance wise >> you''ll see with zfs is from millions of tiny files. That would also >> determine tuning. >> > I''m setting up a trial for one project, there are about 3000 files, > 1GB of > data. Office files and small are orthogonal concepts!Just an aside, docx will defeat both Subversion''s deltas and ZFS compression, so you''re really completely at the mercy of Microsoft no matter what you do. But that''s not a large repository. Vanilla ZFS will do just fine... Good luck, --Toby> >> I guess the other question would be how much ram? What sort of >> backend >> storage? FC/SATA/SAS? Internal, coming off a SAN? I''m assuming >> the files >> won''t get hit very hard if they''re just office documents, but you >> may have a >> special use-case :) >> > The data''s on a Thumper, 16GB of RAM. Most of the load will > probably be > generating deltas on commits. > > Ian > _______________________________________________ > zfs-discuss mailing list > zfs-discuss at opensolaris.org > http://mail.opensolaris.org/mailman/listinfo/zfs-discuss
Toby Thain wrote:> On 27-Aug-08, at 5:47 PM, Ian Collins wrote: > >> Tim writes: >> >>> On Wed, Aug 27, 2008 at 3:29 PM, Ian Collins <ian at ianshome.com> >>> wrote: >>> >>>> Does anyone have any tuning tips for a Subversion repository on >>>> ZFS? The >>>> repository will mainly be storing binary (MS Office documents). >>>> >>>> It looks like a vanilla, uncompressed file system is the best bet. >>>> >>> I believe this is called sharepoint :D >> Don''t mention that abomination! > > Amen.Don''t mention _that_ abomination!
On Aug 27, 2008, at 4:38 PM, Tim wrote:> On Wed, Aug 27, 2008 at 3:29 PM, Ian Collins <ian at ianshome.com> wrote: > > Does anyone have any tuning tips for a Subversion repository on > ZFS? The > repository will mainly be storing binary (MS Office documents). > > It looks like a vanilla, uncompressed file system is the best bet.I have a SVN on ZFS repository with ~75K relatively small files and few binaries. That is working well without any special tuning. Shawn -- Shawn Ferry shawn.ferry at sun.com Senior Primary Systems Engineer Sun Managed Operations -------------- next part -------------- An HTML attachment was scrubbed... URL: <http://mail.opensolaris.org/pipermail/zfs-discuss/attachments/20080828/5cdcc80e/attachment.html>