Hi all i am new on this subject; i have read many manuals,pdf''s about lustre...i have something unclear on my mind...i want to ask them... 1)Do lustre join all hdd''s in cluster as single partititon?So how we call or store a simple image(.jpeg) file...Do we write c:/images/xxx.jpeg as source and lustre brings it from the cluster? 2)Do lustre servers can either run application servers(apache,tomcat...) and act as a storage server together? 3)i have also searched for high avaliability(linux-ha.org project)..Do lustre can do the same job also.?if not can HA and Lustre project work together... why i am asking these questions?what i exactly want to do is building a java web project which users will store huge datas...so the project must supply some properties; -the storage area must be extendable -storage area must be protected with raid -application server and storage area must be high avaliable and must be load balanced... this is my requirements..so do you have any suggestion for me?am i in the right place... and please shortly tell me can LUSTRE handle these requirements together without any extra software support??? thanks for any replies Burak YILMAZ -------------- next part -------------- An HTML attachment was scrubbed... URL: http://mail.clusterfs.com/pipermail/lustre-discuss/attachments/20061119/45d58bde/attachment.html
Aaron Knister
2006-Nov-19 15:31 UTC
[Lustre-discuss] Can lustre handle these requirements?
My first comment would be that lustre runs (at least right now) only under linux- you mentioned in your first question "c:/images/.." which is a windows path...Are you systems you are going to be using running linux? But to answer your questions as best I can- 1) Yes lustre can join together hdds into a single partition. You could either create multiple OST (one per hdd) and join them together in an LOV (logical object volume..I think). Or you could use lvm to create one giant block device and run it as a single OST. 2) Lustre has its own storage "servers". They''re neither apache/tomcat. Hopefully somebody else can explain this better than me. 3) You can have HA with lustre. As I understand it, there are multiple ways of doing this. Perhaps you could have your java project direct files to the appropriate storage location and just run local ext3/xfs/reiser partitions. Just a thought. Lustre LOVs can be extendable (while online, I believe). If you want your storage protected by RAID you should do that at a hardware disk level. As of yet I don''t think lustre supports filesystem RAID. Lustre can be made highly available and it is load balanced to a degree. In your example you mentioned jpegs...what type of files will you be storing? I have seen in my setup (20tb of lustre fs currently) that lustre doesn''t perform very well over gig ethernet when you''re dealing with small (<1meg) files. I don''t know what the exact threshold is. I can run benchmarks and find out exactly for you if you like. -Aaron ps this is my first post to this mailing list. Please correct me anybody if I''m wrong about anything I said. Burak Y?lmaz wrote:> Hi all i am new on this subject; > > i have read many manuals,pdf''s about lustre...i have something unclear > on my mind...i want to ask them... > > 1)Do lustre join all hdd''s in cluster as single partititon?So how we > call or store a simple image(.jpeg) file...Do we write > c:/images/xxx.jpeg as source and lustre brings it from the cluster? > > 2)Do lustre servers can either run application > servers(apache,tomcat...) and act as a storage server together? > > 3)i have also searched for high avaliability(linux-ha.org project)..Do > lustre can do the same job also.?if not can HA and Lustre project work > together... > > why i am asking these questions?what i exactly want to do is building > a java web project which users will store huge datas...so the project > must supply some properties; > -the storage area must be extendable > -storage area must be protected with raid > -application server and storage area must be high avaliable and must > be load balanced... > > > this is my requirements..so do you have any suggestion for me?am i in > the right place... > > and please shortly tell me can LUSTRE handle these requirements > together without any extra software support??? > > thanks for any replies > > Burak YILMAZ > > ------------------------------------------------------------------------ > > _______________________________________________ > Lustre-discuss mailing list > Lustre-discuss@clusterfs.com > https://mail.clusterfs.com/mailman/listinfo/lustre-discuss >