Please check out this PNG image from attachment or from Google docs:
http://docs.google.com/drawings/pub?id=1P3jdSddseG1oSYrtjREWcajizxmxoRIhUHCEw4sDi3k&w=771&h=624So,
what I want to do is something like a private cloud storage solution.I belive
the http servers and application servers should be set up on virtual VMs, but
what about the Cassandra and Hadloop servers, should their be set up on VMs or
directly on physical machines? If they should be set up on VMs, the data of
Cassandra and Hadloop should be stored in local storage or a Storage Repository?
Thanks,Dennis
_______________________________________________
Xen-users mailing list
Xen-users@lists.xensource.com
http://lists.xensource.com/xen-users
Fajar A. Nugraha
2010-May-07 02:27 UTC
Re: [Xen-users] Virtualization vs. Cassandra and Hadloop
On Fri, May 7, 2010 at 9:02 AM, Dennis <arsenepark@yahoo.com.cn> wrote:> I belive the http servers and application servers should be set up on virtual VMs, but what about the Cassandra and Hadloop servers, should their be set up on VMs or directly on physical machines? If they should be set up on VMs, the data of Cassandra and Hadloop should be stored in local storage or a Storage Repository?It''s up to you and your designs, really. Some would suggest put everything on VMs and shared storage. That would offer maximum flexibility. I''d simply put them on local storage as VMs though. No need to compete with other VMs for precious storage IOPS when you''ll never gonna use live migration for it. When it gets too big for a VM, or when a host''s resource is only enough to run that one VM, moving Linux VMs to physical machine is a relatively simple process. -- Fajar _______________________________________________ Xen-users mailing list Xen-users@lists.xensource.com http://lists.xensource.com/xen-users
Edward Capriolo
2010-May-07 15:24 UTC
[Xen-users] Re: Virtualization vs. Cassandra and Hadloop
On Thu, May 6, 2010 at 10:02 PM, Dennis <arsenepark@yahoo.com.cn> wrote:> Please check out this PNG image from attachment or from Google docs: > http://docs.google.com/drawings/pub?id=1P3jdSddseG1oSYrtjREWcajizxmxoRIhUHCEw4sDi3k&w=771&h=624 > So, what I want to do is something like a private cloud storage solution. > I belive the http servers and application servers should be set up on > virtual VMs, but what about the Cassandra and Hadloop servers, should their > be set up on VMs or directly on physical machines? If they should be set up > on VMs, the data of Cassandra and Hadloop should be stored in local storage > or a Storage Repository? > > Thanks, > Dennis > >Dennis, Looks like fun :) Either architect is fine depending on your usage patterns. I have tried running cassandra on non-dedicated nodes. I have noticed that if cassandra gets CPU starved the gossip protocol detects nodes as down and that is a bad thing. so the danger is that very CPU intensive Hadoop jobs could starve our cassandra. Cassandra runs pretty even as I see except when it does its anti-compaction and repairs. _______________________________________________ Xen-users mailing list Xen-users@lists.xensource.com http://lists.xensource.com/xen-users
Probably only me... but we have seen a higher latencies when using VMWare, also i think it depends on the H/W and VM configuration.... I have to figure out why (You might also try to mix the application''s which runs on the hw).... i think there are people who run it on Amazons EC. Regards, </VJ> On Thu, May 6, 2010 at 7:02 PM, Dennis <arsenepark@yahoo.com.cn> wrote:> Please check out this PNG image from attachment or from Google docs: > http://docs.google.com/drawings/pub?id=1P3jdSddseG1oSYrtjREWcajizxmxoRIhUHCEw4sDi3k&w=771&h=624 > So, what I want to do is something like a private cloud storage solution. > I belive the http servers and application servers should be set up on > virtual VMs, but what about the Cassandra and Hadloop servers, should their > be set up on VMs or directly on physical machines? If they should be set up > on VMs, the data of Cassandra and Hadloop should be stored in local storage > or a Storage Repository? > > Thanks, > Dennis > >_______________________________________________ Xen-users mailing list Xen-users@lists.xensource.com http://lists.xensource.com/xen-users