Dear All, We have set up a XEN testbed on AMD64 based cluster nodes. I would like to know the possible ways to monitor the activities of DomU''s from Dom0. Is there any transparent way to monitor cpu usage and network traffic of DomU''s at Dom0 level in order to ensure that SLA gurantees to each DomU. You help is much appreciated. Thanks. Regards, Hassan _______________________________________________ Xen-devel mailing list Xen-devel@lists.xensource.com http://lists.xensource.com/xen-devel
On Mon, Jan 4, 2010 at 9:19 PM, Ahmad Hassan <ahmad.hassan@gmail.com> wrote:> Dear All, > > We have set up a XEN testbed on AMD64 based cluster nodes. I would like to > know the possible ways to monitor the activities of DomU''s from Dom0. Is > there any transparent way to monitor cpu usage and network traffic of DomU''s > at Dom0 level in order to ensure that SLA gurantees to each DomU.Short answer: it requires some effort. Long answer: see this thread http://lists.xensource.com/archives/html/xen-users/2009-05/msg00549.html -- Fajar _______________________________________________ Xen-users mailing list Xen-users@lists.xensource.com http://lists.xensource.com/xen-users
Jean Guyader
2010-Jan-04 14:43 UTC
[Xen-users] Re: [Xen-devel] SLA Monitoring of XEN DomU''s
2010/1/4 Ahmad Hassan <ahmad.hassan@gmail.com>:> Dear All, > > We have set up a XEN testbed on AMD64 based cluster nodes. I would like to > know the possible ways to monitor the activities of DomU''s from Dom0. Is > there any transparent way to monitor cpu usage and network traffic of DomU''s > at Dom0 level in order to ensure that SLA gurantees to each DomU. > > You help is much appreciated. > > Thanks. >There is something called xenaccess, it''s a tools to do introspection of domus, that could do what you look for. http://code.google.com/p/xenaccess/ Jean _______________________________________________ Xen-users mailing list Xen-users@lists.xensource.com http://lists.xensource.com/xen-users
On Mon, 2010-01-04 at 14:19 +0000, Ahmad Hassan wrote:> Dear All, > > We have set up a XEN testbed on AMD64 based cluster nodes. I would > like to know the possible ways to monitor the activities of DomU''s > from Dom0. Is there any transparent way to monitor cpu usage and > network traffic of DomU''s at Dom0 level in order to ensure that SLA > gurantees to each DomU. > > You help is much appreciated. > > Thanks. > > Regards, HassanNetwork traffic is easily monitored by making sure that you assign static vifnames to guests. I.e. if your guest is named "vps-123", then your network config might look like this: vif = [''bridge = br0, mac = xx:xx:xx:..., vifname = vps-123.0'', ''bridge = br1, mac = xx:xx:xx:..., vifname = vps-123.1'' ] ... where vps-123.0 is the device to monitor (on dom-0) for eth0 in that guest, vps-123.1 the one to monitor for eth1, etc .. etc. After that, snmp takes care of logging if using something like cacti. It becomes a little complicated if you tend to migrate guests from node to node, but not unmanageable. I''m not quite sure what kind of SLA you are backing with this. I can produce graphs that tell people they have 100% of all 16 cores in a node rather easily. Since its impossible for the customer to independently verify, its hardly usable in a SLA claim. Unless I missed something? Cheers, --Tim> _______________________________________________ > Xen-devel mailing list > Xen-devel@lists.xensource.com > http://lists.xensource.com/xen-devel_______________________________________________ Xen-users mailing list Xen-users@lists.xensource.com http://lists.xensource.com/xen-users
Thanks for the replies. So I can use either use SNMP monitoring using CACTI or http://www.pmacct.net for Network traffic monitoring of DomU''s. What about CPU availability guarantees for DomU''s? By SLA guarantees, I mean to say that Whether I can proof and show to the owner of DomU''s that you are getting the exact bandwidth and CPU you asked for. Best Regards, Hassan http://cern.ch/ahmadh/portfolio Erasmus Student The University of Reading, UK Aristotle University of Thessaloniki, Greece The University Of Carlos III, Madrid Spain 2010/1/4 Tim Post <echo@echoreply.us>> On Mon, 2010-01-04 at 14:19 +0000, Ahmad Hassan wrote: > > Dear All, > > > > We have set up a XEN testbed on AMD64 based cluster nodes. I would > > like to know the possible ways to monitor the activities of DomU''s > > from Dom0. Is there any transparent way to monitor cpu usage and > > network traffic of DomU''s at Dom0 level in order to ensure that SLA > > gurantees to each DomU. > > > > You help is much appreciated. > > > > Thanks. > > > > Regards, Hassan > > Network traffic is easily monitored by making sure that you assign > static vifnames to guests. I.e. if your guest is named "vps-123", then > your network config might look like this: > > vif = [''bridge = br0, mac = xx:xx:xx:..., vifname = vps-123.0'', > ''bridge = br1, mac = xx:xx:xx:..., vifname = vps-123.1'' ] > > ... where vps-123.0 is the device to monitor (on dom-0) for eth0 in that > guest, vps-123.1 the one to monitor for eth1, etc .. etc. > > After that, snmp takes care of logging if using something like cacti. > > It becomes a little complicated if you tend to migrate guests from node > to node, but not unmanageable. > > I''m not quite sure what kind of SLA you are backing with this. I can > produce graphs that tell people they have 100% of all 16 cores in a node > rather easily. Since its impossible for the customer to independently > verify, its hardly usable in a SLA claim. Unless I missed something? > > Cheers, > --Tim > > > _______________________________________________ > > Xen-devel mailing list > > Xen-devel@lists.xensource.com > > http://lists.xensource.com/xen-devel > >_______________________________________________ Xen-devel mailing list Xen-devel@lists.xensource.com http://lists.xensource.com/xen-devel
On Mon, 2010-01-04 at 15:11 +0000, Ahmad Hassan wrote:> Thanks for the replies. So I can use either use SNMP monitoring using > CACTI or http://www.pmacct.net for Network traffic monitoring of > DomU''s. > > What about CPU availability guarantees for DomU''s? > > By SLA guarantees, I mean to say that Whether I can proof and show to > the owner of DomU''s that you are getting the exact bandwidth and CPU > you asked for.To do that, give them root access to dom-0 and let them see their running configuration. Beyond that, there is no proof that can''t be tainted. Welcome to hosting :) How would you give someone proof that they are one of only five accounts on a shared server? You might want to encourage clients to monitor iowait while doing brief disk operations (i.e. dd) if they are morbidly curious, provided that the backing storage is fast enough to keep up with the vcpus that xen is presenting. BTW, removing xen-devel from the CC list, this is strictly a question for xen-users. Cheers, --Tim _______________________________________________ Xen-users mailing list Xen-users@lists.xensource.com http://lists.xensource.com/xen-users
Ahmad Hassan
2010-Jan-04 15:33 UTC
[Xen-users] Re: [Xen-devel] SLA Monitoring of XEN DomU''s
Yeah you are absolutely rite. Do you know any means to record the CPU consumption and IO consumption of DomU''s on Dom0? Thanks for the help. Best Regards, Hassan http://cern.ch/ahmadh/portfolio Erasmus Student The University of Reading, UK Aristotle University of Thessaloniki, Greece The University Of Carlos III, Madrid Spain 2010/1/4 Tim Post <echo@echoreply.us>> On Mon, 2010-01-04 at 15:11 +0000, Ahmad Hassan wrote: > > Thanks for the replies. So I can use either use SNMP monitoring using > > CACTI or http://www.pmacct.net for Network traffic monitoring of > > DomU''s. > > > > What about CPU availability guarantees for DomU''s? > > > > By SLA guarantees, I mean to say that Whether I can proof and show to > > the owner of DomU''s that you are getting the exact bandwidth and CPU > > you asked for. > > To do that, give them root access to dom-0 and let them see their > running configuration. > > Beyond that, there is no proof that can''t be tainted. Welcome to > hosting :) > > How would you give someone proof that they are one of only five accounts > on a shared server? > > You might want to encourage clients to monitor iowait while doing brief > disk operations (i.e. dd) if they are morbidly curious, provided that > the backing storage is fast enough to keep up with the vcpus that xen is > presenting. > > BTW, removing xen-devel from the CC list, this is strictly a question > for xen-users. > > Cheers, > --Tim > > >_______________________________________________ Xen-users mailing list Xen-users@lists.xensource.com http://lists.xensource.com/xen-users
Tim Post
2010-Jan-04 16:01 UTC
Re: [Xen-users] Re: [Xen-devel] SLA Monitoring of XEN DomU''s
On Mon, 2010-01-04 at 15:33 +0000, Ahmad Hassan wrote:> Yeah you are absolutely rite. Do you know any means to record the CPU > consumption and IO consumption of DomU''s on Dom0?Doing that is as simple as: 1 - Using the Xen API 2 - Using libxc (if you know a little C) 3 - Scraping the output of `xm'' I wrote a tool that exported this in various ways: php, perl, xml, csv, plain text and others, found here: http://sharesource.org/project/xguests I have not updated that, or even used it in some time. If its rusty let me know. That (should) give you the output you want so that other scripts can easily get at the info. NB: Again, I have given that little attention beyond making it work. It uses libxenstat which has received very little love over the years, beyond fixing sysfs breakage. Run it, redirect it to a file and parse away in whatever format you need. Again, its useless for SLA. Clients usually prefer third party monitoring, which is impossible for some kind of credit scheduler guarantee. Cheers, --Tim> > Thanks for the help. > > Best Regards, Hassan > http://cern.ch/ahmadh/portfolio > > Erasmus Student > The University of Reading, UK > Aristotle University of Thessaloniki, Greece > The University Of Carlos III, Madrid Spain > > > > 2010/1/4 Tim Post <echo@echoreply.us> > On Mon, 2010-01-04 at 15:11 +0000, Ahmad Hassan wrote: > > Thanks for the replies. So I can use either use SNMP > monitoring using > > CACTI or http://www.pmacct.net for Network traffic > monitoring of > > DomU''s. > > > > What about CPU availability guarantees for DomU''s? > > > > By SLA guarantees, I mean to say that Whether I can proof > and show to > > the owner of DomU''s that you are getting the exact bandwidth > and CPU > > you asked for. > > > To do that, give them root access to dom-0 and let them see > their > running configuration. > > Beyond that, there is no proof that can''t be tainted. Welcome > to > hosting :) > > How would you give someone proof that they are one of only > five accounts > on a shared server? > > You might want to encourage clients to monitor iowait while > doing brief > disk operations (i.e. dd) if they are morbidly curious, > provided that > the backing storage is fast enough to keep up with the vcpus > that xen is > presenting. > > BTW, removing xen-devel from the CC list, this is strictly a > question > for xen-users. > > Cheers, > --Tim > > > > _______________________________________________ > Xen-users mailing list > Xen-users@lists.xensource.com > http://lists.xensource.com/xen-users_______________________________________________ Xen-users mailing list Xen-users@lists.xensource.com http://lists.xensource.com/xen-users
Tim Post
2010-Jan-04 16:04 UTC
Re: [Xen-users] Re: [Xen-devel] SLA Monitoring of XEN DomU''s
Sorry for top posting, At the time I wrote xguests, the sysfs path to determine VBD read / write / out of requests was in the air. As such, I did not include it. Adding that is now trivial and an exercise for the reader. Use it as a (hurried) example to hack the tools you need into working. Cheers, --Tim On Mon, 2010-01-04 at 15:33 +0000, Ahmad Hassan wrote:> Yeah you are absolutely rite. Do you know any means to record the CPU > consumption and IO consumption of DomU''s on Dom0? > > Thanks for the help. > > Best Regards, Hassan > http://cern.ch/ahmadh/portfolio > > Erasmus Student > The University of Reading, UK > Aristotle University of Thessaloniki, Greece > The University Of Carlos III, Madrid Spain > > > > 2010/1/4 Tim Post <echo@echoreply.us> > On Mon, 2010-01-04 at 15:11 +0000, Ahmad Hassan wrote: > > Thanks for the replies. So I can use either use SNMP > monitoring using > > CACTI or http://www.pmacct.net for Network traffic > monitoring of > > DomU''s. > > > > What about CPU availability guarantees for DomU''s? > > > > By SLA guarantees, I mean to say that Whether I can proof > and show to > > the owner of DomU''s that you are getting the exact bandwidth > and CPU > > you asked for. > > > To do that, give them root access to dom-0 and let them see > their > running configuration. > > Beyond that, there is no proof that can''t be tainted. Welcome > to > hosting :) > > How would you give someone proof that they are one of only > five accounts > on a shared server? > > You might want to encourage clients to monitor iowait while > doing brief > disk operations (i.e. dd) if they are morbidly curious, > provided that > the backing storage is fast enough to keep up with the vcpus > that xen is > presenting. > > BTW, removing xen-devel from the CC list, this is strictly a > question > for xen-users. > > Cheers, > --Tim > > > > _______________________________________________ > Xen-users mailing list > Xen-users@lists.xensource.com > http://lists.xensource.com/xen-users_______________________________________________ Xen-users mailing list Xen-users@lists.xensource.com http://lists.xensource.com/xen-users
Ahmad Hassan
2010-Jan-04 16:23 UTC
Re: [Xen-users] Re: [Xen-devel] SLA Monitoring of XEN DomU''s
Tim, Thanks for the details. I will definitely have a go at Xguests. Apart from monitoring CPU and Network traffic, I am also curious to know the logging for DomU''s activities at the Dom0 level. Do you know any work in logging domU''s area? I know about one study which was conducted by INRIA to intercept the DomU''s system calls at the Dom0 level. But that implementation was not generic so they did not pursue it further. Do you aware of any tools for logging domU''s? Thanks. Best Regards, Hassan http://cern.ch/ahmadh/portfolio Erasmus Student The University of Reading, UK Aristotle University of Thessaloniki, Greece The University Of Carlos III, Madrid Spain 2010/1/4 Tim Post <echo@echoreply.us>> Sorry for top posting, > > At the time I wrote xguests, the sysfs path to determine VBD read / > write / out of requests was in the air. As such, I did not include it. > Adding that is now trivial and an exercise for the reader. > > Use it as a (hurried) example to hack the tools you need into working. > > Cheers, > --Tim > > On Mon, 2010-01-04 at 15:33 +0000, Ahmad Hassan wrote: > > Yeah you are absolutely rite. Do you know any means to record the CPU > > consumption and IO consumption of DomU''s on Dom0? > > > > Thanks for the help. > > > > Best Regards, Hassan > > http://cern.ch/ahmadh/portfolio > > > > Erasmus Student > > The University of Reading, UK > > Aristotle University of Thessaloniki, Greece > > The University Of Carlos III, Madrid Spain > > > > > > > > 2010/1/4 Tim Post <echo@echoreply.us> > > On Mon, 2010-01-04 at 15:11 +0000, Ahmad Hassan wrote: > > > Thanks for the replies. So I can use either use SNMP > > monitoring using > > > CACTI or http://www.pmacct.net for Network traffic > > monitoring of > > > DomU''s. > > > > > > What about CPU availability guarantees for DomU''s? > > > > > > By SLA guarantees, I mean to say that Whether I can proof > > and show to > > > the owner of DomU''s that you are getting the exact bandwidth > > and CPU > > > you asked for. > > > > > > To do that, give them root access to dom-0 and let them see > > their > > running configuration. > > > > Beyond that, there is no proof that can''t be tainted. Welcome > > to > > hosting :) > > > > How would you give someone proof that they are one of only > > five accounts > > on a shared server? > > > > You might want to encourage clients to monitor iowait while > > doing brief > > disk operations (i.e. dd) if they are morbidly curious, > > provided that > > the backing storage is fast enough to keep up with the vcpus > > that xen is > > presenting. > > > > BTW, removing xen-devel from the CC list, this is strictly a > > question > > for xen-users. > > > > Cheers, > > --Tim > > > > > > > > _______________________________________________ > > Xen-users mailing list > > Xen-users@lists.xensource.com > > http://lists.xensource.com/xen-users > >_______________________________________________ Xen-users mailing list Xen-users@lists.xensource.com http://lists.xensource.com/xen-users
Thomas Halinka
2010-Jan-06 15:05 UTC
[Xen-devel] Re: [Xen-users] SLA Monitoring of XEN DomU''s
Hi Ahmad, i''ve written a nagios-plugin which does all the magic for you... IO, Net, CPU-Usage per domU.... If interested i could post it to the list... hth, thomas Am Montag, den 04.01.2010, 14:19 +0000 schrieb Ahmad Hassan:> Dear All, > > We have set up a XEN testbed on AMD64 based cluster nodes. I would > like to know the possible ways to monitor the activities of DomU''s > from Dom0. Is there any transparent way to monitor cpu usage and > network traffic of DomU''s at Dom0 level in order to ensure that SLA > gurantees to each DomU. > > You help is much appreciated. > > Thanks. > > Regards, Hassan > _______________________________________________ > Xen-users mailing list > Xen-users@lists.xensource.com > http://lists.xensource.com/xen-users_______________________________________________ Xen-devel mailing list Xen-devel@lists.xensource.com http://lists.xensource.com/xen-devel
i am interested! Cris -------------------------------------------------- From: "Thomas Halinka" <lists@thohal.de> Sent: Wednesday, January 06, 2010 12:05 PM To: "Ahmad Hassan" <ahmad.hassan@gmail.com> Cc: "Xen-Devel (E-mail)" <Xen-devel@lists.xensource.com>; <xen-users@lists.xensource.com> Subject: Re: [Xen-users] SLA Monitoring of XEN DomU''s> Hi Ahmad, > > i''ve written a nagios-plugin which does all the magic for you... > > IO, Net, CPU-Usage per domU.... > > If interested i could post it to the list... > > hth, > > thomas > > Am Montag, den 04.01.2010, 14:19 +0000 schrieb Ahmad Hassan: >> Dear All, >> >> We have set up a XEN testbed on AMD64 based cluster nodes. I would >> like to know the possible ways to monitor the activities of DomU''s >> from Dom0. Is there any transparent way to monitor cpu usage and >> network traffic of DomU''s at Dom0 level in order to ensure that SLA >> gurantees to each DomU. >> >> You help is much appreciated. >> >> Thanks. >> >> Regards, Hassan >> _______________________________________________ >> Xen-users mailing list >> Xen-users@lists.xensource.com >> http://lists.xensource.com/xen-users > > > _______________________________________________ > Xen-users mailing list > Xen-users@lists.xensource.com > http://lists.xensource.com/xen-users >_______________________________________________ Xen-users mailing list Xen-users@lists.xensource.com http://lists.xensource.com/xen-users
On Wed, 2010-01-06 at 16:05 +0100, Thomas Halinka wrote:> Hi Ahmad, > > i''ve written a nagios-plugin which does all the magic for you... > > IO, Net, CPU-Usage per domU.... > > If interested i could post it to the list... > > hth, > > thomasI second. Please post. Thanks!!! James _______________________________________________ Xen-users mailing list Xen-users@lists.xensource.com http://lists.xensource.com/xen-users
Sander Eikelenboom
2010-Jan-07 11:12 UTC
Re: [Xen-devel] Re: [Xen-users] SLA Monitoring of XEN DomU''s
Hello Thomas, I''m interested in such a script for monitoring, could you please post it ? Regards, Sander Wednesday, January 6, 2010, 4:05:40 PM, you wrote:> Hi Ahmad,> i''ve written a nagios-plugin which does all the magic for you...> IO, Net, CPU-Usage per domU....> If interested i could post it to the list...> hth,> thomas> Am Montag, den 04.01.2010, 14:19 +0000 schrieb Ahmad Hassan: >> Dear All, >> >> We have set up a XEN testbed on AMD64 based cluster nodes. I would >> like to know the possible ways to monitor the activities of DomU''s >> from Dom0. Is there any transparent way to monitor cpu usage and >> network traffic of DomU''s at Dom0 level in order to ensure that SLA >> gurantees to each DomU. >> >> You help is much appreciated. >> >> Thanks. >> >> Regards, Hassan >> _______________________________________________ >> Xen-users mailing list >> Xen-users@lists.xensource.com >> http://lists.xensource.com/xen-users-- Best regards, Sander mailto:linux@eikelenboom.it _______________________________________________ Xen-devel mailing list Xen-devel@lists.xensource.com http://lists.xensource.com/xen-devel
Ahmad Hassan
2010-Jan-21 11:39 UTC
[Xen-devel] Re: [Xen-users] SLA Monitoring of XEN DomU''s
Hi Thomas, Thanks for the message. I am looking for this kind of script since long. Can you please post it? Thanks.> >Best Regards, Hassan http://cern.ch/ahmadh/portfolio Erasmus Student The University of Reading, UK Aristotle University of Thessaloniki, Greece The University Of Carlos III, Madrid Spain Am Montag, den 04.01.2010, 14:19 +0000 schrieb Ahmad Hassan:> > Dear All, > > > > We have set up a XEN testbed on AMD64 based cluster nodes. I would > > like to know the possible ways to monitor the activities of DomU''s > > from Dom0. Is there any transparent way to monitor cpu usage and > > network traffic of DomU''s at Dom0 level in order to ensure that SLA > > gurantees to each DomU. > > > > You help is much appreciated. > > > > Thanks. > > > > Regards, Hassan > > _______________________________________________ > > Xen-users mailing list > > Xen-users@lists.xensource.com > > http://lists.xensource.com/xen-users > >_______________________________________________ Xen-devel mailing list Xen-devel@lists.xensource.com http://lists.xensource.com/xen-devel