1. I''ve got 95% of a server based cloud front end up and running (no client software to load, run your cloud from any machine with a web browser). 2. Just rolled a watchdog for restarting accidentally shutdown virtual machines as well as clearing and restarting virtual machines from a crashed slave host. No more midnight support calls from ticked customers, the cloud almost totally takes care of itself now :). 3. I''ve got the skeleton of a load balancer in testing. As soon as I put a little more polish on things, I''ll be releasing most of this as open source. Ver -- Vern Burke SwiftWater Telecom http://www.swiftwatertel.com ISP/CLEC Engineering Services Data Center Services Remote Backup Services _______________________________________________ Xen-users mailing list Xen-users@lists.xensource.com http://lists.xensource.com/xen-users
On Tue, Feb 16, 2010 at 11:36:10AM -0500, Vern Burke wrote:> 1. I''ve got 95% of a server based cloud front end up and running (no > client software to load, run your cloud from any machine with a web > browser). >Nice! Are you planning to support any of the publicly available user APIs?> 2. Just rolled a watchdog for restarting accidentally shutdown virtual > machines as well as clearing and restarting virtual machines from a > crashed slave host. No more midnight support calls from ticked > customers, the cloud almost totally takes care of itself now :). > > 3. I''ve got the skeleton of a load balancer in testing. > > As soon as I put a little more polish on things, I''ll be releasing most > of this as open source. >Excellent. I''m sure you''ll get contributions to your project when it''s available. -- Pasi _______________________________________________ Xen-users mailing list Xen-users@lists.xensource.com http://lists.xensource.com/xen-users
Pasi:
I havn''t thought a great deal about public facing APIs, been
concentrating on getting the web user interface and multi tenancy with
full self provisioning working. The entire thing is quite modular so I
don''t expect there''d be much problem wrapping almost any of
the common
APIs out there around it (hmmm, a standard base with wrapper modules for
different APIs).
Vern Burke
SwiftWater Telecom
http://www.swiftwatertel.com
ISP/CLEC Engineering Services
Data Center Services
Remote Backup Services
On 2/16/2010 1:39 PM, Pasi Kärkkäinen wrote:> On Tue, Feb 16, 2010 at 11:36:10AM -0500, Vern Burke wrote:
>> 1. I''ve got 95% of a server based cloud front end up and
running (no
>> client software to load, run your cloud from any machine with a web
>> browser).
>>
>
> Nice! Are you planning to support any of the publicly available user APIs?
>
>> 2. Just rolled a watchdog for restarting accidentally shutdown virtual
>> machines as well as clearing and restarting virtual machines from a
>> crashed slave host. No more midnight support calls from ticked
>> customers, the cloud almost totally takes care of itself now :).
>>
>> 3. I''ve got the skeleton of a load balancer in testing.
>>
>> As soon as I put a little more polish on things, I''ll be
releasing most
>> of this as open source.
>>
>
> Excellent. I''m sure you''ll get contributions to your
project when it''s available.
>
> -- Pasi
>
>
_______________________________________________
Xen-users mailing list
Xen-users@lists.xensource.com
http://lists.xensource.com/xen-users
On Tue, Feb 16, 2010 at 02:35:51PM -0500, Vern Burke wrote:> Pasi: > I havn''t thought a great deal about public facing APIs, been > concentrating on getting the web user interface and multi tenancy with > full self provisioning working. The entire thing is quite modular so I > don''t expect there''d be much problem wrapping almost any of the common > APIs out there around it (hmmm, a standard base with wrapper modules for > different APIs). >Ok. Are you using which language for the web frontend? And what framework? Just being curious here :) -- Pasi> Vern Burke > > SwiftWater Telecom > http://www.swiftwatertel.com > ISP/CLEC Engineering Services > Data Center Services > Remote Backup Services > > On 2/16/2010 1:39 PM, Pasi Kärkkäinen wrote: >> On Tue, Feb 16, 2010 at 11:36:10AM -0500, Vern Burke wrote: >>> 1. I''ve got 95% of a server based cloud front end up and running (no >>> client software to load, run your cloud from any machine with a web >>> browser). >>> >> >> Nice! Are you planning to support any of the publicly available user APIs? >> >>> 2. Just rolled a watchdog for restarting accidentally shutdown virtual >>> machines as well as clearing and restarting virtual machines from a >>> crashed slave host. No more midnight support calls from ticked >>> customers, the cloud almost totally takes care of itself now :). >>> >>> 3. I''ve got the skeleton of a load balancer in testing. >>> >>> As soon as I put a little more polish on things, I''ll be releasing most >>> of this as open source. >>> >> >> Excellent. I''m sure you''ll get contributions to your project when it''s available. >> >> -- Pasi >> >>_______________________________________________ Xen-users mailing list Xen-users@lists.xensource.com http://lists.xensource.com/xen-users
When all is said and done, most of it will be PHP. I''m developing in kind of a mishmash right now, I guess you could say I''m freestyling :D. It''s actually working well enough now that I have it in production on my own XCP cloud (live customers and all!), most of the work left on the working sections is to push static settings off to a common config file. It''s so nice to be able to put my feet up in front of the tv and handle the cloud from my BlackBerry :D. Vern Burke SwiftWater Telecom http://www.swiftwatertel.com ISP/CLEC Engineering Services Data Center Services Remote Backup Services On 2/16/2010 2:50 PM, Pasi Kärkkäinen wrote:> On Tue, Feb 16, 2010 at 02:35:51PM -0500, Vern Burke wrote: >> Pasi: >> I havn''t thought a great deal about public facing APIs, been >> concentrating on getting the web user interface and multi tenancy with >> full self provisioning working. The entire thing is quite modular so I >> don''t expect there''d be much problem wrapping almost any of the common >> APIs out there around it (hmmm, a standard base with wrapper modules for >> different APIs). >> > > Ok. > Are you using which language for the web frontend? And what framework? > > Just being curious here :) > > -- Pasi > >> Vern Burke >> >> SwiftWater Telecom >> http://www.swiftwatertel.com >> ISP/CLEC Engineering Services >> Data Center Services >> Remote Backup Services >> >> On 2/16/2010 1:39 PM, Pasi Kärkkäinen wrote: >>> On Tue, Feb 16, 2010 at 11:36:10AM -0500, Vern Burke wrote: >>>> 1. I''ve got 95% of a server based cloud front end up and running (no >>>> client software to load, run your cloud from any machine with a web >>>> browser). >>>> >>> >>> Nice! Are you planning to support any of the publicly available user APIs? >>> >>>> 2. Just rolled a watchdog for restarting accidentally shutdown virtual >>>> machines as well as clearing and restarting virtual machines from a >>>> crashed slave host. No more midnight support calls from ticked >>>> customers, the cloud almost totally takes care of itself now :). >>>> >>>> 3. I''ve got the skeleton of a load balancer in testing. >>>> >>>> As soon as I put a little more polish on things, I''ll be releasing most >>>> of this as open source. >>>> >>> >>> Excellent. I''m sure you''ll get contributions to your project when it''s available. >>> >>> -- Pasi >>> >>> > > _______________________________________________ > Xen-users mailing list > Xen-users@lists.xensource.com > http://lists.xensource.com/xen-users >_______________________________________________ Xen-users mailing list Xen-users@lists.xensource.com http://lists.xensource.com/xen-users
On Tue, February 16, 2010 8:10 pm, Vern Burke wrote:> When all is said and done, most of it will be PHP. > > I''m developing in kind of a mishmash right now, I guess you could say > I''m freestyling :D. > > It''s actually working well enough now that I have it in production on my > own XCP cloud (live customers and all!), most of the work left on the > working sections is to push static settings off to a common config file. > > It''s so nice to be able to put my feet up in front of the tv and handle > the cloud from my BlackBerry :D.Sounds cool, Verne. Can you tell us a bit more? - how many domUs on how many dom0s? What kind of storage and what problems if any did you have to overcome? Are the domUs bridged or routed and are their IPs statically configured or from DHCP? Enquiring minds wanna know! ;-) We are quite late to the Xen party and have very little invested in our own tools. This, and because XCP looks so cool has got us thinking of creating our own XCP frontend in Ruby together with Sinatra or maybe Rails 3 when it comes out soon. The only worry is the cost of capable and redundant shared storage. We''re currently looking at 30 or more domUs across a few dom0s and our small company couldn''t stretch to a NetApp cluster or anything like it. Nor could we afford to move up from gbit switching either... Thanks, Matt. _______________________________________________ Xen-users mailing list Xen-users@lists.xensource.com http://lists.xensource.com/xen-users
Matthew:
The XCP cloud is currently 5 servers (2x Opteron single core with
4GB, soon to get a rolling upgrade to dual core Opterons and more
memory). We''re running about 40 virtual machines (all CentOS 5.4),
practical limit is around 12 per. We leave the pool master open as extra
capacity should a slave server croak.
Networking is the standard XCP configuration using open vswitch.
Public facing ports are static addresses, ports facing the storage area
network are DHCP private addresses.
Back end storage is a pair of the most rock solid NFS servers I
could put together (2x Opteron, 4GB memory, 500GB drives on hardware
RAID (soon to be upgraded to 1TB drives), oversize redundant power
supply, etc) on a private Gigabit Ethernet storage network. I know this
isn''t the most bulletproof redundant storage configuration, but the
MTBFs will hold us until I find something I''m happy with that
doesn''t
require Rube Goldberg to make it work :).
Problems were mostly confined to various bugaboos with XCP, such as
leaving a critical file off the last distribution iso. All in all, I
think XCP is one heckuva package, the bugs just come with the territory
of being out on the front edge :).
Vern Burke
SwiftWater Telecom
http://www.swiftwatertel.com
ISP/CLEC Engineering Services
Data Center Services
Remote Backup Services
On 2/16/2010 7:13 PM, Matthew Law wrote:>
> On Tue, February 16, 2010 8:10 pm, Vern Burke wrote:
>> When all is said and done, most of it will be PHP.
>>
>> I''m developing in kind of a mishmash right now, I guess you
could say
>> I''m freestyling :D.
>>
>> It''s actually working well enough now that I have it in
production on my
>> own XCP cloud (live customers and all!), most of the work left on the
>> working sections is to push static settings off to a common config
file.
>>
>> It''s so nice to be able to put my feet up in front of the tv
and handle
>> the cloud from my BlackBerry :D.
>
> Sounds cool, Verne.
>
> Can you tell us a bit more? - how many domUs on how many dom0s? What kind
> of storage and what problems if any did you have to overcome?
>
> Are the domUs bridged or routed and are their IPs statically configured or
> from DHCP?
>
> Enquiring minds wanna know! ;-)
>
> We are quite late to the Xen party and have very little invested in our
> own tools. This, and because XCP looks so cool has got us thinking of
> creating our own XCP frontend in Ruby together with Sinatra or maybe Rails
> 3 when it comes out soon.
>
> The only worry is the cost of capable and redundant shared storage.
We''re
> currently looking at 30 or more domUs across a few dom0s and our small
> company couldn''t stretch to a NetApp cluster or anything like it.
Nor
> could we afford to move up from gbit switching either...
>
>
> Thanks,
>
> Matt.
>
>
_______________________________________________
Xen-users mailing list
Xen-users@lists.xensource.com
http://lists.xensource.com/xen-users
On Tue, Feb 16, 2010 at 03:10:09PM -0500, Vern Burke wrote:> When all is said and done, most of it will be PHP. >Yeah, no problems there :)> I''m developing in kind of a mishmash right now, I guess you could say > I''m freestyling :D. >Hehe.> It''s actually working well enough now that I have it in production on my > own XCP cloud (live customers and all!), most of the work left on the > working sections is to push static settings off to a common config file. >Sounds promising!> It''s so nice to be able to put my feet up in front of the tv and handle > the cloud from my BlackBerry :D. >:) I assume you''ve checked this: http://www.xvpsource.org/ Sounds like something you need for your frontend :) -- Pasi> Vern Burke > > SwiftWater Telecom > http://www.swiftwatertel.com > ISP/CLEC Engineering Services > Data Center Services > Remote Backup Services > > On 2/16/2010 2:50 PM, Pasi Kärkkäinen wrote: >> On Tue, Feb 16, 2010 at 02:35:51PM -0500, Vern Burke wrote: >>> Pasi: >>> I havn''t thought a great deal about public facing APIs, been >>> concentrating on getting the web user interface and multi tenancy with >>> full self provisioning working. The entire thing is quite modular so I >>> don''t expect there''d be much problem wrapping almost any of the common >>> APIs out there around it (hmmm, a standard base with wrapper modules for >>> different APIs). >>> >> >> Ok. >> Are you using which language for the web frontend? And what framework? >> >> Just being curious here :) >> >> -- Pasi >> >>> Vern Burke >>> >>> SwiftWater Telecom >>> http://www.swiftwatertel.com >>> ISP/CLEC Engineering Services >>> Data Center Services >>> Remote Backup Services >>> >>> On 2/16/2010 1:39 PM, Pasi Kärkkäinen wrote: >>>> On Tue, Feb 16, 2010 at 11:36:10AM -0500, Vern Burke wrote: >>>>> 1. I''ve got 95% of a server based cloud front end up and running (no >>>>> client software to load, run your cloud from any machine with a web >>>>> browser). >>>>> >>>> >>>> Nice! Are you planning to support any of the publicly available user APIs? >>>> >>>>> 2. Just rolled a watchdog for restarting accidentally shutdown virtual >>>>> machines as well as clearing and restarting virtual machines from a >>>>> crashed slave host. No more midnight support calls from ticked >>>>> customers, the cloud almost totally takes care of itself now :). >>>>> >>>>> 3. I''ve got the skeleton of a load balancer in testing. >>>>> >>>>> As soon as I put a little more polish on things, I''ll be releasing most >>>>> of this as open source. >>>>> >>>> >>>> Excellent. I''m sure you''ll get contributions to your project when it''s available. >>>> >>>> -- Pasi >>>> >>>> >> >> _______________________________________________ >> Xen-users mailing list >> Xen-users@lists.xensource.com >> http://lists.xensource.com/xen-users >> > > _______________________________________________ > Xen-users mailing list > Xen-users@lists.xensource.com > http://lists.xensource.com/xen-users_______________________________________________ Xen-users mailing list Xen-users@lists.xensource.com http://lists.xensource.com/xen-users
On Wed, February 17, 2010 1:30 am, Vern Burke wrote:> Matthew: > The XCP cloud is currently 5 servers (2x Opteron single core with > 4GB, soon to get a rolling upgrade to dual core Opterons and more > memory). We''re running about 40 virtual machines (all CentOS 5.4), > practical limit is around 12 per. We leave the pool master open as extra > capacity should a slave server croak. > Networking is the standard XCP configuration using open vswitch. > Public facing ports are static addresses, ports facing the storage area > network are DHCP private addresses. > Back end storage is a pair of the most rock solid NFS servers I > could put together (2x Opteron, 4GB memory, 500GB drives on hardware > RAID (soon to be upgraded to 1TB drives), oversize redundant power > supply, etc) on a private Gigabit Ethernet storage network. I know this > isn''t the most bulletproof redundant storage configuration, but the > MTBFs will hold us until I find something I''m happy with that doesn''t > require Rube Goldberg to make it work :). > Problems were mostly confined to various bugaboos with XCP, such as > leaving a critical file off the last distribution iso. All in all, I > think XCP is one heckuva package, the bugs just come with the territory > of being out on the front edge :).Thanks, Verne A couple more questions: Are you using DRBD or similar to mirror the NFS data? Do you aggregate links for more throughput? This is the stuff we''re mulling over at the moment. I might ask the same question of this list to see what they have had success with in production environments as we are trying to find the best bang for the buck in terms of speed and cost. Thanks, Matt. _______________________________________________ Xen-users mailing list Xen-users@lists.xensource.com http://lists.xensource.com/xen-users
I''ve got a copy of it, just havn''t had time to sort it out, the install procedure''s a bit of a mess. Looks like a good addition though. Vern Burke SwiftWater Telecom http://www.swiftwatertel.com ISP/CLEC Engineering Services Data Center Services Remote Backup Services On 2/17/2010 3:46 AM, Pasi Kärkkäinen wrote:> On Tue, Feb 16, 2010 at 03:10:09PM -0500, Vern Burke wrote: >> When all is said and done, most of it will be PHP. >> > > Yeah, no problems there :) > >> I''m developing in kind of a mishmash right now, I guess you could say >> I''m freestyling :D. >> > > Hehe. > >> It''s actually working well enough now that I have it in production on my >> own XCP cloud (live customers and all!), most of the work left on the >> working sections is to push static settings off to a common config file. >> > > Sounds promising! > >> It''s so nice to be able to put my feet up in front of the tv and handle >> the cloud from my BlackBerry :D. >> > > :) > > I assume you''ve checked this: > http://www.xvpsource.org/ > > Sounds like something you need for your frontend :) > > -- Pasi > >> Vern Burke >> >> SwiftWater Telecom >> http://www.swiftwatertel.com >> ISP/CLEC Engineering Services >> Data Center Services >> Remote Backup Services >> >> On 2/16/2010 2:50 PM, Pasi Kärkkäinen wrote: >>> On Tue, Feb 16, 2010 at 02:35:51PM -0500, Vern Burke wrote: >>>> Pasi: >>>> I havn''t thought a great deal about public facing APIs, been >>>> concentrating on getting the web user interface and multi tenancy with >>>> full self provisioning working. The entire thing is quite modular so I >>>> don''t expect there''d be much problem wrapping almost any of the common >>>> APIs out there around it (hmmm, a standard base with wrapper modules for >>>> different APIs). >>>> >>> >>> Ok. >>> Are you using which language for the web frontend? And what framework? >>> >>> Just being curious here :) >>> >>> -- Pasi >>> >>>> Vern Burke >>>> >>>> SwiftWater Telecom >>>> http://www.swiftwatertel.com >>>> ISP/CLEC Engineering Services >>>> Data Center Services >>>> Remote Backup Services >>>> >>>> On 2/16/2010 1:39 PM, Pasi Kärkkäinen wrote: >>>>> On Tue, Feb 16, 2010 at 11:36:10AM -0500, Vern Burke wrote: >>>>>> 1. I''ve got 95% of a server based cloud front end up and running (no >>>>>> client software to load, run your cloud from any machine with a web >>>>>> browser). >>>>>> >>>>> >>>>> Nice! Are you planning to support any of the publicly available user APIs? >>>>> >>>>>> 2. Just rolled a watchdog for restarting accidentally shutdown virtual >>>>>> machines as well as clearing and restarting virtual machines from a >>>>>> crashed slave host. No more midnight support calls from ticked >>>>>> customers, the cloud almost totally takes care of itself now :). >>>>>> >>>>>> 3. I''ve got the skeleton of a load balancer in testing. >>>>>> >>>>>> As soon as I put a little more polish on things, I''ll be releasing most >>>>>> of this as open source. >>>>>> >>>>> >>>>> Excellent. I''m sure you''ll get contributions to your project when it''s available. >>>>> >>>>> -- Pasi >>>>> >>>>> >>> >>> _______________________________________________ >>> Xen-users mailing list >>> Xen-users@lists.xensource.com >>> http://lists.xensource.com/xen-users >>> >> >> _______________________________________________ >> Xen-users mailing list >> Xen-users@lists.xensource.com >> http://lists.xensource.com/xen-users >_______________________________________________ Xen-users mailing list Xen-users@lists.xensource.com http://lists.xensource.com/xen-users