Carles Amigó
2010-Dec-22 14:45 UTC
[Puppet Users] Use MySQL replication with stored configs
Hello, I''m configuring an environment using multiple puppet masters geographically distributed in different locations. We have a "central" puppet master in our main office with the CA signing authority and we also keep the MySQL database with the stored configs there. As we sometimes have a lot of latency between locations we also configured ActiveMQ with puppetqd so it doesn''t take ages to write the stored configs, but the master is still reading from the central stored configs database making it very slow. As far as I know, the master uses ActiveMQ+puppetqd when it has to write and it connects directly to the database when it has to fetch the stored config data. Am I right? If so, would it be possible to setup a MySQL replication and configure the master to read from the local database (replicated from the MySQL master) and puppetqd to write to the MySQL master? Has anyone tried this architecture? Cheers -- Carles Amigó fr3nd@fr3nd.net http://www.fr3nd.net Hey dol! merry dol! ring a dong dillo! -- You received this message because you are subscribed to the Google Groups "Puppet Users" group. To post to this group, send email to puppet-users@googlegroups.com. To unsubscribe from this group, send email to puppet-users+unsubscribe@googlegroups.com. For more options, visit this group at http://groups.google.com/group/puppet-users?hl=en.
Ohad Levy
2010-Dec-22 20:02 UTC
Re: [Puppet Users] Use MySQL replication with stored configs
Hi, Search the threads, there were a few discussions about this point... at the moment afaik, its not doable. are you using store config for collection or just for inventory? there are a few other options for both requirements without having your central db blocking puppet. Ohad 2010/12/22 Carles Amigó <fr3nd@fr3nd.net>> Hello, > > I''m configuring an environment using multiple puppet masters geographically > distributed in different locations. We have a "central" puppet master in > our main office with the CA signing authority and we also keep the MySQL > database with the stored configs there. > > As we sometimes have a lot of latency between locations we also configured > ActiveMQ with puppetqd so it doesn''t take ages to write the stored configs, > but the master is still reading from the central stored configs database > making it very slow. As far as I know, the master uses ActiveMQ+puppetqd > when it has to write and it connects directly to the database when it has to > fetch the stored config data. Am I right? > > If so, would it be possible to setup a MySQL replication and configure the > master to read from the local database (replicated from the MySQL master) > and puppetqd to write to the MySQL master? Has anyone tried this > architecture? > > Cheers > > -- > Carles Amigó > fr3nd@fr3nd.net > http://www.fr3nd.net > Hey dol! merry dol! ring a dong dillo! > > -- > You received this message because you are subscribed to the Google Groups > "Puppet Users" group. > To post to this group, send email to puppet-users@googlegroups.com. > To unsubscribe from this group, send email to > puppet-users+unsubscribe@googlegroups.com<puppet-users%2Bunsubscribe@googlegroups.com> > . > For more options, visit this group at > http://groups.google.com/group/puppet-users?hl=en. >-- You received this message because you are subscribed to the Google Groups "Puppet Users" group. To post to this group, send email to puppet-users@googlegroups.com. To unsubscribe from this group, send email to puppet-users+unsubscribe@googlegroups.com. For more options, visit this group at http://groups.google.com/group/puppet-users?hl=en.
Thomas Mueller
2010-Dec-23 15:01 UTC
Re: [Puppet Users] Use MySQL replication with stored configs
Am Wed, 22 Dec 2010 22:02:27 +0200 schrieb Ohad Levy:> Hi, > > Search the threads, there were a few discussions about this point... at > the moment afaik, its not doable.it maybe could be done outside of puppet with mysql-proxy. rewriting/ redirecting SELECT and UPDATE/INSERT. - Thomas -- You received this message because you are subscribed to the Google Groups "Puppet Users" group. To post to this group, send email to puppet-users@googlegroups.com. To unsubscribe from this group, send email to puppet-users+unsubscribe@googlegroups.com. For more options, visit this group at http://groups.google.com/group/puppet-users?hl=en.
Carles Amigó
2010-Dec-27 10:30 UTC
Re: [Puppet Users] Use MySQL replication with stored configs
Couldn''t find any related thread... We''re using it mainly for collection so far (ie: nagios), but in the future we''ll probably use it for inventory too. El 22/12/2010 21:02, Ohad Levy escribió:> Hi, > > Search the threads, there were a few discussions about this point... at > the moment afaik, its not doable. > > are you using store config for collection or just for inventory? there > are a few other options for both requirements without having your > central db blocking puppet. > > Ohad > > 2010/12/22 Carles Amigó <fr3nd@fr3nd.net <mailto:fr3nd@fr3nd.net>> > > Hello, > > I''m configuring an environment using multiple puppet masters > geographically distributed in different locations. We have a > "central" puppet master in our main office with the CA signing > authority and we also keep the MySQL database with the stored > configs there. > > As we sometimes have a lot of latency between locations we also > configured ActiveMQ with puppetqd so it doesn''t take ages to write > the stored configs, but the master is still reading from the central > stored configs database making it very slow. As far as I know, the > master uses ActiveMQ+puppetqd when it has to write and it connects > directly to the database when it has to fetch the stored config > data. Am I right? > > If so, would it be possible to setup a MySQL replication and > configure the master to read from the local database (replicated > from the MySQL master) and puppetqd to write to the MySQL master? > Has anyone tried this architecture? > > Cheers > > -- > Carles Amigó > fr3nd@fr3nd.net <mailto:fr3nd@fr3nd.net> > http://www.fr3nd.net > Hey dol! merry dol! ring a dong dillo! > > -- > You received this message because you are subscribed to the Google > Groups "Puppet Users" group. > To post to this group, send email to puppet-users@googlegroups.com > <mailto:puppet-users@googlegroups.com>. > To unsubscribe from this group, send email to > puppet-users+unsubscribe@googlegroups.com > <mailto:puppet-users%2Bunsubscribe@googlegroups.com>. > For more options, visit this group at > http://groups.google.com/group/puppet-users?hl=en. > > > -- > You received this message because you are subscribed to the Google > Groups "Puppet Users" group. > To post to this group, send email to puppet-users@googlegroups.com. > To unsubscribe from this group, send email to > puppet-users+unsubscribe@googlegroups.com. > For more options, visit this group at > http://groups.google.com/group/puppet-users?hl=en.-- Carles Amigó Linux System Administrator carles.amigo@softonic.com http://www.softonic.com Edificio Meridian C/ Rosselló i Porcel, 21, planta 12 - 08016 Barcelona (SPAIN) Tel+34 936 012 700 Fax+34 933 969 292 Award winning company Great Place to Work 2010 This e-mail (and any attached files) may contain confidential and/or privileged information. If you are not the intended recipient (or have received this e-mail in error) please notify the sender immediately and destroy this e-mail. Any unauthorized copying, disclosure or distribution of the material in this e-mail is strictly forbidden. -- You received this message because you are subscribed to the Google Groups "Puppet Users" group. To post to this group, send email to puppet-users@googlegroups.com. To unsubscribe from this group, send email to puppet-users+unsubscribe@googlegroups.com. For more options, visit this group at http://groups.google.com/group/puppet-users?hl=en.
Ohad Levy
2010-Dec-28 16:40 UTC
Re: [Puppet Users] Use MySQL replication with stored configs
2010/12/27 Carles Amigó <carles.amigo@softonic.com>> Couldn''t find any related thread... > > We''re using it mainly for collection so far (ie: nagios), but in the future > we''ll probably use it for inventory too. >My solution for collection / inventory was to use Foreman [1] (and especially its query interface [2] for collections).. inventory comes out of the box too. [1] - http://theforeman.org [2] - http://theforeman.org/projects/foreman/wiki/Query_Interface> > El 22/12/2010 21:02, Ohad Levy escribió: > >> Hi, >> >> Search the threads, there were a few discussions about this point... at >> the moment afaik, its not doable. >> >> are you using store config for collection or just for inventory? there >> are a few other options for both requirements without having your >> central db blocking puppet. >> >> Ohad >> >> 2010/12/22 Carles Amigó <fr3nd@fr3nd.net <mailto:fr3nd@fr3nd.net>> >> >> >> Hello, >> >> I''m configuring an environment using multiple puppet masters >> geographically distributed in different locations. We have a >> "central" puppet master in our main office with the CA signing >> authority and we also keep the MySQL database with the stored >> configs there. >> >> As we sometimes have a lot of latency between locations we also >> configured ActiveMQ with puppetqd so it doesn''t take ages to write >> the stored configs, but the master is still reading from the central >> stored configs database making it very slow. As far as I know, the >> master uses ActiveMQ+puppetqd when it has to write and it connects >> directly to the database when it has to fetch the stored config >> data. Am I right? >> >> If so, would it be possible to setup a MySQL replication and >> configure the master to read from the local database (replicated >> from the MySQL master) and puppetqd to write to the MySQL master? >> Has anyone tried this architecture? >> >> Cheers >> >> -- >> Carles Amigó >> fr3nd@fr3nd.net <mailto:fr3nd@fr3nd.net> >> >> http://www.fr3nd.net >> Hey dol! merry dol! ring a dong dillo! >> >> -- >> You received this message because you are subscribed to the Google >> Groups "Puppet Users" group. >> To post to this group, send email to puppet-users@googlegroups.com >> <mailto:puppet-users@googlegroups.com>. >> >> To unsubscribe from this group, send email to >> puppet-users+unsubscribe@googlegroups.com<puppet-users%2Bunsubscribe@googlegroups.com> >> <mailto:puppet-users%2Bunsubscribe@googlegroups.com<puppet-users%252Bunsubscribe@googlegroups.com> >> >. >> >> For more options, visit this group at >> http://groups.google.com/group/puppet-users?hl=en. >> >> >> -- >> >> You received this message because you are subscribed to the Google >> Groups "Puppet Users" group. >> To post to this group, send email to puppet-users@googlegroups.com. >> To unsubscribe from this group, send email to >> puppet-users+unsubscribe@googlegroups.com<puppet-users%2Bunsubscribe@googlegroups.com> >> . >> For more options, visit this group at >> http://groups.google.com/group/puppet-users?hl=en. >> > > -- > Carles Amigó > Linux System Administrator > carles.amigo@softonic.com > > http://www.softonic.com > Edificio Meridian C/ Rosselló i Porcel, 21, planta 12 - 08016 Barcelona > (SPAIN) > Tel+34 936 012 700 Fax+34 933 969 292 > Award winning company Great Place to Work 2010 > > > This e-mail (and any attached files) may contain confidential and/or > privileged information. If you are not the intended recipient (or have > received this e-mail in error) please notify the sender immediately and > destroy this e-mail. Any unauthorized copying, disclosure or distribution of > the material in this e-mail is strictly forbidden. > > > -- > You received this message because you are subscribed to the Google Groups > "Puppet Users" group. > To post to this group, send email to puppet-users@googlegroups.com. > To unsubscribe from this group, send email to > puppet-users+unsubscribe@googlegroups.com<puppet-users%2Bunsubscribe@googlegroups.com> > . > For more options, visit this group at > http://groups.google.com/group/puppet-users?hl=en. > >-- You received this message because you are subscribed to the Google Groups "Puppet Users" group. To post to this group, send email to puppet-users@googlegroups.com. To unsubscribe from this group, send email to puppet-users+unsubscribe@googlegroups.com. For more options, visit this group at http://groups.google.com/group/puppet-users?hl=en.
Carles Amigó
2010-Dec-29 10:17 UTC
Re: [Puppet Users] Use MySQL replication with stored configs
Thanks. I''ll give it a shot :) El 28/12/2010 17:40, Ohad Levy escribió:> 2010/12/27 Carles Amigó <carles.amigo@softonic.com > <mailto:carles.amigo@softonic.com>> > > Couldn''t find any related thread... > > We''re using it mainly for collection so far (ie: nagios), but in the > future we''ll probably use it for inventory too. > > > My solution for collection / inventory was to use Foreman [1] > (and especially its query interface [2] for collections).. inventory > comes out of the box too. > > [1] - http://theforeman.org > [2] - http://theforeman.org/projects/foreman/wiki/Query_Interface > > > El 22/12/2010 21:02, Ohad Levy escribió: > > Hi, > > Search the threads, there were a few discussions about this > point... at > the moment afaik, its not doable. > > are you using store config for collection or just for inventory? > there > are a few other options for both requirements without having your > central db blocking puppet. > > Ohad > > 2010/12/22 Carles Amigó <fr3nd@fr3nd.net > <mailto:fr3nd@fr3nd.net> <mailto:fr3nd@fr3nd.net > <mailto:fr3nd@fr3nd.net>>> > > > Hello, > > I''m configuring an environment using multiple puppet masters > geographically distributed in different locations. We have a > "central" puppet master in our main office with the CA signing > authority and we also keep the MySQL database with the stored > configs there. > > As we sometimes have a lot of latency between locations we also > configured ActiveMQ with puppetqd so it doesn''t take ages to > write > the stored configs, but the master is still reading from the > central > stored configs database making it very slow. As far as I > know, the > master uses ActiveMQ+puppetqd when it has to write and it > connects > directly to the database when it has to fetch the stored config > data. Am I right? > > If so, would it be possible to setup a MySQL replication and > configure the master to read from the local database (replicated > from the MySQL master) and puppetqd to write to the MySQL > master? > Has anyone tried this architecture? > > Cheers > > -- > Carles Amigó > fr3nd@fr3nd.net <mailto:fr3nd@fr3nd.net> <mailto:fr3nd@fr3nd.net > <mailto:fr3nd@fr3nd.net>> > > http://www.fr3nd.net > Hey dol! merry dol! ring a dong dillo! > > -- > You received this message because you are subscribed to the > Google > Groups "Puppet Users" group. > To post to this group, send email to > puppet-users@googlegroups.com <mailto:puppet-users@googlegroups.com> > <mailto:puppet-users@googlegroups.com > <mailto:puppet-users@googlegroups.com>>. > > To unsubscribe from this group, send email to > puppet-users+unsubscribe@googlegroups.com > <mailto:puppet-users%2Bunsubscribe@googlegroups.com> > <mailto:puppet-users%2Bunsubscribe@googlegroups.com > <mailto:puppet-users%252Bunsubscribe@googlegroups.com>>. > > For more options, visit this group at > http://groups.google.com/group/puppet-users?hl=en. > > > -- > > You received this message because you are subscribed to the Google > Groups "Puppet Users" group. > To post to this group, send email to > puppet-users@googlegroups.com > <mailto:puppet-users@googlegroups.com>. > To unsubscribe from this group, send email to > puppet-users+unsubscribe@googlegroups.com > <mailto:puppet-users%2Bunsubscribe@googlegroups.com>. > For more options, visit this group at > http://groups.google.com/group/puppet-users?hl=en. > > > > This e-mail (and any attached files) may contain confidential and/or > privileged information. If you are not the intended recipient (or > have received this e-mail in error) please notify the sender > immediately and destroy this e-mail. Any unauthorized copying, > disclosure or distribution of the material in this e-mail is > strictly forbidden. > > > -- > You received this message because you are subscribed to the Google > Groups "Puppet Users" group. > To post to this group, send email to puppet-users@googlegroups.com > <mailto:puppet-users@googlegroups.com>. > To unsubscribe from this group, send email to > puppet-users+unsubscribe@googlegroups.com > <mailto:puppet-users%2Bunsubscribe@googlegroups.com>. > For more options, visit this group at > http://groups.google.com/group/puppet-users?hl=en. > > > -- > You received this message because you are subscribed to the Google > Groups "Puppet Users" group. > To post to this group, send email to puppet-users@googlegroups.com. > To unsubscribe from this group, send email to > puppet-users+unsubscribe@googlegroups.com. > For more options, visit this group at > http://groups.google.com/group/puppet-users?hl=en.-- You received this message because you are subscribed to the Google Groups "Puppet Users" group. To post to this group, send email to puppet-users@googlegroups.com. To unsubscribe from this group, send email to puppet-users+unsubscribe@googlegroups.com. For more options, visit this group at http://groups.google.com/group/puppet-users?hl=en.