Puppet users - Oct 2013 - Can't find a supported method of using storeconfigs on AWS

I can''t seem to find a sane way of running storeconfigs on the new AWS 
server environment I''m working on.


   - SQLite is not an option. It becomes unusable far too quickly.
   - Using a mysql adapter doesn''t seem to work properly.
      - I quickly run into bug
#9290<http://projects.puppetlabs.com/issues/9290>again and again. Which
after 2 years STILL hasn''t been fixed.
      - The top of
this<http://projects.puppetlabs.com/projects/1/wiki/using_stored_configuration>seems
to imply that these ActiveRecord storeconfigs adapters are being
      deprecated.
   - The recommendation seems to be to use PuppetDB however from the looks 
   of it, I can''t even use PuppetDB.
      - I''m not going to use the embedded DB and fall right back into
the
      trap with SQLite again.
      - PuppetDB only appears to support PostgreSQL and does not support 
      MySQL.
      - I already have a MySQL database in AWS'' RDS I would like to
use.
      And RDS does not support PostgreSQL.
      - And I am NOT going to go right back to going and installing a 
      separate database server on the local node. That kind of thing has given
me
      problem after problem.
   
Please tell me I''m missing something and there''s a way I can
get this to
work in this AWS environment. Cause otherwise the idea of puppet running 
any type of server at all – rather than simply working as a local 
filesystem `puppet apply` – looks so unreliable (as I''ve also had some 
issues with the puppetmaster) that I should just dump every bit of 
server/client software puppetlabs has and write my own custom way of 
distributing configs and data.

-- 
You received this message because you are subscribed to the Google Groups
"Puppet Users" group.
To unsubscribe from this group and stop receiving emails from it, send an email
to puppet-users+unsubscribe@googlegroups.com.
To post to this group, send email to puppet-users@googlegroups.com.
Visit this group at http://groups.google.com/group/puppet-users.
For more options, visit https://groups.google.com/groups/opt_out.

On Fri, Oct 18, 2013 at 7:30 AM, Daniel Friesen
<nadir.seen.fire@gmail.com>wrote:
> I can''t seem to find a sane way of running storeconfigs on the new
AWS
> server environment I''m working on.
>
>
>    - SQLite is not an option. It becomes unusable far too quickly.
>
> What do you mean, exactly? It isn''t handling your volume, you see
errors,
it''s too slow? That would help us understand your use case better.
>
>    - Using a mysql adapter doesn''t seem to work properly.
>       - I quickly run into bug
#9290<http://projects.puppetlabs.com/issues/9290>again and again. Which
after 2 years STILL hasn''t been fixed.
>       - The top of
this<http://projects.puppetlabs.com/projects/1/wiki/using_stored_configuration>seems
to imply that these ActiveRecord storeconfigs adapters are being
>       deprecated.
>
> Correct, they''ve been deprecated for over a year.
>
>    - The recommendation seems to be to use PuppetDB however from the
>    looks of it, I can''t even use PuppetDB.
>
>
>    - I''m not going to use the embedded DB and fall right back into
the
>       trap with SQLite again.
>
> The PuppetDB embedded DB is approximately a zillion times faster than
ActiveRecord+sqlite, so you may want to reconsider giving it a shot. The
limitation is around how much memory is required for the embedded DB, which
is largely dependent on how many nodes you have (see the docs for sizing
information). How large is your deployment?

In a nutshell, if you have the RAM, it should be entirely functional (we
test against it on literally every commit we do). Note that this isn''t
memory used by the puppetmaster; you could have this on its own EC2 node
that''s sized differently if you like.

>
>    - PuppetDB only appears to support PostgreSQL and does not support
>       MySQL.
>
> The only maintained backends currently are PG and the embedded db, yes.
>
>    - I already have a MySQL database in AWS'' RDS I would like to
use. And
>       RDS does not support PostgreSQL.
>
>
>    - And I am NOT going to go right back to going and installing a
>       separate database server on the local node. That kind of thing has
given me
>       problem after problem.
>
> What are the exact problems you''ve had? Without specifics,
it''s somewhat
difficult for us to offer assistance.

> Please tell me I''m missing something and there''s a way I
can get this to
> work in this AWS environment. Cause otherwise the idea of puppet running
> any type of server at all – rather than simply working as a local
> filesystem `puppet apply` – looks so unreliable (as I''ve also had
some
> issues with the puppetmaster) that I should just dump every bit of
> server/client software puppetlabs has and write my own custom way of
> distributing configs and data.
>
We''re here to help, but you should of course choose whatever option you
feel best meets your needs.

deepak

>
>  --
> You received this message because you are subscribed to the Google Groups
> "Puppet Users" group.
> To unsubscribe from this group and stop receiving emails from it, send an
> email to puppet-users+unsubscribe@googlegroups.com.
> To post to this group, send email to puppet-users@googlegroups.com.
> Visit this group at http://groups.google.com/group/puppet-users.
> For more options, visit https://groups.google.com/groups/opt_out.
>
-- 
You received this message because you are subscribed to the Google Groups
"Puppet Users" group.
To unsubscribe from this group and stop receiving emails from it, send an email
to puppet-users+unsubscribe@googlegroups.com.
To post to this group, send email to puppet-users@googlegroups.com.
Visit this group at http://groups.google.com/group/puppet-users.
For more options, visit https://groups.google.com/groups/opt_out.

On Oct 18, 2013, at 7:30 AM, Daniel Friesen <nadir.seen.fire@gmail.com>
wrote:
> I can''t seem to find a sane way of running storeconfigs on the new
AWS server environment I''m working on.
> 
> SQLite is not an option. It becomes unusable far too quickly.
> Using a mysql adapter doesn''t seem to work properly.
> I quickly run into bug #9290 again and again. Which after 2 years STILL
hasn''t been fixed.
> The top of this seems to imply that these ActiveRecord storeconfigs
adapters are being deprecated.
> The recommendation seems to be to use PuppetDB however from the looks of
it, I can''t even use PuppetDB.
> I''m not going to use the embedded DB and fall right back into the
trap with SQLite again.
> PuppetDB only appears to support PostgreSQL and does not support MySQL.
> I already have a MySQL database in AWS'' RDS I would like to use.
And RDS does not support PostgreSQL.
This thread is a month old, but I thought I''d mention that Amazon now
supports PostgreSQL for RDS, and a number of folks have already started using it
for PuppetDB:

http://aws.amazon.com/rds/postgresql/

> And I am NOT going to go right back to going and installing a separate
database server on the local node. That kind of thing has given me problem after
problem.
> Please tell me I''m missing something and there''s a way I
can get this to work in this AWS environment. Cause otherwise the idea of puppet
running any type of server at all – rather than simply working as a local
filesystem `puppet apply` – looks so unreliable (as I''ve also had some
issues with the puppetmaster) that I should just dump every bit of server/client
software puppetlabs has and write my own custom way of distributing configs and
data.
> 
> 
> -- 
> You received this message because you are subscribed to the Google Groups
"Puppet Users" group.
> To unsubscribe from this group and stop receiving emails from it, send an
email to puppet-users+unsubscribe@googlegroups.com.
> To post to this group, send email to puppet-users@googlegroups.com.
> Visit this group at http://groups.google.com/group/puppet-users.
> For more options, visit https://groups.google.com/groups/opt_out.
-- 
You received this message because you are subscribed to the Google Groups
"Puppet Users" group.
To unsubscribe from this group and stop receiving emails from it, send an email
to puppet-users+unsubscribe@googlegroups.com.
To view this discussion on the web visit
https://groups.google.com/d/msgid/puppet-users/E2F0D574-949C-42AB-9B7D-B35299BE3164%40puppetlabs.com.
For more options, visit https://groups.google.com/groups/opt_out.