For those of you out there using export/collect (which we really need to come up with a better name for...), can you test the current SVN code? I''m mostly wondering if the performance is any better. To use it, you''ll have to remove your current database, since the database schema is significantly changed. I''m getting what looks like an additional 25% reduction in the time it takes to store configurations, but it''s still at just under seconds for my relatively small test configuration. I think my test config is small enough that it''s not a good representative sample, though. -- The great tragedy of Science - the slaying of a beautiful hypothesis by an ugly fact. --Thomas H. Huxley --------------------------------------------------------------------- Luke Kanies | http://reductivelabs.com | http://madstop.com
Hello Luke, I think that you should make a template for that or a link to "how to test from svn" :) I tried to get working puppetmaster using http://mail.madstop.com/pipermail/puppet-users/2006-December/000817.html but... root@puppet:~/svn# ruby -I$RUBYLIB ~/svn/puppet/sbin/puppetmasterd /usr/local/.aqadmin/home/svn/puppet/lib/puppet.rb:3:in `require'': no such file to load -- facter (LoadError) from /usr/local/.aqadmin/home/svn/puppet/lib/puppet.rb:3 from /usr/local/.aqadmin/home/svn/puppet/sbin/puppetmasterd:81:in `require'' from /usr/local/.aqadmin/home/svn/puppet/sbin/puppetmasterd:81 so i done a svn co https://reductivelabs.com/svn/puppet/trunk facter but it does not change the issue, still the same error message so... :( -- Cordialement, Ghislain _______________________________________________ Puppet-users mailing list Puppet-users@madstop.com https://mail.madstop.com/mailman/listinfo/puppet-users
First time I ran puppetmaster from head I got [srv]# ./puppet_svn/sbin/puppetmasterd Mysql::Error: #42000BLOB/TEXT column ''title'' used in key specification without a key length: CREATE INDEX `index_resources_on_title_and_restype` ON resources (`title`, `restype`) I tried running with puppetmasterd with -v -d --trace but couldn''t get any more output. [srv]# svn info puppet_svn/ Path: puppet_svn URL: http://reductivelabs.com/svn/puppet/trunk Repository UUID: 980ebf18-57e1-0310-9a29-db15c13687c0 Revision: 2587 Node Kind: directory Schedule: normal Last Changed Author: luke Last Changed Rev: 2587 Last Changed Date: 2007-06-14 19:40:20 -0700 (Thu, 14 Jun 2007) Properties Last Updated: 2007-06-14 22:43:50 -0700 (Thu, 14 Jun 2007) [/srv]# mysql --version mysql Ver 14.12 Distrib 5.0.41, for unknown-linux-gnu (x86_64) using readline 5.0 rhel4 Let me know if you need any more info, or if it looks like I did somthing wrong. Thanks Brian P.S. I''ll try out ldap tomorow On 6/14/07, ADNET Ghislain <gadnet@aqueos.com> wrote:> Hello Luke, > > > I think that you should make a template for that or a link to "how to > test from svn" :) > > I tried to get working puppetmaster using > http://mail.madstop.com/pipermail/puppet-users/2006-December/000817.html > but... > > root@puppet:~/svn# ruby -I$RUBYLIB ~/svn/puppet/sbin/puppetmasterd > /usr/local/.aqadmin/home/svn/puppet/lib/puppet.rb:3:in `require'': no > such file to load -- facter (LoadError) > from /usr/local/.aqadmin/home/svn/puppet/lib/puppet.rb:3 > from > /usr/local/.aqadmin/home/svn/puppet/sbin/puppetmasterd:81:in `require'' > from /usr/local/.aqadmin/home/svn/puppet/sbin/puppetmasterd:81 > > > so i done a svn co https://reductivelabs.com/svn/puppet/trunk facter > > but it does not change the issue, still the same error message so... :( > > > -- > Cordialement, > Ghislain > > _______________________________________________ > Puppet-users mailing list > Puppet-users@madstop.com > https://mail.madstop.com/mailman/listinfo/puppet-users > > >
Just after that email I reread the email ADNET linked to and realized I did do something wrong. Bad news: I still got the same error Good new: I got more information [root@SE1R4ADM01 srv]# export RUBYLIB=/srv/puppet_svn/lib/ [root@SE1R4ADM01 srv]# ruby -I$RUBYLIB -- /srv/puppet_svn/sbin/puppetmasterd -dv --trace >debug 2>debug [root@SE1R4ADM01 srv]# cat debug Mysql::Error: #42000BLOB/TEXT column ''title'' used in key specification without a key length: CREATE INDEX `index_resources_on_title_and_restype` ON resources (`title`, `restype`) 34mdebug: puppet: Setting logdir to ''/var/log/puppet'' debug: puppet: Setting mkusers to ''true'' debug: puppet: Setting statedir to ''/var/lib/puppet/state'' debug: puppet: Setting ssldir to ''/srv/puppet/ssl'' debug: puppet: Setting authconfig to ''$confdir/namespaceauth.conf'' debug: puppet: Setting rundir to ''/var/run/puppet'' debug: puppet: Setting pluginsource to ''puppet://$server/plugins'' debug: puppet: Setting pluginsync to ''true'' debug: puppet: Setting pluginsignore to ''.svn CVS'' debug: puppet: Setting pluginpath to ''$vardir/plugins'' debug: puppet: Setting plugindest to ''$vardir/plugins'' debug: puppet: Setting factsync to ''true'' debug: puppet: Setting factsignore to ''.svn CVS'' debug: puppet: Setting templatedir to ''$vardir/master/templates'' debug: puppetmasterd: Setting manifestdir to ''/srv/puppet/master/manifests'' debug: puppetmasterd: Setting manifest to ''$manifestdir/site.pp'' debug: puppetmasterd: Setting modulepath to ''$confdir/modules:/usr/share/puppet/modules:$vardir/modules'' debug: puppetd: Setting localconfig to ''/var/lib/puppet/localconfig'' debug: puppetd: Setting classfile to ''/var/lib/puppet/classes.txt'' debug: puppetd: Setting server to ''SE1R4ADM01.3guppies.com'' debug: puppetd: Setting listen to ''true'' debug: puppetd: Setting puppetport to ''8139'' debug: puppetd: Setting report to ''true'' debug: fileserver: Setting fileserverconfig to ''$confdir/fileserver.conf'' debug: reporting: Setting reports to ''store'' debug: reporting: Setting reportdir to ''$vardir/reports'' debug: reporting: Setting reportfrom to ''puppet-report@puppet.3guppies.com'' debug: metrics: Setting rrddir to ''$vardir/rrd'' debug: certificates: Setting hostcsr to ''/var/lib/puppet/ssl/csr_$certname.pem'' debug: certificates: Setting certdir to ''/var/lib/puppet/ssl/certs'' debug: certificates: Setting publickeydir to ''/var/lib/puppet/ssl/public_keys'' debug: certificates: Setting privatekeydir to ''/var/lib/puppet/ssl/private_keys'' debug: certificates: Setting privatedir to ''/var/lib/puppet/ssl/private'' debug: ca: Setting cadir to ''/srv/puppet/master/ssl/ca'' debug: puppetmaster: Setting dbname to ''puppet'' debug: puppetmaster: Setting dbserver to ''127.0.0.1'' debug: puppetmaster: Setting dbuser to ''puppet'' debug: puppetmaster: Setting dbpassword to ''s3s4mestr33t'' debug: puppetmaster: Setting dbadapter to ''mysql'' debug: puppetmaster: Setting storeconfigs to ''true'' info: Starting server for Puppet version 0.22.4 debug: Finishing transaction 91472699060 with 0 changes info: mount[files]: allowing * access info: mount[facts]: allowing * access info: mount[plugins]: allowing * access warning: The ''modules'' module can not have a path. Ignoring attempt to set it info: mount[modules]: allowing * access debug: Creating interpreter debug: Finishing transaction 91471860640 with 0 changes /usr/lib/ruby/gems/1.8/gems/activerecord-1.15.3/lib/active_record/connection_adapters/abstract_adapter.rb:128:in `log'' /usr/lib/ruby/gems/1.8/gems/activerecord-1.15.3/lib/active_record/connection_adapters/mysql_adapter.rb:243:in `execute'' /usr/lib/ruby/gems/1.8/gems/activerecord-1.15.3/lib/active_record/connection_adapters/abstract/schema_statements.rb:197:in `add_index'' /usr/lib/ruby/gems/1.8/gems/activerecord-1.15.3/lib/active_record/migration.rb:275:in `send'' /usr/lib/ruby/gems/1.8/gems/activerecord-1.15.3/lib/active_record/migration.rb:275:in `method_missing'' /usr/lib/ruby/gems/1.8/gems/activerecord-1.15.3/lib/active_record/migration.rb:259:in `say_with_time'' /usr/lib/ruby/1.8/benchmark.rb:293:in `measure'' /usr/lib/ruby/gems/1.8/gems/activerecord-1.15.3/lib/active_record/migration.rb:259:in `say_with_time'' /usr/lib/ruby/gems/1.8/gems/activerecord-1.15.3/lib/active_record/migration.rb:273:in `method_missing'' /srv/puppet_svn/lib/puppet/rails/database/schema.rb:21:in `init'' /usr/lib/ruby/gems/1.8/gems/activerecord-1.15.3/lib/active_record/schema.rb:43:in `instance_eval'' /usr/lib/ruby/gems/1.8/gems/activerecord-1.15.3/lib/active_record/schema.rb:43:in `define'' /srv/puppet_svn/lib/puppet/rails/database/schema.rb:8:in `init'' /srv/puppet_svn/lib/puppet/util.rb:212:in `benchmark'' /usr/lib/ruby/1.8/benchmark.rb:293:in `measure'' /usr/lib/ruby/1.8/benchmark.rb:307:in `realtime'' /srv/puppet_svn/lib/puppet/util.rb:211:in `benchmark'' /srv/puppet_svn/lib/puppet/rails/database/schema.rb:4:in `init'' /srv/puppet_svn/lib/puppet/rails.rb:58:in `init'' /srv/puppet_svn/lib/puppet/parser/interpreter.rb:352:in `initialize'' /srv/puppet_svn/lib/puppet/network/handler/master.rb:124:in `new'' /srv/puppet_svn/lib/puppet/network/handler/master.rb:124:in `initialize'' /srv/puppet_svn/lib/puppet/network/server/webrick.rb:134:in `new'' /srv/puppet_svn/lib/puppet/network/server/webrick.rb:134:in `setup_handlers'' /usr/lib/ruby/gems/1.8/gems/activesupport-1.4.2/lib/active_support/inflector.rb:250:in `collect'' /srv/puppet_svn/lib/puppet/network/server/webrick.rb:129:in `each'' /srv/puppet_svn/lib/puppet/network/server/webrick.rb:129:in `collect'' /srv/puppet_svn/lib/puppet/network/server/webrick.rb:129:in `setup_handlers'' /srv/puppet_svn/lib/puppet/network/server/webrick.rb:79:in `initialize'' /srv/puppet_svn/sbin/puppetmasterd:250:in `new'' /srv/puppet_svn/sbin/puppetmasterd:250 [root@SE1R4ADM01 srv]# mysql -u root -p -e ''show tables\G describe resources\G'' puppet Enter password: *************************** 1. row *************************** Tables_in_puppet: resources *************************** 1. row *************************** Field: id Type: int(11) Null: NO Key: PRI Default: NULL Extra: auto_increment *************************** 2. row *************************** Field: title Type: text Null: NO Key: Default: Extra: *************************** 3. row *************************** Field: restype Type: varchar(255) Null: NO Key: Default: Extra: *************************** 4. row *************************** Field: host_id Type: int(11) Null: YES Key: MUL Default: NULL Extra: *************************** 5. row *************************** Field: source_file_id Type: int(11) Null: YES Key: MUL Default: NULL Extra: *************************** 6. row *************************** Field: exported Type: tinyint(1) Null: YES Key: Default: NULL Extra: *************************** 7. row *************************** Field: line Type: int(11) Null: YES Key: Default: NULL Extra: *************************** 8. row *************************** Field: updated_at Type: datetime Null: YES Key: Default: NULL Extra: Thanks Brian On 6/14/07, Brian Finney <y0gi636@gmail.com> wrote:> First time I ran puppetmaster from head I got > > [srv]# ./puppet_svn/sbin/puppetmasterd > Mysql::Error: #42000BLOB/TEXT column ''title'' used in key specification > without a key length: CREATE INDEX > `index_resources_on_title_and_restype` ON resources (`title`, > `restype`) > > I tried running with puppetmasterd with -v -d --trace but couldn''t get > any more output. > > [srv]# svn info puppet_svn/ > Path: puppet_svn > URL: http://reductivelabs.com/svn/puppet/trunk > Repository UUID: 980ebf18-57e1-0310-9a29-db15c13687c0 > Revision: 2587 > Node Kind: directory > Schedule: normal > Last Changed Author: luke > Last Changed Rev: 2587 > Last Changed Date: 2007-06-14 19:40:20 -0700 (Thu, 14 Jun 2007) > Properties Last Updated: 2007-06-14 22:43:50 -0700 (Thu, 14 Jun 2007) > > [/srv]# mysql --version > mysql Ver 14.12 Distrib 5.0.41, for unknown-linux-gnu (x86_64) using > readline 5.0 > > rhel4 > > Let me know if you need any more info, or if it looks like I did somthing wrong. > > Thanks > Brian > > P.S. I''ll try out ldap tomorow > > On 6/14/07, ADNET Ghislain <gadnet@aqueos.com> wrote: > > Hello Luke, > > > > > > I think that you should make a template for that or a link to "how to > > test from svn" :) > > > > I tried to get working puppetmaster using > > http://mail.madstop.com/pipermail/puppet-users/2006-December/000817.html > > but... > > > > root@puppet:~/svn# ruby -I$RUBYLIB ~/svn/puppet/sbin/puppetmasterd > > /usr/local/.aqadmin/home/svn/puppet/lib/puppet.rb:3:in `require'': no > > such file to load -- facter (LoadError) > > from /usr/local/.aqadmin/home/svn/puppet/lib/puppet.rb:3 > > from > > /usr/local/.aqadmin/home/svn/puppet/sbin/puppetmasterd:81:in `require'' > > from /usr/local/.aqadmin/home/svn/puppet/sbin/puppetmasterd:81 > > > > > > so i done a svn co https://reductivelabs.com/svn/puppet/trunk facter > > > > but it does not change the issue, still the same error message so... :( > > > > > > -- > > Cordialement, > > Ghislain > > > > _______________________________________________ > > Puppet-users mailing list > > Puppet-users@madstop.com > > https://mail.madstop.com/mailman/listinfo/puppet-users > > > > > > >
On Jun 15, 2007, at 12:44 AM, ADNET Ghislain wrote:> I think that you should make a template for that or a link to "how > to test from svn" :) > > I tried to get working puppetmaster using http://mail.madstop.com/ > pipermail/puppet-users/2006-December/000817.html but... > > root@puppet:~/svn# ruby -I$RUBYLIB ~/svn/puppet/sbin/puppetmasterd > /usr/local/.aqadmin/home/svn/puppet/lib/puppet.rb:3:in `require'': > no such file to load -- facter (LoadError) > from /usr/local/.aqadmin/home/svn/puppet/lib/puppet.rb:3 > from /usr/local/.aqadmin/home/svn/puppet/sbin/puppetmasterd: > 81:in `require'' > from /usr/local/.aqadmin/home/svn/puppet/sbin/puppetmasterd:81 > > > so i done a svn co https://reductivelabs.com/svn/puppet/trunk facter > > but it does not change the issue, still the same error message > so... :(My guess is that you''ve either got facter installed with ruby gems and Puppet isn''t looking in gems, or you''ve got multiple versions of Ruby installed and the one you''re using to run Puppet isn''t the one you used to install Facter. I just patched Puppet so it will try loading RubyGems; please try again and let me know if it still doesn''t work. -- I cannot and will not cut my conscience to fit this year''s fashions. -- Lillian Hellman --------------------------------------------------------------------- Luke Kanies | http://reductivelabs.com | http://madstop.com
On Jun 15, 2007, at 1:28 AM, Brian Finney wrote:> Just after that email I reread the email ADNET linked to and realized > I did do something wrong. > > Bad news: I still got the same error > Good new: I got more information > > [root@SE1R4ADM01 srv]# export RUBYLIB=/srv/puppet_svn/lib/ > [root@SE1R4ADM01 srv]# ruby -I$RUBYLIB -- > /srv/puppet_svn/sbin/puppetmasterd -dv --trace >debug 2>debug > [root@SE1R4ADM01 srv]# cat debug > Mysql::Error: #42000BLOB/TEXT column ''title'' used in key specification > without a key length: CREATE INDEX > `index_resources_on_title_and_restype` ON resources (`title`, > `restype`)Were you already using export/collect? If so, you''ll have to drop your existing data, including either dropping and recreating the db or just dropping all of the tables. The database schema is very different, and this error looks to be a result of trying to do index modifications to a column that was previously varchar and is now supposed to be text. Can you try it with a fresh db and see if it works? -- Take the utmost trouble to find the right thing to say, and then say it with the utmost levity. -- George Bernard Shaw --------------------------------------------------------------------- Luke Kanies | http://reductivelabs.com | http://madstop.com
> > I just patched Puppet so it will try loading RubyGems; please try > again and let me know if it still doesn''t work. > >seems that i am a little dumb :) yes i use only gems for puppet as it is cross platform :) (aqadmin)> sudo ruby -I./puppet/lib ./puppet/sbin/puppetd --config /usr/local/.aqadmin/etc/puppetd.conf --onetime --test ./puppet/lib/puppet/util/config.rb:189:in `handlearg'': Invalid argument --no-splay (ArgumentError) from ./puppet/sbin/puppetd:221 from ./puppet/sbin/puppetd:201:in `each'' from /usr/lib/ruby/1.8/getoptlong.rb:457:in `loop'' from /usr/lib/ruby/1.8/getoptlong.rb:457:in `each'' from ./puppet/sbin/puppetd:201 puppetmaster is ok, now the puppetd part has some issues. -- Cordialement, Ghislain _______________________________________________ Puppet-users mailing list Puppet-users@madstop.com https://mail.madstop.com/mailman/listinfo/puppet-users
On Jun 15, 2007, at 9:37 AM, ADNET Ghislain wrote:> yes i use only gems for puppet as it is cross platform :)Ok, glad that''s working.> (aqadmin)> sudo ruby -I./puppet/lib ./puppet/sbin/puppetd --config / > usr/local/.aqadmin/etc/puppetd.conf --onetime --test > ./puppet/lib/puppet/util/config.rb:189:in `handlearg'': Invalid > argument --no-splay (ArgumentError) > from ./puppet/sbin/puppetd:221 > from ./puppet/sbin/puppetd:201:in `each'' > from /usr/lib/ruby/1.8/getoptlong.rb:457:in `loop'' > from /usr/lib/ruby/1.8/getoptlong.rb:457:in `each'' > from ./puppet/sbin/puppetd:201 > > puppetmaster is ok, now the puppetd part has some issues.Strange. That''s basic stuff, so I''m pretty confused. Ruby must be loading an old file somewhere or something. Maybe stupid rubygems is loading an older file instead of the correct file. Splay support has been added since the last release, so if you''ve got 0.22.4 installed somewhere, it doesn''t have that support, but it still isn''t right that you''re getting this failure. I know it works for me, and it''s a pretty fundamental part of Puppet, which makes me think it can only be something stupid that gems are doing. Can anyone else reproduce this problem? -- Should I say "I believe in physics", or "I know that physics is true"? -- Ludwig Wittgenstein, On Certainty, 602. --------------------------------------------------------------------- Luke Kanies | http://reductivelabs.com | http://madstop.com
after removing --test it worked... now i destroyed the mysql table and recreated it but: mysql> show tables; +------------------+ | Tables_in_puppet | +------------------+ | resources | +------------------+ 1 row in set (0.00 sec) mysql> drop table resources; Query OK, 0 rows affected (0.04 sec) mysql> show tables; Empty set (0.00 sec) mysql> Mysql::Error: #42000BLOB/TEXT column ''title'' used in key specification without a key length: CREATE INDEX `index_resources_on_title_and_restype` ON resources (`title`, `restype`) after creating it by hand i have : err: Could not store configs: Mysql::Error: #42S02Table ''puppet.hosts'' doesn''t exist: SHOW FIELDS FROM hosts mysql> CREATE INDEX `index_resources_on_title_and_restype` ON resources (`title`(20), `restype`); Query OK, 0 rows affected (0.06 sec) Records: 0 Duplicates: 0 Warnings: 0 mysql> show tables; +------------------+ | Tables_in_puppet | +------------------+ | resources | +------------------+ 1 row in set (0.00 sec) relaunching puppetmaster it does not create the other tables :( -- Cordialement, Ghislain _______________________________________________ Puppet-users mailing list Puppet-users@madstop.com https://mail.madstop.com/mailman/listinfo/puppet-users
The test was done after dropping all tables in my puppet database. On 6/15/07, Luke Kanies <luke@madstop.com> wrote:> On Jun 15, 2007, at 1:28 AM, Brian Finney wrote: > > > Just after that email I reread the email ADNET linked to and realized > > I did do something wrong. > > > > Bad news: I still got the same error > > Good new: I got more information > > > > [root@SE1R4ADM01 srv]# export RUBYLIB=/srv/puppet_svn/lib/ > > [root@SE1R4ADM01 srv]# ruby -I$RUBYLIB -- > > /srv/puppet_svn/sbin/puppetmasterd -dv --trace >debug 2>debug > > [root@SE1R4ADM01 srv]# cat debug > > Mysql::Error: #42000BLOB/TEXT column ''title'' used in key specification > > without a key length: CREATE INDEX > > `index_resources_on_title_and_restype` ON resources (`title`, > > `restype`) > > Were you already using export/collect? > > If so, you''ll have to drop your existing data, including either > dropping and recreating the db or just dropping all of the tables. > > The database schema is very different, and this error looks to be a > result of trying to do index modifications to a column that was > previously varchar and is now supposed to be text. > > Can you try it with a fresh db and see if it works? > > -- > Take the utmost trouble to find the right thing to say, and then > say it > with the utmost levity. -- George Bernard Shaw > --------------------------------------------------------------------- > Luke Kanies | http://reductivelabs.com | http://madstop.com > > > _______________________________________________ > Puppet-users mailing list > Puppet-users@madstop.com > https://mail.madstop.com/mailman/listinfo/puppet-users >
On Jun 15, 2007, at 11:53 AM, Brian Finney wrote:> The test was done after dropping all tables in my puppet database.Okay, I tracked it down to MySQL requiring that indexes on text columns have a length. So, I created a custom index for MySQL, and it appears to be working for me now. Please try it and let me know. Also, note that the first configuration compile will still be slow, since there is lots of writing; it''s faster on later runs, though. -- You don''t learn anything the second time you''re kicked by a mule. -- Anonymous Texan --------------------------------------------------------------------- Luke Kanies | http://reductivelabs.com | http://madstop.com
On Jun 15, 2007, at 10:02 AM, ADNET Ghislain wrote:> after removing --test it worked...--test sets --no-splay, which is why it started working. See my other email in the thread for the mysql stuff. -- Wear the old coat and buy the new book. -- Austin Phelps --------------------------------------------------------------------- Luke Kanies | http://reductivelabs.com | http://madstop.com
I did an svn up and started puppetmaster up from the svn checkout Start up was smooth, the database tables look like they where created correctly without issue. Next I started up puppetd from the svn checkout and it retrieved it''s configuration without a problem, however every time it tryed to implement the configuration it would stop with a failure such as: Could not apply complete configuration: Could not retrieve dependency ''File[python_sqlite_rpm][Package[sqlite]]'' at /srv/puppet/modules/yum/manifests/init.pp:73 based on quick testing it appears that it is not able to handle `requires` that are given an array to specify multiple dependancies, such as require => [File[python_sqlite_rpm],Package[sqlite]]; Thus as it runs the first one it hits stop the configuration. There are multiple situations like this that puppet randomly stops on which work beautifully in 22.4 rellevent part of localconfig.yaml - !ruby/object:Puppet::TransObject file: /srv/puppet/modules/yum/manifests/init.pp params: tag: install ensure: present source: /tmp/python-sqlite-1.0.1-1.rhel4.x86_64.rpm require: - File[python_sqlite_rpm] - Package[sqlite] provider: rpm tags: - default - main - yum - yum-client - package line: 73 type: package collectable: false name: python-sqlite Thanks Brian On 6/15/07, Luke Kanies <luke@madstop.com> wrote:> On Jun 15, 2007, at 10:02 AM, ADNET Ghislain wrote: > > > after removing --test it worked... > > --test sets --no-splay, which is why it started working. > > See my other email in the thread for the mysql stuff. > > -- > Wear the old coat and buy the new book. -- Austin Phelps > --------------------------------------------------------------------- > Luke Kanies | http://reductivelabs.com | http://madstop.com > > > _______________________________________________ > Puppet-users mailing list > Puppet-users@madstop.com > https://mail.madstop.com/mailman/listinfo/puppet-users >
On Jun 15, 2007, at 4:59 PM, Brian Finney wrote:> I did an svn up and started puppetmaster up from the svn checkout > > Start up was smooth, the database tables look like they where created > correctly without issue.Okay, that''s good.> Next I started up puppetd from the svn checkout and it retrieved it''s > configuration without a problem, however every time it tryed to > implement the configuration it would stop with a failure such as: > > Could not apply complete configuration: Could not retrieve dependency > ''File[python_sqlite_rpm][Package[sqlite]]'' at > /srv/puppet/modules/yum/manifests/init.pp:73 > > based on quick testing it appears that it is not able to handle > `requires` that are given an array to specify multiple dependancies, > such as > > require => [File[python_sqlite_rpm],Package[sqlite]];Strange; it''s working fine for me: exec { echo: command => "/bin/echo yay", refreshonly => true, subscribe => [Exec[one], Exec[two]] } exec { one: command => "/bin/echo one" } exec { two: command => "/bin/echo two" } yeilds: notice: //Exec[one]/returns: executed successfully notice: //Exec[two]/returns: executed successfully notice: //Exec[echo]: Triggering ''refresh'' from 2 dependencies Can anyone else reproduce this?> Thus as it runs the first one it hits stop the configuration. There > are multiple situations like this that puppet randomly stops on which > work beautifully in 22.4Please either let me know of all of these situations or file bugs for them. This is the whole point of prerelease testing -- to find these bugs before they make it into a release.> rellevent part of localconfig.yaml > > - !ruby/object:Puppet::TransObject > file: /srv/puppet/modules/yum/manifests/init.pp > params: > tag: install > ensure: present > source: /tmp/python-sqlite-1.0.1-1.rhel4.x86_64.rpm > require: > - File[python_sqlite_rpm] > - Package[sqlite]This makes it look like they are quoted in the manifest or something; those should each be arrays. -- The Internet, of course, is more than just a place to find pictures of people having sex with dogs. -- Time Magazine, 3 July 1995 --------------------------------------------------------------------- Luke Kanies | http://reductivelabs.com | http://madstop.com
Not sure if it makes a difference, but in your example your using notify, where as the spots where I''m getting the errors I''m just doing a require. Sorry, by multiple situations I meant multiple instances of this particular issue through out my modules, not multiple issues. The particular Package resource for this instance from the manifest is package{ "python-sqlite": source => "/tmp/$python_sqlite_rpm", provider => rpm, ensure => present, require => [File[python_sqlite_rpm],Package[sqlite]]; } On 6/15/07, Luke Kanies <luke@madstop.com> wrote:> On Jun 15, 2007, at 4:59 PM, Brian Finney wrote: > > > I did an svn up and started puppetmaster up from the svn checkout > > > > Start up was smooth, the database tables look like they where created > > correctly without issue. > > Okay, that''s good. > > > Next I started up puppetd from the svn checkout and it retrieved it''s > > configuration without a problem, however every time it tryed to > > implement the configuration it would stop with a failure such as: > > > > Could not apply complete configuration: Could not retrieve dependency > > ''File[python_sqlite_rpm][Package[sqlite]]'' at > > /srv/puppet/modules/yum/manifests/init.pp:73 > > > > based on quick testing it appears that it is not able to handle > > `requires` that are given an array to specify multiple dependancies, > > such as > > > > require => [File[python_sqlite_rpm],Package[sqlite]]; > > Strange; it''s working fine for me: > > exec { echo: command => "/bin/echo yay", refreshonly => true, > subscribe => [Exec[one], Exec[two]] } > > exec { one: command => "/bin/echo one" } > exec { two: command => "/bin/echo two" } > > yeilds: > > notice: //Exec[one]/returns: executed successfully > notice: //Exec[two]/returns: executed successfully > notice: //Exec[echo]: Triggering ''refresh'' from 2 dependencies > > Can anyone else reproduce this? > > > Thus as it runs the first one it hits stop the configuration. There > > are multiple situations like this that puppet randomly stops on which > > work beautifully in 22.4 > > Please either let me know of all of these situations or file bugs for > them. This is the whole point of prerelease testing -- to find these > bugs before they make it into a release. > > > rellevent part of localconfig.yaml > > > > - !ruby/object:Puppet::TransObject > > file: /srv/puppet/modules/yum/manifests/init.pp > > params: > > tag: install > > ensure: present > > source: /tmp/python-sqlite-1.0.1-1.rhel4.x86_64.rpm > > require: > > - File[python_sqlite_rpm] > > - Package[sqlite] > > This makes it look like they are quoted in the manifest or something; > those should each be arrays. > > -- > The Internet, of course, is more than just a place to find pictures of > people having sex with dogs. -- Time Magazine, 3 July 1995 > --------------------------------------------------------------------- > Luke Kanies | http://reductivelabs.com | http://madstop.com > > > _______________________________________________ > Puppet-users mailing list > Puppet-users@madstop.com > https://mail.madstop.com/mailman/listinfo/puppet-users >
On Jun 15, 2007, at 6:54 PM, Brian Finney wrote:> Not sure if it makes a difference, but in your example your using > notify, where as the spots where I''m getting the errors I''m just doing > a require.That doesn''t matter; the problem was the translation from code on the server to Ruby objects on the client, and that''s all done exactly the same for all parameters.> Sorry, by multiple situations I meant multiple instances of this > particular issue through out my modules, not multiple issues.Ah, *whew*. It should be all fixed now; please let me know if you still have problems. -- Life is too short for traffic. --Dan Bellack --------------------------------------------------------------------- Luke Kanies | http://reductivelabs.com | http://madstop.com
Every thing is looking beautiful now, and mysql-slow.log isn''t filling up any more :-D. As my servers check in and the database fills up with information I''ll keep an eye on it and let you guys know if I see anything special. Thanks Brian On 6/17/07, Luke Kanies <luke@madstop.com> wrote:> On Jun 15, 2007, at 6:54 PM, Brian Finney wrote: > > > Not sure if it makes a difference, but in your example your using > > notify, where as the spots where I''m getting the errors I''m just doing > > a require. > > That doesn''t matter; the problem was the translation from code on the > server to Ruby objects on the client, and that''s all done exactly the > same for all parameters. > > > Sorry, by multiple situations I meant multiple instances of this > > particular issue through out my modules, not multiple issues. > > Ah, *whew*. > > It should be all fixed now; please let me know if you still have > problems. > > -- > Life is too short for traffic. --Dan Bellack > --------------------------------------------------------------------- > Luke Kanies | http://reductivelabs.com | http://madstop.com > > > _______________________________________________ > Puppet-users mailing list > Puppet-users@madstop.com > https://mail.madstop.com/mailman/listinfo/puppet-users >
On Jun 18, 2007, at 3:15 PM, Brian Finney wrote:> Every thing is looking beautiful now, and mysql-slow.log isn''t filling > up any more :-D. As my servers check in and the database fills up > with information I''ll keep an eye on it and let you guys know if I see > anything special.Great, thanks. -- Trying to determine what is going on in the world by reading newspapers is like trying to tell the time by watching the second hand of a clock. --Ben Hecht --------------------------------------------------------------------- Luke Kanies | http://reductivelabs.com | http://madstop.com
A few things to report, It appears that the puppetmaster no longer overrides the host name with the ca name when looking for the node definition for servers, I had to add the servers to /etc/hosts on the puppet master to get it to recognize the relevant node sections. I also just got the "value is a required option for Puppet::Parser::Resource::Param" error here is the syslog Jun 18 14:36:52 SE1R4ADM01 puppetmasterd[16884]: value is a required option for Puppet::Parser::Resource::Param Jun 18 14:36:52 se1r4sql03 puppetd[6721]: Could not retrieve configuration: value is a required option for Puppet::Parser::Resource::Param Jun 18 14:36:52 se1r4sql03 puppetd[6721]: Could not get config; using cached copy and the trace from puppetmaster -d --trace: /srv/puppet_svn/lib/puppet/util/errors.rb:51:in `fail'' /srv/puppet_svn/lib/puppet/util/errors.rb:5:in `devfail'' /srv/puppet_svn/lib/puppet/util/methodhelper.rb:6:in `requiredopts'' /srv/puppet_svn/lib/puppet/util/methodhelper.rb:4:in `each'' /srv/puppet_svn/lib/puppet/util/methodhelper.rb:4:in `requiredopts'' /srv/puppet_svn/lib/puppet/parser/resource/param.rb:10:in `initialize'' /srv/puppet_svn/lib/puppet/rails/param_name.rb:19:in `new'' /srv/puppet_svn/lib/puppet/rails/param_name.rb:19:in `to_resourceparam'' /srv/puppet_svn/lib/puppet/rails/resource.rb:109:in `to_resource'' /usr/lib/ruby/gems/1.8/gems/activerecord-1.15.3/lib/active_record/associations/association_proxy.rb:123:in `each'' /usr/lib/ruby/gems/1.8/gems/activerecord-1.15.3/lib/active_record/associations/association_proxy.rb:123:in `send'' /usr/lib/ruby/gems/1.8/gems/activerecord-1.15.3/lib/active_record/associations/association_proxy.rb:123:in `method_missing'' /usr/lib/ruby/gems/1.8/gems/activerecord-1.15.3/lib/active_record/associations/has_many_through_association.rb:108:in `metho d_missing'' /srv/puppet_svn/lib/puppet/rails/resource.rb:108:in `to_resource'' /srv/puppet_svn/lib/puppet/parser/collector.rb:163:in `export_resource'' /srv/puppet_svn/lib/puppet/parser/collector.rb:39:in `collect_exported'' /srv/puppet_svn/lib/puppet/parser/collector.rb:36:in `each'' /srv/puppet_svn/lib/puppet/parser/collector.rb:36:in `collect_exported'' /srv/puppet_svn/lib/puppet/util.rb:419:in `thinmark'' /usr/lib/ruby/1.8/benchmark.rb:293:in `measure'' /usr/lib/ruby/1.8/benchmark.rb:307:in `realtime'' /srv/puppet_svn/lib/puppet/util.rb:418:in `thinmark'' /srv/puppet_svn/lib/puppet/parser/collector.rb:35:in `collect_exported'' /srv/puppet_svn/lib/puppet/parser/collector.rb:109:in `send'' /srv/puppet_svn/lib/puppet/parser/collector.rb:109:in `evaluate'' /srv/puppet_svn/lib/puppet/parser/interpreter.rb:127:in `evaliterate'' /srv/puppet_svn/lib/puppet/parser/interpreter.rb:124:in `each'' /srv/puppet_svn/lib/puppet/parser/interpreter.rb:124:in `evaliterate'' /srv/puppet_svn/lib/puppet/util/errors.rb:25:in `exceptwrap'' /srv/puppet_svn/lib/puppet/parser/interpreter.rb:123:in `evaliterate'' /srv/puppet_svn/lib/puppet/parser/interpreter.rb:118:in `loop'' /srv/puppet_svn/lib/puppet/parser/interpreter.rb:118:in `evaliterate'' /srv/puppet_svn/lib/puppet/parser/interpreter.rb:218:in `evaluate'' /srv/puppet_svn/lib/puppet/parser/interpreter.rb:712:in `run'' /srv/puppet_svn/lib/puppet/network/handler/master.rb:185:in `getconfig'' /srv/puppet_svn/lib/puppet/util.rb:212:in `benchmark'' /usr/lib/ruby/1.8/benchmark.rb:293:in `measure'' /usr/lib/ruby/1.8/benchmark.rb:307:in `realtime'' /srv/puppet_svn/lib/puppet/util.rb:211:in `benchmark'' /srv/puppet_svn/lib/puppet/network/handler/master.rb:183:in `getconfig'' /usr/lib/ruby/gems/1.8/gems/activesupport-1.4.2/lib/active_support/inflector.rb:250:in `to_proc'' /srv/puppet_svn/lib/puppet/network/xmlrpc/processor.rb:52:in `call'' /srv/puppet_svn/lib/puppet/network/xmlrpc/processor.rb:52:in `protect_service'' /srv/puppet_svn/lib/puppet/network/xmlrpc/processor.rb:85:in `setup_processor'' /usr/lib/ruby/1.8/xmlrpc/server.rb:336:in `call'' /usr/lib/ruby/1.8/xmlrpc/server.rb:336:in `dispatch'' /usr/lib/ruby/1.8/xmlrpc/server.rb:323:in `each'' /usr/lib/ruby/1.8/xmlrpc/server.rb:323:in `dispatch'' /usr/lib/ruby/1.8/xmlrpc/server.rb:366:in `call_method'' /usr/lib/ruby/1.8/xmlrpc/server.rb:378:in `handle'' /srv/puppet_svn/lib/puppet/network/xmlrpc/processor.rb:44:in `process'' /srv/puppet_svn/lib/puppet/network/xmlrpc/webrick_servlet.rb:68:in `service'' /usr/lib/ruby/1.8/webrick/httpserver.rb:104:in `service'' /usr/lib/ruby/1.8/webrick/httpserver.rb:65:in `run'' /usr/lib/ruby/1.8/webrick/server.rb:173:in `start_thread'' /usr/lib/ruby/1.8/webrick/server.rb:162:in `start'' /usr/lib/ruby/1.8/webrick/server.rb:162:in `start_thread'' /usr/lib/ruby/1.8/webrick/server.rb:95:in `start'' /usr/lib/ruby/1.8/webrick/server.rb:92:in `each'' /usr/lib/ruby/1.8/webrick/server.rb:92:in `start'' /usr/lib/ruby/1.8/webrick/server.rb:23:in `start'' /usr/lib/ruby/1.8/webrick/server.rb:82:in `start'' /srv/puppet_svn/lib/puppet.rb:334:in `start'' /srv/puppet_svn/lib/puppet.rb:185:in `newthread'' /srv/puppet_svn/lib/puppet.rb:184:in `initialize'' /srv/puppet_svn/lib/puppet.rb:184:in `new'' /srv/puppet_svn/lib/puppet.rb:184:in `newthread'' /srv/puppet_svn/lib/puppet.rb:332:in `start'' /srv/puppet_svn/lib/puppet.rb:331:in `each'' /srv/puppet_svn/lib/puppet.rb:331:in `start'' /srv/puppet_svn/bin/puppetmasterd:297 /srv/puppet_svn/lib/puppet/util/errors.rb:51:in `fail'' /srv/puppet_svn/lib/puppet/util/errors.rb:5:in `devfail'' /srv/puppet_svn/lib/puppet/util/methodhelper.rb:6:in `requiredopts'' /srv/puppet_svn/lib/puppet/util/methodhelper.rb:4:in `each'' /srv/puppet_svn/lib/puppet/util/methodhelper.rb:4:in `requiredopts'' /srv/puppet_svn/lib/puppet/parser/resource/param.rb:10:in `initialize'' /srv/puppet_svn/lib/puppet/rails/param_name.rb:19:in `new'' /srv/puppet_svn/lib/puppet/rails/param_name.rb:19:in `to_resourceparam'' /srv/puppet_svn/lib/puppet/rails/resource.rb:109:in `to_resource'' /usr/lib/ruby/gems/1.8/gems/activerecord-1.15.3/lib/active_record/associations/association_proxy.rb:123:in `each'' /usr/lib/ruby/gems/1.8/gems/activerecord-1.15.3/lib/active_record/associations/association_proxy.rb:123:in `send'' /usr/lib/ruby/gems/1.8/gems/activerecord-1.15.3/lib/active_record/associations/association_proxy.rb:123:in `method_missing'' /usr/lib/ruby/gems/1.8/gems/activerecord-1.15.3/lib/active_record/associations/has_many_through_association.rb:108:in `metho d_missing'' /srv/puppet_svn/lib/puppet/rails/resource.rb:108:in `to_resource'' /srv/puppet_svn/lib/puppet/parser/collector.rb:163:in `export_resource'' /srv/puppet_svn/lib/puppet/parser/collector.rb:39:in `collect_exported'' /srv/puppet_svn/lib/puppet/parser/collector.rb:36:in `each'' /srv/puppet_svn/lib/puppet/parser/collector.rb:36:in `collect_exported'' /srv/puppet_svn/lib/puppet/util.rb:419:in `thinmark'' /usr/lib/ruby/1.8/benchmark.rb:293:in `measure'' /usr/lib/ruby/1.8/benchmark.rb:307:in `realtime'' /srv/puppet_svn/lib/puppet/util.rb:418:in `thinmark'' /srv/puppet_svn/lib/puppet/parser/collector.rb:35:in `collect_exported'' /srv/puppet_svn/lib/puppet/parser/collector.rb:109:in `send'' /srv/puppet_svn/lib/puppet/parser/collector.rb:109:in `evaluate'' /srv/puppet_svn/lib/puppet/parser/interpreter.rb:127:in `evaliterate'' /srv/puppet_svn/lib/puppet/parser/interpreter.rb:124:in `each'' /srv/puppet_svn/lib/puppet/parser/interpreter.rb:124:in `evaliterate'' /srv/puppet_svn/lib/puppet/util/errors.rb:25:in `exceptwrap'' /srv/puppet_svn/lib/puppet/parser/interpreter.rb:123:in `evaliterate'' /srv/puppet_svn/lib/puppet/parser/interpreter.rb:118:in `loop'' /srv/puppet_svn/lib/puppet/parser/interpreter.rb:118:in `evaliterate'' /srv/puppet_svn/lib/puppet/parser/interpreter.rb:218:in `evaluate'' /srv/puppet_svn/lib/puppet/parser/interpreter.rb:712:in `run'' /srv/puppet_svn/lib/puppet/network/handler/master.rb:185:in `getconfig'' /srv/puppet_svn/lib/puppet/util.rb:212:in `benchmark'' /usr/lib/ruby/1.8/benchmark.rb:293:in `measure'' /usr/lib/ruby/1.8/benchmark.rb:307:in `realtime'' /srv/puppet_svn/lib/puppet/util.rb:211:in `benchmark'' /srv/puppet_svn/lib/puppet/network/handler/master.rb:183:in `getconfig'' /usr/lib/ruby/gems/1.8/gems/activesupport-1.4.2/lib/active_support/inflector.rb:250:in `to_proc'' /srv/puppet_svn/lib/puppet/network/xmlrpc/processor.rb:52:in `call'' /srv/puppet_svn/lib/puppet/network/xmlrpc/processor.rb:52:in `protect_service'' /srv/puppet_svn/lib/puppet/network/xmlrpc/processor.rb:85:in `setup_processor'' /usr/lib/ruby/1.8/xmlrpc/server.rb:336:in `call'' /usr/lib/ruby/1.8/xmlrpc/server.rb:336:in `dispatch'' /usr/lib/ruby/1.8/xmlrpc/server.rb:323:in `each'' /usr/lib/ruby/1.8/xmlrpc/server.rb:323:in `dispatch'' /usr/lib/ruby/1.8/xmlrpc/server.rb:366:in `call_method'' /usr/lib/ruby/1.8/xmlrpc/server.rb:378:in `handle'' /srv/puppet_svn/lib/puppet/network/xmlrpc/processor.rb:44:in `process'' /srv/puppet_svn/lib/puppet/network/xmlrpc/webrick_servlet.rb:68:in `service'' /usr/lib/ruby/1.8/webrick/httpserver.rb:104:in `service'' /usr/lib/ruby/1.8/webrick/httpserver.rb:65:in `run'' /usr/lib/ruby/1.8/webrick/server.rb:173:in `start_thread'' /usr/lib/ruby/1.8/webrick/server.rb:162:in `start'' /usr/lib/ruby/1.8/webrick/server.rb:162:in `start_thread'' /usr/lib/ruby/1.8/webrick/server.rb:95:in `start'' /usr/lib/ruby/1.8/webrick/server.rb:92:in `each'' /usr/lib/ruby/1.8/webrick/server.rb:92:in `start'' /usr/lib/ruby/1.8/webrick/server.rb:23:in `start'' /usr/lib/ruby/1.8/webrick/server.rb:82:in `start'' /srv/puppet_svn/lib/puppet.rb:334:in `start'' /srv/puppet_svn/lib/puppet.rb:185:in `newthread'' /srv/puppet_svn/lib/puppet.rb:184:in `initialize'' /srv/puppet_svn/lib/puppet.rb:184:in `new'' /srv/puppet_svn/lib/puppet.rb:184:in `newthread'' /srv/puppet_svn/lib/puppet.rb:332:in `start'' /srv/puppet_svn/lib/puppet.rb:331:in `each'' /srv/puppet_svn/lib/puppet.rb:331:in `start'' /srv/puppet_svn/bin/puppetmasterd:297 Sorry for the long trace, it was simpler to copy/paste than get the file off the server If you need any more info let me know. I''m going to turn of the collection part of my manifest for now and hopefully once things settle down a little bit it will work better. Thanks Brian On 6/18/07, Luke Kanies <luke@madstop.com> wrote:> On Jun 18, 2007, at 3:15 PM, Brian Finney wrote: > > > Every thing is looking beautiful now, and mysql-slow.log isn''t filling > > up any more :-D. As my servers check in and the database fills up > > with information I''ll keep an eye on it and let you guys know if I see > > anything special. > > Great, thanks. > > -- > Trying to determine what is going on in the world by reading > newspapers > is like trying to tell the time by watching the second hand of a > clock. > --Ben Hecht > --------------------------------------------------------------------- > Luke Kanies | http://reductivelabs.com | http://madstop.com > > > _______________________________________________ > Puppet-users mailing list > Puppet-users@madstop.com > https://mail.madstop.com/mailman/listinfo/puppet-users >
On Jun 18, 2007, at 5:33 PM, Brian Finney wrote:> A few things to report, > > It appears that the puppetmaster no longer overrides the host name > with the ca name when looking for the node definition for servers, I > had to add the servers to /etc/hosts on the puppet master to get it to > recognize the relevant node sections. > > I also just got the "value is a required option for > Puppet::Parser::Resource::Param" error > > here is the syslog > > Jun 18 14:36:52 SE1R4ADM01 puppetmasterd[16884]: value is a required > option for Puppet::Parser::Resource::Param > Jun 18 14:36:52 se1r4sql03 puppetd[6721]: Could not retrieve > configuration: value is a required option for > Puppet::Parser::Resource::Param > Jun 18 14:36:52 se1r4sql03 puppetd[6721]: Could not get config; using > cached copy > > and the trace from puppetmaster -d --trace:[...] Do you get this consistently? On every host on every run, just some hosts, or what? I can''t reproduce it, unsurprisingly. :/ -- Silence is a text easy to misread. -- A. A. Attanasio, ''The Eagle and the Sword'' --------------------------------------------------------------------- Luke Kanies | http://reductivelabs.com | http://madstop.com