thr3ads.net - Puppet users - Results from testing our manifests, functions and types against HEAD [Dec 2007]

If this information is useful, please help other people find it:
Share via:

<Derek.Whayman@barclayscapital.com>

2007-Dec-10 17:21 UTC

Results from testing our manifests, functions and types against HEAD

Hi Luke and other people working on 0.24.  I hope this is constructive.

So, I have our configuration working against a checkout from git as of
last night.

Subject to (sorry, here''s the big but :)

   * external_nodes script is not being called (#951)

   * Custom types aren''t working unless I drop them into
$rubysitedir/puppet/{type,provider}.  Previously they worked in
$libdir/puppet/{type,provider}.  See error below[1].  N.B.  I''m still
using the old deprecated plugins fileserver mount.

   * Many Puppet config files and directories now become resources
automatically.  In particular, $config (/etc/puppet/puppet.conf) is one,
so when I try to add a resource Puppet reports a conflict.  This is
problematic because we generate $config from a template for clients (if
you''re interested, it''s because we "write-back"
server = <%= blah %>,
which means your client "sticks" to the last Puppetmaster it
contacted)

   * For custom functions, the newfile call has moved.  We use something
like

self.interp.newfile("#{CACHEDIR}/datafile")

     in order to let Puppet know to invalidate the cache if the file
changes.  Not 100% sure what the new syntax is.  Is it perhaps this
(seems to work)?

self.parser.watch_file("#{CACHEDIR}/datafile")

   * Error when adding packages with yum.  The package is still
installed, but we see:
err: Could not prefetch package provider ''yum'': Execution of
''/usr/bin/python
/usr/lib/ruby/site_ruby/1.8/puppet/provider/package/yumhelper.py''
returned 512: /usr/bin/python: can''t open file
''/usr/lib/ruby/site_ruby/1.8/puppet/provider/package/yumhelper.py'':
[Errno 2] No such file or directory
notice:
//Node[engpsr0155]/packages::setup/rhel5-packagegroups::dmzbase/rhel5-pa
ckagegroups::baseplus/Package[sysstat]/ensure: created

This file exists in git but is not installed by install.rb.  Once I copy
it in manually that error goes away.

   * Miscellaneous networking error (intermittent; happened twice)
warning: Other end went away; restarting connection and retrying
warning: Other end went away; restarting connection and retrying
warning: Other end went away; restarting connection and retrying
warning: Other end went away; restarting connection and retrying
warning: Other end went away; restarting connection and retrying
warning: Other end went away; restarting connection and retrying
warning: Other end went away; restarting connection and retrying
notice: Finished configuration run in 37.68 seconds

Do you want me to log tickets, etc?

Cheers,
Derek


[1] - Error message is:
/usr/lib/ruby/site_ruby/1.8/puppet/util/autoload.rb:114:in `require'':
no
such file to load -- puppet/provider/sy
sctl/parsed (LoadError)
        from /usr/lib/ruby/site_ruby/1.8/puppet/util/autoload.rb:114:in
`loadall''
        from /usr/lib/ruby/site_ruby/1.8/puppet/util/autoload.rb:109:in
`each''
        from /usr/lib/ruby/site_ruby/1.8/puppet/util/autoload.rb:109:in
`loadall''
        from /usr/lib/ruby/site_ruby/1.8/puppet/util/autoload.rb:132:in
`eachdir''
        from /usr/lib/ruby/site_ruby/1.8/puppet/util/autoload.rb:130:in
`each''
        from /usr/lib/ruby/site_ruby/1.8/puppet/util/autoload.rb:130:in
`eachdir''
        from /usr/lib/ruby/site_ruby/1.8/puppet/util/autoload.rb:108:in
`loadall''
        from
/usr/lib/ruby/site_ruby/1.8/puppet/metatype/providers.rb:234:in
`suitableprovider''
         ... 36 levels...
        from
/usr/lib/ruby/site_ruby/1.8/puppet/network/client/master.rb:259:in
`run''
        from /usr/lib/ruby/1.8/sync.rb:229:in `synchronize''
        from
/usr/lib/ruby/site_ruby/1.8/puppet/network/client/master.rb:252:in
`run''
        from /usr/bin/puppetd:427
------------------------------------------------------------------------
For important statutory and regulatory disclosures and more information about
Barclays Capital, please visit our web site at http://www.barcap.com.

Internet communications are not secure and therefore the Barclays Group does not
accept legal responsibility for the contents of this message.  Although the
Barclays Group operates anti-virus programmes, it does not accept responsibility
for any damage whatsoever that is caused by viruses being passed.  Any views or
opinions presented are solely those of the author and do not necessarily
represent those of the Barclays Group.  Replies to this email may be monitored
by the Barclays Group for operational or business reasons.

Barclays Capital is the investment banking division of Barclays Bank PLC, a
company registered in England (number 1026167) with its registered office at 1
Churchill Place, London, E14 5HP. This email may relate to or be sent from other
members of the Barclays Group.
------------------------------------------------------------------------

David Schmitt

2007-Dec-10 21:24 UTC

head link

Re: Results from testing our manifests, functions and types against HEAD

-----BEGIN PGP SIGNED MESSAGE-----
Hash: SHA1

On Monday 10 December 2007, Derek.Whayman@barclayscapital.com
wrote:> Hi Luke and other people working on 0.24.  I hope this is constructive.
>
> So, I have our configuration working against a checkout from git as of
> last night.
Great to hear that I''m not the only one testing 0.24 :)
> Subject to (sorry, here''s the big but :)
>
>    * Custom types aren''t working unless I drop them into
> $rubysitedir/puppet/{type,provider}.  Previously they worked in
> $libdir/puppet/{type,provider}.  See error below[1].  N.B.  I''m
still
> using the old deprecated plugins fileserver mount.
This might be connected to #948 although the error message looks different.
>    * Many Puppet config files and directories now become resources
> automatically.  In particular, $config (/etc/puppet/puppet.conf) is one,
> so when I try to add a resource Puppet reports a conflict.  This is
> problematic because we generate $config from a template for clients (if
> you''re interested, it''s because we "write-back"
server = <%= blah %>,
> which means your client "sticks" to the last Puppetmaster it
contacted)
Hmm ... This is a tough one. Luke, is there a way to override stuff there? 
like "class something inherits SYSTEM {
File["$confdir/puppet.conf"]
{ ... } }"?
>    * For custom functions, the newfile call has moved.  We use something
> like
>
> self.interp.newfile("#{CACHEDIR}/datafile")
>
>      in order to let Puppet know to invalidate the cache if the file
> changes.  Not 100% sure what the new syntax is.  Is it perhaps this
> (seems to work)?
>
> self.parser.watch_file("#{CACHEDIR}/datafile")
This should be documented in the CHANGELOG and on the appropriate wiki pages. 
Could you please take care of that?
>    * Error when adding packages with yum.  The package is still
> installed, but we see:
> err: Could not prefetch package provider ''yum'': Execution
of
> ''/usr/bin/python
> /usr/lib/ruby/site_ruby/1.8/puppet/provider/package/yumhelper.py''
> returned 512: /usr/bin/python: can''t open file
>
''/usr/lib/ruby/site_ruby/1.8/puppet/provider/package/yumhelper.py'':
> [Errno 2] No such file or directory
> notice:
> //Node[engpsr0155]/packages::setup/rhel5-packagegroups::dmzbase/rhel5-pa
> ckagegroups::baseplus/Package[sysstat]/ensure: created
>
> This file exists in git but is not installed by install.rb.  Once I copy
> it in manually that error goes away.
O_O 

This "just" has to be added to the libs variable in the install.rb.
Could you
please verify that this is actually fixing the problem and submit a short 
note in trac?
>    * Miscellaneous networking error (intermittent; happened twice)
> warning: Other end went away; restarting connection and retrying
> warning: Other end went away; restarting connection and retrying
> warning: Other end went away; restarting connection and retrying
> warning: Other end went away; restarting connection and retrying
> warning: Other end went away; restarting connection and retrying
> warning: Other end went away; restarting connection and retrying
> warning: Other end went away; restarting connection and retrying
> notice: Finished configuration run in 37.68 seconds
This is #944 .
> One more error/warning from the latest Puppet from git:
>
> In the provider I have
>
> KEYS = Facter.value(:roothome) + "/.ssh/authorized_keys"
>
> Puppet::Type.type(:authorizedkey).provide(:parsed,
> ...
>
>
> I get an error on the Puppetmaster:
> Could not autoload
>
"/usr/lib/ruby/site_ruby/1.8/puppet/provider/authorizedkey/parsed.rb":
> undefined method `+'' for nil:NilClass
> Could not autoload
>
"/usr/lib/ruby/site_ruby/1.8/puppet/provider/authorizedkey/parsed.rb":
> undefined method `+'' for nil:NilClass
>
> It''s still working (custom fact roothome is /root).  On the
client,
> debug lines let me see that the type is retrieving the custom fact
> correctly.  After all, the type runs on the client.
>
> The custom fact roothome.rb lives in $libdir/facts ($factpath) as
> before.

Is this fact installed on the puppetmaster too? As a trivial workaround, check 
the fact for nil-ness and confine the provider on this check. At least
it''ll
not bomb out.


Regards, David
>
> [1] - Error message is:
> /usr/lib/ruby/site_ruby/1.8/puppet/util/autoload.rb:114:in
`require'': no
> such file to load -- puppet/provider/sy
> sctl/parsed (LoadError)
>         from /usr/lib/ruby/site_ruby/1.8/puppet/util/autoload.rb:114:in
> `loadall''
>         from /usr/lib/ruby/site_ruby/1.8/puppet/util/autoload.rb:109:in
> `each''
>         from /usr/lib/ruby/site_ruby/1.8/puppet/util/autoload.rb:109:in
> `loadall''
>         from /usr/lib/ruby/site_ruby/1.8/puppet/util/autoload.rb:132:in
> `eachdir''
>         from /usr/lib/ruby/site_ruby/1.8/puppet/util/autoload.rb:130:in
> `each''
>         from /usr/lib/ruby/site_ruby/1.8/puppet/util/autoload.rb:130:in
> `eachdir''
>         from /usr/lib/ruby/site_ruby/1.8/puppet/util/autoload.rb:108:in
> `loadall''
>         from
> /usr/lib/ruby/site_ruby/1.8/puppet/metatype/providers.rb:234:in
> `suitableprovider''
>          ... 36 levels...
>         from
> /usr/lib/ruby/site_ruby/1.8/puppet/network/client/master.rb:259:in
`run''
>         from /usr/lib/ruby/1.8/sync.rb:229:in `synchronize''
>         from
> /usr/lib/ruby/site_ruby/1.8/puppet/network/client/master.rb:252:in
`run''
>         from /usr/bin/puppetd:427

- -- 
The primary freedom of open source is not the freedom from cost, but the free-
dom to shape software to do what you want. This freedom is /never/ exercised
without cost, but is available /at all/ only by accepting the very different
costs associated with open source, costs not in money, but in time and effort.
- -- http://www.schierer.org/~luke/log/20070710-1129/on-forks-and-forking
-----BEGIN PGP SIGNATURE-----
Version: GnuPG v1.4.6 (GNU/Linux)

iD8DBQFHXa5+/Pp1N6Uzh0URAqNCAJ44pRHloBn5QG8l12X3Bid6g7YvXQCfSGaB
FFjEjcI+LZb2P3r1WekMn2o=ItgW
-----END PGP SIGNATURE-----

<Derek.Whayman@barclayscapital.com>

2007-Dec-11 10:45 UTC

head link

Re: Results from testing our manifests, functions and types against HEAD

Bit more progress, albeit mainly on the ticket logging front:

#955 - install.rb fix for .py file

newfile / watch_file - Already documented in
http://reductivelabs.com/trac/puppet/wiki/WritingYourOwnFunctions (I must have
missed that)

Custom types - Still a problem - logged #957

Custom fact - Yes it was also installed on the Puppetmaster; resolved by moving
my custom facts into $rubysitedir/facter - logged #958

Autoresources - HELP! :)

Many thanks,
Derek
 

-----Original Message-----
From: puppet-users-bounces@madstop.com [mailto:puppet-users-bounces@madstop.com]
On Behalf Of David Schmitt
Sent: 10 December 2007 21:24
To: Puppet User Discussion
Subject: Re: [Puppet-users] Results from testing our manifests,functions and
types against HEAD

-----BEGIN PGP SIGNED MESSAGE-----
Hash: SHA1

On Monday 10 December 2007, Derek.Whayman@barclayscapital.com
wrote:> Hi Luke and other people working on 0.24.  I hope this is constructive.
>
> So, I have our configuration working against a checkout from git as of 
> last night.
Great to hear that I''m not the only one testing 0.24 :)
> Subject to (sorry, here''s the big but :)
>
>    * Custom types aren''t working unless I drop them into 
> $rubysitedir/puppet/{type,provider}.  Previously they worked in 
> $libdir/puppet/{type,provider}.  See error below[1].  N.B.  I''m
still
> using the old deprecated plugins fileserver mount.
This might be connected to #948 although the error message looks different.
>    * Many Puppet config files and directories now become resources 
> automatically.  In particular, $config (/etc/puppet/puppet.conf) is 
> one, so when I try to add a resource Puppet reports a conflict.  This 
> is problematic because we generate $config from a template for clients 
> (if you''re interested, it''s because we
"write-back" server = <%= blah
> %>, which means your client "sticks" to the last Puppetmaster
it
> contacted)
Hmm ... This is a tough one. Luke, is there a way to override stuff there? 
like "class something inherits SYSTEM {
File["$confdir/puppet.conf"] { ... } }"?
>    * For custom functions, the newfile call has moved.  We use 
> something like
>
> self.interp.newfile("#{CACHEDIR}/datafile")
>
>      in order to let Puppet know to invalidate the cache if the file 
> changes.  Not 100% sure what the new syntax is.  Is it perhaps this 
> (seems to work)?
>
> self.parser.watch_file("#{CACHEDIR}/datafile")
This should be documented in the CHANGELOG and on the appropriate wiki pages. 
Could you please take care of that?
>    * Error when adding packages with yum.  The package is still 
> installed, but we see:
> err: Could not prefetch package provider ''yum'': Execution
of
> ''/usr/bin/python 
> /usr/lib/ruby/site_ruby/1.8/puppet/provider/package/yumhelper.py''
> returned 512: /usr/bin/python: can''t open file
>
''/usr/lib/ruby/site_ruby/1.8/puppet/provider/package/yumhelper.py'':
> [Errno 2] No such file or directory
> notice:
> //Node[engpsr0155]/packages::setup/rhel5-packagegroups::dmzbase/rhel5-
> pa
> ckagegroups::baseplus/Package[sysstat]/ensure: created
>
> This file exists in git but is not installed by install.rb.  Once I 
> copy it in manually that error goes away.
O_O 

This "just" has to be added to the libs variable in the install.rb.
Could you please verify that this is actually fixing the problem and submit a
short note in trac?
>    * Miscellaneous networking error (intermittent; happened twice)
> warning: Other end went away; restarting connection and retrying
> warning: Other end went away; restarting connection and retrying
> warning: Other end went away; restarting connection and retrying
> warning: Other end went away; restarting connection and retrying
> warning: Other end went away; restarting connection and retrying
> warning: Other end went away; restarting connection and retrying
> warning: Other end went away; restarting connection and retrying
> notice: Finished configuration run in 37.68 seconds
This is #944 .
> One more error/warning from the latest Puppet from git:
>
> In the provider I have
>
> KEYS = Facter.value(:roothome) + "/.ssh/authorized_keys"
>
> Puppet::Type.type(:authorizedkey).provide(:parsed,
> ...
>
>
> I get an error on the Puppetmaster:
> Could not autoload
>
"/usr/lib/ruby/site_ruby/1.8/puppet/provider/authorizedkey/parsed.rb":
> undefined method `+'' for nil:NilClass
> Could not autoload
>
"/usr/lib/ruby/site_ruby/1.8/puppet/provider/authorizedkey/parsed.rb":
> undefined method `+'' for nil:NilClass
>
> It''s still working (custom fact roothome is /root).  On the
client,
> debug lines let me see that the type is retrieving the custom fact 
> correctly.  After all, the type runs on the client.
>
> The custom fact roothome.rb lives in $libdir/facts ($factpath) as 
> before.

Is this fact installed on the puppetmaster too? As a trivial workaround, check
the fact for nil-ness and confine the provider on this check. At least
it''ll not bomb out.


Regards, David
>
> [1] - Error message is:
> /usr/lib/ruby/site_ruby/1.8/puppet/util/autoload.rb:114:in
`require'':
> no such file to load -- puppet/provider/sy sctl/parsed (LoadError)
>         from 
> /usr/lib/ruby/site_ruby/1.8/puppet/util/autoload.rb:114:in
> `loadall''
>         from 
> /usr/lib/ruby/site_ruby/1.8/puppet/util/autoload.rb:109:in
> `each''
>         from 
> /usr/lib/ruby/site_ruby/1.8/puppet/util/autoload.rb:109:in
> `loadall''
>         from 
> /usr/lib/ruby/site_ruby/1.8/puppet/util/autoload.rb:132:in
> `eachdir''
>         from 
> /usr/lib/ruby/site_ruby/1.8/puppet/util/autoload.rb:130:in
> `each''
>         from 
> /usr/lib/ruby/site_ruby/1.8/puppet/util/autoload.rb:130:in
> `eachdir''
>         from 
> /usr/lib/ruby/site_ruby/1.8/puppet/util/autoload.rb:108:in
> `loadall''
>         from
> /usr/lib/ruby/site_ruby/1.8/puppet/metatype/providers.rb:234:in
> `suitableprovider''
>          ... 36 levels...
>         from
> /usr/lib/ruby/site_ruby/1.8/puppet/network/client/master.rb:259:in
`run''
>         from /usr/lib/ruby/1.8/sync.rb:229:in `synchronize''
>         from
> /usr/lib/ruby/site_ruby/1.8/puppet/network/client/master.rb:252:in
`run''
>         from /usr/bin/puppetd:427

- --
The primary freedom of open source is not the freedom from cost, but the free-
dom to shape software to do what you want. This freedom is /never/ exercised
without cost, but is available /at all/ only by accepting the very different
costs associated with open source, costs not in money, but in time and effort.
- -- http://www.schierer.org/~luke/log/20070710-1129/on-forks-and-forking
-----BEGIN PGP SIGNATURE-----
Version: GnuPG v1.4.6 (GNU/Linux)

iD8DBQFHXa5+/Pp1N6Uzh0URAqNCAJ44pRHloBn5QG8l12X3Bid6g7YvXQCfSGaB
FFjEjcI+LZb2P3r1WekMn2o=ItgW
-----END PGP SIGNATURE-----
_______________________________________________
Puppet-users mailing list
Puppet-users@madstop.com
https://mail.madstop.com/mailman/listinfo/puppet-users
------------------------------------------------------------------------
For important statutory and regulatory disclosures and more information about
Barclays Capital, please visit our web site at http://www.barcap.com.

Internet communications are not secure and therefore the Barclays Group does not
accept legal responsibility for the contents of this message.  Although the
Barclays Group operates anti-virus programmes, it does not accept responsibility
for any damage whatsoever that is caused by viruses being passed.  Any views or
opinions presented are solely those of the author and do not necessarily
represent those of the Barclays Group.  Replies to this email may be monitored
by the Barclays Group for operational or business reasons.

Barclays Capital is the investment banking division of Barclays Bank PLC, a
company registered in England (number 1026167) with its registered office at 1
Churchill Place, London, E14 5HP. This email may relate to or be sent from other
members of the Barclays Group.
------------------------------------------------------------------------

Luke Kanies

2007-Dec-11 16:34 UTC

head link

Re: Results from testing our manifests, functions and types against HEAD

On Dec 11, 2007, at 4:45 AM, <Derek.Whayman@barclayscapital.com>  
<Derek.Whayman@barclayscapital.com> wrote:
> Bit more progress, albeit mainly on the ticket logging front:
>
> #955 - install.rb fix for .py file
I''ll get this done today.
> newfile / watch_file - Already documented in http:// 
> reductivelabs.com/trac/puppet/wiki/WritingYourOwnFunctions (I must  
> have missed that)
>
> Custom types - Still a problem - logged #957
Should already be fixed.
> Custom fact - Yes it was also installed on the Puppetmaster;  
> resolved by moving my custom facts into $rubysitedir/facter -  
> logged #958
I''ll see if I can reproduce this.
> Autoresources - HELP! :)
I''ll get elaboration on IRC on this one; I don''t know what you
mean.

  --
  If there is anything the nonconformist hates worse than a conformist,
  it''s another nonconformist who doesn''t conform to the
prevailing
  standard of nonconformity.    --Bill Vaughan
  ---------------------------------------------------------------------
  Luke Kanies | http://reductivelabs.com | http://madstop.com

Luke Kanies

2007-Dec-11 22:28 UTC

head link

Re: Results from testing our manifests, functions and types against HEAD

On Dec 10, 2007, at 11:21 AM, <Derek.Whayman@barclayscapital.com>  
<Derek.Whayman@barclayscapital.com> wrote:
> Hi Luke and other people working on 0.24.  I hope this is  
> constructive.
>
> So, I have our configuration working against a checkout from git as of
> last night.
Hi Derek,

Sorry I hadn''t responded to the email in general, but you should be  
able to see that I''ve been following your tickets.

I much appreciate the work you put into testing this release, as you  
caught some important bugs.

Thanks,
Luke

  --
  When a man sits with a pretty girl for an hour, it seems like a
  minute.  But let him sit on a hot stove for a minute, and it''s longer
  than any hour.  That''s relativity.   --Albert Einstein
  ---------------------------------------------------------------------
  Luke Kanies | http://reductivelabs.com | http://madstop.com

Possibly Parallel Threads

Search for more apparently analagous threads

Puppet users - Dec 2007 - Results from testing our manifests, functions and types against HEAD

Results from testing our manifests, functions and types against HEAD

Re: Results from testing our manifests, functions and types against HEAD

Re: Results from testing our manifests, functions and types against HEAD

Re: Results from testing our manifests, functions and types against HEAD

Re: Results from testing our manifests, functions and types against HEAD

Possibly Parallel Threads