Was file bucketing changed as part of this release or is this a bug? When I look in my bucket folder I see: drwxr-xr-x 2 puppet puppet 4096 Mar 17 00:04 5222e054e7bc6248f2e9b9146f75aff5 drwxr-xr-x 2 puppet puppet 4096 Mar 17 00:04 3255ad7efedebfd3eccbba74845002a1 drwxr-xr-x 2 puppet puppet 4096 Mar 17 00:04 f8569b1c57819072c37b36bd3814e328 drwxr-xr-x 2 puppet puppet 4096 Mar 19 14:39 01b92a8a02757669008eebc318afcf41 drwxr-xr-x 2 puppet puppet 4096 Mar 19 14:39 985ab21fa7c9f9a900d3373e04b2f3bf drwxr-xr-x 2 puppet puppet 4096 Mar 20 16:41 863d1ebe1c372f3f222e212fba99cc02 drwxr-xr-x 2 puppet puppet 4096 Mar 20 16:56 6dc087b0005a0cc8321ad3e7a3f51b9b drwxr-xr-x 2 puppet puppet 4096 Mar 20 17:12 e7b4b550c232416265100cb54afe189a drwxrwx--- 3 puppet puppet 4096 Mar 21 14:01 b drwxrwx--- 3 puppet puppet 4096 Mar 21 14:06 2 drwxrwx--- 3 puppet puppet 4096 Mar 21 16:33 1 drwxrwx--- 5 puppet puppet 4096 Mar 21 16:33 4 drwxrwx--- 6 puppet puppet 4096 Mar 21 16:38 f drwxrwx--- 4 puppet puppet 4096 Mar 22 14:54 c drwxrwx--- 6 puppet puppet 4096 Mar 22 15:31 7 drwxrwx--- 4 puppet puppet 4096 Mar 22 15:55 5 drwxrwx--- 3 puppet puppet 4096 Mar 22 16:05 6 You can guess from that when I upgraded to puppetmaster 0.22.2. :)
On Mar 22, 2007, at 7:33 PM, Digant C Kasundra wrote:> drwxr-xr-x 2 puppet puppet 4096 Mar 20 17:12 > e7b4b550c232416265100cb54afe189a > drwxrwx--- 3 puppet puppet 4096 Mar 21 14:01 b > drwxrwx--- 3 puppet puppet 4096 Mar 21 14:06 2 > drwxrwx--- 3 puppet puppet 4096 Mar 21 16:33 1 > drwxrwx--- 5 puppet puppet 4096 Mar 21 16:33 4 > drwxrwx--- 6 puppet puppet 4096 Mar 21 16:38 f > drwxrwx--- 4 puppet puppet 4096 Mar 22 14:54 c > drwxrwx--- 6 puppet puppet 4096 Mar 22 15:31 7 > drwxrwx--- 4 puppet puppet 4096 Mar 22 15:55 5 > drwxrwx--- 3 puppet puppet 4096 Mar 22 16:05 6 > > You can guess from that when I upgraded to puppetmaster 0.22.2. :)Yeah, filebuckets now store in nested directories, because otherwise you''d end up with thousands of files in the same directory. I''ll prioritize getting my stand-alone filebucket client out; it''ll just be a simple tool to retrieve a file from a filebucket by name, and (like puppetrun) will likely not immediately get shipped as part of packages but will work just fine as a download. -- Do not think of knocking out another person''s brains because he differs in opinion from you. It would be as rational to knock yourself on the head because you differ from yourself ten years ago. -- Horace Mann --------------------------------------------------------------------- Luke Kanies | http://reductivelabs.com | http://madstop.com
> I''ll prioritize getting my stand-alone filebucket client out; it''ll > just be a simple tool to retrieve a file from a filebucket by name, > and (like puppetrun) will likely not immediately get shipped as part > of packages but will work just fine as a download.Couldn''t you have changed file bucketing AFTER the stand-alone filebucket client was out? :-P
On Mar 23, 2007, at 3:53 PM, Digant C Kasundra wrote:> > Couldn''t you have changed file bucketing AFTER the stand-alone > filebucket > client was out? :-PSorry; should have released both at the same time. There is now a ''filebucket'' script available in svn; it''ll be up to the packagers to get it into the packages. Unfortunately, in the process of writing this, I realized I made a stupid mistake in setting up nested paths in the filebucket: I was only using the first 8 chars of the md5 sum, not the whole thing (e.g., a file would be in a/b/c/d/e/f/g/h/contents, rather than /a/b/ c/d/e/f/g/<md5>/contents). That''s now fixed, but until I release that (probably in the next couple of days), there''s a chance of conflicts in the filebuckets. -- Chase after truth like hell and you''ll free yourself, even though you never touch its coat-tails. -- Clarence Darrow --------------------------------------------------------------------- Luke Kanies | http://reductivelabs.com | http://madstop.com
On Mar 24, 2007, at 5:28 PM, Luke Kanies wrote:> Sorry; should have released both at the same time. > > There is now a ''filebucket'' script available in svn; it''ll be up to > the packagers to get it into the packages. > > Unfortunately, in the process of writing this, I realized I made a > stupid mistake in setting up nested paths in the filebucket: I was > only using the first 8 chars of the md5 sum, not the whole thing > (e.g., a file would be in a/b/c/d/e/f/g/h/contents, rather than /a/b/ > c/d/e/f/g/<md5>/contents). > > That''s now fixed, but until I release that (probably in the next > couple of days), there''s a chance of conflicts in the filebuckets.I''m curious why (in particular) this was viewed as a mistake. Obviously there''s efficiency to be gained from sizing your hash tree properly...
On Mar 30, 2007, at 9:35 AM, Benjamin C. Kite wrote:> > On Mar 24, 2007, at 5:28 PM, Luke Kanies wrote: > >> Sorry; should have released both at the same time. >> >> There is now a ''filebucket'' script available in svn; it''ll be up to >> the packagers to get it into the packages. >> >> Unfortunately, in the process of writing this, I realized I made a >> stupid mistake in setting up nested paths in the filebucket: I was >> only using the first 8 chars of the md5 sum, not the whole thing >> (e.g., a file would be in a/b/c/d/e/f/g/h/contents, rather than /a/b/ >> c/d/e/f/g/<md5>/contents). >> >> That''s now fixed, but until I release that (probably in the next >> couple of days), there''s a chance of conflicts in the filebuckets. > > I''m curious why (in particular) this was viewed as a mistake. > > Obviously there''s efficiency to be gained from sizing your hash tree > properly...Sorry; my examples weren''t the same length, but that wasn''t really the problem: The problem was the first example did not include full md5 sum, and the second did. Collision likelihood for the full md5 is darn-near impossible, but if you only include the first 8 characters of the sum, suddenly it becomes a lot more likely. -- Talent hits a target no one else can hit; Genius hits a target no one else can see. -- Arthur Schopenhauer --------------------------------------------------------------------- Luke Kanies | http://reductivelabs.com | http://madstop.com