similar to: Tuning for large number of directory entries?

I work with a MySQL installation containing several thousand databases. MySQL represents each database as a seperate sub-directory of the main MySQL data directory. As the number of databases increases it seems that the time to connect is increasing significantly and I believe this is probably due to the time necessary to search through the large number of directory entries. It has been

Greetings Everyone, A group in my office is designing/integrating what I would loosly label as an "embedded system". In that, it performs a dedicated task and is not a general purpose workstation or server. It operates in a harsh environment, particularly a questionable power environment and they are extremely concerned about inadvertent shutdown and recovery. They were totally

I decided that I would try out 2.5.44, and I noticed that htree was merged. If I don't do the tune2fs -O dir_index, and e2fsck -D, the (exisintg) fs won't use htree, right? Once I do the tune2fs and e2fsck, will I still be able to go back to a non-htree kernel if needed? (Will a htree-ized fs work on a non-htree kernel?) I'm guessing that it won't. I've seen a 2.4 htree

Apologies for the newbie question: I have a (stock) 2.4.20 build (*not* -ac), and I'm trying to work with large ext3 directories. By large, I mean 160,000 files per directory. (Yes, I know it would be better in nested directories but such is life). I feel htree would benefit me. Having upgraded from an earlier version of 2.4, I don't see any change, and close reading of the 2.4 changelog

Guys, I have recently applied the latest 2.4 htree patch on a heavily loaded nfs server. The nfs server serves around four very busy clients that deliver email in maildir format and pop3/imap clients. Being maildir I presumed that the htree patch would improve performance - but I was wrong. Load on the server went up by around 25-40%. After 3-4 hours of heavy use the clients load went up to

Apologies for the newbie question: I have a (stock) 2.4.20 build (*not* -ac), and I'm trying to work with large ext3 directories. By large, I mean 160,000 files per directory. (Yes, I know it would be better in nested directories but such is life). I feel htree would benefit me. Close reading of the 2.4 changelog suggests that htree isn't in there - only a patch to prevent non-htree

Well here is what I got from testing htree with NFS. http://labs.zianet.com/benchmarks_html/postmark_benchmarks_NFS_100_htree.html It looks like htree improves performance when the storage device is local(as per my previous post) but it looks like htree degrades performance when used in conjunction with NFS. I am going to try it with gigabit ethernet when I get the time to see if maybe I am

I've backported all of the bugfixes to the 2.5 dxdir/htree patches to 2.4, and have created a new set of patches for Linux 2.4.21rc5. At this point it *looks* like we've fixed all of the htree bugs that people have reported, including the brelse bug, the memory leak bugs, and the NFS compatibility problems. I've done *very* light testing, and things seem to work, but I'm now

hi, i have a tricky situation here and and don't know where to start with the solution. i happened to set up a linux system, but i had to install the base system on another machine. i used e2fsprogs 1.30-WIP (30-Sep-2002) for this. now the machine is up and running, but i have to use e2fsprogs 1.27 (8-Mar-2002). it's a debian system and i wanted to stay sane & stable, hence using

Hello, Could someone create some newer htree patches for the 2.4.x kernel? There are some bug fixes in the 2.4.21-rc releases that would be nice to have but the htree patches preceed those and they won't apply cleanly to later pre/rc kernels. It sounds like Marcelo may be about ready to put out 2.4.21 so it may just be worth holding off until that happens, but I don't suspect much will

-----BEGIN PGP SIGNED MESSAGE----- Hash: SHA1 Hi, I'm trying to install the htree indexed directory patch to my RedHat kernel-source-2.4.18-10, but it seems that doesn't go. First I tried the ext3 patch (I have sent some emails to this list telling the problems I had with it). Now I have just test the ext2 patch. I get it from: http://people.nl.linux.org/~phillips/htree/htree-2.4.18-2

There's a new set of ext2/3 patches for 2.4.21-pre5 available at: http://thunk.org/tytso/linux/extfs-2.4-update/extfs-update-2.4.21pre5-2 and in broken out form at: http://thunk.org/tytso/linux/extfs-2.4-update/broken-out-2.4.21pre5-2 New to this patch set include: * A kludge to help htree work well with Linux's NFS implementation * Allow the orlov allocator to be disabled via a

I have just been thru rebuilding a server that had been suffering severe performance problems. I transferred the partitions to another hard drive, copying into freshly formatted filesystems. This made a HUGE difference in performance. One key directory structure stores email messages in an structure where there is a directory for each mail account, and the messages are stored in

Hi, Just thought I'd share some test results of mine in case anyone is interested. Basically the tests are siumulating what our product does with files - although the tests do it a lot quicker (not as many files though). The test is to create 1 million files (each containing the text of the file number) spread over a number of directories. The files are then removed in the same manner as

I've been attempting to get to get Shared Folders and ACL's to work under dovecot 1.0rc17. Unfortunately, I've run into some problems (many have already been mentioned on the list), specifically the problem where folder-specific ACL files are not found (and I will not use Global ACL's due to the 100% probability of cross-namespace mailbox name conflicts). My namespace

Hello, I am using kernel version 2.4.7-10 I upgraded one of the ext2 partition to ext3. the partitions are nearly empty. I ran a program to create empty files, having names in lexicographical order. The time taken to create empty files (100 .. 100000) is same on an ext2 partition and a ext3 partition. Can anyone pls. tell me why there is no difference in the time taken. Is the htree algo.

Hi Guys, I am planning on upgrading an existing NFS exported filesystem to the ext3 htree patch on kernel v2.4.23. Will the patch index directories automatically after tune2fs -O dir_index or should I do an e2fsck -Dfy on the filesystem before remounting?

My reading of the kernel.src.rpm doesn't indicate that Severn has ext3 htree patches. Stephen, were there any issues seen during Cerberus testing ? Regards, Yusuf -- Yusuf Goolamabbas yusufg@outblaze.com

Hi, Someone knows if the htree patch is applied in the last kernel for RedHat 8 (kernel-2.4.20-18.8) for the ext2/ext3 filesystems ? Greetings. --- Carles Xavier Munyoz Baldó carles@unlimitedmail.org http://www.unlimitedmail.net/ ---

Just looking through the 2.4.20pre changelogs, I see there's been a bunch of Ext3 patches since 2.4.19. I'm keen to take advantage of any bug fixes and performance improvements, but am nervous about using 2.4.20 until it's completed its release cycle. Is there any way to get a patch just containing the Ext3 changes? Are there any changes since 2.4.20 that are very important, either