Hi all, Still playing with a big database (120k users, 150k computers) I tried to split my users into a lot of OUs. This increased the database size and I was not able to finish to add users into the DB because database file has reached 4GB size which seems to be the limit. First: am I right to say file /var/lib/samba/private/sam.ldb.d/DC=example,DC=com.ldb has a maximum size of 4GB? Secondly: if I'm right about the size limit, why this size limit? Best regards, mathias
Am 01.06.2015 um 14:09 schrieb mathias dufresne:> Still playing with a big database (120k users, 150k computers) I tried to > split my users into a lot of OUs. This increased the database size and I > was not able to finish to add users into the DB because database file has > reached 4GB size which seems to be the limit. > > First: am I right to say file > /var/lib/samba/private/sam.ldb.d/DC=example,DC=com.ldb has a maximum size > of 4GB? > > Secondly: if I'm right about the size limit, why this size limit?because nobody expects such setups on 32bit? http://en.wikipedia.org/wiki/Large_file_support -------------- next part -------------- A non-text attachment was scrubbed... Name: signature.asc Type: application/pgp-signature Size: 181 bytes Desc: OpenPGP digital signature URL: <http://lists.samba.org/pipermail/samba/attachments/20150601/f421251e/attachment.pgp>
Sorry I don't understand you answer. For me 32 bits platforms are dead on server side. So nobody would set up a new AD using Samba 4 above a 32 bits system. 2015-06-01 14:34 GMT+02:00 Reindl Harald <h.reindl at thelounge.net>:> > Am 01.06.2015 um 14:09 schrieb mathias dufresne: > >> Still playing with a big database (120k users, 150k computers) I tried to >> split my users into a lot of OUs. This increased the database size and I >> was not able to finish to add users into the DB because database file has >> reached 4GB size which seems to be the limit. >> >> First: am I right to say file >> /var/lib/samba/private/sam.ldb.d/DC=example,DC=com.ldb has a maximum size >> of 4GB? >> >> Secondly: if I'm right about the size limit, why this size limit? >> > > because nobody expects such setups on 32bit? > http://en.wikipedia.org/wiki/Large_file_support > > > -- > To unsubscribe from this list go to the following URL and read the > instructions: https://lists.samba.org/mailman/options/samba >
On Mon, Jun 01, 2015 at 02:09:13PM +0200, mathias dufresne wrote:> Hi all, > > Still playing with a big database (120k users, 150k computers) I tried to > split my users into a lot of OUs. This increased the database size and I > was not able to finish to add users into the DB because database file has > reached 4GB size which seems to be the limit. > > First: am I right to say file > /var/lib/samba/private/sam.ldb.d/DC=example,DC=com.ldb has a maximum size > of 4GB?Yes, you are right.> Secondly: if I'm right about the size limit, why this size limit?History, and so far nobody was really limited by this. Before we expand tdb to 64 bits, you might want to talk to Jakub Hrozek from RedHat and ask about his work on LMDB as a ldb backend. With best regards, Volker Lendecke -- SerNet GmbH, Bahnhofsallee 1b, 37081 G?ttingen phone: +49-551-370000-0, fax: +49-551-370000-9 AG G?ttingen, HRB 2816, GF: Dr. Johannes Loxen http://www.sernet.de, mailto:kontakt at sernet.de
On 06/01/2015 05:09 AM, mathias dufresne wrote:> Hi all, > > Still playing with a big database (120k users, 150k computers) I tried to > split my users into a lot of OUs. This increased the database size and I > was not able to finish to add users into the DB because database file has > reached 4GB size which seems to be the limit. > > First: am I right to say file > /var/lib/samba/private/sam.ldb.d/DC=example,DC=com.ldb has a maximum size > of 4GB?You are right.> Secondly: if I'm right about the size limit, why this size limit?TDB is still using 32bits structures, we had a project called NTDB that was copping with this issue and other issues we had in TDB as we found other way to solve the TDB issues (but the size) we have dropped the work on NTDB as there was some issues on how to manage the migration. In order to compact your database you might want to dump it to a file: tdbdump <file.ldb> > dump_sam.ldb and then restore it to a *new* ldb and see if it improves the size. You should also check if you have any deleted object by doing a ldbsearch with isDeleted=*, and purge all the deleted objects (but the deleted object container). -- Matthieu Patou Samba Team http://samba.org
Thank you all for these detailed answers. This size happened on DC where the import were done. Database with Samba 4 was always significantly bigger on this host than on the replicated ones. According to that I'll try the dump trick which would also teach me some things : ) I'll came back after tests... For LMDB the start seems to be there: https://jhrozek.fedorapeople.org/sambaxp I'll read and try if I can (ie if I'm not too thick :p) Cheers, mathias 2015-06-01 22:06 GMT+02:00 Matthieu Patou <mat at samba.org>:> On 06/01/2015 05:09 AM, mathias dufresne wrote: > >> Hi all, >> >> Still playing with a big database (120k users, 150k computers) I tried to >> split my users into a lot of OUs. This increased the database size and I >> was not able to finish to add users into the DB because database file has >> reached 4GB size which seems to be the limit. >> >> First: am I right to say file >> /var/lib/samba/private/sam.ldb.d/DC=example,DC=com.ldb has a maximum size >> of 4GB? >> > You are right. > >> Secondly: if I'm right about the size limit, why this size limit? >> > TDB is still using 32bits structures, we had a project called NTDB that > was copping with this issue and other issues we had in TDB as we found > other way to solve the TDB issues (but the size) we have dropped the work > on NTDB as there was some issues on how to manage the migration. > > In order to compact your database you might want to dump it to a file: > tdbdump <file.ldb> > dump_sam.ldb and then restore it to a *new* ldb and > see if it improves the size. > You should also check if you have any deleted object by doing a ldbsearch > with isDeleted=*, and purge all the deleted objects (but the deleted object > container). > > > -- > Matthieu Patou > Samba Team > http://samba.org > > -- > To unsubscribe from this list go to the following URL and read the > instructions: https://lists.samba.org/mailman/options/samba >