samba - Nov 2015 - Increasing database size limit

Hi Volker,

First I apologize for very late reply. I did tests in the meantime...

Trust relationships are the option we keep in mind. As trusts are for now
bidirectional-full-trust they give us possibility to increase domain size.
If we have to split our domain we will split in one domain for users and
another for computers (meaning users' MS Windows computers as they need to
be included into AD, which is not the case for UNIX/Linux boxes, and
because MS Windows clients are almost as numerous as users).

The others choices are to have users + computers in same domain, with
several domains. This implies we reproduce management processes on each
domain.
Having one domain for users and another for computers we won't have to
reproduce processes. Of course processes to manage computers and users
should be quiet similar so somewhere we will have to reproduce these
processes, but it seems to me (I can be wrong ;) that would generate less
work during run...
Another good point is once we don't need any more trust relationships we
could move users from their domain to computers' domain almost
automagically.
Having computers spread on several domain means to remove these computers
from their domain then integrate them in the one chosen as main domain when
we'll aggregate them to remove trust relationship(s).

In parallel Oliver Liebel tells around 2 months ago he'll be able to find
funds to develop LMDB backend (in some mail with title "s4 ldb tdb
limits")
which could solve the DB size limitation. And the company I'm working for
is still discussing internally (without me :p) about investing for same
development (and others).

That's where are my thoughts regarding scaling this domain... Critics are
welcome :)

Cheers,

mathias


2015-06-11 13:22 GMT+02:00 Volker Lendecke <Volker.Lendecke at sernet.de>:
> On Thu, Jun 11, 2015 at 11:03:08AM +0200, mathias dufresne wrote:
> > Hi all,
> >
> > Would it be really complex to add some code to have more database
files?
>
> Would trusts help you? Individual domains could become
> smaller.
>
> Volker
>
> --
> SerNet GmbH, Bahnhofsallee 1b, 37081 Göttingen
> phone: +49-551-370000-0, fax: +49-551-370000-9
> AG Göttingen, HRB 2816, GF: Dr. Johannes Loxen
> http://www.sernet.de, mailto:kontakt at sernet.de
>

On Thursday 19 November 2015 10:17:24 mathias dufresne
wrote:
> Hi Volker,
Hi Mathias,
> In parallel Oliver Liebel tells around 2 months ago he'll be able to
find
> funds to develop LMDB backend (in some mail with title "s4 ldb tdb
limits")
> which could solve the DB size limitation. And the company I'm working
for
> is still discussing internally (without me :p) about investing for same
> development (and others).
you should take a look at the talk Nadya gave at SambaXP 2014:

http://www.sambaxp.org/archive_data/SambaXP2014-DATA/thu/track1/Nadezhd_Ivanova-Samba4withOpenLDAPBackend-It_sAlive.pdf
http://www.sambaxp.org/archive_data/SambaXP2014-AUDIO/thu/track1/sambaxp2014-thu-track1-Nadezhda_Ivanova-Samba4withOpenLDAPBackend_-_It_s_Alive.mp3

Cheers,


	-- andreas

-- 
Andreas Schneider                   GPG-ID: CC014E3D
Samba Team                             asn at samba.org
www.samba.org

Jakub's approach is different that ours, we are rewriting the better 
part of the ldb stack into OpenLDAP, so he should be done faster. Even 
if it does not solve all the performance issues, an ldb_mdb backend will 
still be very useful - kudos Jakub for undertaking this.

As for mdb indexing - I haven't "been" in that part of the code
yet and
unfortunately cannot give a meaningful advice. If something is 
happening, it is somewhere in the servers/slapd/back_mdb :).


On 11/19/2015 06:20 PM, Andreas Schneider wrote:
> On Thursday 19 November 2015 10:17:24 mathias dufresne wrote:
>> Hi Volker,
> Hi Mathias,
>
>> In parallel Oliver Liebel tells around 2 months ago he'll be able
to find
>> funds to develop LMDB backend (in some mail with title "s4 ldb tdb
limits")
>> which could solve the DB size limitation. And the company I'm
working for
>> is still discussing internally (without me :p) about investing for same
>> development (and others).
> you should take a look at the talk Nadya gave at SambaXP 2014:
>
>
http://www.sambaxp.org/archive_data/SambaXP2014-DATA/thu/track1/Nadezhd_Ivanova-Samba4withOpenLDAPBackend-It_sAlive.pdf
>
http://www.sambaxp.org/archive_data/SambaXP2014-AUDIO/thu/track1/sambaxp2014-thu-track1-Nadezhda_Ivanova-Samba4withOpenLDAPBackend_-_It_s_Alive.mp3
>
> Cheers,
>
>
> 	-- andreas
>