Displaying 11 results from an estimated 11 matches for "densehash".
2019 Feb 25
4
Making LLD PDB generation faster
...056 - I had to revert it because it was causing
issues with LLDB. But it will give an improvement for LLD.
Please let me know if that improves your timings.
The page faults are probably the OS loading from disk: most, if not all the
files are accessed by LLD by mmap'ing them.
The lockless DenseHash I was talking about will be published in an upcoming
patch. As for reproducibility, this can be an issue on build systems. But on
local machines, we could explicitly state that we want non-deterministic
builds, through some cmd-line flag. If your 57sec for "Type Merging"
transforms in...
2019 Feb 24
2
Making LLD PDB generation faster
...s in parallel at link-time and merging Types with them
is less costly that the current approach to merging. The 35sec you’re seeing
for merging should go down to about 15sec. The patch doesn’t parallelize
(yet) the Type merging itself, but we have an alternate multithread-suitable
implementation of DenseHash which already supports lockless, wait-free,
insert/fetch/resize.
The prototype allows for testing different hashing algorithms, and indeed
xxHash seems to be the best general-purpose choice. I’ve also added support
for more specialized hardware-based hashes, like Casey Muratori’s Meow Hash
(uses h...
2019 Feb 25
2
Making LLD PDB generation faster
...e it was
> causing issues with LLDB. But it will give an improvement for LLD.
> Please let me know if that improves your timings.
>
> The page faults are probably the OS loading from disk: most, if not
> all the files are accessed by LLD by mmap'ing them.
>
> The lockless DenseHash I was talking about will be published in an
> upcoming patch. As for reproducibility, this can be an issue on build
> systems. But on local machines, we could explicitly state that we want
> non-deterministic builds, through some cmd-line flag. If your 57sec for "Type Merging"...
2019 Feb 25
3
Making LLD PDB generation faster
...with LLDB. But it will give an improvement for LLD.
> > Please let me know if that improves your timings.
> >
> > The page faults are probably the OS loading from disk: most, if not
> > all the files are accessed by LLD by mmap'ing them.
> >
> > The lockless DenseHash I was talking about will be published in an
> > upcoming patch. As for reproducibility, this can be an issue on
> > build systems. But on local machines, we could explicitly state that
> > we want non-deterministic builds, through some cmd-line flag. If your 57sec for "Typ...
2019 Feb 25
2
Making LLD PDB generation faster
...gt;> > > Please let me know if that improves your timings.
>> > >
>> > > The page faults are probably the OS loading from disk: most, if not
>> > > all the files are accessed by LLD by mmap'ing them.
>> > >
>> > > The lockless DenseHash I was talking about will be published in an
>> > > upcoming patch. As for reproducibility, this can be an issue on
>> > > build systems. But on local machines, we could explicitly state that
>> > > we want non-deterministic builds, through some cmd-line flag. If...
2019 Feb 25
5
Making LLD PDB generation faster
...let me know if that improves your timings.
> >> > >
> >> > > The page faults are probably the OS loading from disk: most, if not
> >> > > all the files are accessed by LLD by mmap'ing them.
> >> > >
> >> > > The lockless DenseHash I was talking about will be published in an
> >> > > upcoming patch. As for reproducibility, this can be an issue on
> >> > > build systems. But on local machines, we could explicitly state that
> >> > > we want non-deterministic builds, through some cmd...
2019 Feb 25
2
Making LLD PDB generation faster
...gt;> > > Please let me know if that improves your timings.
>> > >
>> > > The page faults are probably the OS loading from disk: most, if not
>> > > all the files are accessed by LLD by mmap'ing them.
>> > >
>> > > The lockless DenseHash I was talking about will be published in an
>> > > upcoming patch. As for reproducibility, this can be an issue on
>> > > build systems. But on local machines, we could explicitly state that
>> > > we want non-deterministic builds, through some cmd-line flag. If...
2019 Feb 25
2
Making LLD PDB generation faster
...ves your timings.
> > >> > >
> > >> > > The page faults are probably the OS loading from disk: most, if
> > >> > > not all the files are accessed by LLD by mmap'ing them.
> > >> > >
> > >> > > The lockless DenseHash I was talking about will be published in
> > >> > > an upcoming patch. As for reproducibility, this can be an issue
> > >> > > on build systems. But on local machines, we could explicitly
> > >> > > state that we want non-deterministic builds, t...
2019 Feb 27
4
Making LLD PDB generation faster
...;
> > > > >> > > The page faults are probably the OS loading from disk: most,
> if
> > > > >> > > not all the files are accessed by LLD by mmap'ing them.
> > > > >> > >
> > > > >> > > The lockless DenseHash I was talking about will be published
> in
> > > > >> > > an upcoming patch. As for reproducibility, this can be an
> issue
> > > > >> > > on build systems. But on local machines, we could explicitly
> > > > >> > > state...
2019 Feb 28
3
Making LLD PDB generation faster
...t; > >> > >
> > > >> > > The page faults are probably the OS loading from disk: most, if
> > > >> > > not all the files are accessed by LLD by mmap'ing them.
> > > >> > >
> > > >> > > The lockless DenseHash I was talking about will be published in
> > > >> > > an upcoming patch. As for reproducibility, this can be an issue
> > > >> > > on build systems. But on local machines, we could explicitly
> > > >> > > state that we want non-determin...
2019 Feb 23
2
Making LLD PDB generation faster
Hi,
Is anyone working on making the PDB generation on LLD faster? Looking
of a trace for linking one of our binaries (it takes 1min6s-1min20s) I
see two things:
1) LookupBucketFor(Val, ConstFoundBucket); takes 35s so almost half of
the time of linking, mostly finding duplicates
2) There is no parallelization inside of addObjectsToPDB
Is anyone working on those? Also has anyone thought about