search for: glasspostlist

Displaying 2 results from an estimated 2 matches for "glasspostlist".

2020 Aug 23
2
MultiDatabase shard count limitations
...libpthread-2.28.so [.] __libc_pread64 2.27% script/public-i [unknown] [k] 0xffffffff81800000 2.18% /mnt/btr/public perl [.] Perl_yyparse 2.11% /mnt/btr/public perl [.] Perl_yylex 1.92% script/public-i libxapian.so.30.8.0 [.] GlassPostList::move_forward_in_chunk_to_at_least 1.76% script/public-i libxapian.so.30.8.0 [.] GlassPostListTable::get_freqs 1.71% script/public-i libxapian.so.30.8.0 [.] GlassTable::find_in_leaf 1.62% script/public-i libxapian.so.30.8.0 [.] Xapian::BM25Weight::get_maxpart 1.55% scr...
2020 Aug 21
2
MultiDatabase shard count limitations
Going back to the "prioritizing aggregated DBs" thread from February 2020, I've got 390 Xapian shards for 130 public inboxes I want to search against(*). There's more on the horizon (we're expecting tens of thousands of public inboxes). After bumping RLIMIT_NOFILE and running ->add_database a bunch, the actual queries seem to be taking ~30s (not good :x). Now I'm