search for: hathitrust

...e user to remove any mails already deleted during the reindexing. - It seems that Solr index shouldn?t grow above 200 GB or the performance will be getting too bad? I?ve seen this in a few web pages. So each server should likely be running multiple separate Solr instances (shards). - http://www.hathitrust.org/blogs/large-scale-search/scaling-large-scale-search-from-500000-volumes-5-million-volumes-and-beyond recommends NFS (or I guess any kind of a shared filesystem), which does seem to make sense. Since Dovecot wants to get instantly updated search results after indexing, I think it?s probably bett...