Hello list I am currently doing some research on running xapian on Distributed File Sysyem(DFS), try to find some cheap solution to scale up the storage, and, without any luck... I am wondering anyone will give me some suggestions and point me to a better direction... Thank you Andrey K
On Mon, Jul 09, 2007 at 12:20:08PM -0700, Andrey wrote:> I am currently doing some research on running xapian on Distributed > File Sysyem(DFS), try to find some cheap solution to scale up the > storage, and, without any luck... > > I am wondering anyone will give me some suggestions and point me to > a better direction...Andrey - why are you looking into distributed file systems? That's a huge amount of infrastructure! What's your actual problem? How big a database are you looking to support? There's a point (although I'm not quite sure where it is) at which moving from (say) a linux clustering solution towards an enterprise box (or boxes) may turn out to be more cost effective. It's difficult to advise you without knowing what kind of scale and constraints you're working with. In general though, providing a file system has normal unix semantics, Xapian should run over it. For Xapian you'd probably want to cluster at the block level I suspect (ideally you probably want to cluster at the btree node level, but that's impractical :-). Olly or Richard may be able to advise further if you do need to go down this route. J -- /--------------------------------------------------------------------------\ James Aylett xapian.org james@tartarus.org uncertaintydivision.org
hi all, could ne one help me by telling me whether the following features are available in xapian.if possible with a link to the reference page in documentation... **Database querying through Z39.50, SOAP, JDBC and HTTP supported? Customized request to http server via http header? A http server to manage search requests? Cache to store previous results? A proxy to feed user-browsed pages directly into the process-buffer? A proxy pre-fetch mechanism? A caching http Proxy with additional function to filter out unwanted content.? Multidimensional index to store different features of 3d and 2d models? Buffer to store the documents or document locators? Extraction of information from the http header? Advance Search Option (User Interface)? Search interface to input sketches ? Saving common searches supported? Algorithm to select databases a user wishes to query?like a metasearche engine? Search for different image formats? API for image analysis, storage and format conversion? Multiple OS Support? Advanced search options, search by color, texture and shape?. Result page with title, date, file size, and url? Hit highlighting in search results ? http header request and response support? Inverted index? Local database for metadata storage and administration? A database consisting of several distributed hash tables? Document storage? Regards _________________________________________________________________ News, entertainment and everything you care about at Live.com. Get it now! http://www.live.com/getstarted.aspx