similar to: Scalability plans: Abstract out filesystem and make it someone else's problem

Displaying 20 results from an estimated 10000 matches similar to: "Scalability plans: Abstract out filesystem and make it someone else's problem"

2009 Oct 27
7
LVM+Xen+FreeNAS possible?
Hi All, We''ve limitation of 500 GB per server as per ServerLoft. we are needing to store word/pdf files. We are planning to use following setup. /dev/sda1 - boot - ext2 /dev/sda2 - swap /dev/sda3 - dom0 - ext3 /dev/sda4 - LVM - one LV for each domU, We''re planning 3 DomUs. /dev/sda5 - FreeNAS. Is that possible? Can it be in one of the LVs under 4th partition? Currently, one
2011 Jan 04
16
[PATCH v2 0/5] add new ioctls to do metadata readahead in btrfs
Hi, We have file readahead to do asyn file read, but has no metadata readahead. For a list of files, their metadata is stored in fragmented disk space and metadata read is a sync operation, which impacts the efficiency of readahead much. The patches try to add meatadata readahead for btrfs. In btrfs, metadata is stored in btree_inode. Ideally, if we could hook the inode to a fd so we could use
2009 Aug 25
3
scalability and arhive ideas
Hi, I?m reading the past topics related to archive and scalability of dovecot, they are all very interesting. Here, I?m using two dovecot proxies in front of five storages pairs, and we split the domain?s accounts among those servers. So, we can share the i/o load and if one server goes down only few accounts of the domain stops (not all of them). But, we began to have space problems - and the
2006 Apr 01
7
Rails Cluster Design
Hello everyone! A collegue and I are beginning development on a site that will eventually need to very scalable (assuming our business model is a good idea). My problem is that I''m not a sysadmin guru, and I''m not terribly comfortable with the design of the hosting platform. We''re going to start with two servers initially (for cost reasons), and I''m considering
2010 Mar 12
1
nosql (it was mogilefs)
Yes, I?ve read these doc. I was just considering if someone had any experience with Mogile in email environment. Well, actually I?m trying to figure out if one of those nosql systems can store and scale email systems (ie, mailboxes - instead of maildir). I know mysql is always quoted as an option and discussed sometimes in the list. I think it?s an unnecessary overhead and bottleneck. As
2012 Mar 23
1
Dovecot and scalable database storage
I saw some interesting mails from TImo back in 2009 talking about the idea of using something like Cassandra db or similar as a storage platform for both email and index/logs. I was wondering if this has been discussed since then, and if there are any plans to support something like this in the future? I have been playing with Cassandra and found that their RackAwareStrategy gives you the
2009 Nov 06
4
Hadoop Cluster on Xen
Hi all, Has anyone created a Xen cluster to run a hadoop vm cluster? I would be interested in how it performs Thanks Lance -- This message has been scanned for viruses and dangerous content by MailScanner, and is believed to be clean. _______________________________________________ Xen-users mailing list Xen-users@lists.xensource.com http://lists.xensource.com/xen-users
2006 Nov 02
8
MogileFS handler
Hello, I''ve been using NFS for sharing files across a cluster of servers but I''ve had a lot of problems with that. I''m planning to move to MogileFS which seems to be more stable and more adapted to this usage (lots of user uploaded files). I wonder if someone has already worked on an integration of MogileFS into Mongrel (and Rails app) for serving the files ? If not, I
2006 Jul 17
3
ROR and MogileFS
I am an engg student looking for project related to ruby and MogileFS... Can anybody suggest me about - use of ruby and MogileFS in application developement regarding - 1.is it efficient enough? 2.any alternate solution available for this? 3.any improvements that are required in MogileFS ? 4.and should i go for it? thank you.. -- Posted via http://www.ruby-forum.com/.
2010 Mar 10
1
mogilefs
Hi list, Have you ever heard or tried mogilefs? (http://danga.com/mogilefs/) Do you think suitable for dovecot/mail environments ? Regards, Fernando
2010 Aug 16
3
R with CouchDB?
Hello all, I'm kind of surprised that searching the archives and Googling haven't given me a result for this... I've got a large amount of data that is a good fit for CouchDB; it's reasonably unstructured, and such structure that exists is quite fluid. I want to slice the data in many different ways, some of which really don't fit well with a relational database model. I
2015 Mar 08
2
Xapian with Couchdb
Hi, I?m looking for how to integrate couchdb with xapian. Couchdb has a elasticsearch plugin, but i didn?t find anything about xapian. How is the best way to do it ? There some tips / tricks about xapian and couchdb ? Best Regards ! Carlos Brazil.
2011 Dec 06
3
Riak on Camping
Good day, does anyone here have a clue on how to make use of the NoSQL database "Riak" with Camping? I am building my website and Riak seems like pretty much the ultimate database! This would probably ruin every little feature in ActiveRecord, I don''t think I''d be able to do any has_many''s or belongs_to but I''d LOVE to be proven wrong. As far as
2010 May 07
3
Virtualization vs. Cassandra and Hadloop
Please check out this PNG image from attachment or from Google docs: http://docs.google.com/drawings/pub?id=1P3jdSddseG1oSYrtjREWcajizxmxoRIhUHCEw4sDi3k&w=771&h=624So, what I want to do is something like a private cloud storage solution.I belive the http servers and application servers should be set up on virtual VMs, but what about the Cassandra and Hadloop servers, should their be set up
2015 Apr 19
4
bash script fails conditional test
Hey all, I wrote a very basic script to determine if cassandra db is running. I'm setting a variable called 'pid' to the output of a ps | grep like to grab the pid of the cassandra process. #!/bin/bash pid=$(ps -ef | grep cassandra | grep -v grep | grep -i -v -e grep -e screen -e s3fs|awk '{print $2}') if [[ -e $pid ]] then echo "Cassandra is running with pid:
2015 Apr 20
4
bash script fails conditional test
> > "-e" means "if file exists". You should use "-n" That did it!! [root at web1:~] #./bin/check-cass.sh Cassandra is running with pid: 26979 This is what the script looks like now: #!/bin/bash pid=$(ps -ef | grep cassandra | grep -v grep | grep -i -v -e grep -e screen -e s3fs|awk '{print $2}') if [[ -n $pid ]] then echo "Cassandra is
2010 Feb 12
2
scalability
Hi Folks, How scalable is dovecot. Do you think a machine with a dual core 2.8Ghz processor and 2GB of RAM would do a business with 600 users? This server will have a 100Mbps link to the net, however it will be access by the business using a couple of ADSL lines (Roughly 7Mbps each). This machine will also be running Postfix Your help is appreciated Cheers Jonny
2013 Feb 16
3
cheap cloud providors
Hey guys, Apologies in advance if this question is in poor taste. But I've really fallen in love with learning about the cassanrdra database. The only problem is that it doesn't run very well on an t1.micro instance at amazon and the larger sizes are quite expensive. An m1.small can do the trick, while still not optimal. So I was wonder if there was any real value in the cloud or even
2003 Apr 03
2
'df' command says partition is full, when it isn't (can't create files, etc)
I am working with ext3 w/ the 2.4.20 kernel. I recently had a case where my root partition indicated that is was 100% full. I was unable to create new files, etc on the system. However, when I issued the 'du' command, the system indicated that only 2G of the 5G drive was in usage. I did a dump of the FS and I see were there is an indication of no free blocks. I decided to reboot
2012 Sep 25
1
mapping data from table to .csv template
I have a .csv table named mailing.csv as below. It consist a receiver, subject and sender. Receiver subject sender 1 Adrian Cole RE: [WHIRR-117] Composable services Tom White 2 Adrian Cole RE: [WHIRR-117] Composable services Tom White 3 Adrian Cole RE: [WHIRR-117] Composable services Adrian Cole 4 Adrian Cole RE: [WHIRR-117]