We are working on a project that requires replication of video archives across a gigE network. The application will provide storage for high definition video surveillance in the data center with replication of all information to a remote data center. The remote data center is accessible via gigE networks. We would like the cameras to send images across the gigE networks to replicated glusterFS servers. There will be constant writing of information. Has this application been explored with GlusterFS? Does anyone have any insight? Thanks, Wayne A. Green BlackBelt Technologies C: (334)233-3482 O: (205)989-0056 F: (251)217-9157
2008/11/9 Wayne A. Green <wgreen at bbtconsulting.com>:> We are working on a project that requires replication of video > archives across a gigE network. The application will provide storage > for high definition video surveillance in the data center with > replication of all information to a remote data center. The remote > data center is accessible via gigE networks. We would like the > cameras to send images across the gigE networks to replicated > glusterFS servers. There will be constant writing of > information. Has this application been explored with GlusterFS? Does > anyone have any insight?The AFR translator in GlusterFS is designed for this very purpose. When you use it, everything your applications write to files on the GlusterFS mountpoint will be replicated to a configurable number of remote servers.> Thanks, > Wayne A. GreenVikas Gorur -- Engineer - Z Research http://gluster.com/
2008/11/10 Vikas Gorur <vikas at zresearch.com>:> 2008/11/9 Wayne A. Green <wgreen at bbtconsulting.com>: > >> We are working on a project that requires replication of video >> archives across a gigE network. The application will provide storage >> for high definition video surveillance in the data center with >> replication of all information to a remote data center. The remote >> data center is accessible via gigE networks. We would like the >> cameras to send images across the gigE networks to replicated >> glusterFS servers. There will be constant writing of >> information. Has this application been explored with GlusterFS? Does >> anyone have any insight? > > The AFR translator in GlusterFS is designed for this very purpose. > When you use it, everything your applications write to files > on the GlusterFS mountpoint will be replicated to a configurable > number of remote servers.Beware that the network bandwidth might get divided between the connections to the servers. 8-) An extreme example: A client machine has one gigE connection to the network and uses client side AFR to replicate the data to 5 servers. The network connection of the client machine has to be shared by the 5 connections - limiting it to a theoretical 200Mbit/s maximum for each connection on write operations. Personally, I would not expect to get more than 15MB/s for big (exceeding client side cache size) write operations on that glusterfs volume because of protocol overhead. Someone who is used to measure 90+MB/s on connections to a single server (using NFS, CIFS or HTTP) might be surprised by that. I admit that this is an extreme example, YMMV.>> Thanks, >> Wayne A. Green > > Vikas Gorur > -- > Engineer - Z Research > http://gluster.com/Harald St?rzebecher
2008/11/10 Harald St?rzebecher <haralds at cs.tu-berlin.de>:> > Beware that the network bandwidth might get divided between the > connections to the servers. 8-) > > An extreme example: > A client machine has one gigE connection to the network and uses > client side AFR to replicate the data to 5 servers.This is a valid point. If you are concerned about the network being the bottleneck, you can configure AFR on the server side and use a separate gigE network for the replication. Vikas -- Engineer - Z Research http://gluster.com/
Any idea onb the write performance across the mountpoints... The clients will be a windows 2003 servers? Thanks, Wayne A. Green ----- Original Message ----- From: "Vikas Gorur" <vikas at zresearch.com> To: "Wayne A. Green" <wgreen at bbtconsulting.com> Cc: "Users Gluster" <gluster-users at gluster.org>, "cnelson" <cnelson at bbtconsulting.com> Sent: Monday, November 10, 2008 4:29:53 AM GMT -06:00 US/Canada Central Subject: Re: [Gluster-users] Video Surviellance Application 2008/11/9 Wayne A. Green <wgreen at bbtconsulting.com>:> We are working on a project that requires replication of video > archives across a gigE network. The application will provide storage > for high definition video surveillance in the data center with > replication of all information to a remote data center. The remote > data center is accessible via gigE networks. We would like the > cameras to send images across the gigE networks to replicated > glusterFS servers. There will be constant writing of > information. Has this application been explored with GlusterFS? Does > anyone have any insight?The AFR translator in GlusterFS is designed for this very purpose. When you use it, everything your applications write to files on the GlusterFS mountpoint will be replicated to a configurable number of remote servers.> Thanks, > Wayne A. GreenVikas Gorur -- Engineer - Z Research http://gluster.com/
Vikas Gorur wrote:> 2008/11/10 Harald St?rzebecher <haralds at cs.tu-berlin.de>: >> Beware that the network bandwidth might get divided between the >> connections to the servers. 8-) >> >> An extreme example: >> A client machine has one gigE connection to the network and uses >> client side AFR to replicate the data to 5 servers. > > This is a valid point. If you are concerned about the network being > the bottleneck, you can configure AFR on the server side and use a > separate gigE network for the replication.This is how we "solve" the bottleneck issue in our primary implementation of GlusterFS : two physical networks, one for normal traffic on eth0 (i.e. interaction with the web servers), and a second for storage traffic on eth1. Furthermore, we use server-side AFR, thus the clients never talk to each other (further reducing overhead). http://www.gluster.org/docs/index.php/High-availability_storage_using_server-side_AFR -- Daniel Maher <dma+gluster AT witbe DOT net>