Dear all, I've 4 servers with 2 TB HD each. I've configured gluster to distribute data between 2 and replicate 2, example: storage01 ---[distribution]---> storage03 storage01 ---[replication]---> storage02 storage03 ---[replication]---> storage04 And everything is working perfectly fine for more than one month. But currently I'm facing a problem when I tried to install Alfresco DMS ( http://www.alfresco.com/). Alfresco is a java-based Document Management System (running over tomcat). When I installed it in the local filesystem, it works fine. It also work great if I install it in an NFS share. But when I install it in the glusterfs, it just don't work and the log file show a lot of exceptions talking about IO, NIO. I need help to fix this, because the main use of glusterFS was to use Alfresco. (The company has huge amount of documents that need to be archived). Note: I've attached the server/client configuration files. Thanks & Regards, -------------- next part -------------- volume posix type storage/posix option directory /storage end-volume volume locks type features/locks subvolumes posix end-volume volume brick type performance/io-threads option thread-count 8 subvolumes locks end-volume volume server type protocol/server option transport-type tcp option auth.addr.brick.allow 192.168.1.* subvolumes brick end-volume -------------- next part -------------- volume remote1 type protocol/client option transport-type tcp option remote-host storage01 option remote-subvolume brick end-volume volume remote2 type protocol/client option transport-type tcp option remote-host storage02 option remote-subvolume brick end-volume volume remote3 type protocol/client option transport-type tcp option remote-host storage03 option remote-subvolume brick end-volume volume remote4 type protocol/client option transport-type tcp option remote-host storage04 option remote-subvolume brick end-volume volume replicate1 type cluster/replicate subvolumes remote1 remote2 end-volume volume replicate2 type cluster/replicate subvolumes remote3 remote4 end-volume volume distribute type cluster/distribute subvolumes replicate1 replicate2 end-volume volume writebehind type performance/write-behind option window-size 1MB subvolumes distribute end-volume volume cache type performance/io-cache option cache-size 512MB subvolumes writebehind end-volume
Muslim wrote:> > I've 4 servers with 2 TB HD each. I've configured gluster to distribute > data between 2 and replicate 2, example:<snip>> And everything is working perfectly fine for more than one month. But > currently I'm facing a problem when I tried to install Alfresco DMS ( > http://www.alfresco.com/). > > Alfresco is a java-based Document Management System (running over tomcat). > When I installed it in the local filesystem, it works fine. > It also work great if I install it in an NFS share.<snip> Well, that's your problem: you tried to install Alfresco. *bleah* Also, be aware that numerous threads have noted that glusterfs is *not* that good with lots and lots of little files, and alfresco is mostly just that. mark
Abu Taha -
What version of Gluster are you running, also how did you create these
volume files?
Craig
Sent from a mobile device, please excuse my tpyos.
On May 12, 2010, at 5:19, Muslim Adel Abu Taha <muslim.adel at gmail.com>
wrote:
> Dear all,
>
> I've 4 servers with 2 TB HD each. I've configured gluster to
distribute data
> between 2 and replicate 2, example:
>
> storage01 ---[distribution]---> storage03
>
> storage01 ---[replication]---> storage02
>
> storage03 ---[replication]---> storage04
>
> And everything is working perfectly fine for more than one month. But
> currently I'm facing a problem when I tried to install Alfresco DMS (
> http://www.alfresco.com/).
>
> Alfresco is a java-based Document Management System (running over tomcat).
> When I installed it in the local filesystem, it works fine.
> It also work great if I install it in an NFS share.
>
> But when I install it in the glusterfs, it just don't work and the log
file
> show a lot of exceptions talking about IO, NIO.
>
> I need help to fix this, because the main use of glusterFS was to use
> Alfresco. (The company has huge amount of documents that need to be
> archived).
>
> Note: I've attached the server/client configuration files.
>
> Thanks & Regards,
> <gluserserver.txt>
> <gluserclient.txt>
> _______________________________________________
> Gluster-users mailing list
> Gluster-users at gluster.org
> http://gluster.org/cgi-bin/mailman/listinfo/gluster-users
On Wed, May 12, 2010 at 7:30 PM, Roberto Franchini <franchini at celi.it>wrote:> On Wed, May 12, 2010 at 2:19 PM, Muslim Adel Abu Taha > <muslim.adel at gmail.com> wrote: > > Dear all, > > > [cut[ > > > > Alfresco is a java-based Document Management System (running over > tomcat). > > When I installed it in the local filesystem, it works fine. > > It also work great if I install it in an NFS share. > > > > But when I install it in the glusterfs, it just don't work and the log > file > > show a lot of exceptions talking about IO, NIO. > > Are this errors related with lucene? > Alfresco indexes the contents with lucene, and uses a lot of small > indexes at the same time. > Indexing over a remote file system such as NFS isn't recommended. See: > > http://lucene.472066.n3.nabble.com/Stale-NFS-file-handle-Exception-td643282.html > Same problem with gluster? > R.F. > > > > -- > Roberto Franchini > http://www.celi.it > http://www.blogmeter.it > http://www.memesphere.it > Tel +39.011.562.71.15 > jabber:ro.franchini at gmail.com <jabber%3Aro.franchini at gmail.com>skype:ro.franchini >Hi Roberto, thanks for your reply. No the problem isn't the same. It seems that Alfresco is complaining about the lock, in the attached log file you'll find the following: Caused by: java.lang.RuntimeException: Error during run with lock. Thanks & Regards,
Abu Taha - That is excellent! Please let us know if there is anything else we can do to help, get in touch anytime! Craig -- Craig Carl Gluster, Inc. Cell - (408) 829-9953 (California, USA) Gtalk - craig.carl at gmail.com ----- Original Message ----- From: "Muslim Adel Abu Taha" <muslim.adel at gmail.com> To: "Vijay Bellur" <vijay at gluster.com> Cc: "Craig Carl" <craig at gluster.com>, gluster-users at gluster.org Sent: Saturday, May 15, 2010 1:04:19 AM GMT -08:00 US/Canada Pacific Subject: Re: [Gluster-users] glusterfs and Alfresco DMS Dear Vijay, Craig I installed glusterfs's latest version in 2 VMs and tried Alfresco with it, the VMs where configured as replication. The result is that it worked as smoothly as it should be. It seems the lock problem was due to the old version. I didn't try it with distribution and replication as my working environment is, but I think it should work normally. I'll do this test early today and post my results. Note: I've attached the vol files and alfresco log. In Alfresco log you may find many errors, but they're not related to GlusterFS, they're due to bad Alfresco's configuration (no time to tweak :) ). The errors related to it (IO, NIO, lock) aren't there any more :) Thank you again both of you and any one who helped. On Fri, May 14, 2010 at 1:05 PM, Vijay Bellur < vijay at gluster.com > wrote: On Friday 14 May 2010 03:20 PM, Muslim Adel Abu Taha wrote: On Thu, May 13, 2010 at 10:51 AM, Craig Carl <craig at gluster.com> wrote: In the storage server, I'm running the version shipped in Ubuntu Server 9.10 (glusterfs-server-2.0.2). In the clients (Debian Lenny) I'm running the same version, but I had to compile the client. Thanks for sending across the logs. We recommend using GlusterFS 3.0.4 as this has more bug fixes and enhancements related to locking. Can you please check and let us know if you observe the same problem with GlusterFS 3.0.4? We also recommend generating volume files using glusterfs-volgen. You can find more details about glusterfs-volgen here: http://www.gluster.com/community/documentation/index.php/Glusterfs-volgen_Reference_Page Please keep us posted about your results. We have logged bug 928 to figure out more on this and address the issue. Regards, Vijay -- Muslim Adel Abu Taha (Arabian Linux Founder and Maintainer)