Pablo Silva
2015-Jun-09 12:30 UTC
[Gluster-users] The strange behavior whose common denominator is gluster
Hi Ted!
Thanks for your reply, for the implementation of Service N2 (As2
Mendelson B45 + gluster 3.3.1-15.el6.x86_64 (1 brick)
we have implemented one brick
As you can see, Mendelson has a Brick, and use it for to process teh
Purchase Ordes feed in SOA21 by MULE process
[root at mendelson ~]# gluster volume info
Volume Name: m2mas2
Type: Distribute
Volume ID: 328d1e48-bb0a-4b41-92ac-699f78d2dca7
Status: Started
Number of Bricks: 1
Transport-type: tcp
Bricks:
Brick1: mendelson.XXXXX.b2b:/opt/mendelson/messages
Options Reconfigured:
auth.allow: 10.200.20.*,10.200.22.*
storage.owner-uid: 500
storage.owner-gid: 500
[root at mendelson ~]# cat /etc/fstab
#
# /etc/fstab
# Created by anaconda on Wed Oct 23 11:42:22 2013
#
# Accessible filesystems, by reference, are maintained under '/dev/disk'
# See man pages fstab(5), findfs(8), mount(8) and/or blkid(8) for more info
#
/dev/mapper/VolGroup-lv_root / ext4
defaults,acl 1 1
UUID=df46586a-2f06-4ada-b2e6-523f7ec3967b /boot ext4
defaults 1 2
/dev/mapper/VolGroup-lv_swap swap swap
defaults 0 0
tmpfs /dev/shm tmpfs defaults 0 0
devpts /dev/pts devpts gid=5,mode=620 0 0
sysfs /sys sysfs defaults 0 0
proc /proc proc defaults 0 0
In this machine run MULE process for to feed with Purchase Orders to
Mendelson.
[root at soa21ifh ~]# mount
/dev/mapper/VolGroup00-LogVol00 on / type ext3 (rw,acl)
proc on /proc type proc (rw)
sysfs on /sys type sysfs (rw)
devpts on /dev/pts type devpts (rw,gid=5,mode=620)
/dev/xvda1 on /boot type ext3 (rw)
tmpfs on /dev/shm type tmpfs (rw)
none on /proc/sys/fs/binfmt_misc type binfmt_misc (rw)
sunrpc on /var/lib/nfs/rpc_pipefs type rpc_pipefs (rw)
glusterfs#mendelson:/m2mas2 on /opt/m2m.as2 type fuse
(rw,allow_other,max_read=131072)
maybe you.'re right and we are wrong with the way of architecture....
Thanks in Advance
-Pablo
On Mon, Jun 8, 2015 at 6:06 PM, Ted Miller <tmiller at
sonsetsolutions.org>
wrote:
> Are you sure you have mounted the gluster volume, and are writing to the
> gluster volume, and NOT to the brick? What you describe can happen when
> you write to the brick instead of the gluster volume. You can see here:
> http://www.gluster.org/community/documentation/index.php/QuickStart in
> steps 6 and 7. If you do not understand the difference, include the output
> of the 'mount' command from one of your servers.
> Ted Miller
> Elkhart, IN, USA
>
>
> On 6/5/2015 8:46 AM, Pablo Silva wrote:
>
> Dear Colleagues:
>
> We are using gluster in 3.3.1-15.el6.x86_64 and GlusterFS-3.6.2-1.el5
> versions, we have two types of service:
>
> 1) Apache httpd-2.2.3-91.el5.centos + GlusterFS-3.6.2-1.el5 (two bricks)
>
> 2) AS2 Mendelson B45 + gluster 3.3.1-15.el6.x86_64 (two bricks)
>
> It is different services, a common problem, which I will explain
>
> Service N1 (Apache httpd-2.2.3-91.el5.centos + GlusterFS-3.6.2-1.el5 (two
> bricks))
>
>
-----------------------------------------------------------------------------------------------------------------------
> We have a high-availability architecture, in which there are two Apache
> servers see a directory that is hosted on a gluster long ago we had a
> problem where an Apache server could list the files and submit them for
> download, while the other Apache server that is watching the same
> directory with the same files gluster indicated that there were no files
for
> download.
>
> Feeding gluster files to that directory, MULE performed asynchronously. In
> summary, an Apache server could access files and another did not give aware
> of their existence, as the directory and the same files.
>
> Service N2 (As2 Mendelson B45 + gluster 3.3.1-15.el6.x86_64 (two bricks)
> )
>
>
--------------------------------------------------------------------------------------------------------------
> We have only one Mendelson AS2 Server B45 running with gluster (two
> bricks),
> The operations of mendelson is quite simple, is to observe the presence of
files
> in a directory every 5 seconds and sent to the partner, the directory is
> hosted in gluster, the issue that every certain amount of time not
> Mendelson AS2 takes cognizance the existence of files in the directory,
> even if you enter the directory notes of its existence
>
> In both cases, different services being the only common denominator is
> gluster, someone else is experiencing this problem?
>
> Have we not set the service gluster well and we are repeating the same
> mistake ?, or is it a bug?
>
> Thanks in advance
> Pablo
>
>
> _______________________________________________
> Gluster-users mailing listGluster-users at
gluster.orghttp://www.gluster.org/mailman/listinfo/gluster-users
>
>
> --
> *Ted Miller*, Design Engineer
> *SonSet Solutions*
> (formerly HCJB Global Technology Center)
> my desk +1 574.970.4272
> receptionist +1 574.972.4252
> http://sonsetsolutions.org
>
> *Technology for abundant life!*
>
> _______________________________________________
> Gluster-users mailing list
> Gluster-users at gluster.org
> http://www.gluster.org/mailman/listinfo/gluster-users
>
-------------- next part --------------
An HTML attachment was scrubbed...
URL:
<http://www.gluster.org/pipermail/gluster-users/attachments/20150609/a17f25ed/attachment.html>
Ted Miller
2015-Jun-09 13:28 UTC
[Gluster-users] The strange behavior whose common denominator is gluster
On 6/9/2015 8:30 AM, Pablo Silva wrote:> Hi Ted! > > Thanks for your reply, for the implementation of Service N2 (As2 > Mendelson B45 + gluster 3.3.1-15.el6.x86_64 (1 brick) > we have implemented one brick > > > As you can see, Mendelson has a Brick, and use it for to process teh > Purchase Ordes feed in SOA21 by MULE process > > [root at mendelson ~]# gluster volume info > > Volume Name: m2mas2 > Type: Distribute > Volume ID: 328d1e48-bb0a-4b41-92ac-699f78d2dca7 > Status: Started > Number of Bricks: 1 > Transport-type: tcp > Bricks: > Brick1: mendelson.XXXXX.b2b:/opt/mendelson/messages > Options Reconfigured: > auth.allow: 10.200.20.*,10.200.22.* > storage.owner-uid: 500 > storage.owner-gid: 500 > > > > [root at mendelson ~]# cat /etc/fstab > > # > # /etc/fstab > # Created by anaconda on Wed Oct 23 11:42:22 2013 > # > # Accessible filesystems, by reference, are maintained under '/dev/disk' > # See man pages fstab(5), findfs(8), mount(8) and/or blkid(8) for more info > # > /dev/mapper/VolGroup-lv_root / ext4 defaults,acl 1 1 > UUID=df46586a-2f06-4ada-b2e6-523f7ec3967b /boot ext4 > defaults 1 2 > /dev/mapper/VolGroup-lv_swap swap swap defaults 0 0 > tmpfs /dev/shm tmpfs defaults 0 0 > devpts /dev/pts devpts gid=5,mode=620 0 0 > sysfs /sys sysfs defaults 0 0 > proc /proc proc defaults 0 0Here is your problem. You are not mounting m2mas2. /opt/mendelson/messages is NOT the same as m2mas2. You can NEVER write (or read) to /opt/mendelson/messages. You must pretend that is _does not exist_. You must mount the Gluster volume, and use only the path to the gluster volume, never to the brick. When you write to the brick you are "going behind gluster's back" and gluster does not know that anything has changed, so it does not make those files available to the gluster clients. It may eventually notice them, and make them available, but it is not anything dependable or predictable. First, make sure you have the glusterfs-fuse package installed. You need to add a line to /etc/fstab that is like: mendelson:/m2mas2/opt/m2m.as2 glusterfs defaults 0 0 Then change everything that you are now reading and writing to /opt/mendelson/messages so that it writes to /opt/m2m.as2 (or whatever mount point you have chosen). Many of us follow this pattern. All bricks are located at /bricks/xxx/xxx. All gluster files systems are mounted to /gluster/xxx. That makes the separation between the bricks and the gluster volumes very clear, and very hard to mess up when writing file paths in programs. No trying to remember "Which is the brick, and which is the gluster volume?" On your Apache system, you again need to mount the glusterfs volume in a separate place, and make sure that the glusterfs location is the only one that Apache knows about or uses in any way whatsoever. Ted Miller> > > In this machine run MULE process for to feed with Purchase Orders to Mendelson. > > [root at soa21ifh ~]# mount > /dev/mapper/VolGroup00-LogVol00 on / type ext3 (rw,acl) > proc on /proc type proc (rw) > sysfs on /sys type sysfs (rw) > devpts on /dev/pts type devpts (rw,gid=5,mode=620) > /dev/xvda1 on /boot type ext3 (rw) > tmpfs on /dev/shm type tmpfs (rw) > none on /proc/sys/fs/binfmt_misc type binfmt_misc (rw) > sunrpc on /var/lib/nfs/rpc_pipefs type rpc_pipefs (rw) > glusterfs#mendelson:/m2mas2 on /opt/m2m.as2 type fuse > (rw,allow_other,max_read=131072) > > maybe you.'re right and we are wrong with the way of architecture.... > > > Thanks in Advance > > -Pablo > > On Mon, Jun 8, 2015 at 6:06 PM, Ted Miller <tmiller at sonsetsolutions.org > <mailto:tmiller at sonsetsolutions.org>> wrote: > > Are you sure you have mounted the gluster volume, and are writing to > the gluster volume, and NOT to the brick? What you describe can happen > when you write to the brick instead of the gluster volume. You can see > here: > http://www.gluster.org/community/documentation/index.php/QuickStart in > steps 6 and 7. If you do not understand the difference, include the > output of the 'mount' command from one of your servers. > Ted Miller > Elkhart, IN, USA > > > On 6/5/2015 8:46 AM, Pablo Silva wrote: >> Dear Colleagues: >> >> We are using gluster in 3.3.1-15.el6.x86_64 and GlusterFS-3.6.2-1.el5 >> versions, we have two types of service: >> >> 1) Apache httpd-2.2.3-91.el5.centos + GlusterFS-3.6.2-1.el5 (two bricks) >> >> 2) AS2 Mendelson B45 + gluster 3.3.1-15.el6.x86_64 (two bricks) >> >> It is different services, a common problem, which I will explain >> >> Service N1 (Apache httpd-2.2.3-91.el5.centos + GlusterFS-3.6.2-1.el5 >> (two bricks)) >> ----------------------------------------------------------------------------------------------------------------------- >> We have a high-availability architecture, in which there are two >> Apache servers see a directory that is hosted on a gluster long ago we >> had a problem where an Apache server could list the files and submit >> them for download, while the other Apache server that is watching the >> same directory with the same files gluster indicated that there were >> no files for download. >> >> Feeding gluster files to that directory, MULE performed >> asynchronously.In summary, an Apache server could access files and >> another did not give aware of their existence, as the directory and >> the same files. >> >> Service N2 (As2 Mendelson B45 + gluster 3.3.1-15.el6.x86_64 (two bricks) ) >> -------------------------------------------------------------------------------------------------------------- >> We have only one Mendelson AS2 Server B45 running with gluster (two >> bricks), >> The operations of mendelson is quite simple, is to observe the >> presence of files in a directory every 5 seconds and sent to the >> partner, the directory is hosted in gluster, the issue that every >> certain amount of time not Mendelson AS2 takes cognizance the >> existence of files in the directory, even if you enter the directory >> notes of its existence >> >> In both cases, different services being the only common denominator is >> gluster, someone else is experiencing this problem? >> >> Have we not set the service gluster well and we are repeating the same >> mistake ?, or is it a bug? >> >> Thanks in advance >> Pablo >> >> >> _______________________________________________ >> Gluster-users mailing list >> Gluster-users at gluster.org <mailto:Gluster-users at gluster.org> >> http://www.gluster.org/mailman/listinfo/gluster-users > > -- > *Ted Miller*, Design Engineer > *SonSet Solutions* > (formerly HCJB Global Technology Center) > my desk +1 574.970.4272 <tel:%2B1%20574.970.4272> > receptionist +1 574.972.4252 <tel:%2B1%20574.972.4252> > http://sonsetsolutions.org > > /Technology for abundant life!/ > > _______________________________________________ > Gluster-users mailing list > Gluster-users at gluster.org <mailto:Gluster-users at gluster.org> > http://www.gluster.org/mailman/listinfo/gluster-users > >-- *Ted Miller*, Design Engineer *SonSet Solutions* (formerly HCJB Global Technology Center) my desk +1 574.970.4272 receptionist +1 574.972.4252 http://sonsetsolutions.org /Technology for abundant life!/ -------------- next part -------------- An HTML attachment was scrubbed... URL: <http://www.gluster.org/pipermail/gluster-users/attachments/20150609/b1bc9ad4/attachment.html>