Dear GlusterFS users, We are trying to use some C programs that rely on direct I/O operations on files residing on a GlusterFS volume composed of ext4 bricks. It is our understanding that this should be possible if we specify the direct-io-mode=enable option when mounting the volume, but for some reason we get the following error message when calling the open() system call with the O_DIRECT flag: "Invalid arguments". The same system call succeeds on the local file system. System info: CentOS 6.2 GlusterFS 3.2.5 gluster volume info: Volume Name: rdmaVol Type: Distribute Status: Started Number of Bricks: 2 Transport-type: rdma Bricks: Brick1: node01:/home/gfs Brick2: node02:/home/gfs mount command: $ mount -t glusterfs -o direct-io-mode=enable node01:/rdmaVol /mnt/gfs We would really appreciate your help and suggestions! Please let us know if you need any additional information. -------------- next part -------------- An HTML attachment was scrubbed... URL: <http://supercolony.gluster.org/pipermail/gluster-users/attachments/20120210/c47f09f9/attachment.html>
Dear GlusterFS users, We are trying to use some C programs that rely on direct I/O operations on files residing on a GlusterFS volume composed of ext4 bricks. It is our understanding that this should be possible if we specify the direct-io-mode=enable option when mounting the volume, but for some reason we get the following error message when calling the open() system call with the O_DIRECT flag: "Invalid arguments". The same system call succeeds on the local file system. System info: CentOS 6.2 GlusterFS 3.2.5 gluster volume info: Volume Name: rdmaVol Type: Distribute Status: Started Number of Bricks: 2 Transport-type: rdma Bricks: Brick1: node01:/home/gfs Brick2: node02:/home/gfs mount command: $ mount -t glusterfs -o direct-io-mode=enable node01:/rdmaVol /mnt/gfs We would really appreciate your help and suggestions! Please let us know if you need any additional information. -------------- next part -------------- An HTML attachment was scrubbed... URL: <http://supercolony.gluster.org/pipermail/gluster-users/attachments/20120210/91e2d8d7/attachment.html>
Bryan Whitehead
2012-Feb-14 21:09 UTC
[Gluster-users] GlusterFS: problem with direct-io-mode
Search the archives but I'm pretty sure directio doesn't work over fuse without some patches. On Fri, Feb 10, 2012 at 5:11 AM, Ionescu, A. <a.ionescu at student.vu.nl>wrote:> Dear GlusterFS users, > > We are trying to use some C programs that rely on direct I/O operations on > files residing on a GlusterFS volume composed of ext4 bricks. > > It is our understanding that this should be possible if we specify the > *direct-io-mode=enable* option when mounting the volume, but for some > reason we get the following error message when calling the *open()* > system call with the * O_DIRECT* flag:* "Invalid arguments"*. > > The same system call succeeds on the local file system. > > > System info: > CentOS 6.2 > GlusterFS 3.2.5 > > gluster volume info: > > Volume Name: rdmaVol > Type: Distribute > Status: Started > Number of Bricks: 2 > Transport-type: rdma > Bricks: > Brick1: node01:/home/gfs > Brick2: node02:/home/gfs > > mount command: > > $ mount -t glusterfs -o direct-io-mode=enable node01:/rdmaVol > /mnt/gfs > > We would really appreciate your help and suggestions! Please let us know > if you need any additional information. > > _______________________________________________ > Gluster-users mailing list > Gluster-users at gluster.org > http://gluster.org/cgi-bin/mailman/listinfo/gluster-users > >-------------- next part -------------- An HTML attachment was scrubbed... URL: <http://supercolony.gluster.org/pipermail/gluster-users/attachments/20120214/c22f17bb/attachment.html>