Hi there,
Appreciate if you could share the following info with us:
* Are you using GlusterFS hadoop plugin (which is here
http://download.gluster.com/pub/gluster/glusterfs/qa-releases/3.3-beta-2/glusterfs-hadoop-0.20.2-0.1.x86_64.rpm
and is still in beta) or are you using GlusterFS as an additional layer below
Hadoop's FileSystem (HDFS) ?
The latter is basically configuring Hadoop to use GlusterFS mount point (e.g.
FUSE mount) as the data directory for Hadoop's DFS.
Let us know your setup (including GlusterFS version) to debug further.
Thanks,
-Venky
________________________________
From: gluster-users-bounces at gluster.org [gluster-users-bounces at
gluster.org] on behalf of andrew [sstrato.kong at gmail.com]
Sent: Wednesday, October 19, 2011 6:15 PM
To: gluster-users at gluster.org
Subject: [Gluster-users] gluster map/reduce performance..
Hi, all,
i try to check the performance of Map/Reduce of Gluster File system.
Mapper side speed is quite good and it is sometimes faster than hadoop's map
job.
But in the Reduce Side job is much slower than hadoop.
i analyze the result and i found the primary reason of slow speed is bad
performance in Merging stage.
Would you have any suggestion for this issue
FYI check the blog http://storage4com.blogspot.com/
thanks.
-------------- next part --------------
An HTML attachment was scrubbed...
URL:
<http://supercolony.gluster.org/pipermail/gluster-users/attachments/20111019/e8a5527e/attachment.html>