Ocfs2 devel - Dec 2009 - 40TB RAID and OCFS2 woes (inode64, JDB2, huge partition support, Volume might try to write to blocks beyond what jbd can address in 32 bits)

Is there a distribution available or at least what real version number of the
tools, and the FS driver to I really need to make this work?

I have a 40TB partition that I want to format an cluster as a single OCFS2
cluster partition. After about 20 hours of reading and messing around with
different solutions, and patches, everything seems to fall back to the following
error:

[ 1358.014040] (11731,7):ocfs2_initialize_super:2157 ERROR: Volume might try to
write to blocks beyond what jbd can address in 32 bits.
[ 1358.014073] (11731,7):ocfs2_fill_super:1006 ERROR: status = -22
[ 1358.014096] ocfs2: Unmounting device (252,2) on (node 0)

root at s2-replay01:~# time mkfs.ocfs2 -N 2 -J block64 -F -v -b 4096 -T mail -M
cluster --fs-feature-level=max-features /dev/replays/replay-data
mkfs.ocfs2 1.4.2
Cluster stack: classic o2cb
Filesystem Type of mail
Filesystem labelBlock size=4096 (bits=12)
Cluster size=16384 (bits=14)
Volume size=39999990923264 (2441405696 clusters) (9765622784 blocks)
75689 cluster groups (tail covers 13568 clusters, rest cover 32256 clusters)
Journal size=268435456
Initial number of node slots: 2
Creating bitmaps: done
Initializing superblock: done
Writing system files: done
Writing superblock: done
Writing backup superblock: 6 block(s)
Formatting Journals: done
Formatting slot map: done
Writing lost+found: done
mkfs.ocfs2 successful


real    24m25.153s
user    0m7.500s
sys     0m5.110s
root at s2-replay01:~# mount.ocfs2 -o inode64 /dev/replays/replay-data
/data/storage/
mount.ocfs2: Invalid argument while mounting /dev/replays/replay-data on
/data/storage/. Check 'dmesg' for more information on this error.
root at s2-replay01:~#


root at s2-replay01:~# dmesg | tail
...
...
[ 1358.014040] (11731,7):ocfs2_initialize_super:2157 ERROR: Volume might try to
write to blocks beyond what jbd can address in 32 bits.
[ 1358.014073] (11731,7):ocfs2_fill_super:1006 ERROR: status = -22
[ 1358.014096] ocfs2: Unmounting device (252,2) on (node 0)
[ 9554.762902] (14685,7):ocfs2_initialize_super:2157 ERROR: Volume might try to
write to blocks beyond what jbd can address in 32 bits.
[ 9554.762964] (14685,7):ocfs2_fill_super:1006 ERROR: status = -22
[ 9554.763001] ocfs2: Unmounting device (252,2) on (node 0)
root at s2-replay01:~#


I've tried compiling the new tools, and FS driver, but it looks like the
most recent version is using some old constructs or API and won't compile
against the most recent kernel versions without a patch.

I've considered scrapping this, and using XFS, and Gluster. However, I like
the prestige of using an Oracle based solution. Can anyone tell me if there is a
combination of Tools and FS driver that can support a 40TB partition at this
time?

-Robert

-- 
Robert Smith, CISSP
Chief Technology Officer
rtsmith at wansecurity.com

WANSecurity, Inc.
https://www.wansecurity.com

My PGP public key is available from:
https://www.wansecurity.com/keys/robert_smith.asc

-------------- next part --------------
An HTML attachment was scrubbed...
URL:
http://oss.oracle.com/pipermail/ocfs2-devel/attachments/20091230/20845c6c/attachment.html

On Wed, Dec 30, 2009 at 11:30:43PM +0900, Robert Smith
wrote:
> Is there a distribution available or at least what real version number of
the tools, and the FS driver to I really need to make this work?
> 
> I have a 40TB partition that I want to format an cluster as a single OCFS2
cluster partition. After about 20 hours of reading and messing around with
different solutions, and patches, everything seems to fall back to the following
error:
	You need an ocfs2 from Linux 2.6.27 or newer.  Are you using
such a kernel?

 
> root at s2-replay01:~# time mkfs.ocfs2 -N 2 -J block64 -F -v -b 4096 -T
mail -M cluster --fs-feature-level=max-features /dev/replays/replay-data
	This looks right.  It doesn't throw you an error.
> root at s2-replay01:~# mount.ocfs2 -o inode64 /dev/replays/replay-data
/data/storage/
> mount.ocfs2: Invalid argument while mounting /dev/replays/replay-data on
/data/storage/. Check 'dmesg' for more information on this error.
	If your kernel driver doesn't understand inode64, it isn't new
enough.  Where did your kernel driver come from?
> I've tried compiling the new tools, and FS driver, but it looks like
the most recent version is using some old constructs or API and won't
compile against the most recent kernel versions without a patch.
	What do you mean by most recent version of the kernel driver?  Do
you mean any version of ocfs2 1.4?  ocfs2 1.4 does not have the support
for this.
	Go get 2.6.32.  Compile, install, and boot it.  You will now
have support for your large volume.

Joel

-- 

"Here's a nickle -- get yourself a better X server."
	- Keith Packard

Joel Becker
Principal Software Developer
Oracle
E-mail: joel.becker at oracle.com
Phone: (650) 506-8127