Hi Folks, Situation, 64 bit Open Solaris on AMD. 2009-6 111b - I can''t successfully update the OS. I''ve got three external 1.5 Tb drives in a raidz pool connected via USB. Hooked on to an IDE channel is a 750gig hard drive that I''m copying the data off. It is an ext3 drive from an Ubuntu server. Copying is being done on the machine using the cp command as root. So far, two files have failed... /mirror2/applications/Microsoft/Operating Systems/Virtual PC/vm/XP-SP2/XP-SP2 Hard Disk.vhd: File too large /mirror2/applications/virtualboximages/xp/xp.tar.bz2: File too large The files are... -rwxr-x--- 1 admin applications 4177570654 Nov 4 08:02 xp.tar.bz2 -rwxr-x--- 1 admin applications 2582259712 Feb 14 2007 XP-SP2 Hard Disk.vhd The system is a home server and contains files of all types and sizes. Any ideas please? -- This message posted from opensolaris.org
CC''ed to ext3-discuss at opensolaris.org because this is an ext3 on Solaris issue. ZFS has no problem with large files, but the older ext3 did. See also the ext3 project page and documentation, especially http://hub.opensolaris.org/bin/view/Project+ext3/Project_status -- richard On Jan 21, 2010, at 11:58 AM, Michelle Knight wrote:> Hi Folks, > > Situation, 64 bit Open Solaris on AMD. 2009-6 111b - I can''t successfully update the OS. > > I''ve got three external 1.5 Tb drives in a raidz pool connected via USB. > > Hooked on to an IDE channel is a 750gig hard drive that I''m copying the data off. It is an ext3 drive from an Ubuntu server. > > Copying is being done on the machine using the cp command as root. > > So far, two files have failed... > /mirror2/applications/Microsoft/Operating Systems/Virtual PC/vm/XP-SP2/XP-SP2 Hard Disk.vhd: File too large > /mirror2/applications/virtualboximages/xp/xp.tar.bz2: File too large > > The files are... > -rwxr-x--- 1 admin applications 4177570654 Nov 4 08:02 xp.tar.bz2 > -rwxr-x--- 1 admin applications 2582259712 Feb 14 2007 XP-SP2 Hard Disk.vhd > > The system is a home server and contains files of all types and sizes. > > Any ideas please? > -- > This message posted from opensolaris.org > _______________________________________________ > zfs-discuss mailing list > zfs-discuss at opensolaris.org > http://mail.opensolaris.org/mailman/listinfo/zfs-discuss
Aplogies for not explaining myself correctly, I''m copying from ext3 on to ZFS - it appears to my amateur eyes, that it is ZFS that is having the problem. -- This message posted from opensolaris.org
+------------------------------------------------------------------------------ | On 2010-01-21 13:06:00, Michelle Knight wrote: | | Aplogies for not explaining myself correctly, I''m copying from ext3 on to ZFS - it appears to my amateur eyes, that it is ZFS that is having the problem. ZFS is quite happy to take files over 2GB. Example InnoDB tablespace: -rw-rw---- 1 mysql mysql 5.1G Jan 21 16:12 cookie_actions.ibd -rw-rw---- 1 mysql mysql 3.4G Jan 21 16:12 list_members.ibd -rw-rw---- 1 mysql mysql 8.3G Jan 21 16:12 log.ibd -rw-rw---- 1 mysql mysql 9.2G Jan 21 16:12 post_clicks.ibd Or test for yourself: [20100121-16:11:06]::[bda at clamour]:[/export/scratch]$ dd if=/dev/urandom of=random bs=1024 count=4194304 4194304+0 records in 4194304+0 records out [20100121-16:14:29]::[bda at clamour]:[/export/scratch]$ ls -lh random -rw-r--r-- 1 bda bda 4.0G Jan 21 16:14 random -- bda cyberpunk is dead. long live cyberpunk.
Fair enough. So where do you think my problem lies? Do you think it could be a limitation of the driver I loaded to read the ext3 partition? -- This message posted from opensolaris.org
Michelle Knight wrote:> Fair enough. > > So where do you think my problem lies? > > Do you think it could be a limitation of the driver I loaded to read the ext3 partition?Without knowing exactly what commands you typed and exactly what error messages they produced, and which directories/files are on which types of file systems, we''re limited to guessing. -- Andrew
The error messages are in the original post. They are... /mirror2/applications/Microsoft/Operating Systems/Virtual PC/vm/XP-SP2/XP-SP2 Hard Disk.vhd: File too large /mirror2/applications/virtualboximages/xp/xp.tar.bz2: File too large The system installed to read the EXT3 system is here - http://blogs.sun.com/pradhap/entry/mount_ntfs_ext2_ext3_in The ZFS partition is on /mirror The EXT3 partition is on /mirror2 The command to start the copy is... cp -R /mirror2/* . ...while being CD''d to /mirror and logged in as root. Anything else I can get that would help this? -- This message posted from opensolaris.org
On Thu, Jan 21, 2010 at 01:55:53PM -0800, Michelle Knight wrote:> The error messages are in the original post. They are... > /mirror2/applications/Microsoft/Operating Systems/Virtual PC/vm/XP-SP2/XP-SP2 Hard Disk.vhd: File too large > /mirror2/applications/virtualboximages/xp/xp.tar.bz2: File too large > > The system installed to read the EXT3 system is here - http://blogs.sun.com/pradhap/entry/mount_ntfs_ext2_ext3_in > > The ZFS partition is on /mirror > > The EXT3 partition is on /mirror2Which is the path in the error filename. You''re having trouble reading the file off ext3 - you can verify this by trying something like cat > /dev/null.> The command to start the copy is... > cp -R /mirror2/* . > ...while being CD''d to /mirror and logged in as root. > > Anything else I can get that would help this?Best would be to plug the ext3 disk into something that can read it fully, and copy over the network. Linux, NetBSD, maybe newer opensolaris. Note that this could be running in a VM on the same box, if necessary. -- Dan. -------------- next part -------------- A non-text attachment was scrubbed... Name: not available Type: application/pgp-signature Size: 194 bytes Desc: not available URL: <http://mail.opensolaris.org/pipermail/zfs-discuss/attachments/20100122/081403a1/attachment.bin>
| On Thu, Jan 21, 2010 at 01:55:53PM -0800, Michelle Knight wrote:> Anything else I can get that would help this?split(1)? :-) -- bda cyberpunk is dead. long live cyberpunk.
On Thursday 21 Jan 2010 22:00:55 Daniel Carosone wrote:> Best would be to plug the ext3 disk into something that can read it > fully, and copy over the network. Linux, NetBSD, maybe newer > opensolaris. Note that this could be running in a VM on the same box, > if necessary.Yep, done. Ubuntu gave me some grief about mounting part elements of a raid set, but I managed it and the files are now copying over to the OS box happily. The problem must have been the drivers loaded to read the ext3 partition.> split(1)?Har, har!!! :-)
On Jan 21, 2010, at 1:55 PM, Michelle Knight wrote:> The error messages are in the original post. They are... > /mirror2/applications/Microsoft/Operating Systems/Virtual PC/vm/XP-SP2/XP-SP2 Hard Disk.vhd: File too large > /mirror2/applications/virtualboximages/xp/xp.tar.bz2: File too large > > The system installed to read the EXT3 system is here - http://blogs.sun.com/pradhap/entry/mount_ntfs_ext2_ext3_in > > The ZFS partition is on /mirror > > The EXT3 partition is on /mirror2 > > The command to start the copy is... > cp -R /mirror2/* . > ...while being CD''d to /mirror and logged in as root. > > Anything else I can get that would help this?So much for adding a link... I''ll try again :-) http://hub.opensolaris.org/bin/view/Project+ext3/Project_status says: Driver is now able to: ... + support file systems larger then 2GiB include 32-bit UIDs a GIDs ... Last modified by senoltj on 2009/11/05 15:59 Hence my attempted cross posting to ext3-discuss where someone should know about the ext3 limitations for the release in question. -- richard
On Thu, Jan 21, 2010 at 02:54:21PM -0800, Richard Elling wrote:> + support file systems larger then 2GiB include 32-bit UIDs a GIDsfile systems, but what about individual files within? -- Dan. -------------- next part -------------- A non-text attachment was scrubbed... Name: not available Type: application/pgp-signature Size: 194 bytes Desc: not available URL: <http://mail.opensolaris.org/pipermail/zfs-discuss/attachments/20100122/ad88d607/attachment.bin>
On Jan 21, 2010, at 6:47 PM, Daniel Carosone <dan at geek.com.au> wrote:> On Thu, Jan 21, 2010 at 02:54:21PM -0800, Richard Elling wrote: >> + support file systems larger then 2GiB include 32-bit UIDs a GIDs > > file systems, but what about individual files within?I think the original author meant files bigger then 2GiB and files systems bigger then 2TiB. I don''t know why that wasn''t builtin from the start it''s been out for a long, long time now, between 5-10 years if I had to guess. -Ross
Hi, it would be very good to know the version of driver used for ext3fs.>From where and how was the driver installed?Best regards, Milan Richard Elling p??e v ?t 21. 01. 2010 v 12:08 -0800:> CC''ed to ext3-discuss at opensolaris.org because this is an ext3 on Solaris > issue. ZFS has no problem with large files, but the older ext3 did. > > See also the ext3 project page and documentation, especially > http://hub.opensolaris.org/bin/view/Project+ext3/Project_status > -- richard > > > On Jan 21, 2010, at 11:58 AM, Michelle Knight wrote: > > > Hi Folks, > > > > Situation, 64 bit Open Solaris on AMD. 2009-6 111b - I can''t successfully update the OS. > > > > I''ve got three external 1.5 Tb drives in a raidz pool connected via USB. > > > > Hooked on to an IDE channel is a 750gig hard drive that I''m copying the data off. It is an ext3 drive from an Ubuntu server. > > > > Copying is being done on the machine using the cp command as root. > > > > So far, two files have failed... > > /mirror2/applications/Microsoft/Operating Systems/Virtual PC/vm/XP-SP2/XP-SP2 Hard Disk.vhd: File too large > > /mirror2/applications/virtualboximages/xp/xp.tar.bz2: File too large > > > > The files are... > > -rwxr-x--- 1 admin applications 4177570654 Nov 4 08:02 xp.tar.bz2 > > -rwxr-x--- 1 admin applications 2582259712 Feb 14 2007 XP-SP2 Hard Disk.vhd > > > > The system is a home server and contains files of all types and sizes. > > > > Any ideas please? > >