samba - May 2008 - Files over 4GB not listing properly. Cannot get CIFSworking.

Put this in the wrong thread, sorry!


UPDATE:  I've realized that this seems to be an issue with the compiler
flags used to build samba.
I've realized that i need to define _LARGEFILE_SOURCE, _LARGEFILE64_SOURCE,
and _FILE_OFFSET_BITS=64.

I've done this, but still have no luck reading files larger than 4GB. 
Anyone have suggestions?

Thanks,
Matt

> Hi guys,
> 
> I'm attempting to move large files (>4GB) from a PowerPC-based
embedded system running a 2.4 kernel architecture to an PC running a 2.6 kernel.
I've got samba compiled, installed, and running on the embedded box. I also
have the directories from the PPC system mounted and accessible from the PC.
> 
> I have two problems: larger file sizes do not list correctly, and large
files transferred from the embedded box to the PC are not complete; IE
they're dropping data along the way. I'm familiar with the 2GB file size
limit on samba, and have mounted the PC side using the lfs flag.
> 
> Problem 1: Incorrect listing
> 
> Here's a list of the directory from the embedded box:
> -r--r--r-- 1 root root 52646396 Jan 5 06:46 file1.ch10
> -r--r--r-- 1 root root 60755936 Jan 5 06:46 file2.ch10
> -r--r--r-- 1 root root 47606684 Jan 5 06:46 file3.ch10
> -r--r--r-- 1 root root 4920604376 Jan 5 05:51 file4.ch10
> 
> Here's that same listing, but of the samba mount of that directory on
the PC:
> 
> -r-xr-xr-x 1 root root 52646396 Jan 5 2007 file1.ch10 -r-xr-xr-x 1 
> root root 60755936 Jan 5 2007 file2.ch10 -r-xr-xr-x 1 root root 
> 47606684 Jan 5 2007 file3.ch10 -r-xr-xr-x 1 root root 625637080 Jan 5 
> 2007 file4.ch10
> 
> As you can see, files 1-3 list fine, but file4 is showing way short.
I'm guessing this might be some sort of overflow condition, any ideas?
> 
> Problem 2: Loss of data during transfer of large files.
> When I try to transfer file4, i only get 41xxxxxxxx or so of the total 
> file size. This is the more pressing issue.
> 
> Also, I cannot mount the samba share using CIFS.  I use the line
> 
> mount -t smbfs //server/share/ path/to/local/ -o user=u,pass=p,lfs
> 
> to mount with SMBFS, and it works correctly, just doesn't display the
large files.
> However, when using the following:
> 
> mount -t smbfs //server/share/ path/to/local/ -o user=u,pass=p,lfs
> 
> I get "Mount error 5= Input/output error"
> 
> Any thoughts?
> 
> Thanks,
> Matt
***Teletronics Technology Corporation*** 
This e-mail is confidential and may also be privileged.  If you are not the
addressee or authorized by the addressee to receive this e-mail, you may not
disclose, copy, distribute, or use this e-mail. If you have received this e-mail
in error, please notify the sender immediately by reply e-mail or by telephone
at 267-352-2020 and destroy this message and any copies.  Thank you.

*******************************************************************


-- 
To unsubscribe from this list go to the following URL and read the
instructions:  https://lists.samba.org/mailman/listinfo/samba

---------- Forwarded message ----------
From: Rob Shinn <rob.shinn@gmail.com>
Date: Tue, May 6, 2008 at 2:57 PM
Subject: Re: [Samba] Files over 4GB not listing properly. Cannot get
CIFSworking.
To: Matt Boyle <MBoyle@ttcdas.com>



> > Also, I cannot mount the samba share using CIFS.  I use the line
> >
> > mount -t smbfs //server/share/ path/to/local/ -o user=u,pass=p,lfs
> >
> > to mount with SMBFS, and it works correctly, just doesn't display
the
> large files.
> > However, when using the following:
> >
> > mount -t smbfs //server/share/ path/to/local/ -o user=u,pass=p,lfs
>
I'm assuming you mean you get the "mount error 5' when you use


mount -t cifs //server/share/ path/to/local/ -o user=u,pass=p,lfs

Do you have an executable named mount.cifs in /sbin or /usr/sbin on the
client?

If not, you'll need to install CIFS VFS on the client.  You may need to
install kernel patches to make this happen.

On Tue, 2008-05-06 at 11:07 -0400, Matt Boyle wrote:
> Put this in the wrong thread, sorry!
> 
> 
> UPDATE:  I've realized that this seems to be an issue with the compiler
flags used to build samba.
> I've realized that i need to define _LARGEFILE_SOURCE,
_LARGEFILE64_SOURCE, and _FILE_OFFSET_BITS=64.
> 
> I've done this, but still have no luck reading files larger than 4GB. 
Anyone have suggestions?
smbfs the in-kernel filesystem, (particularly old versions such as in
Linux 2.4) never did files over 4GB well.  

'Fixing' the userspace samba won't change the in-kernel limitations.
I
suggest you find a different way to move the files, perhaps use
smbclient - the default compile should be perfectly fine for large files
(Samba itself has done large files for many years).

Andrew Bartlett

-- 
Andrew Bartlett
http://samba.org/~abartlet/
Authentication Developer, Samba Team           http://samba.org
Samba Developer, Red Hat Inc.
-------------- next part --------------
A non-text attachment was scrubbed...
Name: not available
Type: application/pgp-signature
Size: 189 bytes
Desc: This is a digitally signed message part
Url :
http://lists.samba.org/archive/samba/attachments/20080507/1f65a0c7/attachment.bin

Am Dienstag, 6. Mai 2008 schrieb Matt Boyle:
> Put this in the wrong thread, sorry!
> 
> 
> UPDATE:  I've realized that this seems to be an issue with the compiler
flags used to build samba.
> I've realized that i need to define _LARGEFILE_SOURCE,
_LARGEFILE64_SOURCE, and _FILE_OFFSET_BITS=64.
> 
> I've done this, but still have no luck reading files larger than 4GB. 
Anyone have suggestions?
> 
> Thanks,
> Matt
> 
> 
> > Hi guys,
> > 
> > I'm attempting to move large files (>4GB) from a PowerPC-based
embedded system running a 2.4 kernel architecture to an PC running a 2.6 kernel.
I've got samba compiled, installed, and running on the embedded box. I also
have the directories from the PPC system mounted and accessible from the PC.
> > 
> > I have two problems: larger file sizes do not list correctly, and
large files transferred from the embedded box to the PC are not complete; IE
they're dropping data along the way. I'm familiar with the 2GB file size
limit on samba, and have mounted the PC side using the lfs flag.
> > 
> > Problem 1: Incorrect listing
> > 
> > Here's a list of the directory from the embedded box:
> > -r--r--r-- 1 root root 52646396 Jan 5 06:46 file1.ch10
> > -r--r--r-- 1 root root 60755936 Jan 5 06:46 file2.ch10
> > -r--r--r-- 1 root root 47606684 Jan 5 06:46 file3.ch10
> > -r--r--r-- 1 root root 4920604376 Jan 5 05:51 file4.ch10
> > 
> > Here's that same listing, but of the samba mount of that directory
on the PC:
> > 
> > -r-xr-xr-x 1 root root 52646396 Jan 5 2007 file1.ch10 -r-xr-xr-x 1 
> > root root 60755936 Jan 5 2007 file2.ch10 -r-xr-xr-x 1 root root 
> > 47606684 Jan 5 2007 file3.ch10 -r-xr-xr-x 1 root root 625637080 Jan 5 
> > 2007 file4.ch10
> > 
> > As you can see, files 1-3 list fine, but file4 is showing way short.
I'm guessing this might be some sort of overflow condition, any ideas?
> > 
> > Problem 2: Loss of data during transfer of large files.
> > When I try to transfer file4, i only get 41xxxxxxxx or so of the total
> > file size. This is the more pressing issue.
> > 
> > Also, I cannot mount the samba share using CIFS.  I use the line
> > 
> > mount -t smbfs //server/share/ path/to/local/ -o user=u,pass=p,lfs
> > 
> > to mount with SMBFS, and it works correctly, just doesn't display
the large files.
> > However, when using the following:
> > 
> > mount -t smbfs //server/share/ path/to/local/ -o user=u,pass=p,lfs
I guess, that's a typo above, so "smbfs" should read
"cifs" ?
> > 
> > I get "Mount error 5= Input/output error"
> > 
You can do the following on your local "PC running a 2.6 kernel" to
track
this down a bit more when using the cifs kernel module:

1. 'modinfo cifs' (to query some cifs version and kernel info)
2. 'modprobe cifs' (to make sure the module is loaded)
3. 'echo 3 > /proc/fs/cifs/cifsFYI' (to make cifs more chatty)
4. 'logger
HERE-ALL-NEW-STUFF-NOW-========================================='
5. In a separate console, use 'tail -f /var/log/messages' to fetch
cifs' msgs
6. use 'mount.cifs //server/share /path/to/local --verbose -o
user=u,pass=p'
   (the option "lfs" is _not_ needed here, not a valid cifs option)

(Usually) there should be cifs debug messages in the 4.) tail -f ... console.
All new entries start at the string
....
"HERE-ALL-NEW-STUFF-NOW-========================================="

Please send all output from the above steps 1.) 2.) 5.) and 6.)

Cheers, G?nter

Note that some of the cmds above need root privs.