RE: [Samba] samba: problem in copying directories with many files

2004-01-15 Thread Mitch Crane
 On Thu, Jan 15, 2004 at 12:08:52AM -0500, Mitch Crane wrote:
 
  I see. I can also reproduce the symptoms, btw, with:
  smbclient //some-server/some-share -U user%pass -c 'dir foo/*' | wc -l
 
  Though I see the missing entries less frequently (which is why I
 originally
  thought smbclient was ok).
 
 Does this happen using smbclient to smbd or does this only happen
 against a Windows server ?
 
 Jeremy.

I don't know. I suspect it's just against a Windows server, and possibly
just 2000 and XP (maybe 2003). I've only seen it when accessing my Windows
XP machine, and all the reports I googled involved Windows based shares. I
run the one Linux web server which only uses the client to serve files which
reside on my XP box.



--
To unsubscribe from this list go to the following URL and read the
instructions:  http://lists.samba.org/mailman/listinfo/samba


RE: [Samba] samba: problem in copying directories with many files

2004-01-14 Thread Mitch Crane


 -Original Message-
 From: Jeremy Allison [mailto:[EMAIL PROTECTED]
 Sent: Wednesday, January 14, 2004 11:33 PM
 To: Mitch Crane
 Cc: 'Jeremy Allison'; [EMAIL PROTECTED]
 Subject: Re: [Samba] samba: problem in copying directories with many files
 
 Ok - the problem is this looks like a smbfs problem, not a Samba
 server problem. The Samba Team doesn't maintain smbfs - one of our
 members (Steve French from IBM) has written and maintains cifsvfs,
 the replacement for smbfs. I don't think we can promise to fix any
 smbfs problem as we aren't the maintainers.

I see. I can also reproduce the symptoms, btw, with:
smbclient //some-server/some-share -U user%pass -c 'dir foo/*' | wc -l

Though I see the missing entries less frequently (which is why I originally
thought smbclient was ok).




--
To unsubscribe from this list go to the following URL and read the
instructions:  http://lists.samba.org/mailman/listinfo/samba


RE: [Samba] samba: problem in copying directories with many files

2004-01-13 Thread Mitch Crane
 From: Jeremy Allison [mailto:[EMAIL PROTECTED]
 Subject: Re: [Samba] samba: problem in copying directories with many files

 On Mon, Jan 12, 2004 at 05:48:19PM -0500, Mitch Crane wrote:
 
  If you are mounting a share from your XP machine then yes, it's a known
  problem. Though I don't recall anyone from the samba team actually
  acknowledging it, I have the problem and I have seen several other
 reports
  of this problem.
 
 Not a known problem to us :-). This is the first I've seen
 of it. Do you have a reproducible test case for this ?

That's why I added that no one from the samba team had acknowledged it--I
wasn't sure you guys were aware of it, just that some people were. I only
joined the samba list about 2 weeks ago (mainly in search of a solution for
this problem) yet I've seen four reports of this problem (including this one
and mine) or something similar.

My post:
http://groups.google.com/groups?hl=enlr=ie=UTF-8oe=utf-8safe=offselm=1
9W2K-6UJ-11%40gated-at.bofh.it

Seems to be the same issue:
http://groups.google.com/groups?hl=enlr=ie=UTF-8oe=utf-8safe=offselm=1
b1Ws-4Sl-13%40gated-at.bofh.it


Possibly related:
http://groups.google.com/groups?q=%5BSamba%5D+Issues+with+SMBFShl=enlr=i
e=UTF-8oe=utf-8safe=offselm=19Dtg-6cT-23%40gated-at.bofh.itrnum=1

Also, searching Google reveals other reports of the same or similar issues
(some fairly old).

 If so I'll commit to get it fixed for 3.0.2 final - but if
 it's a only happens sometimes kind of thing it will take
 longer and probably not make 3.0.2.

I can reproduce it on my machine. I only have the one Linux box and one
Windows box, but this problem has persisted for months while I've gone from
Redhat 9 to SuSE 9, through various kernel versions (all 2.4.*) and a
complete reinstall on the Windows side. (I'm running 3.0.1 now, btw, though
I original discovered the issue in 2.2.x)

It seems to happen fairly consistently, though it's worse at times than
others. The more files in a directory, the more likely it is to occur. 

 Send me details asap (I'm in Australia at the moment so will
 be working funny timezones).

I filed a bug report which details some of my findings:
https://bugzilla.samba.org/show_bug.cgi?id=939

I hope it wasn't too rambling. Take this with several hundred grains of
salt, but it seems to me, from looking at Ethereal captures, that it could
actually be a problem on the Windows side. The XP box appear to, at random
times, skip a directory item on FIND_NEXT2 commands.

Also, Michael Pflüger reported that using CIFS solved the problem.
Unfortunately, I have no idea how to do that (though I did try, always
ending in a target server not found and error 22).



--
To unsubscribe from this list go to the following URL and read the
instructions:  http://lists.samba.org/mailman/listinfo/samba


RE: [Samba] samba: problem in copying directories with many files

2004-01-12 Thread Mitch Crane
 We have setup samba share between XP and Redhat 8.0. We usually deal
 with copying directories with 1000 files over samba share. When we copy,
 we always find that few files are randomly skipped in copying and one
 has to copy few times to get all the files.
 Is this a known problem and is there any fix for this?

If you are mounting a share from your XP machine then yes, it's a known
problem. Though I don't recall anyone from the samba team actually
acknowledging it, I have the problem and I have seen several other reports
of this problem.



-- 
To unsubscribe from this list go to the following URL and read the
instructions:  http://lists.samba.org/mailman/listinfo/samba


RE: [Samba] weird samba bug? some files from shares sometimes missing..

2004-01-06 Thread Mitch Crane

 Hello, well, i have a weird problem:
 i mounted a share, shared on winxp, on my gentoo linux box via mount -t
 smbfs.. everything seems to work - seems. When i started to backup files
 with rdiff-backup, i noticed that it reported about new and deleted
 files, yet those were never deleted and are still present on the source
 share on the windows machine. I thought it might be a bug in
 rdiff-backup, yet that is not the case, ls /share | wc reports very
 often 509, sometimes even 508, 507 and 506 files, even though there are
 510 files in the directory on the share.
 Ok I thought, maybe a bug in a recent samba version or something - yet
 ive tried it on two gentoo machines, one using kernel 2.6/samba
 3.0.1,gcc 3.3.2, and the other one kernel 2.4.23/samba 2.2.8a/gcc 3.2.3
 - and ive also tried it with another windows box, the result is the
 same. When i access the share via a windows box, it works ok and always
 shows 510 files.
 Each backup process, which checked about 40.000 files, only a few files
 were missing, so when you only check folders with only a few files you
 might not notice this at all..
 
 I really hope someone can help me here, a backup with missing files aint
 really nice

I don't have anything that would help solve the problem, but it might be
helpful to know that you aren't alone.

My post to the list about it:
http://groups.google.com/groups?hl=enlr=ie=UTF-8oe=UTF-8safe=offselm=19
W2K-6UJ-11%40gated-at.bofh.it

Other similar reports:
http://marc.theaimsgroup.com/?l=sambam=102458988807544w=2
http://www.ussg.iu.edu/hypermail/linux/kernel/9603.1/0579.html
http://marc.free.net.ph/message/20030811.020338.5e7083b5.html
http://lists.samba.org/archive/samba-technical/2002-November/025587.html

It seems to be a problem on the Windows side--I've verified that my Windows
XP box is skipping files when sending directory listings--, but if I use a
smbclient command to retrieve a listing then there are no missing items, so
it also appears to be related to how the request is made from the Linux
side.

I looked into breaking my directory requests up into smaller chunks, but
anything with a wildcard in it seems to submit a search pattern of '\*'
which I suppose is then filtered on the client side.



--
To unsubscribe from this list go to the following URL and read the
instructions:  http://lists.samba.org/mailman/listinfo/samba


RE: [Samba] Missing Directory Entries (SMBFS)

2004-01-03 Thread Mitch Crane
Following up on this (please feel free to tell me if there is a more
appropriate place to post this info)...

My smbfs directory entries began to show up missing more frequently today,
so I ran ethereal on the Windows box and captured 2 directory listings. One
capture was of an ls of the directory which was complete and the other has a
missing entry.

What I found around the problem area was, a FIND_NEXT2 request from my Linux
box which resulted in 1 FIND_NEXT2 response and 2 NBSS continuation messages
containing the entry list up to the missing entry, then another FIND_NEXT2
requests whose response began after the missing entry. In other words, the
Windows machine never sent the directory entry for the missing item (it just
skipped over it), which implies a problem with the Windows (server) side.

From what I can tell, the missing entry is always the entry which should
have been first in a FIND_NEXT2 response, so it's a problem of the
FIND_NEXT2 response sometimes being off by one file further into the search
than it should be.

Noting that I never get this problem with 'smbclient //server/share -U
user%pass -c dir' I captured one of those and I can see that the smbclient
dir command does things quite a bit differently. Since I know very little
about how the protocol works, I won't go into all the differences (which may
be irrelevant).

 -Original Message-
 SuSE 9.0 Pro - Kernel 2.4.21 - Samba 2.2.8a and 3.0.1-14
 
 Here's my problem:
 
 On a box runninng XP, I have a shared folder which contains 130+
 subdirectories. This share is mounted on my linux box from
 '/etc/smbfstab',
 but some directories do not show up in directory listings. It's never more
 than one, and which one varies, but generally seems to be in or near the
 last half of the listing. As a test, I can do 'ls -l | wc -l' and the
 number
 will frequently be 1 less than it should be. The same test on a directory
 with over 700 files in it I gave as many as 9 missing entries.

[snip]

 I'm guessing this is an issue with smbfs mounts, because I can do
 'smbclient //some-server/blah -U user%pass -c dir' and I don't get any
 missing directories or files.

[snip]

 What I know:
 
 Directories with fewer items don't have this problem.
 The larger the directory, the more missing entries.


--
To unsubscribe from this list go to the following URL and read the
instructions:  http://lists.samba.org/mailman/listinfo/samba


[Samba] Missing Directory Entries (SMBFS)

2004-01-02 Thread Mitch Crane
SuSE 9.0 Pro - Kernel 2.4.21 - Samba 2.2.8a and 3.0.1-14

Here's my problem:

On a box runninng XP, I have a shared folder which contains 130+
subdirectories. This share is mounted on my linux box from '/etc/smbfstab',
but some directories do not show up in directory listings. It's never more
than one, and which one varies, but generally seems to be in or near the
last half of the listing. As a test, I can do 'ls -l | wc -l' and the number
will frequently be 1 less than it should be. The same test on a directory
with over 700 files in it I gave as many as 9 missing entries.

When I first noticed the problem I was running Redhat 9. Now I'm running
SuSE 9 and the problem persists. I've also tried Samba 3.0.1, but that
didn't seem to make any difference.

I'm guessing this is an issue with smbfs mounts, because I can do
'smbclient //some-server/blah -U user%pass -c dir' and I don't get any
missing directories or files.

Here appear to be similar reports, but no solutions:
http://marc.theaimsgroup.com/?l=sambam=102458988807544w=2
http://www.ussg.iu.edu/hypermail/linux/kernel/9603.1/0579.html
http://marc.free.net.ph/message/20030811.020338.5e7083b5.html
http://lists.samba.org/archive/samba-technical/2002-November/025587.html

Some of the above reports are pretty old which makes me wonder why more
people haven't run into the problem or if there's some kind of weird system
combinations which cause it.

What I know:

Directories with fewer items don't have this problem.
The larger the directory, the more missing entries.

Update:

I actually wrote this a few days ago and never sent it because through my
twiddling the problem mysteriously vanished (or so I thought). Now I find
that it's still happening, but much more rarely than before. I stopped some
Norton Antivirus related services on the Windows machine and then (after
that didn't help) I restarted them and I also did a Norton update. Maybe
it's related to NAV activity on the XP box, but I can't say for certain. Now
that it happens so infrequently it's difficult to even test.

So I'm just wondering if anyone else has seen this kind of thing and looking
for advice. 

--
To unsubscribe from this list go to the following URL and read the
instructions:  http://lists.samba.org/mailman/listinfo/samba


RE: [Samba] Issues with SMBFS

2004-01-02 Thread Mitch Crane
 Hi, I am using samba version 2.2.3 on a Red Hat Linux machine with kernel
 version 2.4.18. When I use smbfs to map a Windows share, I cannot list all
 the files in the directory. ls -l does not return anything and ls returns
 some files not all. Can you please let me know what the issue might be or
 how I should go about troubleshooting this?
 
 Thanks in Advance.
 
 Rashmi

Hi Rashmi,

I've been having a similar problem with smbfs mounts (see: Missing
Directory Entries (SMBFS)). Are you running antivirus software on the
Windows machine? After running out of ideas, I've been wondering if my
Norton AV's autoprotect feature may be causing problems.


--
To unsubscribe from this list go to the following URL and read the
instructions:  http://lists.samba.org/mailman/listinfo/samba