Could this be that the were hitting the fly as it started to rise. The same idea that on a stream when the fly drifts to the end of the cast to wait and let it come up to the surface. Alot of fish hit when that happens. I also find that alot of fish hit when I have paused the fly for a couple of seconds after moving it two or three times.
Rick
