pig-user  

local bytes read/written

Haijun Cao
Wed, 04 Jun 2008 22:45:32 -0700

Hi,

I just started using pig, it is really fun to write pig query.

I noticed in the map reduce job page, it reports bytes read/written
from/to local file system, and the number is 2x, 3x of the bytes
read/write to hadoop. Just want to understand the internal working of
pig a little bit better, what operations read/write to local fs? For
what purpose? Is it to the local fs of the data nodes? which directory?

Thanks
Haijun