Hi Chris,
Can you try the following in your local machine,
du -b myfile.txt
and compare this with the hadoop fs -du myfile.txt.
Best,
Mahesh Balija,
Calsoft Labs.
On Wed, Nov 28, 2012 at 7:43 PM, <[email protected]> wrote:
>
> Hi all,
>
> I wonder wy there is a difference between "du" on HDFS and "get" + "du" on
> my local machnine.
>
> Here is an example:
>
> hadoop fs -du myfile.txt
> > 81355258
>
> hadoop fs -get myfile.txt .
> du myfile.txt
> > 34919
>
> --- nevertheless ---
>
> hadoop fs -cat myfile.txt | wc -l
> > 4789943
>
> cat myfile.txt | wc -l
> > 4789943
>
>
> Any idea?
> Thanks.
> Chris
>
