Re: Hadoop Serialization mechanisms

2014-03-30 Thread Harsh J
Does Hadoop provides a pluggible feature for Serialization for both the above cases? - You can override the RPC serialisation module and engine with a custom class if you wish to, but it would not be trivial task. - You can easily use custom data serialisation modules for I/O. Is Writable

issue about mv: `/user/hive/warehouse/dsp_execution/2014-01-31/data_00000': Input/output error

2014-03-30 Thread ch huang
hi,maillist : i need move datafile from one dir to another dir,but i find if i type hadoop fs -mv /A/* /B/ in commandline ,it's ok,but if i let shell do it ,it will get mv: `/user/hive/warehouse/dsp_click/2014-03-31/data_0': Input/output error i do not know why?

Re: task is still running on node has no disk space

2014-03-30 Thread Zhijie Shen
Hi Anfernee, In 2.2, LocalDirsHandlerService doesn't check whether the disk is full or not. It seem that disk fullness check will be available in 2.4: YARN-1781 - Zhijie On Sun, Mar 30, 2014 at 10:33 AM, Anfernee Xu anfernee...@gmail.com wrote: Hi, I'm running 2.2.0 clusters, my