Re: Passing an array of float type to mapper class

2015-03-18 Thread Azuryy Yu
please take a look at LongWritable.java, you need to implement a similiar class. On Wed, Mar 18, 2015 at 3:43 PM, Vandana kumari kvandana1...@gmail.com wrote: Hello all I want to pass an array of float type to mapper class. How to do that. Any help? -- Thanks and regards Vandana kumari

trying to understand HashPartitioner

2015-03-18 Thread xeonmailinglist-gmail
Hi, I am trying to understand how |HashPartitioner.java| works. Thus, I ran a mapreduce job with 5 reducers and 5 input files. I thought that the output of |getPartition(K2 key, V2 value, int numReduceTasks)| was the number of reduce task that |K2| and |V2| will execute. Is this correct? ​

Re: trying to understand HashPartitioner

2015-03-18 Thread xeonmailinglist-gmail
What tells with partition will run on which reduce task? On 18-03-2015 09:30, xeonmailinglist-gmail wrote: Hi, I am trying to understand how |HashPartitioner.java| works. Thus, I ran a mapreduce job with 5 reducers and 5 input files. I thought that the output of |getPartition(K2 key, V2

Re: ApplicationMaster Retrying Connection to Dead Node

2015-03-18 Thread Andrew Johnson
I've tracked down the cause of the problem I was experiencing. There are two levels of retries that were coming into play here. The first is controlled by the setting ipc.client.connect.max.retries.on.timeouts. I have this set to 20. This is used by org.apache.hadoop.ipc.Client when it is

Passing an array of float type to mapper class

2015-03-18 Thread Vandana kumari
Hello all I want to pass an array of float type to mapper class. How to do that. Any help? -- Thanks and regards Vandana kumari

Re: trying to understand HashPartitioner

2015-03-18 Thread Jianfeng (Jeff) Zhang
You can take it similar as the HashMap of java. Use the hashCode of one object to distribute it into different bucket. Best Regard, Jeff Zhang From: xeonmailinglist-gmail xeonmailingl...@gmail.commailto:xeonmailingl...@gmail.com Reply-To: user@hadoop.apache.orgmailto:user@hadoop.apache.org

Re: Reading 2 table data in MapReduce for Performing Join

2015-03-18 Thread Suraj Nayak
Hi All, https://issues.apache.org/jira/browse/HIVE-4997 patch helped! On Tue, Mar 17, 2015 at 1:05 AM, Suraj Nayak snay...@gmail.com wrote: Hi, I tried reading data via HCatalog for 1 Hive table in MapReduce using something similar to