Re: mapValues Transformation (JavaPairRDD)

2015-12-15 Thread Sushrut Ikhar
Well the issue was because I was using some non thread-safe functions for generating the key. Regards, Sushrut Ikhar [image: https://]about.me/sushrutikhar On Tue, Dec 15, 2015 at 2:27 PM, Paweł Szulc wrote: > Hard to

Re: mapValues Transformation (JavaPairRDD)

2015-12-15 Thread Paweł Szulc
Hard to imagine. Can you share a code sample? On Tue, Dec 15, 2015 at 8:06 AM, Sushrut Ikhar wrote: > Hi, > I am finding it difficult to understand the following problem : > I count the number of records before and after applying the mapValues > transformation for a

mapValues Transformation (JavaPairRDD)

2015-12-14 Thread Sushrut Ikhar
Hi, I am finding it difficult to understand the following problem : I count the number of records before and after applying the mapValues transformation for a JavaPairRDD. As expected the number of records were same before and after. Now, I counted number of distinct keys before and after