I have a transformation on a pair rdd using flatmap function.

1.Can I detect in flatmap whether the current record is last record of
partition being processed and
2. what is the partition index of this partition.

public Iterable<Tuple2<String, String>> call(Tuple2<String, String> t)
throws Exception {
//whether element is last elemet of current partiton or not ??
                                //partition index to which element belongs

Reply via email to