Within the mapper you cannot access the parallelism of the following nor
preceding operation.
On 20.06.2016 15:56, Paschek, Robert wrote:
Hi Mailing list,
using a RichMapPartitionFunction i can access the total number m of this mapper
utilized in my job with
int m = getRuntimeContext().getNumberOfParallelSubtasks();
I think that would be - in general - the total number of CPU Cores used by
Apache Flink among the cluster.
Is there a way to access the number of the following reducer?
In general i would assume that the number of the following reducers depends on the
number of groups generated by the groupBy() transformation. So the number of the
reducer r would be 1 <= r <= m.
My Job:
DataSet<?> output = input
.mapPartition(new MR_GPMRS_Mapper())
.groupBy(0)
.reduceGroup(new MR_GPMRS_Reducer());
Thank you in advance
Robert
