Thank you Gary.
Regarding your previous suggestion to to change the configuration regarding
to the number of vcores on the EMR master node, I tried and found one
funny/bad behaviour as following:
 * hardware onfiguration: master node: 4vcores + 8GB ram, 2x executors with
16vcores + 32GB ram each.
 * Flink launch parameters: -yn 2 -ys 16 -ytm 4g...
4 TMs were created, with 2 of them were used (0 free slots) and two others
not used (16 free slots). The bad thing is most of the time 2 free TMs are
on a same machine, and two occupied ones are on the other machine.
If I dont change the Hadoop configurations then still 4 TMs created, but the
occupied ones are always on two different servers.

I'm not sure whether that's EMR's issue, or YARN's or Flink's.

Thanks and regards,
Averell



--
Sent from: http://apache-flink-user-mailing-list-archive.2336050.n4.nabble.com/

Reply via email to