RE: Not all the task slots are used. Are we missing a setting somewhere?

2024-02-23 Thread Schwalbe Matthias
Thought it would be something the like 😊

Jean-Marc, in future, please ‘reply all’ for your answer such that the 
community can see it as well 😊

Welcome anyway to the community

Thias



From: Jean-Marc Paulin 
Sent: Friday, February 23, 2024 1:14 PM
To: Schwalbe Matthias 
Subject: Re: Not all the task slots are used. Are we missing a setting 
somewhere?

⚠EXTERNAL MESSAGE – CAUTION: Think Before You Click ⚠


Ah, found our mistake..

Yes we do set the parallelism as part of the option we pass when we submit the 
job in the first place.

Sorry for the bother  Thias.

JM


From: Schwalbe Matthias 
mailto:matthias.schwa...@viseca.ch>>
Sent: Friday, February 23, 2024 10:21
To: Jean-Marc Paulin mailto:j...@uk.ibm.com>>; 
user@flink.apache.org<mailto:user@flink.apache.org> 
mailto:user@flink.apache.org>>
Subject: [EXTERNAL] RE: Not all the task slots are used. Are we missing a 
setting somewhere?

This Message Is From an External Sender
This message came from outside your organization.
Report 
Suspicious<https://us-phishalarm-ewt.proofpoint.com/EWT/v1/PjiDSg!2m-rCPRfAPMaEGU7OIElDv8JfEX3zZcJfO_N_APNRGxACPCSq5QB1T7f3b8qqNTFK8AEsf1J0Y4_Qp0vsX1y4EZ5$>


Hi Jean-Marc,



In absence of more context, did you adjust the parallelism of you job 
accordingly?



Thias



From: Jean-Marc Paulin mailto:j...@uk.ibm.com>>
Sent: Friday, February 23, 2024 11:06 AM
To: user@flink.apache.org<mailto:user@flink.apache.org>
Subject: Q: Not all the task slots are used. Are we missing a setting somewhere?



Hi,



We used to run with 3 task managers with numberOfTaskSlots = 2. So all together 
we had 6 task slots and our application used them all. Trying to increase 
throughput, we increased the number of task managers to 6. So now we have 12 
task slots all together. However our application still only uses 6 task slots, 
so we have 6 that are unused. Is there a setting I am missing somewhere ?



Thanks



JM

Unless otherwise stated above:

IBM United Kingdom Limited
Registered in England and Wales with number 741598
Registered office: PO Box 41, North Harbour, Portsmouth, Hants. PO6 3AU
Diese Nachricht ist ausschliesslich fĂŒr den Adressaten bestimmt und beinhaltet 
unter UmstÀnden vertrauliche Mitteilungen. Da die Vertraulichkeit von 
e-Mail-Nachrichten nicht gewĂ€hrleistet werden kann, ĂŒbernehmen wir keine 
Haftung fĂŒr die GewĂ€hrung der Vertraulichkeit und Unversehrtheit dieser 
Mitteilung. Bei irrtĂŒmlicher Zustellung bitten wir Sie um Benachrichtigung per 
e-Mail und um Löschung dieser Nachricht sowie eventueller AnhÀnge. Jegliche 
unberechtigte Verwendung oder Verbreitung dieser Informationen ist streng 
verboten.

This message is intended only for the named recipient and may contain 
confidential or privileged information. As the confidentiality of email 
communication cannot be guaranteed, we do not accept any responsibility for the 
confidentiality and the intactness of this message. If you have received it in 
error, please advise the sender by return e-mail and delete this message and 
any attachments. Any unauthorised use or dissemination of this information is 
strictly prohibited.
Unless otherwise stated above:

IBM United Kingdom Limited
Registered in England and Wales with number 741598
Registered office: PO Box 41, North Harbour, Portsmouth, Hants. PO6 3AU
Diese Nachricht ist ausschliesslich fĂŒr den Adressaten bestimmt und beinhaltet 
unter UmstÀnden vertrauliche Mitteilungen. Da die Vertraulichkeit von 
e-Mail-Nachrichten nicht gewĂ€hrleistet werden kann, ĂŒbernehmen wir keine 
Haftung fĂŒr die GewĂ€hrung der Vertraulichkeit und Unversehrtheit dieser 
Mitteilung. Bei irrtĂŒmlicher Zustellung bitten wir Sie um Benachrichtigung per 
e-Mail und um Löschung dieser Nachricht sowie eventueller AnhÀnge. Jegliche 
unberechtigte Verwendung oder Verbreitung dieser Informationen ist streng 
verboten.

This message is intended only for the named recipient and may contain 
confidential or privileged information. As the confidentiality of email 
communication cannot be guaranteed, we do not accept any responsibility for the 
confidentiality and the intactness of this message. If you have received it in 
error, please advise the sender by return e-mail and delete this message and 
any attachments. Any unauthorised use or dissemination of this information is 
strictly prohibited.


RE: Not all the task slots are used. Are we missing a setting somewhere?

2024-02-23 Thread Schwalbe Matthias
Hi Jean-Marc,

In absence of more context, did you adjust the parallelism of you job 
accordingly?

Thias

From: Jean-Marc Paulin 
Sent: Friday, February 23, 2024 11:06 AM
To: user@flink.apache.org
Subject: Q: Not all the task slots are used. Are we missing a setting somewhere?

Hi,

We used to run with 3 task managers with numberOfTaskSlots = 2. So all together 
we had 6 task slots and our application used them all. Trying to increase 
throughput, we increased the number of task managers to 6. So now we have 12 
task slots all together. However our application still only uses 6 task slots, 
so we have 6 that are unused. Is there a setting I am missing somewhere ?

Thanks

JM
Unless otherwise stated above:

IBM United Kingdom Limited
Registered in England and Wales with number 741598
Registered office: PO Box 41, North Harbour, Portsmouth, Hants. PO6 3AU
Diese Nachricht ist ausschliesslich fĂŒr den Adressaten bestimmt und beinhaltet 
unter UmstÀnden vertrauliche Mitteilungen. Da die Vertraulichkeit von 
e-Mail-Nachrichten nicht gewĂ€hrleistet werden kann, ĂŒbernehmen wir keine 
Haftung fĂŒr die GewĂ€hrung der Vertraulichkeit und Unversehrtheit dieser 
Mitteilung. Bei irrtĂŒmlicher Zustellung bitten wir Sie um Benachrichtigung per 
e-Mail und um Löschung dieser Nachricht sowie eventueller AnhÀnge. Jegliche 
unberechtigte Verwendung oder Verbreitung dieser Informationen ist streng 
verboten.

This message is intended only for the named recipient and may contain 
confidential or privileged information. As the confidentiality of email 
communication cannot be guaranteed, we do not accept any responsibility for the 
confidentiality and the intactness of this message. If you have received it in 
error, please advise the sender by return e-mail and delete this message and 
any attachments. Any unauthorised use or dissemination of this information is 
strictly prohibited.