[ https://issues.apache.org/jira/browse/TEZ-4010?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16653140#comment-16653140 ]
Gopal V commented on TEZ-4010: ------------------------------ bq. This seems to be inefficient as tasks are started way before they can run in the DAG. This made sense a long time ago when the BI queries need to start the YARN containers ahead of the broadcast tasks (the YARN task spinups take between 3-10 seconds). At this point (with LLAP replacing YARN containers for BI), I'd say that this is an appendix to be removed and replaced with the InputReadyVertexManager instead. > Use InputReadyVertexManager for broadcast connection > ---------------------------------------------------- > > Key: TEZ-4010 > URL: https://issues.apache.org/jira/browse/TEZ-4010 > Project: Apache Tez > Issue Type: Improvement > Reporter: Hitesh Sharma > Priority: Minor > > As per > [VertexImpl::assignVertexManager|https://github.com/apache/tez/blob/39d76a656216d4843908279ef8eaa29a4cc83104/tez-dag/src/main/java/org/apache/tez/dag/app/dag/impl/VertexImpl.java#L2677] > an ImmediateStartVertexManager is used for broadcast connections. This seems > to be inefficient as tasks are started way before they can run in the DAG. > Thoughts on using InputReadyVertexManager for broadcast connections? -- This message was sent by Atlassian JIRA (v7.6.3#76005)