That configuration is for dag scheduler MRR which was written for MR
compatibility. The default dag scheduler is dag scheduler natural order. So
that conf is inactive by default.

The config you are looking for is
ShuffleVertexManager. TEZ_AM_SHUFFLE_VERTEX_MANAGER_MIN_SRC_FRACTION

Bikas

-----Original Message-----
From: Rohini Palaniswamy [mailto:rohini.adi...@gmail.com]
Sent: Wednesday, July 23, 2014 4:38 PM
To: d...@tez.apache.org
Subject: Slow start of tasks

Hi,
   Is TEZ_AM_SLOWSTART_DAG_SCHEDULER_MIN_SHUFFLE_RESOURCE_FRACTION the
setting that controls when to start the next vertex?

I was just thinking that if it was a vertex level setting, in cases of
unsorted edges we should be able to start the next vertex as soon as 1 task
in previous vertex finishes. Will specially be useful with cases like LIMIT.

Regards,
Rohini

-- 
CONFIDENTIALITY NOTICE
NOTICE: This message is intended for the use of the individual or entity to 
which it is addressed and may contain information that is confidential, 
privileged and exempt from disclosure under applicable law. If the reader 
of this message is not the intended recipient, you are hereby notified that 
any printing, copying, dissemination, distribution, disclosure or 
forwarding of this communication is strictly prohibited. If you have 
received this communication in error, please contact the sender immediately 
and delete it from your system. Thank You.

Reply via email to