J.Andreina created YARN-4244:

             Summary: BlockPlacementPolicy related logs should contain the 
details about the filename and blockid
                 Key: YARN-4244
                 URL: https://issues.apache.org/jira/browse/YARN-4244
             Project: Hadoop YARN
          Issue Type: Improvement
            Reporter: J.Andreina
            Assignee: J.Andreina

Currently the user will not get the details about which file/block , the 
BlockPlacementPolicy is not able to find a replica node , if there is a huge 
client write operation is going on.

For example consider below failure message , which does'nt have details about 
file/block , which will be difficult to track later.
      final String message =
          "Failed to place enough replicas, still in need of "
              + (totalReplicasExpected - results.size()) + " to reach " + 
              + " (unavailableStorages=" + unavailableStorages + ", 
              + storagePolicy + ", newBlock=" + newBlock + ")";

        String msg = "All required storage types are unavailable: "
            + " unavailableStorages=" + unavailableStorages
            + ", storagePolicy=" + storagePolicy.getName();

It  is better to provide the file/block information in the logs for better 
debugability .

This message was sent by Atlassian JIRA

Reply via email to