[jira] [Created] (TEZ-3444) Handling of fetch-failures should consider time spent producing output

2016-09-22 Thread Jason Lowe (JIRA) 
Jason Lowe created TEZ-3444:
---

 Summary: Handling of fetch-failures should consider time spent 
producing output
 Key: TEZ-3444
 URL: https://issues.apache.org/jira/browse/TEZ-3444
 Project: Apache Tez
  Issue Type: Improvement
Reporter: Jason Lowe


When handling fetch failures and deciding whether the upstream task should be 
re-run, we should consider the duration of the upstream task that generated the 
data trying to be fetched.  If the upstream task ran for a long time then we 
may want to retry a bit harder before deciding to re-run.  If the upstream task 
executed in a few seconds then we should probably re-run the upstream task more 
aggressively since that may be cheaper than multiple retries that timeout.




--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

[GitHub] tez pull request #15: TEZ-3443 : Remove a repeated method

2016-09-22 Thread darionyaphet 
GitHub user darionyaphet opened a pull request:

https://github.com/apache/tez/pull/15

TEZ-3443 : Remove a repeated method

MRTask.getFsStatistics seems not used , I try to remove it .

You can merge this pull request into a Git repository by running:

$ git pull https://github.com/darionyaphet/tez TEZ-3443

Alternatively you can review and apply these changes as the patch at:

https://github.com/apache/tez/pull/15.patch

To close this pull request, make a commit to your master/trunk branch
with (at least) the following in the commit message:

This closes #15


commit 88c0157a62aecb8fdf4591e2101e25be6f1477dc
Author: darionyaphet 
Date:   2016-09-22T14:37:33Z

TEZ-3443 : Remove a repeated method




---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---

[jira] [Created] (TEZ-3443) Remove a repeated method

2016-09-22 Thread darion yaphet (JIRA) 
darion yaphet created TEZ-3443:
--

 Summary: Remove a repeated method
 Key: TEZ-3443
 URL: https://issues.apache.org/jira/browse/TEZ-3443
 Project: Apache Tez
  Issue Type: Bug
Affects Versions: 0.8.4
Reporter: darion yaphet
Assignee: darion yaphet
Priority: Minor


MRTask.getFsStatistics seems not used , I try to remove it .



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)