This is an automated email from the ASF dual-hosted git repository.
abstractdog pushed a change to branch master
in repository https://gitbox.apache.org/repos/asf/tez.git.
from f39a51e TEZ-4339: Expose real-time memory consumption of AM and task
containers via DagClient (#157) (Laszlo Bodor reviewed by Rajesh Balamohan)
add 211b59b TEZ-4338: Tez should consider node information to realize
OUTPUT_LOST as early as possible - upstream(mapper) problems (#152) (Laszlo
Bodor reviewed by Rajesh Balamohan)
No new revisions were added by this update.
Summary of changes:
.../org/apache/tez/dag/api/TezConfiguration.java | 18 ++++
.../runtime/api/events/InputReadErrorEvent.java | 29 ++++--
.../api/ContainerLauncherContext.java | 2 +-
tez-api/src/main/proto/Events.proto | 1 +
.../java/org/apache/tez/dag/app/dag/Vertex.java | 5 +
.../dag/event/TaskAttemptEventOutputFailed.java | 4 +-
.../java/org/apache/tez/dag/app/dag/impl/Edge.java | 15 ++-
.../tez/dag/app/dag/impl/TaskAttemptImpl.java | 101 +++++++++++++------
.../apache/tez/dag/app/dag/impl/VertexImpl.java | 27 +++++
.../org/apache/tez/dag/app/rm/node/AMNodeImpl.java | 6 ++
.../apache/tez/dag/app/rm/node/AMNodeTracker.java | 13 ++-
.../tez/dag/app/rm/node/PerSourceNodeTracker.java | 4 +
.../tez/dag/app/dag/impl/TestTaskAttempt.java | 77 ++++++++++++--
.../org/apache/tez/runtime/api/impl/TezEvent.java | 4 +-
.../library/api/TezRuntimeConfiguration.java | 27 ++++-
.../runtime/library/common/shuffle/Fetcher.java | 33 ++++--
.../common/shuffle/FetcherErrorTestingConfig.java | 111 +++++++++++++++++++++
.../shuffle/FetcherWithInjectableErrors.java | 87 ++++++++++++++++
.../common/shuffle/impl/ShuffleManager.java | 14 ++-
.../orderedgrouped/FetcherOrderedGrouped.java | 13 ++-
.../FetcherOrderedGroupedWithInjectableErrors.java | 68 +++++++++++++
.../shuffle/orderedgrouped/ShuffleScheduler.java | 30 ++++--
22 files changed, 608 insertions(+), 81 deletions(-)
create mode 100644
tez-runtime-library/src/main/java/org/apache/tez/runtime/library/common/shuffle/FetcherErrorTestingConfig.java
create mode 100644
tez-runtime-library/src/main/java/org/apache/tez/runtime/library/common/shuffle/FetcherWithInjectableErrors.java
create mode 100644
tez-runtime-library/src/main/java/org/apache/tez/runtime/library/common/shuffle/orderedgrouped/FetcherOrderedGroupedWithInjectableErrors.java
