Hi, I used to develop on Tez-0.2.0 but haven't followed Tez-0.3.0 and Tez-0.4.0. I remeber Tez used to have InMemorySortedOutput and InMemoryShuffleSorter which didn't spill map output to file. I found they were removed in TEZ-791<https://issues.apache.org/jira/browse/TEZ-791> so I wonder whether Tez still supports some sort of In-memory shuffle ? A related question is whether there are any examples for Ephemeral EdgeProperty where a source task may stream its outputs directly to destination task.
Thanks, Manu Zhang