YARN FSDownload: How did Mr1 do it ?

2014-02-11 Thread Jay Vyas
Im noticing that resource localization is much more complex in YARN than MR1, in particular, the timestamps need to be identical, or else, an exception is thrown. i never saw that in MR1. How did MR1 JobTrackers handle resource localization differently than MR2 App Masters? -- Jay Vyas

Re: YARN FSDownload: How did Mr1 do it ?

2014-02-11 Thread Harsh J
DistributedCache has also had timestamp checks in MR1 for quite a while now: https://github.com/apache/hadoop-common/blob/release-0.20.2/src/core/org/apache/hadoop/filecache/DistributedCache.java#L481 (See also the doc at