Bhupesh Bansal wrote:
Minor correction the graph size is about 6G and not 8G.
Ah, that's better.With the jvm reuse feature in 0.19 you should be able to load it once per job into a static, since all tasks of that job can share a JVM. Things will get tight if you try to run two such jobs at once, since JVMs are only shared by a single job.
https://issues.apache.org/jira/browse/HADOOP-249 Doug
