Hi Team, Pig will put “unbar-xxx” directory in /tmp/hadoop-<user> by default, and this is controlled by hadoop.tmp.dir. If many pig jobs are running in parallel, it may fill /tmp or it may cause IO storm to /tmp. The goal is to set hadoop.tmp.dir to other directories to give a better life to /tmp.
I know we can set hadoop.tmp.dir in core-site.xml and it works fine. However I could not find a way to set it at job level. I tried “set hadoop.tmp.dir /xxx” in pig scripts and also put it in: export PIG_OPTS="-Dhadoop.tmp.dir=/xxx" However none of them works. *So is there anyway to set hadoop.tmp.dir instead of putting it in core-site.xml?* -- Thanks, www.openkb.info (Open KnowledgeBase for Hadoop/Database/OS/Network/Tool)
