How are your queues configured ? -----Original Message----- From: "Julien Carme" <[email protected]> Sent: 5/28/2015 11:29 AM To: "[email protected]" <[email protected]> Subject: One job blocks all queues.
Hello, I am experimenting the use of multi-tenancy in Hadoop. I have a Hive queries which does never give a result and whose containers seem to freeze forever. It is basically a join where all key values of both input tables are the same. I understand there can be bugs in Hive and they will be corrected at some point, and twisted queries like this one might crash Hive. However, one this query is submitted, all the cluster is frozen including other queues. The entire cluster is useless until you have manually killed the faulty application. If you want to use a single hadoop cluster for several customers, this is a major issue. Is it the expected behavior? Once Yarn has assigned all its containers, is the only thing it can do is wait until they have finished there job? What could be a solution to this problem? Thanks for your answers.
