Running multiple HMS pointing to the same MySQL

2020-02-14 Thread William Shen
Hi, We're thinking about running multiple instances of Hive Metastore Server (pointing to the same MySQL store) to tackle the HMS load issue we're experiencing. We're thinking about having READ only use cases contact one HMS and the mixed/heavier use cases contact the other HMS. In the past, we

Re: Query Failures

2020-02-14 Thread David Mollitor
Hive has many optimizations. One is that it will load the data directly from storage (HDFS) if it's a trivial query. For example: Select * from table limit 10; In natural language it says "give me any ten rows (if available) from the table." You don't need the overhead of launching a full

Re: Query Failures

2020-02-14 Thread David Mollitor
https://community.cloudera.com/t5/Support-Questions/Map-and-Reduce-Error-Java-heap-space/td-p/45874 On Fri, Feb 14, 2020, 6:58 PM David Mollitor wrote: > Hive has many optimizations. One is that it will load the data directly > from storage (HDFS) if it's a trivial query. For example: > >