Re: Hive tables query failing for simple query with memory error.

2018-10-19 Thread AgriNut solutions
Sure, thank you On Fri, Oct 19, 2018 at 11:06 AM Thai Bui wrote: > Your Tez container size is too small relatively to your query and data > size. Notice the log said *1.0 GB of 1 GB physical memory used. *It's > because the default Tez container/task size for your cluster is 1024GB. You > can

Re: Hive tables query failing for simple query with memory error.

2018-10-19 Thread Thai Bui
Your Tez container size is too small relatively to your query and data size. Notice the log said *1.0 GB of 1 GB physical memory used. *It's because the default Tez container/task size for your cluster is 1024GB. You can increase it to a higher number (such as 2048 or 4096) via the setting

Hive tables query failing for simple query with memory error.

2018-10-18 Thread AgriNut solutions
Hi Hive experts, I am having a 1 Master node, 3 corenodes and autoscaled task nodes from min 1 to max 20 nodes EMR cluster. Hive table's data is 3.5Gb with 1.3e6 rows and 28 columns. And we can't run any query with it, as it fails due to memory error: Intially got below error: ``` Application