https://bugzilla.wikimedia.org/show_bug.cgi?id=65420
--- Comment #22 from Andrew Otto <[email protected]> --- Not really, we just discussed a bit. I hadn't looked into it because I was waiting for your query to fail! I don't think that client side stuff is causing problem for your currently running query. There were client side stuff that was OOMing for weird reasons I don't understand. I tried various versions of your query working on different sizes of partitions. Smaller sizes of partitions don't OOM, larger sizes of partitions do. The OOM happens before the application is given to Hadoop, and it doesn't happen if HADOOP_HEAPSIZE is increased on the client. Hence why I think the OOM errors we saw are somehow client related, although I'm not entirely sure how. I suspect that maybe hive issues some metadata queries to do its query planning, and maybe when there are lots of partitions it gets bogged down somewhere? Not really sure. -- You are receiving this mail because: You are the assignee for the bug. You are on the CC list for the bug. _______________________________________________ Wikibugs-l mailing list [email protected] https://lists.wikimedia.org/mailman/listinfo/wikibugs-l
