[
https://issues.apache.org/jira/browse/IMPALA-3336?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16847874#comment-16847874
]
David Knupp commented on IMPALA-3336:
-------------------------------------
Thanks! Useful information in general.
> psycopg2 as used by qgen prefetches rows, can consume too much memory
> ---------------------------------------------------------------------
>
> Key: IMPALA-3336
> URL: https://issues.apache.org/jira/browse/IMPALA-3336
> Project: IMPALA
> Issue Type: Bug
> Components: Infrastructure
> Affects Versions: Impala 2.6.0
> Reporter: Michael Brown
> Priority: Minor
>
> When I was experimenting with the query generator on EC2, I started having
> problems with the runner process being killed via kernel oom_killer. In
> checking in with Taras, he let me know this was happening to him as well. I
> need to figure out why that is happening so that the query generator can run.
> {noformat}
> 16:07:51 16:07:52 Query execution thread
> run_query_internal_i80swzzi4opv3q0p:hiveserver2[307]:Fetching up to 2000
> result rows
> 16:07:52 16:07:52 Query execution thread
> run_query_internal_i80swzzi4opv3q0p:hiveserver2[307]:Fetching up to 2000
> result rows
> 16:07:52 16:07:52 Query execution thread
> run_query_internal_i80swzzi4opv3q0p:hiveserver2[307]:Fetching up to 2000
> result rows
> 16:08:28 /tmp/hudson351019564031822959.sh: line 11: 4588 Killed
> ./tests/comparison/leopard/job.py
> 16:08:28 Build step 'Execute shell' marked build as failure
> 16:08:31 Finished: FAILURE
> {noformat}
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
