Hi Dmitry, HDFS commands in Apache Hadoop do not launch any python processes. You'll have to find out more about what the process/command is.
On Tue, Feb 19, 2019, 11:23 Dmitry Goldenberg <dgoldenb...@hexastax.com wrote: > Hi, > > We've got a task in Ansible which returns a MemoryError during HDFS > installation on a box with 64 GB memory total, 30 GB free at the moment. > > It appears that during the execution of the hdfs dfs -format command, a > Python process is spawned which gobbles up ~32ish GB of memory and then the > Ansible deploy fails. > > Any ideas as to how we could curtail / manage memory consumption better? > > Thanks >
