Re: Samza tasks aren't starting in YARN containers

2019-05-07 Thread Jagadish Venkatraman
Malcolm, Did the AM-process come up? If so, can you attach its entire log-file? "> everything will launch fine one time, and then it will do this RUNNING-but-no-Samza thing the next." IIUC, you believe your container is not making progress. If the issue is recurs, can you attach a thread-dump &

Re: Samza tasks aren't starting in YARN containers

2019-05-07 Thread Malcolm McFarland
As a followup to this, here's what I see when the Samza app tries to start; it actually seems to be getting to the run-container script, and then stops: Kafka version : 0.11.0.2 Kafka commitId : 73be1e1168f91ee2 Error registering AppInfo mbean Started coordinator stream writer. sent SetConfig mes

Samza tasks aren't starting in YARN containers

2019-05-07 Thread Malcolm McFarland
Hey folks, We're having some trouble running Samza under YARN. The YARN containers are launching fully into the RUNNING state, and I can see in the node manager logs that the containers are running, but my logs are showing that Samza is not actually starting inside of the container. What's really