Completed Tasks in YARN will not release resources

2016-04-30 Thread Benjamin Kim
Has anyone encountered this problem with YARN. It all started after an attempt to upgrade from CDH 5.4.8 to CDH 5.5.2. I ran jobs overnight, and they never completed. But, it did take down the YARN ResourceManager and multiple NodeManagers after 5 or 6 hours. There was one job that out of 450 m

Re: Steps to Run Spark Scala job from Oozie on EC2 Hadoop clsuter

2016-03-07 Thread Benjamin Kim
To comment… At my company, we have not gotten it to work in any other mode than local. If we try any of the yarn modes, it fails with a “file does not exist” error when trying to locate the executable jar. I mentioned this to the Hue users group, which we used for this, and they replied that th

Hadoop 2.8 Release Data

2016-03-04 Thread Benjamin Kim
I have a general question about Hadoop 2.8. Is it being prepped for release anytime soon? I am awaiting HADOOP-5732 bringing SFTP support natively. Thanks, Ben - To unsubscribe, e-mail: user-unsubscr...@hadoop.apache.org For addi

Re: Decommissioning Nodes in Production Cluster.

2013-02-12 Thread Benjamin Kim
Hi, I would like to add another scenario. What are the steps for removing a dead node when the server had a hard failure that is unrecoverable. Thanks, Ben On Tuesday, February 12, 2013 7:30:57 AM UTC-8, sudhakara st wrote: > > The decommissioning process is controlled by an exclude file, which