yes my job has about 160,000 maps and my cluster not getting fully utilized
around 6000 maps ran for 2 hrs and then I killed the job. At any point of
time only 40 containers are running thats just 11% of my cluster capacity.
{
"classification": "mapred-site",
"properties": {
Back with a Kerberos impersonation question. The hadoop.proxyuser.*
settings are correct, at least the same settings worked on a different
cluster that doesn't require Kerberos authentication.
I can perform my action as the basic user.
When I use the same UGI code, add
user =
Oh, forgot to mention: The application is loaded successfully:
2018-01-30 17:28:38,157 INFO
org.apache.flink.yarn.YarnClusterDescriptor - Submitting
application master application_1517332236216_0002
2018-01-30 17:28:38,582 INFO
Hi,
I'm trying to launch Flink as a long-running Yarn app (on Hadoop 2.8.3),
which should be simple as running `./yarn-session.sh`, but something is not
working here.
When I run said command, I get the following error:
Error while deploying YARN cluster: Couldn't deploy Yarn session cluster
Is your job able to use more containers, I.e. does your job have tasks
waiting or are all tasks in progress?
William Watson
On Tue, Jan 30, 2018 at 1:56 AM, nishchay malhotra <
nishchay.malht...@gmail.com> wrote:
> What should I be looking for if my 24-node cluster in not launching enough
>
Dear Software Developers!
I’m writing to you as I need your insight for my research study, if you could
kindly participate in my survey.
As part of my research project at Chalmers University, I have conducted a
research-survey about 23 types of wastes (collected from literature and though
