f the YARN cluster
> deployment on a cluster of thousands of nodes.
>
> Thanks,
> Zhijie
>
>
> On Tue, Sep 2, 2014 at 10:42 AM, bo yang wrote:
>
>> Hi Zhijie,
>>
>> That is great to know. Thanks!
>>
>> So there seems no be much limit to support large
gt;
> On Mon, Sep 1, 2014 at 11:39 PM, bo yang wrote:
>
>> Hi Guys,
>>
>> I am thinking how many concurrent jobs a single Resource Manager might be
>> able to manage? Following is my understanding, please correct me if I am
>> wrong.
>>
>> Let's
Hi Guys,
I am thinking how many concurrent jobs a single Resource Manager might be
able to manage? Following is my understanding, please correct me if I am
wrong.
Let's say if we have 1000 concurrent jobs running. Resource Manager will
have 1000 records in memory to manage these jobs. And it will
You can add the line to your bash profile (.bash_profile)
export HADOOP_INSTALL=/usr/local/hadoop-2.4.0
On Wed, Jun 18, 2014 at 8:18 PM, Mohit Anchlia
wrote:
> No I didn't set that up. Do you know which script it's used? I have
> HADOOP_HOME setup.
>
>
> On Wed, Ju
Hi Mohit,
Did you set up HADOOP_INSTALL?
For me, I did following:
export HADOOP_INSTALL=/usr/local/hadoop-2.4.0
Bo
On Wed, Jun 18, 2014 at 4:27 PM, Mohit Anchlia
wrote:
> I installed Yarn on a single node and now when I try to run hadoop fs I
> get :
>
> Error: Could not find or load main
Just share my experience. I hit build issue on Windows 8 previously. Then I
have to use Visual Studio to open the sln file, and build inside Visual
Studio. After that, I could finish the build of hadoop 2.4.
On Fri, Jun 13, 2014 at 2:26 PM, Arpit Agarwal
wrote:
> No idea. Can you just try to up
No problem. Thanks Wangda to follow up on this issue!
On Sun, May 25, 2014 at 6:36 AM, Wangda Tan wrote:
> Thanks for reporting this, will look at this.
>
>
> On Sat, May 24, 2014 at 8:53 AM, bo yang wrote:
>
>> Yes, after application shown in main page, do step 1 again
p 1 again, will this application disappear?
> And what's version of your Hadoop?
>
> Thanks,
> Wangda
>
>
> On Sat, May 24, 2014 at 1:33 AM, bo yang wrote:
>
>> Wangda,
>>
>> Yes, it is still reproducible.
>>
>> Steps in my side:
>> 1.
bug if it's re-producible.
>
>
> On Thu, May 15, 2014 at 3:26 AM, bo yang wrote:
>
>> Hi Boyu,
>>
>> I hit similar situation previously. I found I clicked some child queue in
>> Scheduler page, then I could not see any applications in main page. If I
>&g
(ProtocMojo.java:107)
>> at
>> org.apache.maven.plugin.DefaultBuildPluginManager.executeMojo(DefaultBuildPluginManager.java:101)
>> at
>> org.apache.maven.lifecycle.internal.MojoExecutor.execute(MojoExecutor.java:209)
>> ... 23 moreCaused by:
>>
I kind of remember I hit similar issue when building hadoop 2.4. I changed
the source code to use the full path of protoc.exe. It is in
hadoop-maven-plugins\src\main\java\org\apache\hadoop\maven\plugin\protoc\ProtocMojo.java:
protocCommand = "C:\\cygwin64\\usr\\local\\bin\\protoc.exe";
Then the b
It might be caused by multiple log4j.properties files in your class path
(e.g. in different jar files). For example, I find
hadoop-mapreduce-client-jobclient-2.4.0-tests.jar
in my class path, and there is log4j.properties inside it. I have to
manually delete it to get logging written to files.
On
Hi Boyu,
I hit similar situation previously. I found I clicked some child queue in
Scheduler page, then I could not see any applications in main page. If I
click the root queue in Scheduler page, I can see applications in main page
again. You may have a similar try.
Regards,
Bo
On Wed, May 14,
Hi,
I am doing some performance test on YARN to see its performance on large
scale application submission and scheduling. I find the application
scheduling slowed down when I continuously submitted jobs in a high speed
(e.g. 20 applications per second).
Anyone has any experience with this? Is the
Hi,
I am running Hadoop Yarn, and find many crc files under D:\temp\001:
.container_1399592412577_0004_01_01.tokens.crc
.container_1399592412577_0006_01_01.tokens.crc
...
Anyone have any idea how to turn it off, or configure the path to be
different directory?
Thanks,
Bo
Sharing a little experience for me to get hadoop working on windows...
I need to build the native binaries (winutils.exe, hadoop.dll) from Hadoop
source code, and copy them to Hadoop bin directory. The maven pom project
cannot build these binaries well on windows. I have to manually open the
sln f
during the
> development and I think that's what you meant.
> I've been playing with it lately, so feel free to take a look -
> https://github.com/olegz/yaya/wiki/CoreFeatures#in-jvm-container-executor.
> At least you'll get some ideas out of it.
>
> Cheers
> Oleg
Hi All,
I just joined this group, and not sure whether this question was discussed
before.
Is it possible to run Application Master within the same process as Node
Manager? If not, any plan to support it future?
I am asking this because we might want to use YARN as a job dispatching
system. We h
18 matches
Mail list logo
