Re: CapacityScheduler vs. FairScheduler

Hi folks, I've a short write-up about feature-wise comparison between fair scheduler and capacity scheduler for latest Hadoop. https://wangda.live/2016/07/07/an-updated-feature-comparison-between-capacity-scheduler-and-fair-scheduler/ HTH, - Wangda On Sun, Jun 19, 2016 at 11:21 PM, sandeep

Re: Help designing application architecture

For 1) you don't have to introduce external storage. You can define case classes for the known formats. FYI On Thu, Jul 7, 2016 at 4:40 PM, venito camelas wrote: > I'm pretty new to this and I have a use case I'm not sure how to > implement, I'll try to explain it and

Help designing application architecture

I'm pretty new to this and I have a use case I'm not sure how to implement, I'll try to explain it and I'd appreciate if anyone could point me in the right direction. The case has these requirements: 1 - Any user shoud be able to define the format of the information they want to store (channel).

YARN application start event

Hello everyone: I was wondering if there is any way to capture the event of an application starting in YARN. The idea is to implement a Listener that every time a YARN application starts, will query the REST API to get the current memory and cores availables in the cluster. Any ideas on this?