Re: Kylin and Yarn configuration

2020-10-09 Thread Omid Vahdaty
? On Thu, Oct 8, 2020 at 10:04 PM eran grin wrote: > Hi, > I run dbgen tool on a scale of 100. > I saw know that whatever I changed in yarn configuration ( jvm ) It > always work at a max of 6G RAM. > What I need to configure in order to build this amount of data in Kylin in > time that makes

Re: RAM alloaction

2020-09-20 Thread Omid Vahdaty
rameter in Kylin? > > > 在 2020年8月13日,19:55,Omid Vahdaty 写道: > > HI, > > Just installed kyling using docker. > > I performed a job and got a reduce error > > i have tried increasing the amount of RAM configuration for yarn get same > error > > i twould seem that

referenace

2020-09-06 Thread Omid Vahdaty
Hi, I am about to implement kylin on a large scale data set of 10 trillion records. I was wondering if there anyone i can speak to regarding implementation of kylin on a large scale dataset with 10 trillion records. I would like to get a sense of project implementation complexity so I can plan

RAM alloaction

2020-08-13 Thread Omid Vahdaty
HI, Just installed kyling using docker. I performed a job and got a reduce error i have tried increasing the amount of RAM configuration for yarn get same error i twould seem that regardless of what i configure i keep getting yarn total moery 6GB and total vcores 4, even though u have 40 cores