Re: Hyracks Job Requirement Configuration

2018-01-29 Thread Michael Carey
ibi <ralot...@eng.ucsd.edu> *Date: *Monday, 29 January 2018 at 6:48 AM *To: *<hubail...@gmail.com> *Cc: *<users@asterixdb.apache.org>, <d...@asterixdb.apache.org> *Subject: *Re: Hyracks Job Requirement Configuration *- Do you see all cores being fully utilized during the query e

Re: Hyracks Job Requirement Configuration

2018-01-28 Thread Murtadha Hubail
to select count(*) instead of subject_id. Cheers, Murtadha From: Rana Alotaibi <ralot...@eng.ucsd.edu> Date: Monday, 29 January 2018 at 6:48 AM To: <hubail...@gmail.com> Cc: <users@asterixdb.apache.org>, <d...@asterixdb.apache.org> Subject: Re: Hyracks Job Requirement

Re: Hyracks Job Requirement Configuration

2018-01-28 Thread Rana Alotaibi
necessarily lead to a better > performance. Have you tried changing these values to something smaller and > seeing the effects? > > > > Cheers, > > Murtadha > > > > *From: *Rana Alotaibi <ralot...@eng.ucsd.edu> > *Date: *Monday, 29 January 2018 at 5:21 AM > *T

Re: Hyracks Job Requirement Configuration

2018-01-28 Thread Murtadha Hubail
<ralot...@eng.ucsd.edu> Date: Monday, 29 January 2018 at 5:21 AM To: <hubail...@gmail.com> Cc: <users@asterixdb.apache.org>, <d...@asterixdb.apache.org> Subject: Re: Hyracks Job Requirement Configuration Thanks Murtadha! The problem solved. However, increasing the numb

Re: Hyracks Job Requirement Configuration

2018-01-28 Thread Rana Alotaibi
Thanks Murtadha! The problem solved. However, increasing the number of cores didn't help to improve the performance of that query. On Sun, Jan 28, 2018 at 5:05 PM, Murtadha Hubail wrote: > Hi Rana, > > The memory used for query processing is automatically calculated as >

Re: Hyracks Job Requirement Configuration

2018-01-28 Thread Murtadha Hubail
Hi Rana, The memory used for query processing is automatically calculated as follows: JVM Max Memory - storage.buffercache.size - storage.memorycomponent.globalbudget The documentation defaults for these parameters are outdated. The default value for storage.buffercache.size is (JVM Max Memory

Re: Hyracks Job Requirement Configuration

2018-01-28 Thread Mike Carey
+ dev On 1/28/18 3:37 PM, Rana Alotaibi wrote: Hi all, I would like to make AsterixDB utilizes all available CPU cores (39) that I have for the following query: USE mimiciii; SET `compiler.parallelism` "39"; SET `compiler.sortmemory` "128MB"; SET `compiler.joinmemory` "265MB"; SELECT