I successfully loaded the compact index and candidate map to a 32G memory
machine with 2 CPUs. Running the build from the trunk, my instance is still
three times slower than the live spotlight version. Any clue what reason could
be?
Any help is appreciated.
Thanks,
Essam
________________________________
From: Essam Elsherif <[email protected]>
To: Pablo N. Mendes <[email protected]>
Cc: "[email protected]"
<[email protected]>
Sent: Wednesday, November 7, 2012 2:05 PM
Subject: Re: [Dbp-spotlight-users] Performance is Slower when loading the index
Yes, around 24G is being used during annotation. Below is the output from top..
I do not have conf under rest.
I used the command below. Still performance is slow.
Thanks,
Essam
PID USER PR NI VIRT RES SHR S %CPU %MEM TIME+ COMMAND
26683 root 19 0 30.6g 20g 20m S 198.8 63.7 22:51.34 java
1 root 15 0 10364 564 528 S 0.0 0.0 0:00.74 init
2 root RT -5 0 0 0 S 0.0 0.0 0:00.18 migration/0
3 root 34 19 0 0 0 S 0.0 0.0 0:00.00 ksoftirqd/0
4 root RT -5 0 0 0 S 0.0 0.0 0:00.13 migration/1
________________________________
From: Pablo N. Mendes <[email protected]>
To: Essam Elsherif <[email protected]>
Cc: "[email protected]"
<[email protected]>
Sent: Wednesday, November 7, 2012 1:02 PM
Subject: Re: [Dbp-spotlight-users] Performance is Slower when loading the index
Do you observe that about 24G is filled when annotation is running? If not, you
might have not successfully configured the server.properties to load things to
memory.
From your command line it seems you have a "conf" directory under the "rest"
module in addition to the original "conf" that sits on the project root? Did
you also try:
cd rest
mvn scala:run -Dlauncher=Server "-DjavaOpts.Xmx=26G"
"-DaddArgs=../conf/server.properties"
Cheers,
Pablo
On Wed, Nov 7, 2012 at 6:56 PM, Essam Elsherif <[email protected]> wrote:
I have 32G of memory. I set the -Xmx in rest/pom.xml to 26G.
>
>
>I am using mvn scala:run '-DaddArgs=./conf/server.properties' to run the server
>
>
>free -m shows most of the 2G swap is free while running the annotation.
>
>
>
>
>Thanks,
>Essam
>
>
>
>________________________________
> From: Pablo N. Mendes <[email protected]>
>To: Essam Elsherif <[email protected]>
>Cc: "[email protected]"
><[email protected]>
>Sent: Wednesday, November 7, 2012 11:42 AM
>Subject: Re: [Dbp-spotlight-users] Performance is Slower when loading the index
>
>
>
>
>Perhaps the system is paging? How much swap is used when the system is running?
>How much memory do you have?
>What command line did you use?
>What is the -Xmx specified in your pom.xml?
>Cheers
>pablo
>On Nov 7, 2012 10:21 AM, "Essam Elsherif" <[email protected]> wrote:
>
>Hi,
>>I built spotlight from the latest source and I am trying to run it on 32G Ram
>>server. When I load the compact index "index-withSF-withTypes-compressed "
>>into memory annotation is very much slower than not loading. Both are slower
>>than the live spotlight anyway. Any idea what is going on here?
>>
>>
>>Thanks,
>>essam
>>------------------------------------------------------------------------------
>>LogMeIn Central: Instant, anywhere, Remote PC access and management.
>>Stay in control, update software, and manage PCs from one command center
>>Diagnose problems and improve visibility into emerging IT issues
>>Automate, monitor and manage. Do more in less time with Central
>>http://p.sf.net/sfu/logmein12331_d2d
>>_______________________________________________
>>Dbp-spotlight-users mailing list
>>[email protected]
>>https://lists.sourceforge.net/lists/listinfo/dbp-spotlight-users
>>
>>
>
>
--
---Pablo N. Mendes
http://pablomendes.com
Events: http://wole2012.eurecom.fr/
------------------------------------------------------------------------------
Monitor your physical, virtual and cloud infrastructure from a single
web console. Get in-depth insight into apps, servers, databases, vmware,
SAP, cloud infrastructure, etc. Download 30-day Free Trial.
Pricing starts from $795 for 25 servers or applications!
http://p.sf.net/sfu/zoho_dev2dev_nov
_______________________________________________
Dbp-spotlight-users mailing list
[email protected]
https://lists.sourceforge.net/lists/listinfo/dbp-spotlight-users
