Re: [fcrepo-user] How can I optimize or improve the response times of Fedora Commons API?

Aaron Coburn Wed, 02 Oct 2013 07:05:43 -0700

Andres,

1 GB of RAM seems a bit low for running Fedora, even if it is the only service 
running on the machine. If the rest of the Islandora stack is on the same 
machine, then I'm not surprised at the slow response times.

>From the looks of the ITQL query, it seems that you are trying to list all the
>objects in a single collection. Using the resource index for this is a
>particularly bad idea -- especially if the collection size is large. It is a
>much better idea to pull that information from Solr or some other fast index.
>For example, if you have 10,000 objects in your collection (islandora:83),
>your query will need to retrieve, sort and then parse all 10,000 records
>before the HTML can even start to be displayed. As you add more items to this
>collection, that query will only take longer to execute.

Best regards,
Aaron

--
Aaron Coburn
System Administrator / Programmer
Web Services, Amherst College

On Oct 1, 2013, at 12:33 PM, Andrés Campanario
<andrescampana...@gmail.com<mailto:andrescampana...@gmail.com>> wrote:

Hi Benjamin,

Yes it's like 10 seconds in islandora the same query, the query fired to
risearch is:

select $object $title $content from <#ri>
where ($object <fedora-model:label> $title
and $object <fedora-model:hasModel> $content
and ($object
<fedora-rels-ext:isMemberOfCollection> <info:fedora/islandora:83>) and $object
<fedora-model:state> <info:fedora/fedora-system:def/model#Active>)
minus $content <mulgara:is>
<info:fedora/fedora-system:FedoraObject-3.0>
order by $title desc

1) The machine where is Fedora have 1GB of memory, is probably little? if i
took a look with command htop in bash, the memroy assigned to tomcat is 30.9%.
How can i enlarge this value?

2) Currently being in development policies XAMCL are disabled.

3) adore-djatoka, but i dont use in this query

4) the log level is set to INFO, it is the minimal value, isn't it?

5) No

6) there are no errors in log file, yes i'm inclined so anything is wrong
configured, but i dont know what it is. The instalation of fedora is the most
simple

Thanks for your help!!

2013/10/1 Benjamin Armintor <armin...@gmail.com<mailto:armin...@gmail.com>>
Andrés:
Is that the response time through Islandora, or simply from the Fedora object
search interface? 10 seconds does sound quite slow. In general, there are some
things to look for, like:

1. When you look at the Tomcat process Fedora is running in, does it appear to
be consistently using all of its maximum allotted memory? If so, you may need
to configure a larger heap.

2. Are there many XACML policies in effect for the request? Authorization
checks are one of the most taxing parts of processing a request to Fedora, so
minimizing the relevant policies (and attributes checked) will boost
performance.

3. Are there extraneous filters or modules configured? Obviously extra chained
processing will slow things down.

4. What is the log level configured for Fedora? The more fine-grained the
logging, the more I/O overhead there will be. DEBUG logging is particularly
onerous, but even INFO level logging produces a lot of output.

5. Are threads a contested resource for the Fedora process? This may be harder
to ascertain without a profiler of some kind.

6. Is there any kind of warning or error indication in the logs? Your response
time is pretty slow, so I'm inclined to think something is actually wrong more
than inefficiently configured.

Hope those ideas help!

- Ben

On Tue, Oct 1, 2013 at 4:21 AM, Andrés Campanario
<andrescampana...@gmail.com<mailto:andrescampana...@gmail.com>> wrote:
Hi,

How can I optimize or improve the response times of Fedora Commons API?

I'm using FCREPO 3.6.2, everything works perfectly, but a simple query using
API findObjets-A takes almost 10 seconds, just as if I use research.

I Have Fedora Commons installed in one machine, mysql in another, and the
application developed in PHP where connect (using Islandora class) in a third
machine.

Are there some tools like APC in JAVA and SPRING to improve TOMCAT server
response ?

Thank you for your help!

--
Andres Campanario
http://www.andrescampanario.es<http://www.andrescampanario.es/>
http://www.linkedin.com/in/andrescampanario

------------------------------------------------------------------------------
October Webinars: Code for Performance
Free Intel webinars can help you accelerate application performance.
Explore tips for MPI, OpenMP, advanced profiling, and more. Get the most from
the latest Intel processors and coprocessors. See abstracts and register >
http://pubads.g.doubleclick.net/gampad/clk?id=60134791&iu=/4140/ostg.clktrk
_______________________________________________
Fedora-commons-users mailing list
Fedora-commons-users@lists.sourceforge.net<mailto:Fedora-commons-users@lists.sourceforge.net>
https://lists.sourceforge.net/lists/listinfo/fedora-commons-users

--
Andres Campanario
http://www.andrescampanario.es<http://www.andrescampanario.es/>
http://www.linkedin.com/in/andrescampanario

------------------------------------------------------------------------------
October Webinars: Code for Performance
Free Intel webinars can help you accelerate application performance.
Explore tips for MPI, OpenMP, advanced profiling, and more. Get the most from
the latest Intel processors and coprocessors. See abstracts and register >
http://pubads.g.doubleclick.net/gampad/clk?id=60134791&iu=/4140/ostg.clktrk_______________________________________________
Fedora-commons-users mailing list
Fedora-commons-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/fedora-commons-users

------------------------------------------------------------------------------
October Webinars: Code for Performance
Free Intel webinars can help you accelerate application performance.
Explore tips for MPI, OpenMP, advanced profiling, and more. Get the most from 
the latest Intel processors and coprocessors. See abstracts and register >
http://pubads.g.doubleclick.net/gampad/clk?id=60134791&iu=/4140/ostg.clktrk

_______________________________________________
Fedora-commons-users mailing list
Fedora-commons-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/fedora-commons-users

Re: [fcrepo-user] How can I optimize or improve the response times of Fedora Commons API?

Reply via email to