[
https://issues.apache.org/jira/browse/CONNECTORS-281?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13133960#comment-13133960
]
Karl Wright commented on CONNECTORS-281:
----------------------------------------
A third dump shows up the temporary file tracker as being a potential
bottleneck. Many threads are waiting on the same synchronizer:
"Worker thread '7'" daemon prio=6 tid=0x055b6800 nid=0x165c waiting for monitor
entry [0x05e8f000]
java.lang.Thread.State: BLOCKED (on object monitor)
at
org.apache.manifoldcf.core.system.ManifoldCF$FileTrack.addFile(ManifoldCF.java:1177)
- waiting to lock <0x292a2728> (a
org.apache.manifoldcf.core.system.ManifoldCF$FileTrack)
at
org.apache.manifoldcf.core.system.ManifoldCF.addFile(ManifoldCF.java:701)
at
org.apache.manifoldcf.crawler.connectors.rss.DataCache.addData(DataCache.java:67)
at
org.apache.manifoldcf.crawler.connectors.rss.RSSConnector.getDocumentVersions(RSSConnector.java:1065)
at
org.apache.manifoldcf.crawler.system.WorkerThread.run(WorkerThread.java:318)
... both add and delete.
> RSS connector takes nearly a second to fetch a document even with no
> throttling
> -------------------------------------------------------------------------------
>
> Key: CONNECTORS-281
> URL: https://issues.apache.org/jira/browse/CONNECTORS-281
> Project: ManifoldCF
> Issue Type: Bug
> Components: RSS connector
> Affects Versions: ManifoldCF 0.4
> Reporter: Karl Wright
> Assignee: Karl Wright
> Fix For: ManifoldCF 0.4
>
>
> The RSS connector load test shows that the RSS connector is overthrottling,
> for some reason.
> 10-24-2011 05:30:50.423 fetch
> http://localhost:8189/rss/gen.php?doc=4&feed=782&type=doc
> 200 46 843
> ... Where 843 ms is taken to fetch a document of size 46 bytes. This is with
> connection parameters as follows:
> Parameters: Robots usage=none
> Max fetches per minute=1000000
> Email address=someb...@somewhere.com
> KB per second=1000000
> Max server connections=100
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators:
https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
