[
https://issues.apache.org/jira/browse/CONNECTORS-518?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13454045#comment-13454045
]
Maciej Lizewski edited comment on CONNECTORS-518 at 9/13/12 1:57 AM:
---------------------------------------------------------------------
Here comes call stack.
"Startup thread"
java.lang.Object.wait(Object.java)
java.lang.Thread.join(Thread.java:1186)
java.lang.Thread.join(Thread.java:1239)
org.apache.manifoldcf.core.database.Database.executeViaThread(Database.java:673)
org.apache.manifoldcf.core.database.Database.executeUncachedQuery(Database.java:709)
org.apache.manifoldcf.core.database.Database$QueryCacheExecutor.create(Database.java:1394)
org.apache.manifoldcf.core.cachemanager.CacheManager.findObjectsAndExecute(CacheManager.java:144)
org.apache.manifoldcf.core.database.Database.executeQuery(Database.java:186)
org.apache.manifoldcf.core.database.DBInterfaceDerby.performModification(DBInterfaceDerby.java:833)
org.apache.manifoldcf.core.database.DBInterfaceDerby.performUpdate(DBInterfaceDerby.java:279)
org.apache.manifoldcf.core.database.BaseTable.performUpdate(BaseTable.java:80)
org.apache.manifoldcf.crawler.jobs.JobQueue.updateExistingRecordInitial(JobQueue.java:1078)
org.apache.manifoldcf.crawler.jobs.JobManager.addDocumentsInitial(JobManager.java:3502)
org.apache.manifoldcf.crawler.system.SeedingActivity.writeSeedDocuments(SeedingActivity.java:232)
org.apache.manifoldcf.crawler.system.SeedingActivity.addSeedDocument(SeedingActivity.java:94)
org.apache.manifoldcf.crawler.system.SeedingActivity.addSeedDocument(SeedingActivity.java:122)
org.apache.manifoldcf.crawler.connectors.wiki.WikiConnector.executeListPagesViaThread(WikiConnector.java:2003)
org.apache.manifoldcf.crawler.connectors.wiki.WikiConnector.listAllPages(WikiConnector.java:1971)
org.apache.manifoldcf.crawler.connectors.wiki.WikiConnector.addSeedDocuments(WikiConnector.java:705)
org.apache.manifoldcf.crawler.connectors.BaseRepositoryConnector.addSeedDocuments(BaseRepositoryConnector.java:150)
org.apache.manifoldcf.crawler.system.StartupThread.run(StartupThread.java:179)
it seems that in listAllPages method:
String newLastTitle =
executeListPagesViaThread(lastTitle,namespace,prefix,activities);
if (newLastTitle == null)
break;
newLastTitle is never null... possible cause:
ExecuteListPagesThread:run method:
StringBuilder lastPageTitleBuffer = new StringBuilder();
loginNeeded =
parseListPagesResponse(is,pageBuffer,startPageTitle,lastPageTitleBuffer);
lastPageTitle = lastPageTitleBuffer.toString();
if there is no queryContinue part in API response,
lastPageTitleBuffer.toString() returns empty string instead of null.
was (Author: redguy666):
Here comes call stack.
"Startup thread"
java.lang.Object.wait(Object.java)
java.lang.Thread.join(Thread.java:1186)
java.lang.Thread.join(Thread.java:1239)
org.apache.manifoldcf.core.database.Database.executeViaThread(Database.java:673)
org.apache.manifoldcf.core.database.Database.executeUncachedQuery(Database.java:709)
org.apache.manifoldcf.core.database.Database$QueryCacheExecutor.create(Database.java:1394)
org.apache.manifoldcf.core.cachemanager.CacheManager.findObjectsAndExecute(CacheManager.java:144)
org.apache.manifoldcf.core.database.Database.executeQuery(Database.java:186)
org.apache.manifoldcf.core.database.DBInterfaceDerby.performModification(DBInterfaceDerby.java:833)
org.apache.manifoldcf.core.database.DBInterfaceDerby.performUpdate(DBInterfaceDerby.java:279)
org.apache.manifoldcf.core.database.BaseTable.performUpdate(BaseTable.java:80)
org.apache.manifoldcf.crawler.jobs.JobQueue.updateExistingRecordInitial(JobQueue.java:1078)
org.apache.manifoldcf.crawler.jobs.JobManager.addDocumentsInitial(JobManager.java:3502)
org.apache.manifoldcf.crawler.system.SeedingActivity.writeSeedDocuments(SeedingActivity.java:232)
org.apache.manifoldcf.crawler.system.SeedingActivity.addSeedDocument(SeedingActivity.java:94)
org.apache.manifoldcf.crawler.system.SeedingActivity.addSeedDocument(SeedingActivity.java:122)
org.apache.manifoldcf.crawler.connectors.wiki.WikiConnector.executeListPagesViaThread(WikiConnector.java:2003)
org.apache.manifoldcf.crawler.connectors.wiki.WikiConnector.listAllPages(WikiConnector.java:1971)
org.apache.manifoldcf.crawler.connectors.wiki.WikiConnector.addSeedDocuments(WikiConnector.java:705)
org.apache.manifoldcf.crawler.connectors.BaseRepositoryConnector.addSeedDocuments(BaseRepositoryConnector.java:150)
org.apache.manifoldcf.crawler.system.StartupThread.run(StartupThread.java:179)
it seems that in listAllPages method:
String newLastTitle =
executeListPagesViaThread(lastTitle,namespace,prefix,activities);
if (newLastTitle == null)
break;
newLastTitle is never null...
> Wiki Connector support for API authorization and security tokens
> ----------------------------------------------------------------
>
> Key: CONNECTORS-518
> URL: https://issues.apache.org/jira/browse/CONNECTORS-518
> Project: ManifoldCF
> Issue Type: Improvement
> Components: Wiki connector
> Affects Versions: ManifoldCF 0.6
> Reporter: Maciej Lizewski
> Assignee: Karl Wright
> Fix For: ManifoldCF next
>
> Attachments: WikiConnector.java,
> WikiConnector.java.namespace.id.patch, wiki.zip
>
>
> Wiki connector does not support API with restricted access (there is "login"
> method in API: https://www.mediawiki.org/wiki/API:Login)
> There is no "security" tab for forced authorization tokens or any other
> security implemented. There should be at least forced tokens tab or tokens
> assigned to wiki namespaces (second would be better)
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira
