[
https://issues.apache.org/jira/browse/CONNECTORS-496?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13427910#comment-13427910
]
Karl Wright commented on CONNECTORS-496:
----------------------------------------
On Ubuntu, the test also passed, but I had an identical cleanup hang waiting to
get a connection during shutdown:
{code}
[junit] "Reference Handler" daemon prio=10 tid=0x00007f907c074800 nid=0x1a28
in Object.wait() [0x00007f9081900000]
[junit] java.lang.Thread.State: WAITING (on object monitor)
[junit] at java.lang.Object.wait(Native Method)
[junit] at java.lang.Object.wait(Object.java:502)
[junit] at
java.lang.ref.Reference$ReferenceHandler.run(Reference.java:133)
[junit] - locked <0x00000000e81501f8> (a java.lang.ref.Reference$Lock)
[junit]
[junit] "main" prio=10 tid=0x00007f907c00a000 nid=0x1a23 in Object.wait()
[0x00007f908553d000]
[junit] java.lang.Thread.State: WAITING (on object monitor)
[junit] at java.lang.Object.wait(Native Method)
[junit] at java.lang.Object.wait(Object.java:502)
[junit] at
org.apache.manifoldcf.core.jdbcpool.ConnectionPool.getConnection(ConnectionPool.java:76)
[junit] - locked <0x00000000e80df1c0> (a
org.apache.manifoldcf.core.jdbcpool.ConnectionPool)
[junit] at
org.apache.manifoldcf.core.database.ConnectionFactory.getConnectionWithRetries(ConnectionFactory.java:125)
[junit] at
org.apache.manifoldcf.core.database.ConnectionFactory.getConnection(ConnectionFactory.java:96)
[junit] at
org.apache.manifoldcf.core.database.Database.internalTransactionBegin(Database.java:250)
[junit] at
org.apache.manifoldcf.core.database.Database.synchronizeTransactions(Database.java:237)
[junit] at
org.apache.manifoldcf.core.database.Database$QueryCacheExecutor.create(Database.java:1382)
[junit] at
org.apache.manifoldcf.core.cachemanager.CacheManager.findObjectsAndExecute(CacheManager.java:144)
[junit] at
org.apache.manifoldcf.core.database.Database.executeQuery(Database.java:186)
[junit] at
org.apache.manifoldcf.core.database.DBInterfaceMySQL.performQuery(DBInterfaceMySQL.java:769)
[junit] at
org.apache.manifoldcf.core.database.BaseTable.performQuery(BaseTable.java:221)
[junit] at
org.apache.manifoldcf.crawler.jobs.Jobs.checkIfReference(Jobs.java:2117)
[junit] at
org.apache.manifoldcf.crawler.jobs.JobManager.checkIfReference(JobManager.java:586)
[junit] at
org.apache.manifoldcf.crawler.repository.RepositoryConnectionManager.delete(RepositoryConnectionManager.java:476)
[junit] at
org.apache.manifoldcf.crawler.tests.ConnectorBaseMySQL.localCleanUp(ConnectorBaseMySQL.java:214)
[junit] at
org.apache.manifoldcf.crawler.tests.ConnectorBaseMySQL.cleanUp(ConnectorBaseMySQL.java:182)
[junit] at
org.apache.manifoldcf.crawler.tests.BaseITMySQL.cleanUp(BaseITMySQL.java:208)
[junit] at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
[junit] at
sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
[junit] at
sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
[junit] at java.lang.reflect.Method.invoke(Method.java:616)
[junit] at
org.junit.runners.model.FrameworkMethod$1.runReflectiveCall(FrameworkMethod.java:44)
[junit] at
org.junit.internal.runners.model.ReflectiveCallable.run(ReflectiveCallable.java:15)
[junit] at
org.junit.runners.model.FrameworkMethod.invokeExplosively(FrameworkMethod.java:41)
[junit] at
org.junit.internal.runners.statements.RunAfters.evaluate(RunAfters.java:37)
[junit] at
org.junit.runners.BlockJUnit4ClassRunner.runNotIgnored(BlockJUnit4ClassRunner.java:79)
[junit] at
org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:71)
[junit] at
org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:49)
[junit] at org.junit.runners.ParentRunner$3.run(ParentRunner.java:193)
[junit] at
org.junit.runners.ParentRunner$1.schedule(ParentRunner.java:52)
[junit] at
org.junit.runners.ParentRunner.runChildren(ParentRunner.java:191)
[junit] at
org.junit.runners.ParentRunner.access$000(ParentRunner.java:42)
[junit] at
org.junit.runners.ParentRunner$2.evaluate(ParentRunner.java:184)
[junit] at org.junit.runners.ParentRunner.run(ParentRunner.java:236)
[junit] at
junit.framework.JUnit4TestAdapter.run(JUnit4TestAdapter.java:39)
[junit] at
org.apache.tools.ant.taskdefs.optional.junit.JUnitTestRunner.run(JUnitTestRunner.java:518)
[junit] at
org.apache.tools.ant.taskdefs.optional.junit.JUnitTestRunner.launch(JUnitTestRunner.java:1052)
[junit] at
org.apache.tools.ant.taskdefs.optional.junit.JUnitTestRunner.main(JUnitTestRunner.java:906)
[junit]
[junit] "VM Thread" prio=10 tid=0x00007f907c06d800 nid=0x1a27 runnable
[junit]
[junit] "GC task thread#0 (ParallelGC)" prio=10 tid=0x00007f907c015000
nid=0x1a25 runnable
[junit]
[junit] "GC task thread#1 (ParallelGC)" prio=10 tid=0x00007f907c016800
nid=0x1a26 runnable
[junit]
[junit] "VM Periodic Task Thread" prio=10 tid=0x00007f907c09e800 nid=0x1a2e
waiting on condition
[junit]
[junit] JNI global references: 1047
{code}
> Test needed for MySQL that exercises hopcount filtering during a load test
> --------------------------------------------------------------------------
>
> Key: CONNECTORS-496
> URL: https://issues.apache.org/jira/browse/CONNECTORS-496
> Project: ManifoldCF
> Issue Type: Test
> Components: Framework core
> Affects Versions: ManifoldCF 0.6
> Reporter: Karl Wright
> Assignee: Karl Wright
> Fix For: ManifoldCF 0.7
>
>
> User reports that ManifoldCF web crawls run on MySQL fail to find the correct
> number of documents, compared to web crawls run on PostgreSQL. The documents
> included differ from run to run. We need a test that duplicates the
> appropriate environment. >12000 documents, hop-count filtering enabled.
> > - Max Hop on Links: 15
> > - Max Hop on Redirects: 10
> > - Include only hosts matching seeds: Checked
> > - org.apache.manifoldcf.crawler.threads: 50
> > - org.apache.manifoldcf.database.maxhandles: 100
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators:
https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira