Got it working, question about retryTime and failTime. From your reply
I got the impression that the user will get the choice to skip or abort,
then what do you set these parms to? 0? Thanks!
On 6/3/2011 12:11 PM, Karl Wright wrote:
Your choice of exception would have been fine if this was a repository
connector, but output connectors do not have the same ability to abort
jobs via ManifoldCFExceptions at this time. (You can create a ticket
if you think this is how it should work). But if you want the job to
abort, you probably want to throw a ServiceInterruption exception,
with zero retries. You have a choice of "skip" or "abort job" as
actions. I recently made this work, so let me know if you encounter
any problems.
http://svn.apache.org/repos/asf/incubator/lcf/trunk/framework/agents/src/main/java/org/apache/manifoldcf/agents/interfaces/ServiceInterruption.java
Karl
On Fri, Jun 3, 2011 at 1:02 PM, Farzad Valad<[email protected]> wrote:
So my output connector connects to another repository. If I can't login to
that repository, I execute the following line "throw new
ManifoldCFException("txn [" + txn + "] failed with error " + e.toString(),
e, ManifoldCFException.REPOSITORY_CONNECTION_ERROR);"
ManifoldCF continues the crawl and actually puts out a WARN message. I
expected ManifoldCF to hault the job and show the error in the UI, at least
that is my desired out come. Do I need a different exception type to throw
besides "Repository Connection Error"? Here is what I get in the log file:
WARN 2011-06-01 15:51:42,276 [Worker thread '27'] (WorkerThread.java:855) -
Connection service interruption reported for job 1306961303236 connection
'FileShare': txn [login] failed with error
org.apache.http.conn.HttpHostConnectException: Connection to
http://valadbld:34544 refused
org.apache.manifoldcf.core.interfaces.ManifoldCFException: txn [login]
failed with error org.apache.http.conn.HttpHostConnectException: Connection
to http://valadbld:34544 refused
at
org.apache.manifoldcf.agents.output.dupfinder.CIConnector.sendTxn(CIConnector.java:266)
at
org.apache.manifoldcf.agents.output.dupfinder.CIConnector.sendTxn(CIConnector.java:318)
at
org.apache.manifoldcf.agents.output.dupfinder.CIConnector.sendTxn(CIConnector.java:314)
at
org.apache.manifoldcf.agents.output.dupfinder.CIConnector.Login(CIConnector.java:134)
at
org.apache.manifoldcf.agents.output.dupfinder.CIConnector.initialize(CIConnector.java:114)
at
org.apache.manifoldcf.agents.output.dupfinder.DupFinderConnector.getSession(DupFinderConnector.java:261)
at
org.apache.manifoldcf.agents.output.dupfinder.DupFinderConnector.addOrReplaceDocument(DupFinderConnector.java:137)
at
org.apache.manifoldcf.agents.incrementalingest.IncrementalIngester.addOrReplaceDocument(IncrementalIngester.java:1433)
at
org.apache.manifoldcf.agents.incrementalingest.IncrementalIngester.performIngestion(IncrementalIngester.java:418)
at
org.apache.manifoldcf.agents.incrementalingest.IncrementalIngester.documentIngest(IncrementalIngester.java:313)
at
org.apache.manifoldcf.crawler.system.WorkerThread$ProcessActivity.ingestDocument(WorkerThread.java:1565)
at
org.apache.manifoldcf.crawler.connectors.filesystem.FileConnector.processDocuments(FileConnector.java:275)
at
org.apache.manifoldcf.crawler.connectors.BaseRepositoryConnector.processDocuments(BaseRepositoryConnector.java:423)
at
org.apache.manifoldcf.crawler.system.WorkerThread.run(WorkerThread.java:564)
Caused by: org.apache.http.conn.HttpHostConnectException: Connection to
http://valadbld:34544 refused
at
org.apache.http.impl.conn.DefaultClientConnectionOperator.openConnection(DefaultClientConnectionOperator.java:158)
at
org.apache.http.impl.conn.AbstractPoolEntry.open(AbstractPoolEntry.java:149)
at
org.apache.http.impl.conn.AbstractPooledConnAdapter.open(AbstractPooledConnAdapter.java:121)
at
org.apache.http.impl.client.DefaultRequestDirector.tryConnect(DefaultRequestDirector.java:561)
at
org.apache.http.impl.client.DefaultRequestDirector.execute(DefaultRequestDirector.java:415)
at
org.apache.http.impl.client.AbstractHttpClient.execute(AbstractHttpClient.java:820)
at
org.apache.http.impl.client.AbstractHttpClient.execute(AbstractHttpClient.java:754)
at
org.apache.manifoldcf.agents.output.dupfinder.CIConnector.sendTxn(CIConnector.java:202)
... 13 more
Caused by: java.net.ConnectException: Connection timed out: connect
at java.net.PlainSocketImpl.socketConnect(Native Method)
at java.net.PlainSocketImpl.doConnect(Unknown Source)
at java.net.PlainSocketImpl.connectToAddress(Unknown Source)
at java.net.PlainSocketImpl.connect(Unknown Source)
at java.net.SocksSocketImpl.connect(Unknown Source)
at java.net.Socket.connect(Unknown Source)
at
org.apache.http.conn.scheme.PlainSocketFactory.connectSocket(PlainSocketFactory.java:123)
at
org.apache.http.impl.conn.DefaultClientConnectionOperator.openConnection(DefaultClientConnectionOperator.java:148)
... 20 more
