Hi Pranesh, There is a WGET-compatible file output connector included with ManifoldCF 1.3.
Karl On Thu, Aug 1, 2013 at 1:11 PM, Pranesh Vadhirajan < [email protected]> wrote: > Hi, > > Is there a way to define an output connection that writes documents to a > file system location? Is there a way to use the "null" output connection > type to accomplish this? I am trying to integrate an application that > would > crawl a source (a livelink based file repository) using ManifoldCF and > store > the crawled documents to a file system location. > > Thanks, > Pranesh > > -----Original Message----- > From: Karl Wright [mailto:[email protected]] > Sent: Monday, July 29, 2013 5:51 PM > To: dev > Subject: Re: How to connecto to LiveLink server via Java API > > Hi Pranesh, > > You can do everything with the REST API that you can do with the UI. You > can also do everything with Java directly, BUT you have to play by the > ManifoldCF rules pertaining to thread management. This is not well > documented and you would need to refer to existing code to do it. > > I suggest you first get familiar with ManifoldCF by using the UI. Here's > the documentation: > > > http://manifoldcf.apache.org/release/trunk/en_US/end-user-documentation.html > > The REST API is documented here: > > > http://manifoldcf.apache.org/release/trunk/en_US/programmatic-operation.html > > You will also note that there are "commands", which are Java classes > invoked > from the command line, that perform various activities: > > > http://manifoldcf.apache.org/release/trunk/en_US/programmatic-operation.html > #Control+via+Commands > > You can look at the source of these commands and build what you need - but > that's all that is really available, and there isn't going to be a lot of > help. You will need to run the agent threads (see the command AgentRun), > as > well as whatever you need to define your connections. > > Karl > > > > On Mon, Jul 29, 2013 at 5:11 PM, Pranesh Vadhirajan < > [email protected]> wrote: > > > Hi Karl, > > > > Thanks for your reply. I do have a question regarding how I plan to > > use ManifoldCF. My reason for writing a connector is to connect to > > livelink servers in a lightweight mechanism and integrate it with an > > enterprse application which will then process the documents crawled > > from the connection. The enterprise application has a fully > > functional user interface and its own data storage mechanism. The > > intent here is to integrate ManifoldCF's pull agent by crawling > > Livelink server based sources and to use ManifoldCF's output > > connection capability (file system based) to write to a local file > > system. The file system will then act as the source of the data for > > the enterprise application. The intent is to not use the full > > capability of the ManifoldCF application (i.e no UI, and if possible, > > no database), if possible, but to integrate it into an existing > application as a crawler of Livelink server based sources. > > > > Based on your reply to my previous email, I assume there is no java > > based API to perform the above mentioned integration. I would like to > > ask if it's possible to perform the above integration with the rest > > API. I have been consulting the documentation from the ManifoldCF > > pages, but I'm very confused at this point. It would help me a great > > deal if you could provide me some ideas/bread crumbs on how the above > > can be implemented via ManifoldCF. > > > > Thanks, > > Pranesh Vadhirajan > > > > > > -----Original Message----- > > From: Karl Wright [mailto:[email protected]] > > Sent: Sunday, July 28, 2013 12:41 PM > > To: Pranesh Vadhirajan; [email protected] > > Subject: RE: How to connecto to LiveLink server via Java API > > > > Manifoldcf is not a library but is instead a full application. You do > > not want to be using a connector by itself; you need the rest of the > > application as well. You can configure a livelink connection either > > using the UI or the rest API. Please consult the documentation. > > > > Karl > > > > Sent from my Windows Phone > > From: Pranesh Vadhirajan > > Sent: 7/28/2013 11:16 AM > > To: [email protected] > > Subject: How to connecto to LiveLink server via Java API Hi Everyone, > > > > > > > > I'm very new to ApacheManifoldCF. I'm writing code to build a > > connector to a LiveLink server. I have been looking at the online > > java docs for ManifoldCF's LiveLink connector, but I'm confused on how to > use the API. > > It's my understanding that the class LiveLinkConnector from the > > package org.apache.manifoldcf.crawler.connectors.livelink can be used > > to connect to a LiveLink server. But this class seems to require > > configuration parameters that are set in the configParams class of the > > package org.apache.manifoldcf.core.interfaces. If this is the case, > > how can I set the configuration parameters of my LiveLink server > > connection using this approach? Also, is there a better approach to > > do this? I'm very unclear on how to write the connection. > > > > > > > > I am building an Eclipse based project and I have already done an ant > > build of all the ManifoldCF code necessary in order to use the API. I > > also have the lapi.jar in my build path, so I believe the necessary > > configurations to use the API are in place. > > > > > > > > I would greatly appreciate it if I can get some ideas on how to build > > the connector through the API. Example code would be greatly > appreciated. > > > > > > > > Thanks, > > > > Pranesh > > > > > > > > >
