On Sun, Jan 26, 2014 at 9:45 PM, rashmi maheshwari < [email protected]> wrote:
> Thanks Tejas and Ahmet for quick response. > > > Could I give intranet web url, file folder path and sharepoint url in same > seed.txt file under urls folder in nutch? > Yes. Please see this tutorial for crawling : http://wiki.apache.org/nutch/NutchTutorial > > > Regards, > Rashmi > > ---------- Forwarded message ---------- > From: Tejas Patil <[email protected]> > Date: Sun, Jan 26, 2014 at 9:39 PM > Subject: Re: Search Engine Framework decision > To: "[email protected]" <[email protected]> > > > On Sun, Jan 26, 2014 at 8:55 PM, rashmi maheshwari < > [email protected]> wrote: > > > Hi, > > > > I want to create a POC to search INTRANET along with documents uploaded > on > > intranet. Documents(PDF, excel, word document, text files, images, > videos) > > are also exists on SHAREPOINT. sharepoint has Authentication access at > > module level(folder level). > > > > My interanet website is http://myintranet/ <http://sparsh/> . and > > Sharepoint url is different. Documents also exist in file folders. > > > > I have below queries: > > A) Which crawler framework do I use along with Solr for this POC, "Nutch" > > or "Apache ManifoldCF"? > > > > > > B) Is it possible to crawl Sharepoint documents usiing Nutch? If yes, > only > > configuration level change would make this possible? or I have to write > > code to parse and send to solr? > > > > As long you have http:// or https:// for the documents (and there is no > weird IIS authentication), Nutch should be able to do this. Nutch delegates > parsing of documents to Apache Tika. So you need to check if Tika supports > parsing of the documents you need. > > > > > C) Which version of Solr+nutch+MCF should be used? because nutch version > > has dependency on solr version. wold nutch 1.7 works properly with solr > > 4.6.0? > > > > I have not used MCF so would leave this question for others. Nutch 1.7 + > Solr 4.5 works fine. > > > > -- > > Rashmi > > Be the change that you want to see in this world! > > > > > > > > > > -- > > Rashmi > > Be the change that you want to see in this world! > > www.minnal.zor.org > > disha.resolve.at > > www.artofliving.org > > > > > > -- > Rashmi > Be the change that you want to see in this world! > www.minnal.zor.org > disha.resolve.at > www.artofliving.org >
