Okay makes sense. If you dont mind can you point me to a specific plugin that does something similar?
On Thu, Jun 29, 2017 at 8:39 AM, Jorge Betancourt < [email protected]> wrote: > Hi Dave, > > My advice would be to leave your resources out of the plugins, if there is > a configuration file (or additional files), just load what you need from > the conf directory if the files dictionary can change just make it > configurable on the nutch-site.xml. > > Best Regards, > Jorge > > PS: You can take a look at how additional files are loaded on the different > Nutch plugins. > > On Thu, Jun 29, 2017 at 5:36 PM SJC Multimedia <[email protected]> > wrote: > > > Thing I have already tried is to bundle these resources in the job jar > > and load them from the > > classpath but that didn't work. I also tried copying them to HDFS and > > loading them from there but that too failed. > > > > > > What is the best way to bundle such static resources and reference > > them in the custom plugin? > > > > > > Thanks > > > > Akshar > > > > > > > > On Thu, Jun 29, 2017 at 8:28 AM, SJC Multimedia <[email protected] > > > > wrote: > > > > > I am building a custom plugin in Nutch 2.3.1 on Hadoop/HBase. In the > > > plugin code, I need to pull in a dictionary of files and run some > > > comparisons while parsing the document. > > > > > > Is there a way to include directory of files through the custom plugin > > ant > > > build framework that will work on both local and cluster(hadoop MR) > mode? > > > > > > Any pointers will be helpful. > > > > > > Thanks > > > Dave > > > > > >
