Hi Dave, My advice would be to leave your resources out of the plugins, if there is a configuration file (or additional files), just load what you need from the conf directory if the files dictionary can change just make it configurable on the nutch-site.xml.
Best Regards, Jorge PS: You can take a look at how additional files are loaded on the different Nutch plugins. On Thu, Jun 29, 2017 at 5:36 PM SJC Multimedia <[email protected]> wrote: > Thing I have already tried is to bundle these resources in the job jar > and load them from the > classpath but that didn't work. I also tried copying them to HDFS and > loading them from there but that too failed. > > > What is the best way to bundle such static resources and reference > them in the custom plugin? > > > Thanks > > Akshar > > > > On Thu, Jun 29, 2017 at 8:28 AM, SJC Multimedia <[email protected]> > wrote: > > > I am building a custom plugin in Nutch 2.3.1 on Hadoop/HBase. In the > > plugin code, I need to pull in a dictionary of files and run some > > comparisons while parsing the document. > > > > Is there a way to include directory of files through the custom plugin > ant > > build framework that will work on both local and cluster(hadoop MR) mode? > > > > Any pointers will be helpful. > > > > Thanks > > Dave > > >
