Great work Lewis and thanks Radoslaw ++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++ Chris Mattmann, Ph.D. Chief Architect Instrument Software and Science Data Systems Section (398) NASA Jet Propulsion Laboratory Pasadena, CA 91109 USA Office: 168-519, Mailstop: 168-527 Email: [email protected] WWW: http://sunset.usc.edu/~mattmann/ ++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++ Adjunct Associate Professor, Computer Science Department University of Southern California, Los Angeles, CA 90089 USA ++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++
-----Original Message----- From: Lewis John Mcgibbney <[email protected]> Reply-To: "[email protected]" <[email protected]> Date: Tuesday, January 27, 2015 at 3:02 PM To: Radoslaw Stankiewicz <[email protected]> Cc: "[email protected]" <[email protected]> Subject: Re: A new comment has been published on a repository you own >Hi Radek, > >CC'd [email protected] >Thanks for quick response, I really appreciate this :) > >Please see my responses inline > > >On Tue, Jan 27, 2015 at 2:27 PM, Radoslaw Stankiewicz ><[email protected]> wrote: > > > >thanks for a comment. I’m glad you like it. > > > > > >Yep, I love it :) > > > >Of course I can cotribute my containter - just tell me how can I do this. > > > > > >OK, well I created two things to help drive this on > >* I've added a docker directory to the Nutch 2.X source code [0]. >Although this is empty we will be gathering community contributions and >making them available there >* I've created an issue on our Jira issue tracker [1] to make sure that >we track the integration of the container into the Nutch codebase. I feel >that if we can upgrade the Gora dependency to Gora 0.6 (which the Gora >community is in the process of releasing) > then we can upograde your image to use Hadoop 2.X and HBase 0.98.X > >It would be excellent if you could check out a version of the Nutch 2.X >source code from [2], then create a patch file and submit it to the Jira >issue at [1]. I will then review and we can hopefully commit it to the >codebase with the aim of releasing Gora > 0.6 and then working to upgrade the container to the newer dependencies >mentioned above. > >[0] http://svn.apache.org/repos/asf/nutch/branches/2.x/docker/ >[1] https://issues.apache.org/jira/browse/NUTCH-1924 >[2] http://svn.apache.org/repos/asf/nutch/branches/2.x/ > > > > > >best regards, >Radek Stankiewicz > > >PS. >I created this image because 2 months ago I had a project recently with >Nutch 2.1 or later - I tried to find working configuration with hadoop >and nosql database. > > > > > >Unfortunately the gora-nosql module is now deprecated within Nutch 2.X. > > > >I tried to configure Nutch 2.X to work with latest hadoop (2.4 or 2.6) >but I failed. I tried different versions of Gora, accumulo, hbase. > > > > > >Yes this can be very painful sometimes. The feedback the Nutch developers >got from ApacheCon EU in Budapest was that we needed a Docket container >for the various Nutch 2.X flavours. > > > >I only succeeded with version you’ve commented. > > > > > > > >Fantastic, I am glad to hear that. > > > > > >Now I can see that 5 days ago there was release and it may be possible to >create working docker image for hadoop 2.4, accumulo 1.5.1 and nutch 2.3. > > > > > > > >Yes I think that an Accumulo Docker image would be excellent as well. >Please feel free to sign up for Jira and create a child issue here [3] > >[3] https://issues.apache.org/jira/browse/NUTCH-1900 > > > >But hbase version is quite old, major Hadoop distributions comes with >0.98 or later. > > > > > > > >Yes we can work on this once we have release Gora 0.6. >Thank you very much. It is great that you are willing to contribute to >the Nutch project and I am very much looking forward to everyone >benefiting from these containers. >Lewis > > > > > > > > >Begin forwarded message: > >On wtorek, sty 27, 2015 at 9:36 PM, >[email protected] <mailto:[email protected]> ><[email protected]>, wrote: > >Hi stankiewicz, > >We just wanted to let you know that someone left a comment on your >stankiewicz/hbase_hadoop_nutch repository on the docker registry. >The user lewismc wrote: > >"Hi @stankiewicz, I am Lewis McGibbney one of the Nutch PMC and >developers of the Nutch 2.X branch. I wonder if you would be interested >in formally contributing your container to the Nutch project? >Our 2.X roadmap has Docket containers as high priority >https://wiki.apache.org/nutch/Nutch2Roadmap >Please also see >https://issues.apache.org/jira/browse/NUTCH-1900 >Thank you and great work on your container this looks excellent." > > > > >On wtorek, sty 27, 2015 at 9:36 PM, >[email protected] <mailto:[email protected]> ><[email protected]>, wrote: > >Hi stankiewicz, > >We just wanted to let you know that someone left a comment on your >stankiewicz/hbase_hadoop_nutch repository on the docker registry. >The user lewismc wrote: > >"Hi @stankiewicz, I am Lewis McGibbney one of the Nutch PMC and >developers of the Nutch 2.X branch. I wonder if you would be interested >in formally contributing your container to the Nutch project? >Our 2.X roadmap has Docket containers as high priority >https://wiki.apache.org/nutch/Nutch2Roadmap >Please also see >https://issues.apache.org/jira/browse/NUTCH-1900 >Thank you and great work on your container this looks excellent." > > > > > > > > >-- >Lewis > > > >
