[jira] Updated: (NUTCH-251) Administration GUI
[ https://issues.apache.org/jira/browse/NUTCH-251?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chris A. Mattmann updated NUTCH-251: Patch Info: [Patch Available] Fix Version/s: (was: 1.1) - pushing this out per http://bit.ly/c7tBv9 (comment from me: would be nice to get this into 1.2) Administration GUI -- Key: NUTCH-251 URL: https://issues.apache.org/jira/browse/NUTCH-251 Project: Nutch Issue Type: Improvement Affects Versions: 0.8 Reporter: Stefan Groschupf Priority: Minor Attachments: hadoop_nutch_gui_v1.patch, Nutch-251-AdminGUI.tar.gz, nutch_gui_plugins_v1.zip, nutch_gui_v1.patch Having a web based administration interface would help to make nutch administration and management much more user friendly. -- This message is automatically generated by JIRA. - You can reply to this email to add a comment to the issue online.
[jira] Updated: (NUTCH-251) Administration GUI
[ https://issues.apache.org/jira/browse/NUTCH-251?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrzej Bialecki updated NUTCH-251: Fix Version/s: (was: 1.0.0) 1.1 Administration GUI -- Key: NUTCH-251 URL: https://issues.apache.org/jira/browse/NUTCH-251 Project: Nutch Issue Type: Improvement Affects Versions: 0.8 Reporter: Stefan Groschupf Priority: Minor Fix For: 1.1 Attachments: hadoop_nutch_gui_v1.patch, Nutch-251-AdminGUI.tar.gz, nutch_gui_plugins_v1.zip, nutch_gui_v1.patch Having a web based administration interface would help to make nutch administration and management much more user friendly. -- This message is automatically generated by JIRA. - You can reply to this email to add a comment to the issue online.
[jira] Updated: (NUTCH-251) Administration GUI
[ http://issues.apache.org/jira/browse/NUTCH-251?page=all ] Enis Soztutar updated NUTCH-251: Attachment: Nutch-251-AdminGUI.tar.gz I have updated the patch written by stephan. This version works with Nutch-0.9-dev and hadoop-0.7.1 (current version of nutch so far) First extract the tar.gaz file into the root of nutch. It should copy src/plugin/admin-* lib/xalan.jar lib/serializer.jar and lib/hadoop-0.7.2-dev.jar hadoop_0.7.1_nutch_gui_v2.patch nutch_0.9-dev_gui_v2.patch then patch nutch with patch -p0 nutch_0.9-dev_gui_v2.patch (you can test the patch first by running : patch -p0 --dry-run nutch_0.9-dev_gui_v2.patch Patched hadoop is included in the archive, but if you wish you can patch hadoop using patch -p0 hadoop_0.7.1_nutch_gui_v2.patch I have : converted necessary java.io.File fields and arguments to org.apache.hadoop.fs.Path replaced deprecated LogFormatter's with LogFactory's used generics with collections(changed only that I've seen) written PathSerializable which is implements Serializable interface(needed for scheduling) Some hadoop changes and some changes due to hadoop conflicts. I have not tested every feature of this plugin so, there still can be some bugs. Administration GUI -- Key: NUTCH-251 URL: http://issues.apache.org/jira/browse/NUTCH-251 Project: Nutch Issue Type: Improvement Affects Versions: 0.8 Reporter: Stefan Groschupf Priority: Minor Fix For: 0.9.0 Attachments: hadoop_nutch_gui_v1.patch, Nutch-251-AdminGUI.tar.gz, nutch_gui_plugins_v1.zip, nutch_gui_v1.patch Having a web based administration interface would help to make nutch administration and management much more user friendly. -- This message is automatically generated by JIRA. - If you think it was sent incorrectly contact one of the administrators: http://issues.apache.org/jira/secure/Administrators.jspa - For more information on JIRA, see: http://www.atlassian.com/software/jira
Re: [jira] Updated: (NUTCH-251) Administration GUI
Super Thanks! Now I can give it a go! Cheers! On 11/23/06, Enis Soztutar (JIRA) [EMAIL PROTECTED] wrote: [ http://issues.apache.org/jira/browse/NUTCH-251?page=all ] Enis Soztutar updated NUTCH-251: Attachment: Nutch-251-AdminGUI.tar.gz I have updated the patch written by stephan. This version works with Nutch-0.9-dev and hadoop-0.7.1 (current version of nutch so far) First extract the tar.gaz file into the root of nutch. It should copy src/plugin/admin-* lib/xalan.jar lib/serializer.jar and lib/hadoop-0.7.2-dev.jar hadoop_0.7.1_nutch_gui_v2.patch nutch_0.9-dev_gui_v2.patch then patch nutch with patch -p0 nutch_0.9-dev_gui_v2.patch (you can test the patch first by running : patch -p0 --dry-run nutch_0.9-dev_gui_v2.patch Patched hadoop is included in the archive, but if you wish you can patch hadoop using patch -p0 hadoop_0.7.1_nutch_gui_v2.patch I have : converted necessary java.io.File fields and arguments to org.apache.hadoop.fs.Path replaced deprecated LogFormatter's with LogFactory's used generics with collections(changed only that I've seen) written PathSerializable which is implements Serializable interface(needed for scheduling) Some hadoop changes and some changes due to hadoop conflicts. I have not tested every feature of this plugin so, there still can be some bugs. Administration GUI -- Key: NUTCH-251 URL: http://issues.apache.org/jira/browse/NUTCH-251 Project: Nutch Issue Type: Improvement Affects Versions: 0.8 Reporter: Stefan Groschupf Priority: Minor Fix For: 0.9.0 Attachments: hadoop_nutch_gui_v1.patch, Nutch-251-AdminGUI.tar.gz, nutch_gui_plugins_v1.zip, nutch_gui_v1.patch Having a web based administration interface would help to make nutch administration and management much more user friendly. -- This message is automatically generated by JIRA. - If you think it was sent incorrectly contact one of the administrators: http://issues.apache.org/jira/secure/Administrators.jspa - For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] Updated: (NUTCH-251) Administration GUI
[ http://issues.apache.org/jira/browse/NUTCH-251?page=all ] Sami Siren updated NUTCH-251: - Fix Version/s: 0.9-dev (was: 0.8-dev) Administration GUI -- Key: NUTCH-251 URL: http://issues.apache.org/jira/browse/NUTCH-251 Project: Nutch Issue Type: Improvement Affects Versions: 0.8-dev Reporter: Stefan Groschupf Priority: Minor Fix For: 0.9-dev Attachments: hadoop_nutch_gui_v1.patch, nutch_gui_plugins_v1.zip, nutch_gui_v1.patch Having a web based administration interface would help to make nutch administration and management much more user friendly. -- This message is automatically generated by JIRA. - If you think it was sent incorrectly contact one of the administrators: http://issues.apache.org/jira/secure/Administrators.jspa - For more information on JIRA, see: http://www.atlassian.com/software/jira
Re: [jira] Updated: (NUTCH-251) Administration GUI
Hi, the easiest way is to download one of the binary distributions. However as far I know the patches still work and need to be applied to both projects. Stefan Am 11.05.2006 um 08:38 schrieb TDLN: Hi Stephan. I am about to get started with the Admin GUI and was wondering if these instructions are . still valid. More in particular, is it still necessary to patch Hadoop, or has this patch already been integrated? Also do you know how the Nutch patches go with the latest revision? Rgrds, Thomas Delnoij How to: + checkout latest nutch sources + checkout hadoop sources + patch hadoop with the hadoop patch + build hadoop jar + remove old hadoop jar from nutch/lib + place new hadoop jar in nutch/lib + uncompress plugin zip file + place plugins in nutch/src/plugins (patch not possible since svn does not support binary patches) + patch nutch with nutch patch + start gui with bin/nutch gui folderWhereYourInstanceDataWillBeStored) + point your browser to: http://localhost:50060/general/ + username and password are admin. ( can be changed in nutch- default.xml) + select the default instance or create a new instance.
Re: [jira] Updated: (NUTCH-251) Administration GUI
I have my local changes, so I can't use the binary distribution. Anyway, I will have a go at it and let you know. Rgrds, Thomas On 5/11/06, Stefan Groschupf [EMAIL PROTECTED] wrote: Hi, the easiest way is to download one of the binary distributions. However as far I know the patches still work and need to be applied to both projects. Stefan Am 11.05.2006 um 08:38 schrieb TDLN: Hi Stephan. I am about to get started with the Admin GUI and was wondering if these instructions are . still valid. More in particular, is it still necessary to patch Hadoop, or has this patch already been integrated? Also do you know how the Nutch patches go with the latest revision? Rgrds, Thomas Delnoij How to: + checkout latest nutch sources + checkout hadoop sources + patch hadoop with the hadoop patch + build hadoop jar + remove old hadoop jar from nutch/lib + place new hadoop jar in nutch/lib + uncompress plugin zip file + place plugins in nutch/src/plugins (patch not possible since svn does not support binary patches) + patch nutch with nutch patch + start gui with bin/nutch gui folderWhereYourInstanceDataWillBeStored) + point your browser to: http://localhost:50060/general/ + username and password are admin. ( can be changed in nutch- default.xml) + select the default instance or create a new instance.
Re: [jira] Updated: (NUTCH-251) Administration GUI
Hi Thomas, 1) I am using local filesystem - as you say that local running jobs can not be stopped, does that imply that the scheduling is dysfunctional as well on local filesystem The gui fully works in a local file system and a local jobrunner, except of stopping a running job. http://mail-archives.apache.org/mod_mbox/lucene-hadoop-dev/ 200603.mbox/[EMAIL PROTECTED] 2) Do you think it makes sense to have a language bundle in Dutch - personally I don't, because I never meet a Dutch developer who doesn't speak English, but I could do it anyway. Getting as much as possible would increase the use friendliness. However we may be need to test it and fix bugs before we start to translate more the ui in more languages. 3) What you like to operate as a filter for the bugs before we add them to Jira, so that we don't post any known issues / duplicates. I created a component called administration gui, just attach bug reports under this component. If we all use the jira than we will know what are known problems. Thanks for all the work. Thanks for looking into it. Stefan
Re: [jira] Updated: (NUTCH-251) Administration GUI
One more question: and where shall we post questions about the admin gui, on the dev or the users list? Rgrds, Thomas Delnoij On 4/26/06, Stefan Groschupf [EMAIL PROTECTED] wrote: Hi Thomas, 1) I am using local filesystem - as you say that local running jobs can not be stopped, does that imply that the scheduling is dysfunctional as well on local filesystem The gui fully works in a local file system and a local jobrunner, except of stopping a running job. http://mail-archives.apache.org/mod_mbox/lucene-hadoop-dev/ 200603.mbox/[EMAIL PROTECTED] 2) Do you think it makes sense to have a language bundle in Dutch - personally I don't, because I never meet a Dutch developer who doesn't speak English, but I could do it anyway. Getting as much as possible would increase the use friendliness. However we may be need to test it and fix bugs before we start to translate more the ui in more languages. 3) What you like to operate as a filter for the bugs before we add them to Jira, so that we don't post any known issues / duplicates. I created a component called administration gui, just attach bug reports under this component. If we all use the jira than we will know what are known problems. Thanks for all the work. Thanks for looking into it. Stefan
