[
https://issues.apache.org/jira/browse/NUTCH-2307?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Work on NUTCH-2307 stopped by Lewis John McGibbney.
---
> Implement Missing NutchServer REST API Te
[
https://issues.apache.org/jira/browse/NUTCH-2307?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Lewis John McGibbney reassigned NUTCH-2307:
---
Assignee: Lewis John McGibbney
> Implement Missing NutchServer REST
Version/s: (was: 2.4)
2.5
> Implement Missing NutchServer REST API Tests
>
>
> Key: NUTCH-2307
> URL: https://issues.apache.org/jira/browse/NUTCH-2307
> Project: Nutc
Quick question about the NutchServer class. The JAXRSServerFactoryBean
documentation seems to ask for a call to close or destroy on the server it
creates, but I notice the NutchServer close simply calls system.exit(0) and
doesn't maintain a reference after the call to create().
Is this a possible
[
https://issues.apache.org/jira/browse/NUTCH-2307?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Work on NUTCH-2307 started by Furkan KAMACI.
> Implement Missing NutchServer REST API Te
] congratulations.
Please put together a wiki page under
http://wiki.apache.org/nutch/#Nutch_2.X_tutorial.28s.29
Thanks and again... congratulations.
> Security layer for NutchServer
> --
>
> Key: NUTCH-1756
>
yer for NutchServer
> --
>
> Key: NUTCH-1756
> URL: https://issues.apache.org/jira/browse/NUTCH-1756
> Project: Nutch
> Issue Type: Improvement
> Components: REST_api, web gui
>Rep
Furkan KAMACI created NUTCH-2307:
Summary: Implement Missing NutchServer REST API Tests
Key: NUTCH-2307
URL: https://issues.apache.org/jira/browse/NUTCH-2307
Project: Nutch
Issue Type
://builds.apache.org/job/Nutch-nutchgora/1571/])
NUTCH-2301 Tests for Security Layer of NutchServer Are Created (furkankamaci:
rev 3bc3d81e964aac59f61951740e848bd429a15b3c)
* (add) src/test/org/apache/nutch/api/TestNutchAPI.java
* (edit) src/test/nutch-site.xml
* (add) src/test/nutch-ssl.keystore.jks
[
https://issues.apache.org/jira/browse/NUTCH-2301?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Furkan KAMACI resolved NUTCH-2301.
--
Resolution: Fixed
> Create Tests for Security Layer of NutchSer
://github.com/apache/nutch/pull/146
> Create Tests for Security Layer of NutchServer
> --
>
> Key: NUTCH-2301
> URL: https://issues.apache.org/jira/browse/NUTCH-2301
> Project: Nutch
>
Github user asfgit closed the pull request at:
https://github.com/apache/nutch/pull/146
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is
://github.com/apache/nutch/pull/146
NUTCH-2301 Tests for Security Layer of NutchServer
You can merge this pull request into a Git repository by running:
$ git pull https://github.com/kamaci/nutch NUTCH-2301
Alternatively you can review and apply these changes as the patch at:
https
GitHub user kamaci opened a pull request:
https://github.com/apache/nutch/pull/146
NUTCH-2301 Tests for Security Layer of NutchServer
You can merge this pull request into a Git repository by running:
$ git pull https://github.com/kamaci/nutch NUTCH-2301
Alternatively you can
://builds.apache.org/job/Nutch-nutchgora/1570/])
NUTCH-2303 NutchServer Could Be Able To Select a Configuration to Use
(furkankamaci: rev 6227f3b171b67e790a089d6fee4d3c65de0e0ee1)
* (edit) src/java/org/apache/nutch/api/NutchServer.java
* (edit) src/java/org/apache/nutch/api/security/SecurityUtil.java
://github.com/apache/nutch/pull/144
> NutchServer Could Be Able To Select a Configuration to Use
> --
>
> Key: NUTCH-2303
> URL: https://issues.apache.org/jira/browse/NUTCH-2303
>
Github user asfgit closed the pull request at:
https://github.com/apache/nutch/pull/144
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is
[
https://issues.apache.org/jira/browse/NUTCH-2303?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Lewis John McGibbney resolved NUTCH-2303.
-
Resolution: Fixed
Thanks [~kamaci].
> NutchServer Could Be Able To Sel
[
https://issues.apache.org/jira/browse/NUTCH-2303?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15432541#comment-15432541
]
Furkan KAMACI commented on NUTCH-2303:
--
[~lewismc] I've created the PR.
> NutchServer Could Be A
://github.com/apache/nutch/pull/144
NUTCH-2303 NutchServer Could Be Able To Select a Configuration to Use
You can merge this pull request into a Git repository by running:
$ git pull https://github.com/kamaci/nutch NUTCH-2303_2
Alternatively you can review and apply these changes
GitHub user kamaci opened a pull request:
https://github.com/apache/nutch/pull/144
NUTCH-2303 NutchServer Could Be Able To Select a Configuration to Use
You can merge this pull request into a Git repository by running:
$ git pull https://github.com/kamaci/nutch NUTCH-2303_2
[
https://issues.apache.org/jira/browse/NUTCH-2301?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Work on NUTCH-2301 started by Furkan KAMACI.
> Create Tests for Security Layer of NutchSer
and
combined that commits into one. Could you check the PR again?)
> NutchServer Could Be Able To Select a Configuration to Use
> --
>
> Key: NUTCH-2303
> URL: https://issues.apache.org/jira/br
class and combined
that commits into one. Could you check the PR again?
> NutchServer Could Be Able To Select a Configuration to Use
> --
>
> Key: NUTCH-2303
> URL: https://issues.apache.org/ji
the public methods you've produced.
It would be great to see tests.
It would also be great to see a wiki page for everything you've done. Otherwise
no-one knows how to use any of it.
Thanks [~kamaci] good work.
> NutchServer Could Be Able To Select a Configuration to
NUTCH-2302 to be
applied.
> NutchServer Could Be Able To Select a Configuration to Use
> --
>
> Key: NUTCH-2303
> URL: https://issues.apache.org/jira/browse/NUTCH-2303
>
Furkan KAMACI created NUTCH-2303:
Summary: NutchServer Could Be Able To Select a Configuration to Use
Key: NUTCH-2303
URL: https://issues.apache.org/jira/browse/NUTCH-2303
Project: Nutch
[
https://issues.apache.org/jira/browse/NUTCH-2303?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Work on NUTCH-2303 started by Furkan KAMACI.
> NutchServer Could Be Able To Select a Configuration to
Furkan KAMACI created NUTCH-2301:
Summary: Create Tests for Security Layer of NutchServer
Key: NUTCH-2301
URL: https://issues.apache.org/jira/browse/NUTCH-2301
Project: Nutch
Issue Type: Sub
://github.com/apache/nutch/pull/142 could you check them?
> Security layer for NutchServer
> --
>
> Key: NUTCH-1756
> URL: https://issues.apache.org/jira/browse/NUTCH-1756
> Project: Nutch
> Is
of this issue? Can you please let me know
what is going on. Thank you very much.
> Security layer for NutchServer
> --
>
> Key: NUTCH-1756
> URL: https://issues.apache.org/jira/browse/NUTCH-1756
> Project: Nutch
>
Hi All,
I am a GSoC 2016 student with my proposal: Security Layer for NutchServer (
NUTCH-1756) at Apache Nutch which will be an implementation for Nutch 2.x.
Today is the deadline for midterm reports and I wanted to inform you about
my current progress. I'm aligned with my timeline and I've
Hi,
I am a GSoC 2016 student with my proposal: Security Layer for NutchServer
(NUTCH-1756) at Apache Nutch which will be an implementation for Nutch 2.x.
For my GSoC task:
I've linked all that issues:
https://issues.apache.org/jira/browse/NUTCH-1756
https://issues.apache.org/jira/browse/NUTCH
Hi,
I'm glad that I've been selected for GSoC 2016 for my proposal: Security
Layer for NutchServer (NUTCH-1756).
I'm planning to implement all new features for Nutch 2.x. I have some
questions and ideas for that. Firstly, I'm planning to link all these
issues:
https://issues.apache.org/jira
[
https://issues.apache.org/jira/browse/NUTCH-1756?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Lewis John McGibbney updated NUTCH-1756:
Description:
It will be beneficial to have a security layer for NutchServer once we
[
https://issues.apache.org/jira/browse/NUTCH-1756?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Lewis John McGibbney updated NUTCH-1756:
Labels: gsoc2016 (was: )
> Security layer for NutchSer
. I've shared my
draft for your comments via Google Summer of Code website to ASF.
> Security layer for NutchServer
> --
>
> Key: NUTCH-1756
> URL: https://issues.apache.org/jira/browse/NUTCH-1756
>
Lewis John McGibbney created NUTCH-2116:
---
Summary: NutchServer and NutchApp should contain shutdown hooks
Key: NUTCH-2116
URL: https://issues.apache.org/jira/browse/NUTCH-2116
Project: Nutch
[
https://issues.apache.org/jira/browse/NUTCH-2117?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Lewis John McGibbney resolved NUTCH-2117.
-
Resolution: Fixed
Committed @revision 1704972 in trunk.
> NutchServer CLI Opt
Lewis John McGibbney created NUTCH-2117:
---
Summary: NutchServer CLI Option for CMD_PORT is incorrect and
should be CMD_HOST
Key: NUTCH-2117
URL: https://issues.apache.org/jira/browse/NUTCH-2117
/job/Nutch-trunk/3282/])
NUTCH-2117 NutchServer CLI Option for CMD_PORT is incorrect and should be
CMD_HOST this closes #63 (lewismc:
http://svn.apache.org/viewvc/nutch/trunk/?view=rev=1704972)
* /nutch/trunk/CHANGES.txt
* /nutch/trunk/src/java/org/apache/nutch/service/NutchServer.java
sec
[junit] Running org.apache.nutch.tika.TestRobotsMetaProcessor
[junit] Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed:
4.861 sec
test:
BUILD SUCCESSFUL
Total time: 8 minutes 38 seconds
[chipotle:~/tmp/nutch1.11] mattmann%
{noformat}
> Unit Test for NutchSer
[
https://issues.apache.org/jira/browse/NUTCH-2092?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14742151#comment-14742151
]
Chris A. Mattmann commented on NUTCH-2092:
--
commiting
> Unit Test for NutchSer
[
https://issues.apache.org/jira/browse/NUTCH-2092?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Chris A. Mattmann reassigned NUTCH-2092:
Assignee: Chris A. Mattmann
> Unit Test for NutchSer
[
https://issues.apache.org/jira/browse/NUTCH-2092?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Work on NUTCH-2092 started by Chris A. Mattmann.
> Unit Test for NutchSer
://github.com/apache/nutch/pull/54
> Unit Test for NutchServer
> -
>
> Key: NUTCH-2092
> URL: https://issues.apache.org/jira/browse/NUTCH-2092
> Project: Nutch
> Issue Type: Sub-task
>
commit -m "Fix for NUTCH-2092: Unit
Test for NutchServer contributedy by Sujen Shah
<sujen@Sujens-MacBook-Pro.local> this closes #54."
SendingCHANGES.txt
Sendingivy/ivy.xml
Sendingsrc/java/org/apache/nutch/service/NutchServer.java
Adding src/test/
/job/Nutch-trunk/3270/])
Fix for NUTCH-2092: Unit Test for NutchServer contributedy by Sujen Shah
<sujen@Sujens-MacBook-Pro.local> this closes #54. (mattmann:
http://svn.apache.org/viewvc/nutch/trunk/?view=rev=1702654)
* /nutch/trunk/CHANGES.txt
* /nutch/trunk/ivy/ivy.xml
* /nutch/trunk/src/ja
Sujen Shah created NUTCH-2092:
-
Summary: Unit Test for NutchServer
Key: NUTCH-2092
URL: https://issues.apache.org/jira/browse/NUTCH-2092
Project: Nutch
Issue Type: Sub-task
Components
015-09-09T04:07:51Z
Unit test for NutchServer
> Unit Test for NutchServer
> -
>
> Key: NUTCH-2092
> URL: https://issues.apache.org/jira/browse/NUTCH-2092
> Project: Nutch
> Issue Type: Sub
:
https://github.com/apache/nutch/pull/54#discussion_r39007826
--- Diff: ivy/ivy.xml ---
@@ -76,6 +76,7 @@
+
--- End diff --
Please set scope to test.
> Unit Test for NutchSer
s can be seen within the remainder of the code and there is also an
existing eclipse code formatter if you would like to import and use that.
> Unit Test for NutchServer
> -
>
> Key: NUTCH-2092
> URL: https://issue
have been addressed looks good.)
> Unit Test for NutchServer
> -
>
> Key: NUTCH-2092
> URL: https://issues.apache.org/jira/browse/NUTCH-2092
> Project: Nutch
> Issue Type: Sub-task
>
) {
+ NutchServer.port = port;
--- End diff --
Formatting
> Unit Test for NutchServer
> -
>
> Key: NUTCH-2092
> URL: https://issues.apache.org/jira/browse/NUTCH-2092
> Project: Nutch
>
- tests pass, should avoid the high memory usage (I didn't really test it ;))
- to be formatted using
[eclipse-codeformat.xml|http://svn.apache.org/viewvc/nutch/branches/2.x/eclipse-codeformat.xml]
Make FetchNodeDb optional (off by default) if NutchServer is not used
!
Make FetchNodeDb optional (off by default) if NutchServer is not used
-
Key: NUTCH-2015
URL: https://issues.apache.org/jira/browse/NUTCH-2015
Project: Nutch
Issue Type
at:
https://github.com/apache/nutch/pull/25
Make FetchNodeDb optional (off by default) if NutchServer is not used
-
Key: NUTCH-2015
URL: https://issues.apache.org/jira/browse/NUTCH-2015
Make FetchNodeDb optional (off by default) if
NutchServer is not used contributed by Sujen Shah this closes #25
/Users/mattmann/src/nutch/src/java/org/apache/nutch/fetcher/FetcherThread.java
/Users/mattmann/src/nutch/CHANGES.txt
Sending/Users/mattmann/src/nutch/CHANGES.txt
Sending
://builds.apache.org/job/Nutch-trunk/3147/])
- fix for NUTCH-2015 Make FetchNodeDb optional (off by default) if NutchServer
is not used contributed by Sujen Shah this closes #25 (mattmann:
http://svn.apache.org/viewvc/nutch/trunk/?view=revrev=1683039)
* /nutch/trunk/CHANGES.txt
* /nutch/trunk/src/java
are we on this?
Make FetchNodeDb optional (off by default) if NutchServer is not used
-
Key: NUTCH-2015
URL: https://issues.apache.org/jira/browse/NUTCH-2015
Project: Nutch
suggested. Have put the parsing and the server state
check outside the loop and created new FetchNodes only if both conditions are
true.
Make FetchNodeDb optional (off by default) if NutchServer is not used
-
Key
, will update the PR in sometime.
Thanks.
Make FetchNodeDb optional (off by default) if NutchServer is not used
-
Key: NUTCH-2015
URL: https://issues.apache.org/jira/browse/NUTCH-2015
] and [~sujenshah] any updates here?
Make FetchNodeDb optional (off by default) if NutchServer is not used
-
Key: NUTCH-2015
URL: https://issues.apache.org/jira/browse/NUTCH-2015
Project
FetchNodeDb optional (off by default) if NutchServer is not used
-
Key: NUTCH-2015
URL: https://issues.apache.org/jira/browse/NUTCH-2015
Project: Nutch
Issue Type: Sub-task
a chance to make updates here?
Make FetchNodeDb optional (off by default) if NutchServer is not used
-
Key: NUTCH-2015
URL: https://issues.apache.org/jira/browse/NUTCH-2015
Project
the wiki for Nutch to include more REST API
docs?
https://wiki.apache.org/nutch/Nutch_1.X_RESTAPI
Make FetchNodeDb optional (off by default) if NutchServer is not used
-
Key: NUTCH-2015
URL: https
) if NutchServer is not used
-
Key: NUTCH-2015
URL: https://issues.apache.org/jira/browse/NUTCH-2015
Project: Nutch
Issue Type: Sub-task
Components: fetcher, REST_api
? Can we commit the pull request?
Make FetchNodeDb optional (off by default) if NutchServer is not used
-
Key: NUTCH-2015
URL: https://issues.apache.org/jira/browse/NUTCH-2015
[
https://issues.apache.org/jira/browse/NUTCH-2015?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Work on NUTCH-2015 started by Chris A. Mattmann.
Make FetchNodeDb optional (off by default) if NutchServer is not used
changes.
Thanks!
Make FetchNodeDb optional (off by default) if NutchServer is not used
-
Key: NUTCH-2015
URL: https://issues.apache.org/jira/browse/NUTCH-2015
Project: Nutch
optional (off by default) if NutchServer is not used
-
Key: NUTCH-2015
URL: https://issues.apache.org/jira/browse/NUTCH-2015
Project: Nutch
Issue Type: Sub-task
Sujen Shah created NUTCH-2015:
-
Summary: Make FetchNodeDb optional (off by default) if NutchServer
is not used
Key: NUTCH-2015
URL: https://issues.apache.org/jira/browse/NUTCH-2015
Project: Nutch
: 2015-05-16T08:32:36Z
Creation of FetchNodes is off by default if NutchServer is not used
Make FetchNodeDb optional (off by default) if NutchServer is not used
-
Key: NUTCH-2015
Make FetchNodeDb optional (off by default) if NutchServer is not used
-
Key: NUTCH-2015
URL: https://issues.apache.org/jira/browse/NUTCH-2015
Project: Nutch
Issue Type: Sub
Dear Wiki user,
You have subscribed to a wiki page or wiki category on Nutch Wiki for change
notification.
The bin/nutch nutchserver page has been changed by LewisJohnMcgibbney:
https://wiki.apache.org/nutch/bin/nutch%20nutchserver?action=diffrev1=2rev2=3
+ nutchserver is an alias
Dear Wiki user,
You have subscribed to a wiki page or wiki category on Nutch Wiki for change
notification.
The bin/nutch nutchserver page has been changed by LewisJohnMcgibbney:
https://wiki.apache.org/nutch/bin/nutch%20nutchserver?action=diffrev1=3rev2=4
- nutchserver is an alias
[
https://issues.apache.org/jira/browse/NUTCH-1851?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Work on NUTCH-1851 started by Lewis John McGibbney.
---
Add/Update wiki pages for NutchServer and WebApp
Lewis John McGibbney created NUTCH-1851:
---
Summary: Add/Update wiki pages for NutchServer and WebApp
Key: NUTCH-1851
URL: https://issues.apache.org/jira/browse/NUTCH-1851
Project: Nutch
[~fjodor.vershinin] :)
I changed some trivial things for logging and for argument params. Tested patch
from different terminals and all working fine.
Better cmd line parsing for NutchServer
---
Key: NUTCH-1731
URL: https
Lewis John McGibbney created NUTCH-1756:
---
Summary: Security layer for NutchServer
Key: NUTCH-1756
URL: https://issues.apache.org/jira/browse/NUTCH-1756
Project: Nutch
Issue Type
see this issue also for GSoC inclusion. Maybe it
is something we can work towards :)
Security layer for NutchServer
--
Key: NUTCH-1756
URL: https://issues.apache.org/jira/browse/NUTCH-1756
Project: Nutch
Issue
please provide your wiki username to me via lewismc
[at] apache [dot] org and I will add you so we cann add documentation for the
NutchServer tool. Thank you v much.
Better cmd line parsing for NutchServer
---
Key: NUTCH-1731
://builds.apache.org/job/Nutch-nutchgora/987/])
NUTCH-1731 Better cmd line parsing for NutchServer (lewismc:
http://svn.apache.org/viewvc/nutch/branches/2.x/?view=revrev=1587275)
* /nutch/branches/2.x/CHANGES.txt
* /nutch/branches/2.x/conf/log4j.properties
* /nutch/branches/2.x/src/java/org/apache
feature, also some refactoring in
AdminResource class and NutchServer. All changes are in commandline.patch file.
There could be be some issues concerning English texts, but I think [~lewismc]
can fix it. After this feature will be merged into mainline, I'll update wiki.
Better cmd line parsing
tomorrow. The patch looks pretty good though from what
I can see.
Better cmd line parsing for NutchServer
---
Key: NUTCH-1731
URL: https://issues.apache.org/jira/browse/NUTCH-1731
Project: Nutch
Issue Type
this issue.
So, main problem is NutchServer runs every time in other JVM, so,
NutchApp.server reference can't work. We should connect to running NutchServer
by using restful API.
I am working on patch now, which removes mandatory keys from NutchServer
command, because it makes application startup much
:
-
I made some investigations about this issue.
So, main problem is NutchServer runs every time in other JVM, so,
NutchApp.server reference can't work. We should connect to running NutchServer
by using restful API.
I am working on patch now, which removes mandatory keys from NutchServer
[
https://issues.apache.org/jira/browse/NUTCH-1731?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Lewis John McGibbney updated NUTCH-1731:
Patch Info: Patch Available
Better cmd line parsing for NutchServer
it would be good.
Thanks
Better cmd line parsing for NutchServer
---
Key: NUTCH-1731
URL: https://issues.apache.org/jira/browse/NUTCH-1731
Project: Nutch
Issue Type: Improvement
Components
[
https://issues.apache.org/jira/browse/NUTCH-1731?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Lewis John McGibbney updated NUTCH-1731:
Attachment: (was: NUTCH-1731.patch)
Better cmd line parsing for NutchServer
the Nutch server statically
through NutchApp like so
NutchApp.server.canStop()
It throws NPE. I'll try and fix this later on.
Starting the server now enables configuration of port and logging level.
Better cmd line parsing for NutchServer
Lewis John McGibbney created NUTCH-1731:
---
Summary: Add stop flag to NutchServer
Key: NUTCH-1731
URL: https://issues.apache.org/jira/browse/NUTCH-1731
Project: Nutch
Issue Type
[
https://issues.apache.org/jira/browse/NUTCH-1731?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Lewis John McGibbney updated NUTCH-1731:
Summary: Better cmd line parsing for NutchServer (was: Add stop flag
[
https://issues.apache.org/jira/browse/NUTCH-1731?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Lewis John McGibbney reassigned NUTCH-1731:
---
Assignee: Lewis John McGibbney
Better cmd line parsing for NutchServer
[
https://issues.apache.org/jira/browse/NUTCH-1731?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Work on NUTCH-1731 started by Lewis John McGibbney.
Better cmd line parsing for NutchServer
---
Key: NUTCH-1731
Dear Wiki user,
You have subscribed to a wiki page or wiki category on Nutch Wiki for change
notification.
The bin/nutch nutchserver page has been changed by kiranchitturi:
http://wiki.apache.org/nutch/bin/nutch%20nutchserver
New page:
{{{
Usage: NutchServer port
}}}
96 matches
Mail list logo
