[
https://issues.apache.org/jira/browse/NUTCH-2883?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17376989#comment-17376989
]
ASF GitHub Bot commented on NUTCH-2883:
---------------------------------------
lewismc commented on pull request #691:
URL: https://github.com/apache/nutch/pull/691#issuecomment-876084540
@sebastian-nagel here's what I tried. First prune entire Docker development
cache
```
docker system prune -a
...
Total reclaimed space: 14.1GB
```
The build
```
docker % docker build -t apache/nutch . --build-arg BUILD_MODE=2 --build-arg
SERVER_PORT=8081 --build-arg SERVER_HOST=0.0.0.0 --build-arg WEBAPP_PORT=8080
...
[+] Building 743.6s (17/17) FINISHED
=> [internal] load build definition from Dockerfile
0.0s
=> => transferring dockerfile: 4.42kB
0.0s
=> [internal] load .dockerignore
0.0s
=> => transferring context: 2B
0.0s
=> [internal] load metadata for docker.io/library/alpine:3.13
1.4s
=> [base 1/8] FROM
docker.io/library/alpine:3.13@sha256:f51ff2d96627690d62fee79e6eecd9fa87429a38142b5df8a3bfbb26061df7fc
0.6s
=> => resolve
docker.io/library/alpine:3.13@sha256:f51ff2d96627690d62fee79e6eecd9fa87429a38142b5df8a3bfbb26061df7fc
0.0s
=> =>
sha256:f51ff2d96627690d62fee79e6eecd9fa87429a38142b5df8a3bfbb26061df7fc 1.64kB
/ 1.64kB
0.0s
=> =>
sha256:def822f9851ca422481ec6fee59a9966f12b351c62ccb9aca841526ffaa9f748 528B /
528B
0.0s
=> =>
sha256:6dbb9cc54074106d46d4ccb330f2a40a682d49dda5f4844962b7dce9fe44aaec 1.47kB
/ 1.47kB
0.0s
=> =>
sha256:540db60ca9383eac9e418f78490994d0af424aab7bf6d0e47ac8ed4e2e9bcbba 2.81MB
/ 2.81MB
0.4s
=> => extracting
sha256:540db60ca9383eac9e418f78490994d0af424aab7bf6d0e47ac8ed4e2e9bcbba
0.2s
=> [internal] load build context
0.0s
=> => transferring context: 2.74kB
0.0s
=> [base 2/8] WORKDIR /root/
0.0s
=> [base 3/8] RUN apk update
1.0s
=> [base 4/8] RUN apk --no-cache add apache-ant bash git openjdk11
supervisor
18.6s
=> [base 5/8] RUN echo 'export JAVA_HOME=/usr/lib/jvm/java-11-openjdk' >>
$HOME/.bashrc
0.2s
=> [base 6/8] RUN git clone https://github.com/apache/nutch.git
nutch_source && cd nutch_source && ant runtime && rm -rf build/
&& rm -rf /root/.ivy2/
716.3s
=> [base 7/8] RUN ln -sf /root/nutch_source/runtime/local/bin/nutch
/usr/local/bin/
0.3s
=> [base 8/8] RUN ln -sf /root/nutch_source/runtime/local/bin/crawl
/usr/local/bin/
0.2s
=> [branch-version-2 1/3] RUN echo "Nutch master branch source install with
'crawl' and 'nutch' scripts on PATH, Nutch REST Server on 0.0.0.0:8081 and
WebApp on this container port 8080"
0.3s
=> [branch-version-2 2/3] RUN mkdir -p /var/log/supervisord
0.3s
=> [branch-version-2 3/3] COPY ./config/supervisord_startserver_webapp.conf
/etc/supervisord.conf
0.0s
=> [final 1/1] RUN echo "Successfully built image, see
https://s.apache.org/m5933 for guidance on running a container instance."
0.2s
=> exporting to image
4.0s
=> => exporting layers
4.0s
=> => writing image
sha256:0b526f0c7743d74fa9afa1db86956e1f2d88974f460bd64d94b6492bfc8b65de
0.0s
=> => naming to docker.io/apache/nutch
```
Note the above output where the correct `supervisord` file is being `COPY`d
and the REST server and WebApp details are all consistent.
I then run
```
docker run -t -i -d -p 8080:8080 -p 8081:8081 --name nutchcontainer
apache/nutch
```
and curl the REST endpoint
```
curl http://localhost:8081/admin
{"startDate":1625713304457,"configuration":["default"],"jobs":[],"runningJobs":[]}
```
I can also reach the WebApp on 8081.
I can exec into contained as follows
```
docker exec -it 1cda988617a6 /bin/bash
...
bash-5.1# tail /var/log/supervisord/*
==> /var/log/supervisord/nutchserver_stderr.log <==
==> /var/log/supervisord/nutchserver_stdout.log <==
Starting NutchServer on 0.0.0.0:8081 ...
Started Nutch Server on 0.0.0.0:8081 at 1625713304457
==> /var/log/supervisord/nutchwebapp_stderr.log <==
WARNING: An illegal reflective access operation has occurred
WARNING: Illegal reflective access by
org.springframework.cglib.core.ReflectUtils$2
(file:/root/nutch_source/runtime/local/lib/spring-core-4.0.9.RELEASE.jar) to
method
java.lang.ClassLoader.defineClass(java.lang.String,byte[],int,int,java.security.ProtectionDomain)
WARNING: Please consider reporting this to the maintainers of
org.springframework.cglib.core.ReflectUtils$2
WARNING: Use --illegal-access=warn to enable warnings of further illegal
reflective access operations
WARNING: All illegal access operations will be denied in a future release
==> /var/log/supervisord/nutchwebapp_stdout.log <==
==> /var/log/supervisord/supervisord.log <==
2021-07-08 03:01:41,515 INFO Set uid to user 0 succeeded
2021-07-08 03:01:41,517 INFO supervisord started with pid 1
2021-07-08 03:01:42,500 INFO spawned: 'nutchserver' with pid 8
2021-07-08 03:01:42,503 INFO spawned: 'nutchwebapp' with pid 9
2021-07-08 03:01:43,505 INFO success: nutchserver entered RUNNING state,
process has stayed up for > than 0 seconds (startsecs)
2021-07-08 03:01:43,506 INFO success: nutchwebapp entered RUNNING state,
process has stayed up for > than 0 seconds (startsecs)
==> /var/log/supervisord/supervisord.pid <==
1
```
All is good...
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: dev-unsubscr...@nutch.apache.org
For queries about this service, please contact Infrastructure at:
us...@infra.apache.org
> Provide means to run server and webapp as persistent services in Docker
> container
> ---------------------------------------------------------------------------------
>
> Key: NUTCH-2883
> URL: https://issues.apache.org/jira/browse/NUTCH-2883
> Project: Nutch
> Issue Type: Improvement
> Components: docker, nutch server, web gui
> Affects Versions: 1.18
> Reporter: Lewis John McGibbney
> Assignee: Lewis John McGibbney
> Priority: Major
> Fix For: 1.19
>
>
> Some conditional logic and some Docker build arguments would allow a user to
> run the nutch server alone or both the nutch server and webapp as long
> running services.
> This could be useful for users who want to remotely interact with Nutch via
> REST where jobs may actually be executed on yet another remote deployment.
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
