[GitHub] [kylin] hit-lacus edited a comment on issue #797: KYLIN-4114 Provided a self-contained docker image for Kylin
hit-lacus edited a comment on issue #797: KYLIN-4114 Provided a self-contained docker image for Kylin URL: https://github.com/apache/kylin/pull/797#issuecomment-520202808 Thanks @weibin0516 , this looks cool, here a list for what I want to check. ### For PoC - [x] MapReduce Cubing - [x] Spark Cubing - [x] Segment Merge - [x] NRT Streaming - [x] Realtime OLAP ### For Developer - [ ] Package from source - [ ] Integration test ### Other Comments - I guess we may check if we could upload image to docker hub, thus user may simplely run it in one command. (For PoC purpose.) - Maybe we could build image in hierarchy way, thus we can switch between different hadoop distribution easily. And for PoC, we could provided a minimized image; for developer, we could add maven/nodejs. - Make sure all basic function works well. This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org With regards, Apache Git Services
[GitHub] [kylin] hit-lacus edited a comment on issue #797: KYLIN-4114 Provided a self-contained docker image for Kylin
hit-lacus edited a comment on issue #797: KYLIN-4114 Provided a self-contained docker image for Kylin URL: https://github.com/apache/kylin/pull/797#issuecomment-520202808 Thanks @weibin0516 , this looks cool, here a list for what I want to check. ### For PoC - [x] MapReduce Cubing - [ ] Spark Cubing - [x] Segment Merge - [x] NRT Streaming - [ ] Realtime OLAP ### For Developer - [ ] Package from source - [ ] Integration test ### Other Comments - I guess we may check if we could upload image to docker hub, thus user may simplely run it in one command. (For PoC purpose.) - Maybe we could build image in hierarchy way, thus we can switch between different hadoop distribution easily. And for PoC, we could provided a minimized image; for developer, we could add maven/nodejs. - Make sure all basic function works well. This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org With regards, Apache Git Services
[GitHub] [kylin] hit-lacus edited a comment on issue #797: KYLIN-4114 Provided a self-contained docker image for Kylin
hit-lacus edited a comment on issue #797: KYLIN-4114 Provided a self-contained docker image for Kylin URL: https://github.com/apache/kylin/pull/797#issuecomment-520202808 Thanks @weibin0516 , this looks cool, here a list for what I want to check. ### For PoC - [x] MapReduce Cubing - [ ] Spark Cubing - [x] Segment Merge - [x] NRT Streaming - [x] Realtime OLAP ### For Developer - [ ] Package from source - [ ] Integration test ### Other Comments - I guess we may check if we could upload image to docker hub, thus user may simplely run it in one command. (For PoC purpose.) - Maybe we could build image in hierarchy way, thus we can switch between different hadoop distribution easily. And for PoC, we could provided a minimized image; for developer, we could add maven/nodejs. - Make sure all basic function works well. This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org With regards, Apache Git Services
[GitHub] [kylin] hit-lacus edited a comment on issue #797: KYLIN-4114 Provided a self-contained docker image for Kylin
hit-lacus edited a comment on issue #797: KYLIN-4114 Provided a self-contained docker image for Kylin URL: https://github.com/apache/kylin/pull/797#issuecomment-520202808 Thanks @weibin0516 , this looks cool, here a list for what I want to check. ### For PoC - [x] MapReduce Cubing - [x] Spark Cubing - [x] Segment Merge - [x] NRT Streaming - [ ] Realtime OLAP ### For Developer - [ ] Package from source - [ ] Integration test ### Other Comments - I guess we may check if we could upload image to docker hub, thus user may simplely run it in one command. (For PoC purpose.) - Maybe we could build image in hierarchy way, thus we can switch between different hadoop distribution easily. And for PoC, we could provided a minimized image; for developer, we could add maven/nodejs. - Make sure all basic function works well. This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org With regards, Apache Git Services
[GitHub] [kylin] hit-lacus edited a comment on issue #797: KYLIN-4114 Provided a self-contained docker image for Kylin
hit-lacus edited a comment on issue #797: KYLIN-4114 Provided a self-contained docker image for Kylin URL: https://github.com/apache/kylin/pull/797#issuecomment-520202808 Thanks @weibin0516 , this looks cool, here a list for what I want to check. ### For PoC - [x] MapReduce Cubing - [ ] Spark Cubing - [ ] Segment Merge - [x] NRT Streaming - [ ] Realtime OLAP ### For Developer - [ ] Package from source - [ ] Integration test ### Other Comments - I guess we may check if we could upload image to docker hub, thus user may simplely run it in one command. (For PoC purpose.) - Maybe we could build image in hierarchy way, thus we can switch between different hadoop distribution easily. And for PoC, we could provided a minimized image; for developer, we could add maven/nodejs. - Make sure all basic function works well. This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org With regards, Apache Git Services
[GitHub] [kylin] hit-lacus edited a comment on issue #797: KYLIN-4114 Provided a self-contained docker image for Kylin
hit-lacus edited a comment on issue #797: KYLIN-4114 Provided a self-contained docker image for Kylin URL: https://github.com/apache/kylin/pull/797#issuecomment-520202808 Thanks @weibin0516 , this looks cool, here a list for what I want to check. ### For PoC - [x] MapReduce Cubing - [x] Spark Cubing - [ ] Segment Merge - [x] NRT Streaming - [ ] Realtime OLAP ### For Developer - [ ] Package from source - [ ] Integration test ### Other Comments - I guess we may check if we could upload image to docker hub, thus user may simplely run it in one command. (For PoC purpose.) - Maybe we could build image in hierarchy way, thus we can switch between different hadoop distribution easily. And for PoC, we could provided a minimized image; for developer, we could add maven/nodejs. - Make sure all basic function works well. This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org With regards, Apache Git Services
[GitHub] [kylin] hit-lacus edited a comment on issue #797: KYLIN-4114 Provided a self-contained docker image for Kylin
hit-lacus edited a comment on issue #797: KYLIN-4114 Provided a self-contained docker image for Kylin URL: https://github.com/apache/kylin/pull/797#issuecomment-520202808 Thanks @weibin0516 , this looks cool, here a list for what I want to check. ### For PoC - [ ] MapReduce Cubing - [ ] Spark Cubing - [ ] Segment Merge - [x] NRT Streaming - [ ] Realtime OLAP ### For Developer - [ ] Package from source - [ ] Integration test ### Other Comments - I guess we may check if we could upload image to docker hub, thus user may simplely run it in one command. (For PoC purpose.) - Maybe we could build image in hierarchy way, thus we can switch between different hadoop distribution easily. And for PoC, we could provided a minimized image; for developer, we could add maven/nodejs. - Make sure all basic function works well. This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org With regards, Apache Git Services
[GitHub] [kylin] hit-lacus edited a comment on issue #797: KYLIN-4114 Provided a self-contained docker image for Kylin
hit-lacus edited a comment on issue #797: KYLIN-4114 Provided a self-contained
docker image for Kylin
URL: https://github.com/apache/kylin/pull/797#issuecomment-521892892
## Test Env
- MacOS 10.14.4
- Docker Desktop for Mac (Docker Engine: 18.09.2)
Start standalone docker container
```sh
docker run -d --rm \
-p 7070:7070 \
-p 8088:8088 \
-p 50070:50070 \
-p 8032:8032 \
-p 8042:8042 \
-p 60010:60010 \
codingforfun/apache-kylin-standalone
```
Attach to container
``` sh
docker exec -it ${CONTAINER_ID} /bin/bash
```
Building Cube (Build/Refresh/Merge)
https://user-images.githubusercontent.com/14030549/63145830-7cb6eb00-c02b-11e9-990e-1fa61c8fce39.png;>
https://user-images.githubusercontent.com/14030549/63141178-5c7d3100-c017-11e9-9786-77e2f7b79460.png;>
Near Realtime Streaming
https://user-images.githubusercontent.com/14030549/63141276-bf6ec800-c017-11e9-959a-a1eb66adc689.png;>
Realtime OLAP
https://user-images.githubusercontent.com/14030549/63141141-348dcd80-c017-11e9-90c2-33eb4b50bc03.png;>
https://user-images.githubusercontent.com/14030549/63141128-22139400-c017-11e9-91a4-cfda28f8a547.png;>
### Known issue
https://user-images.githubusercontent.com/14030549/63146599-0a93d580-c02e-11e9-8500-eb1d94775cbf.png;>
1. Nodemanager may be unhealthy because of lack of disk space.
This may be fixed by `docker image prune -h` to reduce needless disk space.
2. Container cannot restart successfully.
3. Realtime OLAP building job cubing job throw NPE for some reasons(to be
checked).
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
us...@infra.apache.org
With regards,
Apache Git Services
[GitHub] [kylin] hit-lacus edited a comment on issue #797: KYLIN-4114 Provided a self-contained docker image for Kylin
hit-lacus edited a comment on issue #797: KYLIN-4114 Provided a self-contained
docker image for Kylin
URL: https://github.com/apache/kylin/pull/797#issuecomment-521892892
## Test Env
- MacOS 10.14.4
- Docker Desktop for Mac (Docker Engine: 18.09.2)
Start standalone docker container
```sh
docker run -d --rm \
-p 7070:7070 \
-p 8088:8088 \
-p 50070:50070 \
-p 8032:8032 \
-p 8042:8042 \
-p 60010:60010 \
codingforfun/apache-kylin-standalone
```
Attach to container
``` sh
docker exec -it ${CONTAINER_ID} /bin/bash
```
Building Cube (Build/Refresh/Merge)
https://user-images.githubusercontent.com/14030549/63145830-7cb6eb00-c02b-11e9-990e-1fa61c8fce39.png;>
https://user-images.githubusercontent.com/14030549/63141178-5c7d3100-c017-11e9-9786-77e2f7b79460.png;>
Near Realtime Streaming
https://user-images.githubusercontent.com/14030549/63141276-bf6ec800-c017-11e9-959a-a1eb66adc689.png;>
Realtime OLAP
https://user-images.githubusercontent.com/14030549/63141141-348dcd80-c017-11e9-90c2-33eb4b50bc03.png;>
https://user-images.githubusercontent.com/14030549/63141128-22139400-c017-11e9-91a4-cfda28f8a547.png;>
### Known issue
1. Nodemanager may be unhealthy because of lack of disk space.
This may be fixed by `docker image prune -h` to reduce needless disk space.
2. Container cannot restart successfully.
3. Realtime OLAP building job cubing job throw NPE for some reasons(to be
checked).
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
us...@infra.apache.org
With regards,
Apache Git Services
[GitHub] [kylin] hit-lacus edited a comment on issue #797: KYLIN-4114 Provided a self-contained docker image for Kylin
hit-lacus edited a comment on issue #797: KYLIN-4114 Provided a self-contained docker image for Kylin URL: https://github.com/apache/kylin/pull/797#issuecomment-520202808 Thanks @weibin0516 , this looks cool, here a list for what I want to check. ### For PoC - [ ] MapReduce Cubing - [ ] Spark Cubing - [ ] Segment Merge - [ ] NRT Streaming - [ ] Realtime OLAP ### For Developer - [ ] Package from source - [ ] Integration test ### Other Comments - I guess we may check if we could upload image to docker hub, thus user may simplely run it in one command. (For PoC purpose.) - Maybe we could build image in hierarchy way, thus we can switch between different hadoop distribution easily. And for PoC, we could provided a minimized image; for developer, we could add maven/nodejs. - Make sure all basic function works well. This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org With regards, Apache Git Services
