[jira] [Commented] (HBASE-11885) Provide a Dockerfile to easily build and run HBase from source
[
https://issues.apache.org/jira/browse/HBASE-11885?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14122582#comment-14122582
]
Hadoop QA commented on HBASE-11885:
---
{color:red}-1 overall{color}. Here are the results of testing the latest
attachment
http://issues.apache.org/jira/secure/attachment/1274/HBASE-11885_v2.patch
against trunk revision .
ATTACHMENT ID: 1274
{color:green}+1 @author{color}. The patch does not contain any @author
tags.
{color:red}-1 tests included{color}. The patch doesn't appear to include
any new or modified tests.
Please justify why no new tests are needed for this
patch.
Also please list what manual steps were performed to
verify this patch.
{color:green}+1 javac{color}. The applied patch does not increase the
total number of javac compiler warnings.
{color:green}+1 javac{color}. The applied patch does not increase the
total number of javac compiler warnings.
{color:green}+1 javadoc{color}. The javadoc tool did not generate any
warning messages.
{color:green}+1 findbugs{color}. The patch does not introduce any new
Findbugs (version 2.0.3) warnings.
{color:green}+1 release audit{color}. The applied patch does not increase
the total number of release audit warnings.
{color:red}-1 lineLengths{color}. The patch introduces the following lines
longer than 100:
+# # ./hbase_docker.sh -j
http://download.oracle.com/otn-pub/java/jdk/7u67-b01/jdk-7u67-linux-x64.tar.gz \
+ENV PATH
/usr/java/bin:/usr/local/apache-maven/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin
+ENV PATH
/root/hbase-bin/bin:/usr/java/bin:/usr/local/apache-maven/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin
{color:green}+1 site{color}. The mvn site goal succeeds with this patch.
{color:green}+1 core tests{color}. The patch passed unit tests in .
Test results:
https://builds.apache.org/job/PreCommit-HBASE-Build/10720//testReport/
Findbugs warnings:
https://builds.apache.org/job/PreCommit-HBASE-Build/10720//artifact/patchprocess/newPatchFindbugsWarningshbase-hadoop2-compat.html
Findbugs warnings:
https://builds.apache.org/job/PreCommit-HBASE-Build/10720//artifact/patchprocess/newPatchFindbugsWarningshbase-prefix-tree.html
Findbugs warnings:
https://builds.apache.org/job/PreCommit-HBASE-Build/10720//artifact/patchprocess/newPatchFindbugsWarningshbase-common.html
Findbugs warnings:
https://builds.apache.org/job/PreCommit-HBASE-Build/10720//artifact/patchprocess/newPatchFindbugsWarningshbase-thrift.html
Findbugs warnings:
https://builds.apache.org/job/PreCommit-HBASE-Build/10720//artifact/patchprocess/newPatchFindbugsWarningshbase-examples.html
Findbugs warnings:
https://builds.apache.org/job/PreCommit-HBASE-Build/10720//artifact/patchprocess/newPatchFindbugsWarningshbase-client.html
Findbugs warnings:
https://builds.apache.org/job/PreCommit-HBASE-Build/10720//artifact/patchprocess/newPatchFindbugsWarningshbase-hadoop-compat.html
Findbugs warnings:
https://builds.apache.org/job/PreCommit-HBASE-Build/10720//artifact/patchprocess/newPatchFindbugsWarningshbase-server.html
Findbugs warnings:
https://builds.apache.org/job/PreCommit-HBASE-Build/10720//artifact/patchprocess/newPatchFindbugsWarningshbase-protocol.html
Console output:
https://builds.apache.org/job/PreCommit-HBASE-Build/10720//console
This message is automatically generated.
Provide a Dockerfile to easily build and run HBase from source
--
Key: HBASE-11885
URL: https://issues.apache.org/jira/browse/HBASE-11885
Project: HBase
Issue Type: New Feature
Reporter: Dima Spivak
Assignee: Dima Spivak
Attachments: HBASE-11885.patch, HBASE-11885_v2.patch
[A recent email to
dev@|http://mail-archives.apache.org/mod_mbox/hbase-dev/201408.mbox/%3CCAAef%2BM4q%3Da8Dqxe_EHSFTueY%2BXxz%2BtTe%2BJKsWWbXjhB_Pz7oSA%40mail.gmail.com%3E]
highlighted the difficulty that new users can face in getting HBase compiled
from source and running locally. I'd like to provide a Dockerfile that would
allow anyone with Docker running on a machine with a reasonably current Linux
kernel to do so with ease.
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
[jira] [Commented] (HBASE-11885) Provide a Dockerfile to easily build and run HBase from source
[ https://issues.apache.org/jira/browse/HBASE-11885?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14123409#comment-14123409 ] Andrew Purtell commented on HBASE-11885: What SCM branches have been tested with this? Master? Can we check if this works with master, branch-1, and 0.98? If so I will defer to those with Docker expertise and commit this to the respective branches. Provide a Dockerfile to easily build and run HBase from source -- Key: HBASE-11885 URL: https://issues.apache.org/jira/browse/HBASE-11885 Project: HBase Issue Type: New Feature Reporter: Dima Spivak Assignee: Dima Spivak Attachments: HBASE-11885.patch, HBASE-11885_v2.patch [A recent email to dev@|http://mail-archives.apache.org/mod_mbox/hbase-dev/201408.mbox/%3CCAAef%2BM4q%3Da8Dqxe_EHSFTueY%2BXxz%2BtTe%2BJKsWWbXjhB_Pz7oSA%40mail.gmail.com%3E] highlighted the difficulty that new users can face in getting HBase compiled from source and running locally. I'd like to provide a Dockerfile that would allow anyone with Docker running on a machine with a reasonably current Linux kernel to do so with ease. -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Commented] (HBASE-11885) Provide a Dockerfile to easily build and run HBase from source
[ https://issues.apache.org/jira/browse/HBASE-11885?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14123792#comment-14123792 ] Dima Spivak commented on HBASE-11885: - Hey Andy, I've confirmed that it works as expected with master, 0.98, and branch-1. When committing into those branches, I'd just have to modify one line in the Dockerfile to reflect the desired branch. Provide a Dockerfile to easily build and run HBase from source -- Key: HBASE-11885 URL: https://issues.apache.org/jira/browse/HBASE-11885 Project: HBase Issue Type: New Feature Reporter: Dima Spivak Assignee: Dima Spivak Attachments: HBASE-11885.patch, HBASE-11885_v2.patch [A recent email to dev@|http://mail-archives.apache.org/mod_mbox/hbase-dev/201408.mbox/%3CCAAef%2BM4q%3Da8Dqxe_EHSFTueY%2BXxz%2BtTe%2BJKsWWbXjhB_Pz7oSA%40mail.gmail.com%3E] highlighted the difficulty that new users can face in getting HBase compiled from source and running locally. I'd like to provide a Dockerfile that would allow anyone with Docker running on a machine with a reasonably current Linux kernel to do so with ease. -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Commented] (HBASE-11885) Provide a Dockerfile to easily build and run HBase from source
[
https://issues.apache.org/jira/browse/HBASE-11885?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14123843#comment-14123843
]
Andrew Purtell commented on HBASE-11885:
This one, right?
{code}
+RUN git clone https://github.com/apache/hbase.git -b master
{code}
I could do that when committing. Let me know.
Provide a Dockerfile to easily build and run HBase from source
--
Key: HBASE-11885
URL: https://issues.apache.org/jira/browse/HBASE-11885
Project: HBase
Issue Type: New Feature
Reporter: Dima Spivak
Assignee: Dima Spivak
Attachments: HBASE-11885.patch, HBASE-11885_v2.patch
[A recent email to
dev@|http://mail-archives.apache.org/mod_mbox/hbase-dev/201408.mbox/%3CCAAef%2BM4q%3Da8Dqxe_EHSFTueY%2BXxz%2BtTe%2BJKsWWbXjhB_Pz7oSA%40mail.gmail.com%3E]
highlighted the difficulty that new users can face in getting HBase compiled
from source and running locally. I'd like to provide a Dockerfile that would
allow anyone with Docker running on a machine with a reasonably current Linux
kernel to do so with ease.
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
[jira] [Commented] (HBASE-11885) Provide a Dockerfile to easily build and run HBase from source
[ https://issues.apache.org/jira/browse/HBASE-11885?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14123849#comment-14123849 ] Dima Spivak commented on HBASE-11885: - Yessir! Changing that to 0.98 or branch-1 works out of box (just confirmed on my machines). Provide a Dockerfile to easily build and run HBase from source -- Key: HBASE-11885 URL: https://issues.apache.org/jira/browse/HBASE-11885 Project: HBase Issue Type: New Feature Reporter: Dima Spivak Assignee: Dima Spivak Attachments: HBASE-11885.patch, HBASE-11885_v2.patch [A recent email to dev@|http://mail-archives.apache.org/mod_mbox/hbase-dev/201408.mbox/%3CCAAef%2BM4q%3Da8Dqxe_EHSFTueY%2BXxz%2BtTe%2BJKsWWbXjhB_Pz7oSA%40mail.gmail.com%3E] highlighted the difficulty that new users can face in getting HBase compiled from source and running locally. I'd like to provide a Dockerfile that would allow anyone with Docker running on a machine with a reasonably current Linux kernel to do so with ease. -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Commented] (HBASE-11885) Provide a Dockerfile to easily build and run HBase from source
[ https://issues.apache.org/jira/browse/HBASE-11885?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14123851#comment-14123851 ] Andrew Purtell commented on HBASE-11885: Ok, will commit shortly to 0.98+ unless objection. Provide a Dockerfile to easily build and run HBase from source -- Key: HBASE-11885 URL: https://issues.apache.org/jira/browse/HBASE-11885 Project: HBase Issue Type: New Feature Reporter: Dima Spivak Assignee: Dima Spivak Attachments: HBASE-11885.patch, HBASE-11885_v2.patch [A recent email to dev@|http://mail-archives.apache.org/mod_mbox/hbase-dev/201408.mbox/%3CCAAef%2BM4q%3Da8Dqxe_EHSFTueY%2BXxz%2BtTe%2BJKsWWbXjhB_Pz7oSA%40mail.gmail.com%3E] highlighted the difficulty that new users can face in getting HBase compiled from source and running locally. I'd like to provide a Dockerfile that would allow anyone with Docker running on a machine with a reasonably current Linux kernel to do so with ease. -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Commented] (HBASE-11885) Provide a Dockerfile to easily build and run HBase from source
[
https://issues.apache.org/jira/browse/HBASE-11885?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14123872#comment-14123872
]
Andrew Purtell commented on HBASE-11885:
In the example URLs provided for getting JDK and Maven binaries, the resources
are outside of Apache infrastructure. That's no problem as those are user
supplied settings. However in the Dockerfile when checking out HBase we
probably should not rely on third party resources. Therefore I propose:
For 0.98:
{code}
+RUN git clone http://git.apache.org/hbase.git -b 0.98
{code}
For branch-1:
{code}
+RUN git clone http://git.apache.org/hbase.git -b branch-1
{code}
For master:
{code}
+RUN git clone http://git.apache.org/hbase.git -b master
{code}
The downside of this change is git.apache.org is substantially slower than
github.com, although the clones do eventually succeed.
Provide a Dockerfile to easily build and run HBase from source
--
Key: HBASE-11885
URL: https://issues.apache.org/jira/browse/HBASE-11885
Project: HBase
Issue Type: New Feature
Reporter: Dima Spivak
Assignee: Dima Spivak
Attachments: HBASE-11885.patch, HBASE-11885_v2.patch
[A recent email to
dev@|http://mail-archives.apache.org/mod_mbox/hbase-dev/201408.mbox/%3CCAAef%2BM4q%3Da8Dqxe_EHSFTueY%2BXxz%2BtTe%2BJKsWWbXjhB_Pz7oSA%40mail.gmail.com%3E]
highlighted the difficulty that new users can face in getting HBase compiled
from source and running locally. I'd like to provide a Dockerfile that would
allow anyone with Docker running on a machine with a reasonably current Linux
kernel to do so with ease.
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
[jira] [Commented] (HBASE-11885) Provide a Dockerfile to easily build and run HBase from source
[ https://issues.apache.org/jira/browse/HBASE-11885?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14123874#comment-14123874 ] Dima Spivak commented on HBASE-11885: - Fine by me. I just copied and pasted from GitHub, but figured maybe the Apache variant was more correct. Provide a Dockerfile to easily build and run HBase from source -- Key: HBASE-11885 URL: https://issues.apache.org/jira/browse/HBASE-11885 Project: HBase Issue Type: New Feature Reporter: Dima Spivak Assignee: Dima Spivak Attachments: HBASE-11885.patch, HBASE-11885_v2.patch [A recent email to dev@|http://mail-archives.apache.org/mod_mbox/hbase-dev/201408.mbox/%3CCAAef%2BM4q%3Da8Dqxe_EHSFTueY%2BXxz%2BtTe%2BJKsWWbXjhB_Pz7oSA%40mail.gmail.com%3E] highlighted the difficulty that new users can face in getting HBase compiled from source and running locally. I'd like to provide a Dockerfile that would allow anyone with Docker running on a machine with a reasonably current Linux kernel to do so with ease. -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Commented] (HBASE-11885) Provide a Dockerfile to easily build and run HBase from source
[ https://issues.apache.org/jira/browse/HBASE-11885?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14123875#comment-14123875 ] Andrew Purtell commented on HBASE-11885: Ok Provide a Dockerfile to easily build and run HBase from source -- Key: HBASE-11885 URL: https://issues.apache.org/jira/browse/HBASE-11885 Project: HBase Issue Type: New Feature Reporter: Dima Spivak Assignee: Dima Spivak Attachments: HBASE-11885.patch, HBASE-11885_v2.patch [A recent email to dev@|http://mail-archives.apache.org/mod_mbox/hbase-dev/201408.mbox/%3CCAAef%2BM4q%3Da8Dqxe_EHSFTueY%2BXxz%2BtTe%2BJKsWWbXjhB_Pz7oSA%40mail.gmail.com%3E] highlighted the difficulty that new users can face in getting HBase compiled from source and running locally. I'd like to provide a Dockerfile that would allow anyone with Docker running on a machine with a reasonably current Linux kernel to do so with ease. -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Commented] (HBASE-11885) Provide a Dockerfile to easily build and run HBase from source
[ https://issues.apache.org/jira/browse/HBASE-11885?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14124234#comment-14124234 ] Hudson commented on HBASE-11885: FAILURE: Integrated in HBase-0.98-on-Hadoop-1.1 #474 (See [https://builds.apache.org/job/HBase-0.98-on-Hadoop-1.1/474/]) HBASE-11885 Provide a Dockerfile to easily build and run HBase from source (Dima Spivak) (apurtell: rev 2d875c92cd030b974b898f0d9e2b5e5a6aa9a094) * dev-support/hbase_docker.sh * dev-support/hbase_docker/Dockerfile * dev-support/hbase_docker/README.md Provide a Dockerfile to easily build and run HBase from source -- Key: HBASE-11885 URL: https://issues.apache.org/jira/browse/HBASE-11885 Project: HBase Issue Type: New Feature Reporter: Dima Spivak Assignee: Dima Spivak Fix For: 0.99.0, 2.0.0, 0.98.7 Attachments: HBASE-11885.patch, HBASE-11885_v2.patch [A recent email to dev@|http://mail-archives.apache.org/mod_mbox/hbase-dev/201408.mbox/%3CCAAef%2BM4q%3Da8Dqxe_EHSFTueY%2BXxz%2BtTe%2BJKsWWbXjhB_Pz7oSA%40mail.gmail.com%3E] highlighted the difficulty that new users can face in getting HBase compiled from source and running locally. I'd like to provide a Dockerfile that would allow anyone with Docker running on a machine with a reasonably current Linux kernel to do so with ease. -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Commented] (HBASE-11885) Provide a Dockerfile to easily build and run HBase from source
[ https://issues.apache.org/jira/browse/HBASE-11885?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14124283#comment-14124283 ] Hudson commented on HBASE-11885: FAILURE: Integrated in HBase-0.98 #500 (See [https://builds.apache.org/job/HBase-0.98/500/]) HBASE-11885 Provide a Dockerfile to easily build and run HBase from source (Dima Spivak) (apurtell: rev 2d875c92cd030b974b898f0d9e2b5e5a6aa9a094) * dev-support/hbase_docker/README.md * dev-support/hbase_docker/Dockerfile * dev-support/hbase_docker.sh Provide a Dockerfile to easily build and run HBase from source -- Key: HBASE-11885 URL: https://issues.apache.org/jira/browse/HBASE-11885 Project: HBase Issue Type: New Feature Reporter: Dima Spivak Assignee: Dima Spivak Fix For: 0.99.0, 2.0.0, 0.98.7 Attachments: HBASE-11885.patch, HBASE-11885_v2.patch [A recent email to dev@|http://mail-archives.apache.org/mod_mbox/hbase-dev/201408.mbox/%3CCAAef%2BM4q%3Da8Dqxe_EHSFTueY%2BXxz%2BtTe%2BJKsWWbXjhB_Pz7oSA%40mail.gmail.com%3E] highlighted the difficulty that new users can face in getting HBase compiled from source and running locally. I'd like to provide a Dockerfile that would allow anyone with Docker running on a machine with a reasonably current Linux kernel to do so with ease. -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Commented] (HBASE-11885) Provide a Dockerfile to easily build and run HBase from source
[ https://issues.apache.org/jira/browse/HBASE-11885?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14124305#comment-14124305 ] Hudson commented on HBASE-11885: FAILURE: Integrated in HBase-TRUNK #5472 (See [https://builds.apache.org/job/HBase-TRUNK/5472/]) HBASE-11885 Provide a Dockerfile to easily build and run HBase from source (Dima Spivak) (apurtell: rev e13b629843c7dbfbb7aaadc93f90f65d0291755c) * dev-support/hbase_docker.sh * dev-support/hbase_docker/Dockerfile * dev-support/hbase_docker/README.md Provide a Dockerfile to easily build and run HBase from source -- Key: HBASE-11885 URL: https://issues.apache.org/jira/browse/HBASE-11885 Project: HBase Issue Type: New Feature Reporter: Dima Spivak Assignee: Dima Spivak Fix For: 0.99.0, 2.0.0, 0.98.7 Attachments: HBASE-11885.patch, HBASE-11885_v2.patch [A recent email to dev@|http://mail-archives.apache.org/mod_mbox/hbase-dev/201408.mbox/%3CCAAef%2BM4q%3Da8Dqxe_EHSFTueY%2BXxz%2BtTe%2BJKsWWbXjhB_Pz7oSA%40mail.gmail.com%3E] highlighted the difficulty that new users can face in getting HBase compiled from source and running locally. I'd like to provide a Dockerfile that would allow anyone with Docker running on a machine with a reasonably current Linux kernel to do so with ease. -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Commented] (HBASE-11885) Provide a Dockerfile to easily build and run HBase from source
[ https://issues.apache.org/jira/browse/HBASE-11885?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14124318#comment-14124318 ] Hudson commented on HBASE-11885: FAILURE: Integrated in HBase-1.0 #157 (See [https://builds.apache.org/job/HBase-1.0/157/]) HBASE-11885 Provide a Dockerfile to easily build and run HBase from source (Dima Spivak) (apurtell: rev a44bc7ac1a9c189154b9a446b229257f78c90aba) * dev-support/hbase_docker/README.md * dev-support/hbase_docker.sh * dev-support/hbase_docker/Dockerfile Provide a Dockerfile to easily build and run HBase from source -- Key: HBASE-11885 URL: https://issues.apache.org/jira/browse/HBASE-11885 Project: HBase Issue Type: New Feature Reporter: Dima Spivak Assignee: Dima Spivak Fix For: 0.99.0, 2.0.0, 0.98.7 Attachments: HBASE-11885.patch, HBASE-11885_v2.patch [A recent email to dev@|http://mail-archives.apache.org/mod_mbox/hbase-dev/201408.mbox/%3CCAAef%2BM4q%3Da8Dqxe_EHSFTueY%2BXxz%2BtTe%2BJKsWWbXjhB_Pz7oSA%40mail.gmail.com%3E] highlighted the difficulty that new users can face in getting HBase compiled from source and running locally. I'd like to provide a Dockerfile that would allow anyone with Docker running on a machine with a reasonably current Linux kernel to do so with ease. -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Commented] (HBASE-11885) Provide a Dockerfile to easily build and run HBase from source
[ https://issues.apache.org/jira/browse/HBASE-11885?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14121002#comment-14121002 ] Dima Spivak commented on HBASE-11885: - Thanks for the feedback, Srikanth; I'll update documentation tomorrow. The error you saw is because of what seems to be buggy implementation of the devicemapper driver. Unfortunately, this tends to get fixed by just rerunning docker build (sometimes repeatedly). The fact that the image didn't complete is why the second error about being unable to find hbase_docker showed up (Docker always tries to pull images from the central registry if they aren't present locally). Provide a Dockerfile to easily build and run HBase from source -- Key: HBASE-11885 URL: https://issues.apache.org/jira/browse/HBASE-11885 Project: HBase Issue Type: New Feature Reporter: Dima Spivak Assignee: Dima Spivak Attachments: HBASE-11885.patch [A recent email to dev@|http://mail-archives.apache.org/mod_mbox/hbase-dev/201408.mbox/%3CCAAef%2BM4q%3Da8Dqxe_EHSFTueY%2BXxz%2BtTe%2BJKsWWbXjhB_Pz7oSA%40mail.gmail.com%3E] highlighted the difficulty that new users can face in getting HBase compiled from source and running locally. I'd like to provide a Dockerfile that would allow anyone with Docker running on a machine with a reasonably current Linux kernel to do so with ease. -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Commented] (HBASE-11885) Provide a Dockerfile to easily build and run HBase from source
[ https://issues.apache.org/jira/browse/HBASE-11885?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14121591#comment-14121591 ] Esteban Gutierrez commented on HBASE-11885: --- [~dimaspivak] I think having the option to automate the download of maven and the Java JDK as a flag or environment variable should be fine. However I don't think the docker image should have specific URLs or Java/JDK versions and the user should provide that, for instance you could use wget and accept additional parameters besides the URL and so if you want to download the Java JDK you need to explicitly pass the oraclelicense cookie in order to download the tarball directly from Oracle. Provide a Dockerfile to easily build and run HBase from source -- Key: HBASE-11885 URL: https://issues.apache.org/jira/browse/HBASE-11885 Project: HBase Issue Type: New Feature Reporter: Dima Spivak Assignee: Dima Spivak Attachments: HBASE-11885.patch [A recent email to dev@|http://mail-archives.apache.org/mod_mbox/hbase-dev/201408.mbox/%3CCAAef%2BM4q%3Da8Dqxe_EHSFTueY%2BXxz%2BtTe%2BJKsWWbXjhB_Pz7oSA%40mail.gmail.com%3E] highlighted the difficulty that new users can face in getting HBase compiled from source and running locally. I'd like to provide a Dockerfile that would allow anyone with Docker running on a machine with a reasonably current Linux kernel to do so with ease. -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Commented] (HBASE-11885) Provide a Dockerfile to easily build and run HBase from source
[ https://issues.apache.org/jira/browse/HBASE-11885?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14121605#comment-14121605 ] Dima Spivak commented on HBASE-11885: - Yeah, I could create a wrapper script to do that, I just wonder how much use it would get. Someone wanting to automatically download Oracle and Maven would still have to go to the sites to get URLs, and as you point out, in the case of JDK, would also need to pass the correct cookie accepting Oracle's license agreement. In fact, my first iteration of the Dockerfile did just that (i.e. had hardcoded URLs and the cookie passed with wget) before I worried that it would quickly become stale. What do you think? Provide a Dockerfile to easily build and run HBase from source -- Key: HBASE-11885 URL: https://issues.apache.org/jira/browse/HBASE-11885 Project: HBase Issue Type: New Feature Reporter: Dima Spivak Assignee: Dima Spivak Attachments: HBASE-11885.patch [A recent email to dev@|http://mail-archives.apache.org/mod_mbox/hbase-dev/201408.mbox/%3CCAAef%2BM4q%3Da8Dqxe_EHSFTueY%2BXxz%2BtTe%2BJKsWWbXjhB_Pz7oSA%40mail.gmail.com%3E] highlighted the difficulty that new users can face in getting HBase compiled from source and running locally. I'd like to provide a Dockerfile that would allow anyone with Docker running on a machine with a reasonably current Linux kernel to do so with ease. -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Commented] (HBASE-11885) Provide a Dockerfile to easily build and run HBase from source
[ https://issues.apache.org/jira/browse/HBASE-11885?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14121652#comment-14121652 ] Esteban Gutierrez commented on HBASE-11885: --- It will become stale if you leave valid URLs there or you could probably leave them commented out as an example. If you could pass the URLs and other wget arguments if present, that would simply the extra step of having to download and then copy the files. Also the option to assume that those dependencies have already been provided might be good to. If possible try to avoid globs, I know this is done within the container but blindly expanding globs sometimes ir problematic. Provide a Dockerfile to easily build and run HBase from source -- Key: HBASE-11885 URL: https://issues.apache.org/jira/browse/HBASE-11885 Project: HBase Issue Type: New Feature Reporter: Dima Spivak Assignee: Dima Spivak Attachments: HBASE-11885.patch [A recent email to dev@|http://mail-archives.apache.org/mod_mbox/hbase-dev/201408.mbox/%3CCAAef%2BM4q%3Da8Dqxe_EHSFTueY%2BXxz%2BtTe%2BJKsWWbXjhB_Pz7oSA%40mail.gmail.com%3E] highlighted the difficulty that new users can face in getting HBase compiled from source and running locally. I'd like to provide a Dockerfile that would allow anyone with Docker running on a machine with a reasonably current Linux kernel to do so with ease. -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Commented] (HBASE-11885) Provide a Dockerfile to easily build and run HBase from source
[
https://issues.apache.org/jira/browse/HBASE-11885?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14119501#comment-14119501
]
Dima Spivak commented on HBASE-11885:
-
I have a working Dockerfile that sets up the necessary HBase dependencies (i.e.
Maven and Java), clones in the repo, runs {{mvn assembly:single}}, and then
starts HBase and the HBase shell. The main problem I've run into pertains to
the Maven step due to
[HBASE-8674|https://issues.apache.org/jira/browse/HBASE-8674]. Can someone with
knowledge of why the POMs are in the state that they are in take a look there
and chime in on if there any consequence to simply removing Gary H's repo as a
dependency?
Provide a Dockerfile to easily build and run HBase from source
--
Key: HBASE-11885
URL: https://issues.apache.org/jira/browse/HBASE-11885
Project: HBase
Issue Type: New Feature
Reporter: Dima Spivak
Assignee: Dima Spivak
[A recent email to
dev@|http://mail-archives.apache.org/mod_mbox/hbase-dev/201408.mbox/%3CCAAef%2BM4q%3Da8Dqxe_EHSFTueY%2BXxz%2BtTe%2BJKsWWbXjhB_Pz7oSA%40mail.gmail.com%3E]
highlighted the difficulty that new users can face in getting HBase compiled
from source and running locally. I'd like to provide a Dockerfile that would
allow anyone with Docker running on a machine with a reasonably current Linux
kernel to do so with ease.
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
[jira] [Commented] (HBASE-11885) Provide a Dockerfile to easily build and run HBase from source
[ https://issues.apache.org/jira/browse/HBASE-11885?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14119928#comment-14119928 ] Andrew Purtell commented on HBASE-11885: [~nkeywal] Provide a Dockerfile to easily build and run HBase from source -- Key: HBASE-11885 URL: https://issues.apache.org/jira/browse/HBASE-11885 Project: HBase Issue Type: New Feature Reporter: Dima Spivak Assignee: Dima Spivak [A recent email to dev@|http://mail-archives.apache.org/mod_mbox/hbase-dev/201408.mbox/%3CCAAef%2BM4q%3Da8Dqxe_EHSFTueY%2BXxz%2BtTe%2BJKsWWbXjhB_Pz7oSA%40mail.gmail.com%3E] highlighted the difficulty that new users can face in getting HBase compiled from source and running locally. I'd like to provide a Dockerfile that would allow anyone with Docker running on a machine with a reasonably current Linux kernel to do so with ease. -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Commented] (HBASE-11885) Provide a Dockerfile to easily build and run HBase from source
[ https://issues.apache.org/jira/browse/HBASE-11885?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14120122#comment-14120122 ] Nicolas Liochon commented on HBASE-11885: - Since HBASE-4955 is fixed, it's possible and actually better to remove Gary's repo from the master version of HBase. Provide a Dockerfile to easily build and run HBase from source -- Key: HBASE-11885 URL: https://issues.apache.org/jira/browse/HBASE-11885 Project: HBase Issue Type: New Feature Reporter: Dima Spivak Assignee: Dima Spivak [A recent email to dev@|http://mail-archives.apache.org/mod_mbox/hbase-dev/201408.mbox/%3CCAAef%2BM4q%3Da8Dqxe_EHSFTueY%2BXxz%2BtTe%2BJKsWWbXjhB_Pz7oSA%40mail.gmail.com%3E] highlighted the difficulty that new users can face in getting HBase compiled from source and running locally. I'd like to provide a Dockerfile that would allow anyone with Docker running on a machine with a reasonably current Linux kernel to do so with ease. -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Commented] (HBASE-11885) Provide a Dockerfile to easily build and run HBase from source
[ https://issues.apache.org/jira/browse/HBASE-11885?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14120158#comment-14120158 ] Dima Spivak commented on HBASE-11885: - +1 ^^^. As I said, I had no issues at all building master from source after removing that repository altogether (0.94 is a different story, because of the dependency on version 2.12-TRUNK-HBASE-2 Surefire). Provide a Dockerfile to easily build and run HBase from source -- Key: HBASE-11885 URL: https://issues.apache.org/jira/browse/HBASE-11885 Project: HBase Issue Type: New Feature Reporter: Dima Spivak Assignee: Dima Spivak [A recent email to dev@|http://mail-archives.apache.org/mod_mbox/hbase-dev/201408.mbox/%3CCAAef%2BM4q%3Da8Dqxe_EHSFTueY%2BXxz%2BtTe%2BJKsWWbXjhB_Pz7oSA%40mail.gmail.com%3E] highlighted the difficulty that new users can face in getting HBase compiled from source and running locally. I'd like to provide a Dockerfile that would allow anyone with Docker running on a machine with a reasonably current Linux kernel to do so with ease. -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Commented] (HBASE-11885) Provide a Dockerfile to easily build and run HBase from source
[
https://issues.apache.org/jira/browse/HBASE-11885?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14120730#comment-14120730
]
Dima Spivak commented on HBASE-11885:
-
Uploaded my first iteration of the Dockerfile. I hope the instructions on use
are clear; you basically just have to put a JDK and Maven tarball in the same
directory and type {{docker build .}} to create an image.
Provide a Dockerfile to easily build and run HBase from source
--
Key: HBASE-11885
URL: https://issues.apache.org/jira/browse/HBASE-11885
Project: HBase
Issue Type: New Feature
Reporter: Dima Spivak
Assignee: Dima Spivak
Attachments: HBASE-11885.patch
[A recent email to
dev@|http://mail-archives.apache.org/mod_mbox/hbase-dev/201408.mbox/%3CCAAef%2BM4q%3Da8Dqxe_EHSFTueY%2BXxz%2BtTe%2BJKsWWbXjhB_Pz7oSA%40mail.gmail.com%3E]
highlighted the difficulty that new users can face in getting HBase compiled
from source and running locally. I'd like to provide a Dockerfile that would
allow anyone with Docker running on a machine with a reasonably current Linux
kernel to do so with ease.
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
[jira] [Commented] (HBASE-11885) Provide a Dockerfile to easily build and run HBase from source
[ https://issues.apache.org/jira/browse/HBASE-11885?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14120783#comment-14120783 ] chendihao commented on HBASE-11885: --- I'm also interested in building HBase on docker and here's my dockerfile, https://github.com/tobegit3hub/standalone-hbase-0.94. There're lots of HBase images in docker hub. It let us escape from dependency hell so I don't think we should download the JDK and Maven tars by ourselves to build the image:-) Provide a Dockerfile to easily build and run HBase from source -- Key: HBASE-11885 URL: https://issues.apache.org/jira/browse/HBASE-11885 Project: HBase Issue Type: New Feature Reporter: Dima Spivak Assignee: Dima Spivak Attachments: HBASE-11885.patch [A recent email to dev@|http://mail-archives.apache.org/mod_mbox/hbase-dev/201408.mbox/%3CCAAef%2BM4q%3Da8Dqxe_EHSFTueY%2BXxz%2BtTe%2BJKsWWbXjhB_Pz7oSA%40mail.gmail.com%3E] highlighted the difficulty that new users can face in getting HBase compiled from source and running locally. I'd like to provide a Dockerfile that would allow anyone with Docker running on a machine with a reasonably current Linux kernel to do so with ease. -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Commented] (HBASE-11885) Provide a Dockerfile to easily build and run HBase from source
[ https://issues.apache.org/jira/browse/HBASE-11885?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14120789#comment-14120789 ] Dima Spivak commented on HBASE-11885: - I think for licensing reasons (i.e. having to do with Java) and also to avoid stale Maven versions down the line being baked into the Dockerfile itself, having a user supply their own preferred version is the way to go if we are to include a Dockerfile for users in Apache HBase. I think this also lets someone easily test different combinations of Java and Maven to validate that the code builds. Thoughts? Provide a Dockerfile to easily build and run HBase from source -- Key: HBASE-11885 URL: https://issues.apache.org/jira/browse/HBASE-11885 Project: HBase Issue Type: New Feature Reporter: Dima Spivak Assignee: Dima Spivak Attachments: HBASE-11885.patch [A recent email to dev@|http://mail-archives.apache.org/mod_mbox/hbase-dev/201408.mbox/%3CCAAef%2BM4q%3Da8Dqxe_EHSFTueY%2BXxz%2BtTe%2BJKsWWbXjhB_Pz7oSA%40mail.gmail.com%3E] highlighted the difficulty that new users can face in getting HBase compiled from source and running locally. I'd like to provide a Dockerfile that would allow anyone with Docker running on a machine with a reasonably current Linux kernel to do so with ease. -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Commented] (HBASE-11885) Provide a Dockerfile to easily build and run HBase from source
[
https://issues.apache.org/jira/browse/HBASE-11885?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14120798#comment-14120798
]
Hadoop QA commented on HBASE-11885:
---
{color:red}-1 overall{color}. Here are the results of testing the latest
attachment
http://issues.apache.org/jira/secure/attachment/12666367/HBASE-11885.patch
against trunk revision .
ATTACHMENT ID: 12666367
{color:green}+1 @author{color}. The patch does not contain any @author
tags.
{color:red}-1 tests included{color}. The patch doesn't appear to include
any new or modified tests.
Please justify why no new tests are needed for this
patch.
Also please list what manual steps were performed to
verify this patch.
{color:green}+1 javac{color}. The applied patch does not increase the
total number of javac compiler warnings.
{color:green}+1 javac{color}. The applied patch does not increase the
total number of javac compiler warnings.
{color:green}+1 javadoc{color}. The javadoc tool did not generate any
warning messages.
{color:green}+1 findbugs{color}. The patch does not introduce any new
Findbugs (version 2.0.3) warnings.
{color:green}+1 release audit{color}. The applied patch does not increase
the total number of release audit warnings.
{color:red}-1 lineLengths{color}. The patch introduces the following lines
longer than 100:
+ENV PATH
/usr/java/bin:/usr/local/apache-maven/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin
+ENV PATH
/root/hbase-bin/bin:/usr/java/bin:/usr/local/apache-maven/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin
{color:green}+1 site{color}. The mvn site goal succeeds with this patch.
{color:red}-1 core tests{color}. The patch failed these unit tests:
org.apache.hadoop.hbase.replication.TestPerTableCFReplication
{color:red}-1 core zombie tests{color}. There are 11 zombie test(s):
at
org.apache.deltaspike.data.test.util.TestDeployments.addDependencies(TestDeployments.java:171)
at
org.apache.deltaspike.data.test.util.TestDeployments.initDeployment(TestDeployments.java:118)
at
org.apache.deltaspike.data.test.util.TestDeployments.initDeployment(TestDeployments.java:88)
at
org.jboss.arquillian.container.test.impl.client.deployment.AnnotationDeploymentScenarioGenerator.invoke(AnnotationDeploymentScenarioGenerator.java:156)
at
org.jboss.arquillian.container.test.impl.client.deployment.AnnotationDeploymentScenarioGenerator.generateDeployment(AnnotationDeploymentScenarioGenerator.java:94)
at
org.jboss.arquillian.container.test.impl.client.deployment.AnnotationDeploymentScenarioGenerator.generate(AnnotationDeploymentScenarioGenerator.java:57)
at
org.jboss.arquillian.container.test.impl.client.deployment.DeploymentGenerator.generateDeployment(DeploymentGenerator.java:79)
at
org.jboss.arquillian.container.test.impl.client.ContainerEventController.execute(ContainerEventController.java:100)
at
org.jboss.arquillian.test.impl.TestContextHandler.createClassContext(TestContextHandler.java:75)
at
org.jboss.arquillian.test.impl.TestContextHandler.createSuiteContext(TestContextHandler.java:60)
at
org.jboss.arquillian.test.impl.EventTestRunnerAdaptor.beforeClass(EventTestRunnerAdaptor.java:80)
at
org.apache.hadoop.hbase.mapreduce.TestImportExport.testMetaExport(TestImportExport.java:209)
at
org.apache.hadoop.hbase.snapshot.TestExportSnapshot.testExportFailure(TestExportSnapshot.java:321)
at
org.apache.hadoop.hbase.replication.regionserver.TestRegionReplicaReplicationEndpoint.testRegionReplicaReplicationForFlushAndCompaction(TestRegionReplicaReplicationEndpoint.java:246)
at
org.apache.hadoop.hbase.snapshot.TestExportSnapshot.testExportFailure(TestExportSnapshot.java:321)
at
org.apache.hadoop.hbase.mapreduce.TestTableMapReduceBase.testMultiRegionTable(TestTableMapReduceBase.java:96)
at
org.apache.hadoop.hbase.TestZooKeeper.testLogSplittingAfterMasterRecoveryDueToZKExpiry(TestZooKeeper.java:564)
at
org.apache.hadoop.hbase.replication.TestReplicationDisableInactivePeer.testDisableInactivePeer(TestReplicationDisableInactivePeer.java:79)
at
org.apache.hadoop.hbase.mapreduce.TestTableInputFormatScanBase.testScan(TestTableInputFormatScanBase.java:238)
at
org.apache.hadoop.hbase.mapreduce.TestTableInputFormatScan2.testScanOBBToOPP(TestTableInputFormatScan2.java:44)
at
org.apache.hadoop.hbase.replication.TestReplicationSyncUpTool.testSyncUpTool(TestReplicationSyncUpTool.java:140)
at
org.apache.hadoop.hbase.TestAcidGuarantees.testGetAtomicity(TestAcidGuarantees.java:331)
Test results:
https://builds.apache.org/job/PreCommit-HBASE-Build/10706//testReport/
Findbugs warnings:
[jira] [Commented] (HBASE-11885) Provide a Dockerfile to easily build and run HBase from source
[ https://issues.apache.org/jira/browse/HBASE-11885?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14120811#comment-14120811 ] chendihao commented on HBASE-11885: --- That's nice and I haven't thoungt about the license problem. As users they may not care about the versions of Java and Maven. So I think the ideal way for them may be pulling the HBase image to run instead of building it by themselves. As developers we may want to test the combination of softwares. But it's hard to cater to all kinds of environment, like different versions of Java, Maven, Linux distributions and kernels. Provide a Dockerfile to easily build and run HBase from source -- Key: HBASE-11885 URL: https://issues.apache.org/jira/browse/HBASE-11885 Project: HBase Issue Type: New Feature Reporter: Dima Spivak Assignee: Dima Spivak Attachments: HBASE-11885.patch [A recent email to dev@|http://mail-archives.apache.org/mod_mbox/hbase-dev/201408.mbox/%3CCAAef%2BM4q%3Da8Dqxe_EHSFTueY%2BXxz%2BtTe%2BJKsWWbXjhB_Pz7oSA%40mail.gmail.com%3E] highlighted the difficulty that new users can face in getting HBase compiled from source and running locally. I'd like to provide a Dockerfile that would allow anyone with Docker running on a machine with a reasonably current Linux kernel to do so with ease. -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Commented] (HBASE-11885) Provide a Dockerfile to easily build and run HBase from source
[ https://issues.apache.org/jira/browse/HBASE-11885?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14120813#comment-14120813 ] Dima Spivak commented on HBASE-11885: - :) Yep, that's why I think this would belong in hbase/dev-support. Good points all around, [~tobe]. Provide a Dockerfile to easily build and run HBase from source -- Key: HBASE-11885 URL: https://issues.apache.org/jira/browse/HBASE-11885 Project: HBase Issue Type: New Feature Reporter: Dima Spivak Assignee: Dima Spivak Attachments: HBASE-11885.patch [A recent email to dev@|http://mail-archives.apache.org/mod_mbox/hbase-dev/201408.mbox/%3CCAAef%2BM4q%3Da8Dqxe_EHSFTueY%2BXxz%2BtTe%2BJKsWWbXjhB_Pz7oSA%40mail.gmail.com%3E] highlighted the difficulty that new users can face in getting HBase compiled from source and running locally. I'd like to provide a Dockerfile that would allow anyone with Docker running on a machine with a reasonably current Linux kernel to do so with ease. -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Commented] (HBASE-11885) Provide a Dockerfile to easily build and run HBase from source
[
https://issues.apache.org/jira/browse/HBASE-11885?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14120871#comment-14120871
]
Srikanth Srungarapu commented on HBASE-11885:
-
Tried this out on ubuntu instance. A few observations
* The step `docker build -t hbase_docker .` failed in the first run with the
following error message
{code}
2014/09/03 19:02:39 Error getting container
ac1daa65e3f7ae0f2584d8b6c312dcda36125b32b2826acbe4b8306805d21417 from driver
devicemapper: Unknown filesystem type on
/dev/mapper/docker-202:1-928606-ac1daa65e3f7ae0f2584d8b6c312dcda36125b32b2826acbe4b8306805d21417
root@sri-ubuntu:~/hbase/dev-support/hbase_docker# docker run -it hbase_docker
Unable to find image 'hbase_docker' locally
Pulling repository hbase_docker
2014/09/03 19:03:36 Error: image hbase_docker not found
{code}
The second run of the same command didn't run into any failures
* Would be nice if we can include a section to mention the supported OS and/or
Kernel versions.
* How about including the docker specific commands for important functions such
as stopping the existing hbase docker instances?
Provide a Dockerfile to easily build and run HBase from source
--
Key: HBASE-11885
URL: https://issues.apache.org/jira/browse/HBASE-11885
Project: HBase
Issue Type: New Feature
Reporter: Dima Spivak
Assignee: Dima Spivak
Attachments: HBASE-11885.patch
[A recent email to
dev@|http://mail-archives.apache.org/mod_mbox/hbase-dev/201408.mbox/%3CCAAef%2BM4q%3Da8Dqxe_EHSFTueY%2BXxz%2BtTe%2BJKsWWbXjhB_Pz7oSA%40mail.gmail.com%3E]
highlighted the difficulty that new users can face in getting HBase compiled
from source and running locally. I'd like to provide a Dockerfile that would
allow anyone with Docker running on a machine with a reasonably current Linux
kernel to do so with ease.
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
