[
https://issues.apache.org/jira/browse/HDDS-1646?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16871720#comment-16871720
]
Hudson commented on HDDS-1646:
------------------------------
SUCCESS: Integrated in Jenkins build Hadoop-trunk-Commit #16815 (See
[https://builds.apache.org/job/Hadoop-trunk-Commit/16815/])
HDDS-1646. Support real persistence in the k8s example files (#945)
(aengineer: rev d023f1f8640994d5233c27316a036c746c2f8429)
* (edit) hadoop-ozone/dist/src/main/k8s/definitions/ozone/scm-ss.yaml
* (add) hadoop-ozone/dist/src/main/k8s/definitions/ozone/datanode-ss.yaml
* (delete)
hadoop-ozone/dist/src/main/k8s/definitions/ozone/transformations/emptydir.yaml
* (add) hadoop-ozone/dist/src/main/k8s/examples/ozone-dev/Flekszible
* (delete)
hadoop-ozone/dist/src/main/k8s/examples/ozone-dev/datanode-daemonset.yaml
* (delete) hadoop-ozone/dist/src/main/k8s/definitions/ozone/datanode-ds.yaml
* (add) hadoop-ozone/dist/src/main/k8s/examples/ozone/datanode-statefulset.yaml
* (add) hadoop-ozone/dist/src/main/k8s/examples/getting-started/om-service.yaml
* (add)
hadoop-ozone/dist/src/main/k8s/examples/getting-started/s3g-statefulset.yaml
* (add) hadoop-ozone/dist/src/main/k8s/examples/getting-started/LICENSE.header
* (add)
hadoop-ozone/dist/src/main/k8s/definitions/ozone/definitions/persistence.yaml
* (add)
hadoop-ozone/dist/src/main/k8s/examples/getting-started/config-configmap.yaml
* (add)
hadoop-ozone/dist/src/main/k8s/examples/getting-started/datanode-statefulset.yaml
* (edit) hadoop-ozone/dist/src/main/k8s/examples/ozone/s3g-statefulset.yaml
* (add)
hadoop-ozone/dist/src/main/k8s/examples/ozone-dev/datanode-public-service.yaml
* (edit) hadoop-ozone/dist/src/main/k8s/examples/ozone-dev/scm-statefulset.yaml
* (add)
hadoop-ozone/dist/src/main/k8s/examples/getting-started/freon/freon-deployment.yaml
* (add)
hadoop-ozone/dist/src/main/k8s/examples/getting-started/s3g-public-service.yaml
* (delete) hadoop-ozone/dist/src/main/k8s/examples/ozone/datanode-daemonset.yaml
* (edit) hadoop-ozone/dist/src/main/k8s/definitions/ozone/om-ss.yaml
* (add)
hadoop-ozone/dist/src/main/k8s/examples/getting-started/om-statefulset.yaml
* (edit)
hadoop-ozone/dist/src/main/k8s/examples/minikube/datanode-statefulset.yaml
* (add)
hadoop-ozone/dist/src/main/k8s/definitions/ozone/definitions/emptydir.yaml
* (add)
hadoop-ozone/dist/src/main/k8s/examples/getting-started/datanode-public-service.yaml
* (add)
hadoop-ozone/dist/src/main/k8s/examples/getting-started/om-public-service.yaml
* (add) hadoop-ozone/dist/src/main/k8s/examples/ozone/Flekszible
* (edit) hadoop-ozone/dist/src/main/k8s/examples/ozone/om-statefulset.yaml
* (add)
hadoop-ozone/dist/src/main/k8s/examples/getting-started/scm-statefulset.yaml
* (delete)
hadoop-ozone/dist/src/main/k8s/examples/minikube/flekszible/flekszible.yaml
* (add) hadoop-ozone/dist/src/main/k8s/examples/ozone-dev/datanode-service.yaml
* (edit) hadoop-ozone/dist/src/main/k8s/examples/minikube/s3g-statefulset.yaml
* (edit) hadoop-ozone/dist/src/main/k8s/examples/ozone-dev/s3g-statefulset.yaml
* (edit) hadoop-ozone/dist/src/main/k8s/examples/minikube/scm-statefulset.yaml
* (edit) hadoop-ozone/dist/src/main/k8s/examples/minikube/datanode-service.yaml
* (add)
hadoop-ozone/dist/src/main/k8s/examples/getting-started/scm-public-service.yaml
* (add) hadoop-ozone/dist/src/main/k8s/examples/getting-started/scm-service.yaml
* (add) hadoop-ozone/dist/src/main/k8s/examples/ozone/datanode-service.yaml
* (delete)
hadoop-ozone/dist/src/main/k8s/examples/ozone/flekszible/flekszible.yaml
* (delete)
hadoop-ozone/dist/src/main/k8s/examples/ozone-dev/flekszible/flekszible.yaml
* (edit) hadoop-ozone/dist/src/main/k8s/examples/ozone/scm-statefulset.yaml
* (add) hadoop-ozone/dist/src/main/k8s/examples/getting-started/s3g-service.yaml
* (edit) hadoop-ozone/dist/src/main/k8s/examples/ozone-dev/om-statefulset.yaml
* (edit) hadoop-ozone/dist/src/main/k8s/examples/minikube/om-statefulset.yaml
* (add) hadoop-ozone/dist/src/main/k8s/examples/getting-started/Flekszible
* (add) hadoop-ozone/dist/src/main/k8s/examples/minikube/Flekszible
* (add)
hadoop-ozone/dist/src/main/k8s/examples/minikube/datanode-public-service.yaml
* (add)
hadoop-ozone/dist/src/main/k8s/examples/ozone-dev/datanode-statefulset.yaml
* (add)
hadoop-ozone/dist/src/main/k8s/definitions/ozone/datanode-ss-service.yaml
* (add)
hadoop-ozone/dist/src/main/k8s/examples/getting-started/datanode-service.yaml
> Support real persistence in the k8s example files
> --------------------------------------------------
>
> Key: HDDS-1646
> URL: https://issues.apache.org/jira/browse/HDDS-1646
> Project: Hadoop Distributed Data Store
> Issue Type: Sub-task
> Reporter: Elek, Marton
> Assignee: Elek, Marton
> Priority: Critical
> Labels: pull-request-available
> Fix For: 0.4.1
>
> Time Spent: 1h 10m
> Remaining Estimate: 0h
>
> Ozone release contains example k8s deployment files to make it easier to
> deploy Ozone to kubernetes. As of now we use emptyDir everywhere, we should
> support the configuration of host volumes (hostPath or Local Persistent
> volumes).
> The big question here is the default:
> * Make the examples easy to start and ephemeral
> * Make the examples more safe, by default (but couldn't be started without
> additional administration).
> (Note this conversation is started in the review of HDDS-1508)
> Xiaoyu: Can we support mount hostVolume for datanode daemons?
> Marton: Yes, we can.
> AFAIK there are two options:
> * using
> [hostPath](https://kubernetes.io/docs/concepts/storage/volumes/#hostpath)
> * or with [Local
> PersistentVolumes](https://kubernetes.io/blog/2018/04/13/local-persistent-volumes-beta/)
> The first one requires the knowledge of directory names on the host.
> The second one is recommended but it requires the creation of
> PersistentVolumes or install a PersistentVolume provider
> I am not sure what is the best approach, my current proposal is:
> * Use empty dir everywhere to make it easier to start simple ozone cluster
> * Provide simple option to turn on any of theses persistence (the kubernetes
> files are generated and the generation can be parametrized)
> * Document how to customize the kubernetes resources files
> Summary: it's question of the defaults:
>
> 1. Use a complex, but persistent solution, which may not work out of the
> box
> 2. Use a simple, but ephemeral solution (as default)
> I started to use (2) but I am open to change.
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
