[
https://issues.apache.org/jira/browse/SPARK-31244?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Dongjoon Hyun resolved SPARK-31244.
-----------------------------------
Fix Version/s: 3.0.0
Resolution: Fixed
Issue resolved by pull request 28015
[https://github.com/apache/spark/pull/28015]
> Use Minio instead of Ceph in K8S DepsTestsSuite
> -----------------------------------------------
>
> Key: SPARK-31244
> URL: https://issues.apache.org/jira/browse/SPARK-31244
> Project: Spark
> Issue Type: Bug
> Components: Kubernetes, Tests
> Affects Versions: 3.0.0
> Reporter: Dongjoon Hyun
> Assignee: Dongjoon Hyun
> Priority: Major
> Fix For: 3.0.0
>
>
> `DepsTestsSuite` is using `ceph` for S3 storage. However, it's not robust on
> `minikube` version. Also, the image size is almost 1GB.
> {code}
> ceph/daemon
> v4.0.3-stable-4.0-nautilus-centos-7-x86_64 a6a05ccdf924 6 months ago
> 852MB
> ceph/daemon
> v4.0.11-stable-4.0-nautilus-centos-7 87f695550d8e 12 hours ago
> 901MB
> {code}
> {code}
> $ minikube version
> minikube version: v1.8.2
> $ minikube -p minikube docker-env | source
> $ docker run -it --rm -e NETWORK_AUTO_DETECT=4 -e RGW_FRONTEND_PORT=8000 -e
> SREE_PORT=5001 -e CEPH_DEMO_UID=nano -e CEPH_DAEMON=demo
> ceph/daemon:v4.0.3-stable-4.0-nautilus-centos-7-x86_64 /bin/sh
> 2020-03-25 04:26:21 /opt/ceph-container/bin/entrypoint.sh: ERROR- it looks
> like we have not been able to discover the network settings
> $ docker run -it --rm -e NETWORK_AUTO_DETECT=4 -e RGW_FRONTEND_PORT=8000 -e
> SREE_PORT=5001 -e CEPH_DEMO_UID=nano -e CEPH_DAEMON=demo
> ceph/daemon:v4.0.11-stable-4.0-nautilus-centos-7 /bin/sh
> 2020-03-25 04:20:30 /opt/ceph-container/bin/entrypoint.sh: ERROR- it looks
> like we have not been able to discover the network settings
> {code}
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org
For additional commands, e-mail: issues-h...@spark.apache.org
