Re: Conda Python Env in K8S

2021-12-24 Thread Hyukjin Kwon
mstag, 4. Dezember 2021 18:36 > *To:* Bode, Meikel, NMA-CFD > *Cc:* dev ; u...@spark.apache.org > *Subject:* Re: Conda Python Env in K8S > > > > > Hi Meikel > > > > In the past I tried with > > > >--py-files > hdfs://$HDFS_HOST:$HDFS_P

Re: Conda Python Env in K8S

2021-12-06 Thread Mich Talebzadeh
530 > > https://issues.apache.org/jira/browse/SPARK-33615 > > > > Best, > > Meikel > > > > > > *From:* Mich Talebzadeh > *Sent:* Samstag, 4. Dezember 2021 18:36 > *To:* Bode, Meikel, NMA-CFD > *Cc:* dev ; u...@spark.apache.org > *Subject:* Re: Co

RE: Conda Python Env in K8S

2021-12-06 Thread Bode, Meikel, NMA-CFD
615 Best, Meikel From: Mich Talebzadeh Sent: Samstag, 4. Dezember 2021 18:36 To: Bode, Meikel, NMA-CFD Cc: dev ; u...@spark.apache.org Subject: Re: Conda Python Env in K8S Hi Meikel In the past I tried with --py-files hdfs://$HDFS_HOST:$HDFS_PORT/minikube/codes/DSBQ.

Re: Conda Python Env in K8S

2021-12-04 Thread Mich Talebzadeh
want to understand what the issue > is… > > Any hints on that? > > > > Best, > > Meikel > > > > *From:* Mich Talebzadeh > *Sent:* Freitag, 3. Dezember 2021 13:27 > *To:* Bode, Meikel, NMA-CFD > *Cc:* dev ; u...@spark.apache.org > *Subject:* Re:

RE: Conda Python Env in K8S

2021-12-03 Thread Bode, Meikel, NMA-CFD
these options exist and I want to understand what the issue is... Any hints on that? Best, Meikel From: Mich Talebzadeh Sent: Freitag, 3. Dezember 2021 13:27 To: Bode, Meikel, NMA-CFD Cc: dev ; u...@spark.apache.org Subject: Re: Conda Python Env in K8S Build python packages into the docker

Re: Conda Python Env in K8S

2021-12-03 Thread Mich Talebzadeh
Build python packages into the docker image itself first with pip install RUN pip install panda . . —no-cache HTH On Fri, 3 Dec 2021 at 11:58, Bode, Meikel, NMA-CFD < meikel.b...@bertelsmann.de> wrote: > Hello, > > > > I am trying to run spark jobs using Spark Kubernetes Operator. > > But when