appunni-dishq edited a comment on issue #9860:
URL: https://github.com/apache/airflow/issues/9860#issuecomment-696972528
Hey I enabled it and ran the task, and only after beginning first run the
error came. I am using Kubernetes to deploy airflow and this is the docker I am
using may be that is the different you can tell what I am doing wrong
```
FROM apache/airflow:1.10.12-python3.6
USER root
RUN buildDeps="gcc python3-dev" \
&& apt-get update \
&& apt-get install -y $buildDeps --no-install-recommends
RUN pip3 install pyspark==2.4.3 py4j==0.10.7 --no-cache
RUN pip3 install
apache-airflow[postgres,crypto,gcp,google_auth,kubernetes,slack,jdbc,password,aws]==1.10.12
--no-cache
RUN apt-get purge -y --auto-remove gcc python3-dev
USER airflow
RUN curl -O
https://download.java.net/java/GA/jdk11/9/GPL/openjdk-11.0.2_linux-x64_bin.tar.gz
\
&& tar zxvf openjdk-11.0.2_linux-x64_bin.tar.gz \
&& rm openjdk-11.0.2_linux-x64_bin.tar.gz
ENV JAVA_HOME=/opt/airflow/jdk-11.0.2
RUN curl -O
https://archive.apache.org/dist/spark/spark-2.4.3/spark-2.4.3-bin-hadoop2.7.tgz
\
&& tar -xvf spark-2.4.3-bin-hadoop2.7.tgz \
&& rm spark-2.4.3-bin-hadoop2.7.tgz
ENV PYSPARK_PYTHON=/usr/local/bin/python
ENV SPARK_HOME=/opt/airflow/spark-2.4.3-bin-hadoop2.7/
ENV PATH=$PATH:/opt/airflow/dags/
ENV PYTHONPATH=/opt/airflow/dags/
```
@dimberman
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
[email protected]
