Re: [I] SparkKubernetesOperator not retrieves logs from the driver pod and displays them in the Airflow UI. [airflow]

hussein-awala closed issue #37681: SparkKubernetesOperator not retrieves logs from the driver pod and displays them in the Airflow UI. URL: https://github.com/apache/airflow/issues/37681 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to

Re: [I] SparkKubernetesOperator not retrieves logs from the driver pod and displays them in the Airflow UI. [airflow]

sudohainguyen commented on issue #37681: URL: https://github.com/apache/airflow/issues/37681#issuecomment-2016329205 hey can we expect this will be fixed in the next release? -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub

Re: [I] SparkKubernetesOperator not retrieves logs from the driver pod and displays them in the Airflow UI. [airflow]

hamedhsn commented on issue #37681: URL: https://github.com/apache/airflow/issues/37681#issuecomment-2006947587 > cc @hamedhsn could this be related to the recent change in #22253 ? yeah it looks like, since k8sopeartor changed to support list of container using container_logs. lets

Re: [I] SparkKubernetesOperator not retrieves logs from the driver pod and displays them in the Airflow UI. [airflow]

sudohainguyen commented on issue #37681: URL: https://github.com/apache/airflow/issues/37681#issuecomment-2005591684 I've been facing the same, should we proceed this issue? so it could be resolved in the next release -- This is an automated message from the Apache Git Service. To

Re: [I] SparkKubernetesOperator not retrieves logs from the driver pod and displays them in the Airflow UI. [airflow]

eladkal commented on issue #37681: URL: https://github.com/apache/airflow/issues/37681#issuecomment-1991089826 cc @hamedhsn could this be related to the recent change in https://github.com/apache/airflow/pull/22253 ? -- This is an automated message from the Apache Git Service. To respond

Re: [I] SparkKubernetesOperator not retrieves logs from the driver pod and displays them in the Airflow UI. [airflow]

auyer commented on issue #37681: URL: https://github.com/apache/airflow/issues/37681#issuecomment-1984210977 I had a different take. In my case, I only allow one task at a time. Sometimes after a failure, even when Airflow considered the task to be in error state, the Spark Task would

Re: [I] SparkKubernetesOperator not retrieves logs from the driver pod and displays them in the Airflow UI. [airflow]

thispejo commented on issue #37681: URL: https://github.com/apache/airflow/issues/37681#issuecomment-1969619079 Sure, pip show apache-airflow-providers-cncf-kubernetes WARNING: The directory '/.cache/pip' or its parent directory is not owned or is not writable by the current

Re: [I] SparkKubernetesOperator not retrieves logs from the driver pod and displays them in the Airflow UI. [airflow]

SamWheating commented on issue #37681: URL: https://github.com/apache/airflow/issues/37681#issuecomment-1967186556 Hi there, could you please confirm which version of `apache-airflow-providers-cncf-kubernetes` you are using? -- This is an automated message from the Apache Git Service. To

Re: [I] SparkKubernetesOperator not retrieves logs from the driver pod and displays them in the Airflow UI. [airflow]

boring-cyborg[bot] commented on issue #37681: URL: https://github.com/apache/airflow/issues/37681#issuecomment-1962737572 Thanks for opening your first issue here! Be sure to follow the issue template! If you are willing to raise PR to address this issue please do so, no need to wait for

[I] SparkKubernetesOperator not retrieves logs from the driver pod and displays them in the Airflow UI. [airflow]

thispejo opened a new issue, #37681: URL: https://github.com/apache/airflow/issues/37681 ### Apache Airflow version 2.8.1 ### If "Other Airflow 2 version" selected, which one? 2.8.1 ### What happened? I was using version 2.6.1 and after updating to version