Re: How to explode array columns of a dataframe having the same length

2023-02-19 Thread 404
sql: select inline(arrays_zip(col1, col2, col3)) as (c1, c2, c3) from t1 Replied Message | From | Enrico Minack | | Date | 02/16/2023 16:06 | | To | , sam smith | | Subject | Re: How to explode array columns of a dataframe having the same length | You have to take each row and

Re: Graceful shutdown SPARK Structured Streaming

2023-02-19 Thread Bjørn Jørgensen
What is it that stop(stopGraceFully=True) does then? https://spark.apache.org/docs/latest/api/python/_modules/pyspark/streaming/context.html#StreamingContext.stop ons. 8. feb. 2023 kl. 19:22 skrev Brian Wylie : > It's been a few years (so this approach might be out of date) but here's > what I

Re: SPIP: Shutting down spark structured streaming when the streaming process completed current process

2023-02-19 Thread Mich Talebzadeh
Hi Dongjoon., This was an oversight from my side. I confused your involvement with docker build stuff. HTH view my Linkedin profile https://en.everybodywiki.com/Mich_Talebzadeh *Disclaimer:* Use it at your own risk. Any and