[Feature Request] create *permanent* Spark View from DataFrame via PySpark

2023-06-01 Thread keen
Hi all, currently only *temporary* Spark Views can be created from a DataFrame (df.createOrReplaceTempView or df.createOrReplaceGlobalTempView). When I want a *permanent* Spark View I need to specify it via Spark SQL (CREATE VIEW AS SELECT ...). Sometimes it is easier to specify the desired

Re: ChatGPT and prediction of Spark future

2023-06-01 Thread Mich Talebzadeh
Great stuff Winston. I added a channel in Slack Community for Spark https://sparkcommunitytalk.slack.com/archives/C05ACMS63RT cheers Mich Talebzadeh, Lead Solutions Architect/Engineering Lead Palantir Technologies Limited London United Kingdom view my Linkedin profile