Re: spark 3.2.1 download

2022-03-07 Thread Bulldog20630405
yes; a hard refresh did it... was a caching issue...thanx On Mon, Mar 7, 2022 at 11:54 AM Sean Owen wrote: > Hm, 3.2.1 shows up for me, it's the default. Try refreshing the page? > sometimes people have an old cached copy. > > On Mon, Mar 7, 2022 at 10:30 AM Bulldog20630405 > wrote: > >> >>

Re: spark 3.2.1 download

2022-03-07 Thread Sean Owen
Hm, 3.2.1 shows up for me, it's the default. Try refreshing the page? sometimes people have an old cached copy. On Mon, Mar 7, 2022 at 10:30 AM Bulldog20630405 wrote: > > from website spark 3.2.1 has been release in january 2020; however not > available for download from =>

spark 3.2.1 download

2022-03-07 Thread Bulldog20630405
from website spark 3.2.1 has been release in january 2020; however not available for download from => https://spark.apache.org/downloads.html (only 3.2.0) when will spark binary 3.2.1 be available for download?

Re: [EXTERNAL] Re: Need to make WHERE clause compulsory in Spark SQL

2022-03-07 Thread Gourav Sengupta
Hi, are all users using the same cluster of data proc? Regards, Gourav On Mon, Mar 7, 2022 at 9:28 AM Saurabh Gulati wrote: > Thanks for the response, Gourav. > > Queries range from simple to large joins. We expose the data to our > analytics users so that they can develop their models and

python API in Spark-streaming-kafka spark 3.2.1

2022-03-07 Thread Wiśniewski Michał
Hi, I've read in the documentation, that since spark 3.2.1 python API for spark-streaming-kafka is back in the game. https://spark.apache.org/docs/3.2.1/streaming-programming-guide.html#advanced-sources But in the Kafka Integration Guide there is no documentation for the python API.

Re: [EXTERNAL] Re: Need to make WHERE clause compulsory in Spark SQL

2022-03-07 Thread Saurabh Gulati
Thanks for the response, Gourav. Queries range from simple to large joins. We expose the data to our analytics users so that they can develop their models and they use superset as the SQL interface for testing. Hive-metastore will not do a full scan if we specify the partitioning column. But