Re: Spark StructuredStreaming - watermark not working as expected

2023-03-12 Thread Mich Talebzadeh
OK ts is the timestamp right? This is a similar code that works out the average temperature with time frame of 5 minutes. Note the comments and catch error with try: try: # construct a streaming dataframe streamingDataFrame that subscribes to topic temperature

Re: Online classes for spark topics

2023-03-12 Thread Denny Lee
Looks like we have some good topics here - I'm glad to help with setting up the infrastructure to broadcast if it helps? On Thu, Mar 9, 2023 at 6:19 AM neeraj bhadani wrote: > I am happy to be a part of this discussion as well. > > Regards, > Neeraj > > On Wed, 8 Mar 2023 at 22:41, Winston Lai

Re: Online classes for spark topics

2023-03-12 Thread Mich Talebzadeh
Hi Denny, Thanks for the offer. How do you envisage that structure to be? Also it would be good to have a webinar (for a given topic) for different target audiences as we have a mixture of members in Spark forums. For example, beginners, intermediate and advanced. do we have a confluence

Re: Online classes for spark topics

2023-03-12 Thread vaquar khan
I saw you are looking holden video .please find following link. https://www.oreilly.com/library/view/debugging-apache-spark/9781492039174/ Regards, Vaquar khan On Sun, Mar 12, 2023, 6:56 PM Mich Talebzadeh wrote: > Hi Denny, > > Thanks for the offer. How do you envisage that structure to be?