Re: JDK11 Support in Apache Spark

Great work! On Sun, Aug 25, 2019 at 6:03 AM Xiao Li wrote: > Thank you for your contributions! This is a great feature for Spark > 3.0! We finally achieve it! > > Xiao > > On Sat, Aug 24, 2019 at 12:18 PM Felix Cheung > wrote: > >> That’s great! >> >> -- >> *From:*

How to load Python Pickle File in Spark Data frame

Hello Dear Members i want to train model using Bigdl, i have data set of Medical images in the form of pickle object files (,pck).that pickle file is a 3D image(3D array) i have tried pickleRdd = sc.pickleFilehome/student/BigDL- trainings/elephantscale/data/volumetric_data/329637-8.pck

Re: JDK11 Support in Apache Spark

Cool, congrats! Bests, Takeshi On Mon, Aug 26, 2019 at 1:01 PM Hichame El Khalfi wrote: > That's Awesome !!! > > Thanks to everyone that made this possible :cheers: > > Hichame > > *From:* cloud0...@gmail.com > *Sent:* August 25, 2019 10:43 PM > *To:* lix...@databricks.com > *Cc:*

Design review of SPARK-28594

Hi devs, I have been working on designing SPARK-28594 [1] (though I've started with this via different requests) and design doc is now available [2]. Let me describe SPARK-28954 briefly - single and growing event log file for application has been major issue for streaming application as as long