Re: Tools for web-based whiteboards for design, hand-written like diagrams

2021-11-15 Thread Ali Behjati
Hi Mich, Thanks for sharing! Highly appreciated. I always looked for an easy and intuitive tool for drawings. On Sun, Nov 14, 2021 at 10:28 PM Mich Talebzadeh wrote: > Few weeks ago we discussed the choice of IDE for Spark and a number of > great approaches were pointed out. It is good to know

Re: [Spark-Core] Spark Dry Run

2021-10-04 Thread Ali Behjati
Any and all responsibility for >> any loss, damage or destruction of data or any other property which may >> arise from relying on this email's technical content is explicitly >> disclaimed. The author will in no case be liable for any monetary damages >> arising from such los

Re: [Spark-Core] Spark Dry Run

2021-09-30 Thread Ali Behjati
relying on this email's technical content is explicitly disclaimed. > The author will in no case be liable for any monetary damages arising from > such loss, damage or destruction. > > > > > On Thu, 30 Sept 2021 at 15:20, Ali Behjati wrote: > >> Yeah it doesn't remove the ne

Re: [Spark-Core] Spark Dry Run

2021-09-30 Thread Ali Behjati
:15 PM Sean Owen wrote: > If testing, wouldn't you actually want to execute things? even if at a > small scale, on a sample of data? > > On Thu, Sep 30, 2021 at 9:07 AM Ali Behjati wrote: > >> Hey everyone, >> >> >> By dry run I mean ability to validate

[Spark-Core] Spark Dry Run

2021-09-30 Thread Ali Behjati
Hey everyone, By dry run I mean ability to validate the execution plan but not executing it within the code. I was wondering whether this exists in spark or not. I couldn't find it anywhere. If it doesn't exist I want to propose adding such a feature in spark. Why is it useful? 1. Faster