Re: [DISCUSS][SPIP] Standardize Spark Exception Messages

2020-10-25 Thread Nicholas Chammas
Just want to call out that this SPIP should probably account somehow for PySpark and the work being done in SPARK-32082 to improve PySpark exceptions. On Sun, Oct 25, 2020 at 8:05 PM Xinyi Yu wrote: > Hi all, > > We like to post a SPIP of

Re: [DISCUSS] preferred behavior when fails to instantiate configured v2 session catalog

2020-10-25 Thread Jungtaek Lim
Yeah I'm in favor of fast-fail if things are not working out as end users intended. Spark should only fail back when it doesn't make any difference but only some sort of performance. (like whole stage codegen) This fail back brings behavioral differences, which should be considered as a bug. I'll

[DISCUSS][SPIP] Standardize Spark Exception Messages

2020-10-25 Thread Xinyi Yu
Hi all, We like to post a SPIP of Standardize Exception Messages in Spark. Here is the document link:  https://docs.google.com/document/d/1XGj1o3xAFh8BA7RCn3DtwIPC6--hIFOaNUNSlpaOIZs/edit?usp=sharing