Re: Correctness bug on Shuffle+Repartition scenario

2021-01-18 Thread
Hi Shiao-An Yuan I also found this correctness problem in my production environment. My spark version is 2.3.1。 I thought it was because Spark-23243 before . But you said You also have this problem in your environment , and your version is 2.4.4 which had solved spark-23243. So Maybe this problem

【The decimal result is incorrectly enlarged by 100 times】

2020-10-20 Thread
Hi , I have came across a problem about correctness of spark decimal, and I have researched for it a few days. This problem is very curious. My spark version is spark 2.3.1 I have a sql like this: Create table table_S stored as orc as Select a*b*c from table_a Union all Select d from table_B Un