Re: [I] [VL] The aggregation results mismatch between Spark3.2.2 and Gluten 1.3 [incubator-gluten]
FelixYBW commented on issue #11057: URL: https://github.com/apache/incubator-gluten/issues/11057#issuecomment-3536901699 Thank you for update. A result mismatch in general operator is very risky which we must solve immediately. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected] - To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
Re: [I] [VL] The aggregation results mismatch between Spark3.2.2 and Gluten 1.3 [incubator-gluten]
beliefer commented on issue #11057: URL: https://github.com/apache/incubator-gluten/issues/11057#issuecomment-3530664116 @wForget @FelixYBW After my investigation and analysis, I found that is caused by the sort of subquery is different. The subquery does not have a clear sorting, so the sort of output is determined by different engines. I think the result is expected. Users should add `ORDER BY col` for subquery if they want the determined results. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected] - To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
Re: [I] [VL] The aggregation results mismatch between Spark3.2.2 and Gluten 1.3 [incubator-gluten]
beliefer closed issue #11057: [VL] The aggregation results mismatch between Spark3.2.2 and Gluten 1.3 URL: https://github.com/apache/incubator-gluten/issues/11057 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected] - To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
Re: [I] [VL] The aggregation results mismatch between Spark3.2.2 and Gluten 1.3 [incubator-gluten]
beliefer commented on issue #11057: URL: https://github.com/apache/incubator-gluten/issues/11057#issuecomment-352623 > Any possible to try main branch? Yes. I tried main branch (2025_11_01), it is still exists. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected] - To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
Re: [I] [VL] The aggregation results mismatch between Spark3.2.2 and Gluten 1.3 [incubator-gluten]
FelixYBW commented on issue #11057: URL: https://github.com/apache/incubator-gluten/issues/11057#issuecomment-3524800971 Any possible to try main branch? -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected] - To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
Re: [I] [VL] The aggregation results mismatch between Spark3.2.2 and Gluten 1.3 [incubator-gluten]
wForget commented on issue #11057: URL: https://github.com/apache/incubator-gluten/issues/11057#issuecomment-3510211186 > [Gluten-result.txt](https://github.com/user-attachments/files/23449348/Gluten-result.txt) [Spark-result.txt](https://github.com/user-attachments/files/23449349/Spark-result.txt) `os_name` may have inconsistent, this is inconsistent line: ``` Spark: 20251026 1 2095193 1 Gluten: 20251026 2 2095193 1 ``` -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected] - To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
Re: [I] [VL] The aggregation results mismatch between Spark3.2.2 and Gluten 1.3 [incubator-gluten]
beliefer commented on issue #11057: URL: https://github.com/apache/incubator-gluten/issues/11057#issuecomment-3510157701 [Gluten-result.txt](https://github.com/user-attachments/files/23449348/Gluten-result.txt) [Spark-result.txt](https://github.com/user-attachments/files/23449349/Spark-result.txt) -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected] - To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
Re: [I] [VL] The aggregation results mismatch between Spark3.2.2 and Gluten 1.3 [incubator-gluten]
beliefer commented on issue #11057: URL: https://github.com/apache/incubator-gluten/issues/11057#issuecomment-3510151593 As you said, I rerun the SQL, I paste the results into achievement. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected] - To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
Re: [I] [VL] The aggregation results mismatch between Spark3.2.2 and Gluten 1.3 [incubator-gluten]
wForget commented on issue #11057: URL: https://github.com/apache/incubator-gluten/issues/11057#issuecomment-3510016133 Could you check if the results are consistent after adding `aid` to group? like: ``` select 20251026 , os_name , a.aid, count(a.aid) from (select ..) a where a.ds = '20251026' group by ds, os_name, a.aid ``` -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected] - To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
