[GitHub] [spark] LuciferYang commented on a diff in pull request #38064: [SPARK-40622][SQL][CORE]Remove the limitation that single task result must fit in 2GB

2022-11-17 Thread GitBox
LuciferYang commented on code in PR #38064: URL: https://github.com/apache/spark/pull/38064#discussion_r1025982465 ## sql/core/src/test/scala/org/apache/spark/sql/DatasetSuite.scala: ## @@ -2228,6 +2231,31 @@ class DatasetSuite extends QueryTest } } +class

[GitHub] [spark] LuciferYang commented on a diff in pull request #38064: [SPARK-40622][SQL][CORE]Remove the limitation that single task result must fit in 2GB

2022-11-17 Thread GitBox
LuciferYang commented on code in PR #38064: URL: https://github.com/apache/spark/pull/38064#discussion_r1025960041 ## sql/core/src/test/scala/org/apache/spark/sql/DatasetSuite.scala: ## @@ -2228,6 +2231,31 @@ class DatasetSuite extends QueryTest } } +class

[GitHub] [spark] LuciferYang commented on a diff in pull request #38064: [SPARK-40622][SQL][CORE]Remove the limitation that single task result must fit in 2GB

2022-11-17 Thread GitBox
LuciferYang commented on code in PR #38064: URL: https://github.com/apache/spark/pull/38064#discussion_r1025953966 ## sql/core/src/test/scala/org/apache/spark/sql/DatasetSuite.scala: ## @@ -2228,6 +2231,31 @@ class DatasetSuite extends QueryTest } } +class

[GitHub] [spark] LuciferYang commented on a diff in pull request #38064: [SPARK-40622][SQL][CORE]Remove the limitation that single task result must fit in 2GB

2022-11-17 Thread GitBox
LuciferYang commented on code in PR #38064: URL: https://github.com/apache/spark/pull/38064#discussion_r1025955547 ## sql/core/src/test/scala/org/apache/spark/sql/DatasetSuite.scala: ## @@ -2228,6 +2231,31 @@ class DatasetSuite extends QueryTest } } +class

[GitHub] [spark] LuciferYang commented on a diff in pull request #38064: [SPARK-40622][SQL][CORE]Remove the limitation that single task result must fit in 2GB

2022-11-17 Thread GitBox
LuciferYang commented on code in PR #38064: URL: https://github.com/apache/spark/pull/38064#discussion_r1025954405 ## sql/core/src/test/scala/org/apache/spark/sql/DatasetSuite.scala: ## @@ -2228,6 +2231,31 @@ class DatasetSuite extends QueryTest } } +class

[GitHub] [spark] LuciferYang commented on a diff in pull request #38064: [SPARK-40622][SQL][CORE]Remove the limitation that single task result must fit in 2GB

2022-11-17 Thread GitBox
LuciferYang commented on code in PR #38064: URL: https://github.com/apache/spark/pull/38064#discussion_r1025953966 ## sql/core/src/test/scala/org/apache/spark/sql/DatasetSuite.scala: ## @@ -2228,6 +2231,31 @@ class DatasetSuite extends QueryTest } } +class