Github user maropu commented on a diff in the pull request:
https://github.com/apache/spark/pull/16605#discussion_r96789868
--- Diff:
sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/expressions/ScalaUDF.scala
---
@@ -84,7 +86,9 @@ case class ScalaUDF(
case 1 =>
Github user maropu commented on a diff in the pull request:
https://github.com/apache/spark/pull/16605#discussion_r96745940
--- Diff:
sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/expressions/ScalaUDF.scala
---
@@ -84,7 +86,9 @@ case class ScalaUDF(
case 1 =>
Github user dongjoon-hyun commented on a diff in the pull request:
https://github.com/apache/spark/pull/16605#discussion_r96691353
--- Diff:
sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/expressions/ScalaUDF.scala
---
@@ -84,7 +86,9 @@ case class ScalaUDF(
Github user maropu commented on a diff in the pull request:
https://github.com/apache/spark/pull/16605#discussion_r96551693
--- Diff: sql/core/src/test/scala/org/apache/spark/sql/DataFrameSuite.scala
---
@@ -1428,6 +1428,134 @@ class DataFrameSuite extends QueryTest with
Github user dongjoon-hyun commented on a diff in the pull request:
https://github.com/apache/spark/pull/16605#discussion_r96550175
--- Diff: sql/core/src/test/scala/org/apache/spark/sql/DataFrameSuite.scala
---
@@ -1428,6 +1428,134 @@ class DataFrameSuite extends QueryTest with
Github user maropu commented on a diff in the pull request:
https://github.com/apache/spark/pull/16605#discussion_r96549098
--- Diff: sql/core/src/test/scala/org/apache/spark/sql/DataFrameSuite.scala
---
@@ -1428,6 +1428,134 @@ class DataFrameSuite extends QueryTest with
Github user maropu commented on a diff in the pull request:
https://github.com/apache/spark/pull/16605#discussion_r96547709
--- Diff: sql/core/src/main/scala/org/apache/spark/sql/functions.scala ---
@@ -3073,7 +3073,12 @@ object functions {
*/
def udf[RT: TypeTag,
Github user dongjoon-hyun commented on a diff in the pull request:
https://github.com/apache/spark/pull/16605#discussion_r96466671
--- Diff: sql/core/src/test/scala/org/apache/spark/sql/DataFrameSuite.scala
---
@@ -1428,6 +1428,134 @@ class DataFrameSuite extends QueryTest with
Github user dongjoon-hyun commented on a diff in the pull request:
https://github.com/apache/spark/pull/16605#discussion_r96473118
--- Diff:
sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/expressions/ScalaUDF.scala
---
@@ -84,7 +86,9 @@ case class ScalaUDF(
Github user dongjoon-hyun commented on a diff in the pull request:
https://github.com/apache/spark/pull/16605#discussion_r96470295
--- Diff:
sql/core/src/main/scala/org/apache/spark/sql/UDFRegistration.scala ---
@@ -137,7 +137,11 @@ class UDFRegistration private[sql]
Github user dongjoon-hyun commented on a diff in the pull request:
https://github.com/apache/spark/pull/16605#discussion_r96469606
--- Diff: sql/core/src/main/scala/org/apache/spark/sql/functions.scala ---
@@ -3073,7 +3073,12 @@ object functions {
*/
def udf[RT:
GitHub user maropu opened a pull request:
https://github.com/apache/spark/pull/16605
[SPARK-18884][SQL] Support Array[_] in ScalaUDF
## What changes were proposed in this pull request?
This pr is to support `Array[_]` in `ScalaUDF`.
Currently, a query below throws an
12 matches
Mail list logo