[jira] [Updated] (SPARK-14642) import org.apache.spark.sql.expressions._ breaks udf under functions
[ https://issues.apache.org/jira/browse/SPARK-14642?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shixiong Zhu updated SPARK-14642: - Assignee: Subhobrata Dey > import org.apache.spark.sql.expressions._ breaks udf under functions > > > Key: SPARK-14642 > URL: https://issues.apache.org/jira/browse/SPARK-14642 > Project: Spark > Issue Type: Bug > Components: SQL >Reporter: Yin Huai >Assignee: Subhobrata Dey >Priority: Blocker > Fix For: 2.0.0 > > > The following code works > {code} > scala> import org.apache.spark.sql.functions._ > import org.apache.spark.sql.functions._ > scala> udf((v: String) => v.stripSuffix("-abc")) > res0: org.apache.spark.sql.expressions.UserDefinedFunction = > UserDefinedFunction(,StringType,Some(List(StringType))) > {code} > But, the following does not > {code} > scala> import org.apache.spark.sql.functions._ > import org.apache.spark.sql.functions._ > scala> import org.apache.spark.sql.expressions._ > import org.apache.spark.sql.expressions._ > scala> udf((v: String) => v.stripSuffix("-abc")) > :30: error: No TypeTag available for String >udf((v: String) => v.stripSuffix("-abc")) > {code} -- This message was sent by Atlassian JIRA (v6.3.4#6332) - To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org For additional commands, e-mail: issues-h...@spark.apache.org
[jira] [Updated] (SPARK-14642) import org.apache.spark.sql.expressions._ breaks udf under functions
[ https://issues.apache.org/jira/browse/SPARK-14642?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yin Huai updated SPARK-14642: - Priority: Blocker (was: Critical) > import org.apache.spark.sql.expressions._ breaks udf under functions > > > Key: SPARK-14642 > URL: https://issues.apache.org/jira/browse/SPARK-14642 > Project: Spark > Issue Type: Bug > Components: SQL >Reporter: Yin Huai >Priority: Blocker > > The following code works > {code} > scala> import org.apache.spark.sql.functions._ > import org.apache.spark.sql.functions._ > scala> udf((v: String) => v.stripSuffix("-abc")) > res0: org.apache.spark.sql.expressions.UserDefinedFunction = > UserDefinedFunction(,StringType,Some(List(StringType))) > {code} > But, the following does not > {code} > scala> import org.apache.spark.sql.functions._ > import org.apache.spark.sql.functions._ > scala> import org.apache.spark.sql.expressions._ > import org.apache.spark.sql.expressions._ > scala> udf((v: String) => v.stripSuffix("-abc")) > :30: error: No TypeTag available for String >udf((v: String) => v.stripSuffix("-abc")) > {code} -- This message was sent by Atlassian JIRA (v6.3.4#6332) - To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org For additional commands, e-mail: issues-h...@spark.apache.org
[jira] [Updated] (SPARK-14642) import org.apache.spark.sql.expressions._ breaks udf under functions
[ https://issues.apache.org/jira/browse/SPARK-14642?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yin Huai updated SPARK-14642: - Description: The following code works {code} scala> import org.apache.spark.sql.functions._ import org.apache.spark.sql.functions._ scala> udf((v: String) => v.stripSuffix("-abc")) res0: org.apache.spark.sql.expressions.UserDefinedFunction = UserDefinedFunction(,StringType,Some(List(StringType))) {code} But, the following does not {code} scala> import org.apache.spark.sql.functions._ import org.apache.spark.sql.functions._ scala> import org.apache.spark.sql.expressions._ import org.apache.spark.sql.expressions._ scala> udf((v: String) => v.stripSuffix("-abc")) :30: error: No TypeTag available for String udf((v: String) => v.stripSuffix("-abc")) {code} was: The following code works {code} scala> import org.apache.spark.sql.functions._ import org.apache.spark.sql.functions._ scala> udf((v: String) => v.stripSuffix("-abc")) res0: org.apache.spark.sql.expressions.UserDefinedFunction = UserDefinedFunction(,StringType,Some(List(StringType))) {code} But, the following does not {code} scala> import org.apache.spark.sql.functions._ import org.apache.spark.sql.functions._ scala> import org.apache.spark.sql.expressions._ import org.apache.spark.sql.expressions._ scala> udf((v: String) => v.stripSuffix("-abc")) :30: error: No TypeTag available for String udf((v: String) => v.stripSuffix("-SNAPSHOT")) {code} > import org.apache.spark.sql.expressions._ breaks udf under functions > > > Key: SPARK-14642 > URL: https://issues.apache.org/jira/browse/SPARK-14642 > Project: Spark > Issue Type: Bug > Components: SQL >Reporter: Yin Huai >Priority: Critical > > The following code works > {code} > scala> import org.apache.spark.sql.functions._ > import org.apache.spark.sql.functions._ > scala> udf((v: String) => v.stripSuffix("-abc")) > res0: org.apache.spark.sql.expressions.UserDefinedFunction = > UserDefinedFunction(,StringType,Some(List(StringType))) > {code} > But, the following does not > {code} > scala> import org.apache.spark.sql.functions._ > import org.apache.spark.sql.functions._ > scala> import org.apache.spark.sql.expressions._ > import org.apache.spark.sql.expressions._ > scala> udf((v: String) => v.stripSuffix("-abc")) > :30: error: No TypeTag available for String >udf((v: String) => v.stripSuffix("-abc")) > {code} -- This message was sent by Atlassian JIRA (v6.3.4#6332) - To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org For additional commands, e-mail: issues-h...@spark.apache.org