[
https://issues.apache.org/jira/browse/SPARK-7967?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Will Chen updated SPARK-7967:
-----------------------------
Description:
Code:
val userDF = app_user_register_log.filter($"add_time" >
startDay).filter($"add_time" < endDay)
.select("id").as("userReg")
.join(activeDF.as("ad"), $"userReg.id" === $"ad.uid")
.select("ad.uid","ad.clientVerion","ad.loc","ad.auth_status"
,"ad.channel","ad.bd_area","ad.mobile_area","ad.idcard_area")
.withColumn("count", $"count") // Exception came from this line
was:
Code:
val userDF = app_user_register_log.filter($"add_time" >
startDay).filter($"add_time" < endDay)
.select("id").as("userReg")
.join(activeDF.as("ad"), $"userReg.id" === $"ad.uid")
.select("ad.uid","ad.clientVerion","ad.loc","ad.auth_status"
,"ad.channel","ad.bd_area","ad.mobile_area","ad.idcard_area")
.withColumn("count", $"count")
> cannot resolve 'count' given input columns when using DataFrame.withColumn
> --------------------------------------------------------------------------
>
> Key: SPARK-7967
> URL: https://issues.apache.org/jira/browse/SPARK-7967
> Project: Spark
> Issue Type: Bug
> Components: SQL
> Affects Versions: 1.3.0
> Environment: spark 1.3.0 standalone
> Reporter: Will Chen
> Labels: dataFrame, sparksql
>
> Code:
> val userDF = app_user_register_log.filter($"add_time" >
> startDay).filter($"add_time" < endDay)
> .select("id").as("userReg")
> .join(activeDF.as("ad"), $"userReg.id" === $"ad.uid")
> .select("ad.uid","ad.clientVerion","ad.loc","ad.auth_status"
> ,"ad.channel","ad.bd_area","ad.mobile_area","ad.idcard_area")
> .withColumn("count", $"count") // Exception came from this line
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
