Hi Elior, Could you show the query that led to the exception?
Pozdrawiam, Jacek Laskowski ---- https://about.me/JacekLaskowski Mastering Spark SQL https://bit.ly/mastering-spark-sql Spark Structured Streaming https://bit.ly/spark-structured-streaming Mastering Kafka Streams https://bit.ly/mastering-kafka-streams Follow me at https://twitter.com/jaceklaskowski On Wed, Jul 25, 2018 at 10:04 AM, Elior Malul <[email protected]> wrote: > Exception in thread "main" org.apache.spark.sql.AnalysisException: > collect_set(named_struct(value, country#123 AS value#346, count, > (cast(count(country#123) windowspecdefinit ion(campaign_id#104, > app_id#93, country#123, ROWS BETWEEN UNBOUNDED PRECEDING AND UNBOUNDED > FOLLOWING) as double) / cast(count(1) windowspecdefinition(campaign_id#104, > app_id #93, ROWS BETWEEN UNBOUNDED PRECEDING AND UNBOUNDED FOLLOWING) > as double)) AS count#349) AS histogram_country#350, 0, 0) > windowspecdefinition(campaign_id#104, app_id#93, ROWS BETWEEN > UNBOUNDED PRECEDING AND UNBOUNDED FOLLOWING) AS > collect_set(named_struct(NamePlaceholder(), > country AS `value`, NamePlaceholder(), (CAST(count(country) OVER (PARTITI > ON BY campaign_id, app_id, country UnspecifiedFrame) AS DOUBLE) / > CAST(count(1) OVER (PARTITION BY campaign_id, app_id UnspecifiedFrame) AS > DOUBLE)) AS `count`) AS `histogram _country`) OVER (PARTITION BY > campaign_id, app_id UnspecifiedFrame)#352 has multiple Window > Specifications (ArrayBuffer(windowspecdefinition(campaign_id#104, > app_id#93, ROWS BETWEEN UNBOUNDED PRECEDING AND UNBOUNDED FOLLOWING), > windowspecdefinition(campaign_id#104, app_id#93, country#123, ROWS > BETWEEN UNBOUNDED PRECEDING AND UNBOUNDED FOLLOWING)) ).Please file a > bug report with this error message, stack trace, and the query.; >
