[ https://issues.apache.org/jira/browse/SPARK-39783?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Enrico Minack updated SPARK-39783: ---------------------------------- Description: The following code references a nested value {{{}`the`.`id`{}}}, that does not exist. The proposed / existing column names are not correctly wrapped in backticks: {code:scala} Seq((0)).toDF("the.id") .select("the.id").show() org.apache.spark.sql.AnalysisException: [UNRESOLVED_COLUMN] A column or function parameter with name `the`.`id` cannot be resolved. Did you mean one of the following? [`the`.`id`]; {code} Instead of {{{}[`the`.`id`]{}}}, you would expect {{{}[`the.id`]{}}}. Here an example where the nested column exists: {code:scala} spark.range(1).select(struct("id").as("the")) .select("the.id").show() +---+ | id| +---+ | 0| +---+ {code} was: The following code references a column {{`the`.`id`}}, that does not exist. The proposed / existing column names are not correctly wrapped in backticks: {code} Seq((1)).toDF("the.id").select("the.id").show() org.apache.spark.sql.AnalysisException: [UNRESOLVED_COLUMN] A column or function parameter with name `the`.`id` cannot be resolved. Did you mean one of the following? [`the`.`id`]; {code} Instead of {{[`the`.`id`]}}, you would expect {{[`the.id`]}}. > Wrong column backticks in UNRESOLVED_COLUMN error > ------------------------------------------------- > > Key: SPARK-39783 > URL: https://issues.apache.org/jira/browse/SPARK-39783 > Project: Spark > Issue Type: Bug > Components: SQL > Affects Versions: 3.4.0 > Reporter: Enrico Minack > Priority: Major > > The following code references a nested value {{{}`the`.`id`{}}}, that does > not exist. The proposed / existing column names are not correctly wrapped in > backticks: > {code:scala} > Seq((0)).toDF("the.id") > .select("the.id").show() > org.apache.spark.sql.AnalysisException: [UNRESOLVED_COLUMN] A column or > function parameter with name `the`.`id` cannot be resolved. Did you mean one > of the following? [`the`.`id`]; > {code} > Instead of {{{}[`the`.`id`]{}}}, you would expect {{{}[`the.id`]{}}}. > Here an example where the nested column exists: > {code:scala} > spark.range(1).select(struct("id").as("the")) > .select("the.id").show() > +---+ > | id| > +---+ > | 0| > +---+ > {code} -- This message was sent by Atlassian Jira (v8.20.10#820010) --------------------------------------------------------------------- To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org For additional commands, e-mail: issues-h...@spark.apache.org