[
https://issues.apache.org/jira/browse/SPARK-36862?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Magdalena Pilawska updated SPARK-36862:
---------------------------------------
Description:
Hi,
I am getting the following error running spark-submit command:
ERROR CodeGenerator: failed to compile:
org.codehaus.commons.compiler.CompileException: File 'generated.java', Line
321, Column 103: ')' expected instead of '['
It fails running the spark sql command on delta lake:
spark.sql(sqlTransformation)
The template of sqlTransformation is as follows:
MERGE INTO target_table AS d
USING source_table AS s
on s.id = d.id
WHEN MATCHED AND d.hash_value <> s.hash_value
THEN UPDATE SET d.name =s.name, d.address = s.address
It is permanent error both for *spark 3.1.1* and *3.1.2* versions.
The same works fine with spark 3.0.0.
was:
Hi,
I am getting the following error running spark-submit command:
ERROR CodeGenerator: failed to compile:
org.codehaus.commons.compiler.CompileException: File 'generated.java', Line
321, Column 103: ')' expected instead of '['
It is permanent error both for spark 3.1.1 and 3.1.2 versions.
The same works fine with spark 3.0.0.
> ERROR CodeGenerator: failed to compile:
> org.codehaus.commons.compiler.CompileException: File 'generated.java'
> -------------------------------------------------------------------------------------------------------------
>
> Key: SPARK-36862
> URL: https://issues.apache.org/jira/browse/SPARK-36862
> Project: Spark
> Issue Type: Bug
> Components: Spark Submit, SQL
> Affects Versions: 3.1.1, 3.1.2
> Environment: Spark 3.1.1 and Spark 3.1.2
> hadoop 3.2.1
> Reporter: Magdalena Pilawska
> Priority: Major
>
> Hi,
> I am getting the following error running spark-submit command:
> ERROR CodeGenerator: failed to compile:
> org.codehaus.commons.compiler.CompileException: File 'generated.java', Line
> 321, Column 103: ')' expected instead of '['
>
> It fails running the spark sql command on delta lake:
> spark.sql(sqlTransformation)
> The template of sqlTransformation is as follows:
> MERGE INTO target_table AS d
> USING source_table AS s
> on s.id = d.id
> WHEN MATCHED AND d.hash_value <> s.hash_value
> THEN UPDATE SET d.name =s.name, d.address = s.address
>
> It is permanent error both for *spark 3.1.1* and *3.1.2* versions.
>
> The same works fine with spark 3.0.0.
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org
For additional commands, e-mail: issues-h...@spark.apache.org
