[
https://issues.apache.org/jira/browse/HUDI-5574?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
sivabalan narayanan updated HUDI-5574:
--------------------------------------
Description:
HUDI-2681 adds support for auto record key generation with spark dataframes.
This Jira aims to add support for the same with spark sql.
One of the changes required here as pointed out by [~kazdy] is that
SQL_INSERT_MODE would need to be handled here. In this case if SQL_INSERT_MODE
mode is set to strict, the insert should fail.
cc [~shivnarayan]
Essentially, based on this patch
([https://github.com/apache/hudi/pull/7681),|https://github.com/apache/hudi/pull/7681,]
we want to ensure spark-sql writes also supports auto generation of record
keys.
was:
HUDI-2681 adds support for auto record key generation with spark dataframes.
This Jira aims to add support for the same with spark sql.
One of the changes required here as pointed out by [~kazdy] is that
SQL_INSERT_MODE would need to be handled here. In this case if SQL_INSERT_MODE
mode is set to strict, the insert should fail.
cc [~shivnarayan]
> Support auto record key generation with Spark SQL
> -------------------------------------------------
>
> Key: HUDI-5574
> URL: https://issues.apache.org/jira/browse/HUDI-5574
> Project: Apache Hudi
> Issue Type: Bug
> Components: writer-core
> Reporter: Lokesh Jain
> Priority: Blocker
> Fix For: 0.13.0
>
>
> HUDI-2681 adds support for auto record key generation with spark dataframes.
> This Jira aims to add support for the same with spark sql.
> One of the changes required here as pointed out by [~kazdy] is that
> SQL_INSERT_MODE would need to be handled here. In this case if
> SQL_INSERT_MODE mode is set to strict, the insert should fail.
> cc [~shivnarayan]
> Essentially, based on this patch
> ([https://github.com/apache/hudi/pull/7681),|https://github.com/apache/hudi/pull/7681,]
> we want to ensure spark-sql writes also supports auto generation of record
> keys.
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
