[
https://issues.apache.org/jira/browse/HUDI-1765?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17325002#comment-17325002
]
sivabalan narayanan commented on HUDI-1765:
-------------------------------------------
oh, good point. I will check w/ customer. my bad. didn't think about it.
> disabling auto commit does not work with spark ds
> -------------------------------------------------
>
> Key: HUDI-1765
> URL: https://issues.apache.org/jira/browse/HUDI-1765
> Project: Apache Hudi
> Issue Type: Bug
> Components: Spark Integration
> Reporter: sivabalan narayanan
> Priority: Major
> Labels: sev:critical
> Fix For: 0.9.0
>
>
> commitAndPerformPostOperations in HoodieSparkSqlWriter commits all operations
> w/o checking for autoCommitProp. So, this prop is not being honored at spark
> ds layer.
>
> Added below test to TestCOWDataSource and it fails.
> [https://gist.github.com/nsivabalan/479320351bec95ba3e0c0dfa5abb2b06]
>
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
