[jira] [Updated] (HUDI-6390) COW table reads partition spec from file instead of file path

2023-06-16 Thread Vova Kolmakov (Jira)
[ https://issues.apache.org/jira/browse/HUDI-6390?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vova Kolmakov updated HUDI-6390: Summary: COW table reads partition spec from file instead of file path (was: Flink COW table reads

[jira] [Updated] (HUDI-6390) COW table reads partition spec from file instead of file path

2023-06-16 Thread Vova Kolmakov (Jira)
[ https://issues.apache.org/jira/browse/HUDI-6390?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vova Kolmakov updated HUDI-6390: Description: COW table reads partition spec from file instead of file path (when the table is not

[jira] [Created] (HUDI-6390) Flink COW table reads partition spec from file instead of file path

2023-06-15 Thread Vova Kolmakov (Jira)
Vova Kolmakov created HUDI-6390: --- Summary: Flink COW table reads partition spec from file instead of file path Key: HUDI-6390 URL: https://issues.apache.org/jira/browse/HUDI-6390 Project: Apache Hudi

[jira] [Assigned] (HUDI-6390) COW table reads partition spec from file instead of file path

2023-06-27 Thread Vova Kolmakov (Jira)
[ https://issues.apache.org/jira/browse/HUDI-6390?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vova Kolmakov reassigned HUDI-6390: --- Assignee: Vova Kolmakov > COW table reads partition spec from file instead of file path >

[jira] [Assigned] (HUDI-6774) Prefix HiveConf properties to Hoodie catalog properties map with '.hadoop'

2024-02-16 Thread Vova Kolmakov (Jira)
[ https://issues.apache.org/jira/browse/HUDI-6774?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vova Kolmakov reassigned HUDI-6774: --- Assignee: Vova Kolmakov > Prefix HiveConf properties to Hoodie catalog properties map with

[jira] [Resolved] (HUDI-3699) flink ConfigOption default desc wrong

2024-02-19 Thread Vova Kolmakov (Jira)
[ https://issues.apache.org/jira/browse/HUDI-3699?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vova Kolmakov resolved HUDI-3699. - > flink ConfigOption default desc wrong > - > >

[jira] [Updated] (HUDI-4444) Refactor DataSourceInternalWriterHelper

2024-02-20 Thread Vova Kolmakov (Jira)
[ https://issues.apache.org/jira/browse/HUDI-?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vova Kolmakov updated HUDI-: Status: In Progress (was: Open) > Refactor DataSourceInternalWriterHelper >

[jira] [Assigned] (HUDI-4444) Refactor DataSourceInternalWriterHelper

2024-02-20 Thread Vova Kolmakov (Jira)
[ https://issues.apache.org/jira/browse/HUDI-?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vova Kolmakov reassigned HUDI-: --- Assignee: Vova Kolmakov > Refactor DataSourceInternalWriterHelper >

[jira] [Assigned] (HUDI-6860) Move createNewInstantTime out of HoodieActiveTimeline

2024-02-20 Thread Vova Kolmakov (Jira)
[ https://issues.apache.org/jira/browse/HUDI-6860?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vova Kolmakov reassigned HUDI-6860: --- Assignee: Vova Kolmakov > Move createNewInstantTime out of HoodieActiveTimeline >

[jira] [Updated] (HUDI-6860) Move createNewInstantTime out of HoodieActiveTimeline

2024-02-20 Thread Vova Kolmakov (Jira)
[ https://issues.apache.org/jira/browse/HUDI-6860?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vova Kolmakov updated HUDI-6860: Status: In Progress (was: Open) > Move createNewInstantTime out of HoodieActiveTimeline >

[jira] [Updated] (HUDI-7432) Fix excessive object creation in KeyGenUtils

2024-02-20 Thread Vova Kolmakov (Jira)
[ https://issues.apache.org/jira/browse/HUDI-7432?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vova Kolmakov updated HUDI-7432: Status: In Progress (was: Open) > Fix excessive object creation in KeyGenUtils >

[jira] [Assigned] (HUDI-6089) Handle default insert behaviour to ingest duplicates

2024-02-21 Thread Vova Kolmakov (Jira)
[ https://issues.apache.org/jira/browse/HUDI-6089?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vova Kolmakov reassigned HUDI-6089: --- Assignee: Vova Kolmakov > Handle default insert behaviour to ingest duplicates >

[jira] [Commented] (HUDI-6111) Build hudi submodule cause checkstyle not found error

2024-02-21 Thread Vova Kolmakov (Jira)
[ https://issues.apache.org/jira/browse/HUDI-6111?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17819156#comment-17819156 ] Vova Kolmakov commented on HUDI-6111: - Hi. If you want to build a certain module such as hudi-cli, try

[jira] [Updated] (HUDI-6089) Handle default insert behaviour to ingest duplicates

2024-02-21 Thread Vova Kolmakov (Jira)
[ https://issues.apache.org/jira/browse/HUDI-6089?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vova Kolmakov updated HUDI-6089: Status: In Progress (was: Open) > Handle default insert behaviour to ingest duplicates >

[jira] [Updated] (HUDI-7432) Fix excessive object creation in KeyGenUtils

2024-02-21 Thread Vova Kolmakov (Jira)
[ https://issues.apache.org/jira/browse/HUDI-7432?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vova Kolmakov updated HUDI-7432: Description: Some Key generators are creating excessive objects during recordKey/partitionPath

[jira] [Created] (HUDI-7432) Fix excessive object creation in KeyGenUtils

2024-02-20 Thread Vova Kolmakov (Jira)
Vova Kolmakov created HUDI-7432: --- Summary: Fix excessive object creation in KeyGenUtils Key: HUDI-7432 URL: https://issues.apache.org/jira/browse/HUDI-7432 Project: Apache Hudi Issue Type:

[jira] [Updated] (HUDI-7432) Fix excessive object creation in KeyGenUtils

2024-02-20 Thread Vova Kolmakov (Jira)
[ https://issues.apache.org/jira/browse/HUDI-7432?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vova Kolmakov updated HUDI-7432: Description: Some Key generators are creating excessive copies of objects during

[jira] [Assigned] (HUDI-7356) Passing configs to file reader constructor for flexibility

2024-02-18 Thread Vova Kolmakov (Jira)
[ https://issues.apache.org/jira/browse/HUDI-7356?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vova Kolmakov reassigned HUDI-7356: --- Assignee: Vova Kolmakov > Passing configs to file reader constructor for flexibility >

[jira] [Updated] (HUDI-7356) Passing configs to file reader constructor for flexibility

2024-02-19 Thread Vova Kolmakov (Jira)
[ https://issues.apache.org/jira/browse/HUDI-7356?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vova Kolmakov updated HUDI-7356: Status: In Progress (was: Open) > Passing configs to file reader constructor for flexibility >

[jira] [Assigned] (HUDI-5292) Exclude the test resources from every module packaging

2024-02-19 Thread Vova Kolmakov (Jira)
[ https://issues.apache.org/jira/browse/HUDI-5292?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vova Kolmakov reassigned HUDI-5292: --- Assignee: Vova Kolmakov > Exclude the test resources from every module packaging >

[jira] [Updated] (HUDI-6774) Prefix HiveConf properties to Hoodie catalog properties map with '.hadoop'

2024-02-19 Thread Vova Kolmakov (Jira)
[ https://issues.apache.org/jira/browse/HUDI-6774?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vova Kolmakov updated HUDI-6774: Status: In Progress (was: Open) > Prefix HiveConf properties to Hoodie catalog properties map with

[jira] [Updated] (HUDI-5292) Exclude the test resources from every module packaging

2024-02-19 Thread Vova Kolmakov (Jira)
[ https://issues.apache.org/jira/browse/HUDI-5292?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vova Kolmakov updated HUDI-5292: Status: In Progress (was: Open) > Exclude the test resources from every module packaging >

[jira] [Updated] (HUDI-7396) Improve Flink doc related to table services

2024-02-27 Thread Vova Kolmakov (Jira)
[ https://issues.apache.org/jira/browse/HUDI-7396?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vova Kolmakov updated HUDI-7396: Status: In Progress (was: Open) > Improve Flink doc related to table services >

[jira] [Assigned] (HUDI-7396) Improve Flink doc related to table services

2024-02-27 Thread Vova Kolmakov (Jira)
[ https://issues.apache.org/jira/browse/HUDI-7396?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vova Kolmakov reassigned HUDI-7396: --- Assignee: Vova Kolmakov > Improve Flink doc related to table services >

[jira] [Assigned] (HUDI-7396) Improve Flink doc related to table services

2024-03-03 Thread Vova Kolmakov (Jira)
[ https://issues.apache.org/jira/browse/HUDI-7396?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vova Kolmakov reassigned HUDI-7396: --- Assignee: (was: Vova Kolmakov) > Improve Flink doc related to table services >

[jira] [Updated] (HUDI-7396) Improve Flink doc related to table services

2024-03-03 Thread Vova Kolmakov (Jira)
[ https://issues.apache.org/jira/browse/HUDI-7396?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vova Kolmakov updated HUDI-7396: Status: Open (was: In Progress) > Improve Flink doc related to table services >

[jira] [Assigned] (HUDI-7478) Fix max delta commits guard check w/ MDT

2024-03-05 Thread Vova Kolmakov (Jira)
[ https://issues.apache.org/jira/browse/HUDI-7478?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vova Kolmakov reassigned HUDI-7478: --- Assignee: Vova Kolmakov > Fix max delta commits guard check w/ MDT >

[jira] [Updated] (HUDI-7478) Fix max delta commits guard check w/ MDT

2024-03-05 Thread Vova Kolmakov (Jira)
[ https://issues.apache.org/jira/browse/HUDI-7478?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vova Kolmakov updated HUDI-7478: Status: In Progress (was: Open) > Fix max delta commits guard check w/ MDT >

[jira] [Updated] (HUDI-7475) Disable ITs in hudi-aws module

2024-03-05 Thread Vova Kolmakov (Jira)
[ https://issues.apache.org/jira/browse/HUDI-7475?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vova Kolmakov updated HUDI-7475: Status: In Progress (was: Open) > Disable ITs in hudi-aws module > --

[jira] [Assigned] (HUDI-7475) Disable ITs in hudi-aws module

2024-03-05 Thread Vova Kolmakov (Jira)
[ https://issues.apache.org/jira/browse/HUDI-7475?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vova Kolmakov reassigned HUDI-7475: --- Assignee: Vova Kolmakov > Disable ITs in hudi-aws module > -- >

[jira] [Assigned] (HUDI-7187) Fix integ test props to honor new streamer properties

2024-03-14 Thread Vova Kolmakov (Jira)
[ https://issues.apache.org/jira/browse/HUDI-7187?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vova Kolmakov reassigned HUDI-7187: --- Assignee: Vova Kolmakov > Fix integ test props to honor new streamer properties >

[jira] [Updated] (HUDI-7187) Fix integ test props to honor new streamer properties

2024-03-14 Thread Vova Kolmakov (Jira)
[ https://issues.apache.org/jira/browse/HUDI-7187?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vova Kolmakov updated HUDI-7187: Status: In Progress (was: Open) > Fix integ test props to honor new streamer properties >

[jira] [Closed] (HUDI-6346) Allow duplicates by default for insert operation type

2024-03-13 Thread Vova Kolmakov (Jira)
[ https://issues.apache.org/jira/browse/HUDI-6346?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vova Kolmakov closed HUDI-6346. --- Resolution: Fixed > Allow duplicates by default for insert operation type >

[jira] [Commented] (HUDI-6346) Allow duplicates by default for insert operation type

2024-03-13 Thread Vova Kolmakov (Jira)
[ https://issues.apache.org/jira/browse/HUDI-6346?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17826040#comment-17826040 ] Vova Kolmakov commented on HUDI-6346: - Fixed via master branch:

[jira] [Assigned] (HUDI-6346) Allow duplicates by default for insert operation type

2024-03-13 Thread Vova Kolmakov (Jira)
[ https://issues.apache.org/jira/browse/HUDI-6346?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vova Kolmakov reassigned HUDI-6346: --- Assignee: Vova Kolmakov > Allow duplicates by default for insert operation type >

[jira] [Updated] (HUDI-7516) Put jdbc-h2 creds into static variables for hudi-utilities tests

2024-03-19 Thread Vova Kolmakov (Jira)
[ https://issues.apache.org/jira/browse/HUDI-7516?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vova Kolmakov updated HUDI-7516: Status: In Progress (was: Open) > Put jdbc-h2 creds into static variables for hudi-utilities tests

[jira] [Created] (HUDI-7516) Put jdbc-h2 creds into static variables for hudi-utilities tests

2024-03-19 Thread Vova Kolmakov (Jira)
Vova Kolmakov created HUDI-7516: --- Summary: Put jdbc-h2 creds into static variables for hudi-utilities tests Key: HUDI-7516 URL: https://issues.apache.org/jira/browse/HUDI-7516 Project: Apache Hudi

[jira] [Updated] (HUDI-7530) Refactoring of handleUpdateInternal in CommitActionExecutors and HoodieTables

2024-03-22 Thread Vova Kolmakov (Jira)
[ https://issues.apache.org/jira/browse/HUDI-7530?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vova Kolmakov updated HUDI-7530: Status: In Progress (was: Open) > Refactoring of handleUpdateInternal in CommitActionExecutors and

[jira] [Created] (HUDI-7530) Refactoring of handleUpdateInternal in CommitActionExecutors and HoodieTables

2024-03-22 Thread Vova Kolmakov (Jira)
Vova Kolmakov created HUDI-7530: --- Summary: Refactoring of handleUpdateInternal in CommitActionExecutors and HoodieTables Key: HUDI-7530 URL: https://issues.apache.org/jira/browse/HUDI-7530 Project:

[jira] [Closed] (HUDI-6860) Move createNewInstantTime out of HoodieActiveTimeline

2024-03-15 Thread Vova Kolmakov (Jira)
[ https://issues.apache.org/jira/browse/HUDI-6860?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vova Kolmakov closed HUDI-6860. --- Resolution: Won't Fix > Move createNewInstantTime out of HoodieActiveTimeline >

[jira] [Resolved] (HUDI-7356) Passing configs to file reader constructor for flexibility

2024-03-15 Thread Vova Kolmakov (Jira)
[ https://issues.apache.org/jira/browse/HUDI-7356?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vova Kolmakov resolved HUDI-7356. - > Passing configs to file reader constructor for flexibility >

[jira] [Commented] (HUDI-7484) Fix partitioning style when partition is inferred from partitionBy

2024-03-15 Thread Vova Kolmakov (Jira)
[ https://issues.apache.org/jira/browse/HUDI-7484?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17827385#comment-17827385 ] Vova Kolmakov commented on HUDI-7484: - Hi! [~codope] Can you provide the full code sample? It looks

[jira] [Assigned] (HUDI-7421) Build HoodieDeltaWriteStat using CommitMetadataUtils#getHoodieDeltaWriteStatFromPreviousStat

2024-03-15 Thread Vova Kolmakov (Jira)
[ https://issues.apache.org/jira/browse/HUDI-7421?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vova Kolmakov reassigned HUDI-7421: --- Assignee: Vova Kolmakov > Build HoodieDeltaWriteStat using >

[jira] [Updated] (HUDI-7421) Build HoodieDeltaWriteStat using CommitMetadataUtils#getHoodieDeltaWriteStatFromPreviousStat

2024-03-15 Thread Vova Kolmakov (Jira)
[ https://issues.apache.org/jira/browse/HUDI-7421?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vova Kolmakov updated HUDI-7421: Status: In Progress (was: Open) > Build HoodieDeltaWriteStat using >

[jira] [Updated] (HUDI-7516) Put jdbc-h2 creds into static variables for hudi-utilities tests

2024-03-19 Thread Vova Kolmakov (Jira)
[ https://issues.apache.org/jira/browse/HUDI-7516?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vova Kolmakov updated HUDI-7516: Priority: Minor (was: Major) > Put jdbc-h2 creds into static variables for hudi-utilities tests >

[jira] [Resolved] (HUDI-7475) Disable ITs in hudi-aws module

2024-03-05 Thread Vova Kolmakov (Jira)
[ https://issues.apache.org/jira/browse/HUDI-7475?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vova Kolmakov resolved HUDI-7475. - > Disable ITs in hudi-aws module > -- > > Key: HUDI-7475

[jira] [Closed] (HUDI-7534) Refactoring of handleUpdate in CommitActionExecutors and HoodieTables

2024-03-24 Thread Vova Kolmakov (Jira)
[ https://issues.apache.org/jira/browse/HUDI-7534?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vova Kolmakov closed HUDI-7534. --- Resolution: Not A Problem > Refactoring of handleUpdate in CommitActionExecutors and HoodieTables >

[jira] [Updated] (HUDI-4444) Refactor DataSourceInternalWriterHelper

2024-03-24 Thread Vova Kolmakov (Jira)
[ https://issues.apache.org/jira/browse/HUDI-?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vova Kolmakov updated HUDI-: Status: Open (was: In Progress) > Refactor DataSourceInternalWriterHelper >

[jira] [Commented] (HUDI-7475) Disable ITs in hudi-aws module

2024-03-23 Thread Vova Kolmakov (Jira)
[ https://issues.apache.org/jira/browse/HUDI-7475?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17830091#comment-17830091 ] Vova Kolmakov commented on HUDI-7475: - Fixed via master branch:

[jira] [Updated] (HUDI-7534) Refactoring of handleUpdate in CommitActionExecutors and HoodieTables

2024-03-23 Thread Vova Kolmakov (Jira)
[ https://issues.apache.org/jira/browse/HUDI-7534?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vova Kolmakov updated HUDI-7534: Status: In Progress (was: Open) > Refactoring of handleUpdate in CommitActionExecutors and

[jira] [Closed] (HUDI-7356) Passing configs to file reader constructor for flexibility

2024-03-23 Thread Vova Kolmakov (Jira)
[ https://issues.apache.org/jira/browse/HUDI-7356?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vova Kolmakov closed HUDI-7356. --- Resolution: Fixed Fixed via master branch: d7b9d744d6f8e9e9c5d8ec244afc3fe79922833c > Passing

[jira] [Created] (HUDI-7534) Refactoring of handleUpdate in CommitActionExecutors and HoodieTables

2024-03-23 Thread Vova Kolmakov (Jira)
Vova Kolmakov created HUDI-7534: --- Summary: Refactoring of handleUpdate in CommitActionExecutors and HoodieTables Key: HUDI-7534 URL: https://issues.apache.org/jira/browse/HUDI-7534 Project: Apache Hudi

[jira] [Updated] (HUDI-6884) hudi-cli should generate correct HoodieTimeGeneratorConfig

2024-03-30 Thread Vova Kolmakov (Jira)
[ https://issues.apache.org/jira/browse/HUDI-6884?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vova Kolmakov updated HUDI-6884: Status: In Progress (was: Open) > hudi-cli should generate correct HoodieTimeGeneratorConfig >

[jira] [Assigned] (HUDI-6884) hudi-cli should generate correct HoodieTimeGeneratorConfig

2024-03-30 Thread Vova Kolmakov (Jira)
[ https://issues.apache.org/jira/browse/HUDI-6884?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vova Kolmakov reassigned HUDI-6884: --- Assignee: Vova Kolmakov > hudi-cli should generate correct HoodieTimeGeneratorConfig >

[jira] [Closed] (HUDI-7187) Fix integ test props to honor new streamer properties

2024-03-30 Thread Vova Kolmakov (Jira)
[ https://issues.apache.org/jira/browse/HUDI-7187?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vova Kolmakov closed HUDI-7187. --- Resolution: Fixed Fixed via master branch: 26c00a3adefff9217187ca0ab9a5b2a7c9e42199 > Fix integ test

[jira] [Assigned] (HUDI-7526) Fix constructors for all bulk insert sort partitioners to ensure we could use it as user defined partitioners

2024-03-31 Thread Vova Kolmakov (Jira)
[ https://issues.apache.org/jira/browse/HUDI-7526?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vova Kolmakov reassigned HUDI-7526: --- Assignee: Vova Kolmakov > Fix constructors for all bulk insert sort partitioners to ensure

[jira] [Updated] (HUDI-7526) Fix constructors for all bulk insert sort partitioners to ensure we could use it as user defined partitioners

2024-03-31 Thread Vova Kolmakov (Jira)
[ https://issues.apache.org/jira/browse/HUDI-7526?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vova Kolmakov updated HUDI-7526: Status: In Progress (was: Open) > Fix constructors for all bulk insert sort partitioners to ensure

[jira] [Updated] (HUDI-7187) Fix integ test props to honor new streamer properties

2024-03-30 Thread Vova Kolmakov (Jira)
[ https://issues.apache.org/jira/browse/HUDI-7187?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vova Kolmakov updated HUDI-7187: Status: Open (was: In Progress) > Fix integ test props to honor new streamer properties >

[jira] [Updated] (HUDI-6854) Change default payload type to HOODIE_AVRO_DEFAULT

2024-04-02 Thread Vova Kolmakov (Jira)
[ https://issues.apache.org/jira/browse/HUDI-6854?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vova Kolmakov updated HUDI-6854: Summary: Change default payload type to HOODIE_AVRO_DEFAULT (was: Change default keygen type to

[jira] [Assigned] (HUDI-6762) Remove usages of MetadataRecordsGenerationParams

2024-04-03 Thread Vova Kolmakov (Jira)
[ https://issues.apache.org/jira/browse/HUDI-6762?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vova Kolmakov reassigned HUDI-6762: --- Assignee: Vova Kolmakov > Remove usages of MetadataRecordsGenerationParams >

[jira] [Updated] (HUDI-6762) Remove usages of MetadataRecordsGenerationParams

2024-04-03 Thread Vova Kolmakov (Jira)
[ https://issues.apache.org/jira/browse/HUDI-6762?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vova Kolmakov updated HUDI-6762: Status: In Progress (was: Open) > Remove usages of MetadataRecordsGenerationParams >

[jira] [Updated] (HUDI-6441) Passing custom Headers with Hudi Callback URL

2024-04-07 Thread Vova Kolmakov (Jira)
[ https://issues.apache.org/jira/browse/HUDI-6441?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vova Kolmakov updated HUDI-6441: Status: In Progress (was: Open) > Passing custom Headers with Hudi Callback URL >

[jira] [Assigned] (HUDI-6441) Passing custom Headers with Hudi Callback URL

2024-04-07 Thread Vova Kolmakov (Jira)
[ https://issues.apache.org/jira/browse/HUDI-6441?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vova Kolmakov reassigned HUDI-6441: --- Assignee: Vova Kolmakov > Passing custom Headers with Hudi Callback URL >

[jira] [Assigned] (HUDI-6854) Change default keygen type to HOODIE_AVRO_DEFAULT

2024-04-01 Thread Vova Kolmakov (Jira)
[ https://issues.apache.org/jira/browse/HUDI-6854?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vova Kolmakov reassigned HUDI-6854: --- Assignee: Vova Kolmakov > Change default keygen type to HOODIE_AVRO_DEFAULT >

[jira] [Updated] (HUDI-6854) Change default keygen type to HOODIE_AVRO_DEFAULT

2024-04-01 Thread Vova Kolmakov (Jira)
[ https://issues.apache.org/jira/browse/HUDI-6854?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vova Kolmakov updated HUDI-6854: Status: In Progress (was: Open) > Change default keygen type to HOODIE_AVRO_DEFAULT >

[jira] [Closed] (HUDI-7475) Disable ITs in hudi-aws module

2024-03-23 Thread Vova Kolmakov (Jira)
[ https://issues.apache.org/jira/browse/HUDI-7475?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vova Kolmakov closed HUDI-7475. --- Resolution: Fixed > Disable ITs in hudi-aws module > -- > >

[jira] [Updated] (HUDI-7534) Refactoring of handleUpdate in CommitActionExecutors and HoodieTables

2024-03-23 Thread Vova Kolmakov (Jira)
[ https://issues.apache.org/jira/browse/HUDI-7534?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vova Kolmakov updated HUDI-7534: Description: After refactoring HUDI-7530 there still remains many places to be cleaned in

[jira] [Assigned] (HUDI-4444) Refactor DataSourceInternalWriterHelper

2024-04-01 Thread Vova Kolmakov (Jira)
[ https://issues.apache.org/jira/browse/HUDI-?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vova Kolmakov reassigned HUDI-: --- Assignee: (was: Vova Kolmakov) > Refactor DataSourceInternalWriterHelper >

[jira] [Closed] (HUDI-6819) Fix logic to throw exception in HoodieBackedTableMetadataWriter

2024-03-29 Thread Vova Kolmakov (Jira)
[ https://issues.apache.org/jira/browse/HUDI-6819?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vova Kolmakov closed HUDI-6819. --- Resolution: Invalid no such code in current master branch > Fix logic to throw exception in

[jira] [Assigned] (HUDI-6538) Refactor methods in TimelineDiffHelper class

2024-03-29 Thread Vova Kolmakov (Jira)
[ https://issues.apache.org/jira/browse/HUDI-6538?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vova Kolmakov reassigned HUDI-6538: --- Assignee: Vova Kolmakov > Refactor methods in TimelineDiffHelper class >

[jira] [Updated] (HUDI-6538) Refactor methods in TimelineDiffHelper class

2024-03-29 Thread Vova Kolmakov (Jira)
[ https://issues.apache.org/jira/browse/HUDI-6538?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vova Kolmakov updated HUDI-6538: Status: In Progress (was: Open) > Refactor methods in TimelineDiffHelper class >

[jira] [Created] (HUDI-7595) Investigate and fix flaky tests in ITTestHoodieDataSource

2024-04-09 Thread Vova Kolmakov (Jira)
Vova Kolmakov created HUDI-7595: --- Summary: Investigate and fix flaky tests in ITTestHoodieDataSource Key: HUDI-7595 URL: https://issues.apache.org/jira/browse/HUDI-7595 Project: Apache Hudi

[jira] [Updated] (HUDI-7595) Investigate and fix flaky tests in ITTestHoodieDataSource

2024-04-09 Thread Vova Kolmakov (Jira)
[ https://issues.apache.org/jira/browse/HUDI-7595?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vova Kolmakov updated HUDI-7595: Description:   {code:java} Failures:  2024-04-10T00:47:48.7776428Z [ERROR]  

[jira] [Updated] (HUDI-7595) Investigate and fix flaky tests in ITTestHoodieDataSource

2024-04-11 Thread Vova Kolmakov (Jira)
[ https://issues.apache.org/jira/browse/HUDI-7595?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vova Kolmakov updated HUDI-7595: Component/s: tests-ci > Investigate and fix flaky tests in ITTestHoodieDataSource >

[jira] [Updated] (HUDI-7595) Investigate and fix flaky tests in ITTestHoodieDataSource

2024-04-11 Thread Vova Kolmakov (Jira)
[ https://issues.apache.org/jira/browse/HUDI-7595?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vova Kolmakov updated HUDI-7595: Labels: test-stability (was: ) > Investigate and fix flaky tests in ITTestHoodieDataSource >

[jira] [Updated] (HUDI-7584) Always read log block lazily and remove readBlockLazily argument

2024-04-13 Thread Vova Kolmakov (Jira)
[ https://issues.apache.org/jira/browse/HUDI-7584?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vova Kolmakov updated HUDI-7584: Status: In Progress (was: Open) > Always read log block lazily and remove readBlockLazily argument

[jira] [Assigned] (HUDI-7584) Always read log block lazily and remove readBlockLazily argument

2024-04-13 Thread Vova Kolmakov (Jira)
[ https://issues.apache.org/jira/browse/HUDI-7584?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vova Kolmakov reassigned HUDI-7584: --- Assignee: Vova Kolmakov > Always read log block lazily and remove readBlockLazily argument >

[jira] [Assigned] (HUDI-4228) Clean up literal usage in Hudi CLI argument check

2024-04-17 Thread Vova Kolmakov (Jira)
[ https://issues.apache.org/jira/browse/HUDI-4228?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vova Kolmakov reassigned HUDI-4228: --- Assignee: Vova Kolmakov > Clean up literal usage in Hudi CLI argument check >

[jira] [Updated] (HUDI-4228) Clean up literal usage in Hudi CLI argument check

2024-04-17 Thread Vova Kolmakov (Jira)
[ https://issues.apache.org/jira/browse/HUDI-4228?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vova Kolmakov updated HUDI-4228: Status: In Progress (was: Open) > Clean up literal usage in Hudi CLI argument check >

[jira] [Updated] (HUDI-7595) Investigate and fix flaky tests in ITTestHoodieDataSource

2024-04-17 Thread Vova Kolmakov (Jira)
[ https://issues.apache.org/jira/browse/HUDI-7595?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vova Kolmakov updated HUDI-7595: Description:   {code:java} 2024-04-17T15:25:52.8085340Z [ERROR] Tests run: 132, Failures: 2,

[jira] [Created] (HUDI-7623) Refactoring of RemoteHoodieTableFileSystemView and RequestHandler

2024-04-16 Thread Vova Kolmakov (Jira)
Vova Kolmakov created HUDI-7623: --- Summary: Refactoring of RemoteHoodieTableFileSystemView and RequestHandler Key: HUDI-7623 URL: https://issues.apache.org/jira/browse/HUDI-7623 Project: Apache Hudi

[jira] [Updated] (HUDI-7623) Refactoring of RemoteHoodieTableFileSystemView and RequestHandler

2024-04-16 Thread Vova Kolmakov (Jira)
[ https://issues.apache.org/jira/browse/HUDI-7623?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vova Kolmakov updated HUDI-7623: Status: In Progress (was: Open) > Refactoring of RemoteHoodieTableFileSystemView and

[jira] [Updated] (HUDI-7631) Clean up usage of `CachingPath` outside hudi-common module

2024-04-20 Thread Vova Kolmakov (Jira)
[ https://issues.apache.org/jira/browse/HUDI-7631?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vova Kolmakov updated HUDI-7631: Status: In Progress (was: Open) > Clean up usage of `CachingPath` outside hudi-common module >

[jira] [Closed] (HUDI-7628) Rename FSUtils.getPartitionPath to constructAbsolutePath

2024-04-20 Thread Vova Kolmakov (Jira)
[ https://issues.apache.org/jira/browse/HUDI-7628?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vova Kolmakov closed HUDI-7628. --- Resolution: Fixed Fixed via master branch: 683c4998d6de28605f9e94c05972258a22f2e5b9 > Rename

[jira] [Updated] (HUDI-7628) Rename FSUtils.getPartitionPath to constructAbsolutePath

2024-04-19 Thread Vova Kolmakov (Jira)
[ https://issues.apache.org/jira/browse/HUDI-7628?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vova Kolmakov updated HUDI-7628: Status: In Progress (was: Open) > Rename FSUtils.getPartitionPath to constructAbsolutePath >

[jira] [Assigned] (HUDI-7630) Create a separate StorageUtils for hadoop-free util method

2024-04-19 Thread Vova Kolmakov (Jira)
[ https://issues.apache.org/jira/browse/HUDI-7630?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vova Kolmakov reassigned HUDI-7630: --- Assignee: Vova Kolmakov > Create a separate StorageUtils for hadoop-free util method >

[jira] [Assigned] (HUDI-7629) Safely rename HoodieFileStatus

2024-04-19 Thread Vova Kolmakov (Jira)
[ https://issues.apache.org/jira/browse/HUDI-7629?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vova Kolmakov reassigned HUDI-7629: --- Assignee: Vova Kolmakov > Safely rename HoodieFileStatus > -- >

[jira] [Assigned] (HUDI-7628) Rename FSUtils.getPartitionPath to constructAbsolutePath

2024-04-19 Thread Vova Kolmakov (Jira)
[ https://issues.apache.org/jira/browse/HUDI-7628?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vova Kolmakov reassigned HUDI-7628: --- Assignee: Vova Kolmakov > Rename FSUtils.getPartitionPath to constructAbsolutePath >

[jira] [Assigned] (HUDI-7631) Clean up usage of `CachingPath` outside hudi-common module

2024-04-19 Thread Vova Kolmakov (Jira)
[ https://issues.apache.org/jira/browse/HUDI-7631?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vova Kolmakov reassigned HUDI-7631: --- Assignee: Vova Kolmakov > Clean up usage of `CachingPath` outside hudi-common module >

[jira] [Updated] (HUDI-7645) Optimize BQ sync tool for MDT

2024-04-22 Thread Vova Kolmakov (Jira)
[ https://issues.apache.org/jira/browse/HUDI-7645?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vova Kolmakov updated HUDI-7645: Status: In Progress (was: Open) > Optimize BQ sync tool for MDT > - >

[jira] [Assigned] (HUDI-7639) Refactor HoodieFileIndex so that different indexes can be used via optimizer rules

2024-04-22 Thread Vova Kolmakov (Jira)
[ https://issues.apache.org/jira/browse/HUDI-7639?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vova Kolmakov reassigned HUDI-7639: --- Assignee: Vova Kolmakov > Refactor HoodieFileIndex so that different indexes can be used via

[jira] [Updated] (HUDI-7639) Refactor HoodieFileIndex so that different indexes can be used via optimizer rules

2024-04-23 Thread Vova Kolmakov (Jira)
[ https://issues.apache.org/jira/browse/HUDI-7639?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vova Kolmakov updated HUDI-7639: Status: In Progress (was: Open) > Refactor HoodieFileIndex so that different indexes can be used

[jira] [Assigned] (HUDI-7645) Optimize BQ sync tool for MDT

2024-04-21 Thread Vova Kolmakov (Jira)
[ https://issues.apache.org/jira/browse/HUDI-7645?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vova Kolmakov reassigned HUDI-7645: --- Assignee: Vova Kolmakov > Optimize BQ sync tool for MDT > - > >

[jira] [Closed] (HUDI-6762) Remove usages of MetadataRecordsGenerationParams

2024-04-15 Thread Vova Kolmakov (Jira)
[ https://issues.apache.org/jira/browse/HUDI-6762?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vova Kolmakov closed HUDI-6762. --- Reviewers: Sagar Sumit Resolution: Fixed Fixed via master branch:

[jira] [Created] (HUDI-7619) Remove code duplication in HoodieTableMetadataUtil

2024-04-15 Thread Vova Kolmakov (Jira)
Vova Kolmakov created HUDI-7619: --- Summary: Remove code duplication in HoodieTableMetadataUtil Key: HUDI-7619 URL: https://issues.apache.org/jira/browse/HUDI-7619 Project: Apache Hudi Issue

[jira] [Updated] (HUDI-7619) Remove code duplication in HoodieTableMetadataUtil

2024-04-15 Thread Vova Kolmakov (Jira)
[ https://issues.apache.org/jira/browse/HUDI-7619?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vova Kolmakov updated HUDI-7619: Status: In Progress (was: Open) > Remove code duplication in HoodieTableMetadataUtil >

[jira] [Created] (HUDI-7660) Fix excessive object creation in RowDataKeyGen

2024-04-24 Thread Vova Kolmakov (Jira)
Vova Kolmakov created HUDI-7660: --- Summary: Fix excessive object creation in RowDataKeyGen Key: HUDI-7660 URL: https://issues.apache.org/jira/browse/HUDI-7660 Project: Apache Hudi Issue Type:

[jira] [Updated] (HUDI-7660) Fix excessive object creation in RowDataKeyGen

2024-04-24 Thread Vova Kolmakov (Jira)
[ https://issues.apache.org/jira/browse/HUDI-7660?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vova Kolmakov updated HUDI-7660: Status: In Progress (was: Open) > Fix excessive object creation in RowDataKeyGen >

[jira] [Updated] (HUDI-7660) Fix excessive object creation in RowDataKeyGen

2024-04-24 Thread Vova Kolmakov (Jira)
[ https://issues.apache.org/jira/browse/HUDI-7660?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vova Kolmakov updated HUDI-7660: Description: RowDataKeyGen is creating excessive objects during recordKey/partitionPath

[jira] [Closed] (HUDI-7645) Optimize BQ sync tool for MDT

2024-04-25 Thread Vova Kolmakov (Jira)
[ https://issues.apache.org/jira/browse/HUDI-7645?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vova Kolmakov closed HUDI-7645. --- Resolution: Fixed Fixed via master branch: 835d47367e37b09d7c62cb6af1e71bbb5e90c4ff > Optimize BQ

  1   2   >