[jira] [Assigned] (HUDI-246) Apache Pulsar data source for Hudi

2019-09-23 Thread Vinay (Jira)
[ https://issues.apache.org/jira/browse/HUDI-246?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vinay reassigned HUDI-246: -- Assignee: Vinay > Apache Pulsar data source for Hudi > -- > >

[jira] [Comment Edited] (HUDI-1910) Supporting Kafka based checkpointing for HoodieDeltaStreamer

2021-06-14 Thread Vinay (Jira)
[ https://issues.apache.org/jira/browse/HUDI-1910?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17362688#comment-17362688 ] Vinay edited comment on HUDI-1910 at 6/14/21, 9:09 AM: --- [~nishith29] Make sense, so

[jira] [Resolved] (HUDI-2004) Move KafkaOffsetGen.CheckpointUtils test cases to independent class and improve coverage

2021-06-14 Thread Vinay (Jira)
[ https://issues.apache.org/jira/browse/HUDI-2004?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vinay resolved HUDI-2004. - Resolution: Done Done - 769dd2d7c98558146eb4accb75b6d8e339ae6e0f > Move KafkaOffsetGen.CheckpointUtils test

[jira] [Commented] (HUDI-2003) Auto Compute Compression

2021-06-14 Thread Vinay (Jira)
[ https://issues.apache.org/jira/browse/HUDI-2003?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17362925#comment-17362925 ] Vinay commented on HUDI-2003: - [~nishith29] Please do update the description if I have missed anything here >

[jira] [Commented] (HUDI-1872) Move HoodieFlinkStreamer into hudi-utilities module

2021-06-16 Thread Vinay (Jira)
[ https://issues.apache.org/jira/browse/HUDI-1872?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17364250#comment-17364250 ] Vinay commented on HUDI-1872: - Assigning to me as per the discussion on mailing list, also the PR is in closed

[jira] [Updated] (HUDI-1872) Move HoodieFlinkStreamer into hudi-utilities module

2021-06-16 Thread Vinay (Jira)
[ https://issues.apache.org/jira/browse/HUDI-1872?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vinay updated HUDI-1872: Status: In Progress (was: Open) > Move HoodieFlinkStreamer into hudi-utilities module >

[jira] [Assigned] (HUDI-1872) Move HoodieFlinkStreamer into hudi-utilities module

2021-06-16 Thread Vinay (Jira)
[ https://issues.apache.org/jira/browse/HUDI-1872?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vinay reassigned HUDI-1872: --- Assignee: Vinay (was: 谢波) > Move HoodieFlinkStreamer into hudi-utilities module >

[jira] [Resolved] (HUDI-1892) NullPointerException when using OverwriteNonDefaultsWithLatestAvroPayload at hudi 0.9.0

2021-06-09 Thread Vinay (Jira)
[ https://issues.apache.org/jira/browse/HUDI-1892?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vinay resolved HUDI-1892. - Resolution: Fixed > NullPointerException when using OverwriteNonDefaultsWithLatestAvroPayload at > hudi 0.9.0 >

[jira] [Commented] (HUDI-1892) NullPointerException when using OverwriteNonDefaultsWithLatestAvroPayload at hudi 0.9.0

2021-06-09 Thread Vinay (Jira)
[ https://issues.apache.org/jira/browse/HUDI-1892?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17360060#comment-17360060 ] Vinay commented on HUDI-1892: - Fixed - 11360f707e969747e1a30791acb23857cc376589 > NullPointerException when

[jira] [Commented] (HUDI-1975) Upgrade java-prometheus-client from 3.1.2 to 4.x

2021-06-12 Thread Vinay (Jira)
[ https://issues.apache.org/jira/browse/HUDI-1975?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17362375#comment-17362375 ] Vinay commented on HUDI-1975: - [~nishith29] Currently in pom.xml the version is specified as    {code:java}

[jira] [Updated] (HUDI-2004) Move KafkaOffsetGen.CheckpointUtils test cases to independent class and improve coverage

2021-06-12 Thread Vinay (Jira)
[ https://issues.apache.org/jira/browse/HUDI-2004?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vinay updated HUDI-2004: Status: In Progress (was: Open) > Move KafkaOffsetGen.CheckpointUtils test cases to independent class and >

[jira] [Commented] (HUDI-1976) Upgrade hive, jackson, log4j, hadoop to remove vulnerability

2021-06-12 Thread Vinay (Jira)
[ https://issues.apache.org/jira/browse/HUDI-1976?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17362372#comment-17362372 ] Vinay commented on HUDI-1976: - WIP PR -https://github.com/apache/hudi/pull/3071 > Upgrade hive, jackson,

[jira] [Closed] (HUDI-1148) Revisit log messages seen when wiriting or reading through Hudi

2021-06-12 Thread Vinay (Jira)
[ https://issues.apache.org/jira/browse/HUDI-1148?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vinay closed HUDI-1148. --- > Revisit log messages seen when wiriting or reading through Hudi >

[jira] [Created] (HUDI-2003) Auto Compute Compression

2021-06-12 Thread Vinay (Jira)
Vinay created HUDI-2003: --- Summary: Auto Compute Compression Key: HUDI-2003 URL: https://issues.apache.org/jira/browse/HUDI-2003 Project: Apache Hudi Issue Type: Bug Components: Writer Core

[jira] [Commented] (HUDI-1148) Revisit log messages seen when wiriting or reading through Hudi

2021-06-12 Thread Vinay (Jira)
[ https://issues.apache.org/jira/browse/HUDI-1148?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17362376#comment-17362376 ] Vinay commented on HUDI-1148: - Fixed - f3d7b49bfea0630dcf488c087755485d8d088270 > Revisit log messages seen

[jira] [Resolved] (HUDI-1942) HIVE_AUTO_CREATE_DATABASE_OPT_KEY This should default to true when Hudi synchronizes Hive

2021-06-10 Thread Vinay (Jira)
[ https://issues.apache.org/jira/browse/HUDI-1942?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vinay resolved HUDI-1942. - Fix Version/s: (was: 0.8.0) Resolution: Fixed Fixed - 

[jira] [Commented] (HUDI-1997) Fix hoodie.datasource.hive_sync.auto_create_database documentation

2021-06-12 Thread Vinay (Jira)
[ https://issues.apache.org/jira/browse/HUDI-1997?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17362465#comment-17362465 ] Vinay commented on HUDI-1997: - Created PR - https://github.com/apache/hudi/pull/3066 > Fix

[jira] [Updated] (HUDI-1997) Fix hoodie.datasource.hive_sync.auto_create_database documentation

2021-06-12 Thread Vinay (Jira)
[ https://issues.apache.org/jira/browse/HUDI-1997?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vinay updated HUDI-1997: Status: Patch Available (was: In Progress) > Fix hoodie.datasource.hive_sync.auto_create_database documentation >

[jira] [Commented] (HUDI-2004) Move KafkaOffsetGen.CheckpointUtils test cases to independent class and improve coverage

2021-06-13 Thread Vinay (Jira)
[ https://issues.apache.org/jira/browse/HUDI-2004?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17362549#comment-17362549 ] Vinay commented on HUDI-2004: - Created PR - https://github.com/apache/hudi/pull/3072 > Move

[jira] [Commented] (HUDI-1997) Fix hoodie.datasource.hive_sync.auto_create_database documentation

2021-06-13 Thread Vinay (Jira)
[ https://issues.apache.org/jira/browse/HUDI-1997?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17362550#comment-17362550 ] Vinay commented on HUDI-1997: - Fixed - 64a8f53b25dd21fb737f783a5cf5d316fc0ae56d > Fix

[jira] [Updated] (HUDI-1997) Fix hoodie.datasource.hive_sync.auto_create_database documentation

2021-06-13 Thread Vinay (Jira)
[ https://issues.apache.org/jira/browse/HUDI-1997?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vinay updated HUDI-1997: Status: Closed (was: Patch Available) > Fix hoodie.datasource.hive_sync.auto_create_database documentation >

[jira] [Resolved] (HUDI-1997) Fix hoodie.datasource.hive_sync.auto_create_database documentation

2021-06-13 Thread Vinay (Jira)
[ https://issues.apache.org/jira/browse/HUDI-1997?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vinay resolved HUDI-1997. - Resolution: Fixed > Fix hoodie.datasource.hive_sync.auto_create_database documentation >

[jira] [Reopened] (HUDI-1997) Fix hoodie.datasource.hive_sync.auto_create_database documentation

2021-06-13 Thread Vinay (Jira)
[ https://issues.apache.org/jira/browse/HUDI-1997?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vinay reopened HUDI-1997: - > Fix hoodie.datasource.hive_sync.auto_create_database documentation >

[jira] [Updated] (HUDI-2004) Move KafkaOffsetGen.CheckpointUtils test cases to independent class and improve coverage

2021-06-13 Thread Vinay (Jira)
[ https://issues.apache.org/jira/browse/HUDI-2004?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vinay updated HUDI-2004: Labels: pull-request-available (was: ) > Move KafkaOffsetGen.CheckpointUtils test cases to independent class and

[jira] [Updated] (HUDI-1910) Supporting Kafka based checkpointing for HoodieDeltaStreamer

2021-06-13 Thread Vinay (Jira)
[ https://issues.apache.org/jira/browse/HUDI-1910?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vinay updated HUDI-1910: Status: In Progress (was: Open) > Supporting Kafka based checkpointing for HoodieDeltaStreamer >

[jira] [Commented] (HUDI-1910) Supporting Kafka based checkpointing for HoodieDeltaStreamer

2021-06-13 Thread Vinay (Jira)
[ https://issues.apache.org/jira/browse/HUDI-1910?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17362564#comment-17362564 ] Vinay commented on HUDI-1910: - [~nishith29]  Instead of Updating the HoodieWriteCommitCallbackMessage and

[jira] [Commented] (HUDI-1975) Upgrade java-prometheus-client from 3.1.2 to 4.x

2021-06-13 Thread Vinay (Jira)
[ https://issues.apache.org/jira/browse/HUDI-1975?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17362691#comment-17362691 ] Vinay commented on HUDI-1975: - Updated the metrics.version in pom to 3.1.2 , the build fails with {code:java}

[jira] [Commented] (HUDI-1910) Supporting Kafka based checkpointing for HoodieDeltaStreamer

2021-06-13 Thread Vinay (Jira)
[ https://issues.apache.org/jira/browse/HUDI-1910?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17362688#comment-17362688 ] Vinay commented on HUDI-1910: - [~nishith29] Make sense, so you suggesting to include COMMIT_OFFSET_TO_KAFKA

[jira] [Created] (HUDI-2060) Create Tests for KafkaOffsetGen

2021-06-23 Thread Vinay (Jira)
Vinay created HUDI-2060: --- Summary: Create Tests for KafkaOffsetGen Key: HUDI-2060 URL: https://issues.apache.org/jira/browse/HUDI-2060 Project: Apache Hudi Issue Type: Test Components:

[jira] [Updated] (HUDI-2060) Create Tests for KafkaOffsetGen

2021-06-23 Thread Vinay (Jira)
[ https://issues.apache.org/jira/browse/HUDI-2060?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vinay updated HUDI-2060: Status: In Progress (was: Open) > Create Tests for KafkaOffsetGen > --- > >

[jira] [Updated] (HUDI-2020) Add Concurrency based configs to Write Configs

2021-06-22 Thread Vinay (Jira)
[ https://issues.apache.org/jira/browse/HUDI-2020?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vinay updated HUDI-2020: Status: In Progress (was: Open) > Add Concurrency based configs to Write Configs >

[jira] [Assigned] (HUDI-2020) Add Concurrency based configs to Write Configs

2021-06-22 Thread Vinay (Jira)
[ https://issues.apache.org/jira/browse/HUDI-2020?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vinay reassigned HUDI-2020: --- Assignee: (was: Vinay) > Add Concurrency based configs to Write Configs >

[jira] [Updated] (HUDI-2020) Add Concurrency based configs to Write Configs

2021-06-22 Thread Vinay (Jira)
[ https://issues.apache.org/jira/browse/HUDI-2020?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vinay updated HUDI-2020: Status: Open (was: New) > Add Concurrency based configs to Write Configs >

[jira] [Updated] (HUDI-2020) Add Concurrency based configs to Write Configs

2021-06-22 Thread Vinay (Jira)
[ https://issues.apache.org/jira/browse/HUDI-2020?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vinay updated HUDI-2020: Status: New (was: Open) > Add Concurrency based configs to Write Configs >

[jira] [Commented] (HUDI-2020) Add Concurrency based configs to Write Configs

2021-06-22 Thread Vinay (Jira)
[ https://issues.apache.org/jira/browse/HUDI-2020?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17367224#comment-17367224 ] Vinay commented on HUDI-2020: - Not an issue, configs are provided in LockConfiguration class > Add

[jira] [Closed] (HUDI-2020) Add Concurrency based configs to Write Configs

2021-06-22 Thread Vinay (Jira)
[ https://issues.apache.org/jira/browse/HUDI-2020?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vinay closed HUDI-2020. --- Resolution: Not A Problem > Add Concurrency based configs to Write Configs >

[jira] [Created] (HUDI-2020) Add Concurrency based configs to Write Configs

2021-06-15 Thread Vinay (Jira)
Vinay created HUDI-2020: --- Summary: Add Concurrency based configs to Write Configs Key: HUDI-2020 URL: https://issues.apache.org/jira/browse/HUDI-2020 Project: Apache Hudi Issue Type: Improvement

[jira] [Comment Edited] (HUDI-1975) Upgrade java-prometheus-client from 3.1.2 to 4.x

2021-06-14 Thread Vinay (Jira)
[ https://issues.apache.org/jira/browse/HUDI-1975?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17362691#comment-17362691 ] Vinay edited comment on HUDI-1975 at 6/14/21, 7:54 AM: --- [~nishith29] Updated the

[jira] [Created] (HUDI-2035) Create document for PrometheusReporter

2021-06-16 Thread Vinay (Jira)
Vinay created HUDI-2035: --- Summary: Create document for PrometheusReporter Key: HUDI-2035 URL: https://issues.apache.org/jira/browse/HUDI-2035 Project: Apache Hudi Issue Type: Task

[jira] [Assigned] (HUDI-1892) NullPointerException when using OverwriteNonDefaultsWithLatestAvroPayload at hudi 0.9.0

2021-06-08 Thread Vinay (Jira)
[ https://issues.apache.org/jira/browse/HUDI-1892?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vinay reassigned HUDI-1892: --- Assignee: Vinay > NullPointerException when using OverwriteNonDefaultsWithLatestAvroPayload at > hudi 0.9.0

[jira] [Updated] (HUDI-1892) NullPointerException when using OverwriteNonDefaultsWithLatestAvroPayload at hudi 0.9.0

2021-06-08 Thread Vinay (Jira)
[ https://issues.apache.org/jira/browse/HUDI-1892?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vinay updated HUDI-1892: Status: In Progress (was: Open) > NullPointerException when using OverwriteNonDefaultsWithLatestAvroPayload at >

[jira] [Commented] (HUDI-1892) NullPointerException when using OverwriteNonDefaultsWithLatestAvroPayload at hudi 0.9.0

2021-06-08 Thread Vinay (Jira)
[ https://issues.apache.org/jira/browse/HUDI-1892?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17359328#comment-17359328 ] Vinay commented on HUDI-1892: - Looking at the code this issue could be because the defaultValue is not empty

[jira] [Assigned] (HUDI-1997) Fix hoodie.datasource.hive_sync.auto_create_database documentation

2021-06-11 Thread Vinay (Jira)
[ https://issues.apache.org/jira/browse/HUDI-1997?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vinay reassigned HUDI-1997: --- Assignee: Vinay > Fix hoodie.datasource.hive_sync.auto_create_database documentation >

[jira] [Updated] (HUDI-1997) Fix hoodie.datasource.hive_sync.auto_create_database documentation

2021-06-11 Thread Vinay (Jira)
[ https://issues.apache.org/jira/browse/HUDI-1997?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vinay updated HUDI-1997: Status: In Progress (was: Open) > Fix hoodie.datasource.hive_sync.auto_create_database documentation >

[jira] [Assigned] (HUDI-1910) Supporting Kafka based checkpointing for HoodieDeltaStreamer

2021-05-18 Thread Vinay (Jira)
[ https://issues.apache.org/jira/browse/HUDI-1910?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vinay reassigned HUDI-1910: --- Assignee: Vinay (was: Nishith Agarwal) > Supporting Kafka based checkpointing for HoodieDeltaStreamer >

[jira] [Created] (HUDI-1935) Update Logger for FlatteningTransformer

2021-05-25 Thread Vinay (Jira)
Vinay created HUDI-1935: --- Summary: Update Logger for FlatteningTransformer Key: HUDI-1935 URL: https://issues.apache.org/jira/browse/HUDI-1935 Project: Apache Hudi Issue Type: Task

[jira] [Commented] (HUDI-1910) Supporting Kafka based checkpointing for HoodieDeltaStreamer

2021-05-26 Thread Vinay (Jira)
[ https://issues.apache.org/jira/browse/HUDI-1910?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17351542#comment-17351542 ] Vinay commented on HUDI-1910: - [~nishith29] I think first approach is good, like Hudi will continue to rely on

[jira] [Updated] (HUDI-1935) Update Logger for FlatteningTransformer

2021-05-25 Thread Vinay (Jira)
[ https://issues.apache.org/jira/browse/HUDI-1935?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vinay updated HUDI-1935: Status: In Progress (was: Open) > Update Logger for FlatteningTransformer >

[jira] [Updated] (HUDI-1426) Typo in class declaration

2021-05-26 Thread Vinay (Jira)
[ https://issues.apache.org/jira/browse/HUDI-1426?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vinay updated HUDI-1426: Fix Version/s: 0.9.0 > Typo in class declaration > - > > Key: HUDI-1426 >

[jira] [Updated] (HUDI-1426) Typo in class declaration

2021-05-26 Thread Vinay (Jira)
[ https://issues.apache.org/jira/browse/HUDI-1426?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vinay updated HUDI-1426: Status: Open (was: New) > Typo in class declaration > - > > Key: HUDI-1426

[jira] [Assigned] (HUDI-1426) Typo in class declaration

2021-05-26 Thread Vinay (Jira)
[ https://issues.apache.org/jira/browse/HUDI-1426?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vinay reassigned HUDI-1426: --- Assignee: Vinay > Typo in class declaration > - > > Key: HUDI-1426 >

[jira] [Updated] (HUDI-1426) Typo in class declaration

2021-05-26 Thread Vinay (Jira)
[ https://issues.apache.org/jira/browse/HUDI-1426?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vinay updated HUDI-1426: Status: In Progress (was: Open) > Typo in class declaration > - > > Key:

[jira] [Updated] (HUDI-1281) deltacommit is not part of ActionType used in HoodieArchivedMetaEntry

2021-05-31 Thread Vinay (Jira)
[ https://issues.apache.org/jira/browse/HUDI-1281?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vinay updated HUDI-1281: Status: Open (was: New) > deltacommit is not part of ActionType used in HoodieArchivedMetaEntry >

[jira] [Updated] (HUDI-1281) deltacommit is not part of ActionType used in HoodieArchivedMetaEntry

2021-05-31 Thread Vinay (Jira)
[ https://issues.apache.org/jira/browse/HUDI-1281?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vinay updated HUDI-1281: Status: In Progress (was: Open) > deltacommit is not part of ActionType used in HoodieArchivedMetaEntry >

[jira] [Comment Edited] (HUDI-1281) deltacommit is not part of ActionType used in HoodieArchivedMetaEntry

2021-05-31 Thread Vinay (Jira)
[ https://issues.apache.org/jira/browse/HUDI-1281?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17354433#comment-17354433 ] Vinay edited comment on HUDI-1281 at 5/31/21, 12:29 PM: [~shivnarayan] Since there

[jira] [Commented] (HUDI-1281) deltacommit is not part of ActionType used in HoodieArchivedMetaEntry

2021-05-31 Thread Vinay (Jira)
[ https://issues.apache.org/jira/browse/HUDI-1281?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17354433#comment-17354433 ] Vinay commented on HUDI-1281: - [~shivnarayan] Since there is no activity on this ticket, I can pick this up, I

[jira] [Assigned] (HUDI-1281) deltacommit is not part of ActionType used in HoodieArchivedMetaEntry

2021-05-31 Thread Vinay (Jira)
[ https://issues.apache.org/jira/browse/HUDI-1281?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vinay reassigned HUDI-1281: --- Assignee: Vinay > deltacommit is not part of ActionType used in HoodieArchivedMetaEntry >

[jira] [Assigned] (HUDI-1148) Revisit log messages seen when wiriting or reading through Hudi

2021-06-02 Thread Vinay (Jira)
[ https://issues.apache.org/jira/browse/HUDI-1148?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vinay reassigned HUDI-1148: --- Assignee: Vinay > Revisit log messages seen when wiriting or reading through Hudi >

[jira] [Updated] (HUDI-1148) Revisit log messages seen when wiriting or reading through Hudi

2021-06-02 Thread Vinay (Jira)
[ https://issues.apache.org/jira/browse/HUDI-1148?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vinay updated HUDI-1148: Status: In Progress (was: Open) > Revisit log messages seen when wiriting or reading through Hudi >

[jira] [Commented] (HUDI-1148) Revisit log messages seen when wiriting or reading through Hudi

2021-06-02 Thread Vinay (Jira)
[ https://issues.apache.org/jira/browse/HUDI-1148?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17356174#comment-17356174 ] Vinay commented on HUDI-1148: - [~vbalaji] I can take a look at this, looking at the code we printing the

[jira] [Commented] (HUDI-1847) Add ability to decouple configs for scheduling inline and running async

2021-06-05 Thread Vinay (Jira)
[ https://issues.apache.org/jira/browse/HUDI-1847?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17357787#comment-17357787 ] Vinay commented on HUDI-1847: - [~nishith29]  Thank you for mentioning all the steps clearly, I would like to

[jira] [Assigned] (HUDI-1847) Add ability to decouple configs for scheduling inline and running async

2021-06-05 Thread Vinay (Jira)
[ https://issues.apache.org/jira/browse/HUDI-1847?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vinay reassigned HUDI-1847: --- Assignee: Vinay > Add ability to decouple configs for scheduling inline and running async >

[jira] [Updated] (HUDI-1942) HIVE_AUTO_CREATE_DATABASE_OPT_KEY This should default to true when Hudi synchronizes Hive

2021-06-05 Thread Vinay (Jira)
[ https://issues.apache.org/jira/browse/HUDI-1942?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vinay updated HUDI-1942: Status: In Progress (was: Open) > HIVE_AUTO_CREATE_DATABASE_OPT_KEY This should default to true when Hudi >

[jira] [Commented] (HUDI-1942) HIVE_AUTO_CREATE_DATABASE_OPT_KEY This should default to true when Hudi synchronizes Hive

2021-06-05 Thread Vinay (Jira)
[ https://issues.apache.org/jira/browse/HUDI-1942?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17357776#comment-17357776 ] Vinay commented on HUDI-1942: - Tried to test code snippet locally   {code:java} scala> var parameters =

[jira] [Assigned] (HUDI-1942) HIVE_AUTO_CREATE_DATABASE_OPT_KEY This should default to true when Hudi synchronizes Hive

2021-06-05 Thread Vinay (Jira)
[ https://issues.apache.org/jira/browse/HUDI-1942?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vinay reassigned HUDI-1942: --- Assignee: Vinay > HIVE_AUTO_CREATE_DATABASE_OPT_KEY This should default to true when Hudi > synchronizes

[jira] [Closed] (HUDI-1281) deltacommit is not part of ActionType used in HoodieArchivedMetaEntry

2021-06-04 Thread Vinay (Jira)
[ https://issues.apache.org/jira/browse/HUDI-1281?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vinay closed HUDI-1281. --- > deltacommit is not part of ActionType used in HoodieArchivedMetaEntry >

[jira] [Resolved] (HUDI-1281) deltacommit is not part of ActionType used in HoodieArchivedMetaEntry

2021-06-04 Thread Vinay (Jira)
[ https://issues.apache.org/jira/browse/HUDI-1281?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vinay resolved HUDI-1281. - Resolution: Fixed > deltacommit is not part of ActionType used in HoodieArchivedMetaEntry >

[jira] [Commented] (HUDI-1281) deltacommit is not part of ActionType used in HoodieArchivedMetaEntry

2021-06-04 Thread Vinay (Jira)
[ https://issues.apache.org/jira/browse/HUDI-1281?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17357761#comment-17357761 ] Vinay commented on HUDI-1281: - cf90f17732e313cf71248a8baaf10307463d9b6e > deltacommit is not part of

[jira] [Commented] (HUDI-1942) HIVE_AUTO_CREATE_DATABASE_OPT_KEY This should default to true when Hudi synchronizes Hive

2021-06-05 Thread Vinay (Jira)
[ https://issues.apache.org/jira/browse/HUDI-1942?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17357786#comment-17357786 ] Vinay commented on HUDI-1942: - [~yao.z...@yuanxi.onaliyun.com] yes, I have already added that in the PR, can

[jira] [Updated] (HUDI-1909) Skip the commits with empty files for flink streaming reader

2021-06-07 Thread Vinay (Jira)
[ https://issues.apache.org/jira/browse/HUDI-1909?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vinay updated HUDI-1909: Status: In Progress (was: Open) > Skip the commits with empty files for flink streaming reader >

[jira] [Assigned] (HUDI-1909) Skip the commits with empty files for flink streaming reader

2021-06-07 Thread Vinay (Jira)
[ https://issues.apache.org/jira/browse/HUDI-1909?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vinay reassigned HUDI-1909: --- Assignee: Vinay (was: Danny Chen) > Skip the commits with empty files for flink streaming reader >

[jira] [Created] (HUDI-1944) Support Hudi to read from Kafka Consumer Group Offset

2021-05-28 Thread Vinay (Jira)
Vinay created HUDI-1944: --- Summary: Support Hudi to read from Kafka Consumer Group Offset Key: HUDI-1944 URL: https://issues.apache.org/jira/browse/HUDI-1944 Project: Apache Hudi Issue Type: Sub-task

[jira] [Created] (HUDI-1945) Support Hudi to read from Kafka Consumer Group Offset

2021-05-28 Thread Vinay (Jira)
Vinay created HUDI-1945: --- Summary: Support Hudi to read from Kafka Consumer Group Offset Key: HUDI-1945 URL: https://issues.apache.org/jira/browse/HUDI-1945 Project: Apache Hudi Issue Type: Sub-task

[jira] [Updated] (HUDI-1945) Support Hudi to read from Kafka Consumer Group Offset

2021-05-28 Thread Vinay (Jira)
[ https://issues.apache.org/jira/browse/HUDI-1945?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vinay updated HUDI-1945: Status: New (was: Open) > Support Hudi to read from Kafka Consumer Group Offset >

[jira] [Commented] (HUDI-1910) Supporting Kafka based checkpointing for HoodieDeltaStreamer

2021-05-28 Thread Vinay (Jira)
[ https://issues.apache.org/jira/browse/HUDI-1910?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17353335#comment-17353335 ] Vinay commented on HUDI-1910: - [~nishith29] can you pls delete one of the sub-tasks, got added twice. I added

[jira] [Assigned] (HUDI-2067) Sync all the options of FlinkOptions to FlinkStreamerConfig

2021-06-23 Thread Vinay (Jira)
[ https://issues.apache.org/jira/browse/HUDI-2067?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vinay reassigned HUDI-2067: --- Assignee: Vinay > Sync all the options of FlinkOptions to FlinkStreamerConfig >

[jira] [Updated] (HUDI-2083) Hudi CLI does not work with S3

2021-07-03 Thread Vinay (Jira)
[ https://issues.apache.org/jira/browse/HUDI-2083?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vinay updated HUDI-2083: Status: In Progress (was: Open) > Hudi CLI does not work with S3 > -- > >

[jira] [Updated] (HUDI-1910) Supporting Kafka based checkpointing for HoodieDeltaStreamer

2021-06-30 Thread Vinay (Jira)
[ https://issues.apache.org/jira/browse/HUDI-1910?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vinay updated HUDI-1910: Status: In Progress (was: Open) > Supporting Kafka based checkpointing for HoodieDeltaStreamer >

[jira] [Resolved] (HUDI-1910) Supporting Kafka based checkpointing for HoodieDeltaStreamer

2021-06-30 Thread Vinay (Jira)
[ https://issues.apache.org/jira/browse/HUDI-1910?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vinay resolved HUDI-1910. - Resolution: Implemented > Supporting Kafka based checkpointing for HoodieDeltaStreamer >

[jira] [Updated] (HUDI-2083) Hudi CLI does not work with S3

2021-06-28 Thread Vinay (Jira)
[ https://issues.apache.org/jira/browse/HUDI-2083?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vinay updated HUDI-2083: Description: Hudi CLI gives exception when trying to connect to s3 path {code:java} create --path

[jira] [Resolved] (HUDI-2060) Create Tests for KafkaOffsetGen

2021-06-25 Thread Vinay (Jira)
[ https://issues.apache.org/jira/browse/HUDI-2060?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vinay resolved HUDI-2060. - Resolution: Done Done - ed1a5daa9a15e9123aa7fdba5ce8262d1cae0704 > Create Tests for KafkaOffsetGen >

[jira] [Assigned] (HUDI-1975) Upgrade java-prometheus-client from 3.1.2 to 4.x

2021-06-25 Thread Vinay (Jira)
[ https://issues.apache.org/jira/browse/HUDI-1975?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vinay reassigned HUDI-1975: --- Assignee: Vinay > Upgrade java-prometheus-client from 3.1.2 to 4.x >

[jira] [Updated] (HUDI-1975) Upgrade java-prometheus-client from 3.1.2 to 4.x

2021-06-25 Thread Vinay (Jira)
[ https://issues.apache.org/jira/browse/HUDI-1975?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vinay updated HUDI-1975: Status: In Progress (was: Open) > Upgrade java-prometheus-client from 3.1.2 to 4.x >

[jira] [Commented] (HUDI-1975) Upgrade java-prometheus-client from 3.1.2 to 4.x

2021-06-25 Thread Vinay (Jira)
[ https://issues.apache.org/jira/browse/HUDI-1975?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17369811#comment-17369811 ] Vinay commented on HUDI-1975: - [~nishith29] I have tried 1st option, the build is passing locally. Asked asked

[jira] [Updated] (HUDI-1944) Support Hudi to read from Kafka Consumer Group Offset

2021-06-28 Thread Vinay (Jira)
[ https://issues.apache.org/jira/browse/HUDI-1944?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vinay updated HUDI-1944: Status: In Progress (was: Open) > Support Hudi to read from Kafka Consumer Group Offset >

[jira] [Commented] (HUDI-1910) Supporting Kafka based checkpointing for HoodieDeltaStreamer

2021-06-28 Thread Vinay (Jira)
[ https://issues.apache.org/jira/browse/HUDI-1910?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17370650#comment-17370650 ] Vinay commented on HUDI-1910: - Done - 039aeb6dcee0a8eb4372c079ec07b8fc2582e41f > Supporting Kafka based

[jira] [Created] (HUDI-2082) Provide option to choose Spark or Flink Delta Streamer

2021-06-27 Thread Vinay (Jira)
Vinay created HUDI-2082: --- Summary: Provide option to choose Spark or Flink Delta Streamer Key: HUDI-2082 URL: https://issues.apache.org/jira/browse/HUDI-2082 Project: Apache Hudi Issue Type: New

[jira] [Updated] (HUDI-1976) Upgrade hive, jackson, log4j, hadoop to remove vulnerability

2021-06-27 Thread Vinay (Jira)
[ https://issues.apache.org/jira/browse/HUDI-1976?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vinay updated HUDI-1976: Status: In Progress (was: Open) > Upgrade hive, jackson, log4j, hadoop to remove vulnerability >

[jira] [Assigned] (HUDI-1976) Upgrade hive, jackson, log4j, hadoop to remove vulnerability

2021-06-27 Thread Vinay (Jira)
[ https://issues.apache.org/jira/browse/HUDI-1976?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vinay reassigned HUDI-1976: --- Assignee: Vinay > Upgrade hive, jackson, log4j, hadoop to remove vulnerability >

[jira] [Updated] (HUDI-2083) Hudi CLI does not work with S3

2021-06-27 Thread Vinay (Jira)
[ https://issues.apache.org/jira/browse/HUDI-2083?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vinay updated HUDI-2083: Summary: Hudi CLI does not work with S3 (was: Hudi CLI does not with S3) > Hudi CLI does not work with S3 >

[jira] [Created] (HUDI-2083) Hudi CLI does not with S3

2021-06-27 Thread Vinay (Jira)
Vinay created HUDI-2083: --- Summary: Hudi CLI does not with S3 Key: HUDI-2083 URL: https://issues.apache.org/jira/browse/HUDI-2083 Project: Apache Hudi Issue Type: Task Components: CLI

[jira] [Created] (HUDI-2168) AccessControlException for anonymous user

2021-07-12 Thread Vinay (Jira)
Vinay created HUDI-2168: --- Summary: AccessControlException for anonymous user Key: HUDI-2168 URL: https://issues.apache.org/jira/browse/HUDI-2168 Project: Apache Hudi Issue Type: Task

[jira] [Updated] (HUDI-2168) AccessControlException for anonymous user

2021-07-12 Thread Vinay (Jira)
[ https://issues.apache.org/jira/browse/HUDI-2168?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vinay updated HUDI-2168: Status: In Progress (was: Open) > AccessControlException for anonymous user >

[jira] [Resolved] (HUDI-2168) AccessControlException for anonymous user

2021-07-13 Thread Vinay (Jira)
[ https://issues.apache.org/jira/browse/HUDI-2168?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vinay resolved HUDI-2168. - Resolution: Fixed > AccessControlException for anonymous user > - > >

[jira] [Updated] (HUDI-2257) Add a note to set keygenerator class while deleting data

2021-07-30 Thread Vinay (Jira)
[ https://issues.apache.org/jira/browse/HUDI-2257?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vinay updated HUDI-2257: Status: In Progress (was: Open) > Add a note to set keygenerator class while deleting data >

[jira] [Updated] (HUDI-2257) Add a note to set keygenerator class while deleting data

2021-07-30 Thread Vinay (Jira)
[ https://issues.apache.org/jira/browse/HUDI-2257?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vinay updated HUDI-2257: Description: Copying examples from this blog [https://hudi.apache.org/blog/delete-support-in-hudi/] , does not work

[jira] [Updated] (HUDI-2257) Add a note to set keygenerator class while deleting data

2021-07-30 Thread Vinay (Jira)
[ https://issues.apache.org/jira/browse/HUDI-2257?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vinay updated HUDI-2257: Description: Copying examples from this blog [https://hudi.apache.org/blog/delete-support-in-hudi/] , does not

[jira] [Created] (HUDI-2257) Add a note to set keygenerator class while deleting data

2021-07-30 Thread Vinay (Jira)
Vinay created HUDI-2257: --- Summary: Add a note to set keygenerator class while deleting data Key: HUDI-2257 URL: https://issues.apache.org/jira/browse/HUDI-2257 Project: Apache Hudi Issue Type:

[jira] [Resolved] (HUDI-2257) Add a note to set keygenerator class while deleting data

2021-10-19 Thread Vinay (Jira)
[ https://issues.apache.org/jira/browse/HUDI-2257?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vinay resolved HUDI-2257. - Resolution: Done > Add a note to set keygenerator class while deleting data >

[jira] [Created] (HUDI-2498) Support Hive sync to work with s3

2021-09-28 Thread Vinay (Jira)
Vinay created HUDI-2498: --- Summary: Support Hive sync to work with s3 Key: HUDI-2498 URL: https://issues.apache.org/jira/browse/HUDI-2498 Project: Apache Hudi Issue Type: New Feature

  1   2   >