[GitHub] [hudi] hudi-bot commented on pull request #4282: [WIP][DO_NOT_MERGE] Enabling debug logs to investigate IT test failure

2021-12-13 Thread GitBox
hudi-bot commented on pull request #4282: URL: https://github.com/apache/hudi/pull/4282#issuecomment-993251730 ## CI report: * 6f7215ce8294d550104454bc33c75d6a62a93940 Azure:

[GitHub] [hudi] hudi-bot commented on pull request #4307: [HUDI-3015] Implement #reset and #sync for metadata filesystem view

2021-12-13 Thread GitBox
hudi-bot commented on pull request #4307: URL: https://github.com/apache/hudi/pull/4307#issuecomment-993251798 ## CI report: * e1d850ee39d30c10e1f3db98381df5d1e435ec81 Azure:

[GitHub] [hudi] hudi-bot removed a comment on pull request #4282: [WIP][DO_NOT_MERGE] Enabling debug logs to investigate IT test failure

2021-12-13 Thread GitBox
hudi-bot removed a comment on pull request #4282: URL: https://github.com/apache/hudi/pull/4282#issuecomment-993250262 ## CI report: * f64035708cbf23f9b4bb8492247c7b480496eb12 Azure:

[GitHub] [hudi] hudi-bot removed a comment on pull request #4307: [HUDI-3015] Implement #reset and #sync for metadata filesystem view

2021-12-13 Thread GitBox
hudi-bot removed a comment on pull request #4307: URL: https://github.com/apache/hudi/pull/4307#issuecomment-993250329 ## CI report: * e1d850ee39d30c10e1f3db98381df5d1e435ec81 Azure:

[GitHub] [hudi] hudi-bot commented on pull request #4282: [WIP][DO_NOT_MERGE] Enabling debug logs to investigate IT test failure

2021-12-13 Thread GitBox
hudi-bot commented on pull request #4282: URL: https://github.com/apache/hudi/pull/4282#issuecomment-993250262 ## CI report: * f64035708cbf23f9b4bb8492247c7b480496eb12 Azure:

[GitHub] [hudi] hudi-bot commented on pull request #4307: [HUDI-3015] Implement #reset and #sync for metadata filesystem view

2021-12-13 Thread GitBox
hudi-bot commented on pull request #4307: URL: https://github.com/apache/hudi/pull/4307#issuecomment-993250329 ## CI report: * e1d850ee39d30c10e1f3db98381df5d1e435ec81 Azure:

[GitHub] [hudi] hudi-bot removed a comment on pull request #4307: [HUDI-3015] Implement #reset and #sync for metadata filesystem view

2021-12-13 Thread GitBox
hudi-bot removed a comment on pull request #4307: URL: https://github.com/apache/hudi/pull/4307#issuecomment-993247237 ## CI report: * e1d850ee39d30c10e1f3db98381df5d1e435ec81 Azure:

[GitHub] [hudi] hudi-bot removed a comment on pull request #4282: [WIP][DO_NOT_MERGE] Enabling debug logs to investigate IT test failure

2021-12-13 Thread GitBox
hudi-bot removed a comment on pull request #4282: URL: https://github.com/apache/hudi/pull/4282#issuecomment-993248662 ## CI report: * f64035708cbf23f9b4bb8492247c7b480496eb12 Azure:

[GitHub] [hudi] hudi-bot removed a comment on pull request #4282: [WIP][DO_NOT_MERGE] Enabling debug logs to investigate IT test failure

2021-12-13 Thread GitBox
hudi-bot removed a comment on pull request #4282: URL: https://github.com/apache/hudi/pull/4282#issuecomment-993247170 ## CI report: * f64035708cbf23f9b4bb8492247c7b480496eb12 Azure:

[GitHub] [hudi] hudi-bot commented on pull request #4282: [WIP][DO_NOT_MERGE] Enabling debug logs to investigate IT test failure

2021-12-13 Thread GitBox
hudi-bot commented on pull request #4282: URL: https://github.com/apache/hudi/pull/4282#issuecomment-993248662 ## CI report: * f64035708cbf23f9b4bb8492247c7b480496eb12 Azure:

[GitHub] [hudi] hudi-bot commented on pull request #4307: [HUDI-3015] Implement #reset and #sync for metadata filesystem view

2021-12-13 Thread GitBox
hudi-bot commented on pull request #4307: URL: https://github.com/apache/hudi/pull/4307#issuecomment-993247237 ## CI report: * e1d850ee39d30c10e1f3db98381df5d1e435ec81 Azure:

[GitHub] [hudi] hudi-bot removed a comment on pull request #4307: [HUDI-3015] Implement #reset and #sync for metadata filesystem view

2021-12-13 Thread GitBox
hudi-bot removed a comment on pull request #4307: URL: https://github.com/apache/hudi/pull/4307#issuecomment-993245434 ## CI report: * e1d850ee39d30c10e1f3db98381df5d1e435ec81 UNKNOWN Bot commands @hudi-bot supports the following commands: - `@hudi-bot run

[GitHub] [hudi] hudi-bot removed a comment on pull request #4282: [WIP][DO_NOT_MERGE] Enabling debug logs to investigate IT test failure

2021-12-13 Thread GitBox
hudi-bot removed a comment on pull request #4282: URL: https://github.com/apache/hudi/pull/4282#issuecomment-993112303 ## CI report: * f64035708cbf23f9b4bb8492247c7b480496eb12 Azure:

[GitHub] [hudi] hudi-bot commented on pull request #4282: [WIP][DO_NOT_MERGE] Enabling debug logs to investigate IT test failure

2021-12-13 Thread GitBox
hudi-bot commented on pull request #4282: URL: https://github.com/apache/hudi/pull/4282#issuecomment-993247170 ## CI report: * f64035708cbf23f9b4bb8492247c7b480496eb12 Azure:

[GitHub] [hudi] hudi-bot commented on pull request #4307: [HUDI-3015] Implement #reset and #sync for metadata filesystem view

2021-12-13 Thread GitBox
hudi-bot commented on pull request #4307: URL: https://github.com/apache/hudi/pull/4307#issuecomment-993245434 ## CI report: * e1d850ee39d30c10e1f3db98381df5d1e435ec81 UNKNOWN Bot commands @hudi-bot supports the following commands: - `@hudi-bot run azure`

[GitHub] [hudi] hudi-bot commented on pull request #4301: [Minor] Catch and ignore all the exceptions in quietDeleteMarkerDir

2021-12-13 Thread GitBox
hudi-bot commented on pull request #4301: URL: https://github.com/apache/hudi/pull/4301#issuecomment-993243738 ## CI report: * 64ea4442ad179875fe2dbaa7c6a001b4000b4524 UNKNOWN * 4bd6b8cc1f93c3963b41bf50fcc99415533edc22 Azure:

[GitHub] [hudi] hudi-bot removed a comment on pull request #4301: [Minor] Catch and ignore all the exceptions in quietDeleteMarkerDir

2021-12-13 Thread GitBox
hudi-bot removed a comment on pull request #4301: URL: https://github.com/apache/hudi/pull/4301#issuecomment-993202841 ## CI report: * 64ea4442ad179875fe2dbaa7c6a001b4000b4524 UNKNOWN * 4bd6b8cc1f93c3963b41bf50fcc99415533edc22 Azure:

[jira] [Updated] (HUDI-3015) Implement #reset and #sync for metadata filesystem view

2021-12-13 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HUDI-3015?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated HUDI-3015: - Labels: pull-request-available (was: ) > Implement #reset and #sync for metadata filesystem view

[GitHub] [hudi] danny0405 opened a new pull request #4307: [HUDI-3015] Implement #reset and #sync for metadata filesystem view

2021-12-13 Thread GitBox
danny0405 opened a new pull request #4307: URL: https://github.com/apache/hudi/pull/4307 ## *Tips* - *Thank you very much for contributing to Apache Hudi.* - *Please review https://hudi.apache.org/contribute/how-to-contribute before opening a pull request.* ## What is the

[GitHub] [hudi] wjcwin closed issue #4249: [SUPPORT]FLINK CDC WRITE HUDI, restart job get exception:org.apache.hudi.org.apache.avro.InvalidAvroMagicException: Not an Avro data file

2021-12-13 Thread GitBox
wjcwin closed issue #4249: URL: https://github.com/apache/hudi/issues/4249 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail:

[GitHub] [hudi] wjcwin commented on issue #4249: [SUPPORT]FLINK CDC WRITE HUDI, restart job get exception:org.apache.hudi.org.apache.avro.InvalidAvroMagicException: Not an Avro data file

2021-12-13 Thread GitBox
wjcwin commented on issue #4249: URL: https://github.com/apache/hudi/issues/4249#issuecomment-993241480 @danny0405 ; nice -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment.

[jira] [Created] (HUDI-3015) Implement #reset and #sync for metadata filesystem view

2021-12-13 Thread Danny Chen (Jira)
Danny Chen created HUDI-3015: Summary: Implement #reset and #sync for metadata filesystem view Key: HUDI-3015 URL: https://issues.apache.org/jira/browse/HUDI-3015 Project: Apache Hudi Issue

[GitHub] [hudi] hudi-bot commented on pull request #4306: [HUDI-3014] add table option to set utc timezone

2021-12-13 Thread GitBox
hudi-bot commented on pull request #4306: URL: https://github.com/apache/hudi/pull/4306#issuecomment-993237460 ## CI report: * a39258ca69c6302da42cdb1fe1a0794676480952 UNKNOWN * 03dc939b0ef9852fd2a7970630b14b61c4833e8a Azure:

[GitHub] [hudi] hudi-bot removed a comment on pull request #4306: [HUDI-3014] add table option to set utc timezone

2021-12-13 Thread GitBox
hudi-bot removed a comment on pull request #4306: URL: https://github.com/apache/hudi/pull/4306#issuecomment-993235819 ## CI report: * a39258ca69c6302da42cdb1fe1a0794676480952 UNKNOWN * 03dc939b0ef9852fd2a7970630b14b61c4833e8a UNKNOWN Bot commands @hudi-bot

[GitHub] [hudi] hudi-bot commented on pull request #4306: [HUDI-3014] add table option to set utc timezone

2021-12-13 Thread GitBox
hudi-bot commented on pull request #4306: URL: https://github.com/apache/hudi/pull/4306#issuecomment-993235819 ## CI report: * a39258ca69c6302da42cdb1fe1a0794676480952 UNKNOWN * 03dc939b0ef9852fd2a7970630b14b61c4833e8a UNKNOWN Bot commands @hudi-bot supports

[GitHub] [hudi] hudi-bot removed a comment on pull request #4306: [HUDI-3014] add table option to set utc timezone

2021-12-13 Thread GitBox
hudi-bot removed a comment on pull request #4306: URL: https://github.com/apache/hudi/pull/4306#issuecomment-993234153 ## CI report: * a39258ca69c6302da42cdb1fe1a0794676480952 UNKNOWN Bot commands @hudi-bot supports the following commands: - `@hudi-bot run

[GitHub] [hudi] ngk2009 edited a comment on issue #4297: [SUPPORT]Flink SQL No FileSystem for scheme s3

2021-12-13 Thread GitBox
ngk2009 edited a comment on issue #4297: URL: https://github.com/apache/hudi/issues/4297#issuecomment-993232636 > > > > > > > > > > Flink use its own plugin to support filesystems other than HDFS. Hudi adapter to different DFS by extending the `FileSystem` interface directly.

[GitHub] [hudi] hudi-bot commented on pull request #4306: [HUDI-3014] add table option to set utc timezone

2021-12-13 Thread GitBox
hudi-bot commented on pull request #4306: URL: https://github.com/apache/hudi/pull/4306#issuecomment-993234153 ## CI report: * a39258ca69c6302da42cdb1fe1a0794676480952 UNKNOWN Bot commands @hudi-bot supports the following commands: - `@hudi-bot run azure`

[GitHub] [hudi] ngk2009 commented on issue #4297: [SUPPORT]Flink SQL No FileSystem for scheme s3

2021-12-13 Thread GitBox
ngk2009 commented on issue #4297: URL: https://github.com/apache/hudi/issues/4297#issuecomment-993232636 > > > > > > > > > > Flink use its own plugin to support filesystems other than HDFS. Hudi adapter to different DFS by extending the `FileSystem` interface directly. > >

[jira] [Updated] (HUDI-3014) Hudi commit timeline 都是固定本地时区,云主机比如spot机制会受到时区影响

2021-12-13 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HUDI-3014?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated HUDI-3014: - Labels: pull-request-available (was: ) > Hudi commit timeline 都是固定本地时区,云主机比如spot机制会受到时区影响 >

[GitHub] [hudi] xuzifu666 commented on pull request #4306: [HUDI-3014] add table option to set utc timezone

2021-12-13 Thread GitBox
xuzifu666 commented on pull request #4306: URL: https://github.com/apache/hudi/pull/4306#issuecomment-993232176 @leesf @danny0405 @xushiyan have a review please, thanks -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and

[GitHub] [hudi] xuzifu666 opened a new pull request #4306: add table option to set utc timezone

2021-12-13 Thread GitBox
xuzifu666 opened a new pull request #4306: URL: https://github.com/apache/hudi/pull/4306 ## *Tips* - *Thank you very much for contributing to Apache Hudi.* - *Please review https://hudi.apache.org/contribute/how-to-contribute before opening a pull request.* ## What is the

[GitHub] [hudi] hudi-bot commented on pull request #4287: [DO NOT MERGE] 0.10.0 release patch for flink

2021-12-13 Thread GitBox
hudi-bot commented on pull request #4287: URL: https://github.com/apache/hudi/pull/4287#issuecomment-993230492 ## CI report: * 23b2245d3b600b469b09992c7502471fe7daf75e Azure:

[GitHub] [hudi] hudi-bot removed a comment on pull request #4287: [DO NOT MERGE] 0.10.0 release patch for flink

2021-12-13 Thread GitBox
hudi-bot removed a comment on pull request #4287: URL: https://github.com/apache/hudi/pull/4287#issuecomment-993202783 ## CI report: * 9c9e95d14ec1ef850c9bd92292311a4853155ab3 Azure:

[jira] [Assigned] (HUDI-3014) Hudi commit timeline 都是固定本地时区,云主机比如spot机制会受到时区影响

2021-12-13 Thread xy (Jira)
[ https://issues.apache.org/jira/browse/HUDI-3014?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] xy reassigned HUDI-3014: Fix Version/s: 0.11.0 Assignee: xy Summary: Hudi commit timeline 都是固定本地时区,云主机比如spot机制会受到时区影响

[jira] [Created] (HUDI-3014) Hudi

2021-12-13 Thread xy (Jira)
xy created HUDI-3014: Summary: Hudi Key: HUDI-3014 URL: https://issues.apache.org/jira/browse/HUDI-3014 Project: Apache Hudi Issue Type: Improvement Reporter: xy -- This message was

[GitHub] [hudi] waywtdcc opened a new issue #4305: [SUPPORT] Duplicate Flink write record

2021-12-13 Thread GitBox
waywtdcc opened a new issue #4305: URL: https://github.com/apache/hudi/issues/4305 **Describe the problem you faced** When Flink submits multiple tasks, the write record is repeated. There are multiple data with the same primary key in the Hudi table. **To Reproduce**

[GitHub] [hudi] danny0405 commented on issue #4249: [SUPPORT]FLINK CDC WRITE HUDI, restart job get exception:org.apache.hudi.org.apache.avro.InvalidAvroMagicException: Not an Avro data file

2021-12-13 Thread GitBox
danny0405 commented on issue #4249: URL: https://github.com/apache/hudi/issues/4249#issuecomment-993212863 No, it is not jar conflict, i have fixed it in https://github.com/apache/hudi/pull/4296, you can use the patch branch code here: https://github.com/apache/hudi/pull/4287, the

[GitHub] [hudi] wjcwin commented on issue #4249: [SUPPORT]FLINK CDC WRITE HUDI, restart job get exception:org.apache.hudi.org.apache.avro.InvalidAvroMagicException: Not an Avro data file

2021-12-13 Thread GitBox
wjcwin commented on issue #4249: URL: https://github.com/apache/hudi/issues/4249#issuecomment-993209994 @nsivabalan ; @danny0405 ; my application base on flink version:1.13.1 hudi-flink-bundle version:0.10.0 . sorry, i have cleared this files, and i remove hive-exec-2.1.1.jar ,

[GitHub] [hudi] zhangyue19921010 edited a comment on pull request #4078: [HUDI-2833] Clean up unused archive files instead of expanding indefinitely.

2021-12-13 Thread GitBox
zhangyue19921010 edited a comment on pull request #4078: URL: https://github.com/apache/hudi/pull/4078#issuecomment-992236967 Hi @yihua Thanks a lot for your attention. I agree with your opinion, indeed deleting archived files will lose historical instants information and affect

[GitHub] [hudi] hudi-bot commented on pull request #4287: [DO NOT MERGE] 0.10.0 release patch for flink

2021-12-13 Thread GitBox
hudi-bot commented on pull request #4287: URL: https://github.com/apache/hudi/pull/4287#issuecomment-993202783 ## CI report: * 9c9e95d14ec1ef850c9bd92292311a4853155ab3 Azure:

[GitHub] [hudi] zhangyue19921010 commented on pull request #4301: [Minor] Catch and ignore all the exceptions in quietDeleteMarkerDir

2021-12-13 Thread GitBox
zhangyue19921010 commented on pull request #4301: URL: https://github.com/apache/hudi/pull/4301#issuecomment-993202768 @hudi-bot run azure -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the

[GitHub] [hudi] hudi-bot removed a comment on pull request #4301: [Minor] Catch and ignore all the exceptions in quietDeleteMarkerDir

2021-12-13 Thread GitBox
hudi-bot removed a comment on pull request #4301: URL: https://github.com/apache/hudi/pull/4301#issuecomment-993201497 ## CI report: * 64ea4442ad179875fe2dbaa7c6a001b4000b4524 UNKNOWN * 4bd6b8cc1f93c3963b41bf50fcc99415533edc22 Azure:

[GitHub] [hudi] zhangyue19921010 removed a comment on pull request #4301: [Minor] Catch and ignore all the exceptions in quietDeleteMarkerDir

2021-12-13 Thread GitBox
zhangyue19921010 removed a comment on pull request #4301: URL: https://github.com/apache/hudi/pull/4301#issuecomment-993165038 @hudi-bot run azure -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go

[GitHub] [hudi] hudi-bot commented on pull request #4301: [Minor] Catch and ignore all the exceptions in quietDeleteMarkerDir

2021-12-13 Thread GitBox
hudi-bot commented on pull request #4301: URL: https://github.com/apache/hudi/pull/4301#issuecomment-993202841 ## CI report: * 64ea4442ad179875fe2dbaa7c6a001b4000b4524 UNKNOWN * 4bd6b8cc1f93c3963b41bf50fcc99415533edc22 Azure:

[GitHub] [hudi] hudi-bot removed a comment on pull request #4287: [DO NOT MERGE] 0.10.0 release patch for flink

2021-12-13 Thread GitBox
hudi-bot removed a comment on pull request #4287: URL: https://github.com/apache/hudi/pull/4287#issuecomment-993201439 ## CI report: * 9c9e95d14ec1ef850c9bd92292311a4853155ab3 Azure:

[GitHub] [hudi] hudi-bot commented on pull request #4287: [DO NOT MERGE] 0.10.0 release patch for flink

2021-12-13 Thread GitBox
hudi-bot commented on pull request #4287: URL: https://github.com/apache/hudi/pull/4287#issuecomment-993201439 ## CI report: * 9c9e95d14ec1ef850c9bd92292311a4853155ab3 Azure:

[GitHub] [hudi] hudi-bot removed a comment on pull request #4301: [Minor] Catch and ignore all the exceptions in quietDeleteMarkerDir

2021-12-13 Thread GitBox
hudi-bot removed a comment on pull request #4301: URL: https://github.com/apache/hudi/pull/4301#issuecomment-993165734 ## CI report: * 64ea4442ad179875fe2dbaa7c6a001b4000b4524 UNKNOWN * 4bd6b8cc1f93c3963b41bf50fcc99415533edc22 Azure:

[GitHub] [hudi] hudi-bot commented on pull request #4301: [Minor] Catch and ignore all the exceptions in quietDeleteMarkerDir

2021-12-13 Thread GitBox
hudi-bot commented on pull request #4301: URL: https://github.com/apache/hudi/pull/4301#issuecomment-993201497 ## CI report: * 64ea4442ad179875fe2dbaa7c6a001b4000b4524 UNKNOWN * 4bd6b8cc1f93c3963b41bf50fcc99415533edc22 Azure:

[GitHub] [hudi] hudi-bot removed a comment on pull request #4287: [DO NOT MERGE] 0.10.0 release patch for flink

2021-12-13 Thread GitBox
hudi-bot removed a comment on pull request #4287: URL: https://github.com/apache/hudi/pull/4287#issuecomment-993195520 ## CI report: * 9c9e95d14ec1ef850c9bd92292311a4853155ab3 Azure:

[GitHub] [hudi] hudi-bot removed a comment on pull request #4287: [DO NOT MERGE] 0.10.0 release patch for flink

2021-12-13 Thread GitBox
hudi-bot removed a comment on pull request #4287: URL: https://github.com/apache/hudi/pull/4287#issuecomment-993166835 ## CI report: * 8431c896cde1284a5a8068c8f34133984c165771 Azure:

[GitHub] [hudi] hudi-bot commented on pull request #4287: [DO NOT MERGE] 0.10.0 release patch for flink

2021-12-13 Thread GitBox
hudi-bot commented on pull request #4287: URL: https://github.com/apache/hudi/pull/4287#issuecomment-993195520 ## CI report: * 9c9e95d14ec1ef850c9bd92292311a4853155ab3 Azure:

[jira] [Commented] (HUDI-2997) Skip the corrupt meta file for pending rollback action

2021-12-13 Thread Danny Chen (Jira)
[ https://issues.apache.org/jira/browse/HUDI-2997?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17458922#comment-17458922 ] Danny Chen commented on HUDI-2997: -- Fixed via master branch: c8d6bd88988f19f5163553b4438981e780dfda0c >

[jira] [Resolved] (HUDI-2997) Skip the corrupt meta file for pending rollback action

2021-12-13 Thread Danny Chen (Jira)
[ https://issues.apache.org/jira/browse/HUDI-2997?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Danny Chen resolved HUDI-2997. -- > Skip the corrupt meta file for pending rollback action >

[hudi] branch master updated (29bc5fd -> c8d6bd8)

2021-12-13 Thread danny0405
This is an automated email from the ASF dual-hosted git repository. danny0405 pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/hudi.git. from 29bc5fd [HUDI-2996] Flink streaming reader 'skip_compaction' option does not work (#4304) add c8d6bd8

[GitHub] [hudi] danny0405 merged pull request #4296: [HUDI-2997] Skip the corrupt meta file for pending rollback action

2021-12-13 Thread GitBox
danny0405 merged pull request #4296: URL: https://github.com/apache/hudi/pull/4296 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail:

[GitHub] [hudi] RocMarshal removed a comment on pull request #3813: [HUDI-2563][hudi-client] Refactor CompactionTriggerStrategy.

2021-12-13 Thread GitBox
RocMarshal removed a comment on pull request #3813: URL: https://github.com/apache/hudi/pull/3813#issuecomment-976249155 cc @leesf -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific

[GitHub] [hudi] hudi-bot removed a comment on pull request #4296: [HUDI-2997] Skip the corrupt meta file for pending rollback action

2021-12-13 Thread GitBox
hudi-bot removed a comment on pull request #4296: URL: https://github.com/apache/hudi/pull/4296#issuecomment-993133437 ## CI report: * 770a33584084a0ae4b6fcb59bee8433bae8bc803 Azure:

[GitHub] [hudi] hudi-bot commented on pull request #4296: [HUDI-2997] Skip the corrupt meta file for pending rollback action

2021-12-13 Thread GitBox
hudi-bot commented on pull request #4296: URL: https://github.com/apache/hudi/pull/4296#issuecomment-993175043 ## CI report: * 770a33584084a0ae4b6fcb59bee8433bae8bc803 Azure:

[GitHub] [hudi] hudi-bot removed a comment on pull request #4287: [DO NOT MERGE] 0.10.0 release patch for flink

2021-12-13 Thread GitBox
hudi-bot removed a comment on pull request #4287: URL: https://github.com/apache/hudi/pull/4287#issuecomment-993165678 ## CI report: * 8431c896cde1284a5a8068c8f34133984c165771 Azure:

[GitHub] [hudi] hudi-bot commented on pull request #4287: [DO NOT MERGE] 0.10.0 release patch for flink

2021-12-13 Thread GitBox
hudi-bot commented on pull request #4287: URL: https://github.com/apache/hudi/pull/4287#issuecomment-993166835 ## CI report: * 8431c896cde1284a5a8068c8f34133984c165771 Azure:

[GitHub] [hudi] YuweiXiao commented on pull request #4303: [HUDI-2998] Claiming RFC number for consistent hashing index

2021-12-13 Thread GitBox
YuweiXiao commented on pull request #4303: URL: https://github.com/apache/hudi/pull/4303#issuecomment-993166520 @hotienvu run azure -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific

[GitHub] [hudi] hudi-bot commented on pull request #4301: [Minor] Catch and ignore all the exceptions in quietDeleteMarkerDir

2021-12-13 Thread GitBox
hudi-bot commented on pull request #4301: URL: https://github.com/apache/hudi/pull/4301#issuecomment-993165734 ## CI report: * 64ea4442ad179875fe2dbaa7c6a001b4000b4524 UNKNOWN * 4bd6b8cc1f93c3963b41bf50fcc99415533edc22 Azure:

[GitHub] [hudi] hudi-bot removed a comment on pull request #4301: [Minor] Catch and ignore all the exceptions in quietDeleteMarkerDir

2021-12-13 Thread GitBox
hudi-bot removed a comment on pull request #4301: URL: https://github.com/apache/hudi/pull/4301#issuecomment-993164483 ## CI report: * 64ea4442ad179875fe2dbaa7c6a001b4000b4524 UNKNOWN * 4bd6b8cc1f93c3963b41bf50fcc99415533edc22 Azure:

[GitHub] [hudi] hudi-bot commented on pull request #4287: [DO NOT MERGE] 0.10.0 release patch for flink

2021-12-13 Thread GitBox
hudi-bot commented on pull request #4287: URL: https://github.com/apache/hudi/pull/4287#issuecomment-993165678 ## CI report: * 8431c896cde1284a5a8068c8f34133984c165771 Azure:

[GitHub] [hudi] hudi-bot removed a comment on pull request #4287: [DO NOT MERGE] 0.10.0 release patch for flink

2021-12-13 Thread GitBox
hudi-bot removed a comment on pull request #4287: URL: https://github.com/apache/hudi/pull/4287#issuecomment-991570858 ## CI report: * 8431c896cde1284a5a8068c8f34133984c165771 Azure:

[GitHub] [hudi] zhangyue19921010 commented on pull request #4301: [Minor] Catch and ignore all the exceptions in quietDeleteMarkerDir

2021-12-13 Thread GitBox
zhangyue19921010 commented on pull request #4301: URL: https://github.com/apache/hudi/pull/4301#issuecomment-993165038 @hudi-bot run azure -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the

[GitHub] [hudi] hudi-bot removed a comment on pull request #4301: [Minor] Catch and ignore all the exceptions in quietDeleteMarkerDir

2021-12-13 Thread GitBox
hudi-bot removed a comment on pull request #4301: URL: https://github.com/apache/hudi/pull/4301#issuecomment-993132478 ## CI report: * c5f5433e2fc8209377bd66fdad4d8b2efd9b358a Azure:

[GitHub] [hudi] hudi-bot commented on pull request #4301: [Minor] Catch and ignore all the exceptions in quietDeleteMarkerDir

2021-12-13 Thread GitBox
hudi-bot commented on pull request #4301: URL: https://github.com/apache/hudi/pull/4301#issuecomment-993164483 ## CI report: * 64ea4442ad179875fe2dbaa7c6a001b4000b4524 UNKNOWN * 4bd6b8cc1f93c3963b41bf50fcc99415533edc22 Azure:

[jira] [Created] (HUDI-3013) Docs for Presto and Hudi

2021-12-13 Thread Kyle Weller (Jira)
Kyle Weller created HUDI-3013: - Summary: Docs for Presto and Hudi Key: HUDI-3013 URL: https://issues.apache.org/jira/browse/HUDI-3013 Project: Apache Hudi Issue Type: Sub-task

[jira] [Updated] (HUDI-1370) Scoping work needed to support bootstrap and RFC-15 together

2021-12-13 Thread Manoj Govindassamy (Jira)
[ https://issues.apache.org/jira/browse/HUDI-1370?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Manoj Govindassamy updated HUDI-1370: - Priority: Major (was: Blocker) > Scoping work needed to support bootstrap and RFC-15

[jira] [Updated] (HUDI-2747) Fix hudi cli metadata commands

2021-12-13 Thread Manoj Govindassamy (Jira)
[ https://issues.apache.org/jira/browse/HUDI-2747?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Manoj Govindassamy updated HUDI-2747: - Priority: Major (was: Blocker) > Fix hudi cli metadata commands >

[GitHub] [hudi] alexeykudinkin commented on a change in pull request #3989: [HUDI-2589] RFC-37: Metadata table based bloom index

2021-12-13 Thread GitBox
alexeykudinkin commented on a change in pull request #3989: URL: https://github.com/apache/hudi/pull/3989#discussion_r768318819 ## File path: rfc/rfc-37/rfc-37.md ## @@ -0,0 +1,286 @@ + +# RFC-37: Metadata based Bloom Index + +## Proposers +- @nsivabalan +- @manojpec + +##

[jira] [Assigned] (HUDI-2695) Documentation

2021-12-13 Thread Sagar Sumit (Jira)
[ https://issues.apache.org/jira/browse/HUDI-2695?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sagar Sumit reassigned HUDI-2695: - Assignee: Kyle Weller > Documentation > - > > Key: HUDI-2695 >

[jira] [Created] (HUDI-3012) Investigate: Metadata table write performance impact

2021-12-13 Thread Manoj Govindassamy (Jira)
Manoj Govindassamy created HUDI-3012: Summary: Investigate: Metadata table write performance impact Key: HUDI-3012 URL: https://issues.apache.org/jira/browse/HUDI-3012 Project: Apache Hudi

[GitHub] [hudi] alexeykudinkin commented on a change in pull request #3989: [HUDI-2589] RFC-37: Metadata table based bloom index

2021-12-13 Thread GitBox
alexeykudinkin commented on a change in pull request #3989: URL: https://github.com/apache/hudi/pull/3989#discussion_r768317411 ## File path: rfc/rfc-37/rfc-37.md ## @@ -0,0 +1,286 @@ + +# RFC-37: Metadata based Bloom Index + +## Proposers +- @nsivabalan +- @manojpec + +##

[GitHub] [hudi] hudi-bot commented on pull request #3989: [HUDI-2589] RFC-37: Metadata table based bloom index

2021-12-13 Thread GitBox
hudi-bot commented on pull request #3989: URL: https://github.com/apache/hudi/pull/3989#issuecomment-993158874 ## CI report: * 7416b261921c79d298d924f70e0b2375b664356b Azure:

[GitHub] [hudi] hudi-bot removed a comment on pull request #3989: [HUDI-2589] RFC-37: Metadata table based bloom index

2021-12-13 Thread GitBox
hudi-bot removed a comment on pull request #3989: URL: https://github.com/apache/hudi/pull/3989#issuecomment-993125014 ## CI report: * d23a140d1925eafba49a7dc822add31dba771e33 Azure:

[jira] [Commented] (HUDI-3008) Nested partition column parsing fails w/ S3 2 stage pipeline

2021-12-13 Thread sivabalan narayanan (Jira)
[ https://issues.apache.org/jira/browse/HUDI-3008?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17458903#comment-17458903 ] sivabalan narayanan commented on HUDI-3008: --- CC [~harsh1231]  > Nested partition column parsing

[jira] [Commented] (HUDI-3009) Ignore metadata files in S3 when 1st deltastreamer in 2 stage pipeline

2021-12-13 Thread sivabalan narayanan (Jira)
[ https://issues.apache.org/jira/browse/HUDI-3009?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17458902#comment-17458902 ] sivabalan narayanan commented on HUDI-3009: --- CC [~harsh1231]  > Ignore metadata files in S3

[jira] [Commented] (HUDI-3011) Add support to start incremental consumption from begin time rather than latest commit time with S3EventsHoodieIncrSource

2021-12-13 Thread sivabalan narayanan (Jira)
[ https://issues.apache.org/jira/browse/HUDI-3011?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17458901#comment-17458901 ] sivabalan narayanan commented on HUDI-3011: --- CC [~harsh1231]  > Add support to start

[jira] [Created] (HUDI-3011) Add support to start incremental consumption from begin time rather than latest commit time with S3EventsHoodieIncrSource

2021-12-13 Thread sivabalan narayanan (Jira)
sivabalan narayanan created HUDI-3011: - Summary: Add support to start incremental consumption from begin time rather than latest commit time with S3EventsHoodieIncrSource Key: HUDI-3011 URL:

[jira] [Assigned] (HUDI-3011) Add support to start incremental consumption from begin time rather than latest commit time with S3EventsHoodieIncrSource

2021-12-13 Thread sivabalan narayanan (Jira)
[ https://issues.apache.org/jira/browse/HUDI-3011?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] sivabalan narayanan reassigned HUDI-3011: - Assignee: sivabalan narayanan > Add support to start incremental consumption

[jira] [Updated] (HUDI-3011) Add support to start incremental consumption from begin time rather than latest commit time with S3EventsHoodieIncrSource

2021-12-13 Thread sivabalan narayanan (Jira)
[ https://issues.apache.org/jira/browse/HUDI-3011?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] sivabalan narayanan updated HUDI-3011: -- Labels: core-flow-ds sev:critical (was: ) > Add support to start incremental

[jira] [Updated] (HUDI-3010) Enable metadata file listing for Presto directory lister

2021-12-13 Thread Vinoth Chandar (Jira)
[ https://issues.apache.org/jira/browse/HUDI-3010?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vinoth Chandar updated HUDI-3010: - Description: lets the PR landed. with numbers showing that queries stabilize after a while (w/o

[jira] [Updated] (HUDI-3010) Enable metadata file listing for Presto directory lister

2021-12-13 Thread Vinoth Chandar (Jira)
[ https://issues.apache.org/jira/browse/HUDI-3010?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vinoth Chandar updated HUDI-3010: - Fix Version/s: 0.11.0 > Enable metadata file listing for Presto directory lister >

[jira] [Updated] (HUDI-3010) Enable metadata file listing for Presto directory lister

2021-12-13 Thread Vinoth Chandar (Jira)
[ https://issues.apache.org/jira/browse/HUDI-3010?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vinoth Chandar updated HUDI-3010: - Priority: Blocker (was: Major) > Enable metadata file listing for Presto directory lister >

[jira] [Updated] (HUDI-3009) Ignore metadata files in S3 when 1st deltastreamer in 2 stage pipeline

2021-12-13 Thread sivabalan narayanan (Jira)
[ https://issues.apache.org/jira/browse/HUDI-3009?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] sivabalan narayanan updated HUDI-3009: -- Labels: core-flow-ds sev:high (was: sev:high) > Ignore metadata files in S3 when 1st

[jira] [Updated] (HUDI-3009) Ignore metadata files in S3 when 1st deltastreamer in 2 stage pipeline

2021-12-13 Thread sivabalan narayanan (Jira)
[ https://issues.apache.org/jira/browse/HUDI-3009?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] sivabalan narayanan updated HUDI-3009: -- Labels: sev:high (was: ) > Ignore metadata files in S3 when 1st deltastreamer in 2

[jira] [Created] (HUDI-3010) Enable metadata file listing for Presto directory lister

2021-12-13 Thread Vinoth Chandar (Jira)
Vinoth Chandar created HUDI-3010: Summary: Enable metadata file listing for Presto directory lister Key: HUDI-3010 URL: https://issues.apache.org/jira/browse/HUDI-3010 Project: Apache Hudi

[jira] [Updated] (HUDI-3009) Ignore metadata files in S3 when 1st deltastreamer in 2 stage pipeline

2021-12-13 Thread sivabalan narayanan (Jira)
[ https://issues.apache.org/jira/browse/HUDI-3009?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] sivabalan narayanan updated HUDI-3009: -- Fix Version/s: 0.11.0 > Ignore metadata files in S3 when 1st deltastreamer in 2 stage

[jira] [Updated] (HUDI-3008) Nested partition column parsing fails w/ S3 2 stage pipeline

2021-12-13 Thread sivabalan narayanan (Jira)
[ https://issues.apache.org/jira/browse/HUDI-3008?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] sivabalan narayanan updated HUDI-3008: -- Labels: core-flow-ds sev:critical (was: sev:critical) > Nested partition column

[jira] [Updated] (HUDI-3008) Nested partition column parsing fails w/ S3 2 stage pipeline

2021-12-13 Thread sivabalan narayanan (Jira)
[ https://issues.apache.org/jira/browse/HUDI-3008?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] sivabalan narayanan updated HUDI-3008: -- Fix Version/s: 0.11.0 > Nested partition column parsing fails w/ S3 2 stage pipeline >

[jira] [Updated] (HUDI-3008) Nested partition column parsing fails w/ S3 2 stage pipeline

2021-12-13 Thread sivabalan narayanan (Jira)
[ https://issues.apache.org/jira/browse/HUDI-3008?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] sivabalan narayanan updated HUDI-3008: -- Labels: sev:critical (was: ) > Nested partition column parsing fails w/ S3 2 stage

[jira] [Created] (HUDI-3009) Ignore metadata files in S3 when 1st deltastreamer in 2 stage pipeline

2021-12-13 Thread sivabalan narayanan (Jira)
sivabalan narayanan created HUDI-3009: - Summary: Ignore metadata files in S3 when 1st deltastreamer in 2 stage pipeline Key: HUDI-3009 URL: https://issues.apache.org/jira/browse/HUDI-3009

[jira] [Updated] (HUDI-2982) Verify Metadata table key deduplication and enable by default

2021-12-13 Thread Manoj Govindassamy (Jira)
[ https://issues.apache.org/jira/browse/HUDI-2982?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Manoj Govindassamy updated HUDI-2982: - Labels: release-notes (was: ) > Verify Metadata table key deduplication and enable by

[jira] [Assigned] (HUDI-3008) Nested partition column parsing fails w/ S3 2 stage pipeline

2021-12-13 Thread sivabalan narayanan (Jira)
[ https://issues.apache.org/jira/browse/HUDI-3008?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] sivabalan narayanan reassigned HUDI-3008: - Assignee: sivabalan narayanan > Nested partition column parsing fails w/ S3 2

[jira] [Created] (HUDI-3008) Nested partition column parsing fails w/ S3 2 stage pipeline

2021-12-13 Thread sivabalan narayanan (Jira)
sivabalan narayanan created HUDI-3008: - Summary: Nested partition column parsing fails w/ S3 2 stage pipeline Key: HUDI-3008 URL: https://issues.apache.org/jira/browse/HUDI-3008 Project: Apache

[jira] [Updated] (HUDI-2981) Verify Metadata table virtual keys support and enable by default

2021-12-13 Thread Manoj Govindassamy (Jira)
[ https://issues.apache.org/jira/browse/HUDI-2981?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Manoj Govindassamy updated HUDI-2981: - Labels: pull-request-available release-notes (was: pull-request-available) > Verify

[jira] [Assigned] (HUDI-2558) Clustering w/ sort columns with null values fails

2021-12-13 Thread sivabalan narayanan (Jira)
[ https://issues.apache.org/jira/browse/HUDI-2558?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] sivabalan narayanan reassigned HUDI-2558: - Assignee: Harshal Patil (was: sivabalan narayanan) > Clustering w/ sort columns

  1   2   3   4   5   6   7   >