[GitHub] [hudi] danny0405 commented on pull request #2786: Add more options for HUDI Flink

2021-04-08 Thread GitBox
danny0405 commented on pull request #2786: URL: https://github.com/apache/hudi/pull/2786#issuecomment-815792095 > @danny0405 Can you please correct the title of the PR? What title should i use ? -- This is an automated message from the Apache Git Service. To respond to the

[GitHub] [hudi] danny0405 commented on a change in pull request #2785: [HUDI-1775] Add option for compaction parallelism

2021-04-08 Thread GitBox
danny0405 commented on a change in pull request #2785: URL: https://github.com/apache/hudi/pull/2785#discussion_r609662357 ## File path: hudi-flink/src/main/java/org/apache/hudi/sink/partitioner/BucketAssignFunction.java ## @@ -159,8 +164,11 @@ public void processElement(I

[GitHub] [hudi] danny0405 commented on a change in pull request #2785: [HUDI-1775] Add option for compaction parallelism

2021-04-08 Thread GitBox
danny0405 commented on a change in pull request #2785: URL: https://github.com/apache/hudi/pull/2785#discussion_r609661804 ## File path: hudi-flink/src/main/java/org/apache/hudi/configuration/FlinkOptions.java ## @@ -255,8 +264,14 @@ private FlinkOptions() { public static

[hudi] branch asf-site updated: Travis CI build asf-site

2021-04-08 Thread vinoth
This is an automated email from the ASF dual-hosted git repository. vinoth pushed a commit to branch asf-site in repository https://gitbox.apache.org/repos/asf/hudi.git The following commit(s) were added to refs/heads/asf-site by this push: new d909cf7 Travis CI build asf-site d909cf7 is

[GitHub] [hudi] yanghua commented on a change in pull request #2785: [HUDI-1775] Add option for compaction parallelism

2021-04-08 Thread GitBox
yanghua commented on a change in pull request #2785: URL: https://github.com/apache/hudi/pull/2785#discussion_r609610921 ## File path: hudi-flink/src/main/java/org/apache/hudi/sink/partitioner/BucketAssignFunction.java ## @@ -159,8 +164,11 @@ public void processElement(I

[jira] [Closed] (HUDI-1778) Add setter to CompactionPlanEvent and CompactionCommitEvent to have better SE/DE performance for Flink

2021-04-08 Thread vinoyang (Jira)
[ https://issues.apache.org/jira/browse/HUDI-1778?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] vinoyang closed HUDI-1778. -- Resolution: Done 5b3608f14951e3aaf4ef7b5238bf32f524c24bb0 > Add setter to CompactionPlanEvent and

[jira] [Updated] (HUDI-1778) Add setter to CompactionPlanEvent and CompactionCommitEvent to have better SE/DE performance for Flink

2021-04-08 Thread vinoyang (Jira)
[ https://issues.apache.org/jira/browse/HUDI-1778?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] vinoyang updated HUDI-1778: --- Fix Version/s: 0.9.0 > Add setter to CompactionPlanEvent and CompactionCommitEvent to have better > SE/DE

[GitHub] [hudi] yanghua merged pull request #2789: [HUDI-1778] Add setter to CompactionPlanEvent and CompactionCommitEvent to have better SE/DE performance for Flink

2021-04-08 Thread GitBox
yanghua merged pull request #2789: URL: https://github.com/apache/hudi/pull/2789 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please

[hudi] branch master updated: [HUDI-1778] Add setter to CompactionPlanEvent and CompactionCommitEvent to have better SE/DE performance for Flink (#2789)

2021-04-08 Thread vinoyang
This is an automated email from the ASF dual-hosted git repository. vinoyang pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/hudi.git The following commit(s) were added to refs/heads/master by this push: new 5b3608f [HUDI-1778] Add setter to

[hudi] branch asf-site updated: [MINOR] Correct logFileDataBlockMaxSize description (#2788)

2021-04-08 Thread vinoyang
This is an automated email from the ASF dual-hosted git repository. vinoyang pushed a commit to branch asf-site in repository https://gitbox.apache.org/repos/asf/hudi.git The following commit(s) were added to refs/heads/asf-site by this push: new a821d83 [MINOR] Correct

[GitHub] [hudi] yanghua merged pull request #2788: [MINOR] Correct logFileDataBlockMaxSize description

2021-04-08 Thread GitBox
yanghua merged pull request #2788: URL: https://github.com/apache/hudi/pull/2788 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please

[GitHub] [hudi] yanghua commented on pull request #2786: Add more options for HUDI Flink

2021-04-08 Thread GitBox
yanghua commented on pull request #2786: URL: https://github.com/apache/hudi/pull/2786#issuecomment-815689735 @danny0405 Can you please correct the title of the PR? -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the

[GitHub] [hudi] codecov-io commented on pull request #2789: [HUDI-1778] Add setter to CompactionPlanEvent and CompactionCommitEvent to have better SE/DE performance for Flink

2021-04-08 Thread GitBox
codecov-io commented on pull request #2789: URL: https://github.com/apache/hudi/pull/2789#issuecomment-815677174 # [Codecov](https://codecov.io/gh/apache/hudi/pull/2789?src=pr=h1) Report > Merging [#2789](https://codecov.io/gh/apache/hudi/pull/2789?src=pr=desc) (47d2db7) into

[GitHub] [hudi] codecov-io edited a comment on pull request #2761: [HUDI-1676] Support SQL with spark3

2021-04-08 Thread GitBox
codecov-io edited a comment on pull request #2761: URL: https://github.com/apache/hudi/pull/2761#issuecomment-812815750 # [Codecov](https://codecov.io/gh/apache/hudi/pull/2761?src=pr=h1) Report > Merging [#2761](https://codecov.io/gh/apache/hudi/pull/2761?src=pr=desc) (15ea2d6) into

[GitHub] [hudi] lw309637554 commented on pull request #2773: [HUDI-1764] Add Hudi-CLI support for clustering

2021-04-08 Thread GitBox
lw309637554 commented on pull request #2773: URL: https://github.com/apache/hudi/pull/2773#issuecomment-815623703 LGTM , @satishkotha @n3nash can you also review? -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the

[jira] [Updated] (HUDI-1778) Add setter to CompactionPlanEvent and CompactionCommitEvent to have better SE/DE performance for Flink

2021-04-08 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HUDI-1778?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated HUDI-1778: - Labels: pull-request-available (was: ) > Add setter to CompactionPlanEvent and

[GitHub] [hudi] MyLanPangzi opened a new pull request #2789: [HUDI-1778] Add setter to CompactionPlanEvent and CompactionCommitEvent to have better SE/DE performance for Flink

2021-04-08 Thread GitBox
MyLanPangzi opened a new pull request #2789: URL: https://github.com/apache/hudi/pull/2789 ## *Tips* - *Thank you very much for contributing to Apache Hudi.* - *Please review https://hudi.apache.org/contributing.html before opening a pull request.* ## What is the purpose of

[jira] [Updated] (HUDI-1778) Add setter to CompactionPlanEvent and CompactionCommitEvent to have better SE/DE performance for Flink

2021-04-08 Thread Jira
[ https://issues.apache.org/jira/browse/HUDI-1778?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] 谢波 updated HUDI-1778: - Description: Currently the CompactionPlanEvent and CompactionCommitEvent   do not implement the setters for the POJO

[jira] [Updated] (HUDI-1778) Add setter to CompactionPlanEvent and CompactionCommitEvent to have better SE/DE performance for Flink

2021-04-08 Thread Jira
[ https://issues.apache.org/jira/browse/HUDI-1778?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] 谢波 updated HUDI-1778: - Description: Currently the {{HoodieKey}} and {{HoodieRecordLocation}} do not implement the setters for the POJO member,

[jira] [Updated] (HUDI-1778) Add setter to CompactionPlanEvent and CompactionCommitEvent to have better SE/DE performance for Flink

2021-04-08 Thread Jira
[ https://issues.apache.org/jira/browse/HUDI-1778?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] 谢波 updated HUDI-1778: - Description: Currently the CompactionPlanEvent and {{HoodieRecordLocation}} do not implement the setters for the POJO

[jira] [Created] (HUDI-1778) Add setter to CompactionPlanEvent and CompactionCommitEvent to have better SE/DE performance for Flink

2021-04-08 Thread Jira
谢波 created HUDI-1778: Summary: Add setter to CompactionPlanEvent and CompactionCommitEvent to have better SE/DE performance for Flink Key: HUDI-1778 URL: https://issues.apache.org/jira/browse/HUDI-1778 Project:

[jira] [Assigned] (HUDI-1778) Add setter to CompactionPlanEvent and CompactionCommitEvent to have better SE/DE performance for Flink

2021-04-08 Thread Jira
[ https://issues.apache.org/jira/browse/HUDI-1778?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] 谢波 reassigned HUDI-1778: Assignee: 谢波 > Add setter to CompactionPlanEvent and CompactionCommitEvent to have better > SE/DE performance for

[GitHub] [hudi] pengzhiwei2018 commented on pull request #2645: [HUDI-1659] Basic Implementation Of Spark Sql Support

2021-04-08 Thread GitBox
pengzhiwei2018 commented on pull request #2645: URL: https://github.com/apache/hudi/pull/2645#issuecomment-815583131 Hi @vinothchandar @kwondw , Thanks for the review on this feature. The code has updated. Main changes: - Sql support spark3 based on the same `HoodieAnalysis` and

[GitHub] [hudi] codecov-io edited a comment on pull request #2645: [HUDI-1659] Basic Implementation Of Spark Sql Support

2021-04-08 Thread GitBox
codecov-io edited a comment on pull request #2645: URL: https://github.com/apache/hudi/pull/2645#issuecomment-792430670 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For

[GitHub] [hudi] vobukh commented on issue #2774: [SUPPORT] NoSuchMethodError on exposing metrics

2021-04-08 Thread GitBox
vobukh commented on issue #2774: URL: https://github.com/apache/hudi/issues/2774#issuecomment-815556571 @n3nash , actually downgrading hudi metrics to 3.1.2 looks better for us - we have a transitive dependency on io.dropwizard.metrics: metrics-core:3.1.5 in our application, which I

[GitHub] [hudi] MyLanPangzi opened a new pull request #2788: [hotfix] correct logFileDataBlockMaxSize description

2021-04-08 Thread GitBox
MyLanPangzi opened a new pull request #2788: URL: https://github.com/apache/hudi/pull/2788 ## *Tips* - *Thank you very much for contributing to Apache Hudi.* - *Please review https://hudi.apache.org/contributing.html before opening a pull request.* ## What is the purpose of

[GitHub] [hudi] rubenssoto opened a new issue #2787: [SUPPORT] Error upserting bucketType UPDATE for partition

2021-04-08 Thread GitBox
rubenssoto opened a new issue #2787: URL: https://github.com/apache/hudi/issues/2787 Hello guys, My hudi job start to have this error, could you help me with it? emr 6.2 Hudi 0.8.0 spark 3.0.1 Thank you 21/04/08 07:38:34 WARN TaskSetManager: Lost task

[jira] [Closed] (HUDI-699) Add unit test for CompactionCommand

2021-04-08 Thread vinoyang (Jira)
[ https://issues.apache.org/jira/browse/HUDI-699?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] vinoyang closed HUDI-699. - Resolution: Done ecdbd2517fd8157d9e96f3d9abf195a589e191ae > Add unit test for CompactionCommand >

[jira] [Updated] (HUDI-699) Add unit test for CompactionCommand

2021-04-08 Thread vinoyang (Jira)
[ https://issues.apache.org/jira/browse/HUDI-699?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] vinoyang updated HUDI-699: -- Fix Version/s: 0.9.0 > Add unit test for CompactionCommand > --- > >

[jira] [Updated] (HUDI-699) Add unit test for CompactionCommand

2021-04-08 Thread vinoyang (Jira)
[ https://issues.apache.org/jira/browse/HUDI-699?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] vinoyang updated HUDI-699: -- Status: Open (was: New) > Add unit test for CompactionCommand > --- > >

[hudi] branch master updated: [HUDI-699] Fix CompactionCommand and add unit test for CompactionCommand (#2325)

2021-04-08 Thread vinoyang
This is an automated email from the ASF dual-hosted git repository. vinoyang pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/hudi.git The following commit(s) were added to refs/heads/master by this push: new ecdbd25 [HUDI-699] Fix CompactionCommand and

[GitHub] [hudi] yanghua merged pull request #2325: [HUDI-699] Fix CompactionCommand and add unit test for CompactionCommand

2021-04-08 Thread GitBox
yanghua merged pull request #2325: URL: https://github.com/apache/hudi/pull/2325 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please

[GitHub] [hudi] danny0405 closed pull request #2785: [HUDI-1775] Add option for compaction parallelism

2021-04-08 Thread GitBox
danny0405 closed pull request #2785: URL: https://github.com/apache/hudi/pull/2785 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please

[GitHub] [hudi] danny0405 opened a new pull request #2786: Add more options for HUDI Flink

2021-04-08 Thread GitBox
danny0405 opened a new pull request #2786: URL: https://github.com/apache/hudi/pull/2786 ## *Tips* - *Thank you very much for contributing to Apache Hudi.* - *Please review https://hudi.apache.org/contributing.html before opening a pull request.* ## What is the purpose of the

[GitHub] [hudi] NickYoungPeng edited a comment on pull request #2744: [HUDI-1742]improve table level config priority

2021-04-08 Thread GitBox
NickYoungPeng edited a comment on pull request #2744: URL: https://github.com/apache/hudi/pull/2744#issuecomment-814594032 > @NickYoungPeng Please refer these 2 classes - `TestHoodieMultiTableDeltaStreamer` and `TestHoodieDeltaStreamer`. Hopefully these will give you a decent idea about

[GitHub] [hudi] jintaoguan commented on pull request #2773: [HUDI-1764] Add Hudi-CLI support for clustering

2021-04-08 Thread GitBox
jintaoguan commented on pull request #2773: URL: https://github.com/apache/hudi/pull/2773#issuecomment-815519172 @lw309637554 I updated the PR according to your comments above. Please take a look and let me know if it looks good to you. Thanks. -- This is an automated message from the

[GitHub] [hudi] garyli1019 closed pull request #2783: [DOCS]Add docs for 0.8.0 release

2021-04-08 Thread GitBox
garyli1019 closed pull request #2783: URL: https://github.com/apache/hudi/pull/2783 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service,

[GitHub] [hudi] garyli1019 commented on pull request #2783: [DOCS]Add docs for 0.8.0 release

2021-04-08 Thread GitBox
garyli1019 commented on pull request #2783: URL: https://github.com/apache/hudi/pull/2783#issuecomment-815496613 closing pr for now, will reopen once fixed -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL

[jira] [Updated] (HUDI-1716) rt view w/ MOR tables fails after schema evolution

2021-04-08 Thread Aditya Tiwari (Jira)
[ https://issues.apache.org/jira/browse/HUDI-1716?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Aditya Tiwari updated HUDI-1716: Status: In Progress (was: Open) > rt view w/ MOR tables fails after schema evolution >

[GitHub] [hudi] jintaoguan commented on a change in pull request #2773: [HUDI-1764] Add Hudi-CLI support for clustering

2021-04-08 Thread GitBox
jintaoguan commented on a change in pull request #2773: URL: https://github.com/apache/hudi/pull/2773#discussion_r609351211 ## File path: hudi-cli/src/main/java/org/apache/hudi/cli/commands/ClusteringCommand.java ## @@ -0,0 +1,102 @@ +/* + * Licensed to the Apache Software

[GitHub] [hudi] n3nash commented on pull request #2388: [HUDI-1353] add incremental timeline support for pending clustering ops

2021-04-08 Thread GitBox
n3nash commented on pull request #2388: URL: https://github.com/apache/hudi/pull/2388#issuecomment-815488402 @satishkotha gentle reminder -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the

[GitHub] [hudi] codecov-io edited a comment on pull request #2785: [HUDI-1775] Add option for compaction parallelism

2021-04-08 Thread GitBox
codecov-io edited a comment on pull request #2785: URL: https://github.com/apache/hudi/pull/2785#issuecomment-815400787 # [Codecov](https://codecov.io/gh/apache/hudi/pull/2785?src=pr=h1) Report > Merging [#2785](https://codecov.io/gh/apache/hudi/pull/2785?src=pr=desc) (a53b11e) into

[GitHub] [hudi] n3nash commented on issue #2743: Do we have any TTL mechanism in Hudi?

2021-04-08 Thread GitBox
n3nash commented on issue #2743: URL: https://github.com/apache/hudi/issues/2743#issuecomment-815473655 @aditiwari01 Here is the ticket and is assigned to you for now :) BTW, there is some relevant work happening here https://github.com/apache/hudi/pull/2452. Please comment on the PR for

[GitHub] [hudi] n3nash closed issue #2743: Do we have any TTL mechanism in Hudi?

2021-04-08 Thread GitBox
n3nash closed issue #2743: URL: https://github.com/apache/hudi/issues/2743 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact

[jira] [Updated] (HUDI-1777) Add SparkDatasource support for delete_partition API

2021-04-08 Thread Nishith Agarwal (Jira)
[ https://issues.apache.org/jira/browse/HUDI-1777?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Nishith Agarwal updated HUDI-1777: -- Labels: feature-request sev:normal (was: ) > Add SparkDatasource support for delete_partition

[jira] [Created] (HUDI-1777) Add SparkDatasource support for delete_partition API

2021-04-08 Thread Nishith Agarwal (Jira)
Nishith Agarwal created HUDI-1777: - Summary: Add SparkDatasource support for delete_partition API Key: HUDI-1777 URL: https://issues.apache.org/jira/browse/HUDI-1777 Project: Apache Hudi

<    1   2