[jira] [Commented] (HUDI-64) Estimation of compression ratio & other dynamic storage knobs based on historical stats

[ https://issues.apache.org/jira/browse/HUDI-64?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16972319#comment-16972319 ] vinoyang commented on HUDI-64: -- Hi [~vinoth] IMO, we can refer to Flink's optimizer of batch processing. There

[GitHub] [incubator-hudi] lyogev opened a new pull request #1011: update to upstream

lyogev opened a new pull request #1011: update to upstream URL: https://github.com/apache/incubator-hudi/pull/1011 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub

[GitHub] [incubator-hudi] lyogev closed pull request #1011: update to upstream

lyogev closed pull request #1011: update to upstream URL: https://github.com/apache/incubator-hudi/pull/1011 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and

[GitHub] [incubator-hudi] yuhadooper commented on issue #143: Tracking ticket for folks to be added to slack group

yuhadooper commented on issue #143: Tracking ticket for folks to be added to slack group URL: https://github.com/apache/incubator-hudi/issues/143#issuecomment-553099051 Hello @vinothchandar, please add pyuvaraj.na...@gmail.com to the slack group, thank you!

[GitHub] [incubator-hudi] bwu2 commented on issue #143: Tracking ticket for folks to be added to slack group

bwu2 commented on issue #143: Tracking ticket for folks to be added to slack group URL: https://github.com/apache/incubator-hudi/issues/143#issuecomment-553058449 Hi @vinothchandar , could you please send me the slack invitation at bwall...@veracode.com Thanks!

[GitHub] [incubator-hudi] bwu2 edited a comment on issue #143: Tracking ticket for folks to be added to slack group

bwu2 edited a comment on issue #143: Tracking ticket for folks to be added to slack group URL: https://github.com/apache/incubator-hudi/issues/143#issuecomment-553058449 Hi @vinothchandar , could you please send me the slack invitation at bwallace AT veracode.com Thanks!

[GitHub] [incubator-hudi] anmolaj commented on issue #143: Tracking ticket for folks to be added to slack group

anmolaj commented on issue #143: Tracking ticket for folks to be added to slack group URL: https://github.com/apache/incubator-hudi/issues/143#issuecomment-553115387 @vinothchandar can you add anmol...@gmail.com to the group please. Thanks in advance :)

[GitHub] [incubator-hudi] sudhar-sense commented on issue #143: Tracking ticket for folks to be added to slack group

sudhar-sense commented on issue #143: Tracking ticket for folks to be added to slack group URL: https://github.com/apache/incubator-hudi/issues/143#issuecomment-552986380 Hi @vinothchandar , please add me into the slack group sudharshan@gmail.com

[GitHub] [incubator-hudi] nsivabalan commented on issue #1004: [WIP] [HUDI-15] Adding delete api to HoodieWriteClient

nsivabalan commented on issue #1004: [WIP] [HUDI-15] Adding delete api to HoodieWriteClient URL: https://github.com/apache/incubator-hudi/pull/1004#issuecomment-552934641 @vinothchandar : yes, you are right. I will be putting up multiple PRs.

[GitHub] [incubator-hudi] nsivabalan commented on a change in pull request #1004: [WIP] [HUDI-15] Adding delete api to HoodieWriteClient

nsivabalan commented on a change in pull request #1004: [WIP] [HUDI-15] Adding delete api to HoodieWriteClient URL: https://github.com/apache/incubator-hudi/pull/1004#discussion_r345261159 ## File path: hudi-client/src/main/java/org/apache/hudi/HoodieWriteClient.java ##

[jira] [Resolved] (HUDI-129) How to release cWiki page

[ https://issues.apache.org/jira/browse/HUDI-129?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Balaji Varadarajan resolved HUDI-129. - Resolution: Fixed > How to release cWiki page > - > >

[jira] [Resolved] (HUDI-121) Prepare for first Apache Release

[ https://issues.apache.org/jira/browse/HUDI-121?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Balaji Varadarajan resolved HUDI-121. - Resolution: Fixed > Prepare for first Apache Release > >

[jira] [Closed] (HUDI-129) How to release cWiki page

[ https://issues.apache.org/jira/browse/HUDI-129?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Balaji Varadarajan closed HUDI-129. --- > How to release cWiki page > - > > Key: HUDI-129 >

[jira] [Closed] (HUDI-121) Prepare for first Apache Release

[ https://issues.apache.org/jira/browse/HUDI-121?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Balaji Varadarajan closed HUDI-121. --- > Prepare for first Apache Release > > > Key:

[jira] [Commented] (HUDI-238) Make separate release for hudi spark/scala based packages for scala 2.12

[ https://issues.apache.org/jira/browse/HUDI-238?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16972565#comment-16972565 ] Tadas Sugintas commented on HUDI-238: - Yes, I will continue where I stopped. > Make separate release

[jira] [Updated] (HUDI-53) Implement Record level Index to map a record key to a pair #90

[ https://issues.apache.org/jira/browse/HUDI-53?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vinoth Chandar updated HUDI-53: --- Summary: Implement Record level Index to map a record key to a pair #90 (was: Implement Global Index

[GitHub] [incubator-hudi] nsivabalan commented on a change in pull request #1004: [WIP] [HUDI-15] Adding delete api to HoodieWriteClient

nsivabalan commented on a change in pull request #1004: [WIP] [HUDI-15] Adding delete api to HoodieWriteClient URL: https://github.com/apache/incubator-hudi/pull/1004#discussion_r345247576 ## File path: hudi-client/src/main/java/org/apache/hudi/HoodieWriteClient.java ##

[jira] [Commented] (HUDI-64) Estimation of compression ratio & other dynamic storage knobs based on historical stats

[ https://issues.apache.org/jira/browse/HUDI-64?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16972563#comment-16972563 ] Vinoth Chandar commented on HUDI-64: Will try to dig deeper into the flink concepts. They seem similar

[jira] [Updated] (HUDI-80) Incrementalize cleaning based on timeline metadata

[ https://issues.apache.org/jira/browse/HUDI-80?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vinoth Chandar updated HUDI-80: --- Status: Closed (was: Patch Available) > Incrementalize cleaning based on timeline metadata >

[jira] [Commented] (HUDI-238) Make separate release for hudi spark/scala based packages for scala 2.12

[ https://issues.apache.org/jira/browse/HUDI-238?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16972553#comment-16972553 ] Vinoth Chandar commented on HUDI-238: - Do you have cycles to take a crack at this? > Make separate

[GitHub] [incubator-hudi] vinothchandar merged pull request #1008: [HUDI-80] Leverage Commit metadata to figure out partitions to be cleaned for Cleaning by commits mode

vinothchandar merged pull request #1008: [HUDI-80] Leverage Commit metadata to figure out partitions to be cleaned for Cleaning by commits mode URL: https://github.com/apache/incubator-hudi/pull/1008 This is an automated

[incubator-hudi] branch master updated (0bb5999 -> 8ff06dd)

This is an automated email from the ASF dual-hosted git repository. vinoth pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/incubator-hudi.git. from 0bb5999 [HUDI-306] Support Glue catalog and other hive metastore implementations (#961) add 8ff06dd

[GitHub] [incubator-hudi] bvaradar commented on a change in pull request #996: Fixes to ensure MOR incr pull provides consistent results

bvaradar commented on a change in pull request #996: Fixes to ensure MOR incr pull provides consistent results URL: https://github.com/apache/incubator-hudi/pull/996#discussion_r345068038 ## File path:

[GitHub] [incubator-hudi] bvaradar removed a comment on issue #1005: [HUDI-91][HUDI-12]Migrate to spark 2.4.4, migrate to spark-avro library instead of databricks-avro, add support for Decimal/Date ty

bvaradar removed a comment on issue #1005: [HUDI-91][HUDI-12]Migrate to spark 2.4.4, migrate to spark-avro library instead of databricks-avro, add support for Decimal/Date types URL: https://github.com/apache/incubator-hudi/pull/1005#issuecomment-552788039 Once you resolve the conflicts

[GitHub] [incubator-hudi] bvaradar commented on issue #1005: [HUDI-91][HUDI-12]Migrate to spark 2.4.4, migrate to spark-avro library instead of databricks-avro, add support for Decimal/Date types

bvaradar commented on issue #1005: [HUDI-91][HUDI-12]Migrate to spark 2.4.4, migrate to spark-avro library instead of databricks-avro, add support for Decimal/Date types URL: https://github.com/apache/incubator-hudi/pull/1005#issuecomment-552788039 Once you resolve the conflicts and the

[GitHub] [incubator-hudi] bvaradar commented on issue #1005: [HUDI-91][HUDI-12]Migrate to spark 2.4.4, migrate to spark-avro library instead of databricks-avro, add support for Decimal/Date types

bvaradar commented on issue #1005: [HUDI-91][HUDI-12]Migrate to spark 2.4.4, migrate to spark-avro library instead of databricks-avro, add support for Decimal/Date types URL: https://github.com/apache/incubator-hudi/pull/1005#issuecomment-552788499 Mistakenly added a comment for another

[GitHub] [incubator-hudi] bvaradar commented on issue #996: Fixes to ensure MOR incr pull provides consistent results

bvaradar commented on issue #996: Fixes to ensure MOR incr pull provides consistent results URL: https://github.com/apache/incubator-hudi/pull/996#issuecomment-552788878 @n3nash : Once you resolve the conflicts and the tests passes, we can merge the change

[GitHub] [incubator-hudi] bvaradar commented on issue #1005: [HUDI-91][HUDI-12]Migrate to spark 2.4.4, migrate to spark-avro library instead of databricks-avro, add support for Decimal/Date types

bvaradar commented on issue #1005: [HUDI-91][HUDI-12]Migrate to spark 2.4.4, migrate to spark-avro library instead of databricks-avro, add support for Decimal/Date types URL: https://github.com/apache/incubator-hudi/pull/1005#issuecomment-552792607 @umehrot2 : If you want to give it a

[GitHub] [incubator-hudi] bvaradar commented on a change in pull request #1008: [HUDI-80] Leverage Commit metadata to figure out partitions to be cleaned for Cleaning by commits mode

bvaradar commented on a change in pull request #1008: [HUDI-80] Leverage Commit metadata to figure out partitions to be cleaned for Cleaning by commits mode URL: https://github.com/apache/incubator-hudi/pull/1008#discussion_r345080158 ## File path:

[GitHub] [incubator-hudi] bvaradar commented on a change in pull request #1008: [HUDI-80] Leverage Commit metadata to figure out partitions to be cleaned for Cleaning by commits mode

bvaradar commented on a change in pull request #1008: [HUDI-80] Leverage Commit metadata to figure out partitions to be cleaned for Cleaning by commits mode URL: https://github.com/apache/incubator-hudi/pull/1008#discussion_r345080276 ## File path:

[GitHub] [incubator-hudi] bvaradar commented on a change in pull request #1008: [HUDI-80] Leverage Commit metadata to figure out partitions to be cleaned for Cleaning by commits mode

bvaradar commented on a change in pull request #1008: [HUDI-80] Leverage Commit metadata to figure out partitions to be cleaned for Cleaning by commits mode URL: https://github.com/apache/incubator-hudi/pull/1008#discussion_r345080192 ## File path:

[GitHub] [incubator-hudi] bvaradar commented on a change in pull request #1008: [HUDI-80] Leverage Commit metadata to figure out partitions to be cleaned for Cleaning by commits mode

bvaradar commented on a change in pull request #1008: [HUDI-80] Leverage Commit metadata to figure out partitions to be cleaned for Cleaning by commits mode URL: https://github.com/apache/incubator-hudi/pull/1008#discussion_r345080244 ## File path:

[GitHub] [incubator-hudi] bvaradar commented on a change in pull request #1008: [HUDI-80] Leverage Commit metadata to figure out partitions to be cleaned for Cleaning by commits mode

bvaradar commented on a change in pull request #1008: [HUDI-80] Leverage Commit metadata to figure out partitions to be cleaned for Cleaning by commits mode URL: https://github.com/apache/incubator-hudi/pull/1008#discussion_r345080327 ## File path:

[GitHub] [incubator-hudi] umehrot2 commented on issue #1005: [HUDI-91][HUDI-12]Migrate to spark 2.4.4, migrate to spark-avro library instead of databricks-avro, add support for Decimal/Date types

umehrot2 commented on issue #1005: [HUDI-91][HUDI-12]Migrate to spark 2.4.4, migrate to spark-avro library instead of databricks-avro, add support for Decimal/Date types URL: https://github.com/apache/incubator-hudi/pull/1005#issuecomment-552798034 > @umehrot2 : If you want to give it a

Build failed in Jenkins: hudi-snapshot-deployment-0.5 #97

See Changes: -- [...truncated 2.23 KB...] /home/jenkins/tools/maven/apache-maven-3.5.4/bin: m2.conf mvn mvn.cmd mvnDebug mvnDebug.cmd mvnyjp

[jira] [Commented] (HUDI-310) DynamoDB/Kinesis Change Capture using Delta Streamer

[ https://issues.apache.org/jira/browse/HUDI-310?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16973020#comment-16973020 ] Vinoth Chandar commented on HUDI-310: - Hi [~vinaypatil18] any updates for us? > DynamoDB/Kinesis

[GitHub] [incubator-hudi] vinothchandar commented on issue #991: Hudi Test Suite (Refactor)

vinothchandar commented on issue #991: Hudi Test Suite (Refactor) URL: https://github.com/apache/incubator-hudi/pull/991#issuecomment-553243184 @yanghua Assigned this PR to you for review. Please work with nishith and merge. I have left my high level comments already

[jira] [Commented] (HUDI-76) CSV Source support for Hudi Delta Streamer

[ https://issues.apache.org/jira/browse/HUDI-76?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16973025#comment-16973025 ] Ethan Guo commented on HUDI-76: --- [~vinoth] [~xleesf] > CSV Source support for Hudi Delta Streamer >

[incubator-hudi] branch asf-site updated: [HUDI-277] Translate the Performance page into Chinese (#1010)

This is an automated email from the ASF dual-hosted git repository. leesf pushed a commit to branch asf-site in repository https://gitbox.apache.org/repos/asf/incubator-hudi.git The following commit(s) were added to refs/heads/asf-site by this push: new 747a1d4 [HUDI-277] Translate the

[GitHub] [incubator-hudi] yihua commented on issue #1010: [HUDI-277] Translate the Performance page into Chinese

yihua commented on issue #1010: [HUDI-277] Translate the Performance page into Chinese URL: https://github.com/apache/incubator-hudi/pull/1010#issuecomment-553250274 @leesf Thanks for the review. Comment addressed. This is

[GitHub] [incubator-hudi] leesf merged pull request #1010: [HUDI-277] Translate the Performance page into Chinese

leesf merged pull request #1010: [HUDI-277] Translate the Performance page into Chinese URL: https://github.com/apache/incubator-hudi/pull/1010 This is an automated message from the Apache Git Service. To respond to the

[jira] [Closed] (HUDI-277) Translate Documentation -> Performance page

[ https://issues.apache.org/jira/browse/HUDI-277?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] leesf closed HUDI-277. -- Resolution: Fixed Fixed via asf-site: 747a1d4e21dd7900085b8cc0f695daa147727241 > Translate Documentation -> Performance

[GitHub] [incubator-hudi] leesf commented on a change in pull request #1010: [HUDI-277] Translate the Performance page into Chinese

leesf commented on a change in pull request #1010: [HUDI-277] Translate the Performance page into Chinese URL: https://github.com/apache/incubator-hudi/pull/1010#discussion_r345532446 ## File path: docs/performance.cn.md ## @@ -1,50 +1,47 @@ --- -title: Performance

[GitHub] [incubator-hudi] leesf commented on issue #1010: [HUDI-277] Translate the Performance page into Chinese

leesf commented on issue #1010: [HUDI-277] Translate the Performance page into Chinese URL: https://github.com/apache/incubator-hudi/pull/1010#issuecomment-553198443 Thanks for opening the PR @yihua ! Looks good overall. only left one comment.

[GitHub] [incubator-hudi] umehrot2 opened a new pull request #1012: Migrate integration tests to spark 2.4.4

umehrot2 opened a new pull request #1012: Migrate integration tests to spark 2.4.4 URL: https://github.com/apache/incubator-hudi/pull/1012 This migrates integration tests to use Spark 2.4.4. The tests pass for me locally after building the docker images with spark 2.4.4. Let me know if