[GitHub] [hudi] n3nash closed issue #2409: [SUPPORT] Spark structured Streaming writes to Hudi and synchronizes Hive to create only read-optimized tables without creating real-time tables

n3nash closed issue #2409: URL: https://github.com/apache/hudi/issues/2409 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact

[jira] [Closed] (HUDI-1953) No set the output type of the operator, Throw java.lang.NullPointerException

[ https://issues.apache.org/jira/browse/HUDI-1953?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] vinoyang closed HUDI-1953. -- Resolution: Fixed 86007e9a13341e1181f940c5f6e5f6dba8eed755 > No set the output type of the operator, Throw

[GitHub] [hudi] yanghua merged pull request #3023: [HUDI-1953] Fix NPE due to not set the output type of the operator

yanghua merged pull request #3023: URL: https://github.com/apache/hudi/pull/3023 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please

[hudi] branch master updated (05a9830 -> 86007e9)

This is an automated email from the ASF dual-hosted git repository. vinoyang pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/hudi.git. from 05a9830 [HUDI-1952] Fix hive3 meta sync for flink writer (#3021) add 86007e9 [HUDI-1953] Fix NPE due to not

[jira] [Updated] (HUDI-1548) Fix documentation around schema evolution

[ https://issues.apache.org/jira/browse/HUDI-1548?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Nishith Agarwal updated HUDI-1548: -- Labels: sev:high user-support-issues (was: user-support-issues) > Fix documentation around

[GitHub] [hudi] n3nash commented on issue #2409: [SUPPORT] Spark structured Streaming writes to Hudi and synchronizes Hive to create only read-optimized tables without creating real-time tables

n3nash commented on issue #2409: URL: https://github.com/apache/hudi/issues/2409#issuecomment-853602852 Closing this ticket due to inactivity. @wosow Please feel free to re-open if you need more information. -- This is an automated message from the Apache Git Service. To respond to the

[GitHub] [hudi] xdingou commented on issue #143: Tracking ticket for folks to be added to slack group

xdingou commented on issue #143: URL: https://github.com/apache/hudi/issues/143#issuecomment-853606643 Please add me to slack group Email: dinesh.go...@gmail.com Thanks -- This is an automated message from the Apache Git Service. To respond to the message, please log on to

[GitHub] [hudi] codecov-commenter edited a comment on pull request #3024: [HUDI-1924] Add BootstrapFunction to support index bootstrap

codecov-commenter edited a comment on pull request #3024: URL: https://github.com/apache/hudi/pull/3024#issuecomment-852820330 #

[jira] [Created] (HUDI-1957) Flink hive synchronization related functions lack jetty dependency.

Zheng yunhong created HUDI-1957: --- Summary: Flink hive synchronization related functions lack jetty dependency. Key: HUDI-1957 URL: https://issues.apache.org/jira/browse/HUDI-1957 Project: Apache Hudi

[GitHub] [hudi] n3nash closed issue #2331: Why does Hudi not support field deletions?

n3nash closed issue #2331: URL: https://github.com/apache/hudi/issues/2331 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact

[GitHub] [hudi] n3nash commented on issue #2331: Why does Hudi not support field deletions?

n3nash commented on issue #2331: URL: https://github.com/apache/hudi/issues/2331#issuecomment-853605219 Closing this ticket, docs will be added as part of the JIRA. @brandon-stanley Feel free to re-open if needed -- This is an automated message from the Apache Git Service. To respond to

[jira] [Commented] (HUDI-1138) Re-implement marker files via timeline server

[ https://issues.apache.org/jira/browse/HUDI-1138?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17356211#comment-17356211 ] Ethan Guo commented on HUDI-1138: - [~nishith29]  echoing Vinoth, we have to rely on timeline server as a

[GitHub] [hudi] swuferhong opened a new pull request #3027: [HUDI-1957] Fix flink timeline service lack jetty dependency.

swuferhong opened a new pull request #3027: URL: https://github.com/apache/hudi/pull/3027 …oblem. ## *Tips* - *Thank you very much for contributing to Apache Hudi.* - *Please review https://hudi.apache.org/contributing.html before opening a pull request.* ## What is the

[jira] [Updated] (HUDI-1957) Flink hive synchronization related functions lack jetty dependency.

[ https://issues.apache.org/jira/browse/HUDI-1957?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated HUDI-1957: - Labels: pull-request-available (was: ) > Flink hive synchronization related functions lack jetty

[GitHub] [hudi] yuzhaojing opened a new pull request #3029: [HUDI-1954] Only reset bucket when flush bucket success

yuzhaojing opened a new pull request #3029: URL: https://github.com/apache/hudi/pull/3029 ## *Tips* - *Thank you very much for contributing to Apache Hudi.* - *Please review https://hudi.apache.org/contributing.html before opening a pull request.* ## What is the purpose of the

[jira] [Created] (HUDI-1958) [Umbrella] Improve documentation

Nishith Agarwal created HUDI-1958: - Summary: [Umbrella] Improve documentation Key: HUDI-1958 URL: https://issues.apache.org/jira/browse/HUDI-1958 Project: Apache Hudi Issue Type: Improvement

[GitHub] [hudi] n3nash commented on issue #1981: [SUPPORT] Huge performance Difference Between Hudi and Regular Parquet in Athena

n3nash commented on issue #1981: URL: https://github.com/apache/hudi/issues/1981#issuecomment-853641371 @umehrot2 gentle reminder on this one -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the

[jira] [Closed] (HUDI-1957) Fix flink timeline service lack jetty dependency

[ https://issues.apache.org/jira/browse/HUDI-1957?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] vinoyang closed HUDI-1957. -- Resolution: Fixed > Fix flink timeline service lack jetty dependency >

[jira] [Commented] (HUDI-1957) Fix flink timeline service lack jetty dependency

[ https://issues.apache.org/jira/browse/HUDI-1957?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17356369#comment-17356369 ] vinoyang commented on HUDI-1957: [~zhengyunhong97] Thanks for your contribution, I have given you Jira

[GitHub] [hudi] codecov-commenter edited a comment on pull request #3024: [HUDI-1924] Add BootstrapFunction to support index bootstrap

codecov-commenter edited a comment on pull request #3024: URL: https://github.com/apache/hudi/pull/3024#issuecomment-852820330 #

[jira] [Created] (HUDI-1960) Add documentation to be able to disable parquet configs

Nishith Agarwal created HUDI-1960: - Summary: Add documentation to be able to disable parquet configs Key: HUDI-1960 URL: https://issues.apache.org/jira/browse/HUDI-1960 Project: Apache Hudi

[GitHub] [hudi] n3nash closed issue #2066: [SUPPORT] Hudi is increasing the storage size big time

n3nash closed issue #2066: URL: https://github.com/apache/hudi/issues/2066 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact

[GitHub] [hudi] n3nash closed issue #1957: [SUPPORT] Small Table Upsert sometimes take a lot of time

n3nash closed issue #1957: URL: https://github.com/apache/hudi/issues/1957 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact

[jira] [Updated] (HUDI-1954) StreamWriterFunction only reset when flush success

[ https://issues.apache.org/jira/browse/HUDI-1954?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated HUDI-1954: - Labels: pull-request-available (was: ) > StreamWriterFunction only reset when flush success >

[hudi] branch master updated: [HUDI-1957] Fix flink timeline service lack jetty dependency (#3028)

This is an automated email from the ASF dual-hosted git repository. vinoyang pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/hudi.git The following commit(s) were added to refs/heads/master by this push: new ad72691 [HUDI-1957] Fix flink timeline service

[jira] [Updated] (HUDI-1929) Support configure KeyGenerator by type

[ https://issues.apache.org/jira/browse/HUDI-1929?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xianghu Wang updated HUDI-1929: --- Summary: Support configure KeyGenerator by type (was: Make HoodieDeltaStreamer support configure

[GitHub] [hudi] yanghua merged pull request #3028: [HUDI-1957] Fix flink timeline service lack jetty dependency

yanghua merged pull request #3028: URL: https://github.com/apache/hudi/pull/3028 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please

[GitHub] [hudi] yanghua merged pull request #3020: [MINOR] Remove the implementation of Serializable from HoodieException

yanghua merged pull request #3020: URL: https://github.com/apache/hudi/pull/3020 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please

[hudi] branch master updated: [MINOR] Remove the implementation of Serializable from HoodieException (#3020)

This is an automated email from the ASF dual-hosted git repository. vinoyang pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/hudi.git The following commit(s) were added to refs/heads/master by this push: new f6eee77 [MINOR] Remove the implementation of

[GitHub] [hudi] codecov-commenter edited a comment on pull request #3024: [HUDI-1924] Add BootstrapFunction to support index bootstrap

codecov-commenter edited a comment on pull request #3024: URL: https://github.com/apache/hudi/pull/3024#issuecomment-852820330 #

[jira] [Updated] (HUDI-1957) Fix flink timeline service lack jetty dependency

[ https://issues.apache.org/jira/browse/HUDI-1957?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zheng yunhong updated HUDI-1957: Summary: Fix flink timeline service lack jetty dependency (was: Flink hive synchronization related

[GitHub] [hudi] swuferhong opened a new pull request #3028: [HUDI-1957] Fix flink timeline service lack jetty dependency

swuferhong opened a new pull request #3028: URL: https://github.com/apache/hudi/pull/3028 ## *Tips* - *Thank you very much for contributing to Apache Hudi.* - *Please review https://hudi.apache.org/contributing.html before opening a pull request.* ## What is the purpose of the

[GitHub] [hudi] codecov-commenter edited a comment on pull request #3028: [HUDI-1957] Fix flink timeline service lack jetty dependency

codecov-commenter edited a comment on pull request #3028: URL: https://github.com/apache/hudi/pull/3028#issuecomment-853696055 #

[GitHub] [hudi] liijiankang closed issue #2723: [SUPPORT]RejectedExecutionException FutureTask rejected from ThreadPoolExecutor[Terminated...]

liijiankang closed issue #2723: URL: https://github.com/apache/hudi/issues/2723 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please

[GitHub] [hudi] danny0405 commented on a change in pull request #3024: [HUDI-1924] Add BootstrapFunction to support index bootstrap

danny0405 commented on a change in pull request #3024: URL: https://github.com/apache/hudi/pull/3024#discussion_r644521244 ## File path: hudi-flink/src/main/java/org/apache/hudi/sink/bootstrap/aggregate/BootstrapOutput.java ## @@ -0,0 +1,36 @@ +/* + * Licensed to the Apache

[GitHub] [hudi] n3nash closed issue #2135: [SUPPORT] GDPR safe deletes is complex

n3nash closed issue #2135: URL: https://github.com/apache/hudi/issues/2135 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact

[GitHub] [hudi] codecov-commenter commented on pull request #3029: [HUDI-1954] Only reset bucket when flush bucket success

codecov-commenter commented on pull request #3029: URL: https://github.com/apache/hudi/pull/3029#issuecomment-853731624 # [Codecov](https://codecov.io/gh/apache/hudi/pull/3029?src=pr=h1_medium=referral_source=github_content=comment_campaign=pr+comments_term=The+Apache+Software+Foundation)

[GitHub] [hudi] swuferhong closed pull request #3027: [HUDI-1957] Fix flink timeline service lack jetty dependency.

swuferhong closed pull request #3027: URL: https://github.com/apache/hudi/pull/3027 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service,

[GitHub] [hudi] codecov-commenter edited a comment on pull request #3028: [HUDI-1957] Fix flink timeline service lack jetty dependency

codecov-commenter edited a comment on pull request #3028: URL: https://github.com/apache/hudi/pull/3028#issuecomment-853696055 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific

[jira] [Assigned] (HUDI-1957) Fix flink timeline service lack jetty dependency

[ https://issues.apache.org/jira/browse/HUDI-1957?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] vinoyang reassigned HUDI-1957: -- Assignee: Zheng yunhong > Fix flink timeline service lack jetty dependency >

[jira] [Created] (HUDI-1959) Add links to small file handling and clustering to the config section

Nishith Agarwal created HUDI-1959: - Summary: Add links to small file handling and clustering to the config section Key: HUDI-1959 URL: https://issues.apache.org/jira/browse/HUDI-1959 Project: Apache

[GitHub] [hudi] codecov-commenter edited a comment on pull request #3028: [HUDI-1957] Fix flink timeline service lack jetty dependency

codecov-commenter edited a comment on pull request #3028: URL: https://github.com/apache/hudi/pull/3028#issuecomment-853696055 #

[GitHub] [hudi] codecov-commenter edited a comment on pull request #3024: [HUDI-1924] Add BootstrapFunction to support index bootstrap

codecov-commenter edited a comment on pull request #3024: URL: https://github.com/apache/hudi/pull/3024#issuecomment-852820330 #

[GitHub] [hudi] codecov-commenter edited a comment on pull request #3024: [HUDI-1924] Add BootstrapFunction to support index bootstrap

codecov-commenter edited a comment on pull request #3024: URL: https://github.com/apache/hudi/pull/3024#issuecomment-852820330 #

[jira] [Commented] (HUDI-1957) Fix flink timeline service lack jetty dependency

[ https://issues.apache.org/jira/browse/HUDI-1957?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17356355#comment-17356355 ] vinoyang commented on HUDI-1957: ad72691d24443bab1b3828bf435b3f8404ea9dab > Fix flink timeline service

[GitHub] [hudi] codecov-commenter commented on pull request #3031: [MINOR] Remove unused method in DataSourceUtils

codecov-commenter commented on pull request #3031: URL: https://github.com/apache/hudi/pull/3031#issuecomment-853873382 # [Codecov](https://codecov.io/gh/apache/hudi/pull/3031?src=pr=h1_medium=referral_source=github_content=comment_campaign=pr+comments_term=The+Apache+Software+Foundation)

[GitHub] [hudi] pratyakshsharma commented on pull request #2967: Added blog for Hudi cleaner service

pratyakshsharma commented on pull request #2967: URL: https://github.com/apache/hudi/pull/2967#issuecomment-853878207 https://user-images.githubusercontent.com/30863489/120653442-4c5d6c80-c49e-11eb-8881-30366627206b.png;>

[jira] [Created] (HUDI-1962) Add a blog/docs for shuffle paralelism

Nishith Agarwal created HUDI-1962: - Summary: Add a blog/docs for shuffle paralelism Key: HUDI-1962 URL: https://issues.apache.org/jira/browse/HUDI-1962 Project: Apache Hudi Issue Type:

[jira] [Created] (HUDI-1961) Add a debezium json integration test case for flink

Danny Chen created HUDI-1961: Summary: Add a debezium json integration test case for flink Key: HUDI-1961 URL: https://issues.apache.org/jira/browse/HUDI-1961 Project: Apache Hudi Issue Type:

[GitHub] [hudi] wangxianghu opened a new pull request #3031: [MINOR] Remove unused method in DataSourceUtils

wangxianghu opened a new pull request #3031: URL: https://github.com/apache/hudi/pull/3031 ## *Tips* - *Thank you very much for contributing to Apache Hudi.* - *Please review https://hudi.apache.org/contributing.html before opening a pull request.* ## What is the purpose of

[GitHub] [hudi] wangxianghu commented on a change in pull request #2993: [HUDI-1929] Support configure KeyGenerator by type

wangxianghu commented on a change in pull request #2993: URL: https://github.com/apache/hudi/pull/2993#discussion_r644780371 ## File path: hudi-client/hudi-spark-client/src/main/java/org/apache/hudi/keygen/factory/HoodieSparkKeyGeneratorFactory.java ## @@ -0,0 +1,82 @@ +/* +

[GitHub] [hudi] nsivabalan edited a comment on pull request #2438: [HUDI-1447] DeltaStreamer kafka source supports consuming from specified timestamp

nsivabalan edited a comment on pull request #2438: URL: https://github.com/apache/hudi/pull/2438#issuecomment-853866564 good point. Tell me if my understanding is right in general wrt usage of timestamp based checkpointing. user would like to use timestamp based checkpointing in

[GitHub] [hudi] wangxianghu commented on a change in pull request #2993: [HUDI-1929] Support configure KeyGenerator by type

wangxianghu commented on a change in pull request #2993: URL: https://github.com/apache/hudi/pull/2993#discussion_r644777231 ## File path: hudi-client/hudi-client-common/src/main/java/org/apache/hudi/keygen/factory/HoodieAvroKeyGeneratorFactory.java ## @@ -0,0 +1,94 @@ +/* +

[GitHub] [hudi] codecov-commenter edited a comment on pull request #3030: [HUDI-1961] Add a debezium json integration test case for flink

codecov-commenter edited a comment on pull request #3030: URL: https://github.com/apache/hudi/pull/3030#issuecomment-853883816 #

[GitHub] [hudi] danny0405 commented on pull request #3025: [HUDI-1955]Fix the filter condition is missing in the judgment condition of comp…

danny0405 commented on pull request #3025: URL: https://github.com/apache/hudi/pull/3025#issuecomment-853627636 Hi, @vinothchandar , can you take a look for this small fix, i'm confident that this may be a bug here ~ -- This is an automated message from the Apache Git Service. To

[GitHub] [hudi] djKooks edited a comment on issue #160: Failure to find org.pentaho:pentaho-aggdesigner-algorithm:jar:5.1.5-jhyde

djKooks edited a comment on issue #160: URL: https://github.com/apache/hudi/issues/160#issuecomment-853671434 Also facing with this issue...is there any solution? (it was working well about 2 weeks ago...) -- This is an automated message from the Apache Git Service. To respond to the

[GitHub] [hudi] djKooks commented on issue #160: Failure to find org.pentaho:pentaho-aggdesigner-algorithm:jar:5.1.5-jhyde

djKooks commented on issue #160: URL: https://github.com/apache/hudi/issues/160#issuecomment-853671434 Also facing with this issue...is there any solution? -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL

[GitHub] [hudi] codecov-commenter commented on pull request #3028: [HUDI-1957] Fix flink timeline service lack jetty dependency

codecov-commenter commented on pull request #3028: URL: https://github.com/apache/hudi/pull/3028#issuecomment-853696055 # [Codecov](https://codecov.io/gh/apache/hudi/pull/3028?src=pr=h1_medium=referral_source=github_content=comment_campaign=pr+comments_term=The+Apache+Software+Foundation)

[GitHub] [hudi] codecov-commenter edited a comment on pull request #3024: [HUDI-1924] Add BootstrapFunction to support index bootstrap

codecov-commenter edited a comment on pull request #3024: URL: https://github.com/apache/hudi/pull/3024#issuecomment-852820330 #

[GitHub] [hudi] hk-lrzy commented on a change in pull request #3024: [HUDI-1924] Add BootstrapFunction to support index bootstrap

hk-lrzy commented on a change in pull request #3024: URL: https://github.com/apache/hudi/pull/3024#discussion_r644650661 ## File path: hudi-flink/src/main/java/org/apache/hudi/sink/partitioner/BucketAssignFunction.java ## @@ -168,31 +150,28 @@ public void

[GitHub] [hudi] codecov-commenter edited a comment on pull request #3029: [HUDI-1954] Only reset bucket when flush bucket success

codecov-commenter edited a comment on pull request #3029: URL: https://github.com/apache/hudi/pull/3029#issuecomment-853731624 #

[GitHub] [hudi] codecov-commenter edited a comment on pull request #2993: [HUDI-1929] Support configure KeyGenerator by type

codecov-commenter edited a comment on pull request #2993: URL: https://github.com/apache/hudi/pull/2993#issuecomment-848384059 #

[GitHub] [hudi] wangxianghu commented on a change in pull request #2993: [HUDI-1929] Support configure KeyGenerator by type

wangxianghu commented on a change in pull request #2993: URL: https://github.com/apache/hudi/pull/2993#discussion_r644777231 ## File path: hudi-client/hudi-client-common/src/main/java/org/apache/hudi/keygen/factory/HoodieAvroKeyGeneratorFactory.java ## @@ -0,0 +1,94 @@ +/* +

[GitHub] [hudi] codecov-commenter commented on pull request #3030: [HUDI-1961] Add a debezium json integration test case for flink

codecov-commenter commented on pull request #3030: URL: https://github.com/apache/hudi/pull/3030#issuecomment-853883816 # [Codecov](https://codecov.io/gh/apache/hudi/pull/3030?src=pr=h1_medium=referral_source=github_content=comment_campaign=pr+comments_term=The+Apache+Software+Foundation)

[GitHub] [hudi] codecov-commenter edited a comment on pull request #3031: [MINOR] Remove unused method in DataSourceUtils

codecov-commenter edited a comment on pull request #3031: URL: https://github.com/apache/hudi/pull/3031#issuecomment-853873382 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific

[GitHub] [hudi] codecov-commenter edited a comment on pull request #3030: [HUDI-1961] Add a debezium json integration test case for flink

codecov-commenter edited a comment on pull request #3030: URL: https://github.com/apache/hudi/pull/3030#issuecomment-853883816 #

[GitHub] [hudi] wangxianghu commented on a change in pull request #2993: [HUDI-1929] Support configure KeyGenerator by type

wangxianghu commented on a change in pull request #2993: URL: https://github.com/apache/hudi/pull/2993#discussion_r644780371 ## File path: hudi-client/hudi-spark-client/src/main/java/org/apache/hudi/keygen/factory/HoodieSparkKeyGeneratorFactory.java ## @@ -0,0 +1,82 @@ +/* +

[GitHub] [hudi] codecov-commenter edited a comment on pull request #3030: [HUDI-1961] Add a debezium json integration test case for flink

codecov-commenter edited a comment on pull request #3030: URL: https://github.com/apache/hudi/pull/3030#issuecomment-853883816 #

[GitHub] [hudi] n3nash commented on issue #2919: [SUPPORT] Schema Evolution Failing Spark+Hudi- Adding New fields

n3nash commented on issue #2919: URL: https://github.com/apache/hudi/issues/2919#issuecomment-853958300 @tandonraghav Hive-Sync tool will register the schema in the glue catalog. This process is not new. -- This is an automated message from the Apache Git Service. To respond to the

[GitHub] [hudi] wangxianghu commented on pull request #2993: [HUDI-1929] Support configure KeyGenerator by type

wangxianghu commented on pull request #2993: URL: https://github.com/apache/hudi/pull/2993#issuecomment-853841430 hi @nsivabalan, I have addressed all your concerns, please take a look when free -- This is an automated message from the Apache Git Service. To respond to the message,

[jira] [Updated] (HUDI-1961) Add a debezium json integration test case for flink

[ https://issues.apache.org/jira/browse/HUDI-1961?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated HUDI-1961: - Labels: pull-request-available (was: ) > Add a debezium json integration test case for flink >

[GitHub] [hudi] danny0405 opened a new pull request #3030: [HUDI-1961] Add a debezium json integration test case for flink

danny0405 opened a new pull request #3030: URL: https://github.com/apache/hudi/pull/3030 ## *Tips* - *Thank you very much for contributing to Apache Hudi.* - *Please review https://hudi.apache.org/contributing.html before opening a pull request.* ## What is the purpose of the

[GitHub] [hudi] pratyakshsharma commented on a change in pull request #2967: Added blog for Hudi cleaner service

pratyakshsharma commented on a change in pull request #2967: URL: https://github.com/apache/hudi/pull/2967#discussion_r644803395 ## File path: docs/_posts/2021-05-28-employing-right-configurations-for-hudi-cleaner.md ## @@ -0,0 +1,106 @@ +--- +title: "Employing correct

[GitHub] [hudi] codecov-commenter edited a comment on pull request #2993: [HUDI-1929] Support configure KeyGenerator by type

codecov-commenter edited a comment on pull request #2993: URL: https://github.com/apache/hudi/pull/2993#issuecomment-848384059 #

[GitHub] [hudi] codecov-commenter edited a comment on pull request #2993: [HUDI-1929] Support configure KeyGenerator by type

codecov-commenter edited a comment on pull request #2993: URL: https://github.com/apache/hudi/pull/2993#issuecomment-848384059 #

[GitHub] [hudi] vinothchandar merged pull request #3031: [MINOR] Remove unused method in DataSourceUtils

vinothchandar merged pull request #3031: URL: https://github.com/apache/hudi/pull/3031 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service,

[hudi] branch master updated (f6eee77 -> 870e97b)

This is an automated email from the ASF dual-hosted git repository. vinoth pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/hudi.git. from f6eee77 [MINOR] Remove the implementation of Serializable from HoodieException (#3020) add 870e97b [MINOR]

[GitHub] [hudi] n3nash closed issue #2482: [SUPPORT]

n3nash closed issue #2482: URL: https://github.com/apache/hudi/issues/2482 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact

[GitHub] [hudi] n3nash commented on issue #1679: [HUDI-1609] How to disable Hive JDBC and enable metastore

n3nash commented on issue #1679: URL: https://github.com/apache/hudi/issues/1679#issuecomment-854078777 @diogodilcl Are you able to reproduce this issue consistently ? Could you provide some ways to reproduce it so we can find a resolution. -- This is an automated message from the

[GitHub] [hudi] pratyakshsharma commented on a change in pull request #3010: Improving Hudi CLI tool docs

pratyakshsharma commented on a change in pull request #3010: URL: https://github.com/apache/hudi/pull/3010#discussion_r644755482 ## File path: docs/_docs/2_6_deployment.md ## @@ -225,41 +238,128 @@ hudi:trips->connect --path /app/uber/trips Metadata for table trips loaded

[GitHub] [hudi] pratyakshsharma commented on a change in pull request #3010: Improving Hudi CLI tool docs

pratyakshsharma commented on a change in pull request #3010: URL: https://github.com/apache/hudi/pull/3010#discussion_r644754962 ## File path: docs/_docs/2_6_deployment.md ## @@ -225,41 +238,128 @@ hudi:trips->connect --path /app/uber/trips Metadata for table trips loaded

[GitHub] [hudi] nsivabalan commented on a change in pull request #2993: [HUDI-1929] Support configure KeyGenerator by type

nsivabalan commented on a change in pull request #2993: URL: https://github.com/apache/hudi/pull/2993#discussion_r644769428 ## File path: hudi-client/hudi-client-common/src/main/java/org/apache/hudi/keygen/factory/HoodieAvroKeyGeneratorFactory.java ## @@ -0,0 +1,94 @@ +/* + *

[GitHub] [hudi] wangxianghu commented on a change in pull request #2993: [HUDI-1929] Support configure KeyGenerator by type

wangxianghu commented on a change in pull request #2993: URL: https://github.com/apache/hudi/pull/2993#discussion_r644780371 ## File path: hudi-client/hudi-spark-client/src/main/java/org/apache/hudi/keygen/factory/HoodieSparkKeyGeneratorFactory.java ## @@ -0,0 +1,82 @@ +/* +

[GitHub] [hudi] wangxianghu commented on a change in pull request #2993: [HUDI-1929] Support configure KeyGenerator by type

wangxianghu commented on a change in pull request #2993: URL: https://github.com/apache/hudi/pull/2993#discussion_r644783012 ## File path: hudi-client/hudi-client-common/src/main/java/org/apache/hudi/keygen/factory/HoodieAvroKeyGeneratorFactory.java ## @@ -0,0 +1,94 @@ +/* +

[GitHub] [hudi] nsivabalan commented on pull request #2438: [HUDI-1447] DeltaStreamer kafka source supports consuming from specified timestamp

nsivabalan commented on pull request #2438: URL: https://github.com/apache/hudi/pull/2438#issuecomment-853866564 good point. Tell me if my understanding is right in general wrt usage of timestamp based checkpointing. user would like to use timestamp based checkpointing in

[GitHub] [hudi] wangxianghu commented on a change in pull request #2993: [HUDI-1929] Support configure KeyGenerator by type

wangxianghu commented on a change in pull request #2993: URL: https://github.com/apache/hudi/pull/2993#discussion_r644780371 ## File path: hudi-client/hudi-spark-client/src/main/java/org/apache/hudi/keygen/factory/HoodieSparkKeyGeneratorFactory.java ## @@ -0,0 +1,82 @@ +/* +

[GitHub] [hudi] danny0405 closed pull request #3030: [HUDI-1961] Add a debezium json integration test case for flink

danny0405 closed pull request #3030: URL: https://github.com/apache/hudi/pull/3030 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please

[GitHub] [hudi] satishkotha commented on a change in pull request #2542: [WIP] Global consistency

satishkotha commented on a change in pull request #2542: URL: https://github.com/apache/hudi/pull/2542#discussion_r645062426 ## File path: hudi-sync/hudi-hive-sync/src/main/java/org/apache/hudi/hive/HoodieHiveClient.java ## @@ -410,7 +421,20 @@ public void

[jira] [Updated] (HUDI-1839) FSUtils getAllPartitions broken by NotSerializableException: org.apache.hadoop.fs.Path

[ https://issues.apache.org/jira/browse/HUDI-1839?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] satish updated HUDI-1839: - Description: FSUtils getAllPartitionPaths is expected to work if metadata table is enabled or not. It can also

[GitHub] [hudi] vinothchandar commented on issue #160: Failure to find org.pentaho:pentaho-aggdesigner-algorithm:jar:5.1.5-jhyde

vinothchandar commented on issue #160: URL: https://github.com/apache/hudi/issues/160#issuecomment-854181782 reopening this. @n3nash could you please try and repro this? If the jar is already cached in local .m2, it won't repro. So we need to manually delete that or force update/fetch.

[GitHub] [hudi] ajaychitre opened a new issue #160: Failure to find org.pentaho:pentaho-aggdesigner-algorithm:jar:5.1.5-jhyde

ajaychitre opened a new issue #160: URL: https://github.com/apache/hudi/issues/160 Got latest code from master branch. Was getting error message given below: Failure to find org.pentaho:pentaho-aggdesigner-algorithm:jar:5.1.5-jhyde in

[GitHub] [hudi] arun990 edited a comment on issue #160: Failure to find org.pentaho:pentaho-aggdesigner-algorithm:jar:5.1.5-jhyde

arun990 edited a comment on issue #160: URL: https://github.com/apache/hudi/issues/160#issuecomment-851299700 Hi, is this issue resolved. Even after cloning the https://github.com/vinothchandar/hudi/tree/remove-spring-deps adn attemp to mvn build, getting the same error. Please

[jira] [Created] (HUDI-1964) Add a blog around hive metastore and hive sync for hudi tables

Nishith Agarwal created HUDI-1964: - Summary: Add a blog around hive metastore and hive sync for hudi tables Key: HUDI-1964 URL: https://issues.apache.org/jira/browse/HUDI-1964 Project: Apache Hudi

[GitHub] [hudi] codecov-commenter edited a comment on pull request #2993: [HUDI-1929] Support configure KeyGenerator by type

codecov-commenter edited a comment on pull request #2993: URL: https://github.com/apache/hudi/pull/2993#issuecomment-848384059 #

[jira] [Created] (HUDI-1965) Add a FAQ around upgrading Hudi version in EMR cluster

Nishith Agarwal created HUDI-1965: - Summary: Add a FAQ around upgrading Hudi version in EMR cluster Key: HUDI-1965 URL: https://issues.apache.org/jira/browse/HUDI-1965 Project: Apache Hudi

[GitHub] [hudi] yuzhaojing commented on a change in pull request #3029: [HUDI-1954] Only reset bucket when flush bucket success

yuzhaojing commented on a change in pull request #3029: URL: https://github.com/apache/hudi/pull/3029#discussion_r645243751 ## File path: hudi-flink/src/main/java/org/apache/hudi/sink/StreamWriteFunction.java ## @@ -470,30 +470,36 @@ private void bufferRecord(HoodieRecord

[jira] [Updated] (HUDI-1965) Add a FAQ around upgrading Hudi version in EMR cluster

[ https://issues.apache.org/jira/browse/HUDI-1965?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Nishith Agarwal updated HUDI-1965: -- https://github.com/apache/hudi/issues/2529 > Add a FAQ around upgrading Hudi version in EMR

[GitHub] [hudi] n3nash commented on issue #2537: [SUPPORT] delta streamer sql transformer does not work for my kafka data

n3nash commented on issue #2537: URL: https://github.com/apache/hudi/issues/2537#issuecomment-854307353 Closing this issue due to no activity. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to

[GitHub] [hudi] n3nash closed issue #2537: [SUPPORT] delta streamer sql transformer does not work for my kafka data

n3nash closed issue #2537: URL: https://github.com/apache/hudi/issues/2537 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact

[jira] [Commented] (HUDI-1964) Add a blog around hive metastore and hive sync for hudi tables

[ https://issues.apache.org/jira/browse/HUDI-1964?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17357022#comment-17357022 ] Nishith Agarwal commented on HUDI-1964: --- https://github.com/apache/hudi/issues/2544 > Add a blog

  1   2   >