[GitHub] [hudi] YannByron commented on issue #3670: [SUPPORT] SQL stmt managed table, not update/delete with datasource API

YannByron commented on issue #3670: URL: https://github.com/apache/hudi/issues/3670#issuecomment-926364363 @parisni if that specify `hoodie.datasource.write.keygenerator.class` to `org.apache.hudi.keygen.ComplexKeyGenerator` works, maybe it's same with this:

[GitHub] [hudi] hudi-bot edited a comment on pull request #3590: [HUDI-2285][HUDI-2476] Metadata table synchronous design. Rebased and Squashed from pull/3426

hudi-bot edited a comment on pull request #3590: URL: https://github.com/apache/hudi/pull/3590#issuecomment-912237120 ## CI report: * aefac7ec2f2e40bdf3ad4365ea6aa825803a439d UNKNOWN * 13b80067ae00a760c57d184f70e2d98f63027e80 Azure:

[GitHub] [hudi] leesf merged pull request #3578: [HUDI-2385] Make parquet dictionary encoding configurable

leesf merged pull request #3578: URL: https://github.com/apache/hudi/pull/3578 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail:

[hudi] branch master updated (f52cb32 -> 06c2cc2)

This is an automated email from the ASF dual-hosted git repository. leesf pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/hudi.git. from f52cb32 [HUDI-2248] Fixing the closing of hms client (#3364) add 06c2cc2 [HUDI-2385] Make parquet dictionary

[GitHub] [hudi] hudi-bot edited a comment on pull request #3666: [HUDI-2435][BUG]Fix clustering handle errors

hudi-bot edited a comment on pull request #3666: URL: https://github.com/apache/hudi/pull/3666#issuecomment-919801616 ## CI report: * 3c644ce10e79d7ada8e04ef8227e12ad4a1d7e7e Azure:

[GitHub] [hudi] xushiyan commented on issue #3392: [SUPPORT] Compile hudi master with hive version 2.1.1 error

xushiyan commented on issue #3392: URL: https://github.com/apache/hudi/issues/3392#issuecomment-926354023 > You only need to package the flink bundle jar with hive 2.1.1, there is no need to package the mr-bundle first. @springMoon Did you get this resolved by the suggestion? Please

[GitHub] [hudi] xushiyan closed issue #3323: [SUPPORT] Trouble with Point in time, Incremental queries

xushiyan closed issue #3323: URL: https://github.com/apache/hudi/issues/3323 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail:

[GitHub] [hudi] Samrat002 commented on issue #661: Tracking ticket for reporting Hudi usages from the community

Samrat002 commented on issue #661: URL: https://github.com/apache/hudi/issues/661#issuecomment-926344915 At Hotstar (OTT platform in India), we are in progress of migrating to Hudi in production , There are multiple parallel jobs running in shallow mode in production, validating data.

[GitHub] [hudi] hudi-bot edited a comment on pull request #3666: [HUDI-2435][BUG]Fix clustering handle errors

hudi-bot edited a comment on pull request #3666: URL: https://github.com/apache/hudi/pull/3666#issuecomment-919801616 ## CI report: * 91c8a9be88ffcfd2e52e6c45f9cc525b0c58a930 Azure:

[GitHub] [hudi] xushiyan closed issue #3629: [SUPPORT] Branch and tag with same name which makes fetching branch is diffcult

xushiyan closed issue #3629: URL: https://github.com/apache/hudi/issues/3629 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail:

[GitHub] [hudi] xushiyan commented on issue #3629: [SUPPORT] Branch and tag with same name which makes fetching branch is diffcult

xushiyan commented on issue #3629: URL: https://github.com/apache/hudi/issues/3629#issuecomment-926336678 @PengleiShi I don't see this as a big issue. You can always check out the branch using a different local branch name? same for tags. Please kindly start a [DISCUSS] thread to the dev

[GitHub] [hudi] vinothchandar commented on issue #3629: [SUPPORT] Branch and tag with same name which makes fetching branch is diffcult

vinothchandar commented on issue #3629: URL: https://github.com/apache/hudi/issues/3629#issuecomment-926334335 This probably needs to be a dev list conversation? -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the

[GitHub] [hudi] vinothchandar commented on issue #3607: [SUPPORT]Presto query hudi data with metadata table enable un-successfully.

vinothchandar commented on issue #3607: URL: https://github.com/apache/hudi/issues/3607#issuecomment-926334058 There is a PR out for a long time now in fact. Not Merged yet -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub

[GitHub] [hudi] vinothchandar commented on issue #3603: [SUPPORT] delta streamer Failed to archive commits

vinothchandar commented on issue #3603: URL: https://github.com/apache/hudi/issues/3603#issuecomment-926332955 @fengjian428 any updates ? -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the

[GitHub] [hudi] xushiyan closed issue #3635: [SUPPORT] java.lang.NoSuchMethodError while launching Spark 2.3.1 in stand alone cluster mode.

xushiyan closed issue #3635: URL: https://github.com/apache/hudi/issues/3635 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail:

[GitHub] [hudi] xushiyan commented on issue #3635: [SUPPORT] java.lang.NoSuchMethodError while launching Spark 2.3.1 in stand alone cluster mode.

xushiyan commented on issue #3635: URL: https://github.com/apache/hudi/issues/3635#issuecomment-926332253 @deshpandeanoop noticed that you used a different version `"spark-avro" % "2.4.4"` rather than your main spark version 2.3.1 A more important matter: it has been discussed long

[GitHub] [hudi] vinothchandar commented on issue #3530: Unable to query Hudi table using Presto Cli

vinothchandar commented on issue #3530: URL: https://github.com/apache/hudi/issues/3530#issuecomment-926330990 @Ayan07 I Can explain why its working for lower version@though. The issue seems to happen only when instantiating from the path filter. This code along with the Compile

[GitHub] [hudi] vinothchandar commented on issue #3530: Unable to query Hudi table using Presto Cli

vinothchandar commented on issue #3530: URL: https://github.com/apache/hudi/issues/3530#issuecomment-926330082 @codope did you get a chance to reproduce this. I'd be surprised about why this could be failing. iiuc You have been testing on later Versions of presto using the compile time

[GitHub] [hudi] vinothchandar closed issue #3500: [SUPPORT]Order changed while using sanpshot query

vinothchandar closed issue #3500: URL: https://github.com/apache/hudi/issues/3500 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail:

[GitHub] [hudi] xushiyan edited a comment on issue #3641: [SUPPORT] Retrieving latest completed commit timestamp via HoodieTableMetaClient in PySpark

xushiyan edited a comment on issue #3641: URL: https://github.com/apache/hudi/issues/3641#issuecomment-926325168 > Is this approach valid? If not, what alternative do you suggest? As commented above, I think the commit callback is a better approach > Do the Hudi classes and

[GitHub] [hudi] xushiyan commented on issue #3641: [SUPPORT] Retrieving latest completed commit timestamp via HoodieTableMetaClient in PySpark

xushiyan commented on issue #3641: URL: https://github.com/apache/hudi/issues/3641#issuecomment-926325168 > Is this approach valid? If not, what alternative do you suggest? As commented above, I think the commit callback is a better approach > Do the Hudi classes and methods I use

[GitHub] [hudi] xushiyan commented on issue #3641: [SUPPORT] Retrieving latest completed commit timestamp via HoodieTableMetaClient in PySpark

xushiyan commented on issue #3641: URL: https://github.com/apache/hudi/issues/3641#issuecomment-926323464 @bryanburke also noticed that you are using S3. please also check out the latest feature https://hudi.apache.org/blog/2021/08/23/s3-events-source might be relevant to your pipeline

[GitHub] [hudi] xushiyan commented on issue #3641: [SUPPORT] Retrieving latest completed commit timestamp via HoodieTableMetaClient in PySpark

xushiyan commented on issue #3641: URL: https://github.com/apache/hudi/issues/3641#issuecomment-926322751 > The overall idea is to save the timestamp of the latest completed commit on the source Hudi table as a bookmark @bryanburke Please check out

[GitHub] [hudi] vinothchandar commented on issue #3670: [SUPPORT] SQL stmt managed table, not update/delete with datasource API

vinothchandar commented on issue #3670: URL: https://github.com/apache/hudi/issues/3670#issuecomment-926321403 Cc @pengzhiwei2018 can you please comment on this. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the

[GitHub] [hudi] hudi-bot edited a comment on pull request #3666: [HUDI-2435][BUG]Fix clustering handle errors

hudi-bot edited a comment on pull request #3666: URL: https://github.com/apache/hudi/pull/3666#issuecomment-919801616 ## CI report: * 91c8a9be88ffcfd2e52e6c45f9cc525b0c58a930 Azure:

[GitHub] [hudi] hudi-bot edited a comment on pull request #3666: [HUDI-2435][BUG]Fix clustering handle errors

hudi-bot edited a comment on pull request #3666: URL: https://github.com/apache/hudi/pull/3666#issuecomment-919801616 ## CI report: * a28e73a2afbf7d793f4468df1b3e8f4a20516155 Azure:

[GitHub] [hudi] nsivabalan commented on issue #3313: [SUPPORT] CoW: Hudi Upsert not working when there is a timestamp field in the composite key

nsivabalan commented on issue #3313: URL: https://github.com/apache/hudi/issues/3313#issuecomment-926318350 @vinothchandar : I wanna repro myself before we can close this out. Author claims that w/ composite keys, we have some issues w/ timestamp based partition path when row writer is

[GitHub] [hudi] hudi-bot edited a comment on pull request #3710: [HUDI-2485] Remove the uuid of flink streaming source operators

hudi-bot edited a comment on pull request #3710: URL: https://github.com/apache/hudi/pull/3710#issuecomment-926303340 ## CI report: * fde8dd56208ab1377244812af5eb6726431cd65b Azure:

[GitHub] [hudi] hudi-bot edited a comment on pull request #3666: [HUDI-2435][BUG]Fix clustering handle errors

hudi-bot edited a comment on pull request #3666: URL: https://github.com/apache/hudi/pull/3666#issuecomment-919801616 ## CI report: * a28e73a2afbf7d793f4468df1b3e8f4a20516155 Azure:

[GitHub] [hudi] xushiyan commented on issue #3670: [SUPPORT] SQL stmt managed table, not update/delete with datasource API

xushiyan commented on issue #3670: URL: https://github.com/apache/hudi/issues/3670#issuecomment-926317636 @parisni would you provide the details of your experiments? it'd be helpful for us to reproduce the issue and make fixes where needed. -- This is an automated message from the

[jira] [Updated] (HUDI-29) Patch to Hive-sync to enable stats on Hive tables #393

[ https://issues.apache.org/jira/browse/HUDI-29?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Raymond Xu updated HUDI-29: --- Description: [https://github.com/uber/hudi/issues/393]   Similar request 

[jira] [Updated] (HUDI-2485) Flink streaming reader supports mini-batch

[ https://issues.apache.org/jira/browse/HUDI-2485?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Danny Chen updated HUDI-2485: - Summary: Flink streaming reader supports mini-batch (was: Remove the uuid of flink streaming source

[GitHub] [hudi] xushiyan commented on issue #3685: [FEATURE REQUEST] HUDI Add metadata for Presto CBO

xushiyan commented on issue #3685: URL: https://github.com/apache/hudi/issues/3685#issuecomment-926314170 similar improvement was actually proposed and attempted before. https://issues.apache.org/jira/browse/HUDI-29 closing this and moving to the JIRA ticket. @rubenssoto

[GitHub] [hudi] xushiyan closed issue #3685: [FEATURE REQUEST] HUDI Add metadata for Presto CBO

xushiyan closed issue #3685: URL: https://github.com/apache/hudi/issues/3685 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail:

[GitHub] [hudi] xushiyan commented on issue #3707: [SUPPORT] Flink Hudi write on S3 DataStreamSinkProvider error

xushiyan commented on issue #3707: URL: https://github.com/apache/hudi/issues/3707#issuecomment-926307629 @ibudanaev-crunchyroll are you able to print the classpath and have you tried putting the needed jar there? @danny0405 Is flink bundle jar expected to have this dependency? --

[GitHub] [hudi] hudi-bot edited a comment on pull request #3706: [HUDI-2483] Infer changelog mode for flink compactor

hudi-bot edited a comment on pull request #3706: URL: https://github.com/apache/hudi/pull/3706#issuecomment-925635274 ## CI report: * e3315bf1418c5059c9e20b8ae2d1d95a425b5317 UNKNOWN * 5926bcf2aaa00c2f440343f5ce02c080c6dfcf43 Azure:

[GitHub] [hudi] hudi-bot edited a comment on pull request #3710: [HUDI-2485] Remove the uuid of flink streaming source operators

hudi-bot edited a comment on pull request #3710: URL: https://github.com/apache/hudi/pull/3710#issuecomment-926303340 ## CI report: * fde8dd56208ab1377244812af5eb6726431cd65b Azure:

[GitHub] [hudi] hudi-bot edited a comment on pull request #3696: [WIP][HUDI-2439] Refactor commit actions in hudi-client module

hudi-bot edited a comment on pull request #3696: URL: https://github.com/apache/hudi/pull/3696#issuecomment-924126593 ## CI report: * fd009859feea167404987ccb60ee154c2b844c60 Azure:

[GitHub] [hudi] hudi-bot commented on pull request #3710: [HUDI-2485] Remove the uuid of flink streaming source operators

hudi-bot commented on pull request #3710: URL: https://github.com/apache/hudi/pull/3710#issuecomment-926303340 ## CI report: * fde8dd56208ab1377244812af5eb6726431cd65b UNKNOWN Bot commands @hudi-bot supports the following commands: - `@hudi-bot run travis`

[jira] [Updated] (HUDI-2485) Remove the uuid of flink streaming source operators

[ https://issues.apache.org/jira/browse/HUDI-2485?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated HUDI-2485: - Labels: pull-request-available (was: ) > Remove the uuid of flink streaming source operators >

[GitHub] [hudi] danny0405 opened a new pull request #3710: [HUDI-2485] Remove the uuid of flink streaming source operators

danny0405 opened a new pull request #3710: URL: https://github.com/apache/hudi/pull/3710 ## *Tips* - *Thank you very much for contributing to Apache Hudi.* - *Please review https://hudi.apache.org/contribute/how-to-contribute before opening a pull request.* ## What is the

[jira] [Created] (HUDI-2485) Remove the uuid of flink streaming source operators

Danny Chen created HUDI-2485: Summary: Remove the uuid of flink streaming source operators Key: HUDI-2485 URL: https://issues.apache.org/jira/browse/HUDI-2485 Project: Apache Hudi Issue Type:

[GitHub] [hudi] hudi-bot edited a comment on pull request #3687: [HUDI-2451] on windows client with hdfs server for wrong file seperator

hudi-bot edited a comment on pull request #3687: URL: https://github.com/apache/hudi/pull/3687#issuecomment-922231621 ## CI report: * e99345eab2e19026bfb344b5679031127a45ee15 Azure:

[GitHub] [hudi] hudi-bot edited a comment on pull request #3578: [HUDI-2385] Make parquet dictionary encoding configurable

hudi-bot edited a comment on pull request #3578: URL: https://github.com/apache/hudi/pull/3578#issuecomment-909972703 ## CI report: * afe4df51e9c5a66b6c0ecca7948b283e8e713363 Azure:

[GitHub] [hudi] Ambarish-Giri edited a comment on issue #3395: [SUPPORT] Issues with read optimized query MOR table

Ambarish-Giri edited a comment on issue #3395: URL: https://github.com/apache/hudi/issues/3395#issuecomment-926281577 Hi @vinothchandar , For POC purpose I was using Windows where the code was not working directly from IDE where as if packaged and run, it executed. Currently testing on

[GitHub] [hudi] hudi-bot edited a comment on pull request #3706: [HUDI-2483] Infer changelog mode for flink compactor

hudi-bot edited a comment on pull request #3706: URL: https://github.com/apache/hudi/pull/3706#issuecomment-925635274 ## CI report: * e3315bf1418c5059c9e20b8ae2d1d95a425b5317 UNKNOWN * 5926bcf2aaa00c2f440343f5ce02c080c6dfcf43 Azure:

[GitHub] [hudi] danny0405 commented on pull request #3706: [HUDI-2483] Infer changelog mode for flink compactor

danny0405 commented on pull request #3706: URL: https://github.com/apache/hudi/pull/3706#issuecomment-926281711 @hudi-bot run azure -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific

[GitHub] [hudi] Ambarish-Giri commented on issue #3395: [SUPPORT] Issues with read optimized query MOR table

Ambarish-Giri commented on issue #3395: URL: https://github.com/apache/hudi/issues/3395#issuecomment-926281577 Hi @vinothchandar , For POC purpose I was using Windows where the code the not working directly from IDE where as if packaged and run it executed. Currently testing on EMR. --

[GitHub] [hudi] hudi-bot edited a comment on pull request #3696: [WIP][HUDI-2439] Refactor commit actions in hudi-client module

hudi-bot edited a comment on pull request #3696: URL: https://github.com/apache/hudi/pull/3696#issuecomment-924126593 ## CI report: * 6cfc4dfdc0b11718a314559027b5ae5b7a79a9f1 Azure:

[GitHub] [hudi] hudi-bot edited a comment on pull request #3578: [HUDI-2385] Make parquet dictionary encoding configurable

hudi-bot edited a comment on pull request #3578: URL: https://github.com/apache/hudi/pull/3578#issuecomment-909972703 ## CI report: * 179749874c91368727ff2165ec48b5943965f095 Azure:

[GitHub] [hudi] FelixKJose commented on issue #3323: [SUPPORT] Trouble with Point in time, Incremental queries

FelixKJose commented on issue #3323: URL: https://github.com/apache/hudi/issues/3323#issuecomment-926279759 @vinothchandar Yes, I tested and is solved. Thank you so much -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and

[GitHub] [hudi] hudi-bot edited a comment on pull request #3687: [HUDI-2451] on windows client with hdfs server for wrong file seperator

hudi-bot edited a comment on pull request #3687: URL: https://github.com/apache/hudi/pull/3687#issuecomment-922231621 ## CI report: * e99345eab2e19026bfb344b5679031127a45ee15 Azure:

[GitHub] [hudi] hudi-bot edited a comment on pull request #3578: [HUDI-2385] Make parquet dictionary encoding configurable

hudi-bot edited a comment on pull request #3578: URL: https://github.com/apache/hudi/pull/3578#issuecomment-909972703 ## CI report: * 179749874c91368727ff2165ec48b5943965f095 Azure:

[GitHub] [hudi] vinothchandar commented on issue #3533: [SUPPORT]How to use MOR Table to Merge small file?

vinothchandar commented on issue #3533: URL: https://github.com/apache/hudi/issues/3533#issuecomment-926278499 @aresa7796 any more updates for us? -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go

[GitHub] [hudi] leesf commented on pull request #3687: [HUDI-2451] on windows client with hdfs server for wrong file seperator

leesf commented on pull request #3687: URL: https://github.com/apache/hudi/pull/3687#issuecomment-926278188 @hudi-bot run azure -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific

[GitHub] [hudi] vinothchandar commented on issue #3499: [SUPPORT] Inline Clustering fails with Hudi

vinothchandar commented on issue #3499: URL: https://github.com/apache/hudi/issues/3499#issuecomment-926275260 @satishkotha is anything jumping out to you here? -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL

[GitHub] [hudi] vinothchandar commented on issue #3423: [SUPPORT] Table or view not found error in Hoodie Delta Streamer

vinothchandar commented on issue #3423: URL: https://github.com/apache/hudi/issues/3423#issuecomment-926274535 @TamilselvanBalaiah any updates on this? -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above

[GitHub] [hudi] vinothchandar commented on issue #3395: [SUPPORT] Issues with read optimized query MOR table

vinothchandar commented on issue #3395: URL: https://github.com/apache/hudi/issues/3395#issuecomment-926274331 I realized @Ambarish-Giri was asking for windows help. Not sure how we can. I actually don't have access to a machine -- This is an automated message from the Apache Git

[GitHub] [hudi] nsivabalan opened a new issue #3395: [SUPPORT] Issues with read optimized query MOR table

nsivabalan opened a new issue #3395: URL: https://github.com/apache/hudi/issues/3395 **_Tips before filing an issue_** - Have you gone through our [FAQs](https://cwiki.apache.org/confluence/display/HUDI/FAQ)? - Join the mailing list to engage in conversations and get faster

[GitHub] [hudi] vinothchandar commented on issue #3395: [SUPPORT] Issues with read optimized query MOR table

vinothchandar commented on issue #3395: URL: https://github.com/apache/hudi/issues/3395#issuecomment-926273616 Closing! Thanks everyone -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the

[GitHub] [hudi] vinothchandar closed issue #3395: [SUPPORT] Issues with read optimized query MOR table

vinothchandar closed issue #3395: URL: https://github.com/apache/hudi/issues/3395 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail:

[GitHub] [hudi] vinothchandar commented on issue #3394: [SUPPORT] Question on hudi's default behaviour for UPSERT

vinothchandar commented on issue #3394: URL: https://github.com/apache/hudi/issues/3394#issuecomment-926273464 @maddy2u any more updates on this issue ? or can we close this? -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub

[GitHub] [hudi] vinothchandar commented on issue #3344: [SUPPORT]Best way to ingest a large number of tables

vinothchandar commented on issue #3344: URL: https://github.com/apache/hudi/issues/3344#issuecomment-926273191 @ziudu this has come up a few times now. Do you mind sharing what you decided to do? -- This is an automated message from the Apache Git Service. To respond to the message,

[GitHub] [hudi] vinothchandar commented on issue #3324: [SUPPORT]Slow Performance With Spark Structured Streaming

vinothchandar commented on issue #3324: URL: https://github.com/apache/hudi/issues/3324#issuecomment-926272675 I am gathering these issues under perf. and give it a go. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use

[GitHub] [hudi] vinothchandar commented on issue #3323: [SUPPORT] Trouble with Point in time, Incremental queries

vinothchandar commented on issue #3323: URL: https://github.com/apache/hudi/issues/3323#issuecomment-926272319 @FelixKJose this is in 0.9.0. Can we close this? -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL

[GitHub] [hudi] mkk1490 opened a new issue #3313: [SUPPORT] CoW: Hudi Upsert not working when there is a timestamp field in the composite key

mkk1490 opened a new issue #3313: URL: https://github.com/apache/hudi/issues/3313 **_Tips before filing an issue_** - Have you gone through our [FAQs](https://cwiki.apache.org/confluence/display/HUDI/FAQ)? - Join the mailing list to engage in conversations and get faster

[GitHub] [hudi] vinothchandar closed issue #3313: [SUPPORT] CoW: Hudi Upsert not working when there is a timestamp field in the composite key

vinothchandar closed issue #3313: URL: https://github.com/apache/hudi/issues/3313 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail:

[GitHub] [hudi] vinothchandar commented on issue #3313: [SUPPORT] CoW: Hudi Upsert not working when there is a timestamp field in the composite key

vinothchandar commented on issue #3313: URL: https://github.com/apache/hudi/issues/3313#issuecomment-926272005 @nsivabalan can you confirm fixes releated to the precombining are now done? if so, we can close this and have @mkk1490 reopen as needed -- This is an automated message from

[GitHub] [hudi] vinothchandar commented on issue #3313: [SUPPORT] CoW: Hudi Upsert not working when there is a timestamp field in the composite key

vinothchandar commented on issue #3313: URL: https://github.com/apache/hudi/issues/3313#issuecomment-926271684 @mkk1490 row writer is fully certified for 0.9.0 and now the default. Could you comment on whether we need this issue around -- This is an automated message from the Apache Git

[GitHub] [hudi] vinothchandar commented on issue #3454: [SUPPORT] Is Hive v3 supported?

vinothchandar commented on issue #3454: URL: https://github.com/apache/hudi/issues/3454#issuecomment-926269216 Please feel free to reopen if there are further qyestions -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use

[GitHub] [hudi] vinothchandar closed issue #3454: [SUPPORT] Is Hive v3 supported?

vinothchandar closed issue #3454: URL: https://github.com/apache/hudi/issues/3454 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail:

[GitHub] [hudi] vinothchandar commented on issue #3559: [SUPPORT] Failed to archive commits

vinothchandar commented on issue #3559: URL: https://github.com/apache/hudi/issues/3559#issuecomment-926268715 0.9.0 should fix this. @codejoyan let me know if that helps! -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub

[GitHub] [hudi] vinothchandar closed issue #3562: [SUPPORT] Add hudi-spark3-bundle to mvnrepository

vinothchandar closed issue #3562: URL: https://github.com/apache/hudi/issues/3562 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail:

[GitHub] [hudi] vinothchandar commented on issue #3572: compatble version of hudi, hive and hadoop

vinothchandar commented on issue #3572: URL: https://github.com/apache/hudi/issues/3572#issuecomment-926267261 @borasy are you also trying via IDE> -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go

[GitHub] [hudi] vinothchandar commented on issue #3572: compatble version of hudi, hive and hadoop

vinothchandar commented on issue #3572: URL: https://github.com/apache/hudi/issues/3572#issuecomment-926267139 Also note that you probably should depend on `hudi-spark` and not hudi-spark-bundle to write programs. -- This is an automated message from the Apache Git Service. To respond

[GitHub] [hudi] vinothchandar commented on issue #3572: compatble version of hudi, hive and hadoop

vinothchandar commented on issue #3572: URL: https://github.com/apache/hudi/issues/3572#issuecomment-926266895 @niloo-sh thats because hive is a provided dependency. you need to add one of the hudi bundles in the module class path to make it work from IDE> -- This is an automated

[GitHub] [hudi] vinothchandar commented on issue #2856: [SUPPORT] Metrics Prometheus pushgateway

vinothchandar commented on issue #2856: URL: https://github.com/apache/hudi/issues/2856#issuecomment-926266094 Closing due to inactivity -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the

[GitHub] [hudi] vinothchandar closed issue #2856: [SUPPORT] Metrics Prometheus pushgateway

vinothchandar closed issue #2856: URL: https://github.com/apache/hudi/issues/2856 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail:

[GitHub] [hudi] vinothchandar closed issue #2869: [SUPPORT] java.lang.ClassCastException: org.apache.hadoop.io.LongWritable cannot be cast to org.apache.hadoop.hive.serde2.io.TimestampWritable when I

vinothchandar closed issue #2869: URL: https://github.com/apache/hudi/issues/2869 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail:

[GitHub] [hudi] vinothchandar commented on issue #2869: [SUPPORT] java.lang.ClassCastException: org.apache.hadoop.io.LongWritable cannot be cast to org.apache.hadoop.hive.serde2.io.TimestampWritable w

vinothchandar commented on issue #2869: URL: https://github.com/apache/hudi/issues/2869#issuecomment-926265872 Closing this. since there are few similar ones -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL

[GitHub] [hudi] vinothchandar commented on issue #2888: [SUPPORT] Hudi DeltaStreamer Job with continuos mode submit job crashes at some point after eating all memory available

vinothchandar commented on issue #2888: URL: https://github.com/apache/hudi/issues/2888#issuecomment-926265582 Queuing up for reproducing -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the

[GitHub] [hudi] vinothchandar closed issue #2910: java.lang.NoSuchMethodError: 'java.lang.String org.apache.http.client.utils.URLEncodedUtils.formatSegments

vinothchandar closed issue #2910: URL: https://github.com/apache/hudi/issues/2910 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail:

[GitHub] [hudi] vinothchandar commented on issue #2934: [SUPPORT] Parquet file does not exist when trying to read hudi table incrementally

vinothchandar commented on issue #2934: URL: https://github.com/apache/hudi/issues/2934#issuecomment-926264772 cc @vingov as well. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific

[GitHub] [hudi] vinothchandar commented on issue #2934: [SUPPORT] Parquet file does not exist when trying to read hudi table incrementally

vinothchandar commented on issue #2934: URL: https://github.com/apache/hudi/issues/2934#issuecomment-926264579 I will keep this open, to track and tag against JIRAs that exist to have more graceful fallback to either listing or metadata table to handle this scenario. -- This is an

[GitHub] [hudi] vinothchandar closed issue #2919: [SUPPORT] Schema Evolution Failing Spark+Hudi- Adding New fields

vinothchandar closed issue #2919: URL: https://github.com/apache/hudi/issues/2919 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail:

[GitHub] [hudi] vinothchandar commented on issue #2919: [SUPPORT] Schema Evolution Failing Spark+Hudi- Adding New fields

vinothchandar commented on issue #2919: URL: https://github.com/apache/hudi/issues/2919#issuecomment-926263798 cc @codope could you take a pass? and see if this needs triaging still with 0.9.0. Reopen as needed -- This is an automated message from the Apache Git Service. To respond to

[GitHub] [hudi] vinothchandar commented on issue #2919: [SUPPORT] Schema Evolution Failing Spark+Hudi- Adding New fields

vinothchandar commented on issue #2919: URL: https://github.com/apache/hudi/issues/2919#issuecomment-926263558 @nsivabalan why did we reopen this? -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go

[GitHub] [hudi] vinothchandar commented on issue #2948: [SUPPORT] EMR (5.33.x) Presto Query on _rt tables

vinothchandar commented on issue #2948: URL: https://github.com/apache/hudi/issues/2948#issuecomment-926263122 #3122 seems related ? it's in 0.9.0. @umehrot2 @nmukerje something to look at for 0.9.0 -- This is an automated message from the Apache Git Service. To respond to the

[GitHub] [hudi] hudi-bot edited a comment on pull request #3696: [WIP][HUDI-2439] Refactor commit actions in hudi-client module

hudi-bot edited a comment on pull request #3696: URL: https://github.com/apache/hudi/pull/3696#issuecomment-924126593 ## CI report: * 6cfc4dfdc0b11718a314559027b5ae5b7a79a9f1 Azure:

[GitHub] [hudi] hudi-bot edited a comment on pull request #3696: [WIP][HUDI-2439] Refactor commit actions in hudi-client module

hudi-bot edited a comment on pull request #3696: URL: https://github.com/apache/hudi/pull/3696#issuecomment-924126593 ## CI report: * 3e3130c71a195b75c9c8d6c15a265ca5b21e5cbe Azure:

[GitHub] [hudi] hudi-bot edited a comment on pull request #3696: [WIP][HUDI-2439] Refactor commit actions in hudi-client module

hudi-bot edited a comment on pull request #3696: URL: https://github.com/apache/hudi/pull/3696#issuecomment-924126593 ## CI report: * 3e3130c71a195b75c9c8d6c15a265ca5b21e5cbe Azure:

[GitHub] [hudi] vinothchandar closed issue #3005: [SUPPORT]How to query history snapshot by given one history partition?

vinothchandar closed issue #3005: URL: https://github.com/apache/hudi/issues/3005 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail:

[GitHub] [hudi] vinothchandar commented on issue #3005: [SUPPORT]How to query history snapshot by given one history partition?

vinothchandar commented on issue #3005: URL: https://github.com/apache/hudi/issues/3005#issuecomment-926255387 Closing due to inactivity -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the

[GitHub] [hudi] vinothchandar commented on issue #2936: [SUPPORT] OverwriteNonDefaultsWithLatestAvroPayload not work in mor table

vinothchandar commented on issue #2936: URL: https://github.com/apache/hudi/issues/2936#issuecomment-926254780 we need to make a stab at reproducing this with MOR and the payload. There could be some impedance mismatch between merging logs by commit time vs the precombine field -- This

[GitHub] [hudi] vinothchandar closed issue #2959: No data stored after migrating to Hudi 0.8.0

vinothchandar closed issue #2959: URL: https://github.com/apache/hudi/issues/2959 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail:

[GitHub] [hudi] vinothchandar commented on issue #2959: No data stored after migrating to Hudi 0.8.0

vinothchandar commented on issue #2959: URL: https://github.com/apache/hudi/issues/2959#issuecomment-926254291 I can't find any exceptions in the log. Please feel free to reopen if this is still an issue. -- This is an automated message from the Apache Git Service. To respond to the

[GitHub] [hudi] vinothchandar closed issue #2973: [SUPPORT]Fail to run compaction in Docker Demo

vinothchandar closed issue #2973: URL: https://github.com/apache/hudi/issues/2973 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail:

[GitHub] [hudi] vinothchandar commented on issue #3077: [SUPPORT] Large latencies in hudi writes using upsert mode.

vinothchandar commented on issue #3077: URL: https://github.com/apache/hudi/issues/3077#issuecomment-926241776 There are a few issues around this. We will batch it up and look all structured streaming in one shot. -- This is an automated message from the Apache Git Service. To respond

[GitHub] [hudi] vinothchandar commented on issue #3095: [SUPPORT] Not able to submit the spark-submit code into AWS EMR step execution

vinothchandar commented on issue #3095: URL: https://github.com/apache/hudi/issues/3095#issuecomment-926239033 Closing this for direct follow up with EMR support -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the

[GitHub] [hudi] vinothchandar closed issue #3095: [SUPPORT] Not able to submit the spark-submit code into AWS EMR step execution

vinothchandar closed issue #3095: URL: https://github.com/apache/hudi/issues/3095 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail:

  1   2   3   >