[GitHub] [hudi] dmenin commented on issue #3394: [SUPPORT] Question on hudi's default behaviour for UPSERT

2021-08-09 Thread GitBox
dmenin commented on issue #3394: URL: https://github.com/apache/hudi/issues/3394#issuecomment-895017446 Yes it does, thanks for clarifying. I guess the confusion (mainly from my part) was that when I was said NEW and OLD, I was referring to the timestamp of the row (translated to

[jira] [Commented] (HUDI-393) Integrate with Azure Pipeline run the end to end tests

2021-08-09 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HUDI-393?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17395896#comment-17395896 ] ASF GitHub Bot commented on HUDI-393: - hudi-bot edited a comment on pull request #2906: URL:

[GitHub] [hudi] codope opened a new pull request #3433: [HUDI-1897] Deltastreamer source for AWS S3

2021-08-09 Thread GitBox
codope opened a new pull request #3433: URL: https://github.com/apache/hudi/pull/3433 * HUDI-1896 intial source for Cloud Dfs * update with changes, added for fileMap support HUDI-1896 * update with changes, added for fileMap support HUDI-1896 * s3 meta source HUDI-1896

[GitHub] [hudi] hudi-bot edited a comment on pull request #2906: [HUDI-393] remove travis

2021-08-09 Thread GitBox
hudi-bot edited a comment on pull request #2906: URL: https://github.com/apache/hudi/pull/2906#issuecomment-894845691 ## CI report: * c244f1bc4ddb093a5e751ebfd4ec2d8e409238e8 UNKNOWN * 0985b9b4a64b8015257eae8d85dfd899acf7a910 UNKNOWN *

[jira] [Commented] (HUDI-1897) Implement DeltaStreamer Source for AWS S3

2021-08-09 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HUDI-1897?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17395876#comment-17395876 ] ASF GitHub Bot commented on HUDI-1897: -- hudi-bot commented on pull request #3433: URL:

[GitHub] [hudi] hudi-bot commented on pull request #3433: [HUDI-1897] Deltastreamer source for AWS S3

2021-08-09 Thread GitBox
hudi-bot commented on pull request #3433: URL: https://github.com/apache/hudi/pull/3433#issuecomment-895012652 ## CI report: * 076123328724c1ef5051208c57706ae09ba6c11e UNKNOWN Bot commands @hudi-bot supports the following commands: - `@hudi-bot run travis`

[jira] [Commented] (HUDI-393) Integrate with Azure Pipeline run the end to end tests

2021-08-09 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HUDI-393?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17395888#comment-17395888 ] ASF GitHub Bot commented on HUDI-393: - hudi-bot edited a comment on pull request #2906: URL:

[GitHub] [hudi] hudi-bot edited a comment on pull request #2906: [HUDI-393] remove travis

2021-08-09 Thread GitBox
hudi-bot edited a comment on pull request #2906: URL: https://github.com/apache/hudi/pull/2906#issuecomment-894845691 ## CI report: * c244f1bc4ddb093a5e751ebfd4ec2d8e409238e8 UNKNOWN * 0985b9b4a64b8015257eae8d85dfd899acf7a910 UNKNOWN *

[GitHub] [hudi] hudi-bot edited a comment on pull request #3433: [HUDI-1897] Deltastreamer source for AWS S3

2021-08-09 Thread GitBox
hudi-bot edited a comment on pull request #3433: URL: https://github.com/apache/hudi/pull/3433#issuecomment-895012652 ## CI report: * 076123328724c1ef5051208c57706ae09ba6c11e Azure:

[jira] [Commented] (HUDI-393) Integrate with Azure Pipeline run the end to end tests

2021-08-09 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HUDI-393?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17395860#comment-17395860 ] ASF GitHub Bot commented on HUDI-393: - xushiyan commented on pull request #2906: URL:

[GitHub] [hudi] hudi-bot edited a comment on pull request #3330: [HUDI-2101][RFC-28]support z-order for hudi

2021-08-09 Thread GitBox
hudi-bot edited a comment on pull request #3330: URL: https://github.com/apache/hudi/pull/3330#issuecomment-885350571 ## CI report: * 2fe602cd21e55a32be8900eadfd3b5a0da152a9f Azure:

[jira] [Commented] (HUDI-2101) support z-order for hudi

2021-08-09 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HUDI-2101?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17395892#comment-17395892 ] ASF GitHub Bot commented on HUDI-2101: -- hudi-bot edited a comment on pull request #3330: URL:

[GitHub] [hudi] hudi-bot edited a comment on pull request #3432: [Blocker]Fix travis from errors

2021-08-09 Thread GitBox
hudi-bot edited a comment on pull request #3432: URL: https://github.com/apache/hudi/pull/3432#issuecomment-894918264 ## CI report: * a9fac161ee301491c1dde2481976b17b53c720e2 UNKNOWN * d35d7536de2b0758a3cacc470f313f3ff1c90700 Azure:

[jira] [Commented] (HUDI-2194) Skip the latest N partitions when creating ClusteringPlan

2021-08-09 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HUDI-2194?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17395913#comment-17395913 ] ASF GitHub Bot commented on HUDI-2194: -- zhangyue19921010 commented on pull request #3300: URL:

[GitHub] [hudi] zhangyue19921010 commented on pull request #3300: [HUDI-2194] Skip the latest N partitions when choosing partitions to create ClusteringPlan

2021-08-09 Thread GitBox
zhangyue19921010 commented on pull request #3300: URL: https://github.com/apache/hudi/pull/3300#issuecomment-895049937 Hi @satishkotha Travis and Azure are all passed. Could you please take a look at your convenient? Thanks a lot! -- This is an automated message from the Apache Git

[GitHub] [hudi] yanghua merged pull request #3424: [MINOR] Remove link to missing monitoring section

2021-08-09 Thread GitBox
yanghua merged pull request #3424: URL: https://github.com/apache/hudi/pull/3424 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail:

[hudi] branch asf-site updated: [MINOR] Remove link to missing monitoring section (#3424)

2021-08-09 Thread vinoyang
This is an automated email from the ASF dual-hosted git repository. vinoyang pushed a commit to branch asf-site in repository https://gitbox.apache.org/repos/asf/hudi.git The following commit(s) were added to refs/heads/asf-site by this push: new de2ea79 [MINOR] Remove link to missing

[jira] [Commented] (HUDI-393) Integrate with Azure Pipeline run the end to end tests

2021-08-09 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HUDI-393?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17395842#comment-17395842 ] ASF GitHub Bot commented on HUDI-393: - hudi-bot edited a comment on pull request #2906: URL:

[GitHub] [hudi] hudi-bot edited a comment on pull request #2906: [HUDI-393] remove travis

2021-08-09 Thread GitBox
hudi-bot edited a comment on pull request #2906: URL: https://github.com/apache/hudi/pull/2906#issuecomment-894845691 ## CI report: * c244f1bc4ddb093a5e751ebfd4ec2d8e409238e8 UNKNOWN * 0985b9b4a64b8015257eae8d85dfd899acf7a910 UNKNOWN *

[jira] [Commented] (HUDI-393) Integrate with Azure Pipeline run the end to end tests

2021-08-09 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HUDI-393?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17395859#comment-17395859 ] ASF GitHub Bot commented on HUDI-393: - hudi-bot edited a comment on pull request #2906: URL:

[GitHub] [hudi] xushiyan commented on pull request #2906: [HUDI-393] remove travis

2021-08-09 Thread GitBox
xushiyan commented on pull request #2906: URL: https://github.com/apache/hudi/pull/2906#issuecomment-894997395 @hudi-bot run azure -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific

[jira] [Commented] (HUDI-2279) Support column name matching for insert * and update set * in merge into when sourceTable's columns contains all targetTable's columns

2021-08-09 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HUDI-2279?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17395864#comment-17395864 ] ASF GitHub Bot commented on HUDI-2279: -- hudi-bot edited a comment on pull request #3415: URL:

[GitHub] [hudi] hudi-bot edited a comment on pull request #3415: [HUDI-2279]Support column name matching for insert * and update set *

2021-08-09 Thread GitBox
hudi-bot edited a comment on pull request #3415: URL: https://github.com/apache/hudi/pull/3415#issuecomment-893539789 ## CI report: * 10b2dc9c80f373a90f0140507fb20b85dfcf30d5 Azure:

[jira] [Commented] (HUDI-393) Integrate with Azure Pipeline run the end to end tests

2021-08-09 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HUDI-393?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17395869#comment-17395869 ] ASF GitHub Bot commented on HUDI-393: - hudi-bot edited a comment on pull request #2906: URL:

[jira] [Commented] (HUDI-1897) Implement DeltaStreamer Source for AWS S3

2021-08-09 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HUDI-1897?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17395879#comment-17395879 ] ASF GitHub Bot commented on HUDI-1897: -- hudi-bot edited a comment on pull request #3433: URL:

[GitHub] [hudi] hudi-bot edited a comment on pull request #3433: [HUDI-1897] Deltastreamer source for AWS S3

2021-08-09 Thread GitBox
hudi-bot edited a comment on pull request #3433: URL: https://github.com/apache/hudi/pull/3433#issuecomment-895012652 ## CI report: * 076123328724c1ef5051208c57706ae09ba6c11e Azure:

[GitHub] [hudi] hudi-bot edited a comment on pull request #3432: [Blocker]Fix travis from errors

2021-08-09 Thread GitBox
hudi-bot edited a comment on pull request #3432: URL: https://github.com/apache/hudi/pull/3432#issuecomment-894918264 ## CI report: * a9fac161ee301491c1dde2481976b17b53c720e2 UNKNOWN * d35d7536de2b0758a3cacc470f313f3ff1c90700 Azure:

[jira] [Commented] (HUDI-1897) Implement DeltaStreamer Source for AWS S3

2021-08-09 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HUDI-1897?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17395871#comment-17395871 ] ASF GitHub Bot commented on HUDI-1897: -- codope opened a new pull request #3433: URL:

[jira] [Updated] (HUDI-1897) Implement DeltaStreamer Source for AWS S3

2021-08-09 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HUDI-1897?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated HUDI-1897: - Labels: pull-request-available (was: ) > Implement DeltaStreamer Source for AWS S3 >

[GitHub] [hudi] hudi-bot edited a comment on pull request #2906: [HUDI-393] remove travis

2021-08-09 Thread GitBox
hudi-bot edited a comment on pull request #2906: URL: https://github.com/apache/hudi/pull/2906#issuecomment-894845691 ## CI report: * c244f1bc4ddb093a5e751ebfd4ec2d8e409238e8 UNKNOWN * 0985b9b4a64b8015257eae8d85dfd899acf7a910 UNKNOWN *

[jira] [Commented] (HUDI-1897) Implement DeltaStreamer Source for AWS S3

2021-08-09 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HUDI-1897?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17395901#comment-17395901 ] ASF GitHub Bot commented on HUDI-1897: -- hudi-bot edited a comment on pull request #3433: URL:

[jira] [Commented] (HUDI-2279) Support column name matching for insert * and update set * in merge into when sourceTable's columns contains all targetTable's columns

2021-08-09 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HUDI-2279?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17395865#comment-17395865 ] ASF GitHub Bot commented on HUDI-2279: -- hudi-bot edited a comment on pull request #3415: URL:

[GitHub] [hudi] hudi-bot edited a comment on pull request #3415: [HUDI-2279]Support column name matching for insert * and update set *

2021-08-09 Thread GitBox
hudi-bot edited a comment on pull request #3415: URL: https://github.com/apache/hudi/pull/3415#issuecomment-893539789 ## CI report: * 10b2dc9c80f373a90f0140507fb20b85dfcf30d5 Azure:

[GitHub] [hudi] hudi-bot edited a comment on pull request #2906: [HUDI-393] remove travis

2021-08-09 Thread GitBox
hudi-bot edited a comment on pull request #2906: URL: https://github.com/apache/hudi/pull/2906#issuecomment-894845691 ## CI report: * c244f1bc4ddb093a5e751ebfd4ec2d8e409238e8 UNKNOWN * 0985b9b4a64b8015257eae8d85dfd899acf7a910 UNKNOWN *

[jira] [Commented] (HUDI-2279) Support column name matching for insert * and update set * in merge into when sourceTable's columns contains all targetTable's columns

2021-08-09 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HUDI-2279?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17395890#comment-17395890 ] ASF GitHub Bot commented on HUDI-2279: -- hudi-bot edited a comment on pull request #3415: URL:

[jira] [Commented] (HUDI-2101) support z-order for hudi

2021-08-09 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HUDI-2101?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17395889#comment-17395889 ] ASF GitHub Bot commented on HUDI-2101: -- hudi-bot edited a comment on pull request #3330: URL:

[GitHub] [hudi] hudi-bot edited a comment on pull request #3330: [HUDI-2101][RFC-28]support z-order for hudi

2021-08-09 Thread GitBox
hudi-bot edited a comment on pull request #3330: URL: https://github.com/apache/hudi/pull/3330#issuecomment-885350571 ## CI report: * 2fe602cd21e55a32be8900eadfd3b5a0da152a9f Azure:

[GitHub] [hudi] hudi-bot edited a comment on pull request #3415: [HUDI-2279]Support column name matching for insert * and update set *

2021-08-09 Thread GitBox
hudi-bot edited a comment on pull request #3415: URL: https://github.com/apache/hudi/pull/3415#issuecomment-893539789 ## CI report: * f8fb54e42c50bd8cfa3dd8be161f0d924b581081 Azure:

[jira] [Commented] (HUDI-2194) Skip the latest N partitions when creating ClusteringPlan

2021-08-09 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HUDI-2194?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17395911#comment-17395911 ] ASF GitHub Bot commented on HUDI-2194: -- zhangyue19921010 edited a comment on pull request #3300: URL:

[GitHub] [hudi] zhangyue19921010 edited a comment on pull request #3300: [HUDI-2194] Skip the latest N partitions when choosing partitions to create ClusteringPlan

2021-08-09 Thread GitBox
zhangyue19921010 edited a comment on pull request #3300: URL: https://github.com/apache/hudi/pull/3300#issuecomment-884662878 Hi @satishkotha Thanks for your review. > @zhangyue19921010 LGTM. Is it possible to add a test? Sure thing, added. -- This is an automated

[jira] [Commented] (HUDI-2101) support z-order for hudi

2021-08-09 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HUDI-2101?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17395925#comment-17395925 ] ASF GitHub Bot commented on HUDI-2101: -- hudi-bot edited a comment on pull request #3330: URL:

[GitHub] [hudi] hudi-bot edited a comment on pull request #3330: [HUDI-2101][RFC-28]support z-order for hudi

2021-08-09 Thread GitBox
hudi-bot edited a comment on pull request #3330: URL: https://github.com/apache/hudi/pull/3330#issuecomment-885350571 ## CI report: * 83abfb9aeb86b988d48ec0177cedd30afcd93a82 Azure:

[GitHub] [hudi] xushiyan commented on pull request #2906: [HUDI-393] remove travis

2021-08-09 Thread GitBox
xushiyan commented on pull request #2906: URL: https://github.com/apache/hudi/pull/2906#issuecomment-895295370 @hudi-bot run azure -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the

[GitHub] [hudi] minihippo commented on a change in pull request #3173: [HUDI-1951] Add bucket hash index, compatible with the hive bucket

2021-08-09 Thread GitBox
minihippo commented on a change in pull request #3173: URL: https://github.com/apache/hudi/pull/3173#discussion_r685122711 ## File path: hudi-client/hudi-client-common/src/main/java/org/apache/hudi/keygen/BaseKeyGenerator.java ## @@ -71,11 +84,25 @@ public final HoodieKey

[jira] [Commented] (HUDI-1951) Hash Index for HUDI

2021-08-09 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HUDI-1951?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17396000#comment-17396000 ] ASF GitHub Bot commented on HUDI-1951: -- minihippo commented on a change in pull request #3173: URL:

[GitHub] [hudi] minihippo commented on a change in pull request #3173: [HUDI-1951] Add bucket hash index, compatible with the hive bucket

2021-08-09 Thread GitBox
minihippo commented on a change in pull request #3173: URL: https://github.com/apache/hudi/pull/3173#discussion_r685129939 ## File path: hudi-common/src/main/java/org/apache/hudi/common/table/HoodieTableConfig.java ## @@ -140,6 +140,12 @@ public static final String

[jira] [Commented] (HUDI-1951) Hash Index for HUDI

2021-08-09 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HUDI-1951?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17396004#comment-17396004 ] ASF GitHub Bot commented on HUDI-1951: -- minihippo commented on a change in pull request #3173: URL:

[jira] [Commented] (HUDI-1951) Hash Index for HUDI

2021-08-09 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HUDI-1951?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17396005#comment-17396005 ] ASF GitHub Bot commented on HUDI-1951: -- minihippo commented on a change in pull request #3173: URL:

[GitHub] [hudi] minihippo commented on a change in pull request #3173: [HUDI-1951] Add bucket hash index, compatible with the hive bucket

2021-08-09 Thread GitBox
minihippo commented on a change in pull request #3173: URL: https://github.com/apache/hudi/pull/3173#discussion_r685129787 ## File path: hudi-client/hudi-spark-client/src/main/java/org/apache/hudi/index/bucket/SparkHiveBucketIndex.java ## @@ -0,0 +1,179 @@ +/* + * Licensed to

[jira] [Commented] (HUDI-1951) Hash Index for HUDI

2021-08-09 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HUDI-1951?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17396041#comment-17396041 ] ASF GitHub Bot commented on HUDI-1951: -- minihippo commented on a change in pull request #3173: URL:

[GitHub] [hudi] nsivabalan commented on a change in pull request #3401: [HUDI-2170] [HUDI-1763] Always choose the latest record for HoodieRecordPayload

2021-08-09 Thread GitBox
nsivabalan commented on a change in pull request #3401: URL: https://github.com/apache/hudi/pull/3401#discussion_r685189688 ## File path: hudi-common/src/main/java/org/apache/hudi/common/model/OverwriteWithLatestAvroPayload.java ## @@ -47,10 +47,14 @@ public

[jira] [Commented] (HUDI-2170) Always choose the latest record for HoodieRecordPayload

2021-08-09 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HUDI-2170?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17396045#comment-17396045 ] ASF GitHub Bot commented on HUDI-2170: -- nsivabalan commented on a change in pull request #3401: URL:

[GitHub] [hudi] hudi-bot edited a comment on pull request #3434: support ks3 storage for hudi

2021-08-09 Thread GitBox
hudi-bot edited a comment on pull request #3434: URL: https://github.com/apache/hudi/pull/3434#issuecomment-895214352 ## CI report: * cead7cfa9f01a34464585f8adb3f39f435e1680d Azure:

[jira] [Commented] (HUDI-1951) Hash Index for HUDI

2021-08-09 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HUDI-1951?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17396078#comment-17396078 ] ASF GitHub Bot commented on HUDI-1951: -- hudi-bot edited a comment on pull request #3173: URL:

[GitHub] [hudi] hudi-bot edited a comment on pull request #3173: [HUDI-1951] Add bucket hash index, compatible with the hive bucket

2021-08-09 Thread GitBox
hudi-bot edited a comment on pull request #3173: URL: https://github.com/apache/hudi/pull/3173#issuecomment-869653867 ## CI report: * d57170ffa890527ef78b2a07b0743734221a3cde Azure:

[jira] [Commented] (HUDI-393) Integrate with Azure Pipeline run the end to end tests

2021-08-09 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HUDI-393?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17396088#comment-17396088 ] ASF GitHub Bot commented on HUDI-393: - hudi-bot edited a comment on pull request #2906: URL:

[jira] [Commented] (HUDI-2170) Always choose the latest record for HoodieRecordPayload

2021-08-09 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HUDI-2170?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17395951#comment-17395951 ] ASF GitHub Bot commented on HUDI-2170: -- swuferhong closed pull request #3401: URL:

[jira] [Commented] (HUDI-2170) Always choose the latest record for HoodieRecordPayload

2021-08-09 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HUDI-2170?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17395950#comment-17395950 ] ASF GitHub Bot commented on HUDI-2170: -- swuferhong opened a new pull request #3401: URL:

[GitHub] [hudi] xuzifu666 opened a new pull request #3434: support ks3 storage for hudi

2021-08-09 Thread GitBox
xuzifu666 opened a new pull request #3434: URL: https://github.com/apache/hudi/pull/3434 ## *Tips* - *Thank you very much for contributing to Apache Hudi.* - *Please review https://hudi.apache.org/contributing.html before opening a pull request.* ## What is the purpose of the

[jira] [Commented] (HUDI-1129) AvroConversionUtils unable to handle avro to row transformation when passing evolved schema

2021-08-09 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HUDI-1129?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17396066#comment-17396066 ] ASF GitHub Bot commented on HUDI-1129: -- hudi-bot edited a comment on pull request #2927: URL:

[GitHub] [hudi] hudi-bot edited a comment on pull request #2927: [HUDI-1129] Improving schema evolution support in hudi

2021-08-09 Thread GitBox
hudi-bot edited a comment on pull request #2927: URL: https://github.com/apache/hudi/pull/2927#issuecomment-864700767 ## CI report: * fad0bc7d53c2b525fa80cfc4d23588df4ba2274e Azure:

[GitHub] [hudi] xuzifu666 opened a new pull request #3435: Asf site ks3 doc

2021-08-09 Thread GitBox
xuzifu666 opened a new pull request #3435: URL: https://github.com/apache/hudi/pull/3435 ## *Tips* - *Thank you very much for contributing to Apache Hudi.* - *Please review https://hudi.apache.org/contributing.html before opening a pull request.* ## What is the purpose of the

[jira] [Commented] (HUDI-1951) Hash Index for HUDI

2021-08-09 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HUDI-1951?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17396079#comment-17396079 ] ASF GitHub Bot commented on HUDI-1951: -- hudi-bot edited a comment on pull request #3173: URL:

[GitHub] [hudi] hudi-bot edited a comment on pull request #3173: [HUDI-1951] Add bucket hash index, compatible with the hive bucket

2021-08-09 Thread GitBox
hudi-bot edited a comment on pull request #3173: URL: https://github.com/apache/hudi/pull/3173#issuecomment-869653867 ## CI report: * d57170ffa890527ef78b2a07b0743734221a3cde Azure:

[GitHub] [hudi] leesf commented on a change in pull request #3426: [HUDI-2285] Metadata Table synchronous design

2021-08-09 Thread GitBox
leesf commented on a change in pull request #3426: URL: https://github.com/apache/hudi/pull/3426#discussion_r685275659 ## File path: hudi-client/hudi-client-common/src/main/java/org/apache/hudi/client/AbstractHoodieWriteClient.java ## @@ -435,7 +425,6 @@ protected void

[jira] [Commented] (HUDI-1129) AvroConversionUtils unable to handle avro to row transformation when passing evolved schema

2021-08-09 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HUDI-1129?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17396065#comment-17396065 ] ASF GitHub Bot commented on HUDI-1129: -- hudi-bot edited a comment on pull request #2927: URL:

[GitHub] [hudi] garyli1019 commented on a change in pull request #3434: support ks3 storage for hudi

2021-08-09 Thread GitBox
garyli1019 commented on a change in pull request #3434: URL: https://github.com/apache/hudi/pull/3434#discussion_r685274040 ## File path: hudi-common/src/test/java/org/apache/hudi/common/fs/TestStorageSchemes.java ## @@ -46,6 +46,7 @@ public void testStorageSchemes() {

[jira] [Commented] (HUDI-393) Integrate with Azure Pipeline run the end to end tests

2021-08-09 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HUDI-393?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17396089#comment-17396089 ] ASF GitHub Bot commented on HUDI-393: - hudi-bot edited a comment on pull request #2906: URL:

[GitHub] [hudi] hudi-bot edited a comment on pull request #2906: [HUDI-393] remove travis

2021-08-09 Thread GitBox
hudi-bot edited a comment on pull request #2906: URL: https://github.com/apache/hudi/pull/2906#issuecomment-894845691 ## CI report: * c244f1bc4ddb093a5e751ebfd4ec2d8e409238e8 UNKNOWN * 0985b9b4a64b8015257eae8d85dfd899acf7a910 UNKNOWN *

[GitHub] [hudi] swuferhong closed pull request #3401: [HUDI-2170] [HUDI-1763] Always choose the latest record for HoodieRecordPayload

2021-08-09 Thread GitBox
swuferhong closed pull request #3401: URL: https://github.com/apache/hudi/pull/3401 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail:

[GitHub] [hudi] leesf commented on a change in pull request #3428: [HUDI-2286] Handle the case of failed deltacommit on the metadata table.

2021-08-09 Thread GitBox
leesf commented on a change in pull request #3428: URL: https://github.com/apache/hudi/pull/3428#discussion_r685266163 ## File path: hudi-client/hudi-spark-client/src/test/java/org/apache/hudi/client/functional/TestHoodieBackedMetadata.java ## @@ -857,6 +859,62 @@ public void

[GitHub] [hudi] garyli1019 commented on pull request #3432: [Blocker]Fix travis from errors

2021-08-09 Thread GitBox
garyli1019 commented on pull request #3432: URL: https://github.com/apache/hudi/pull/3432#issuecomment-895290869 Not sure if there will be any side effect of too many parallel builds, cause the build resource is limited. cc: @xushiyan -- This is an automated message from the Apache Git

[jira] [Commented] (HUDI-2286) Handle the case of failed deltacommit on the metadata table.

2021-08-09 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HUDI-2286?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17396084#comment-17396084 ] ASF GitHub Bot commented on HUDI-2286: -- leesf commented on a change in pull request #3428: URL:

[GitHub] [hudi] hudi-bot edited a comment on pull request #3432: [Blocker]Fix travis from errors

2021-08-09 Thread GitBox
hudi-bot edited a comment on pull request #3432: URL: https://github.com/apache/hudi/pull/3432#issuecomment-894918264 ## CI report: * a9fac161ee301491c1dde2481976b17b53c720e2 UNKNOWN * dbdb73e6d8b5d801e6ad7d1a409944bab3979975 Azure:

[GitHub] [hudi] hudi-bot edited a comment on pull request #3434: support ks3 storage for hudi

2021-08-09 Thread GitBox
hudi-bot edited a comment on pull request #3434: URL: https://github.com/apache/hudi/pull/3434#issuecomment-895214352 ## CI report: * cead7cfa9f01a34464585f8adb3f39f435e1680d Azure:

[GitHub] [hudi] xuzifu666 opened a new pull request #3436: feat(docs): add ks3 support doc for hudi

2021-08-09 Thread GitBox
xuzifu666 opened a new pull request #3436: URL: https://github.com/apache/hudi/pull/3436 ## *Tips* - *Thank you very much for contributing to Apache Hudi.* - *Please review https://hudi.apache.org/contributing.html before opening a pull request.* ## What is the purpose of the

[GitHub] [hudi] yanghua commented on pull request #3432: [Blocker]Fix travis from errors

2021-08-09 Thread GitBox
yanghua commented on pull request #3432: URL: https://github.com/apache/hudi/pull/3432#issuecomment-895164149 @leesf @garyli1019 @danny0405 @pengzhiwei2018 double check? -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and

[GitHub] [hudi] hudi-bot commented on pull request #3434: support ks3 storage for hudi

2021-08-09 Thread GitBox
hudi-bot commented on pull request #3434: URL: https://github.com/apache/hudi/pull/3434#issuecomment-895214352 ## CI report: * cead7cfa9f01a34464585f8adb3f39f435e1680d UNKNOWN Bot commands @hudi-bot supports the following commands: - `@hudi-bot run travis`

[GitHub] [hudi] xuzifu666 commented on pull request #3434: support ks3 storage for hudi

2021-08-09 Thread GitBox
xuzifu666 commented on pull request #3434: URL: https://github.com/apache/hudi/pull/3434#issuecomment-895225871 support s3 storage (Kingsoft Standard Storage Service) for hudi @leesf -- This is an automated message from the Apache Git Service. To respond to the message, please log on to

[GitHub] [hudi] hudi-bot edited a comment on pull request #2927: [HUDI-1129] Improving schema evolution support in hudi

2021-08-09 Thread GitBox
hudi-bot edited a comment on pull request #2927: URL: https://github.com/apache/hudi/pull/2927#issuecomment-864700767 ## CI report: * fad0bc7d53c2b525fa80cfc4d23588df4ba2274e Azure:

[GitHub] [hudi] hudi-bot commented on pull request #3435: Asf site ks3 doc

2021-08-09 Thread GitBox
hudi-bot commented on pull request #3435: URL: https://github.com/apache/hudi/pull/3435#issuecomment-895271918 ## CI report: * a47b1c3a38b0c1c87c5265c8af34526aff84eee8 UNKNOWN Bot commands @hudi-bot supports the following commands: - `@hudi-bot run travis`

[GitHub] [hudi] xuzifu666 commented on pull request #3436: feat(docs): add ks3 support doc for hudi

2021-08-09 Thread GitBox
xuzifu666 commented on pull request #3436: URL: https://github.com/apache/hudi/pull/3436#issuecomment-895271605 add doc with support ks3 storage on hudi @leesf -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL

[GitHub] [hudi] minihippo commented on a change in pull request #3173: [HUDI-1951] Add bucket hash index, compatible with the hive bucket

2021-08-09 Thread GitBox
minihippo commented on a change in pull request #3173: URL: https://github.com/apache/hudi/pull/3173#discussion_r685185980 ## File path: hudi-client/hudi-client-common/src/main/java/org/apache/hudi/utils/HiveHasher.java ## @@ -0,0 +1,362 @@ +/* + * Licensed to the Apache

[GitHub] [hudi] hudi-bot edited a comment on pull request #3434: support ks3 storage for hudi

2021-08-09 Thread GitBox
hudi-bot edited a comment on pull request #3434: URL: https://github.com/apache/hudi/pull/3434#issuecomment-895214352 ## CI report: * cead7cfa9f01a34464585f8adb3f39f435e1680d Azure:

[GitHub] [hudi] hudi-bot edited a comment on pull request #3434: support ks3 storage for hudi

2021-08-09 Thread GitBox
hudi-bot edited a comment on pull request #3434: URL: https://github.com/apache/hudi/pull/3434#issuecomment-895214352 ## CI report: * cead7cfa9f01a34464585f8adb3f39f435e1680d Azure:

[jira] [Commented] (HUDI-393) Integrate with Azure Pipeline run the end to end tests

2021-08-09 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HUDI-393?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17396086#comment-17396086 ] ASF GitHub Bot commented on HUDI-393: - xushiyan commented on pull request #2906: URL:

[GitHub] [hudi] hudi-bot edited a comment on pull request #2906: [HUDI-393] remove travis

2021-08-09 Thread GitBox
hudi-bot edited a comment on pull request #2906: URL: https://github.com/apache/hudi/pull/2906#issuecomment-894845691 ## CI report: * c244f1bc4ddb093a5e751ebfd4ec2d8e409238e8 UNKNOWN * 0985b9b4a64b8015257eae8d85dfd899acf7a910 UNKNOWN *

[jira] [Commented] (HUDI-2285) Metadata Table Synchronous Design

2021-08-09 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HUDI-2285?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17396092#comment-17396092 ] ASF GitHub Bot commented on HUDI-2285: -- leesf commented on a change in pull request #3426: URL:

[jira] [Commented] (HUDI-2285) Metadata Table Synchronous Design

2021-08-09 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HUDI-2285?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17396090#comment-17396090 ] ASF GitHub Bot commented on HUDI-2285: -- leesf commented on a change in pull request #3426: URL:

[jira] [Commented] (HUDI-393) Integrate with Azure Pipeline run the end to end tests

2021-08-09 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HUDI-393?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17396148#comment-17396148 ] ASF GitHub Bot commented on HUDI-393: - hudi-bot edited a comment on pull request #2906: URL:

[GitHub] [hudi] hudi-bot edited a comment on pull request #3434: support ks3 storage for hudi

2021-08-09 Thread GitBox
hudi-bot edited a comment on pull request #3434: URL: https://github.com/apache/hudi/pull/3434#issuecomment-895214352 ## CI report: * 80b42cd7bb32d70e9dcd1e8b7106b9a1f36099ac Azure:

[jira] [Commented] (HUDI-1129) AvroConversionUtils unable to handle avro to row transformation when passing evolved schema

2021-08-09 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HUDI-1129?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17396180#comment-17396180 ] ASF GitHub Bot commented on HUDI-1129: -- hudi-bot edited a comment on pull request #2927: URL:

[GitHub] [hudi] mithalee closed issue #3336: [SUPPORT] Delete not functioning with deltastreamer

2021-08-09 Thread GitBox
mithalee closed issue #3336: URL: https://github.com/apache/hudi/issues/3336 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail:

[GitHub] [hudi] mithalee commented on issue #3336: [SUPPORT] Delete not functioning with deltastreamer

2021-08-09 Thread GitBox
mithalee commented on issue #3336: URL: https://github.com/apache/hudi/issues/3336#issuecomment-895405470 @nsivabalan @codope Hi, I found the issue. Spark on K8 3.1.1 has some bugs and throws the "Premature Content" error. I tried the Spark on K8 3.1.2 which is the latest release and the

[jira] [Commented] (HUDI-2285) Metadata Table Synchronous Design

2021-08-09 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HUDI-2285?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17396101#comment-17396101 ] ASF GitHub Bot commented on HUDI-2285: -- leesf commented on a change in pull request #3426: URL:

[GitHub] [hudi] leesf commented on a change in pull request #3426: [HUDI-2285] Metadata Table synchronous design

2021-08-09 Thread GitBox
leesf commented on a change in pull request #3426: URL: https://github.com/apache/hudi/pull/3426#discussion_r685286237 ## File path: hudi-client/hudi-flink-client/src/main/java/org/apache/hudi/table/upgrade/FlinkUpgradeDowngrade.java ## @@ -43,7 +43,9 @@ public void

[GitHub] [hudi] zhangyue19921010 edited a comment on pull request #3432: [Blocker]Fix travis from errors

2021-08-09 Thread GitBox
zhangyue19921010 edited a comment on pull request #3432: URL: https://github.com/apache/hudi/pull/3432#issuecomment-895328709 hi @garyli1019 With the continuous development of hudi, there will be more and more uts and the size of a single job is limited, so sooner or later we need to

[GitHub] [hudi] nsivabalan commented on issue #3395: [SUPPORT] Issues with read optimized query MOR table

2021-08-09 Thread GitBox
nsivabalan commented on issue #3395: URL: https://github.com/apache/hudi/issues/3395#issuecomment-895329692 Can you try w/ scala version 2.11. If not, artifacts for bundle has to change. ``` spark-shell \ --packages

[GitHub] [hudi] hudi-bot edited a comment on pull request #2927: [HUDI-1129] Improving schema evolution support in hudi

2021-08-09 Thread GitBox
hudi-bot edited a comment on pull request #2927: URL: https://github.com/apache/hudi/pull/2927#issuecomment-864700767 ## CI report: * 9ee6b0b8946899fbe7d2f2008fc35fae3d998a41 Azure:

[GitHub] [hudi] hudi-bot edited a comment on pull request #3173: [HUDI-1951] Add bucket hash index, compatible with the hive bucket

2021-08-09 Thread GitBox
hudi-bot edited a comment on pull request #3173: URL: https://github.com/apache/hudi/pull/3173#issuecomment-869653867 ## CI report: * b347d2ab957e175083af033f3d2f10d066d63015 Azure:

  1   2   3   >