[GitHub] [hudi] hudi-bot edited a comment on pull request #3360: [HUDI-2243] Support Time Travel Query For Hoodie Table

2021-08-05 Thread GitBox
hudi-bot edited a comment on pull request #3360: URL: https://github.com/apache/hudi/pull/3360#issuecomment-888079450 ## CI report: * b9e30d2e16f50ff360d63b63db9c5c6150a03082 Azure:

[jira] [Commented] (HUDI-2243) Support Time Travel Query For Hoodie Table

2021-08-05 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HUDI-2243?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17393963#comment-17393963 ] ASF GitHub Bot commented on HUDI-2243: -- hudi-bot edited a comment on pull request #3360: URL:

[jira] [Commented] (HUDI-2278) Use INT64 timestamp with precision 3 for flink parquet writer

2021-08-05 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HUDI-2278?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17393990#comment-17393990 ] ASF GitHub Bot commented on HUDI-2278: -- hudi-bot edited a comment on pull request #3414: URL:

[GitHub] [hudi] hudi-bot edited a comment on pull request #3414: [HUDI-2278] Use INT64 timestamp with precision 3 for flink parquet wr…

2021-08-05 Thread GitBox
hudi-bot edited a comment on pull request #3414: URL: https://github.com/apache/hudi/pull/3414#issuecomment-893397192 ## CI report: * 1fca7df825c95dd45fdcc73864437440f2a73531 Azure:

[jira] [Commented] (HUDI-2208) [SQL] Support Bulk Insert For Spark Sql

2021-08-05 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HUDI-2208?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17394000#comment-17394000 ] ASF GitHub Bot commented on HUDI-2208: -- hudi-bot edited a comment on pull request #3328: URL:

[GitHub] [hudi] hudi-bot commented on pull request #3415: [HUDI-2279]Support column name matching for insert * and update set *

2021-08-05 Thread GitBox
hudi-bot commented on pull request #3415: URL: https://github.com/apache/hudi/pull/3415#issuecomment-893539789 ## CI report: * 10b2dc9c80f373a90f0140507fb20b85dfcf30d5 UNKNOWN Bot commands @hudi-bot supports the following commands: - `@hudi-bot run travis`

[jira] [Commented] (HUDI-1985) Website re-design implementation

2021-08-05 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HUDI-1985?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17393910#comment-17393910 ] ASF GitHub Bot commented on HUDI-1985: -- vingov opened a new pull request #3410: URL:

[jira] [Commented] (HUDI-2277) Let HoodieDeltaStreamer reading ORC files using ORCDFSSource

2021-08-05 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HUDI-2277?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17393909#comment-17393909 ] ASF GitHub Bot commented on HUDI-2277: -- hudi-bot commented on pull request #3413: URL:

[jira] [Commented] (HUDI-2243) Support Time Travel Query For Hoodie Table

2021-08-05 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HUDI-2243?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17393911#comment-17393911 ] ASF GitHub Bot commented on HUDI-2243: -- hudi-bot edited a comment on pull request #3360: URL:

[jira] [Commented] (HUDI-2257) Add a note to set keygenerator class while deleting data

2021-08-05 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HUDI-2257?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17393912#comment-17393912 ] ASF GitHub Bot commented on HUDI-2257: -- nsivabalan commented on pull request #3375: URL:

[GitHub] [hudi] veenaypatil closed pull request #3375: [HUDI-2257] Adding note to set Keygen class while deleting data

2021-08-05 Thread GitBox
veenaypatil closed pull request #3375: URL: https://github.com/apache/hudi/pull/3375 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail:

[GitHub] [hudi] nsivabalan commented on a change in pull request #3233: [HUDI-1138] Add timeline-server-based marker file strategy for improving marker-related latency

2021-08-05 Thread GitBox
nsivabalan commented on a change in pull request #3233: URL: https://github.com/apache/hudi/pull/3233#discussion_r683052454 ## File path: hudi-common/src/main/java/org/apache/hudi/common/fs/FSUtils.java ## @@ -601,4 +604,84 @@ public static HoodieWrapperFileSystem getFs(String

[jira] [Commented] (HUDI-1138) Re-implement marker files via timeline server

2021-08-05 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HUDI-1138?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17393927#comment-17393927 ] ASF GitHub Bot commented on HUDI-1138: -- nsivabalan commented on a change in pull request #3233: URL:

[jira] [Commented] (HUDI-2208) [SQL] Support Bulk Insert For Spark Sql

2021-08-05 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HUDI-2208?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17393903#comment-17393903 ] ASF GitHub Bot commented on HUDI-2208: -- hudi-bot edited a comment on pull request #3328: URL:

[jira] [Commented] (HUDI-1842) [SQL] Spark Sql Support For The Exists Hoodie Table

2021-08-05 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HUDI-1842?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17393965#comment-17393965 ] ASF GitHub Bot commented on HUDI-1842: -- hudi-bot edited a comment on pull request #3393: URL:

[jira] [Created] (HUDI-2279) Support column name matching for insert * and update set * when sourceTable's columns contains all targetTable's columns

2021-08-05 Thread Jira
董可伦 created HUDI-2279: - Summary: Support column name matching for insert * and update set * when sourceTable's columns contains all targetTable's columns Key: HUDI-2279 URL: https://issues.apache.org/jira/browse/HUDI-2279

[jira] [Commented] (HUDI-2274) Allows INSERT duplicates for Flink MOR table

2021-08-05 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HUDI-2274?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17394034#comment-17394034 ] ASF GitHub Bot commented on HUDI-2274: -- danny0405 opened a new pull request #3403: URL:

[jira] [Commented] (HUDI-2274) Allows INSERT duplicates for Flink MOR table

2021-08-05 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HUDI-2274?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17394033#comment-17394033 ] ASF GitHub Bot commented on HUDI-2274: -- danny0405 closed pull request #3403: URL:

[jira] [Commented] (HUDI-2182) Support Compaction Command For Spark Sql

2021-08-05 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HUDI-2182?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17394056#comment-17394056 ] ASF GitHub Bot commented on HUDI-2182: -- hudi-bot edited a comment on pull request #3277: URL:

[GitHub] [hudi] hudi-bot edited a comment on pull request #3277: [HUDI-2182] Support Compaction Command For Spark Sql

2021-08-05 Thread GitBox
hudi-bot edited a comment on pull request #3277: URL: https://github.com/apache/hudi/pull/3277#issuecomment-880506300 ## CI report: * 7b570f6bc38c8843a81eed76eaaeb280bf9ded05 Azure:

[jira] [Created] (HUDI-2280) Azure CI build and test different spark and scala versions

2021-08-05 Thread Raymond Xu (Jira)
Raymond Xu created HUDI-2280: Summary: Azure CI build and test different spark and scala versions Key: HUDI-2280 URL: https://issues.apache.org/jira/browse/HUDI-2280 Project: Apache Hudi Issue

[jira] [Commented] (HUDI-2187) Hive integration Improvment

2021-08-05 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HUDI-2187?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17393925#comment-17393925 ] ASF GitHub Bot commented on HUDI-2187: -- hudi-bot edited a comment on pull request #3289: URL:

[GitHub] [hudi] hudi-bot commented on pull request #3408: [MINOR] Move to ubuntu-latest for Azure CI

2021-08-05 Thread GitBox
hudi-bot commented on pull request #3408: URL: https://github.com/apache/hudi/pull/3408#issuecomment-892925161 ## CI report: * f3c307c39786779117314c2164a3b982945784cb UNKNOWN Bot commands @hudi-bot supports the following commands: - `@hudi-bot run travis`

[GitHub] [hudi] danny0405 commented on pull request #3325: [WIP] Fixing payload instantiation to include preCombine field in LogRecordScanner

2021-08-05 Thread GitBox
danny0405 commented on pull request #3325: URL: https://github.com/apache/hudi/pull/3325#issuecomment-89385 We have moved to https://github.com/apache/hudi/pull/3401, please review if you have time. -- This is an automated message from the Apache Git Service. To respond to the

[jira] [Commented] (HUDI-1887) Make schema post processor's default as disabled

2021-08-05 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HUDI-1887?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17393924#comment-17393924 ] ASF GitHub Bot commented on HUDI-1887: -- vinothchandar commented on pull request #2911: URL:

[jira] [Commented] (HUDI-1842) [SQL] Spark Sql Support For The Exists Hoodie Table

2021-08-05 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HUDI-1842?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17393938#comment-17393938 ] ASF GitHub Bot commented on HUDI-1842: -- hudi-bot edited a comment on pull request #3393: URL:

[GitHub] [hudi] hudi-bot edited a comment on pull request #3330: [HUDI-2101][RFC-28]support z-order for hudi

2021-08-05 Thread GitBox
hudi-bot edited a comment on pull request #3330: URL: https://github.com/apache/hudi/pull/3330#issuecomment-885350571 ## CI report: * c76a7f280b74ae9cc971754e7731c2196c0a3983 Azure:

[jira] [Commented] (HUDI-2101) support z-order for hudi

2021-08-05 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HUDI-2101?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17393945#comment-17393945 ] ASF GitHub Bot commented on HUDI-2101: -- hudi-bot edited a comment on pull request #3330: URL:

[GitHub] [hudi] nsivabalan edited a comment on issue #2409: [SUPPORT] Spark structured Streaming writes to Hudi and synchronizes Hive to create only read-optimized tables without creating real-time ta

2021-08-05 Thread GitBox
nsivabalan edited a comment on issue #2409: URL: https://github.com/apache/hudi/issues/2409#issuecomment-893436528 @dude0001 : Did you open up a new github issue? usually table rename exception happens if your table name in hudi mismatches w/ that in hive. Is there any case sensitivity

[GitHub] [hudi] nsivabalan commented on issue #2409: [SUPPORT] Spark structured Streaming writes to Hudi and synchronizes Hive to create only read-optimized tables without creating real-time tables

2021-08-05 Thread GitBox
nsivabalan commented on issue #2409: URL: https://github.com/apache/hudi/issues/2409#issuecomment-893436528 @dude0001 : Did you open up a new github issue? usually table rename exception happens if your table name in hudi mismatches w/ that in hive. Is there any case sensitivity that

[jira] [Commented] (HUDI-2233) [SQL] Hive sync is not working

2021-08-05 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HUDI-2233?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17394028#comment-17394028 ] ASF GitHub Bot commented on HUDI-2233: -- nsivabalan merged pull request #3387: URL:

[jira] [Commented] (HUDI-2279) Support column name matching for insert * and update set * in merge into when sourceTable's columns contains all targetTable's columns

2021-08-05 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HUDI-2279?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17394106#comment-17394106 ] ASF GitHub Bot commented on HUDI-2279: -- dongkelun opened a new pull request #3415: URL:

[jira] [Updated] (HUDI-2279) Support column name matching for insert * and update set * in merge into when sourceTable's columns contains all targetTable's columns

2021-08-05 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HUDI-2279?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated HUDI-2279: - Labels: pull-request-available (was: ) > Support column name matching for insert * and update

[jira] [Updated] (HUDI-2280) Azure CI build and test different spark and scala versions

2021-08-05 Thread Raymond Xu (Jira)
[ https://issues.apache.org/jira/browse/HUDI-2280?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Raymond Xu updated HUDI-2280: - Description: Migrate to test with Spark 3 + Scala 2.12 Additional build task for Spark 2 + Scala 2.11  

[GitHub] [hudi] hudi-bot edited a comment on pull request #3330: [HUDI-2101][RFC-28]support z-order for hudi

2021-08-05 Thread GitBox
hudi-bot edited a comment on pull request #3330: URL: https://github.com/apache/hudi/pull/3330#issuecomment-885350571 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To

[GitHub] [hudi] vingov commented on pull request #3375: [HUDI-2257] Adding note to set Keygen class while deleting data

2021-08-05 Thread GitBox
vingov commented on pull request #3375: URL: https://github.com/apache/hudi/pull/3375#issuecomment-892796613 Thanks, @nsivabalan! I pushed multiple changes after the site was rebuilt, all the tests were passed. AFAIK, the asf-site build works as expected. -- This is an automated

[jira] [Commented] (HUDI-2187) Hive integration Improvment

2021-08-05 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HUDI-2187?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17393917#comment-17393917 ] ASF GitHub Bot commented on HUDI-2187: -- zhangminglei commented on pull request #3289: URL:

[jira] [Commented] (HUDI-2101) support z-order for hudi

2021-08-05 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HUDI-2101?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17393919#comment-17393919 ] ASF GitHub Bot commented on HUDI-2101: -- hudi-bot edited a comment on pull request #3330: URL:

[jira] [Commented] (HUDI-2257) Add a note to set keygenerator class while deleting data

2021-08-05 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HUDI-2257?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17393920#comment-17393920 ] ASF GitHub Bot commented on HUDI-2257: -- vingov commented on pull request #3375: URL:

[GitHub] [hudi] sannidhiteredesai commented on issue #3399: [SUPPORT] How to purge older partitions in hudi partitioned tables ?

2021-08-05 Thread GitBox
sannidhiteredesai commented on issue #3399: URL: https://github.com/apache/hudi/issues/3399#issuecomment-893214335 Hi Siva, Yes I am using spark datasource. So, I use this for table upserts: df.write.format("hudi"). -- This is an automated message from the Apache

[GitHub] [hudi] umehrot2 commented on pull request #3383: [HUDI-2151] Enable defaults for out of box performance

2021-08-05 Thread GitBox
umehrot2 commented on pull request #3383: URL: https://github.com/apache/hudi/pull/3383#issuecomment-893072921 Put out a separate PR to enable metadata, as enabling some of these might be more involved https://github.com/apache/hudi/pull/3411 . Keeping this PR open, and will use this to

[GitHub] [hudi] hudi-bot edited a comment on pull request #3387: [HUDI-2233] Use HMS To Sync Hive Meta For Spark Sql

2021-08-05 Thread GitBox
hudi-bot edited a comment on pull request #3387: URL: https://github.com/apache/hudi/pull/3387#issuecomment-891570386 ## CI report: * dae0d69eade3ba95d39e37c1851a56534f80e007 UNKNOWN * 6043d6a54b7e2d70a071f556b4eb3da8e3992e2c UNKNOWN *

[GitHub] [hudi] hudi-bot edited a comment on pull request #3328: [HUDI-2208] Support Bulk Insert For Spark Sql

2021-08-05 Thread GitBox
hudi-bot edited a comment on pull request #3328: URL: https://github.com/apache/hudi/pull/3328#issuecomment-884869427 ## CI report: * 9c9f804618dd0275abdae10673c21bf1f5737caf UNKNOWN * 50539ec543951e7a4442798ac7c66e5dc3d3705a UNKNOWN *

[GitHub] [hudi] hudi-bot edited a comment on pull request #3393: [HUDI-1842] Spark Sql Support For The Exists Hoodie Table

2021-08-05 Thread GitBox
hudi-bot edited a comment on pull request #3393: URL: https://github.com/apache/hudi/pull/3393#issuecomment-891812944 ## CI report: * 6952cc701cda4b7f1f7fde9896d2bce0b2a4b66b Azure:

[hudi] branch master updated: [HUDI-2233] Use HMS To Sync Hive Meta For Spark Sql (#3387)

2021-08-05 Thread sivabalan
This is an automated email from the ASF dual-hosted git repository. sivabalan pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/hudi.git The following commit(s) were added to refs/heads/master by this push: new 0dcd6a8 [HUDI-2233] Use HMS To Sync Hive Meta

[GitHub] [hudi] nsivabalan merged pull request #3387: [HUDI-2233] Use HMS To Sync Hive Meta For Spark Sql

2021-08-05 Thread GitBox
nsivabalan merged pull request #3387: URL: https://github.com/apache/hudi/pull/3387 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail:

[jira] [Commented] (HUDI-1985) Website re-design implementation

2021-08-05 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HUDI-1985?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17394025#comment-17394025 ] ASF GitHub Bot commented on HUDI-1985: -- vinothchandar merged pull request #3410: URL:

[GitHub] [hudi] nsivabalan commented on pull request #2911: [HUDI-1887] Setting default value to false for enabling schema post processor

2021-08-05 Thread GitBox
nsivabalan commented on pull request #2911: URL: https://github.com/apache/hudi/pull/2911#issuecomment-893109348 @vinothchandar : If you are good with the patch, I can rebase and land it. -- This is an automated message from the Apache Git Service. To respond to the message, please log

[GitHub] [hudi] vingov commented on pull request #3405: [HUDI-1985] Added algolia search to the site + fixed broken links on the blog

2021-08-05 Thread GitBox
vingov commented on pull request #3405: URL: https://github.com/apache/hudi/pull/3405#issuecomment-892832349 Search bar in my local: ![Screen Shot 2021-08-04 at 10 16 22 AM](https://user-images.githubusercontent.com/1142498/128225323-1710b662-d8c3-4482-b268-fd9b309986c1.png)

[jira] [Commented] (HUDI-2273) Bring down the total test run time with CI

2021-08-05 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HUDI-2273?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17393908#comment-17393908 ] ASF GitHub Bot commented on HUDI-2273: -- nsivabalan commented on a change in pull request #3398: URL:

[GitHub] [hudi] hudi-bot edited a comment on pull request #3360: [HUDI-2243] Support Time Travel Query For Hoodie Table

2021-08-05 Thread GitBox
hudi-bot edited a comment on pull request #3360: URL: https://github.com/apache/hudi/pull/3360#issuecomment-888079450 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To

[GitHub] [hudi] hudi-bot commented on pull request #3413: [HUDI-2277] Let HoodieDeltaStreamer reading ORC files directly using ORCDFSSource

2021-08-05 Thread GitBox
hudi-bot commented on pull request #3413: URL: https://github.com/apache/hudi/pull/3413#issuecomment-893311636 ## CI report: * 45fbd4f73a6ccd0918e545702900351a2ed1070b UNKNOWN Bot commands @hudi-bot supports the following commands: - `@hudi-bot run travis`

[GitHub] [hudi] vinothchandar commented on pull request #2911: [HUDI-1887] Setting default value to false for enabling schema post processor

2021-08-05 Thread GitBox
vinothchandar commented on pull request #2911: URL: https://github.com/apache/hudi/pull/2911#issuecomment-892929973 I am marking this a non-blocker. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to

[jira] [Commented] (HUDI-2151) Make performant out-of-box configs

2021-08-05 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HUDI-2151?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17393922#comment-17393922 ] ASF GitHub Bot commented on HUDI-2151: -- umehrot2 commented on pull request #3383: URL:

[GitHub] [hudi] hudi-bot edited a comment on pull request #3289: [HUDI-2187] Add a shim layer to support multiple hive version

2021-08-05 Thread GitBox
hudi-bot edited a comment on pull request #3289: URL: https://github.com/apache/hudi/pull/3289#issuecomment-881900670 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To

[jira] [Updated] (HUDI-2279) Support column name matching for insert * and update set * in merge into when sourceTable's columns contains all targetTable's columns

2021-08-05 Thread Jira
[ https://issues.apache.org/jira/browse/HUDI-2279?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] 董可伦 updated HUDI-2279: -- Summary: Support column name matching for insert * and update set * in merge into when sourceTable's columns contains

[GitHub] [hudi] dongkelun opened a new pull request #3415: [HUDI-2279]Support column name matching for insert * and update set *

2021-08-05 Thread GitBox
dongkelun opened a new pull request #3415: URL: https://github.com/apache/hudi/pull/3415 ## What is the purpose of the pull request Support column name matching for insert * and update set * in merge into when sourceTable's columns contains all targetTable's columns ##

[GitHub] [hudi] dude0001 commented on issue #2409: [SUPPORT] Spark structured Streaming writes to Hudi and synchronizes Hive to create only read-optimized tables without creating real-time tables

2021-08-05 Thread GitBox
dude0001 commented on issue #2409: URL: https://github.com/apache/hudi/issues/2409#issuecomment-893584529 I apologize, I did not open a new issue as I've been in meetings and working on production stories. I got back to my POC this morning, and prove your theory correct. Renaming my table

[GitHub] [hudi] hudi-bot edited a comment on pull request #3409: [MINOR] Move to ubuntu-latest for Azure CI

2021-08-05 Thread GitBox
hudi-bot edited a comment on pull request #3409: URL: https://github.com/apache/hudi/pull/3409#issuecomment-892942265 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To

[jira] [Commented] (HUDI-2278) Use INT64 timestamp with precision 3 for flink parquet writer

2021-08-05 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HUDI-2278?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17393939#comment-17393939 ] ASF GitHub Bot commented on HUDI-2278: -- danny0405 opened a new pull request #3414: URL:

[GitHub] [hudi] danny0405 opened a new pull request #3414: [HUDI-2278] Use INT64 timestamp with precision 3 for flink parquet wr…

2021-08-05 Thread GitBox
danny0405 opened a new pull request #3414: URL: https://github.com/apache/hudi/pull/3414 …iter ## *Tips* - *Thank you very much for contributing to Apache Hudi.* - *Please review https://hudi.apache.org/contributing.html before opening a pull request.* ## What is the

[GitHub] [hudi] hudi-bot edited a comment on pull request #3393: [HUDI-1842] Spark Sql Support For The Exists Hoodie Table

2021-08-05 Thread GitBox
hudi-bot edited a comment on pull request #3393: URL: https://github.com/apache/hudi/pull/3393#issuecomment-891812944 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To

[jira] [Commented] (HUDI-2182) Support Compaction Command For Spark Sql

2021-08-05 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HUDI-2182?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17393956#comment-17393956 ] ASF GitHub Bot commented on HUDI-2182: -- hudi-bot edited a comment on pull request #3277: URL:

[GitHub] [hudi] hudi-bot edited a comment on pull request #3277: [HUDI-2182] Support Compaction Command For Spark Sql

2021-08-05 Thread GitBox
hudi-bot edited a comment on pull request #3277: URL: https://github.com/apache/hudi/pull/3277#issuecomment-880506300 ## CI report: * 0eeef02b58baa7ade8fc0196c2c16c165daafcdf Azure:

[GitHub] [hudi] nsivabalan commented on pull request #3409: [MINOR] Move to ubuntu-18.04 for Azure CI

2021-08-05 Thread GitBox
nsivabalan commented on pull request #3409: URL: https://github.com/apache/hudi/pull/3409#issuecomment-893439469 sure. go ahead. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific

[GitHub] [hudi] hudi-bot edited a comment on pull request #3328: [HUDI-2208] Support Bulk Insert For Spark Sql

2021-08-05 Thread GitBox
hudi-bot edited a comment on pull request #3328: URL: https://github.com/apache/hudi/pull/3328#issuecomment-884869427 ## CI report: * 9c9f804618dd0275abdae10673c21bf1f5737caf UNKNOWN * 50539ec543951e7a4442798ac7c66e5dc3d3705a UNKNOWN *

[GitHub] [hudi] hudi-bot edited a comment on pull request #3330: [HUDI-2101][RFC-28]support z-order for hudi

2021-08-05 Thread GitBox
hudi-bot edited a comment on pull request #3330: URL: https://github.com/apache/hudi/pull/3330#issuecomment-885350571 ## CI report: * b3d274d5a0962ba9a7c7a35590bff03a96802bd8 Azure:

[GitHub] [hudi] xushiyan commented on pull request #3409: [MINOR] Move to ubuntu-18.04 for Azure CI

2021-08-05 Thread GitBox
xushiyan commented on pull request #3409: URL: https://github.com/apache/hudi/pull/3409#issuecomment-893604097 @vinothchandar @nsivabalan agreed. noted down this in https://issues.apache.org/jira/browse/HUDI-2280 I can take a look this weekend. -- This is an automated message from

[GitHub] [hudi] nsivabalan commented on a change in pull request #3398: [HUDI-2273] Moving some long running tests to functional

2021-08-05 Thread GitBox
nsivabalan commented on a change in pull request #3398: URL: https://github.com/apache/hudi/pull/3398#discussion_r683040733 ## File path: hudi-client/hudi-spark-client/src/test/java/org/apache/hudi/client/functional/SparkClientFunctionalTestSuite.java ## @@ -0,0 +1,32 @@ +/*

[jira] [Commented] (HUDI-1985) Website re-design implementation

2021-08-05 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HUDI-1985?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17393905#comment-17393905 ] ASF GitHub Bot commented on HUDI-1985: -- vingov commented on pull request #3405: URL:

[jira] [Commented] (HUDI-1887) Make schema post processor's default as disabled

2021-08-05 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HUDI-1887?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17393907#comment-17393907 ] ASF GitHub Bot commented on HUDI-1887: -- nsivabalan commented on pull request #2911: URL:

[GitHub] [hudi] vinothchandar merged pull request #3405: [HUDI-1985] Added algolia search to the site + fixed broken links on the blog

2021-08-05 Thread GitBox
vinothchandar merged pull request #3405: URL: https://github.com/apache/hudi/pull/3405 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail:

[jira] [Commented] (HUDI-1985) Website re-design implementation

2021-08-05 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HUDI-1985?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17393916#comment-17393916 ] ASF GitHub Bot commented on HUDI-1985: -- vinothchandar merged pull request #3405: URL:

[jira] [Commented] (HUDI-2257) Add a note to set keygenerator class while deleting data

2021-08-05 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HUDI-2257?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17393915#comment-17393915 ] ASF GitHub Bot commented on HUDI-2257: -- veenaypatil closed pull request #3375: URL:

[GitHub] [hudi] nsivabalan commented on pull request #3375: [HUDI-2257] Adding note to set Keygen class while deleting data

2021-08-05 Thread GitBox
nsivabalan commented on pull request #3375: URL: https://github.com/apache/hudi/pull/3375#issuecomment-892618121 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To

[GitHub] [hudi] danny0405 merged pull request #3390: [HUDI-2087] Support Append only in Flink stream

2021-08-05 Thread GitBox
danny0405 merged pull request #3390: URL: https://github.com/apache/hudi/pull/3390 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail:

[jira] [Commented] (HUDI-2087) Support Append only in Flink stream

2021-08-05 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HUDI-2087?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17393913#comment-17393913 ] ASF GitHub Bot commented on HUDI-2087: -- danny0405 merged pull request #3390: URL:

[GitHub] [hudi] zhangminglei commented on pull request #3289: [HUDI-2187] Add a shim layer to support multiple hive version

2021-08-05 Thread GitBox
zhangminglei commented on pull request #3289: URL: https://github.com/apache/hudi/pull/3289#issuecomment-893146261 trigger again... -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific

[GitHub] [hudi] vinothchandar merged pull request #3410: [HUDI-1985] Added babel dev dependencies to avoid build failures.

2021-08-05 Thread GitBox
vinothchandar merged pull request #3410: URL: https://github.com/apache/hudi/pull/3410 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail:

[jira] [Commented] (HUDI-2101) support z-order for hudi

2021-08-05 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HUDI-2101?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17394024#comment-17394024 ] ASF GitHub Bot commented on HUDI-2101: -- hudi-bot edited a comment on pull request #3330: URL:

[hudi] branch asf-site updated: [HUDI-1985] Added babel dev dependencies to avoid build failures. (#3410)

2021-08-05 Thread vinoth
This is an automated email from the ASF dual-hosted git repository. vinoth pushed a commit to branch asf-site in repository https://gitbox.apache.org/repos/asf/hudi.git The following commit(s) were added to refs/heads/asf-site by this push: new 301fb24 [HUDI-1985] Added babel dev

[jira] [Updated] (HUDI-2279) Support column name matching for insert * and update set * when sourceTable's columns contains all targetTable's columns

2021-08-05 Thread Jira
[ https://issues.apache.org/jira/browse/HUDI-2279?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] 董可伦 updated HUDI-2279: -- Description: Example: {code:java} val tableName = generateTableName // Create table spark.sql( s""" |create table

[jira] [Commented] (HUDI-2279) Support column name matching for insert * and update set * in merge into when sourceTable's columns contains all targetTable's columns

2021-08-05 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HUDI-2279?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17394110#comment-17394110 ] ASF GitHub Bot commented on HUDI-2279: -- hudi-bot edited a comment on pull request #3415: URL:

[GitHub] [hudi] hudi-bot edited a comment on pull request #3415: [HUDI-2279]Support column name matching for insert * and update set *

2021-08-05 Thread GitBox
hudi-bot edited a comment on pull request #3415: URL: https://github.com/apache/hudi/pull/3415#issuecomment-893539789 ## CI report: * 10b2dc9c80f373a90f0140507fb20b85dfcf30d5 Azure:

[jira] [Updated] (HUDI-2278) Use INT64 timestamp with precision 3 for flink parquet writer

2021-08-05 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HUDI-2278?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated HUDI-2278: - Labels: pull-request-available (was: ) > Use INT64 timestamp with precision 3 for flink parquet

[jira] [Commented] (HUDI-2278) Use INT64 timestamp with precision 3 for flink parquet writer

2021-08-05 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HUDI-2278?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17393937#comment-17393937 ] ASF GitHub Bot commented on HUDI-2278: -- hudi-bot commented on pull request #3414: URL:

[jira] [Commented] (HUDI-2278) Use INT64 timestamp with precision 3 for flink parquet writer

2021-08-05 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HUDI-2278?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17393936#comment-17393936 ] ASF GitHub Bot commented on HUDI-2278: -- hudi-bot edited a comment on pull request #3414: URL:

[jira] [Commented] (HUDI-2233) [SQL] Hive sync is not working

2021-08-05 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HUDI-2233?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17393932#comment-17393932 ] ASF GitHub Bot commented on HUDI-2233: -- hudi-bot edited a comment on pull request #3387: URL:

[GitHub] [hudi] hudi-bot edited a comment on pull request #3414: [HUDI-2278] Use INT64 timestamp with precision 3 for flink parquet wr…

2021-08-05 Thread GitBox
hudi-bot edited a comment on pull request #3414: URL: https://github.com/apache/hudi/pull/3414#issuecomment-893397192 ## CI report: * 1fca7df825c95dd45fdcc73864437440f2a73531 Azure:

[GitHub] [hudi] hudi-bot commented on pull request #3414: [HUDI-2278] Use INT64 timestamp with precision 3 for flink parquet wr…

2021-08-05 Thread GitBox
hudi-bot commented on pull request #3414: URL: https://github.com/apache/hudi/pull/3414#issuecomment-893397192 ## CI report: * 1fca7df825c95dd45fdcc73864437440f2a73531 UNKNOWN Bot commands @hudi-bot supports the following commands: - `@hudi-bot run travis`

[jira] [Commented] (HUDI-2208) [SQL] Support Bulk Insert For Spark Sql

2021-08-05 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HUDI-2208?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17393933#comment-17393933 ] ASF GitHub Bot commented on HUDI-2208: -- pengzhiwei2018 commented on pull request #3328: URL:

[GitHub] [hudi] hudi-bot edited a comment on pull request #3387: [HUDI-2233] Use HMS To Sync Hive Meta For Spark Sql

2021-08-05 Thread GitBox
hudi-bot edited a comment on pull request #3387: URL: https://github.com/apache/hudi/pull/3387#issuecomment-891570386 ## CI report: * dae0d69eade3ba95d39e37c1851a56534f80e007 UNKNOWN * 6043d6a54b7e2d70a071f556b4eb3da8e3992e2c UNKNOWN *

[jira] [Commented] (HUDI-2101) support z-order for hudi

2021-08-05 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HUDI-2101?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17393949#comment-17393949 ] ASF GitHub Bot commented on HUDI-2101: -- hudi-bot edited a comment on pull request #3330: URL:

[GitHub] [hudi] hudi-bot edited a comment on pull request #3330: [HUDI-2101][RFC-28]support z-order for hudi

2021-08-05 Thread GitBox
hudi-bot edited a comment on pull request #3330: URL: https://github.com/apache/hudi/pull/3330#issuecomment-885350571 ## CI report: * c76a7f280b74ae9cc971754e7731c2196c0a3983 Azure:

[jira] [Commented] (HUDI-2279) Support column name matching for insert * and update set * in merge into when sourceTable's columns contains all targetTable's columns

2021-08-05 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HUDI-2279?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17394107#comment-17394107 ] ASF GitHub Bot commented on HUDI-2279: -- hudi-bot commented on pull request #3415: URL:

[jira] [Commented] (HUDI-2268) Upgrade hoodie table to 0.9.0

2021-08-05 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HUDI-2268?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17393929#comment-17393929 ] ASF GitHub Bot commented on HUDI-2268: -- nsivabalan opened a new pull request #3407: URL:

[GitHub] [hudi] pengzhiwei2018 commented on pull request #3328: [HUDI-2208] Support Bulk Insert For Spark Sql

2021-08-05 Thread GitBox
pengzhiwei2018 commented on pull request #3328: URL: https://github.com/apache/hudi/pull/3328#issuecomment-893396472 @vinothchandar @nsivabalan The PR has updated with the follow changes: 1、Allow bulk insert for pk-table. I introduce a config: `hoodie.sql.insert.mode` . If set to

[jira] [Commented] (HUDI-2208) [SQL] Support Bulk Insert For Spark Sql

2021-08-05 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HUDI-2208?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17393942#comment-17393942 ] ASF GitHub Bot commented on HUDI-2208: -- hudi-bot edited a comment on pull request #3328: URL:

[jira] [Commented] (HUDI-2233) [SQL] Hive sync is not working

2021-08-05 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HUDI-2233?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17393943#comment-17393943 ] ASF GitHub Bot commented on HUDI-2233: -- hudi-bot edited a comment on pull request #3387: URL:

[jira] [Commented] (HUDI-2182) Support Compaction Command For Spark Sql

2021-08-05 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HUDI-2182?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17393959#comment-17393959 ] ASF GitHub Bot commented on HUDI-2182: -- hudi-bot edited a comment on pull request #3277: URL:

  1   2   3   4   5   >