[jira] [Commented] (HUDI-1842) [SQL] Spark Sql Support For The Exists Hoodie Table

2021-08-03 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HUDI-1842?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17392739#comment-17392739 ] ASF GitHub Bot commented on HUDI-1842: -- hudi-bot edited a comment on pull request #3393: URL:

[GitHub] [hudi] hudi-bot edited a comment on pull request #3393: [HUDI-1842] Spark Sql Support For The Exists Hoodie Table

2021-08-03 Thread GitBox
hudi-bot edited a comment on pull request #3393: URL: https://github.com/apache/hudi/pull/3393#issuecomment-891812944 ## CI report: * 53186a44289eb1740d15d0b35afc9d9f3c9f5904 Azure:

[jira] [Commented] (HUDI-2273) Bring down the total test run time with CI

2021-08-03 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HUDI-2273?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17392731#comment-17392731 ] ASF GitHub Bot commented on HUDI-2273: -- nsivabalan commented on a change in pull request #3398: URL:

[GitHub] [hudi] nsivabalan commented on a change in pull request #3398: [HUDI-2273] Moving some long running tests to functional

2021-08-03 Thread GitBox
nsivabalan commented on a change in pull request #3398: URL: https://github.com/apache/hudi/pull/3398#discussion_r682303297 ## File path: hudi-sync/hudi-hive-sync/src/test/java/org/apache/hudi/hive/functional/HiveSyncFunctionalTestSuite.java ## @@ -25,7 +25,7 @@ import

[jira] [Commented] (HUDI-2273) Bring down the total test run time with CI

2021-08-03 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HUDI-2273?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17392727#comment-17392727 ] ASF GitHub Bot commented on HUDI-2273: -- hudi-bot edited a comment on pull request #3398: URL:

[GitHub] [hudi] hudi-bot edited a comment on pull request #3398: [HUDI-2273] Moving some long running tests to functional

2021-08-03 Thread GitBox
hudi-bot edited a comment on pull request #3398: URL: https://github.com/apache/hudi/pull/3398#issuecomment-892305785 ## CI report: * 0a32f4afcbf92b85e51b12de7af26b918d58a549 UNKNOWN * acbedb531fdbade17ba78c53cb23786f04ea8cb8 Azure:

[jira] [Commented] (HUDI-922) [UMBRELLA] Transfer out of the Incubator

2021-08-03 Thread Vinoth Chandar (Jira)
[ https://issues.apache.org/jira/browse/HUDI-922?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17392725#comment-17392725 ] Vinoth Chandar commented on HUDI-922: - nah. we can close this. > [UMBRELLA] Transfer out of the

[jira] [Resolved] (HUDI-922) [UMBRELLA] Transfer out of the Incubator

2021-08-03 Thread Vinoth Chandar (Jira)
[ https://issues.apache.org/jira/browse/HUDI-922?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vinoth Chandar resolved HUDI-922. - Resolution: Fixed > [UMBRELLA] Transfer out of the Incubator >

[jira] [Resolved] (HUDI-937) Site content revamp ahead of graduation

2021-08-03 Thread Vinoth Chandar (Jira)
[ https://issues.apache.org/jira/browse/HUDI-937?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vinoth Chandar resolved HUDI-937. - Resolution: Fixed > Site content revamp ahead of graduation >

[jira] [Resolved] (HUDI-929) Update the Incubator status records

2021-08-03 Thread Vinoth Chandar (Jira)
[ https://issues.apache.org/jira/browse/HUDI-929?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vinoth Chandar resolved HUDI-929. - Resolution: Fixed > Update the Incubator status records > --- > >

[jira] [Commented] (HUDI-2199) DynamoDB based external index implementation

2021-08-03 Thread Vinoth Chandar (Jira)
[ https://issues.apache.org/jira/browse/HUDI-2199?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17392723#comment-17392723 ] Vinoth Chandar commented on HUDI-2199: -- > it creates a table for each table name ingested or it uses

[GitHub] [hudi] garyli1019 commented on issue #3301: [SUPPORT] Deltastreamer cannot pattern match from AWS s3 files with wildcard

2021-08-03 Thread GitBox
garyli1019 commented on issue #3301: URL: https://github.com/apache/hudi/issues/3301#issuecomment-892370496 hello @chb77 , ParquetDFSSource doesn't support wildcard. You can define a root path and set up a sourceLimit to each run. Delta Streamer will load files based on their latest

[jira] [Commented] (HUDI-2273) Bring down the total test run time with CI

2021-08-03 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HUDI-2273?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17392722#comment-17392722 ] ASF GitHub Bot commented on HUDI-2273: -- hudi-bot edited a comment on pull request #3398: URL:

[jira] [Commented] (HUDI-2273) Bring down the total test run time with CI

2021-08-03 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HUDI-2273?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17392721#comment-17392721 ] ASF GitHub Bot commented on HUDI-2273: -- vinothchandar commented on a change in pull request #3398:

[GitHub] [hudi] hudi-bot edited a comment on pull request #3398: [HUDI-2273] Moving some long running tests to functional

2021-08-03 Thread GitBox
hudi-bot edited a comment on pull request #3398: URL: https://github.com/apache/hudi/pull/3398#issuecomment-892305785 ## CI report: * 0a32f4afcbf92b85e51b12de7af26b918d58a549 UNKNOWN * acbedb531fdbade17ba78c53cb23786f04ea8cb8 Azure:

[GitHub] [hudi] vinothchandar commented on a change in pull request #3398: [HUDI-2273] Moving some long running tests to functional

2021-08-03 Thread GitBox
vinothchandar commented on a change in pull request #3398: URL: https://github.com/apache/hudi/pull/3398#discussion_r682293294 ## File path: hudi-sync/hudi-hive-sync/src/test/java/org/apache/hudi/hive/functional/HiveSyncFunctionalTestSuite.java ## @@ -25,7 +25,7 @@ import

[jira] [Commented] (HUDI-2273) Bring down the total test run time with CI

2021-08-03 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HUDI-2273?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17392720#comment-17392720 ] ASF GitHub Bot commented on HUDI-2273: -- vinothchandar commented on a change in pull request #3398:

[GitHub] [hudi] vinothchandar commented on a change in pull request #3398: [HUDI-2273] Moving some long running tests to functional

2021-08-03 Thread GitBox
vinothchandar commented on a change in pull request #3398: URL: https://github.com/apache/hudi/pull/3398#discussion_r682292940 ## File path: hudi-client/hudi-spark-client/src/test/java/org/apache/hudi/client/functional/SparkClientFunctionalTestSuite.java ## @@ -0,0 +1,32 @@

[jira] [Commented] (HUDI-2273) Bring down the total test run time with CI

2021-08-03 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HUDI-2273?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17392719#comment-17392719 ] ASF GitHub Bot commented on HUDI-2273: -- hudi-bot edited a comment on pull request #3398: URL:

[GitHub] [hudi] hudi-bot edited a comment on pull request #3398: [HUDI-2273] Moving some long running tests to functional

2021-08-03 Thread GitBox
hudi-bot edited a comment on pull request #3398: URL: https://github.com/apache/hudi/pull/3398#issuecomment-892305785 ## CI report: * 0a32f4afcbf92b85e51b12de7af26b918d58a549 UNKNOWN * acbedb531fdbade17ba78c53cb23786f04ea8cb8 Azure:

[jira] [Commented] (HUDI-2273) Bring down the total test run time with CI

2021-08-03 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HUDI-2273?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17392718#comment-17392718 ] ASF GitHub Bot commented on HUDI-2273: -- hudi-bot edited a comment on pull request #3398: URL:

[jira] [Commented] (HUDI-2087) Support Append only in Flink stream

2021-08-03 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HUDI-2087?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17392717#comment-17392717 ] ASF GitHub Bot commented on HUDI-2087: -- hudi-bot edited a comment on pull request #3390: URL:

[GitHub] [hudi] hudi-bot edited a comment on pull request #3398: [HUDI-2273] Moving some long running tests to functional

2021-08-03 Thread GitBox
hudi-bot edited a comment on pull request #3398: URL: https://github.com/apache/hudi/pull/3398#issuecomment-892305785 ## CI report: * 0a32f4afcbf92b85e51b12de7af26b918d58a549 UNKNOWN * acbedb531fdbade17ba78c53cb23786f04ea8cb8 Azure:

[GitHub] [hudi] hudi-bot edited a comment on pull request #3390: [HUDI-2087] Support Append only in Flink stream

2021-08-03 Thread GitBox
hudi-bot edited a comment on pull request #3390: URL: https://github.com/apache/hudi/pull/3390#issuecomment-891674857 ## CI report: * b7cb83fc91ebba1152070307fa4c926889a7da2a Azure:

[jira] [Commented] (HUDI-2273) Bring down the total test run time with CI

2021-08-03 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HUDI-2273?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17392716#comment-17392716 ] ASF GitHub Bot commented on HUDI-2273: -- nsivabalan commented on pull request #3398: URL:

[GitHub] [hudi] nsivabalan commented on pull request #3398: [HUDI-2273] Moving some long running tests to functional

2021-08-03 Thread GitBox
nsivabalan commented on pull request #3398: URL: https://github.com/apache/hudi/pull/3398#issuecomment-892367490 @hudi-bot run azure -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific

[jira] [Updated] (HUDI-2273) Bring down the total test run time with CI

2021-08-03 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HUDI-2273?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated HUDI-2273: - Labels: pull-request-available (was: ) > Bring down the total test run time with CI >

[jira] [Commented] (HUDI-2273) Bring down the total test run time with CI

2021-08-03 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HUDI-2273?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17392715#comment-17392715 ] ASF GitHub Bot commented on HUDI-2273: -- hudi-bot edited a comment on pull request #3398: URL:

[GitHub] [hudi] hudi-bot edited a comment on pull request #3398: [HUDI-2273] Moving some long running tests to functional

2021-08-03 Thread GitBox
hudi-bot edited a comment on pull request #3398: URL: https://github.com/apache/hudi/pull/3398#issuecomment-892305785 ## CI report: * 0a32f4afcbf92b85e51b12de7af26b918d58a549 UNKNOWN * acbedb531fdbade17ba78c53cb23786f04ea8cb8 Azure:

[jira] [Created] (HUDI-2273) Bring down the total test run time with CI

2021-08-03 Thread sivabalan narayanan (Jira)
sivabalan narayanan created HUDI-2273: - Summary: Bring down the total test run time with CI Key: HUDI-2273 URL: https://issues.apache.org/jira/browse/HUDI-2273 Project: Apache Hudi Issue

[jira] [Commented] (HUDI-1842) [SQL] Spark Sql Support For The Exists Hoodie Table

2021-08-03 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HUDI-1842?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17392712#comment-17392712 ] ASF GitHub Bot commented on HUDI-1842: -- nsivabalan edited a comment on pull request #3393: URL:

[GitHub] [hudi] nsivabalan edited a comment on pull request #3393: [HUDI-1842] Spark Sql Support For The Exists Hoodie Table

2021-08-03 Thread GitBox
nsivabalan edited a comment on pull request #3393: URL: https://github.com/apache/hudi/pull/3393#issuecomment-892140145 Hey peng. I did a round of testing on this patch. Here are my findings. Insert into is till prefixing col name to meta fields. (3rd col and 4th col) ```

[jira] [Assigned] (HUDI-2268) Upgrade hoodie table to 0.9.0

2021-08-03 Thread sivabalan narayanan (Jira)
[ https://issues.apache.org/jira/browse/HUDI-2268?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] sivabalan narayanan reassigned HUDI-2268: - Assignee: sivabalan narayanan > Upgrade hoodie table to 0.9.0 >

[GitHub] [hudi] hudi-bot edited a comment on pull request #3398: [WIP] Moving some long running tests to functional

2021-08-03 Thread GitBox
hudi-bot edited a comment on pull request #3398: URL: https://github.com/apache/hudi/pull/3398#issuecomment-892305785 ## CI report: * 0a32f4afcbf92b85e51b12de7af26b918d58a549 UNKNOWN * acbedb531fdbade17ba78c53cb23786f04ea8cb8 Azure:

[GitHub] [hudi] hudi-bot edited a comment on pull request #3398: [WIP] Moving some long running tests to functional

2021-08-03 Thread GitBox
hudi-bot edited a comment on pull request #3398: URL: https://github.com/apache/hudi/pull/3398#issuecomment-892305785 ## CI report: * 789fffca8ce157f80909735eff313b046c9e092c Azure:

[GitHub] [hudi] hudi-bot edited a comment on pull request #3398: [WIP] Moving some long running tests to functional

2021-08-03 Thread GitBox
hudi-bot edited a comment on pull request #3398: URL: https://github.com/apache/hudi/pull/3398#issuecomment-892305785 ## CI report: * 789fffca8ce157f80909735eff313b046c9e092c Azure:

[GitHub] [hudi] hudi-bot edited a comment on pull request #3398: [WIP] Moving some long running tests to functional

2021-08-03 Thread GitBox
hudi-bot edited a comment on pull request #3398: URL: https://github.com/apache/hudi/pull/3398#issuecomment-892305785 ## CI report: * 789fffca8ce157f80909735eff313b046c9e092c Azure:

[GitHub] [hudi] Ambarish-Giri commented on issue #3395: [SUPPORT] Issues with read optimized query MOR table

2021-08-03 Thread GitBox
Ambarish-Giri commented on issue #3395: URL: https://github.com/apache/hudi/issues/3395#issuecomment-892350596 Hi @nsivabalan , I am not executing the spark job from spark-shell I am running the spark driver program from Intellij IDE. By spark-shell launch command I am

[GitHub] [hudi] sannidhiteredesai opened a new issue #3399: [SUPPORT] How to purge older partitions in hudi partitioned tables ?

2021-08-03 Thread GitBox
sannidhiteredesai opened a new issue #3399: URL: https://github.com/apache/hudi/issues/3399 **Question:** How to purge older partitions in hudi partitioned tables ? **Scenario:** - I have a partitioned table that will be created on daily basis. - If everyday a new partition is

[jira] [Commented] (HUDI-2087) Support Append only in Flink stream

2021-08-03 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HUDI-2087?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17392705#comment-17392705 ] ASF GitHub Bot commented on HUDI-2087: -- hudi-bot edited a comment on pull request #3390: URL:

[GitHub] [hudi] hudi-bot edited a comment on pull request #3390: [HUDI-2087] Support Append only in Flink stream

2021-08-03 Thread GitBox
hudi-bot edited a comment on pull request #3390: URL: https://github.com/apache/hudi/pull/3390#issuecomment-891674857 ## CI report: * e88db7d1056d593083d59b7987bee92f5a6b3ae6 Azure:

[jira] [Commented] (HUDI-2087) Support Append only in Flink stream

2021-08-03 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HUDI-2087?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17392704#comment-17392704 ] ASF GitHub Bot commented on HUDI-2087: -- hudi-bot edited a comment on pull request #3390: URL:

[GitHub] [hudi] hudi-bot edited a comment on pull request #3390: [HUDI-2087] Support Append only in Flink stream

2021-08-03 Thread GitBox
hudi-bot edited a comment on pull request #3390: URL: https://github.com/apache/hudi/pull/3390#issuecomment-891674857 ## CI report: * e88db7d1056d593083d59b7987bee92f5a6b3ae6 Azure:

[GitHub] [hudi] hudi-bot edited a comment on pull request #3398: [WIP] Moving some long running tests to functional

2021-08-03 Thread GitBox
hudi-bot edited a comment on pull request #3398: URL: https://github.com/apache/hudi/pull/3398#issuecomment-892305785 ## CI report: * 789fffca8ce157f80909735eff313b046c9e092c Azure:

[GitHub] [hudi] nsivabalan commented on a change in pull request #3398: [WIP] Moving some long running tests to functional

2021-08-03 Thread GitBox
nsivabalan commented on a change in pull request #3398: URL: https://github.com/apache/hudi/pull/3398#discussion_r682271526 ## File path: hudi-utilities/src/test/java/org/apache/hudi/utilities/functional/TestHoodieDeltaStreamer.java ## @@ -115,6 +116,7 @@ /** * Basic tests

[jira] [Commented] (HUDI-2263) Document checkstyle setup

2021-08-03 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HUDI-2263?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17392697#comment-17392697 ] ASF GitHub Bot commented on HUDI-2263: -- vinothchandar commented on pull request #3385: URL:

[GitHub] [hudi] vinothchandar commented on pull request #3385: [HUDI-2263] add steps for checkstyle

2021-08-03 Thread GitBox
vinothchandar commented on pull request #3385: URL: https://github.com/apache/hudi/pull/3385#issuecomment-892342756 @satishmittal can we retarget this on the new site docs. We just moved to docusaurus -- This is an automated message from the Apache Git Service. To respond to the

[jira] [Commented] (HUDI-1985) Website re-design implementation

2021-08-03 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HUDI-1985?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17392696#comment-17392696 ] ASF GitHub Bot commented on HUDI-1985: -- vinothchandar merged pull request #3396: URL:

[GitHub] [hudi] vinothchandar merged pull request #3396: [HUDI-1985] Cleaned up the jekyll files and fixed the title, readme and mobile css

2021-08-03 Thread GitBox
vinothchandar merged pull request #3396: URL: https://github.com/apache/hudi/pull/3396 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail:

[jira] [Commented] (HUDI-2087) Support Append only in Flink stream

2021-08-03 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HUDI-2087?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17392695#comment-17392695 ] ASF GitHub Bot commented on HUDI-2087: -- hudi-bot edited a comment on pull request #3390: URL:

[GitHub] [hudi] vinothchandar commented on a change in pull request #3398: [WIP] Moving some long running tests to functional

2021-08-03 Thread GitBox
vinothchandar commented on a change in pull request #3398: URL: https://github.com/apache/hudi/pull/3398#discussion_r682267498 ## File path: hudi-utilities/src/test/java/org/apache/hudi/utilities/functional/TestHoodieDeltaStreamer.java ## @@ -115,6 +116,7 @@ /** * Basic

[GitHub] [hudi] hudi-bot edited a comment on pull request #3390: [HUDI-2087] Support Append only in Flink stream

2021-08-03 Thread GitBox
hudi-bot edited a comment on pull request #3390: URL: https://github.com/apache/hudi/pull/3390#issuecomment-891674857 ## CI report: * e88db7d1056d593083d59b7987bee92f5a6b3ae6 Azure:

[GitHub] [hudi] vinothchandar commented on pull request #3398: [WIP] Moving some long running tests to functional

2021-08-03 Thread GitBox
vinothchandar commented on pull request #3398: URL: https://github.com/apache/hudi/pull/3398#issuecomment-892341412 https://dev.azure.com/apache-hudi-ci-org/apache-hudi-ci/_build/results?buildId=1345=logs=49186a26-7c18-5ea7-a030-c991549c6bb6 seems to be working? but wondering if there is

[jira] [Commented] (HUDI-2141) Integration flink metric in flink stream

2021-08-03 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HUDI-2141?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17392687#comment-17392687 ] ASF GitHub Bot commented on HUDI-2141: -- yuzhaojing commented on pull request #3235: URL:

[GitHub] [hudi] yuzhaojing commented on pull request #3235: [HUDI-2141] Integration flink metric in flink stream

2021-08-03 Thread GitBox
yuzhaojing commented on pull request #3235: URL: https://github.com/apache/hudi/pull/3235#issuecomment-892331262 > The change is huge, let's move it to 0.10.0 Ok. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and

[GitHub] [hudi] hudi-bot edited a comment on pull request #3398: [WIP] Moving some long running tests to functional

2021-08-03 Thread GitBox
hudi-bot edited a comment on pull request #3398: URL: https://github.com/apache/hudi/pull/3398#issuecomment-892305785 ## CI report: * f8bd430efadd3a37885a3e811c132ba1bf07073d Azure:

[jira] [Commented] (HUDI-1842) [SQL] Spark Sql Support For The Exists Hoodie Table

2021-08-03 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HUDI-1842?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17392685#comment-17392685 ] ASF GitHub Bot commented on HUDI-1842: -- nsivabalan commented on pull request #3393: URL:

[GitHub] [hudi] nsivabalan commented on pull request #3393: [HUDI-1842] Spark Sql Support For The Exists Hoodie Table

2021-08-03 Thread GitBox
nsivabalan commented on pull request #3393: URL: https://github.com/apache/hudi/pull/3393#issuecomment-892329397 > Hey peng. I did a round of testing on this patch. Here are my findings. > > Insert into is till prefixing col name to meta fields. (3rd col and 4th col) > > ```

[GitHub] [hudi] hudi-bot edited a comment on pull request #3398: [WIP] Moving some long running tests to functional

2021-08-03 Thread GitBox
hudi-bot edited a comment on pull request #3398: URL: https://github.com/apache/hudi/pull/3398#issuecomment-892305785 ## CI report: * f8bd430efadd3a37885a3e811c132ba1bf07073d Azure:

[jira] [Commented] (HUDI-2243) Support Time Travel Query For Hoodie Table

2021-08-03 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HUDI-2243?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17392679#comment-17392679 ] ASF GitHub Bot commented on HUDI-2243: -- codope commented on pull request #3360: URL:

[GitHub] [hudi] codope commented on pull request #3360: [HUDI-2243] Support Time Travel Query For Hoodie Table

2021-08-03 Thread GitBox
codope commented on pull request #3360: URL: https://github.com/apache/hudi/pull/3360#issuecomment-892324921 > > @pengzhiwei2018 Thanks for this. Maybe we could have couple of follow on tasks. > > > > 1. Allow user to specify `as.of.instant` in `-MM-DD` to `-MM-DD hh:mm:ss`

[GitHub] [hudi] hudi-bot edited a comment on pull request #3398: [WIP] Moving some long running tests to functional

2021-08-03 Thread GitBox
hudi-bot edited a comment on pull request #3398: URL: https://github.com/apache/hudi/pull/3398#issuecomment-892305785 ## CI report: * f8bd430efadd3a37885a3e811c132ba1bf07073d Azure:

[jira] [Commented] (HUDI-2141) Integration flink metric in flink stream

2021-08-03 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HUDI-2141?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17392678#comment-17392678 ] ASF GitHub Bot commented on HUDI-2141: -- danny0405 commented on pull request #3235: URL:

[GitHub] [hudi] danny0405 commented on pull request #3235: [HUDI-2141] Integration flink metric in flink stream

2021-08-03 Thread GitBox
danny0405 commented on pull request #3235: URL: https://github.com/apache/hudi/pull/3235#issuecomment-892324047 The change is huge, let's move it to 0.10.0 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL

[jira] [Commented] (HUDI-2087) Support Append only in Flink stream

2021-08-03 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HUDI-2087?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17392677#comment-17392677 ] ASF GitHub Bot commented on HUDI-2087: -- danny0405 commented on a change in pull request #3390: URL:

[GitHub] [hudi] danny0405 commented on a change in pull request #3390: [HUDI-2087] Support Append only in Flink stream

2021-08-03 Thread GitBox
danny0405 commented on a change in pull request #3390: URL: https://github.com/apache/hudi/pull/3390#discussion_r682250961 ## File path: hudi-flink/src/test/java/org/apache/hudi/utils/TestData.java ## @@ -394,6 +394,48 @@ public static void checkWrittenData( } } +

[jira] [Commented] (HUDI-2233) [SQL] Hive sync is not working

2021-08-03 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HUDI-2233?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17392676#comment-17392676 ] ASF GitHub Bot commented on HUDI-2233: -- pengzhiwei2018 commented on a change in pull request #3387:

[GitHub] [hudi] pengzhiwei2018 commented on a change in pull request #3387: [HUDI-2233] Use HMS To Sync Hive Meta For Spark Sql

2021-08-03 Thread GitBox
pengzhiwei2018 commented on a change in pull request #3387: URL: https://github.com/apache/hudi/pull/3387#discussion_r682249809 ## File path: hudi-spark-datasource/hudi-spark-common/src/main/scala/org/apache/hudi/DataSourceOptions.scala ## @@ -399,6 +400,11 @@ object

[jira] [Commented] (HUDI-2087) Support Append only in Flink stream

2021-08-03 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HUDI-2087?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17392674#comment-17392674 ] ASF GitHub Bot commented on HUDI-2087: -- hudi-bot edited a comment on pull request #3390: URL:

[GitHub] [hudi] hudi-bot edited a comment on pull request #3390: [HUDI-2087] Support Append only in Flink stream

2021-08-03 Thread GitBox
hudi-bot edited a comment on pull request #3390: URL: https://github.com/apache/hudi/pull/3390#issuecomment-891674857 ## CI report: * 9e23c85db5538c8ee8ab1d84330a864f0fa710bd Azure:

[jira] [Closed] (HUDI-2222) [SQL] Test catalog integration

2021-08-03 Thread Sagar Sumit (Jira)
[ https://issues.apache.org/jira/browse/HUDI-?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sagar Sumit closed HUDI-. - Resolution: Done > [SQL] Test catalog integration > -- > >

[jira] [Commented] (HUDI-2222) [SQL] Test catalog integration

2021-08-03 Thread Sagar Sumit (Jira)
[ https://issues.apache.org/jira/browse/HUDI-?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17392672#comment-17392672 ] Sagar Sumit commented on HUDI-: --- Catalog integration works after configuring the hive-site.xml and

[jira] [Resolved] (HUDI-2258) Metadata table for flink

2021-08-03 Thread Danny Chen (Jira)
[ https://issues.apache.org/jira/browse/HUDI-2258?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Danny Chen resolved HUDI-2258. -- Resolution: Fixed Fixed via master branch: 02331fc223ca1272e3a9039c6563b9d511a8fbef > Metadata table

[jira] [Commented] (HUDI-2087) Support Append only in Flink stream

2021-08-03 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HUDI-2087?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17392669#comment-17392669 ] ASF GitHub Bot commented on HUDI-2087: -- hudi-bot edited a comment on pull request #3390: URL:

[jira] [Commented] (HUDI-2258) Metadata table for flink

2021-08-03 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HUDI-2258?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17392668#comment-17392668 ] ASF GitHub Bot commented on HUDI-2258: -- danny0405 merged pull request #3381: URL:

[GitHub] [hudi] hudi-bot edited a comment on pull request #3390: [HUDI-2087] Support Append only in Flink stream

2021-08-03 Thread GitBox
hudi-bot edited a comment on pull request #3390: URL: https://github.com/apache/hudi/pull/3390#issuecomment-891674857 ## CI report: * 9e23c85db5538c8ee8ab1d84330a864f0fa710bd Azure:

[GitHub] [hudi] danny0405 merged pull request #3381: [HUDI-2258] Metadata table for flink

2021-08-03 Thread GitBox
danny0405 merged pull request #3381: URL: https://github.com/apache/hudi/pull/3381 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail:

[hudi] branch master updated (b4c14ea -> 02331fc)

2021-08-03 Thread danny0405
This is an automated email from the ASF dual-hosted git repository. danny0405 pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/hudi.git. from b4c14ea [HUDI-2090] Ensure Disk Maps create a subfolder with appropriate prefixes and cleans them up on close

[jira] [Closed] (HUDI-2221) [SQL] Functionality testing with Spark 2

2021-08-03 Thread Sagar Sumit (Jira)
[ https://issues.apache.org/jira/browse/HUDI-2221?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sagar Sumit closed HUDI-2221. - Resolution: Fixed > [SQL] Functionality testing with Spark 2 > >

[jira] [Commented] (HUDI-2258) Metadata table for flink

2021-08-03 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HUDI-2258?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17392667#comment-17392667 ] ASF GitHub Bot commented on HUDI-2258: -- danny0405 commented on a change in pull request #3381: URL:

[GitHub] [hudi] danny0405 commented on a change in pull request #3381: [HUDI-2258] Metadata table for flink

2021-08-03 Thread GitBox
danny0405 commented on a change in pull request #3381: URL: https://github.com/apache/hudi/pull/3381#discussion_r682248124 ## File path: hudi-client/hudi-client-common/src/main/java/org/apache/hudi/metadata/HoodieBackedTableMetadataWriter.java ## @@ -248,7 +248,8 @@ protected

[jira] [Commented] (HUDI-2221) [SQL] Functionality testing with Spark 2

2021-08-03 Thread Sagar Sumit (Jira)
[ https://issues.apache.org/jira/browse/HUDI-2221?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17392666#comment-17392666 ] Sagar Sumit commented on HUDI-2221: --- [~shivnarayan] I am closing this ticket. I have tested with Spark

[GitHub] [hudi] yuzhaojing commented on pull request #3381: [HUDI-2258] Metadata table for flink

2021-08-03 Thread GitBox
yuzhaojing commented on pull request #3381: URL: https://github.com/apache/hudi/pull/3381#issuecomment-892310319 +1 LGTM -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment.

[jira] [Commented] (HUDI-2258) Metadata table for flink

2021-08-03 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HUDI-2258?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17392652#comment-17392652 ] ASF GitHub Bot commented on HUDI-2258: -- yuzhaojing commented on pull request #3381: URL:

[jira] [Commented] (HUDI-1842) [SQL] Spark Sql Support For The Exists Hoodie Table

2021-08-03 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HUDI-1842?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17392650#comment-17392650 ] ASF GitHub Bot commented on HUDI-1842: -- nsivabalan edited a comment on pull request #3393: URL:

[GitHub] [hudi] nsivabalan edited a comment on pull request #3393: [HUDI-1842] Spark Sql Support For The Exists Hoodie Table

2021-08-03 Thread GitBox
nsivabalan edited a comment on pull request #3393: URL: https://github.com/apache/hudi/pull/3393#issuecomment-892140145 Hey peng. I did a round of testing on this patch. Here are my findings. Insert into is till prefixing col name to meta fields. (3rd col and 4th col) ```

[jira] [Commented] (HUDI-1842) [SQL] Spark Sql Support For The Exists Hoodie Table

2021-08-03 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HUDI-1842?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17392649#comment-17392649 ] ASF GitHub Bot commented on HUDI-1842: -- nsivabalan edited a comment on pull request #3393: URL:

[GitHub] [hudi] nsivabalan edited a comment on pull request #3393: [HUDI-1842] Spark Sql Support For The Exists Hoodie Table

2021-08-03 Thread GitBox
nsivabalan edited a comment on pull request #3393: URL: https://github.com/apache/hudi/pull/3393#issuecomment-892140145 Hey peng. I did a round of testing on this patch. Here are my findings. Insert into is till prefixing col name to meta fields. (3rd col and 4th col) ```

[jira] [Commented] (HUDI-1771) Propagate CDC format for hoodie

2021-08-03 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HUDI-1771?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17392647#comment-17392647 ] ASF GitHub Bot commented on HUDI-1771: -- danny0405 commented on pull request #3285: URL:

[GitHub] [hudi] danny0405 commented on pull request #3285: [HUDI-1771] Propagate CDC format for hoodie

2021-08-03 Thread GitBox
danny0405 commented on pull request #3285: URL: https://github.com/apache/hudi/pull/3285#issuecomment-892308623 > @swuferhong @danny0405 is this ready for review? It is, currently, we only add the operation field in Flink side. -- This is an automated message from the Apache Git

[jira] [Commented] (HUDI-1842) [SQL] Spark Sql Support For The Exists Hoodie Table

2021-08-03 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HUDI-1842?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17392644#comment-17392644 ] ASF GitHub Bot commented on HUDI-1842: -- pengzhiwei2018 commented on a change in pull request #3393:

[GitHub] [hudi] hudi-bot edited a comment on pull request #3398: [WIP] Moving some long running tests to functional

2021-08-03 Thread GitBox
hudi-bot edited a comment on pull request #3398: URL: https://github.com/apache/hudi/pull/3398#issuecomment-892305785 ## CI report: * f8bd430efadd3a37885a3e811c132ba1bf07073d Azure:

[GitHub] [hudi] pengzhiwei2018 commented on a change in pull request #3393: [HUDI-1842] Spark Sql Support For The Exists Hoodie Table

2021-08-03 Thread GitBox
pengzhiwei2018 commented on a change in pull request #3393: URL: https://github.com/apache/hudi/pull/3393#discussion_r682236278 ## File path: hudi-spark-datasource/hudi-spark/src/test/scala/org/apache/spark/sql/hudi/TestCreateTable.scala ## @@ -272,4 +278,48 @@ class

[jira] [Commented] (HUDI-1842) [SQL] Spark Sql Support For The Exists Hoodie Table

2021-08-03 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HUDI-1842?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17392643#comment-17392643 ] ASF GitHub Bot commented on HUDI-1842: -- pengzhiwei2018 commented on a change in pull request #3393:

[jira] [Commented] (HUDI-1842) [SQL] Spark Sql Support For The Exists Hoodie Table

2021-08-03 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HUDI-1842?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17392642#comment-17392642 ] ASF GitHub Bot commented on HUDI-1842: -- pengzhiwei2018 commented on a change in pull request #3393:

[GitHub] [hudi] pengzhiwei2018 commented on a change in pull request #3393: [HUDI-1842] Spark Sql Support For The Exists Hoodie Table

2021-08-03 Thread GitBox
pengzhiwei2018 commented on a change in pull request #3393: URL: https://github.com/apache/hudi/pull/3393#discussion_r682236141 ## File path: hudi-spark-datasource/hudi-spark/src/main/scala/org/apache/spark/sql/hudi/command/CreateHoodieTableCommand.scala ## @@ -306,34 +299,49

[GitHub] [hudi] pengzhiwei2018 commented on a change in pull request #3393: [HUDI-1842] Spark Sql Support For The Exists Hoodie Table

2021-08-03 Thread GitBox
pengzhiwei2018 commented on a change in pull request #3393: URL: https://github.com/apache/hudi/pull/3393#discussion_r682235910 ## File path: hudi-spark-datasource/hudi-spark/src/main/scala/org/apache/spark/sql/hudi/analysis/HoodieAnalysis.scala ## @@ -268,7 +269,25 @@ case

[jira] [Commented] (HUDI-1842) [SQL] Spark Sql Support For The Exists Hoodie Table

2021-08-03 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HUDI-1842?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17392641#comment-17392641 ] ASF GitHub Bot commented on HUDI-1842: -- pengzhiwei2018 commented on a change in pull request #3393:

[GitHub] [hudi] pengzhiwei2018 commented on a change in pull request #3393: [HUDI-1842] Spark Sql Support For The Exists Hoodie Table

2021-08-03 Thread GitBox
pengzhiwei2018 commented on a change in pull request #3393: URL: https://github.com/apache/hudi/pull/3393#discussion_r682235533 ## File path: hudi-spark-datasource/hudi-spark/src/main/scala/org/apache/spark/sql/hudi/analysis/HoodieAnalysis.scala ## @@ -268,7 +269,25 @@ case

[GitHub] [hudi] hudi-bot commented on pull request #3398: [WIP] Moving some long running tests to functional

2021-08-03 Thread GitBox
hudi-bot commented on pull request #3398: URL: https://github.com/apache/hudi/pull/3398#issuecomment-892305785 ## CI report: * f8bd430efadd3a37885a3e811c132ba1bf07073d UNKNOWN Bot commands @hudi-bot supports the following commands: - `@hudi-bot run travis`

  1   2   3   4   5   >