[GitHub] [hudi] hudi-bot edited a comment on pull request #3401: [HUDI-2170] Always choose the latest record for HoodieRecordPayload

2021-08-05 Thread GitBox


hudi-bot edited a comment on pull request #3401:
URL: https://github.com/apache/hudi/pull/3401#issuecomment-892472052


   
   ## CI report:
   
   * 7fe0db6bdda8a2f543d068efa1cbb60682b2ef95 UNKNOWN
   * 829139528e53953e6f39d708d31fb876f0a32cd1 Azure: 
[FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=1392)
 
   * 0b34d55f238b889fb2fcc2526e4657ea981c431c Azure: 
[PENDING](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=1397)
 
   
   
   Bot commands
 @hudi-bot supports the following commands:
   
- `@hudi-bot run travis` re-run the last Travis build
- `@hudi-bot run azure` re-run the last Azure build
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscr...@hudi.apache.org

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org




[GitHub] [hudi] hudi-bot edited a comment on pull request #3289: [HUDI-2187] Add a shim layer to support multiple hive version

2021-08-05 Thread GitBox


hudi-bot edited a comment on pull request #3289:
URL: https://github.com/apache/hudi/pull/3289#issuecomment-881900670


   
   ## CI report:
   
   * 04cc6dc7a378f36d70c84269baeaae1bd935fdb6 UNKNOWN
   * cba2f23fb2cfbf01dcd2dc26ca981fd447a7b005 Azure: 
[SUCCESS](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=1389)
 
   * 316b83a6f045c9cc57f049d092463402d4139b95 UNKNOWN
   
   
   Bot commands
 @hudi-bot supports the following commands:
   
- `@hudi-bot run travis` re-run the last Travis build
- `@hudi-bot run azure` re-run the last Azure build
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscr...@hudi.apache.org

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org




[GitHub] [hudi] hudi-bot edited a comment on pull request #3387: [HUDI-2233] Use HMS To Sync Hive Meta For Spark Sql

2021-08-05 Thread GitBox


hudi-bot edited a comment on pull request #3387:
URL: https://github.com/apache/hudi/pull/3387#issuecomment-891570386


   
   ## CI report:
   
   * dae0d69eade3ba95d39e37c1851a56534f80e007 UNKNOWN
   * 6043d6a54b7e2d70a071f556b4eb3da8e3992e2c UNKNOWN
   * 5dd343e30f7560d258887843a811373feb1a6931 Azure: 
[SUCCESS](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=1395)
 
   
   
   Bot commands
 @hudi-bot supports the following commands:
   
- `@hudi-bot run travis` re-run the last Travis build
- `@hudi-bot run azure` re-run the last Azure build
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscr...@hudi.apache.org

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org




[GitHub] [hudi] sannidhiteredesai commented on issue #3399: [SUPPORT] How to purge older partitions in hudi partitioned tables ?

2021-08-05 Thread GitBox


sannidhiteredesai commented on issue #3399:
URL: https://github.com/apache/hudi/issues/3399#issuecomment-893214335


   Hi Siva,
   
   Yes I am using spark datasource.
   
   So, I use this for table upserts: df.write.format("hudi").
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscr...@hudi.apache.org

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org




[GitHub] [hudi] hudi-bot edited a comment on pull request #3393: [HUDI-1842] Spark Sql Support For The Exists Hoodie Table

2021-08-05 Thread GitBox


hudi-bot edited a comment on pull request #3393:
URL: https://github.com/apache/hudi/pull/3393#issuecomment-891812944


   
   ## CI report:
   
   * 314a8f66727958ac7830c9d82e8a7ea97be74900 Azure: 
[SUCCESS](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=1394)
 
   
   
   Bot commands
 @hudi-bot supports the following commands:
   
- `@hudi-bot run travis` re-run the last Travis build
- `@hudi-bot run azure` re-run the last Azure build
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscr...@hudi.apache.org

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org




[GitHub] [hudi] hudi-bot edited a comment on pull request #3401: [HUDI-2170] Always choose the latest record for HoodieRecordPayload

2021-08-05 Thread GitBox


hudi-bot edited a comment on pull request #3401:
URL: https://github.com/apache/hudi/pull/3401#issuecomment-892472052


   
   ## CI report:
   
   * 7fe0db6bdda8a2f543d068efa1cbb60682b2ef95 UNKNOWN
   * 829139528e53953e6f39d708d31fb876f0a32cd1 Azure: 
[FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=1392)
 
   * 0b34d55f238b889fb2fcc2526e4657ea981c431c UNKNOWN
   
   
   Bot commands
 @hudi-bot supports the following commands:
   
- `@hudi-bot run travis` re-run the last Travis build
- `@hudi-bot run azure` re-run the last Azure build
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscr...@hudi.apache.org

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org




[GitHub] [hudi] hudi-bot edited a comment on pull request #3360: [HUDI-2243] Support Time Travel Query For Hoodie Table

2021-08-05 Thread GitBox


hudi-bot edited a comment on pull request #3360:
URL: https://github.com/apache/hudi/pull/3360#issuecomment-888079450


   
   ## CI report:
   
   * e84a04f73a9234a0d02696094bfd92169a43cfc6 Azure: 
[FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=1365)
 
   * ee3fa851ec4a06a2b4ea9e1ea4006e4233d0f3fa Azure: 
[PENDING](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=1396)
 
   
   
   Bot commands
 @hudi-bot supports the following commands:
   
- `@hudi-bot run travis` re-run the last Travis build
- `@hudi-bot run azure` re-run the last Azure build
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscr...@hudi.apache.org

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org




[GitHub] [hudi] hudi-bot edited a comment on pull request #3360: [HUDI-2243] Support Time Travel Query For Hoodie Table

2021-08-05 Thread GitBox


hudi-bot edited a comment on pull request #3360:
URL: https://github.com/apache/hudi/pull/3360#issuecomment-888079450


   
   ## CI report:
   
   * e84a04f73a9234a0d02696094bfd92169a43cfc6 Azure: 
[FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=1365)
 
   * ee3fa851ec4a06a2b4ea9e1ea4006e4233d0f3fa UNKNOWN
   
   
   Bot commands
 @hudi-bot supports the following commands:
   
- `@hudi-bot run travis` re-run the last Travis build
- `@hudi-bot run azure` re-run the last Azure build
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscr...@hudi.apache.org

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org




[GitHub] [hudi] zhangminglei opened a new pull request #3289: [HUDI-2187] Add a shim layer to support multiple hive version

2021-08-05 Thread GitBox


zhangminglei opened a new pull request #3289:
URL: https://github.com/apache/hudi/pull/3289


   ## *Tips*
   - *Thank you very much for contributing to Apache Hudi.*
   - *Please review https://hudi.apache.org/contributing.html before opening a 
pull request.*
   
   ## What is the purpose of the pull request
   
   *Support multiple versions of hive, the main idea is to use reflection to 
get hive under the user's classpath in which get the corresponding client* See 
the RFC for more details: 
https://cwiki.apache.org/confluence/display/HUDI/RFC+-+31%3A+Hive+integration+Improvment
   
   ## Brief change log
   
   *(for example:)*
 - *Modify AnnotationLocation checkstyle rule in checkstyle.xml*
   
   ## Verify this pull request
   
   *(Please pick either of the following options)*
   
   This pull request is a trivial rework / code cleanup without any test 
coverage.
   
   *(or)*
   
   This pull request is already covered by existing tests, such as *(please 
describe tests)*.
   
   (or)
   
   This change added tests and can be verified as follows:
   
   *(example:)*
   
 - *Added integration tests for end-to-end.*
 - *Added HoodieClientWriteTest to verify the change.*
 - *Manually verified the change by running a job locally.*
   
   ## Committer checklist
   
- [ ] Has a corresponding JIRA in PR title & commit

- [ ] Commit message is descriptive of the change

- [ ] CI is green
   
- [ ] Necessary doc changes done or have another open PR
  
- [ ] For large changes, please consider breaking it into sub-tasks under 
an umbrella JIRA.


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscr...@hudi.apache.org

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org




[GitHub] [hudi] zhangminglei closed pull request #3289: [HUDI-2187] Add a shim layer to support multiple hive version

2021-08-05 Thread GitBox


zhangminglei closed pull request #3289:
URL: https://github.com/apache/hudi/pull/3289


   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscr...@hudi.apache.org

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org




[GitHub] [hudi] liujinhui1994 commented on issue #3280: [SUPPORT] Use structedstreaming to consume kafka to write to hudi error

2021-08-05 Thread GitBox


liujinhui1994 commented on issue #3280:
URL: https://github.com/apache/hudi/issues/3280#issuecomment-893200281


   @nsivabalan @codope @vinothchandar  thanks


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscr...@hudi.apache.org

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org




[GitHub] [hudi] hudi-bot edited a comment on pull request #3412: [MINOR] Moving some scala tests in hudi-spark to functional

2021-08-05 Thread GitBox


hudi-bot edited a comment on pull request #3412:
URL: https://github.com/apache/hudi/pull/3412#issuecomment-893109672


   
   ## CI report:
   
   * caeda40eb1be6dd236e47aa5f2a13f30c9be20f4 Azure: 
[SUCCESS](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=1387)
 Azure: 
[FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=1393)
 Azure: 
[CANCELED](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=1391)
 
   
   
   Bot commands
 @hudi-bot supports the following commands:
   
- `@hudi-bot run travis` re-run the last Travis build
- `@hudi-bot run azure` re-run the last Azure build
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscr...@hudi.apache.org

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org




[GitHub] [hudi] nsivabalan commented on issue #3280: [SUPPORT] Use structedstreaming to consume kafka to write to hudi error

2021-08-05 Thread GitBox


nsivabalan commented on issue #3280:
URL: https://github.com/apache/hudi/issues/3280#issuecomment-893194763


   thanks @codope 


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscr...@hudi.apache.org

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org




[GitHub] [hudi] liujinhui1994 closed issue #3280: [SUPPORT] Use structedstreaming to consume kafka to write to hudi error

2021-08-05 Thread GitBox


liujinhui1994 closed issue #3280:
URL: https://github.com/apache/hudi/issues/3280


   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscr...@hudi.apache.org

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org




[GitHub] [hudi] liujinhui1994 commented on issue #3280: [SUPPORT] Use structedstreaming to consume kafka to write to hudi error

2021-08-05 Thread GitBox


liujinhui1994 commented on issue #3280:
URL: https://github.com/apache/hudi/issues/3280#issuecomment-893193914


   I re-synchronized the latest code this time, and now it works. I think a lot 
of content has been updated recently. It should have been repaired.I have 
informed my colleagues that they are now also updating to the latest version. I 
found it was also successful
   @codope 


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscr...@hudi.apache.org

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org




[GitHub] [hudi] danny0405 closed pull request #3403: [HUDI-2274] Allows INSERT duplicates for Flink MOR table

2021-08-05 Thread GitBox


danny0405 closed pull request #3403:
URL: https://github.com/apache/hudi/pull/3403


   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscr...@hudi.apache.org

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org




[GitHub] [hudi] hudi-bot edited a comment on pull request #3401: [HUDI-2170] Always choose the latest record for HoodieRecordPayload

2021-08-05 Thread GitBox


hudi-bot edited a comment on pull request #3401:
URL: https://github.com/apache/hudi/pull/3401#issuecomment-892472052


   
   ## CI report:
   
   * 7fe0db6bdda8a2f543d068efa1cbb60682b2ef95 UNKNOWN
   * 829139528e53953e6f39d708d31fb876f0a32cd1 Azure: 
[FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=1392)
 
   
   
   Bot commands
 @hudi-bot supports the following commands:
   
- `@hudi-bot run travis` re-run the last Travis build
- `@hudi-bot run azure` re-run the last Azure build
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscr...@hudi.apache.org

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org




[GitHub] [hudi] hudi-bot edited a comment on pull request #3387: [HUDI-2233] Use HMS To Sync Hive Meta For Spark Sql

2021-08-04 Thread GitBox


hudi-bot edited a comment on pull request #3387:
URL: https://github.com/apache/hudi/pull/3387#issuecomment-891570386


   
   ## CI report:
   
   * dae0d69eade3ba95d39e37c1851a56534f80e007 UNKNOWN
   * 6043d6a54b7e2d70a071f556b4eb3da8e3992e2c UNKNOWN
   * a5fb3f243e544f91d61c9dd55da80b26c08c4c4c Azure: 
[FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=1385)
 
   * 5dd343e30f7560d258887843a811373feb1a6931 Azure: 
[PENDING](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=1395)
 
   
   
   Bot commands
 @hudi-bot supports the following commands:
   
- `@hudi-bot run travis` re-run the last Travis build
- `@hudi-bot run azure` re-run the last Azure build
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscr...@hudi.apache.org

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org




[GitHub] [hudi] hudi-bot edited a comment on pull request #3387: [HUDI-2233] Use HMS To Sync Hive Meta For Spark Sql

2021-08-04 Thread GitBox


hudi-bot edited a comment on pull request #3387:
URL: https://github.com/apache/hudi/pull/3387#issuecomment-891570386


   
   ## CI report:
   
   * dae0d69eade3ba95d39e37c1851a56534f80e007 UNKNOWN
   * 6043d6a54b7e2d70a071f556b4eb3da8e3992e2c UNKNOWN
   * a5fb3f243e544f91d61c9dd55da80b26c08c4c4c Azure: 
[FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=1385)
 
   * 5dd343e30f7560d258887843a811373feb1a6931 UNKNOWN
   
   
   Bot commands
 @hudi-bot supports the following commands:
   
- `@hudi-bot run travis` re-run the last Travis build
- `@hudi-bot run azure` re-run the last Azure build
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscr...@hudi.apache.org

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org




[GitHub] [hudi] hudi-bot edited a comment on pull request #3393: [HUDI-1842] Spark Sql Support For The Exists Hoodie Table

2021-08-04 Thread GitBox


hudi-bot edited a comment on pull request #3393:
URL: https://github.com/apache/hudi/pull/3393#issuecomment-891812944


   
   ## CI report:
   
   * b75f709b3759b283822cc55f8c3030bc57fc4122 Azure: 
[FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=1367)
 
   * 314a8f66727958ac7830c9d82e8a7ea97be74900 Azure: 
[PENDING](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=1394)
 
   
   
   Bot commands
 @hudi-bot supports the following commands:
   
- `@hudi-bot run travis` re-run the last Travis build
- `@hudi-bot run azure` re-run the last Azure build
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscr...@hudi.apache.org

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org




[GitHub] [hudi] hudi-bot edited a comment on pull request #3393: [HUDI-1842] Spark Sql Support For The Exists Hoodie Table

2021-08-04 Thread GitBox


hudi-bot edited a comment on pull request #3393:
URL: https://github.com/apache/hudi/pull/3393#issuecomment-891812944


   
   ## CI report:
   
   * b75f709b3759b283822cc55f8c3030bc57fc4122 Azure: 
[FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=1367)
 
   * 314a8f66727958ac7830c9d82e8a7ea97be74900 UNKNOWN
   
   
   Bot commands
 @hudi-bot supports the following commands:
   
- `@hudi-bot run travis` re-run the last Travis build
- `@hudi-bot run azure` re-run the last Azure build
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscr...@hudi.apache.org

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org




[GitHub] [hudi] hudi-bot edited a comment on pull request #3412: [MINOR] Moving some scala tests in hudi-spark to functional

2021-08-04 Thread GitBox


hudi-bot edited a comment on pull request #3412:
URL: https://github.com/apache/hudi/pull/3412#issuecomment-893109672


   
   ## CI report:
   
   * caeda40eb1be6dd236e47aa5f2a13f30c9be20f4 Azure: 
[SUCCESS](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=1387)
 Azure: 
[PENDING](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=1393)
 Azure: 
[CANCELED](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=1391)
 
   
   
   Bot commands
 @hudi-bot supports the following commands:
   
- `@hudi-bot run travis` re-run the last Travis build
- `@hudi-bot run azure` re-run the last Azure build
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscr...@hudi.apache.org

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org




[GitHub] [hudi] pengzhiwei2018 edited a comment on pull request #3393: [HUDI-1842] Spark Sql Support For The Exists Hoodie Table

2021-08-04 Thread GitBox


pengzhiwei2018 edited a comment on pull request #3393:
URL: https://github.com/apache/hudi/pull/3393#issuecomment-893180101


   > > > > Hey peng. I did a round of testing on this patch. Here are my 
findings.
   > > > > Insert into is till prefixing col name to meta fields. (3rd col and 
4th col)
   > > > > ```
   > > > > select * from hudi_ny where tpep_pickup_datetime like '%00:04:03%';
   > > > > 20210802105420   20210802105420_2_23 2019-01-01 00:04:03 
2019-01-01  
c5e6a617-dfc5-4051-8c1a-8daead3847af-0_2-37-62_20210802105420.parquet   2   
2019-01-01 00:04:03 2019-01-01 00:11:48 1   3.011   N   
137 262 1   10.00.5 0.5 2.260.0 0.3 13.56   
NULL2019-01-01
   > > > > 20210803162030   20210803162030_0_1  
tpep_pickup_datetime:2021-01-01 00:04:03date_col=2021-01-01 
c5c72f9e-9a63-48ca-a981-4302890f5210-0_0-27-1635_20210803162030.parquet 2   
2021-01-01 00:04:03 2021-01-01 00:11:48 1   3.011   N   
137 262 10.00.5 0.5 2.260.0 0.3 13.56   NULL
2021-01-01
   > > > > Time taken: 0.524 seconds, Fetched 2 row(s)
   > > > > ```
   > > > > 
   > > > > 
   > > > > 
   > > > >   
   > > > > 
   > > > > 
   > > > >   
   > > > > 
   > > > > 
   > > > > 
   > > > >   
   > > > > 1st row was part of the table before onboarding to spark-sql.
   > > > > 2nd row was inserted using insert into.
   > > > > Hi @nsivabalan , I know the difference now. The spark sql use the 
`SqlKeyGenerator` which is a sub-class of `ComplexKeyGenerator` to generated 
record key which will add the column name to the record key. While the 
`SimpleKeyGenerator` will not do that. So we should keep the behavior the same 
for `ComplexKeyGenerator` and `SimpleKeyGenerator`.
   > > > 
   > > > 
   > > > sorry, I don't get you. I understand SqlKeyGenerator extends from 
ComplexKeyGen. but why do we need to keep the same for SimpleKeyGen? We should 
not add any field prefix for SimpleKeyGen. If not, no updates will work for an 
existing table.
   > > 
   > > 
   > > Hi @nsivabalan , Have solved the record key not matched issue. Please 
take a test again~
   > 
   > @pengzhiwei2018 I tested the patch. I can see the column names are no 
longer being prefixed. Updates and deletes by record key is working fine now. 
However., the uri encoding of partition path is still an issue. For example, I 
did an insert to an existing partition. The insert was successful but it 
created a new partition as below:
   > 
   > ```
   > insert into hudi_trips_cow values(1.0, 2.0, "driver_2", 3.0, 4.0, 100.0, 
"rider_2", 12345, "765544i-e89b-12d3-a456-42665544", 
"americas/united_states/san_francisco/");
   > 
   > % ls -l /private/tmp/hudi_trips_cow
   > total 0
   > drwxr-xr-x  4 sagars  wheel  128 Aug  4 16:49 americas
   > drwxr-xr-x  6 sagars  wheel  192 Aug  4 16:50 
americas%2Funited_states%2Fsan_francisco%2F
   > drwxr-xr-x  3 sagars  wheel   96 Aug  4 16:49 asia
   > ```
   
   Hi @codope , can you drop the table and create again with the latest code of 
this patch?  I am afraid this happen because you create the table by the old 
code of the patch. I have fix this issue in the latest .


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscr...@hudi.apache.org

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org




[GitHub] [hudi] pengzhiwei2018 commented on pull request #3393: [HUDI-1842] Spark Sql Support For The Exists Hoodie Table

2021-08-04 Thread GitBox


pengzhiwei2018 commented on pull request #3393:
URL: https://github.com/apache/hudi/pull/3393#issuecomment-893180101


   > > > > Hey peng. I did a round of testing on this patch. Here are my 
findings.
   > > > > Insert into is till prefixing col name to meta fields. (3rd col and 
4th col)
   > > > > ```
   > > > > select * from hudi_ny where tpep_pickup_datetime like '%00:04:03%';
   > > > > 20210802105420   20210802105420_2_23 2019-01-01 00:04:03 
2019-01-01  
c5e6a617-dfc5-4051-8c1a-8daead3847af-0_2-37-62_20210802105420.parquet   2   
2019-01-01 00:04:03 2019-01-01 00:11:48 1   3.011   N   
137 262 1   10.00.5 0.5 2.260.0 0.3 13.56   
NULL2019-01-01
   > > > > 20210803162030   20210803162030_0_1  
tpep_pickup_datetime:2021-01-01 00:04:03date_col=2021-01-01 
c5c72f9e-9a63-48ca-a981-4302890f5210-0_0-27-1635_20210803162030.parquet 2   
2021-01-01 00:04:03 2021-01-01 00:11:48 1   3.011   N   
137 262 10.00.5 0.5 2.260.0 0.3 13.56   NULL
2021-01-01
   > > > > Time taken: 0.524 seconds, Fetched 2 row(s)
   > > > > ```
   > > > > 
   > > > > 
   > > > > 
   > > > >   
   > > > > 
   > > > > 
   > > > >   
   > > > > 
   > > > > 
   > > > > 
   > > > >   
   > > > > 1st row was part of the table before onboarding to spark-sql.
   > > > > 2nd row was inserted using insert into.
   > > > > Hi @nsivabalan , I know the difference now. The spark sql use the 
`SqlKeyGenerator` which is a sub-class of `ComplexKeyGenerator` to generated 
record key which will add the column name to the record key. While the 
`SimpleKeyGenerator` will not do that. So we should keep the behavior the same 
for `ComplexKeyGenerator` and `SimpleKeyGenerator`.
   > > > 
   > > > 
   > > > sorry, I don't get you. I understand SqlKeyGenerator extends from 
ComplexKeyGen. but why do we need to keep the same for SimpleKeyGen? We should 
not add any field prefix for SimpleKeyGen. If not, no updates will work for an 
existing table.
   > > 
   > > 
   > > Hi @nsivabalan , Have solved the record key not matched issue. Please 
take a test again~
   > 
   > @pengzhiwei2018 I tested the patch. I can see the column names are no 
longer being prefixed. Updates and deletes by record key is working fine now. 
However., the uri encoding of partition path is still an issue. For example, I 
did an insert to an existing partition. The insert was successful but it 
created a new partition as below:
   > 
   > ```
   > insert into hudi_trips_cow values(1.0, 2.0, "driver_2", 3.0, 4.0, 100.0, 
"rider_2", 12345, "765544i-e89b-12d3-a456-42665544", 
"americas/united_states/san_francisco/");
   > 
   > % ls -l /private/tmp/hudi_trips_cow
   > total 0
   > drwxr-xr-x  4 sagars  wheel  128 Aug  4 16:49 americas
   > drwxr-xr-x  6 sagars  wheel  192 Aug  4 16:50 
americas%2Funited_states%2Fsan_francisco%2F
   > drwxr-xr-x  3 sagars  wheel   96 Aug  4 16:49 asia
   > ```
   
   Hi @codope , can you drop the table and create again with the latest code of 
this patch. I am afraid this happen because you create the table by the old 
code of the patch. I have fix this issue in the latest .


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscr...@hudi.apache.org

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org




[GitHub] [hudi] hudi-bot edited a comment on pull request #3412: [MINOR] Moving some scala tests in hudi-spark to functional

2021-08-04 Thread GitBox


hudi-bot edited a comment on pull request #3412:
URL: https://github.com/apache/hudi/pull/3412#issuecomment-893109672


   
   ## CI report:
   
   * caeda40eb1be6dd236e47aa5f2a13f30c9be20f4 Azure: 
[SUCCESS](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=1387)
 Azure: 
[PENDING](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=1391)
 Azure: 
[PENDING](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=1393)
 
   
   
   Bot commands
 @hudi-bot supports the following commands:
   
- `@hudi-bot run travis` re-run the last Travis build
- `@hudi-bot run azure` re-run the last Azure build
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscr...@hudi.apache.org

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org




[GitHub] [hudi] nsivabalan commented on pull request #3412: [MINOR] Moving some scala tests in hudi-spark to functional

2021-08-04 Thread GitBox


nsivabalan commented on pull request #3412:
URL: https://github.com/apache/hudi/pull/3412#issuecomment-893179118


   @hudi-bot run azure


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscr...@hudi.apache.org

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org




[GitHub] [hudi] hudi-bot edited a comment on pull request #2927: [HUDI-1129] Improving schema evolution support in hudi

2021-08-04 Thread GitBox


hudi-bot edited a comment on pull request #2927:
URL: https://github.com/apache/hudi/pull/2927#issuecomment-864700767


   
   ## CI report:
   
   * f660b5a5ad27f5bcbfa915d2f3da3db0a37bd7a6 Azure: 
[FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=1390)
 
   
   
   Bot commands
 @hudi-bot supports the following commands:
   
- `@hudi-bot run travis` re-run the last Travis build
- `@hudi-bot run azure` re-run the last Azure build
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscr...@hudi.apache.org

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org




[GitHub] [hudi] hudi-bot edited a comment on pull request #3289: [HUDI-2187] Add a shim layer to support multiple hive version

2021-08-04 Thread GitBox


hudi-bot edited a comment on pull request #3289:
URL: https://github.com/apache/hudi/pull/3289#issuecomment-881900670


   
   ## CI report:
   
   * 04cc6dc7a378f36d70c84269baeaae1bd935fdb6 UNKNOWN
   * cba2f23fb2cfbf01dcd2dc26ca981fd447a7b005 Azure: 
[SUCCESS](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=1389)
 
   
   
   Bot commands
 @hudi-bot supports the following commands:
   
- `@hudi-bot run travis` re-run the last Travis build
- `@hudi-bot run azure` re-run the last Azure build
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscr...@hudi.apache.org

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org




[GitHub] [hudi] hudi-bot edited a comment on pull request #3401: [HUDI-2170] Always choose the latest record for HoodieRecordPayload

2021-08-04 Thread GitBox


hudi-bot edited a comment on pull request #3401:
URL: https://github.com/apache/hudi/pull/3401#issuecomment-892472052


   
   ## CI report:
   
   * 7fe0db6bdda8a2f543d068efa1cbb60682b2ef95 UNKNOWN
   * eb5956b8463eafa8253732698fc26778b15b2829 Azure: 
[FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=1358)
 
   * 829139528e53953e6f39d708d31fb876f0a32cd1 Azure: 
[PENDING](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=1392)
 
   
   
   Bot commands
 @hudi-bot supports the following commands:
   
- `@hudi-bot run travis` re-run the last Travis build
- `@hudi-bot run azure` re-run the last Azure build
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscr...@hudi.apache.org

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org




[GitHub] [hudi] vingov commented on pull request #3404: [HUDI-2257] Adding note to set Keygen class while deleting data

2021-08-04 Thread GitBox


vingov commented on pull request #3404:
URL: https://github.com/apache/hudi/pull/3404#issuecomment-893164594


   looking into it, my local env is not matching travis env, replicating the 
same docker image and testing it out.


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscr...@hudi.apache.org

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org




[GitHub] [hudi] hudi-bot edited a comment on pull request #3412: [MINOR] Moving some scala tests in hudi-spark to functional

2021-08-04 Thread GitBox


hudi-bot edited a comment on pull request #3412:
URL: https://github.com/apache/hudi/pull/3412#issuecomment-893109672


   
   ## CI report:
   
   * caeda40eb1be6dd236e47aa5f2a13f30c9be20f4 Azure: 
[SUCCESS](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=1387)
 Azure: 
[PENDING](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=1391)
 
   
   
   Bot commands
 @hudi-bot supports the following commands:
   
- `@hudi-bot run travis` re-run the last Travis build
- `@hudi-bot run azure` re-run the last Azure build
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscr...@hudi.apache.org

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org




[GitHub] [hudi] hudi-bot edited a comment on pull request #2927: [HUDI-1129] Improving schema evolution support in hudi

2021-08-04 Thread GitBox


hudi-bot edited a comment on pull request #2927:
URL: https://github.com/apache/hudi/pull/2927#issuecomment-864700767


   
   ## CI report:
   
   * dfe1c00fce8dd2c9ede13944042430c4c738f414 Azure: 
[FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=1380)
 
   * f660b5a5ad27f5bcbfa915d2f3da3db0a37bd7a6 Azure: 
[PENDING](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=1390)
 
   
   
   Bot commands
 @hudi-bot supports the following commands:
   
- `@hudi-bot run travis` re-run the last Travis build
- `@hudi-bot run azure` re-run the last Azure build
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscr...@hudi.apache.org

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org




[GitHub] [hudi] nsivabalan commented on pull request #3412: [MINOR] Moving some scala tests in hudi-spark to functional

2021-08-04 Thread GitBox


nsivabalan commented on pull request #3412:
URL: https://github.com/apache/hudi/pull/3412#issuecomment-893160317


   @hudi-bot run azure
   
   
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscr...@hudi.apache.org

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org




[GitHub] [hudi] hudi-bot edited a comment on pull request #3403: [HUDI-2274] Allows INSERT duplicates for Flink MOR table

2021-08-04 Thread GitBox


hudi-bot edited a comment on pull request #3403:
URL: https://github.com/apache/hudi/pull/3403#issuecomment-892564001


   
   ## CI report:
   
   * 69fac2bdbf29d3d16dd4e72069056334a92d3b1a Azure: 
[SUCCESS](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=1388)
 
   
   
   Bot commands
 @hudi-bot supports the following commands:
   
- `@hudi-bot run travis` re-run the last Travis build
- `@hudi-bot run azure` re-run the last Azure build
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscr...@hudi.apache.org

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org




[GitHub] [hudi] hudi-bot edited a comment on pull request #2927: [HUDI-1129] Improving schema evolution support in hudi

2021-08-04 Thread GitBox


hudi-bot edited a comment on pull request #2927:
URL: https://github.com/apache/hudi/pull/2927#issuecomment-864700767


   
   ## CI report:
   
   * dfe1c00fce8dd2c9ede13944042430c4c738f414 Azure: 
[FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=1380)
 
   * f660b5a5ad27f5bcbfa915d2f3da3db0a37bd7a6 UNKNOWN
   
   
   Bot commands
 @hudi-bot supports the following commands:
   
- `@hudi-bot run travis` re-run the last Travis build
- `@hudi-bot run azure` re-run the last Azure build
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscr...@hudi.apache.org

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org




[GitHub] [hudi] nsivabalan commented on pull request #3404: [HUDI-2257] Adding note to set Keygen class while deleting data

2021-08-04 Thread GitBox


nsivabalan commented on pull request #3404:
URL: https://github.com/apache/hudi/pull/3404#issuecomment-893157959


   thanks. looks like CI failed.


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscr...@hudi.apache.org

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org




[GitHub] [hudi] hudi-bot edited a comment on pull request #3412: [MINOR] Moving some scala tests in hudi-spark to functional

2021-08-04 Thread GitBox


hudi-bot edited a comment on pull request #3412:
URL: https://github.com/apache/hudi/pull/3412#issuecomment-893109672


   
   ## CI report:
   
   * caeda40eb1be6dd236e47aa5f2a13f30c9be20f4 Azure: 
[SUCCESS](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=1387)
 
   
   
   Bot commands
 @hudi-bot supports the following commands:
   
- `@hudi-bot run travis` re-run the last Travis build
- `@hudi-bot run azure` re-run the last Azure build
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscr...@hudi.apache.org

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org




[GitHub] [hudi] hudi-bot edited a comment on pull request #3401: [HUDI-2170] Always choose the latest record for HoodieRecordPayload

2021-08-04 Thread GitBox


hudi-bot edited a comment on pull request #3401:
URL: https://github.com/apache/hudi/pull/3401#issuecomment-892472052


   
   ## CI report:
   
   * 7fe0db6bdda8a2f543d068efa1cbb60682b2ef95 UNKNOWN
   * eb5956b8463eafa8253732698fc26778b15b2829 Azure: 
[FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=1358)
 
   * 829139528e53953e6f39d708d31fb876f0a32cd1 UNKNOWN
   
   
   Bot commands
 @hudi-bot supports the following commands:
   
- `@hudi-bot run travis` re-run the last Travis build
- `@hudi-bot run azure` re-run the last Azure build
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscr...@hudi.apache.org

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org




[GitHub] [hudi] hudi-bot edited a comment on pull request #3289: [HUDI-2187] Add a shim layer to support multiple hive version

2021-08-04 Thread GitBox


hudi-bot edited a comment on pull request #3289:
URL: https://github.com/apache/hudi/pull/3289#issuecomment-881900670


   
   ## CI report:
   
   * 04cc6dc7a378f36d70c84269baeaae1bd935fdb6 UNKNOWN
   * 71d53b3a8838eb4b5bcac15a6ce24026f1d75e7a Azure: 
[FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=1299)
 
   * cba2f23fb2cfbf01dcd2dc26ca981fd447a7b005 Azure: 
[PENDING](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=1389)
 
   
   
   Bot commands
 @hudi-bot supports the following commands:
   
- `@hudi-bot run travis` re-run the last Travis build
- `@hudi-bot run azure` re-run the last Azure build
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscr...@hudi.apache.org

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org




[GitHub] [hudi] hudi-bot edited a comment on pull request #3289: [HUDI-2187] Add a shim layer to support multiple hive version

2021-08-04 Thread GitBox


hudi-bot edited a comment on pull request #3289:
URL: https://github.com/apache/hudi/pull/3289#issuecomment-881900670


   
   ## CI report:
   
   * 04cc6dc7a378f36d70c84269baeaae1bd935fdb6 UNKNOWN
   * 71d53b3a8838eb4b5bcac15a6ce24026f1d75e7a Azure: 
[FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=1299)
 
   * cba2f23fb2cfbf01dcd2dc26ca981fd447a7b005 UNKNOWN
   
   
   Bot commands
 @hudi-bot supports the following commands:
   
- `@hudi-bot run travis` re-run the last Travis build
- `@hudi-bot run azure` re-run the last Azure build
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscr...@hudi.apache.org

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org




[GitHub] [hudi] zhangminglei commented on pull request #3289: [HUDI-2187] Add a shim layer to support multiple hive version

2021-08-04 Thread GitBox


zhangminglei commented on pull request #3289:
URL: https://github.com/apache/hudi/pull/3289#issuecomment-893146261


   trigger again...


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscr...@hudi.apache.org

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org




[GitHub] [hudi] Ambarish-Giri edited a comment on issue #3395: [SUPPORT] Issues with read optimized query MOR table

2021-08-04 Thread GitBox


Ambarish-Giri edited a comment on issue #3395:
URL: https://github.com/apache/hudi/issues/3395#issuecomment-893140263


   Sure @nsivabalan eventually our test and prod environment will be EMR only. 
But before doing actual testing and derive the benchmarking metrics as I said 
earlier just evaluating Hudi to explore all its features in my local setup.

   But for now below are the libraries I am using :  
   scalaVersion := "2.12.11" 
   libraryDependencies += "org.apache.spark" %% "spark-core" % "2.4.7"
   libraryDependencies += "org.apache.spark" %% "spark-sql" % "2.4.7"
   libraryDependencies += "org.apache.hudi" %% "hudi-spark-bundle" % "0.7.0"
   libraryDependencies += "org.apache.hudi" %% "hudi-utilities-bundle" % "0.7.0"
   libraryDependencies += "org.apache.spark" %% "spark-avro" % "2.4.7"
   
   
   and while creating Spark session Object below is the spark config settings:
   val spark: SparkSession = SparkSession.builder()
 .appName("hudi-datalake")
 .master("local[*]")
 .config("spark.serializer", 
"org.apache.spark.serializer.KryoSerializer")
 .config("spark.shuffle.compress", "true")
 .config("spark.shuffle.spill.compress", "true")
 .config("spark.executor.extraJavaOptions", "-XX:+UseG1GC")
 .config("spark.sql.hive.convertMetastoreParquet", "false") 
 .getOrCreate()


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscr...@hudi.apache.org

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org




[GitHub] [hudi] swuferhong closed pull request #3285: [HUDI-1771] Propagate CDC format for hoodie

2021-08-04 Thread GitBox


swuferhong closed pull request #3285:
URL: https://github.com/apache/hudi/pull/3285


   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscr...@hudi.apache.org

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org




[GitHub] [hudi] hudi-bot edited a comment on pull request #3387: [HUDI-2233] Use HMS To Sync Hive Meta For Spark Sql

2021-08-04 Thread GitBox


hudi-bot edited a comment on pull request #3387:
URL: https://github.com/apache/hudi/pull/3387#issuecomment-891570386


   
   ## CI report:
   
   * dae0d69eade3ba95d39e37c1851a56534f80e007 UNKNOWN
   * 6043d6a54b7e2d70a071f556b4eb3da8e3992e2c UNKNOWN
   * a5fb3f243e544f91d61c9dd55da80b26c08c4c4c Azure: 
[FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=1385)
 
   
   
   Bot commands
 @hudi-bot supports the following commands:
   
- `@hudi-bot run travis` re-run the last Travis build
- `@hudi-bot run azure` re-run the last Azure build
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscr...@hudi.apache.org

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org




[GitHub] [hudi] hudi-bot edited a comment on pull request #3330: [HUDI-2101][RFC-28]support z-order for hudi

2021-08-04 Thread GitBox


hudi-bot edited a comment on pull request #3330:
URL: https://github.com/apache/hudi/pull/3330#issuecomment-885350571


   
   ## CI report:
   
   * c76a7f280b74ae9cc971754e7731c2196c0a3983 Azure: 
[SUCCESS](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=1386)
 
   
   
   Bot commands
 @hudi-bot supports the following commands:
   
- `@hudi-bot run travis` re-run the last Travis build
- `@hudi-bot run azure` re-run the last Azure build
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscr...@hudi.apache.org

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org




[GitHub] [hudi] Ambarish-Giri commented on issue #3395: [SUPPORT] Issues with read optimized query MOR table

2021-08-04 Thread GitBox


Ambarish-Giri commented on issue #3395:
URL: https://github.com/apache/hudi/issues/3395#issuecomment-893140263


   Sure @nsivabalan eventually our test and prod environment will be EMR only. 
But before doing actual testing and derive the benchmarking metrics as I said 
earlier just evaluating Hudi to explore all its features in my local setup.

   But for now below are the libraries I am using :   
   libraryDependencies += "org.apache.spark" %% "spark-core" % "2.4.7"
   libraryDependencies += "org.apache.spark" %% "spark-sql" % "2.4.7"
   libraryDependencies += "org.apache.hudi" %% "hudi-spark-bundle" % "0.7.0"
   libraryDependencies += "org.apache.hudi" %% "hudi-utilities-bundle" % "0.7.0"
   libraryDependencies += "org.apache.spark" %% "spark-avro" % "2.4.7"
   
   
   and while creating Spark session Object below is the spark config settings:
   val spark: SparkSession = SparkSession.builder()
 .appName("hudi-datalake")
 .master("local[*]")
 .config("spark.serializer", 
"org.apache.spark.serializer.KryoSerializer")
 .config("spark.shuffle.compress", "true")
 .config("spark.shuffle.spill.compress", "true")
 .config("spark.executor.extraJavaOptions", "-XX:+UseG1GC")
 .config("spark.sql.hive.convertMetastoreParquet", "false") 
 .getOrCreate()


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscr...@hudi.apache.org

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org




[GitHub] [hudi] nsivabalan commented on issue #3399: [SUPPORT] How to purge older partitions in hudi partitioned tables ?

2021-08-04 Thread GitBox


nsivabalan commented on issue #3399:
URL: https://github.com/apache/hudi/issues/3399#issuecomment-893138598


   WriteClient has support for 
[deletePartitions](https://github.com/apache/hudi/blob/1df5ded433eced3bbb66137bc741e616beab9a70/hudi-client/hudi-spark-client/src/main/java/org/apache/hudi/client/SparkRDDWriteClient.java#L257).
 But looks like we have not added the support to spark data source yet. 
   Are you using spark datasource? 


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscr...@hudi.apache.org

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org




[GitHub] [hudi] hudi-bot edited a comment on pull request #3403: [HUDI-2274] Allows INSERT duplicates for Flink MOR table

2021-08-04 Thread GitBox


hudi-bot edited a comment on pull request #3403:
URL: https://github.com/apache/hudi/pull/3403#issuecomment-892564001


   
   ## CI report:
   
   * 701f4efe322ae9a960734bacf21b911c2be9f14c Azure: 
[CANCELED](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=1384)
 
   * 69fac2bdbf29d3d16dd4e72069056334a92d3b1a Azure: 
[PENDING](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=1388)
 
   
   
   Bot commands
 @hudi-bot supports the following commands:
   
- `@hudi-bot run travis` re-run the last Travis build
- `@hudi-bot run azure` re-run the last Azure build
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscr...@hudi.apache.org

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org




[GitHub] [hudi] hudi-bot edited a comment on pull request #3412: [MINOR] Moving some scala tests in hudi-spark to functional

2021-08-04 Thread GitBox


hudi-bot edited a comment on pull request #3412:
URL: https://github.com/apache/hudi/pull/3412#issuecomment-893109672


   
   ## CI report:
   
   * ceb79cfbcd97cd57f1815abbdcc4cd5294e5468a Azure: 
[SUCCESS](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=1383)
 
   * caeda40eb1be6dd236e47aa5f2a13f30c9be20f4 Azure: 
[PENDING](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=1387)
 
   
   
   Bot commands
 @hudi-bot supports the following commands:
   
- `@hudi-bot run travis` re-run the last Travis build
- `@hudi-bot run azure` re-run the last Azure build
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscr...@hudi.apache.org

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org




[GitHub] [hudi] nsivabalan commented on issue #3395: [SUPPORT] Issues with read optimized query MOR table

2021-08-04 Thread GitBox


nsivabalan commented on issue #3395:
URL: https://github.com/apache/hudi/issues/3395#issuecomment-893136900


   yes, For eg, something like this
   ```
   spark-shell \
 --packages 
org.apache.hudi:hudi-spark3-bundle_2.12:0.8.0,org.apache.spark:spark-avro_2.12:3.0.1
 \
 --conf 'spark.serializer=org.apache.spark.serializer.KryoSerializer'
   ```
   Ref: https://hudi.apache.org/docs/quick-start-guide
   
   Also, is your production env(eventually) going to be windows? If not, I 
would recommend you to try it out in EMR or some cluster, as those are well 
tested environments. I am not sure if hudi is tested end to end in windows. 
Just a suggestion. 
   
   
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscr...@hudi.apache.org

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org




[GitHub] [hudi] hudi-bot edited a comment on pull request #3412: [MINOR] Moving some scala tests in hudi-spark to functional

2021-08-04 Thread GitBox


hudi-bot edited a comment on pull request #3412:
URL: https://github.com/apache/hudi/pull/3412#issuecomment-893109672


   
   ## CI report:
   
   * ceb79cfbcd97cd57f1815abbdcc4cd5294e5468a Azure: 
[SUCCESS](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=1383)
 
   * caeda40eb1be6dd236e47aa5f2a13f30c9be20f4 UNKNOWN
   
   
   Bot commands
 @hudi-bot supports the following commands:
   
- `@hudi-bot run travis` re-run the last Travis build
- `@hudi-bot run azure` re-run the last Azure build
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscr...@hudi.apache.org

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org




[GitHub] [hudi] hudi-bot edited a comment on pull request #3403: [HUDI-2274] Allows INSERT duplicates for Flink MOR table

2021-08-04 Thread GitBox


hudi-bot edited a comment on pull request #3403:
URL: https://github.com/apache/hudi/pull/3403#issuecomment-892564001


   
   ## CI report:
   
   * 701f4efe322ae9a960734bacf21b911c2be9f14c Azure: 
[CANCELED](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=1384)
 
   * 69fac2bdbf29d3d16dd4e72069056334a92d3b1a UNKNOWN
   
   
   Bot commands
 @hudi-bot supports the following commands:
   
- `@hudi-bot run travis` re-run the last Travis build
- `@hudi-bot run azure` re-run the last Azure build
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscr...@hudi.apache.org

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org




[GitHub] [hudi] hudi-bot edited a comment on pull request #3403: [HUDI-2274] Allows INSERT duplicates for Flink MOR table

2021-08-04 Thread GitBox


hudi-bot edited a comment on pull request #3403:
URL: https://github.com/apache/hudi/pull/3403#issuecomment-892564001


   
   ## CI report:
   
   * 7054bac54ab01214b060ed22332149f41dff1ad3 Azure: 
[FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=1363)
 
   * 701f4efe322ae9a960734bacf21b911c2be9f14c Azure: 
[PENDING](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=1384)
 
   * 69fac2bdbf29d3d16dd4e72069056334a92d3b1a UNKNOWN
   
   
   Bot commands
 @hudi-bot supports the following commands:
   
- `@hudi-bot run travis` re-run the last Travis build
- `@hudi-bot run azure` re-run the last Azure build
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscr...@hudi.apache.org

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org




[GitHub] [hudi] hudi-bot edited a comment on pull request #3412: [MINOR] Moving some scala tests in hudi-spark to functional

2021-08-04 Thread GitBox


hudi-bot edited a comment on pull request #3412:
URL: https://github.com/apache/hudi/pull/3412#issuecomment-893109672


   
   ## CI report:
   
   * ceb79cfbcd97cd57f1815abbdcc4cd5294e5468a Azure: 
[SUCCESS](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=1383)
 
   
   
   Bot commands
 @hudi-bot supports the following commands:
   
- `@hudi-bot run travis` re-run the last Travis build
- `@hudi-bot run azure` re-run the last Azure build
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscr...@hudi.apache.org

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org




[GitHub] [hudi] hudi-bot edited a comment on pull request #3330: [HUDI-2101][RFC-28]support z-order for hudi

2021-08-04 Thread GitBox


hudi-bot edited a comment on pull request #3330:
URL: https://github.com/apache/hudi/pull/3330#issuecomment-885350571


   
   ## CI report:
   
   * 0fe4ed6eea50bd7f03ded7620d391bcf82cf834e Azure: 
[FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=1325)
 
   * c76a7f280b74ae9cc971754e7731c2196c0a3983 Azure: 
[PENDING](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=1386)
 
   
   
   Bot commands
 @hudi-bot supports the following commands:
   
- `@hudi-bot run travis` re-run the last Travis build
- `@hudi-bot run azure` re-run the last Azure build
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscr...@hudi.apache.org

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org




[GitHub] [hudi] hudi-bot edited a comment on pull request #3387: [HUDI-2233] Use HMS To Sync Hive Meta For Spark Sql

2021-08-04 Thread GitBox


hudi-bot edited a comment on pull request #3387:
URL: https://github.com/apache/hudi/pull/3387#issuecomment-891570386


   
   ## CI report:
   
   * dae0d69eade3ba95d39e37c1851a56534f80e007 UNKNOWN
   * e2e35cec3fb48b01bf0a19bf4f2913bd7cb45a2b Azure: 
[FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=1356)
 
   * 6043d6a54b7e2d70a071f556b4eb3da8e3992e2c UNKNOWN
   * a5fb3f243e544f91d61c9dd55da80b26c08c4c4c Azure: 
[PENDING](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=1385)
 
   
   
   Bot commands
 @hudi-bot supports the following commands:
   
- `@hudi-bot run travis` re-run the last Travis build
- `@hudi-bot run azure` re-run the last Azure build
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscr...@hudi.apache.org

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org




[GitHub] [hudi] hudi-bot edited a comment on pull request #3330: [HUDI-2101][RFC-28]support z-order for hudi

2021-08-04 Thread GitBox


hudi-bot edited a comment on pull request #3330:
URL: https://github.com/apache/hudi/pull/3330#issuecomment-885350571


   
   ## CI report:
   
   * 0fe4ed6eea50bd7f03ded7620d391bcf82cf834e Azure: 
[FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=1325)
 
   * c76a7f280b74ae9cc971754e7731c2196c0a3983 UNKNOWN
   
   
   Bot commands
 @hudi-bot supports the following commands:
   
- `@hudi-bot run travis` re-run the last Travis build
- `@hudi-bot run azure` re-run the last Azure build
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscr...@hudi.apache.org

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org




[GitHub] [hudi] hudi-bot edited a comment on pull request #3403: [HUDI-2274] Allows INSERT duplicates for Flink MOR table

2021-08-04 Thread GitBox


hudi-bot edited a comment on pull request #3403:
URL: https://github.com/apache/hudi/pull/3403#issuecomment-892564001


   
   ## CI report:
   
   * 7054bac54ab01214b060ed22332149f41dff1ad3 Azure: 
[FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=1363)
 
   * 701f4efe322ae9a960734bacf21b911c2be9f14c Azure: 
[PENDING](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=1384)
 
   
   
   Bot commands
 @hudi-bot supports the following commands:
   
- `@hudi-bot run travis` re-run the last Travis build
- `@hudi-bot run azure` re-run the last Azure build
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscr...@hudi.apache.org

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org




[GitHub] [hudi] hudi-bot edited a comment on pull request #3403: [HUDI-2274] Allows INSERT duplicates for Flink MOR table

2021-08-04 Thread GitBox


hudi-bot edited a comment on pull request #3403:
URL: https://github.com/apache/hudi/pull/3403#issuecomment-892564001


   
   ## CI report:
   
   * 7054bac54ab01214b060ed22332149f41dff1ad3 Azure: 
[FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=1363)
 
   * 701f4efe322ae9a960734bacf21b911c2be9f14c UNKNOWN
   
   
   Bot commands
 @hudi-bot supports the following commands:
   
- `@hudi-bot run travis` re-run the last Travis build
- `@hudi-bot run azure` re-run the last Azure build
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscr...@hudi.apache.org

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org




[GitHub] [hudi] danny0405 commented on pull request #3267: [HUDI-2170] Always choose the latest record for HoodieRecordPayload

2021-08-04 Thread GitBox


danny0405 commented on pull request #3267:
URL: https://github.com/apache/hudi/pull/3267#issuecomment-893111329


   Have moved to https://github.com/apache/hudi/pull/3401.


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscr...@hudi.apache.org

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org




[GitHub] [hudi] danny0405 commented on pull request #3325: [WIP] Fixing payload instantiation to include preCombine field in LogRecordScanner

2021-08-04 Thread GitBox


danny0405 commented on pull request #3325:
URL: https://github.com/apache/hudi/pull/3325#issuecomment-89385


   We have moved to https://github.com/apache/hudi/pull/3401, please review if 
you have time.


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscr...@hudi.apache.org

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org




[GitHub] [hudi] hudi-bot edited a comment on pull request #3412: [MINOR] Moving some scala tests in hudi-spark to functional

2021-08-04 Thread GitBox


hudi-bot edited a comment on pull request #3412:
URL: https://github.com/apache/hudi/pull/3412#issuecomment-893109672


   
   ## CI report:
   
   * ceb79cfbcd97cd57f1815abbdcc4cd5294e5468a Azure: 
[PENDING](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=1383)
 
   
   
   Bot commands
 @hudi-bot supports the following commands:
   
- `@hudi-bot run travis` re-run the last Travis build
- `@hudi-bot run azure` re-run the last Azure build
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscr...@hudi.apache.org

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org




[GitHub] [hudi] hudi-bot edited a comment on pull request #3387: [HUDI-2233] Use HMS To Sync Hive Meta For Spark Sql

2021-08-04 Thread GitBox


hudi-bot edited a comment on pull request #3387:
URL: https://github.com/apache/hudi/pull/3387#issuecomment-891570386


   
   ## CI report:
   
   * dae0d69eade3ba95d39e37c1851a56534f80e007 UNKNOWN
   * e2e35cec3fb48b01bf0a19bf4f2913bd7cb45a2b Azure: 
[FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=1356)
 
   * 6043d6a54b7e2d70a071f556b4eb3da8e3992e2c UNKNOWN
   * a5fb3f243e544f91d61c9dd55da80b26c08c4c4c UNKNOWN
   
   
   Bot commands
 @hudi-bot supports the following commands:
   
- `@hudi-bot run travis` re-run the last Travis build
- `@hudi-bot run azure` re-run the last Azure build
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscr...@hudi.apache.org

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org




[GitHub] [hudi] hudi-bot commented on pull request #3412: [MINOR] Moving some scala tests in hudi-spark to functional

2021-08-04 Thread GitBox


hudi-bot commented on pull request #3412:
URL: https://github.com/apache/hudi/pull/3412#issuecomment-893109672


   
   ## CI report:
   
   * ceb79cfbcd97cd57f1815abbdcc4cd5294e5468a UNKNOWN
   
   
   Bot commands
 @hudi-bot supports the following commands:
   
- `@hudi-bot run travis` re-run the last Travis build
- `@hudi-bot run azure` re-run the last Azure build
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscr...@hudi.apache.org

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org




[GitHub] [hudi] nsivabalan commented on pull request #2911: [HUDI-1887] Setting default value to false for enabling schema post processor

2021-08-04 Thread GitBox


nsivabalan commented on pull request #2911:
URL: https://github.com/apache/hudi/pull/2911#issuecomment-893109348


   @vinothchandar : If you are good with the patch, I can rebase and land it. 


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscr...@hudi.apache.org

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org




[GitHub] [hudi] hudi-bot edited a comment on pull request #3387: [HUDI-2233] Use HMS To Sync Hive Meta For Spark Sql

2021-08-04 Thread GitBox


hudi-bot edited a comment on pull request #3387:
URL: https://github.com/apache/hudi/pull/3387#issuecomment-891570386


   
   ## CI report:
   
   * dae0d69eade3ba95d39e37c1851a56534f80e007 UNKNOWN
   * e2e35cec3fb48b01bf0a19bf4f2913bd7cb45a2b Azure: 
[FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=1356)
 
   * 6043d6a54b7e2d70a071f556b4eb3da8e3992e2c UNKNOWN
   
   
   Bot commands
 @hudi-bot supports the following commands:
   
- `@hudi-bot run travis` re-run the last Travis build
- `@hudi-bot run azure` re-run the last Azure build
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscr...@hudi.apache.org

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org




[GitHub] [hudi] nsivabalan opened a new pull request #3412: [MINOR] Moving some scala tests in hudi-spark to functional

2021-08-04 Thread GitBox


nsivabalan opened a new pull request #3412:
URL: https://github.com/apache/hudi/pull/3412


   ## *Tips*
   - *Thank you very much for contributing to Apache Hudi.*
   - *Please review https://hudi.apache.org/contributing.html before opening a 
pull request.*
   
   ## What is the purpose of the pull request
   
   *(For example: This pull request adds quick-start document.)*
   
   ## Brief change log
   
   *(for example:)*
 - *Modify AnnotationLocation checkstyle rule in checkstyle.xml*
   
   ## Verify this pull request
   
   *(Please pick either of the following options)*
   
   This pull request is a trivial rework / code cleanup without any test 
coverage.
   
   *(or)*
   
   This pull request is already covered by existing tests, such as *(please 
describe tests)*.
   
   (or)
   
   This change added tests and can be verified as follows:
   
   *(example:)*
   
 - *Added integration tests for end-to-end.*
 - *Added HoodieClientWriteTest to verify the change.*
 - *Manually verified the change by running a job locally.*
   
   ## Committer checklist
   
- [ ] Has a corresponding JIRA in PR title & commit

- [ ] Commit message is descriptive of the change

- [ ] CI is green
   
- [ ] Necessary doc changes done or have another open PR
  
- [ ] For large changes, please consider breaking it into sub-tasks under 
an umbrella JIRA.


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscr...@hudi.apache.org

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org




[GitHub] [hudi] nsivabalan commented on a change in pull request #3233: [HUDI-1138] Add timeline-server-based marker file strategy for improving marker-related latency

2021-08-04 Thread GitBox


nsivabalan commented on a change in pull request #3233:
URL: https://github.com/apache/hudi/pull/3233#discussion_r683052454



##
File path: hudi-common/src/main/java/org/apache/hudi/common/fs/FSUtils.java
##
@@ -601,4 +604,84 @@ public static HoodieWrapperFileSystem getFs(String path, 
SerializableConfigurati
 .filter(fileStatus -> 
!fileStatus.getPath().toString().contains(HoodieTableMetaClient.METAFOLDER_NAME))
 .collect(Collectors.toList());
   }
+
+  /**
+   * Deletes a directory by deleting sub-paths in parallel on the file system.
+   *
+   * @param hoodieEngineContext {@code HoodieEngineContext} instance
+   * @param fs file system
+   * @param dirPath directory path
+   * @param parallelism parallelism to use for sub-paths
+   * @return {@code true} if the directory is delete; {@code false} otherwise.
+   */
+  public static boolean deleteDir(
+  HoodieEngineContext hoodieEngineContext, FileSystem fs, Path dirPath, 
int parallelism) {
+try {
+  if (fs.exists(dirPath)) {
+FSUtils.parallelizeSubPathProcess(hoodieEngineContext, fs, dirPath, 
parallelism, e -> true,
+pairOfSubPathAndConf -> 
deleteSubPath(pairOfSubPathAndConf.getKey(), pairOfSubPathAndConf.getValue())
+);
+
+boolean result = fs.delete(dirPath, true);
+LOG.info("Removed directory at " + dirPath);
+return result;
+  }
+} catch (IOException ioe) {
+  throw new HoodieIOException(ioe.getMessage(), ioe);
+}
+return false;
+  }
+
+  /**
+   * Processes sub-path in parallel.
+   *
+   * @param hoodieEngineContext {@code HoodieEngineContext} instance
+   * @param fs file system
+   * @param dirPath directory path
+   * @param parallelism parallelism to use for sub-paths
+   * @param subPathPredicate predicate to use to filter sub-paths for 
processing
+   * @param pairFunction actual processing logic for each sub-path
+   * @param  type of result to return for each sub-path
+   * @return a map of sub-path to result of the processing
+   */
+  public static  Map parallelizeSubPathProcess(

Review comment:
   looks neat :) 

##
File path: hudi-common/src/main/java/org/apache/hudi/common/fs/FSUtils.java
##
@@ -601,4 +604,84 @@ public static HoodieWrapperFileSystem getFs(String path, 
SerializableConfigurati
 .filter(fileStatus -> 
!fileStatus.getPath().toString().contains(HoodieTableMetaClient.METAFOLDER_NAME))
 .collect(Collectors.toList());
   }
+
+  /**
+   * Deletes a directory by deleting sub-paths in parallel on the file system.
+   *
+   * @param hoodieEngineContext {@code HoodieEngineContext} instance
+   * @param fs file system
+   * @param dirPath directory path
+   * @param parallelism parallelism to use for sub-paths
+   * @return {@code true} if the directory is delete; {@code false} otherwise.
+   */
+  public static boolean deleteDir(
+  HoodieEngineContext hoodieEngineContext, FileSystem fs, Path dirPath, 
int parallelism) {
+try {
+  if (fs.exists(dirPath)) {
+FSUtils.parallelizeSubPathProcess(hoodieEngineContext, fs, dirPath, 
parallelism, e -> true,
+pairOfSubPathAndConf -> 
deleteSubPath(pairOfSubPathAndConf.getKey(), pairOfSubPathAndConf.getValue())
+);
+
+boolean result = fs.delete(dirPath, true);
+LOG.info("Removed directory at " + dirPath);
+return result;
+  }
+} catch (IOException ioe) {
+  throw new HoodieIOException(ioe.getMessage(), ioe);
+}
+return false;
+  }
+
+  /**
+   * Processes sub-path in parallel.
+   *
+   * @param hoodieEngineContext {@code HoodieEngineContext} instance
+   * @param fs file system
+   * @param dirPath directory path
+   * @param parallelism parallelism to use for sub-paths
+   * @param subPathPredicate predicate to use to filter sub-paths for 
processing
+   * @param pairFunction actual processing logic for each sub-path
+   * @param  type of result to return for each sub-path
+   * @return a map of sub-path to result of the processing
+   */
+  public static  Map parallelizeSubPathProcess(

Review comment:
   Do we have unit tests for these newly added methods. Other devs might 
possible start using it in future. So, lets ensure we have good test coverage. 

##
File path: hudi-common/src/main/java/org/apache/hudi/common/fs/FSUtils.java
##
@@ -601,4 +604,84 @@ public static HoodieWrapperFileSystem getFs(String path, 
SerializableConfigurati
 .filter(fileStatus -> 
!fileStatus.getPath().toString().contains(HoodieTableMetaClient.METAFOLDER_NAME))
 .collect(Collectors.toList());
   }
+
+  /**
+   * Deletes a directory by deleting sub-paths in parallel on the file system.
+   *
+   * @param hoodieEngineContext {@code HoodieEngineContext} instance
+   * @param fs file system
+   * @param dirPath directory path
+   * @param parallelism parallelism to use for sub-paths
+   * @return {@code true} if the directory is delete; 

[GitHub] [hudi] hudi-bot edited a comment on pull request #3411: [HUDI-2276] Enable metadata table by default for readers and writers

2021-08-04 Thread GitBox


hudi-bot edited a comment on pull request #3411:
URL: https://github.com/apache/hudi/pull/3411#issuecomment-893073002


   
   ## CI report:
   
   * e441c95e938929d79f78fb9561869bd726dd69b8 Azure: 
[FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=1382)
 
   
   
   Bot commands
 @hudi-bot supports the following commands:
   
- `@hudi-bot run travis` re-run the last Travis build
- `@hudi-bot run azure` re-run the last Azure build
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscr...@hudi.apache.org

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org




[GitHub] [hudi] hudi-bot commented on pull request #3411: [HUDI-2276] Enable metadata table by default for readers and writers

2021-08-04 Thread GitBox


hudi-bot commented on pull request #3411:
URL: https://github.com/apache/hudi/pull/3411#issuecomment-893073002


   
   ## CI report:
   
   * e441c95e938929d79f78fb9561869bd726dd69b8 UNKNOWN
   
   
   Bot commands
 @hudi-bot supports the following commands:
   
- `@hudi-bot run travis` re-run the last Travis build
- `@hudi-bot run azure` re-run the last Azure build
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscr...@hudi.apache.org

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org




[GitHub] [hudi] umehrot2 commented on pull request #3383: [HUDI-2151] Enable defaults for out of box performance

2021-08-04 Thread GitBox


umehrot2 commented on pull request #3383:
URL: https://github.com/apache/hudi/pull/3383#issuecomment-893072921


   Put out a separate PR to enable metadata, as enabling some of these might be 
more involved https://github.com/apache/hudi/pull/3411 . Keeping this PR open, 
and will use this to enable the non-trivial defaults.


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscr...@hudi.apache.org

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org




[GitHub] [hudi] umehrot2 opened a new pull request #3411: [HUDI-2276] Enable metadata table by default for readers and writers

2021-08-04 Thread GitBox


umehrot2 opened a new pull request #3411:
URL: https://github.com/apache/hudi/pull/3411


   ## *Tips*
   - *Thank you very much for contributing to Apache Hudi.*
   - *Please review https://hudi.apache.org/contributing.html before opening a 
pull request.*
   
   ## What is the purpose of the pull request
   
   We have had metadata table disabled by default in Hudi 0.8.0, as we released 
it as an experimental feature. With Hudi 0.9.0, we should enable it by default 
to improve out of the box performance.
   
   ## Brief change log
   
   *(for example:)*
 - *Modify AnnotationLocation checkstyle rule in checkstyle.xml*
   
   ## Verify this pull request
   
   *(Please pick either of the following options)*
   
   This pull request is a trivial rework / code cleanup without any test 
coverage.
   
   *(or)*
   
   This pull request is already covered by existing tests, such as *(please 
describe tests)*.
   
   (or)
   
   This change added tests and can be verified as follows:
   
   *(example:)*
   
 - *Added integration tests for end-to-end.*
 - *Added HoodieClientWriteTest to verify the change.*
 - *Manually verified the change by running a job locally.*
   
   ## Committer checklist
   
- [ ] Has a corresponding JIRA in PR title & commit

- [ ] Commit message is descriptive of the change

- [ ] CI is green
   
- [ ] Necessary doc changes done or have another open PR
  
- [ ] For large changes, please consider breaking it into sub-tasks under 
an umbrella JIRA.


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscr...@hudi.apache.org

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org




[GitHub] [hudi] vingov commented on pull request #3404: [HUDI-2257] Adding note to set Keygen class while deleting data

2021-08-04 Thread GitBox


vingov commented on pull request #3404:
URL: https://github.com/apache/hudi/pull/3404#issuecomment-893069533


   @nsivabalan @veenaypatil - Fixed the build issue in this 
[PR](https://github.com/apache/hudi/pull/3410), once the CI is green we can 
merge, after which we can rebase this branch to fix the build.


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscr...@hudi.apache.org

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org




[GitHub] [hudi] vingov opened a new pull request #3410: [HUDI-1985] Added package-lock.json to avoid dependencies issues during build/deploy

2021-08-04 Thread GitBox


vingov opened a new pull request #3410:
URL: https://github.com/apache/hudi/pull/3410


   
   
   ## *Tips*
   - *Thank you very much for contributing to Apache Hudi.*
   - *Please review https://hudi.apache.org/contributing.html before opening a 
pull request.*
   
   ## What is the purpose of the pull request
   
   *Added package-lock.json so that anyone else who runs npm install to get the 
exact same dependency tree that was already tested and working..*
   
   ## Brief change log
   
   *(for example:)*
 - *Added package-lock.json to avoid build issues.*
   
   ## Verify this pull request
   This change added tests and can be verified as follows:
   
   Run these commands to test the site locally at http://localhost:3000/:
   
   ```
   cd website
   npm run build
   ```
   Manually verified the website re-design changes by running the site locally.
   
   ## Committer checklist
   
- [x] Has a corresponding JIRA in PR title & commit

- [x] Commit message is descriptive of the change

- [ ] CI is green
   
- [ ] Necessary doc changes done or have another open PR
  
- [ ] For large changes, please consider breaking it into sub-tasks under 
an umbrella JIRA.


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscr...@hudi.apache.org

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org




[GitHub] [hudi] xushiyan commented on a change in pull request #3398: [HUDI-2273] Moving some long running tests to functional

2021-08-04 Thread GitBox


xushiyan commented on a change in pull request #3398:
URL: https://github.com/apache/hudi/pull/3398#discussion_r683041878



##
File path: 
hudi-client/hudi-spark-client/src/test/java/org/apache/hudi/client/functional/SparkClientFunctionalTestSuite.java
##
@@ -0,0 +1,32 @@
+/*
+ * Licensed to the Apache Software Foundation (ASF) under one
+ * or more contributor license agreements.  See the NOTICE file
+ * distributed with this work for additional information
+ * regarding copyright ownership.  The ASF licenses this file
+ * to you under the Apache License, Version 2.0 (the
+ * "License"); you may not use this file except in compliance
+ * with the License.  You may obtain a copy of the License at
+ *
+ *   http://www.apache.org/licenses/LICENSE-2.0
+ *
+ * Unless required by applicable law or agreed to in writing,
+ * software distributed under the License is distributed on an
+ * "AS IS" BASIS, WITHOUT WARRANTIES OR CONDITIONS OF ANY
+ * KIND, either express or implied.  See the License for the
+ * specific language governing permissions and limitations
+ * under the License.
+ */
+
+package org.apache.hudi.client.functional;
+
+import org.junit.platform.runner.JUnitPlatform;
+import org.junit.platform.suite.api.IncludeTags;
+import org.junit.platform.suite.api.SelectPackages;
+import org.junit.runner.RunWith;
+
+@RunWith(JUnitPlatform.class)
+@SelectPackages("org.apache.hudi.client")
+@IncludeTags("functional")
+public class SparkClientFunctionalTestSuite {

Review comment:
   i think one should suffice with `@SelectPackages("")` handles multiple 
package paths. but please give a try i haven't done it myself :). (Or even if 
package paths the same for java and scala, it might still work)




-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscr...@hudi.apache.org

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org




[GitHub] [hudi] xushiyan commented on a change in pull request #3398: [HUDI-2273] Moving some long running tests to functional

2021-08-04 Thread GitBox


xushiyan commented on a change in pull request #3398:
URL: https://github.com/apache/hudi/pull/3398#discussion_r683041878



##
File path: 
hudi-client/hudi-spark-client/src/test/java/org/apache/hudi/client/functional/SparkClientFunctionalTestSuite.java
##
@@ -0,0 +1,32 @@
+/*
+ * Licensed to the Apache Software Foundation (ASF) under one
+ * or more contributor license agreements.  See the NOTICE file
+ * distributed with this work for additional information
+ * regarding copyright ownership.  The ASF licenses this file
+ * to you under the Apache License, Version 2.0 (the
+ * "License"); you may not use this file except in compliance
+ * with the License.  You may obtain a copy of the License at
+ *
+ *   http://www.apache.org/licenses/LICENSE-2.0
+ *
+ * Unless required by applicable law or agreed to in writing,
+ * software distributed under the License is distributed on an
+ * "AS IS" BASIS, WITHOUT WARRANTIES OR CONDITIONS OF ANY
+ * KIND, either express or implied.  See the License for the
+ * specific language governing permissions and limitations
+ * under the License.
+ */
+
+package org.apache.hudi.client.functional;
+
+import org.junit.platform.runner.JUnitPlatform;
+import org.junit.platform.suite.api.IncludeTags;
+import org.junit.platform.suite.api.SelectPackages;
+import org.junit.runner.RunWith;
+
+@RunWith(JUnitPlatform.class)
+@SelectPackages("org.apache.hudi.client")
+@IncludeTags("functional")
+public class SparkClientFunctionalTestSuite {

Review comment:
   i think one should suffice with `@SelectPackages("")` handles multiple 
package paths. but please give a try i haven't done it myself :)




-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscr...@hudi.apache.org

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org




[GitHub] [hudi] nsivabalan commented on a change in pull request #3398: [HUDI-2273] Moving some long running tests to functional

2021-08-04 Thread GitBox


nsivabalan commented on a change in pull request #3398:
URL: https://github.com/apache/hudi/pull/3398#discussion_r683040733



##
File path: 
hudi-client/hudi-spark-client/src/test/java/org/apache/hudi/client/functional/SparkClientFunctionalTestSuite.java
##
@@ -0,0 +1,32 @@
+/*
+ * Licensed to the Apache Software Foundation (ASF) under one
+ * or more contributor license agreements.  See the NOTICE file
+ * distributed with this work for additional information
+ * regarding copyright ownership.  The ASF licenses this file
+ * to you under the Apache License, Version 2.0 (the
+ * "License"); you may not use this file except in compliance
+ * with the License.  You may obtain a copy of the License at
+ *
+ *   http://www.apache.org/licenses/LICENSE-2.0
+ *
+ * Unless required by applicable law or agreed to in writing,
+ * software distributed under the License is distributed on an
+ * "AS IS" BASIS, WITHOUT WARRANTIES OR CONDITIONS OF ANY
+ * KIND, either express or implied.  See the License for the
+ * specific language governing permissions and limitations
+ * under the License.
+ */
+
+package org.apache.hudi.client.functional;
+
+import org.junit.platform.runner.JUnitPlatform;
+import org.junit.platform.suite.api.IncludeTags;
+import org.junit.platform.suite.api.SelectPackages;
+import org.junit.runner.RunWith;
+
+@RunWith(JUnitPlatform.class)
+@SelectPackages("org.apache.hudi.client")
+@IncludeTags("functional")
+public class SparkClientFunctionalTestSuite {

Review comment:
   thanks. @xushiyan. quick question. If we have java and scala test 
directory for a module. do we need two FunctionalTestsuite (one for java and 
one for scala) or having just one in java would suffice? 




-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscr...@hudi.apache.org

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org




[GitHub] [hudi] xushiyan commented on a change in pull request #3398: [HUDI-2273] Moving some long running tests to functional

2021-08-04 Thread GitBox


xushiyan commented on a change in pull request #3398:
URL: https://github.com/apache/hudi/pull/3398#discussion_r683038895



##
File path: 
hudi-client/hudi-spark-client/src/test/java/org/apache/hudi/client/functional/SparkClientFunctionalTestSuite.java
##
@@ -0,0 +1,32 @@
+/*
+ * Licensed to the Apache Software Foundation (ASF) under one
+ * or more contributor license agreements.  See the NOTICE file
+ * distributed with this work for additional information
+ * regarding copyright ownership.  The ASF licenses this file
+ * to you under the Apache License, Version 2.0 (the
+ * "License"); you may not use this file except in compliance
+ * with the License.  You may obtain a copy of the License at
+ *
+ *   http://www.apache.org/licenses/LICENSE-2.0
+ *
+ * Unless required by applicable law or agreed to in writing,
+ * software distributed under the License is distributed on an
+ * "AS IS" BASIS, WITHOUT WARRANTIES OR CONDITIONS OF ANY
+ * KIND, either express or implied.  See the License for the
+ * specific language governing permissions and limitations
+ * under the License.
+ */
+
+package org.apache.hudi.client.functional;
+
+import org.junit.platform.runner.JUnitPlatform;
+import org.junit.platform.suite.api.IncludeTags;
+import org.junit.platform.suite.api.SelectPackages;
+import org.junit.runner.RunWith;
+
+@RunWith(JUnitPlatform.class)
+@SelectPackages("org.apache.hudi.client")
+@IncludeTags("functional")
+public class SparkClientFunctionalTestSuite {

Review comment:
   Yes this looks good. `*FunctionalTestSuite.java` is the entrypoint for 
functional tests in each module. Defined in pom.xml functional test profile




-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscr...@hudi.apache.org

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org




[GitHub] [hudi] hudi-bot edited a comment on pull request #2927: [HUDI-1129] Improving schema evolution support in hudi

2021-08-04 Thread GitBox


hudi-bot edited a comment on pull request #2927:
URL: https://github.com/apache/hudi/pull/2927#issuecomment-864700767


   
   ## CI report:
   
   * dfe1c00fce8dd2c9ede13944042430c4c738f414 Azure: 
[FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=1380)
 
   
   
   Bot commands
 @hudi-bot supports the following commands:
   
- `@hudi-bot run travis` re-run the last Travis build
- `@hudi-bot run azure` re-run the last Azure build
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscr...@hudi.apache.org

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org




[GitHub] [hudi] vingov commented on pull request #3404: [HUDI-2257] Adding note to set Keygen class while deleting data

2021-08-04 Thread GitBox


vingov commented on pull request #3404:
URL: https://github.com/apache/hudi/pull/3404#issuecomment-893051174


   @nsivabalan - I guess it's a dependency version mismatch issue, let me add 
the package-lock.json so that the versions will be locked.


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscr...@hudi.apache.org

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org




[GitHub] [hudi] hudi-bot edited a comment on pull request #2927: [HUDI-1129] Improving schema evolution support in hudi

2021-08-04 Thread GitBox


hudi-bot edited a comment on pull request #2927:
URL: https://github.com/apache/hudi/pull/2927#issuecomment-864700767


   
   ## CI report:
   
   * 2667501ff9689af403ed7de7101375ea74ce407b Azure: 
[FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=294)
 
   * dfe1c00fce8dd2c9ede13944042430c4c738f414 Azure: 
[PENDING](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=1380)
 
   
   
   Bot commands
 @hudi-bot supports the following commands:
   
- `@hudi-bot run travis` re-run the last Travis build
- `@hudi-bot run azure` re-run the last Azure build
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscr...@hudi.apache.org

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org




[GitHub] [hudi] hudi-bot edited a comment on pull request #2927: [HUDI-1129] Improving schema evolution support in hudi

2021-08-04 Thread GitBox


hudi-bot edited a comment on pull request #2927:
URL: https://github.com/apache/hudi/pull/2927#issuecomment-864700767


   
   ## CI report:
   
   * 2667501ff9689af403ed7de7101375ea74ce407b Azure: 
[FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=294)
 
   * dfe1c00fce8dd2c9ede13944042430c4c738f414 UNKNOWN
   
   
   Bot commands
 @hudi-bot supports the following commands:
   
- `@hudi-bot run travis` re-run the last Travis build
- `@hudi-bot run azure` re-run the last Azure build
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscr...@hudi.apache.org

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org




[GitHub] [hudi] nsivabalan merged pull request #3398: [HUDI-2273] Moving some long running tests to functional

2021-08-04 Thread GitBox


nsivabalan merged pull request #3398:
URL: https://github.com/apache/hudi/pull/3398


   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscr...@hudi.apache.org

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org




[GitHub] [hudi] nsivabalan commented on pull request #3398: [HUDI-2273] Moving some long running tests to functional

2021-08-04 Thread GitBox


nsivabalan commented on pull request #3398:
URL: https://github.com/apache/hudi/pull/3398#issuecomment-893032290


   Landing for now. Will put up additional PR if required. 


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscr...@hudi.apache.org

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org




[GitHub] [hudi] hudi-bot edited a comment on pull request #3398: [HUDI-2273] Moving some long running tests to functional

2021-08-04 Thread GitBox


hudi-bot edited a comment on pull request #3398:
URL: https://github.com/apache/hudi/pull/3398#issuecomment-892305785


   
   ## CI report:
   
   * 0a32f4afcbf92b85e51b12de7af26b918d58a549 UNKNOWN
   * 805cfcf4e270703ccb03d0db17253308e66280c5 UNKNOWN
   * 5b7d4da1c0ba008a854e00330fb4e18e00687e58 UNKNOWN
   * 033c308c111d420251b6f9bff3e1ea6b48c9756e UNKNOWN
   * 8bf1a88ae9f1eff7e119b83e386d9f7179e0c46f Azure: 
[SUCCESS](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=1379)
 
   
   
   Bot commands
 @hudi-bot supports the following commands:
   
- `@hudi-bot run travis` re-run the last Travis build
- `@hudi-bot run azure` re-run the last Azure build
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscr...@hudi.apache.org

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org




[GitHub] [hudi] hudi-bot edited a comment on pull request #3409: [MINOR] Move to ubuntu-18.04 for Azure CI

2021-08-04 Thread GitBox


hudi-bot edited a comment on pull request #3409:
URL: https://github.com/apache/hudi/pull/3409#issuecomment-892942265


   
   ## CI report:
   
   * 2dab0596a2d884145dd6f516ced082e55619835b UNKNOWN
   * b5a96cf362b3f61ceeb42cddea9c98ac341f5213 Azure: 
[FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=1377)
 
   
   
   Bot commands
 @hudi-bot supports the following commands:
   
- `@hudi-bot run travis` re-run the last Travis build
- `@hudi-bot run azure` re-run the last Azure build
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscr...@hudi.apache.org

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org




[GitHub] [hudi] hudi-bot edited a comment on pull request #3398: [HUDI-2273] Moving some long running tests to functional

2021-08-04 Thread GitBox


hudi-bot edited a comment on pull request #3398:
URL: https://github.com/apache/hudi/pull/3398#issuecomment-892305785


   
   ## CI report:
   
   * 0a32f4afcbf92b85e51b12de7af26b918d58a549 UNKNOWN
   * 805cfcf4e270703ccb03d0db17253308e66280c5 UNKNOWN
   * 5b7d4da1c0ba008a854e00330fb4e18e00687e58 UNKNOWN
   * 40e7e94a88e0b97d1ef09b5c4a3a855e6b9e7f6e Azure: 
[FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=1375)
 Azure: 
[FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=1378)
 Azure: 
[CANCELED](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=1376)
 
   * 033c308c111d420251b6f9bff3e1ea6b48c9756e UNKNOWN
   * 8bf1a88ae9f1eff7e119b83e386d9f7179e0c46f Azure: 
[PENDING](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=1379)
 
   
   
   Bot commands
 @hudi-bot supports the following commands:
   
- `@hudi-bot run travis` re-run the last Travis build
- `@hudi-bot run azure` re-run the last Azure build
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscr...@hudi.apache.org

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org




[GitHub] [hudi] vinothchandar edited a comment on pull request #3409: [MINOR] Move to ubuntu-18.04 for Azure CI

2021-08-04 Thread GitBox


vinothchandar edited a comment on pull request #3409:
URL: https://github.com/apache/hudi/pull/3409#issuecomment-893017385


   @xushiyan @nsivabalan I am landing this for now once CI passes, this gets 
rid of warnings. ubuntu-16.04 is soon to be deprecated. 
   
   But ideally, we should be switching to `ubuntu-latest` and scala 2.12. (may 
be even Spark3) for CI. We should also just build across spark 2, spark 2.11 on 
each commit (not running tests, just build to ensure things remain functional?) 
   
   May be some one can take care of this gap?


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscr...@hudi.apache.org

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org




[GitHub] [hudi] vinothchandar commented on pull request #3409: [MINOR] Move to ubuntu-18.04 for Azure CI

2021-08-04 Thread GitBox


vinothchandar commented on pull request #3409:
URL: https://github.com/apache/hudi/pull/3409#issuecomment-893017385


   @xushiyan @nsivabalan I am landing this for now once CI passes. 
   
   But ideally, we should be switching to `ubuntu-latest` and scala 2.12. (may 
be even Spark3) for CI. We should also just build across spark 2, spark 2.11 on 
each commit (not running tests, just build to ensure things remain functional?) 
   
   May be some one can take care of this gap?


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscr...@hudi.apache.org

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org




[GitHub] [hudi] hudi-bot edited a comment on pull request #3398: [HUDI-2273] Moving some long running tests to functional

2021-08-04 Thread GitBox


hudi-bot edited a comment on pull request #3398:
URL: https://github.com/apache/hudi/pull/3398#issuecomment-892305785


   
   ## CI report:
   
   * 0a32f4afcbf92b85e51b12de7af26b918d58a549 UNKNOWN
   * 805cfcf4e270703ccb03d0db17253308e66280c5 UNKNOWN
   * 5b7d4da1c0ba008a854e00330fb4e18e00687e58 UNKNOWN
   * 40e7e94a88e0b97d1ef09b5c4a3a855e6b9e7f6e Azure: 
[FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=1375)
 Azure: 
[PENDING](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=1378)
 Azure: 
[CANCELED](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=1376)
 
   * 033c308c111d420251b6f9bff3e1ea6b48c9756e UNKNOWN
   * 8bf1a88ae9f1eff7e119b83e386d9f7179e0c46f Azure: 
[PENDING](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=1379)
 
   
   
   Bot commands
 @hudi-bot supports the following commands:
   
- `@hudi-bot run travis` re-run the last Travis build
- `@hudi-bot run azure` re-run the last Azure build
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscr...@hudi.apache.org

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org




[GitHub] [hudi] hudi-bot edited a comment on pull request #3398: [HUDI-2273] Moving some long running tests to functional

2021-08-04 Thread GitBox


hudi-bot edited a comment on pull request #3398:
URL: https://github.com/apache/hudi/pull/3398#issuecomment-892305785


   
   ## CI report:
   
   * 0a32f4afcbf92b85e51b12de7af26b918d58a549 UNKNOWN
   * 805cfcf4e270703ccb03d0db17253308e66280c5 UNKNOWN
   * 5b7d4da1c0ba008a854e00330fb4e18e00687e58 UNKNOWN
   * 40e7e94a88e0b97d1ef09b5c4a3a855e6b9e7f6e Azure: 
[FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=1375)
 Azure: 
[PENDING](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=1378)
 Azure: 
[CANCELED](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=1376)
 
   * 033c308c111d420251b6f9bff3e1ea6b48c9756e UNKNOWN
   * 8bf1a88ae9f1eff7e119b83e386d9f7179e0c46f UNKNOWN
   
   
   Bot commands
 @hudi-bot supports the following commands:
   
- `@hudi-bot run travis` re-run the last Travis build
- `@hudi-bot run azure` re-run the last Azure build
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscr...@hudi.apache.org

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org




[GitHub] [hudi] hudi-bot edited a comment on pull request #3398: [HUDI-2273] Moving some long running tests to functional

2021-08-04 Thread GitBox


hudi-bot edited a comment on pull request #3398:
URL: https://github.com/apache/hudi/pull/3398#issuecomment-892305785


   
   ## CI report:
   
   * 0a32f4afcbf92b85e51b12de7af26b918d58a549 UNKNOWN
   * 805cfcf4e270703ccb03d0db17253308e66280c5 UNKNOWN
   * 5b7d4da1c0ba008a854e00330fb4e18e00687e58 UNKNOWN
   * 40e7e94a88e0b97d1ef09b5c4a3a855e6b9e7f6e Azure: 
[FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=1375)
 Azure: 
[PENDING](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=1376)
 Azure: 
[PENDING](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=1378)
 
   * 033c308c111d420251b6f9bff3e1ea6b48c9756e UNKNOWN
   * 8bf1a88ae9f1eff7e119b83e386d9f7179e0c46f UNKNOWN
   
   
   Bot commands
 @hudi-bot supports the following commands:
   
- `@hudi-bot run travis` re-run the last Travis build
- `@hudi-bot run azure` re-run the last Azure build
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscr...@hudi.apache.org

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org




[GitHub] [hudi] nsivabalan commented on pull request #3398: [HUDI-2273] Moving some long running tests to functional

2021-08-04 Thread GitBox


nsivabalan commented on pull request #3398:
URL: https://github.com/apache/hudi/pull/3398#issuecomment-893007161


   @hudi-bot run azure


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscr...@hudi.apache.org

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org




[GitHub] [hudi] hudi-bot edited a comment on pull request #3409: [MINOR] Move to ubuntu-latest for Azure CI

2021-08-04 Thread GitBox


hudi-bot edited a comment on pull request #3409:
URL: https://github.com/apache/hudi/pull/3409#issuecomment-892942265


   
   ## CI report:
   
   * 2dab0596a2d884145dd6f516ced082e55619835b UNKNOWN
   *  Unknown: [CANCELED](TBD) 
   * b5a96cf362b3f61ceeb42cddea9c98ac341f5213 Azure: 
[PENDING](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=1377)
 
   
   
   Bot commands
 @hudi-bot supports the following commands:
   
- `@hudi-bot run travis` re-run the last Travis build
- `@hudi-bot run azure` re-run the last Azure build
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscr...@hudi.apache.org

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org




[GitHub] [hudi] hudi-bot edited a comment on pull request #3409: [MINOR] Move to ubuntu-latest for Azure CI

2021-08-04 Thread GitBox


hudi-bot edited a comment on pull request #3409:
URL: https://github.com/apache/hudi/pull/3409#issuecomment-892942265


   
   ## CI report:
   
   * 2dab0596a2d884145dd6f516ced082e55619835b UNKNOWN
   *  Unknown: [CANCELED](TBD) 
   * b5a96cf362b3f61ceeb42cddea9c98ac341f5213 UNKNOWN
   
   
   Bot commands
 @hudi-bot supports the following commands:
   
- `@hudi-bot run travis` re-run the last Travis build
- `@hudi-bot run azure` re-run the last Azure build
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscr...@hudi.apache.org

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org




[GitHub] [hudi] vinothchandar commented on pull request #3409: [MINOR] Move to ubuntu-latest for Azure CI

2021-08-04 Thread GitBox


vinothchandar commented on pull request #3409:
URL: https://github.com/apache/hudi/pull/3409#issuecomment-893000906


   @hudi-bot run azure


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscr...@hudi.apache.org

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org




[GitHub] [hudi] hudi-bot edited a comment on pull request #3398: [HUDI-2273] Moving some long running tests to functional

2021-08-04 Thread GitBox


hudi-bot edited a comment on pull request #3398:
URL: https://github.com/apache/hudi/pull/3398#issuecomment-892305785


   
   ## CI report:
   
   * 0a32f4afcbf92b85e51b12de7af26b918d58a549 UNKNOWN
   * 805cfcf4e270703ccb03d0db17253308e66280c5 UNKNOWN
   * 5b7d4da1c0ba008a854e00330fb4e18e00687e58 UNKNOWN
   * 40e7e94a88e0b97d1ef09b5c4a3a855e6b9e7f6e Azure: 
[FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=1375)
 Azure: 
[PENDING](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=1376)
 
   * 033c308c111d420251b6f9bff3e1ea6b48c9756e UNKNOWN
   * 8bf1a88ae9f1eff7e119b83e386d9f7179e0c46f UNKNOWN
   
   
   Bot commands
 @hudi-bot supports the following commands:
   
- `@hudi-bot run travis` re-run the last Travis build
- `@hudi-bot run azure` re-run the last Azure build
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscr...@hudi.apache.org

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org




[GitHub] [hudi] nsivabalan commented on pull request #3398: [HUDI-2273] Moving some long running tests to functional

2021-08-04 Thread GitBox


nsivabalan commented on pull request #3398:
URL: https://github.com/apache/hudi/pull/3398#issuecomment-892996880


   @hudi-bot run azure


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscr...@hudi.apache.org

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org




[GitHub] [hudi] hudi-bot edited a comment on pull request #3398: [HUDI-2273] Moving some long running tests to functional

2021-08-04 Thread GitBox


hudi-bot edited a comment on pull request #3398:
URL: https://github.com/apache/hudi/pull/3398#issuecomment-892305785


   
   ## CI report:
   
   * 0a32f4afcbf92b85e51b12de7af26b918d58a549 UNKNOWN
   * 805cfcf4e270703ccb03d0db17253308e66280c5 UNKNOWN
   * 5b7d4da1c0ba008a854e00330fb4e18e00687e58 UNKNOWN
   * 40e7e94a88e0b97d1ef09b5c4a3a855e6b9e7f6e Azure: 
[FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=1375)
 
   * 033c308c111d420251b6f9bff3e1ea6b48c9756e UNKNOWN
   * 8bf1a88ae9f1eff7e119b83e386d9f7179e0c46f UNKNOWN
   
   
   Bot commands
 @hudi-bot supports the following commands:
   
- `@hudi-bot run travis` re-run the last Travis build
- `@hudi-bot run azure` re-run the last Azure build
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscr...@hudi.apache.org

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org




[GitHub] [hudi] nsivabalan commented on pull request #3404: [HUDI-2257] Adding note to set Keygen class while deleting data

2021-08-04 Thread GitBox


nsivabalan commented on pull request #3404:
URL: https://github.com/apache/hudi/pull/3404#issuecomment-892991015


   @vingov : hey can you help out here. Author did a complete redo of the 
previous patch. Again, build is failing. I don't understand the build errors. 
Can you look at the build errors and suggest ways to fix it. or whats the 
actual issue. 


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscr...@hudi.apache.org

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org




  1   2   3   4   5   6   7   8   9   10   >