[GitHub] [incubator-hudi] vinothchandar commented on a change in pull request #1390: [HUDI-634] Cut 0.5.2 documentation and write release note

2020-03-12 Thread GitBox
vinothchandar commented on a change in pull request #1390: [HUDI-634] Cut 0.5.2 
documentation and write release note
URL: https://github.com/apache/incubator-hudi/pull/1390#discussion_r391422119
 
 

 ##
 File path: docs/_pages/releases.md
 ##
 @@ -6,6 +6,32 @@ toc: true
 last_modified_at: 2019-12-30T15:59:57-04:00
 ---
 
+## [Release 
0.5.2-incubating](https://github.com/apache/incubator-hudi/releases/tag/release-0.5.2-incubating)
 ([docs](/docs/0.5.2-quick-start-guide.html))
+
+### Download Information
+ * Source Release : [Apache Hudi(incubating) 0.5.2-incubating Source 
Release](https://www.apache.org/dist/incubator/hudi/0.5.2-incubating/hudi-0.5.2-incubating.src.tgz)
 
([asc](https://www.apache.org/dist/incubator/hudi/0.5.2-incubating/hudi-0.5.2-incubating.src.tgz.asc),
 
[sha512](https://www.apache.org/dist/incubator/hudi/0.5.2-incubating/hudi-0.5.2-incubating.src.tgz.sha512))
+ * Apache Hudi (incubating) jars corresponding to this release is available 
[here](https://repository.apache.org/#nexus-search;quick~hudi)
+
+### Migration Guide for this release
 
 Review comment:
   if thats in 0.5.1 [(which I think it 
is)](https://github.com/apache/incubator-hudi/tree/release-0.5.1/hudi-utilities/src/main/java/org/apache/hudi/utilities/keygen),
 please add a section to 0.5.1 and not here .. ? 
   
   its fine, we can fix it now atleast.. 


This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
 
For queries about this service, please contact Infrastructure at:
us...@infra.apache.org


With regards,
Apache Git Services


[GitHub] [incubator-hudi] vinothchandar commented on a change in pull request #1390: [HUDI-634] Cut 0.5.2 documentation and write release note

2020-03-11 Thread GitBox
vinothchandar commented on a change in pull request #1390: [HUDI-634] Cut 0.5.2 
documentation and write release note
URL: https://github.com/apache/incubator-hudi/pull/1390#discussion_r391401705
 
 

 ##
 File path: docs/_pages/releases.md
 ##
 @@ -6,6 +6,32 @@ toc: true
 last_modified_at: 2019-12-30T15:59:57-04:00
 ---
 
+## [Release 
0.5.2-incubating](https://github.com/apache/incubator-hudi/releases/tag/release-0.5.2-incubating)
 ([docs](/docs/0.5.2-quick-start-guide.html))
+
+### Download Information
+ * Source Release : [Apache Hudi(incubating) 0.5.2-incubating Source 
Release](https://www.apache.org/dist/incubator/hudi/0.5.2-incubating/hudi-0.5.2-incubating.src.tgz)
 
([asc](https://www.apache.org/dist/incubator/hudi/0.5.2-incubating/hudi-0.5.2-incubating.src.tgz.asc),
 
[sha512](https://www.apache.org/dist/incubator/hudi/0.5.2-incubating/hudi-0.5.2-incubating.src.tgz.sha512))
+ * Apache Hudi (incubating) jars corresponding to this release is available 
[here](https://repository.apache.org/#nexus-search;quick~hudi)
+
+### Migration Guide for this release
 
 Review comment:
   can we call out the `KeyGenerator` rename? this is critical.. already one 
user has raised this in slack or mailing list 


This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
 
For queries about this service, please contact Infrastructure at:
us...@infra.apache.org


With regards,
Apache Git Services


[GitHub] [incubator-hudi] vinothchandar commented on a change in pull request #1390: [HUDI-634] Cut 0.5.2 documentation and write release note

2020-03-11 Thread GitBox
vinothchandar commented on a change in pull request #1390: [HUDI-634] Cut 0.5.2 
documentation and write release note
URL: https://github.com/apache/incubator-hudi/pull/1390#discussion_r391401512
 
 

 ##
 File path: docs/_pages/releases.md
 ##
 @@ -6,6 +6,32 @@ toc: true
 last_modified_at: 2019-12-30T15:59:57-04:00
 ---
 
+## [Release 
0.5.2-incubating](https://github.com/apache/incubator-hudi/releases/tag/release-0.5.2-incubating)
 ([docs](/docs/0.5.2-quick-start-guide.html))
+
+### Download Information
+ * Source Release : [Apache Hudi(incubating) 0.5.2-incubating Source 
Release](https://www.apache.org/dist/incubator/hudi/0.5.2-incubating/hudi-0.5.2-incubating.src.tgz)
 
([asc](https://www.apache.org/dist/incubator/hudi/0.5.2-incubating/hudi-0.5.2-incubating.src.tgz.asc),
 
[sha512](https://www.apache.org/dist/incubator/hudi/0.5.2-incubating/hudi-0.5.2-incubating.src.tgz.sha512))
+ * Apache Hudi (incubating) jars corresponding to this release is available 
[here](https://repository.apache.org/#nexus-search;quick~hudi)
+
+### Migration Guide for this release
+ * Support for overwriting the payload implementation in `hoodie.properties` 
via specifying the `hoodie.compaction.payload.class` config option. Previously, 
once the payload class is set once in `hoodie.properties`, it cannot be 
changed. In some cases, if a code refactor is done and the jar updated, one may 
need to pass the new payload class name.
+ * Write Client restructuring has moved classes around 
([HUDI-554](https://issues.apache.org/jira/browse/HUDI-554)). Package `client` 
now has all the various client classes, that do the transaction management. 
`func` renamed to `execution` and some helpers moved to `client/utils`. All 
compaction code under `io` now under `table/compact`. Rollback code under 
`table/rollback` and in general all code for individual operations under `table`
+ * Simplify `HoodieBloomIndex` without the need for 2GB limit handling. Prior 
to spark 2.4.0, each spark partition has a limit of 2GB. In Hudi 0.5.1, after 
we upgraded to spark 2.4.4, we don't have the limitation anymore. Hence 
removing the safe parallelism constraint we had in` HoodieBloomIndex`.
 
 Review comment:
   yes.. correct.. the question we need to ask yourselves is "does the user 
need to do any action" to migrate.. No action is needed here. That is why I 
don't think this needs to be moved out 


This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
 
For queries about this service, please contact Infrastructure at:
us...@infra.apache.org


With regards,
Apache Git Services


[GitHub] [incubator-hudi] vinothchandar commented on a change in pull request #1390: [HUDI-634] Cut 0.5.2 documentation and write release note

2020-03-11 Thread GitBox
vinothchandar commented on a change in pull request #1390: [HUDI-634] Cut 0.5.2 
documentation and write release note
URL: https://github.com/apache/incubator-hudi/pull/1390#discussion_r391334410
 
 

 ##
 File path: docs/_pages/releases.md
 ##
 @@ -6,6 +6,32 @@ toc: true
 last_modified_at: 2019-12-30T15:59:57-04:00
 ---
 
+## [Release 
0.5.2-incubating](https://github.com/apache/incubator-hudi/releases/tag/release-0.5.2-incubating)
 ([docs](/docs/0.5.2-quick-start-guide.html))
+
+### Download Information
+ * Source Release : [Apache Hudi(incubating) 0.5.2-incubating Source 
Release](https://www.apache.org/dist/incubator/hudi/0.5.2-incubating/hudi-0.5.2-incubating.src.tgz)
 
([asc](https://www.apache.org/dist/incubator/hudi/0.5.2-incubating/hudi-0.5.2-incubating.src.tgz.asc),
 
[sha512](https://www.apache.org/dist/incubator/hudi/0.5.2-incubating/hudi-0.5.2-incubating.src.tgz.sha512))
+ * Apache Hudi (incubating) jars corresponding to this release is available 
[here](https://repository.apache.org/#nexus-search;quick~hudi)
+
+### Migration Guide for this release
+ * Support for overwriting the payload implementation in `hoodie.properties` 
via specifying the `hoodie.compaction.payload.class` config option. Previously, 
once the payload class is set once in `hoodie.properties`, it cannot be 
changed. In some cases, if a code refactor is done and the jar updated, one may 
need to pass the new payload class name.
+ * Write Client restructuring has moved classes around 
([HUDI-554](https://issues.apache.org/jira/browse/HUDI-554)). Package `client` 
now has all the various client classes, that do the transaction management. 
`func` renamed to `execution` and some helpers moved to `client/utils`. All 
compaction code under `io` now under `table/compact`. Rollback code under 
`table/rollback` and in general all code for individual operations under `table`
 
 Review comment:
   Let's make it clearer that this only affects the apps/projects depending on 
`hudi-client`. Users of deltastreamer/datasource will see no change.. 


This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
 
For queries about this service, please contact Infrastructure at:
us...@infra.apache.org


With regards,
Apache Git Services


[GitHub] [incubator-hudi] vinothchandar commented on a change in pull request #1390: [HUDI-634] Cut 0.5.2 documentation and write release note

2020-03-11 Thread GitBox
vinothchandar commented on a change in pull request #1390: [HUDI-634] Cut 0.5.2 
documentation and write release note
URL: https://github.com/apache/incubator-hudi/pull/1390#discussion_r391334510
 
 

 ##
 File path: docs/_pages/releases.md
 ##
 @@ -6,6 +6,32 @@ toc: true
 last_modified_at: 2019-12-30T15:59:57-04:00
 ---
 
+## [Release 
0.5.2-incubating](https://github.com/apache/incubator-hudi/releases/tag/release-0.5.2-incubating)
 ([docs](/docs/0.5.2-quick-start-guide.html))
+
+### Download Information
+ * Source Release : [Apache Hudi(incubating) 0.5.2-incubating Source 
Release](https://www.apache.org/dist/incubator/hudi/0.5.2-incubating/hudi-0.5.2-incubating.src.tgz)
 
([asc](https://www.apache.org/dist/incubator/hudi/0.5.2-incubating/hudi-0.5.2-incubating.src.tgz.asc),
 
[sha512](https://www.apache.org/dist/incubator/hudi/0.5.2-incubating/hudi-0.5.2-incubating.src.tgz.sha512))
+ * Apache Hudi (incubating) jars corresponding to this release is available 
[here](https://repository.apache.org/#nexus-search;quick~hudi)
+
+### Migration Guide for this release
+ * Support for overwriting the payload implementation in `hoodie.properties` 
via specifying the `hoodie.compaction.payload.class` config option. Previously, 
once the payload class is set once in `hoodie.properties`, it cannot be 
changed. In some cases, if a code refactor is done and the jar updated, one may 
need to pass the new payload class name.
+ * Write Client restructuring has moved classes around 
([HUDI-554](https://issues.apache.org/jira/browse/HUDI-554)). Package `client` 
now has all the various client classes, that do the transaction management. 
`func` renamed to `execution` and some helpers moved to `client/utils`. All 
compaction code under `io` now under `table/compact`. Rollback code under 
`table/rollback` and in general all code for individual operations under `table`
+ * Simplify `HoodieBloomIndex` without the need for 2GB limit handling. Prior 
to spark 2.4.0, each spark partition has a limit of 2GB. In Hudi 0.5.1, after 
we upgraded to spark 2.4.4, we don't have the limitation anymore. Hence 
removing the safe parallelism constraint we had in` HoodieBloomIndex`.
 
 Review comment:
   Again, this is not needed for migration rihgt? 


This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
 
For queries about this service, please contact Infrastructure at:
us...@infra.apache.org


With regards,
Apache Git Services


[GitHub] [incubator-hudi] vinothchandar commented on a change in pull request #1390: [HUDI-634] Cut 0.5.2 documentation and write release note

2020-03-11 Thread GitBox
vinothchandar commented on a change in pull request #1390: [HUDI-634] Cut 0.5.2 
documentation and write release note
URL: https://github.com/apache/incubator-hudi/pull/1390#discussion_r391334001
 
 

 ##
 File path: docs/_pages/releases.md
 ##
 @@ -6,6 +6,32 @@ toc: true
 last_modified_at: 2019-12-30T15:59:57-04:00
 ---
 
+## [Release 
0.5.2-incubating](https://github.com/apache/incubator-hudi/releases/tag/release-0.5.2-incubating)
 ([docs](/docs/0.5.2-quick-start-guide.html))
+
+### Download Information
+ * Source Release : [Apache Hudi(incubating) 0.5.2-incubating Source 
Release](https://www.apache.org/dist/incubator/hudi/0.5.2-incubating/hudi-0.5.2-incubating.src.tgz)
 
([asc](https://www.apache.org/dist/incubator/hudi/0.5.2-incubating/hudi-0.5.2-incubating.src.tgz.asc),
 
[sha512](https://www.apache.org/dist/incubator/hudi/0.5.2-incubating/hudi-0.5.2-incubating.src.tgz.sha512))
+ * Apache Hudi (incubating) jars corresponding to this release is available 
[here](https://repository.apache.org/#nexus-search;quick~hudi)
+
+### Migration Guide for this release
+ * Support for overwriting the payload implementation in `hoodie.properties` 
via specifying the `hoodie.compaction.payload.class` config option. Previously, 
once the payload class is set once in `hoodie.properties`, it cannot be 
changed. In some cases, if a code refactor is done and the jar updated, one may 
need to pass the new payload class name.
 
 Review comment:
   I am not sure if this is needed for migration, right? its just a feature. 
Can we move this to highlights?


This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
 
For queries about this service, please contact Infrastructure at:
us...@infra.apache.org


With regards,
Apache Git Services