[jira] [Updated] (HUDI-676) Address issues towards removing use of WIP Disclaimer

[vinoyang (Jira)]

 [ 
https://issues.apache.org/jira/browse/HUDI-676?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

vinoyang updated HUDI-676:
--
Status: Open  (was: New)

> Address issues towards removing use of WIP Disclaimer
> -
>
> Key: HUDI-676
> URL: https://issues.apache.org/jira/browse/HUDI-676
> Project: Apache Hudi (incubating)
>  Issue Type: Task
>  Components: Release & Administrative
>Reporter: Vinoth Chandar
>Assignee: vinoyang
>Priority: Blocker
>  Labels: pull-request-available
> Fix For: 0.5.2
>
>  Time Spent: 10m
>  Remaining Estimate: 0h
>
> https://incubator.apache.org/guides/releasemanagement.html#choice_of_disclaimers
> Currently we use the
> https://github.com/apache/incubator-hudi/blob/master/DISCLAIMER-WIP 
> Addressing gaps to remove this is also a good step in the direction of being 
> compliant 



--
This message was sent by Atlassian Jira
(v8.3.4#803005)

[jira] [Updated] (HUDI-676) Address issues towards removing use of WIP Disclaimer

[vinoyang (Jira)]

 [ 
https://issues.apache.org/jira/browse/HUDI-676?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

vinoyang updated HUDI-676:
--
Status: In Progress  (was: Open)

> Address issues towards removing use of WIP Disclaimer
> -
>
> Key: HUDI-676
> URL: https://issues.apache.org/jira/browse/HUDI-676
> Project: Apache Hudi (incubating)
>  Issue Type: Task
>  Components: Release & Administrative
>Reporter: Vinoth Chandar
>Assignee: vinoyang
>Priority: Blocker
>  Labels: pull-request-available
> Fix For: 0.5.2
>
>  Time Spent: 10m
>  Remaining Estimate: 0h
>
> https://incubator.apache.org/guides/releasemanagement.html#choice_of_disclaimers
> Currently we use the
> https://github.com/apache/incubator-hudi/blob/master/DISCLAIMER-WIP 
> Addressing gaps to remove this is also a good step in the direction of being 
> compliant 



--
This message was sent by Atlassian Jira
(v8.3.4#803005)

[GitHub] [incubator-hudi] codecov-io edited a comment on issue #1387: [HUDI-674] Rename hudi-hadoop-mr-bundle to hudi-hive-bundle

[GitBox]

codecov-io edited a comment on issue #1387: [HUDI-674] Rename 
hudi-hadoop-mr-bundle to hudi-hive-bundle
URL: https://github.com/apache/incubator-hudi/pull/1387#issuecomment-596169301
 
 
   # 
[Codecov](https://codecov.io/gh/apache/incubator-hudi/pull/1387?src=pr&el=h1) 
Report
   > Merging 
[#1387](https://codecov.io/gh/apache/incubator-hudi/pull/1387?src=pr&el=desc) 
into 
[master](https://codecov.io/gh/apache/incubator-hudi/commit/415882f9023795994e9cc8a8294909bbec7ab191?src=pr&el=desc)
 will **increase** coverage by `0.01%`.
   > The diff coverage is `n/a`.
   
   [![Impacted file tree 
graph](https://codecov.io/gh/apache/incubator-hudi/pull/1387/graphs/tree.svg?width=650&token=VTTXabwbs2&height=150&src=pr)](https://codecov.io/gh/apache/incubator-hudi/pull/1387?src=pr&el=tree)
   
   ```diff
   @@ Coverage Diff @@
   ## master   #1387  +/-   ##
   ===
   + Coverage 67.19%   67.2%   +0.01% 
 Complexity  223 223  
   ===
 Files   335 335  
 Lines 16279   16279  
 Branches   16611661  
   ===
   + Hits  10939   10941   +2 
   + Misses 46044603   -1 
   + Partials736 735   -1
   ```
   
   
   | [Impacted 
Files](https://codecov.io/gh/apache/incubator-hudi/pull/1387?src=pr&el=tree) | 
Coverage Δ | Complexity Δ | |
   |---|---|---|---|
   | 
[...n/java/org/apache/hudi/common/model/HoodieKey.java](https://codecov.io/gh/apache/incubator-hudi/pull/1387/diff?src=pr&el=tree#diff-aHVkaS1jb21tb24vc3JjL21haW4vamF2YS9vcmcvYXBhY2hlL2h1ZGkvY29tbW9uL21vZGVsL0hvb2RpZUtleS5qYXZh)
 | `88.88% <0%> (-5.56%)` | `0% <0%> (ø)` | |
   | 
[...e/hudi/common/table/log/HoodieLogFormatWriter.java](https://codecov.io/gh/apache/incubator-hudi/pull/1387/diff?src=pr&el=tree#diff-aHVkaS1jb21tb24vc3JjL21haW4vamF2YS9vcmcvYXBhY2hlL2h1ZGkvY29tbW9uL3RhYmxlL2xvZy9Ib29kaWVMb2dGb3JtYXRXcml0ZXIuamF2YQ==)
 | `76.92% <0%> (+0.96%)` | `0% <0%> (ø)` | :arrow_down: |
   | 
[...i/utilities/deltastreamer/HoodieDeltaStreamer.java](https://codecov.io/gh/apache/incubator-hudi/pull/1387/diff?src=pr&el=tree#diff-aHVkaS11dGlsaXRpZXMvc3JjL21haW4vamF2YS9vcmcvYXBhY2hlL2h1ZGkvdXRpbGl0aWVzL2RlbHRhc3RyZWFtZXIvSG9vZGllRGVsdGFTdHJlYW1lci5qYXZh)
 | `80.8% <0%> (+1.01%)` | `8% <0%> (ø)` | :arrow_down: |
   
   --
   
   [Continue to review full report at 
Codecov](https://codecov.io/gh/apache/incubator-hudi/pull/1387?src=pr&el=continue).
   > **Legend** - [Click here to learn 
more](https://docs.codecov.io/docs/codecov-delta)
   > `Δ = absolute  (impact)`, `ø = not affected`, `? = missing data`
   > Powered by 
[Codecov](https://codecov.io/gh/apache/incubator-hudi/pull/1387?src=pr&el=footer).
 Last update 
[415882f...074e845](https://codecov.io/gh/apache/incubator-hudi/pull/1387?src=pr&el=lastupdated).
 Read the [comment docs](https://docs.codecov.io/docs/pull-request-comments).
   


This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
 
For queries about this service, please contact Infrastructure at:
us...@infra.apache.org


With regards,
Apache Git Services

[GitHub] [incubator-hudi] codecov-io commented on issue #1387: [HUDI-674] Rename hudi-hadoop-mr-bundle to hudi-hive-bundle

[GitBox]

codecov-io commented on issue #1387: [HUDI-674] Rename hudi-hadoop-mr-bundle to 
hudi-hive-bundle
URL: https://github.com/apache/incubator-hudi/pull/1387#issuecomment-596169301
 
 
   # 
[Codecov](https://codecov.io/gh/apache/incubator-hudi/pull/1387?src=pr&el=h1) 
Report
   > Merging 
[#1387](https://codecov.io/gh/apache/incubator-hudi/pull/1387?src=pr&el=desc) 
into 
[master](https://codecov.io/gh/apache/incubator-hudi/commit/415882f9023795994e9cc8a8294909bbec7ab191?src=pr&el=desc)
 will **increase** coverage by `0.01%`.
   > The diff coverage is `n/a`.
   
   [![Impacted file tree 
graph](https://codecov.io/gh/apache/incubator-hudi/pull/1387/graphs/tree.svg?width=650&token=VTTXabwbs2&height=150&src=pr)](https://codecov.io/gh/apache/incubator-hudi/pull/1387?src=pr&el=tree)
   
   ```diff
   @@ Coverage Diff @@
   ## master   #1387  +/-   ##
   ===
   + Coverage 67.19%   67.2%   +0.01% 
 Complexity  223 223  
   ===
 Files   335 335  
 Lines 16279   16279  
 Branches   16611661  
   ===
   + Hits  10939   10941   +2 
   + Misses 46044603   -1 
   + Partials736 735   -1
   ```
   
   
   | [Impacted 
Files](https://codecov.io/gh/apache/incubator-hudi/pull/1387?src=pr&el=tree) | 
Coverage Δ | Complexity Δ | |
   |---|---|---|---|
   | 
[...n/java/org/apache/hudi/common/model/HoodieKey.java](https://codecov.io/gh/apache/incubator-hudi/pull/1387/diff?src=pr&el=tree#diff-aHVkaS1jb21tb24vc3JjL21haW4vamF2YS9vcmcvYXBhY2hlL2h1ZGkvY29tbW9uL21vZGVsL0hvb2RpZUtleS5qYXZh)
 | `88.88% <0%> (-5.56%)` | `0% <0%> (ø)` | |
   | 
[...e/hudi/common/table/log/HoodieLogFormatWriter.java](https://codecov.io/gh/apache/incubator-hudi/pull/1387/diff?src=pr&el=tree#diff-aHVkaS1jb21tb24vc3JjL21haW4vamF2YS9vcmcvYXBhY2hlL2h1ZGkvY29tbW9uL3RhYmxlL2xvZy9Ib29kaWVMb2dGb3JtYXRXcml0ZXIuamF2YQ==)
 | `76.92% <0%> (+0.96%)` | `0% <0%> (ø)` | :arrow_down: |
   | 
[...i/utilities/deltastreamer/HoodieDeltaStreamer.java](https://codecov.io/gh/apache/incubator-hudi/pull/1387/diff?src=pr&el=tree#diff-aHVkaS11dGlsaXRpZXMvc3JjL21haW4vamF2YS9vcmcvYXBhY2hlL2h1ZGkvdXRpbGl0aWVzL2RlbHRhc3RyZWFtZXIvSG9vZGllRGVsdGFTdHJlYW1lci5qYXZh)
 | `80.8% <0%> (+1.01%)` | `8% <0%> (ø)` | :arrow_down: |
   
   --
   
   [Continue to review full report at 
Codecov](https://codecov.io/gh/apache/incubator-hudi/pull/1387?src=pr&el=continue).
   > **Legend** - [Click here to learn 
more](https://docs.codecov.io/docs/codecov-delta)
   > `Δ = absolute  (impact)`, `ø = not affected`, `? = missing data`
   > Powered by 
[Codecov](https://codecov.io/gh/apache/incubator-hudi/pull/1387?src=pr&el=footer).
 Last update 
[415882f...074e845](https://codecov.io/gh/apache/incubator-hudi/pull/1387?src=pr&el=lastupdated).
 Read the [comment docs](https://docs.codecov.io/docs/pull-request-comments).
   


This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
 
For queries about this service, please contact Infrastructure at:
us...@infra.apache.org


With regards,
Apache Git Services

[GitHub] [incubator-hudi] lamber-ken opened a new pull request #1387: [HUDI-674] Rename hudi-hadoop-mr-bundle to hudi-hive-bundle

[GitBox]

lamber-ken opened a new pull request #1387: [HUDI-674] Rename 
hudi-hadoop-mr-bundle to hudi-hive-bundle
URL: https://github.com/apache/incubator-hudi/pull/1387
 
 
   ## What is the purpose of the pull request
   
   Mmore details, ge ahead with
   
https://lists.apache.org/thread.html/ra659be560374a9c2f39007e719bac11a8422e31f42769a49a757ea25%40%3Cdev.hudi.apache.org%3E
   
   ## Brief change log
   
 - Rename `hudi-hadoop-mr-bundle` to `hudi-hive-bundle `
   
   ## Verify this pull request
   
   Test steps: follow docker demo.
   http://hudi.apache.org/docs/docker_demo.html
   
   ## Committer checklist
   
- [X] Has a corresponding JIRA in PR title & commit

- [X] Commit message is descriptive of the change

- [ ] CI is green
   
- [ ] Necessary doc changes done or have another open PR
  
- [ ] For large changes, please consider breaking it into sub-tasks under 
an umbrella JIRA.


This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
 
For queries about this service, please contact Infrastructure at:
us...@infra.apache.org


With regards,
Apache Git Services

[jira] [Updated] (HUDI-674) Rename hudi-hadoop-mr-bundle to hudi-hive-bundle

[ASF GitHub Bot (Jira)]

 [ 
https://issues.apache.org/jira/browse/HUDI-674?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

ASF GitHub Bot updated HUDI-674:

Labels: pull-request-available  (was: )

> Rename hudi-hadoop-mr-bundle to hudi-hive-bundle
> 
>
> Key: HUDI-674
> URL: https://issues.apache.org/jira/browse/HUDI-674
> Project: Apache Hudi (incubating)
>  Issue Type: Sub-task
>  Components: Code Cleanup
>Reporter: lamber-ken
>Assignee: lamber-ken
>Priority: Major
>  Labels: pull-request-available
>




--
This message was sent by Atlassian Jira
(v8.3.4#803005)

[GitHub] [incubator-hudi] codecov-io commented on issue #1386: [HUDI-676] Address issues towards removing use of WIP Disclaimer

[GitBox]

codecov-io commented on issue #1386: [HUDI-676] Address issues towards removing 
use of WIP Disclaimer
URL: https://github.com/apache/incubator-hudi/pull/1386#issuecomment-596163892
 
 
   # 
[Codecov](https://codecov.io/gh/apache/incubator-hudi/pull/1386?src=pr&el=h1) 
Report
   > Merging 
[#1386](https://codecov.io/gh/apache/incubator-hudi/pull/1386?src=pr&el=desc) 
into 
[master](https://codecov.io/gh/apache/incubator-hudi/commit/415882f9023795994e9cc8a8294909bbec7ab191?src=pr&el=desc)
 will **decrease** coverage by `<.01%`.
   > The diff coverage is `n/a`.
   
   [![Impacted file tree 
graph](https://codecov.io/gh/apache/incubator-hudi/pull/1386/graphs/tree.svg?width=650&token=VTTXabwbs2&height=150&src=pr)](https://codecov.io/gh/apache/incubator-hudi/pull/1386?src=pr&el=tree)
   
   ```diff
   @@ Coverage Diff  @@
   ## master#1386  +/-   ##
   
   - Coverage 67.19%   67.19%   -0.01% 
 Complexity  223  223  
   
 Files   335  335  
 Lines 1627916279  
 Branches   1661 1661  
   
   - Hits  1093910938   -1 
 Misses 4604 4604  
   - Partials736  737   +1
   ```
   
   
   | [Impacted 
Files](https://codecov.io/gh/apache/incubator-hudi/pull/1386?src=pr&el=tree) | 
Coverage Δ | Complexity Δ | |
   |---|---|---|---|
   | 
[...n/java/org/apache/hudi/common/model/HoodieKey.java](https://codecov.io/gh/apache/incubator-hudi/pull/1386/diff?src=pr&el=tree#diff-aHVkaS1jb21tb24vc3JjL21haW4vamF2YS9vcmcvYXBhY2hlL2h1ZGkvY29tbW9uL21vZGVsL0hvb2RpZUtleS5qYXZh)
 | `88.88% <0%> (-5.56%)` | `0% <0%> (ø)` | |
   
   --
   
   [Continue to review full report at 
Codecov](https://codecov.io/gh/apache/incubator-hudi/pull/1386?src=pr&el=continue).
   > **Legend** - [Click here to learn 
more](https://docs.codecov.io/docs/codecov-delta)
   > `Δ = absolute  (impact)`, `ø = not affected`, `? = missing data`
   > Powered by 
[Codecov](https://codecov.io/gh/apache/incubator-hudi/pull/1386?src=pr&el=footer).
 Last update 
[415882f...a22ee5a](https://codecov.io/gh/apache/incubator-hudi/pull/1386?src=pr&el=lastupdated).
 Read the [comment docs](https://docs.codecov.io/docs/pull-request-comments).
   


This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
 
For queries about this service, please contact Infrastructure at:
us...@infra.apache.org


With regards,
Apache Git Services

[GitHub] [incubator-hudi] codecov-io edited a comment on issue #1350: [HUDI-629]: Replace Guava's Hashing with an equivalent in NumericUtils.java

[GitBox]

codecov-io edited a comment on issue #1350: [HUDI-629]: Replace Guava's Hashing 
with an equivalent in NumericUtils.java
URL: https://github.com/apache/incubator-hudi/pull/1350#issuecomment-59868
 
 
   # 
[Codecov](https://codecov.io/gh/apache/incubator-hudi/pull/1350?src=pr&el=h1) 
Report
   > Merging 
[#1350](https://codecov.io/gh/apache/incubator-hudi/pull/1350?src=pr&el=desc) 
into 
[master](https://codecov.io/gh/apache/incubator-hudi/commit/415882f9023795994e9cc8a8294909bbec7ab191?src=pr&el=desc)
 will **decrease** coverage by `0.02%`.
   > The diff coverage is `58.5%`.
   
   [![Impacted file tree 
graph](https://codecov.io/gh/apache/incubator-hudi/pull/1350/graphs/tree.svg?width=650&token=VTTXabwbs2&height=150&src=pr)](https://codecov.io/gh/apache/incubator-hudi/pull/1350?src=pr&el=tree)
   
   ```diff
   @@ Coverage Diff  @@
   ## master#1350  +/-   ##
   
   - Coverage 67.19%   67.17%   -0.03% 
 Complexity  223  223  
   
 Files   335  336   +1 
 Lines 1627916299  +20 
 Branches   1661 1661  
   
   + Hits  1093910949  +10 
   - Misses 4604 4609   +5 
   - Partials736  741   +5
   ```
   
   
   | [Impacted 
Files](https://codecov.io/gh/apache/incubator-hudi/pull/1350?src=pr&el=tree) | 
Coverage Δ | Complexity Δ | |
   |---|---|---|---|
   | 
[...java/org/apache/hudi/config/HoodieWriteConfig.java](https://codecov.io/gh/apache/incubator-hudi/pull/1350/diff?src=pr&el=tree#diff-aHVkaS1jbGllbnQvc3JjL21haW4vamF2YS9vcmcvYXBhY2hlL2h1ZGkvY29uZmlnL0hvb2RpZVdyaXRlQ29uZmlnLmphdmE=)
 | `83.84% <ø> (ø)` | `0 <0> (ø)` | :arrow_down: |
   | 
[...pache/hudi/utilities/HoodieWithTimelineServer.java](https://codecov.io/gh/apache/incubator-hudi/pull/1350/diff?src=pr&el=tree#diff-aHVkaS11dGlsaXRpZXMvc3JjL21haW4vamF2YS9vcmcvYXBhY2hlL2h1ZGkvdXRpbGl0aWVzL0hvb2RpZVdpdGhUaW1lbGluZVNlcnZlci5qYXZh)
 | `0% <0%> (ø)` | `0 <0> (ø)` | :arrow_down: |
   | 
[...e/hudi/common/util/queue/BoundedInMemoryQueue.java](https://codecov.io/gh/apache/incubator-hudi/pull/1350/diff?src=pr&el=tree#diff-aHVkaS1jb21tb24vc3JjL21haW4vamF2YS9vcmcvYXBhY2hlL2h1ZGkvY29tbW9uL3V0aWwvcXVldWUvQm91bmRlZEluTWVtb3J5UXVldWUuamF2YQ==)
 | `91.13% <0%> (ø)` | `0 <0> (ø)` | :arrow_down: |
   | 
[...pache/hudi/common/model/TimelineLayoutVersion.java](https://codecov.io/gh/apache/incubator-hudi/pull/1350/diff?src=pr&el=tree#diff-aHVkaS1jb21tb24vc3JjL21haW4vamF2YS9vcmcvYXBhY2hlL2h1ZGkvY29tbW9uL21vZGVsL1RpbWVsaW5lTGF5b3V0VmVyc2lvbi5qYXZh)
 | `65% <0%> (ø)` | `0 <0> (ø)` | :arrow_down: |
   | 
[...pache/hudi/common/versioning/MetadataMigrator.java](https://codecov.io/gh/apache/incubator-hudi/pull/1350/diff?src=pr&el=tree#diff-aHVkaS1jb21tb24vc3JjL21haW4vamF2YS9vcmcvYXBhY2hlL2h1ZGkvY29tbW9uL3ZlcnNpb25pbmcvTWV0YWRhdGFNaWdyYXRvci5qYXZh)
 | `58.33% <0%> (ø)` | `0 <0> (ø)` | :arrow_down: |
   | 
[...common/table/view/FileSystemViewStorageConfig.java](https://codecov.io/gh/apache/incubator-hudi/pull/1350/diff?src=pr&el=tree#diff-aHVkaS1jb21tb24vc3JjL21haW4vamF2YS9vcmcvYXBhY2hlL2h1ZGkvY29tbW9uL3RhYmxlL3ZpZXcvRmlsZVN5c3RlbVZpZXdTdG9yYWdlQ29uZmlnLmphdmE=)
 | `84.12% <0%> (ø)` | `0 <0> (ø)` | :arrow_down: |
   | 
[...in/java/org/apache/hudi/utilities/UtilHelpers.java](https://codecov.io/gh/apache/incubator-hudi/pull/1350/diff?src=pr&el=tree#diff-aHVkaS11dGlsaXRpZXMvc3JjL21haW4vamF2YS9vcmcvYXBhY2hlL2h1ZGkvdXRpbGl0aWVzL1V0aWxIZWxwZXJzLmphdmE=)
 | `62.79% <0%> (ø)` | `20 <0> (ø)` | :arrow_down: |
   | 
[...pache/hudi/common/table/HoodieTableMetaClient.java](https://codecov.io/gh/apache/incubator-hudi/pull/1350/diff?src=pr&el=tree#diff-aHVkaS1jb21tb24vc3JjL21haW4vamF2YS9vcmcvYXBhY2hlL2h1ZGkvY29tbW9uL3RhYmxlL0hvb2RpZVRhYmxlTWV0YUNsaWVudC5qYXZh)
 | `76.77% <0%> (ø)` | `0 <0> (ø)` | :arrow_down: |
   | 
[...mmon/versioning/clean/CleanV2MigrationHandler.java](https://codecov.io/gh/apache/incubator-hudi/pull/1350/diff?src=pr&el=tree#diff-aHVkaS1jb21tb24vc3JjL21haW4vamF2YS9vcmcvYXBhY2hlL2h1ZGkvY29tbW9uL3ZlcnNpb25pbmcvY2xlYW4vQ2xlYW5WMk1pZ3JhdGlvbkhhbmRsZXIuamF2YQ==)
 | `94.87% <0%> (ø)` | `0 <0> (ø)` | :arrow_down: |
   | 
[.../apache/hudi/hive/MultiPartKeysValueExtractor.java](https://codecov.io/gh/apache/incubator-hudi/pull/1350/diff?src=pr&el=tree#diff-aHVkaS1oaXZlLXN5bmMvc3JjL21haW4vamF2YS9vcmcvYXBhY2hlL2h1ZGkvaGl2ZS9NdWx0aVBhcnRLZXlzVmFsdWVFeHRyYWN0b3IuamF2YQ==)
 | `55.55% <0%> (ø)` | `0 <0> (ø)` | :arrow_down: |
   | ... and [34 
more](https://codecov.io/gh/apache/incubator-hudi/pull/1350/diff?src=pr&el=tree-more)
 | |
   
   --
   
   [Continue to review full report at 
Codecov](https://codecov.io/gh/apache/incubator-hudi/pull/1350?src=pr&el=continue).
   > **Legend** - [Click here to learn 
more](https://docs.codecov.io/docs/codecov-delta)
 

Build failed in Jenkins: hudi-snapshot-deployment-0.5 #210

[Apache Jenkins Server]

See 


Changes:


--
[...truncated 2.41 KB...]
/home/jenkins/tools/maven/apache-maven-3.5.4/conf:
logging
settings.xml
toolchains.xml

/home/jenkins/tools/maven/apache-maven-3.5.4/conf/logging:
simplelogger.properties

/home/jenkins/tools/maven/apache-maven-3.5.4/lib:
aopalliance-1.0.jar
cdi-api-1.0.jar
cdi-api.license
commons-cli-1.4.jar
commons-cli.license
commons-io-2.5.jar
commons-io.license
commons-lang3-3.5.jar
commons-lang3.license
ext
guava-20.0.jar
guice-4.2.0-no_aop.jar
jansi-1.17.1.jar
jansi-native
javax.inject-1.jar
jcl-over-slf4j-1.7.25.jar
jcl-over-slf4j.license
jsr250-api-1.0.jar
jsr250-api.license
maven-artifact-3.5.4.jar
maven-artifact.license
maven-builder-support-3.5.4.jar
maven-builder-support.license
maven-compat-3.5.4.jar
maven-compat.license
maven-core-3.5.4.jar
maven-core.license
maven-embedder-3.5.4.jar
maven-embedder.license
maven-model-3.5.4.jar
maven-model-builder-3.5.4.jar
maven-model-builder.license
maven-model.license
maven-plugin-api-3.5.4.jar
maven-plugin-api.license
maven-repository-metadata-3.5.4.jar
maven-repository-metadata.license
maven-resolver-api-1.1.1.jar
maven-resolver-api.license
maven-resolver-connector-basic-1.1.1.jar
maven-resolver-connector-basic.license
maven-resolver-impl-1.1.1.jar
maven-resolver-impl.license
maven-resolver-provider-3.5.4.jar
maven-resolver-provider.license
maven-resolver-spi-1.1.1.jar
maven-resolver-spi.license
maven-resolver-transport-wagon-1.1.1.jar
maven-resolver-transport-wagon.license
maven-resolver-util-1.1.1.jar
maven-resolver-util.license
maven-settings-3.5.4.jar
maven-settings-builder-3.5.4.jar
maven-settings-builder.license
maven-settings.license
maven-shared-utils-3.2.1.jar
maven-shared-utils.license
maven-slf4j-provider-3.5.4.jar
maven-slf4j-provider.license
org.eclipse.sisu.inject-0.3.3.jar
org.eclipse.sisu.inject.license
org.eclipse.sisu.plexus-0.3.3.jar
org.eclipse.sisu.plexus.license
plexus-cipher-1.7.jar
plexus-cipher.license
plexus-component-annotations-1.7.1.jar
plexus-component-annotations.license
plexus-interpolation-1.24.jar
plexus-interpolation.license
plexus-sec-dispatcher-1.4.jar
plexus-sec-dispatcher.license
plexus-utils-3.1.0.jar
plexus-utils.license
slf4j-api-1.7.25.jar
slf4j-api.license
wagon-file-3.1.0.jar
wagon-file.license
wagon-http-3.1.0-shaded.jar
wagon-http.license
wagon-provider-api-3.1.0.jar
wagon-provider-api.license

/home/jenkins/tools/maven/apache-maven-3.5.4/lib/ext:
README.txt

/home/jenkins/tools/maven/apache-maven-3.5.4/lib/jansi-native:
freebsd32
freebsd64
linux32
linux64
osx
README.txt
windows32
windows64

/home/jenkins/tools/maven/apache-maven-3.5.4/lib/jansi-native/freebsd32:
libjansi.so

/home/jenkins/tools/maven/apache-maven-3.5.4/lib/jansi-native/freebsd64:
libjansi.so

/home/jenkins/tools/maven/apache-maven-3.5.4/lib/jansi-native/linux32:
libjansi.so

/home/jenkins/tools/maven/apache-maven-3.5.4/lib/jansi-native/linux64:
libjansi.so

/home/jenkins/tools/maven/apache-maven-3.5.4/lib/jansi-native/osx:
libjansi.jnilib

/home/jenkins/tools/maven/apache-maven-3.5.4/lib/jansi-native/windows32:
jansi.dll

/home/jenkins/tools/maven/apache-maven-3.5.4/lib/jansi-native/windows64:
jansi.dll
Finished /home/jenkins/tools/maven/apache-maven-3.5.4 Directory Listing :
Detected current version as: 
'HUDI_home=
0.6.0-SNAPSHOT'
[INFO] Scanning for projects...
[WARNING] 
[WARNING] Some problems were encountered while building the effective model for 
org.apache.hudi:hudi-spark_2.11:jar:0.6.0-SNAPSHOT
[WARNING] 'artifactId' contains an expression but should be a constant. @ 
org.apache.hudi:hudi-spark_${scala.binary.version}:[unknown-version], 

 line 26, column 15
[WARNING] 
[WARNING] Some problems were encountered while building the effective model for 
org.apache.hudi:hudi-timeline-service:jar:0.6.0-SNAPSHOT
[WARNING] 'build.plugins.plugin.(groupId:artifactId)' must be unique but found 
duplicate declaration of plugin org.jacoco:jacoco-maven-plugin @ 
org.apache.hudi:hudi-timeline-service:[unknown-version], 

 line 58, column 15
[WARNING] 
[WARNING] Some problems were encountered while building the effective model for 
org.apache.hudi:hudi-utilities_2.11:jar:0.6.0-SNAPSHOT
[WARNING] 'artifactId' contains an expression but should be a constant. @ 
org.apache.hudi:hudi-utilities_${scala.binary.version}:[unknown-version], 

 line 26, column 15
[WARNING] 
[WARNING] Some problems were encountered while building the effective model for 
org.apache.hudi:hudi-spark-bundle_2.11:jar:0.6.0-SNAPSHOT
[WARNING] 'artifactId' contains an expression but should be a constant. @ 
or

[GitHub] [incubator-hudi] yanghua commented on issue #1386: [HUDI-676] Address issues towards removing use of WIP Disclaimer

[GitBox]

yanghua commented on issue #1386: [HUDI-676] Address issues towards removing 
use of WIP Disclaimer
URL: https://github.com/apache/incubator-hudi/pull/1386#issuecomment-596162453
 
 
   @vinothchandar @smarthi Have changed the disclaimer to the standard. Please 
help to review. More details please see here: 
https://incubator.apache.org/guides/releasemanagement.html#choice_of_disclaimers


This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
 
For queries about this service, please contact Infrastructure at:
us...@infra.apache.org


With regards,
Apache Git Services

[jira] [Updated] (HUDI-676) Address issues towards removing use of WIP Disclaimer

[ASF GitHub Bot (Jira)]

 [ 
https://issues.apache.org/jira/browse/HUDI-676?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

ASF GitHub Bot updated HUDI-676:

Labels: pull-request-available  (was: )

> Address issues towards removing use of WIP Disclaimer
> -
>
> Key: HUDI-676
> URL: https://issues.apache.org/jira/browse/HUDI-676
> Project: Apache Hudi (incubating)
>  Issue Type: Task
>  Components: Release & Administrative
>Reporter: Vinoth Chandar
>Assignee: vinoyang
>Priority: Blocker
>  Labels: pull-request-available
> Fix For: 0.5.2
>
>
> https://incubator.apache.org/guides/releasemanagement.html#choice_of_disclaimers
> Currently we use the
> https://github.com/apache/incubator-hudi/blob/master/DISCLAIMER-WIP 
> Addressing gaps to remove this is also a good step in the direction of being 
> compliant 



--
This message was sent by Atlassian Jira
(v8.3.4#803005)

[GitHub] [incubator-hudi] yanghua opened a new pull request #1386: [HUDI-676] Address issues towards removing use of WIP Disclaimer

[GitBox]

yanghua opened a new pull request #1386: [HUDI-676] Address issues towards 
removing use of WIP Disclaimer
URL: https://github.com/apache/incubator-hudi/pull/1386
 
 
   ## What is the purpose of the pull request
   
   *This pull request addresses issues towards removing use of WIP Disclaimer*
   
   ## Brief change log
   
 - *Address issues towards removing use of WIP Disclaimer*
   
   ## Verify this pull request
   
   This pull request is a trivial rework / code cleanup without any test 
coverage.
   
   
   ## Committer checklist
   
- [ ] Has a corresponding JIRA in PR title & commit

- [ ] Commit message is descriptive of the change

- [ ] CI is green
   
- [ ] Necessary doc changes done or have another open PR
  
- [ ] For large changes, please consider breaking it into sub-tasks under 
an umbrella JIRA.


This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
 
For queries about this service, please contact Infrastructure at:
us...@infra.apache.org


With regards,
Apache Git Services

[jira] [Closed] (HUDI-581) NOTICE need more work as it missing content form included 3rd party ALv2 licensed NOTICE files

[Suneel Marthi (Jira)]

 [ 
https://issues.apache.org/jira/browse/HUDI-581?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Suneel Marthi closed HUDI-581.
--

> NOTICE need more work as it missing content form included 3rd party ALv2 
> licensed NOTICE files
> --
>
> Key: HUDI-581
> URL: https://issues.apache.org/jira/browse/HUDI-581
> Project: Apache Hudi (incubating)
>  Issue Type: Improvement
>  Components: Release & Administrative
>Reporter: leesf
>Assignee: Suneel Marthi
>Priority: Blocker
>  Labels: pull-request-available
> Fix For: 0.5.2
>
>  Time Spent: 20m
>  Remaining Estimate: 0h
>
> Issues pointed out in general@incubator ML, more context here: 
> [https://lists.apache.org/thread.html/rd3f4a72d82a4a5a81b2c6bd71e1417054daa38637ce8e07901f26f04%40%3Cgeneral.incubator.apache.org%3E]
>  
> Would get it fixed before next release.



--
This message was sent by Atlassian Jira
(v8.3.4#803005)

[jira] [Closed] (HUDI-108) Simplify HoodieBloomIndex without the need for 2GB limit handling

[Suneel Marthi (Jira)]

 [ 
https://issues.apache.org/jira/browse/HUDI-108?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Suneel Marthi closed HUDI-108.
--

> Simplify HoodieBloomIndex without the need for 2GB limit handling
> -
>
> Key: HUDI-108
> URL: https://issues.apache.org/jira/browse/HUDI-108
> Project: Apache Hudi (incubating)
>  Issue Type: Improvement
>  Components: Index, Performance
>Reporter: Vinoth Chandar
>Assignee: sivabalan narayanan
>Priority: Major
>  Labels: pull-request-available
> Fix For: 0.5.2
>
>  Time Spent: 10m
>  Remaining Estimate: 0h
>




--
This message was sent by Atlassian Jira
(v8.3.4#803005)

[jira] [Resolved] (HUDI-581) NOTICE need more work as it missing content form included 3rd party ALv2 licensed NOTICE files

[Suneel Marthi (Jira)]

 [ 
https://issues.apache.org/jira/browse/HUDI-581?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Suneel Marthi resolved HUDI-581.

Resolution: Fixed

> NOTICE need more work as it missing content form included 3rd party ALv2 
> licensed NOTICE files
> --
>
> Key: HUDI-581
> URL: https://issues.apache.org/jira/browse/HUDI-581
> Project: Apache Hudi (incubating)
>  Issue Type: Improvement
>  Components: Release & Administrative
>Reporter: leesf
>Assignee: Suneel Marthi
>Priority: Blocker
>  Labels: pull-request-available
> Fix For: 0.5.2
>
>  Time Spent: 20m
>  Remaining Estimate: 0h
>
> Issues pointed out in general@incubator ML, more context here: 
> [https://lists.apache.org/thread.html/rd3f4a72d82a4a5a81b2c6bd71e1417054daa38637ce8e07901f26f04%40%3Cgeneral.incubator.apache.org%3E]
>  
> Would get it fixed before next release.



--
This message was sent by Atlassian Jira
(v8.3.4#803005)

[GitHub] [incubator-hudi] lamber-ken edited a comment on issue #1373: [WIP] [HUDI-646] Re-enable TestUpdateSchemaEvolution to reproduce CI error

[GitBox]

lamber-ken edited a comment on issue #1373: [WIP] [HUDI-646] Re-enable 
TestUpdateSchemaEvolution to reproduce CI error
URL: https://github.com/apache/incubator-hudi/pull/1373#issuecomment-596161259
 
 
   hi @vinothchandar, no need to assign it myself again(like kryo issue), 
willing to debug challenging issues.
   Trying to find out the root cause, keep going : )
   
   btw, if you have time, try
   ```
   ===
   --- 
hudi-client/src/test/java/org/apache/hudi/client/TestUpdateSchemaEvolution.java 
 (revision 90227eeda757516abdd06b436ae08a4adacc28e1)
   +++ 
hudi-client/src/test/java/org/apache/hudi/client/TestUpdateSchemaEvolution.java 
 (date 1583616789967)
   @@ -55,6 +55,7 @@
initPath();
HoodieTestUtils.init(HoodieTestUtils.getDefaultHadoopConf(), basePath);
initSparkContexts("TestUpdateSchemaEvolution");
   +initFileSystem();
  }
   ```


This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
 
For queries about this service, please contact Infrastructure at:
us...@infra.apache.org


With regards,
Apache Git Services

[incubator-hudi] branch master updated (5f8bf97 -> 415882f)

[smarthi]

This is an automated email from the ASF dual-hosted git repository.

smarthi pushed a change to branch master
in repository https://gitbox.apache.org/repos/asf/incubator-hudi.git.


from 5f8bf97  [HUDI-671] Added unit-test for HBaseIndex (#1381)
 add 415882f  [HUDI-581] NOTICE need more work as it missing content form 
included 3rd party ALv2 licensed NOTICE files (#1354)

No new revisions were added by this update.

Summary of changes:
 NOTICE | 83 +-
 1 file changed, 82 insertions(+), 1 deletion(-)

[GitHub] [incubator-hudi] lamber-ken commented on issue #1373: [WIP] [HUDI-646] Re-enable TestUpdateSchemaEvolution to reproduce CI error

[GitBox]

lamber-ken commented on issue #1373: [WIP] [HUDI-646] Re-enable 
TestUpdateSchemaEvolution to reproduce CI error
URL: https://github.com/apache/incubator-hudi/pull/1373#issuecomment-596161259
 
 
   hi @vinothchandar, no need to assign it myself again(like kryo issue), 
willing to debug challenging issues.
   Trying to find out the root cause, keep going : )


This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
 
For queries about this service, please contact Infrastructure at:
us...@infra.apache.org


With regards,
Apache Git Services

[GitHub] [incubator-hudi] smarthi merged pull request #1354: [HUDI-581] NOTICE need more work as it missing content form included 3rd party ALv2 licensed NOTICE files

[GitBox]

smarthi merged pull request #1354: [HUDI-581] NOTICE need more work as it 
missing content form included 3rd party ALv2 licensed NOTICE files
URL: https://github.com/apache/incubator-hudi/pull/1354
 
 
   


This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
 
For queries about this service, please contact Infrastructure at:
us...@infra.apache.org


With regards,
Apache Git Services

[GitHub] [incubator-hudi] vinothchandar commented on issue #1384: [SUPPORT] Hudi datastore missing updates for many records

[GitBox]

vinothchandar commented on issue #1384: [SUPPORT] Hudi datastore missing 
updates for many records
URL: https://github.com/apache/incubator-hudi/issues/1384#issuecomment-596159563
 
 
   Does sound weird and the fact that you can repro on dev environment suggests 
may be this is a data issue? Can you see any errors reported in the commit 
metadata. 
   
   


This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
 
For queries about this service, please contact Infrastructure at:
us...@infra.apache.org


With regards,
Apache Git Services

[GitHub] [incubator-hudi] leesf commented on issue #1360: [HUDI-344][RFC-09] Hudi Dataset Snapshot Exporter

[GitBox]

leesf commented on issue #1360: [HUDI-344][RFC-09] Hudi Dataset Snapshot 
Exporter
URL: https://github.com/apache/incubator-hudi/pull/1360#issuecomment-596159183
 
 
   @OpenOpened Thanks for opening the PR, looks good overall, and @xushiyan 
Thanks for your detail review, only left some minor comments.


This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
 
For queries about this service, please contact Infrastructure at:
us...@infra.apache.org


With regards,
Apache Git Services

[GitHub] [incubator-hudi] leesf commented on a change in pull request #1360: [HUDI-344][RFC-09] Hudi Dataset Snapshot Exporter

[GitBox]

leesf commented on a change in pull request #1360: [HUDI-344][RFC-09] Hudi 
Dataset Snapshot Exporter
URL: https://github.com/apache/incubator-hudi/pull/1360#discussion_r389328898
 
 

 ##
 File path: 
hudi-utilities/src/main/java/org/apache/hudi/utilities/HoodieSnapshotExporter.java
 ##
 @@ -0,0 +1,233 @@
+/*
+ * Licensed to the Apache Software Foundation (ASF) under one
+ * or more contributor license agreements.  See the NOTICE file
+ * distributed with this work for additional information
+ * regarding copyright ownership.  The ASF licenses this file
+ * to you under the Apache License, Version 2.0 (the
+ * "License"); you may not use this file except in compliance
+ * with the License.  You may obtain a copy of the License at
+ *
+ *  http://www.apache.org/licenses/LICENSE-2.0
+ *
+ * Unless required by applicable law or agreed to in writing, software
+ * distributed under the License is distributed on an "AS IS" BASIS,
+ * WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
+ * See the License for the specific language governing permissions and
+ * limitations under the License.
+ */
+
+package org.apache.hudi.utilities;
+
+import com.beust.jcommander.JCommander;
+import com.beust.jcommander.Parameter;
+
+import org.apache.hadoop.fs.FileStatus;
+import org.apache.hadoop.fs.FileSystem;
+import org.apache.hadoop.fs.FileUtil;
+import org.apache.hadoop.fs.Path;
+import org.apache.hudi.common.util.StringUtils;
+import org.apache.hudi.common.SerializableConfiguration;
+import org.apache.hudi.common.model.HoodiePartitionMetadata;
+import org.apache.hudi.common.table.HoodieTableConfig;
+import org.apache.hudi.common.table.HoodieTableMetaClient;
+import org.apache.hudi.common.table.HoodieTimeline;
+import org.apache.hudi.common.table.TableFileSystemView;
+import org.apache.hudi.common.table.timeline.HoodieInstant;
+import org.apache.hudi.common.table.view.HoodieTableFileSystemView;
+import org.apache.hudi.common.util.FSUtils;
+import org.apache.hudi.common.util.Option;
+import org.apache.log4j.LogManager;
+import org.apache.log4j.Logger;
+import org.apache.spark.api.java.JavaSparkContext;
+import org.apache.spark.sql.Column;
+import org.apache.spark.sql.DataFrameWriter;
+import org.apache.spark.sql.Dataset;
+import org.apache.spark.sql.Row;
+import org.apache.spark.sql.SaveMode;
+import org.apache.spark.sql.SparkSession;
+import org.apache.spark.sql.execution.datasources.DataSource;
+
+import scala.Tuple2;
+import scala.collection.JavaConversions;
+
+import java.io.IOException;
+import java.io.Serializable;
+import java.util.ArrayList;
+import java.util.Arrays;
+import java.util.List;
+import java.util.stream.Collectors;
+
+/**
+ * Export the latest records of Hudi dataset to a set of external files (e.g., 
plain parquet files).
+ */
+
+public class HoodieSnapshotExporter {
+  private static final Logger LOG = 
LogManager.getLogger(HoodieSnapshotExporter.class);
+
+  public static class Config implements Serializable {
+@Parameter(names = {"--source-base-path"}, description = "Base path for 
the source Hudi dataset to be snapshotted", required = true)
+String sourceBasePath = null;
+
+@Parameter(names = {"--target-base-path"}, description = "Base path for 
the target output files (snapshots)", required = true)
+String targetOutputPath = null;
+
+@Parameter(names = {"--snapshot-prefix"}, description = "Snapshot prefix 
or directory under the target base path in order to segregate different 
snapshots")
+String snapshotPrefix;
+
+@Parameter(names = {"--output-format"}, description = "e.g. Hudi or 
Parquet", required = true)
+String outputFormat;
+
+@Parameter(names = {"--output-partition-field"}, description = "A field to 
be used by Spark repartitioning")
+String outputPartitionField;
+  }
+
+  public int export(SparkSession spark, Config cfg) throws IOException {
+JavaSparkContext jsc = new JavaSparkContext(spark.sparkContext());
+FileSystem fs = FSUtils.getFs(cfg.sourceBasePath, 
jsc.hadoopConfiguration());
+
+final SerializableConfiguration serConf = new 
SerializableConfiguration(jsc.hadoopConfiguration());
+final HoodieTableMetaClient tableMetadata = new 
HoodieTableMetaClient(fs.getConf(), cfg.sourceBasePath);
+final TableFileSystemView.BaseFileOnlyView fsView = new 
HoodieTableFileSystemView(tableMetadata,
+
tableMetadata.getActiveTimeline().getCommitsTimeline().filterCompletedInstants());
+// Get the latest commit
+Option latestCommit =
+
tableMetadata.getActiveTimeline().getCommitsTimeline().filterCompletedInstants().lastInstant();
+if (!latestCommit.isPresent()) {
+  LOG.error("No commits present. Nothing to snapshot");
+  return -1;
+}
+final String latestCommitTimestamp = latestCommit.get().getTimestamp();
 
 Review comment:
   one minor question, would we support config commit time ? it is optional, 
and get lastest commit by default or get the specified 

[GitHub] [incubator-hudi] leesf commented on a change in pull request #1360: [HUDI-344][RFC-09] Hudi Dataset Snapshot Exporter

[GitBox]

leesf commented on a change in pull request #1360: [HUDI-344][RFC-09] Hudi 
Dataset Snapshot Exporter
URL: https://github.com/apache/incubator-hudi/pull/1360#discussion_r389328760
 
 

 ##
 File path: 
hudi-utilities/src/main/java/org/apache/hudi/utilities/HoodieSnapshotExporter.java
 ##
 @@ -0,0 +1,233 @@
+/*
+ * Licensed to the Apache Software Foundation (ASF) under one
+ * or more contributor license agreements.  See the NOTICE file
+ * distributed with this work for additional information
+ * regarding copyright ownership.  The ASF licenses this file
+ * to you under the Apache License, Version 2.0 (the
+ * "License"); you may not use this file except in compliance
+ * with the License.  You may obtain a copy of the License at
+ *
+ *  http://www.apache.org/licenses/LICENSE-2.0
+ *
+ * Unless required by applicable law or agreed to in writing, software
+ * distributed under the License is distributed on an "AS IS" BASIS,
+ * WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
+ * See the License for the specific language governing permissions and
+ * limitations under the License.
+ */
+
+package org.apache.hudi.utilities;
+
+import com.beust.jcommander.JCommander;
+import com.beust.jcommander.Parameter;
+
+import org.apache.hadoop.fs.FileStatus;
+import org.apache.hadoop.fs.FileSystem;
+import org.apache.hadoop.fs.FileUtil;
+import org.apache.hadoop.fs.Path;
+import org.apache.hudi.common.util.StringUtils;
+import org.apache.hudi.common.SerializableConfiguration;
+import org.apache.hudi.common.model.HoodiePartitionMetadata;
+import org.apache.hudi.common.table.HoodieTableConfig;
+import org.apache.hudi.common.table.HoodieTableMetaClient;
+import org.apache.hudi.common.table.HoodieTimeline;
+import org.apache.hudi.common.table.TableFileSystemView;
+import org.apache.hudi.common.table.timeline.HoodieInstant;
+import org.apache.hudi.common.table.view.HoodieTableFileSystemView;
+import org.apache.hudi.common.util.FSUtils;
+import org.apache.hudi.common.util.Option;
+import org.apache.log4j.LogManager;
+import org.apache.log4j.Logger;
+import org.apache.spark.api.java.JavaSparkContext;
+import org.apache.spark.sql.Column;
+import org.apache.spark.sql.DataFrameWriter;
+import org.apache.spark.sql.Dataset;
+import org.apache.spark.sql.Row;
+import org.apache.spark.sql.SaveMode;
+import org.apache.spark.sql.SparkSession;
+import org.apache.spark.sql.execution.datasources.DataSource;
+
+import scala.Tuple2;
+import scala.collection.JavaConversions;
+
+import java.io.IOException;
+import java.io.Serializable;
+import java.util.ArrayList;
+import java.util.Arrays;
+import java.util.List;
+import java.util.stream.Collectors;
+
+/**
+ * Export the latest records of Hudi dataset to a set of external files (e.g., 
plain parquet files).
+ */
+
+public class HoodieSnapshotExporter {
+  private static final Logger LOG = 
LogManager.getLogger(HoodieSnapshotExporter.class);
+
+  public static class Config implements Serializable {
+@Parameter(names = {"--source-base-path"}, description = "Base path for 
the source Hudi dataset to be snapshotted", required = true)
+String sourceBasePath = null;
+
+@Parameter(names = {"--target-base-path"}, description = "Base path for 
the target output files (snapshots)", required = true)
+String targetOutputPath = null;
+
+@Parameter(names = {"--snapshot-prefix"}, description = "Snapshot prefix 
or directory under the target base path in order to segregate different 
snapshots")
 
 Review comment:
   the description here, I feel a little bit wierd after reading the code 
below, it means only export source Hudi dataset which contains the 
snapshotPrefix? would be changed to `Snapshot prefix or directory under the 
source Hudi dataset to be exported`? cc @OpenOpened @xushiyan 


This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
 
For queries about this service, please contact Infrastructure at:
us...@infra.apache.org


With regards,
Apache Git Services

[GitHub] [incubator-hudi] vinothchandar commented on issue #1354: [HUDI-581] NOTICE need more work as it missing content form included 3rd party ALv2 licensed NOTICE files

[GitBox]

vinothchandar commented on issue #1354: [HUDI-581] NOTICE need more work as it 
missing content form included 3rd party ALv2 licensed NOTICE files
URL: https://github.com/apache/incubator-hudi/pull/1354#issuecomment-596154105
 
 
   I am looking at more samples still.. I can do a follow on fix for 
https://issues.apache.org/jira/browse/HUDI-662 
   
   let's merge this PR as is... This is adding bundled deps to the `NOTICE` 
like how Flink is doing.. 


This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
 
For queries about this service, please contact Infrastructure at:
us...@infra.apache.org


With regards,
Apache Git Services

[GitHub] [incubator-hudi] vinothchandar commented on a change in pull request #1354: [HUDI-581] NOTICE need more work as it missing content form included 3rd party ALv2 licensed NOTICE files

[GitBox]

vinothchandar commented on a change in pull request #1354: [HUDI-581] NOTICE 
need more work as it missing content form included 3rd party ALv2 licensed 
NOTICE files
URL: https://github.com/apache/incubator-hudi/pull/1354#discussion_r389324734
 
 

 ##
 File path: NOTICE
 ##
 @@ -1,5 +1,86 @@
 Apache Hudi (incubating)
-Copyright 2020 The Apache Software Foundation
+Copyright 2019 and onwards The Apache Software Foundation
 
 This product includes software developed at
 The Apache Software Foundation (http://www.apache.org/).
+
+This project bundles the following dependencies
 
 Review comment:
   we have more bundled like beust/jcommander etc? (the list I pasted before).. 
 


This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
 
For queries about this service, please contact Infrastructure at:
us...@infra.apache.org


With regards,
Apache Git Services

[GitHub] [incubator-hudi] vinothchandar commented on issue #1373: [WIP] [HUDI-646] Re-enable TestUpdateSchemaEvolution to reproduce CI error

[GitBox]

vinothchandar commented on issue #1373: [WIP] [HUDI-646] Re-enable 
TestUpdateSchemaEvolution to reproduce CI error
URL: https://github.com/apache/incubator-hudi/pull/1373#issuecomment-596153759
 
 
   @lamber-ken sg.. please assign the JIRA to yourself in that case.. It's a 
really weird case.. 


This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
 
For queries about this service, please contact Infrastructure at:
us...@infra.apache.org


With regards,
Apache Git Services

[GitHub] [incubator-hudi] vinothchandar merged pull request #1381: [HUDI-671] Added unit-test for HBaseIndex

[GitBox]

vinothchandar merged pull request #1381: [HUDI-671] Added unit-test for 
HBaseIndex
URL: https://github.com/apache/incubator-hudi/pull/1381
 
 
   


This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
 
For queries about this service, please contact Infrastructure at:
us...@infra.apache.org


With regards,
Apache Git Services

[incubator-hudi] branch master updated: [HUDI-671] Added unit-test for HBaseIndex (#1381)

[vinoth]

This is an automated email from the ASF dual-hosted git repository.

vinoth pushed a commit to branch master
in repository https://gitbox.apache.org/repos/asf/incubator-hudi.git


The following commit(s) were added to refs/heads/master by this push:
 new 5f8bf97  [HUDI-671] Added unit-test for HBaseIndex (#1381)
5f8bf97 is described below

commit 5f8bf970058d5915af1910dbf917a33356d06af2
Author: Prashant Wason 
AuthorDate: Sat Mar 7 16:48:43 2020 -0800

[HUDI-671] Added unit-test for HBaseIndex (#1381)
---
 .../java/org/apache/hudi/index/TestHbaseIndex.java | 133 -
 1 file changed, 129 insertions(+), 4 deletions(-)

diff --git 
a/hudi-client/src/test/java/org/apache/hudi/index/TestHbaseIndex.java 
b/hudi-client/src/test/java/org/apache/hudi/index/TestHbaseIndex.java
index 2893947..53adf6c 100644
--- a/hudi-client/src/test/java/org/apache/hudi/index/TestHbaseIndex.java
+++ b/hudi-client/src/test/java/org/apache/hudi/index/TestHbaseIndex.java
@@ -22,9 +22,11 @@ import org.apache.hudi.common.HoodieClientTestHarness;
 import org.apache.hudi.client.HoodieWriteClient;
 import org.apache.hudi.client.WriteStatus;
 import org.apache.hudi.common.HoodieTestDataGenerator;
+import org.apache.hudi.common.model.HoodieKey;
 import org.apache.hudi.common.model.HoodieRecord;
 import org.apache.hudi.common.model.HoodieWriteStat;
 import org.apache.hudi.common.table.HoodieTableMetaClient;
+import org.apache.hudi.common.util.Option;
 import org.apache.hudi.config.HoodieCompactionConfig;
 import org.apache.hudi.config.HoodieHBaseIndexConfig;
 import org.apache.hudi.config.HoodieIndexConfig;
@@ -38,6 +40,7 @@ import org.apache.hudi.table.HoodieTable;
 
 import org.apache.hadoop.conf.Configuration;
 import org.apache.hadoop.fs.Path;
+import org.apache.hadoop.hbase.HBaseConfiguration;
 import org.apache.hadoop.hbase.HBaseTestingUtility;
 import org.apache.hadoop.hbase.TableName;
 import org.apache.hadoop.hbase.client.Connection;
@@ -57,6 +60,7 @@ import org.junit.Test;
 import org.junit.runners.MethodSorters;
 import org.mockito.Mockito;
 
+import java.util.ArrayList;
 import java.util.Arrays;
 import java.util.List;
 
@@ -65,6 +69,7 @@ import scala.Tuple2;
 import static org.junit.Assert.assertEquals;
 import static org.junit.Assert.assertFalse;
 import static org.junit.Assert.assertTrue;
+import static org.junit.Assert.fail;
 import static org.mockito.Matchers.anyObject;
 import static org.mockito.Mockito.atMost;
 import static org.mockito.Mockito.times;
@@ -93,7 +98,10 @@ public class TestHbaseIndex extends HoodieClientTestHarness {
   @BeforeClass
   public static void init() throws Exception {
 // Initialize HbaseMiniCluster
-utility = new HBaseTestingUtility();
+hbaseConfig = HBaseConfiguration.create();
+hbaseConfig.set("zookeeper.znode.parent", "/hudi-hbase-test");
+
+utility = new HBaseTestingUtility(hbaseConfig);
 utility.startMiniCluster();
 hbaseConfig = utility.getConnection().getConfiguration();
 utility.createTable(TableName.valueOf(tableName), Bytes.toBytes("_s"));
@@ -389,6 +397,117 @@ public class TestHbaseIndex extends 
HoodieClientTestHarness {
 
hBaseIndexQPSResourceAllocator.acquireQPSResources(config.getHbaseIndexQPSFraction(),
 100), 0.0f);
   }
 
+  @Test
+  public void testSmallBatchSize() throws Exception {
+String newCommitTime = "001";
+List records = dataGen.generateInserts(newCommitTime, 200);
+JavaRDD writeRecords = jsc.parallelize(records, 1);
+
+// Load to memory
+HoodieWriteConfig config = getConfig(2);
+HBaseIndex index = new HBaseIndex(config);
+try (HoodieWriteClient writeClient = getWriteClient(config);) {
+  metaClient = HoodieTableMetaClient.reload(metaClient);
+  HoodieTable hoodieTable = HoodieTable.getHoodieTable(metaClient, config, 
jsc);
+
+  // Test tagLocation without any entries in index
+  JavaRDD javaRDD = index.tagLocation(writeRecords, jsc, 
hoodieTable);
+  assert (javaRDD.filter(record -> 
record.isCurrentLocationKnown()).collect().size() == 0);
+
+  // Insert 200 records
+  writeClient.startCommitWithTime(newCommitTime);
+  JavaRDD writeStatues = writeClient.upsert(writeRecords, 
newCommitTime);
+  assertNoWriteErrors(writeStatues.collect());
+
+  // Now tagLocation for these records, hbaseIndex should not tag them 
since it was a failed
+  // commit
+  javaRDD = index.tagLocation(writeRecords, jsc, hoodieTable);
+  assert (javaRDD.filter(record -> 
record.isCurrentLocationKnown()).collect().size() == 0);
+
+  // Now commit this & update location of records inserted and validate no 
errors
+  writeClient.commit(newCommitTime, writeStatues);
+  // Now tagLocation for these records, hbaseIndex should tag them 
correctly
+  metaClient = HoodieTableMetaClient.reload(metaClient);
+  hoodieTable = HoodieTable.getHoodieTable(metaClient, config, jsc);
+  javaRDD = index.tagLocation(writeRecords, jsc, hoodieTable);
+

[GitHub] [incubator-hudi] codecov-io edited a comment on issue #1350: [HUDI-629]: Replace Guava's Hashing with an equivalent in NumericUtils.java

[GitBox]

codecov-io edited a comment on issue #1350: [HUDI-629]: Replace Guava's Hashing 
with an equivalent in NumericUtils.java
URL: https://github.com/apache/incubator-hudi/pull/1350#issuecomment-59868
 
 
   # 
[Codecov](https://codecov.io/gh/apache/incubator-hudi/pull/1350?src=pr&el=h1) 
Report
   > Merging 
[#1350](https://codecov.io/gh/apache/incubator-hudi/pull/1350?src=pr&el=desc) 
into 
[master](https://codecov.io/gh/apache/incubator-hudi/commit/fdcd3b18b63d54e4b468a62d92c27497398d67ac?src=pr&el=desc)
 will **decrease** coverage by `0.02%`.
   > The diff coverage is `58.5%`.
   
   [![Impacted file tree 
graph](https://codecov.io/gh/apache/incubator-hudi/pull/1350/graphs/tree.svg?width=650&token=VTTXabwbs2&height=150&src=pr)](https://codecov.io/gh/apache/incubator-hudi/pull/1350?src=pr&el=tree)
   
   ```diff
   @@ Coverage Diff  @@
   ## master#1350  +/-   ##
   
   - Coverage 66.96%   66.94%   -0.03% 
 Complexity  223  223  
   
 Files   335  336   +1 
 Lines 1627916299  +20 
 Branches   1661 1661  
   
   + Hits  1090110911  +10 
   - Misses 4639 4645   +6 
   - Partials739  743   +4
   ```
   
   
   | [Impacted 
Files](https://codecov.io/gh/apache/incubator-hudi/pull/1350?src=pr&el=tree) | 
Coverage Δ | Complexity Δ | |
   |---|---|---|---|
   | 
[...java/org/apache/hudi/config/HoodieWriteConfig.java](https://codecov.io/gh/apache/incubator-hudi/pull/1350/diff?src=pr&el=tree#diff-aHVkaS1jbGllbnQvc3JjL21haW4vamF2YS9vcmcvYXBhY2hlL2h1ZGkvY29uZmlnL0hvb2RpZVdyaXRlQ29uZmlnLmphdmE=)
 | `83.84% <ø> (ø)` | `0 <0> (ø)` | :arrow_down: |
   | 
[...pache/hudi/utilities/HoodieWithTimelineServer.java](https://codecov.io/gh/apache/incubator-hudi/pull/1350/diff?src=pr&el=tree#diff-aHVkaS11dGlsaXRpZXMvc3JjL21haW4vamF2YS9vcmcvYXBhY2hlL2h1ZGkvdXRpbGl0aWVzL0hvb2RpZVdpdGhUaW1lbGluZVNlcnZlci5qYXZh)
 | `0% <0%> (ø)` | `0 <0> (ø)` | :arrow_down: |
   | 
[...e/hudi/common/util/queue/BoundedInMemoryQueue.java](https://codecov.io/gh/apache/incubator-hudi/pull/1350/diff?src=pr&el=tree#diff-aHVkaS1jb21tb24vc3JjL21haW4vamF2YS9vcmcvYXBhY2hlL2h1ZGkvY29tbW9uL3V0aWwvcXVldWUvQm91bmRlZEluTWVtb3J5UXVldWUuamF2YQ==)
 | `91.13% <0%> (ø)` | `0 <0> (ø)` | :arrow_down: |
   | 
[...pache/hudi/common/model/TimelineLayoutVersion.java](https://codecov.io/gh/apache/incubator-hudi/pull/1350/diff?src=pr&el=tree#diff-aHVkaS1jb21tb24vc3JjL21haW4vamF2YS9vcmcvYXBhY2hlL2h1ZGkvY29tbW9uL21vZGVsL1RpbWVsaW5lTGF5b3V0VmVyc2lvbi5qYXZh)
 | `65% <0%> (ø)` | `0 <0> (ø)` | :arrow_down: |
   | 
[...pache/hudi/common/versioning/MetadataMigrator.java](https://codecov.io/gh/apache/incubator-hudi/pull/1350/diff?src=pr&el=tree#diff-aHVkaS1jb21tb24vc3JjL21haW4vamF2YS9vcmcvYXBhY2hlL2h1ZGkvY29tbW9uL3ZlcnNpb25pbmcvTWV0YWRhdGFNaWdyYXRvci5qYXZh)
 | `58.33% <0%> (ø)` | `0 <0> (ø)` | :arrow_down: |
   | 
[...common/table/view/FileSystemViewStorageConfig.java](https://codecov.io/gh/apache/incubator-hudi/pull/1350/diff?src=pr&el=tree#diff-aHVkaS1jb21tb24vc3JjL21haW4vamF2YS9vcmcvYXBhY2hlL2h1ZGkvY29tbW9uL3RhYmxlL3ZpZXcvRmlsZVN5c3RlbVZpZXdTdG9yYWdlQ29uZmlnLmphdmE=)
 | `84.12% <0%> (ø)` | `0 <0> (ø)` | :arrow_down: |
   | 
[...in/java/org/apache/hudi/utilities/UtilHelpers.java](https://codecov.io/gh/apache/incubator-hudi/pull/1350/diff?src=pr&el=tree#diff-aHVkaS11dGlsaXRpZXMvc3JjL21haW4vamF2YS9vcmcvYXBhY2hlL2h1ZGkvdXRpbGl0aWVzL1V0aWxIZWxwZXJzLmphdmE=)
 | `62.79% <0%> (ø)` | `20 <0> (ø)` | :arrow_down: |
   | 
[...pache/hudi/common/table/HoodieTableMetaClient.java](https://codecov.io/gh/apache/incubator-hudi/pull/1350/diff?src=pr&el=tree#diff-aHVkaS1jb21tb24vc3JjL21haW4vamF2YS9vcmcvYXBhY2hlL2h1ZGkvY29tbW9uL3RhYmxlL0hvb2RpZVRhYmxlTWV0YUNsaWVudC5qYXZh)
 | `76.77% <0%> (ø)` | `0 <0> (ø)` | :arrow_down: |
   | 
[...mmon/versioning/clean/CleanV2MigrationHandler.java](https://codecov.io/gh/apache/incubator-hudi/pull/1350/diff?src=pr&el=tree#diff-aHVkaS1jb21tb24vc3JjL21haW4vamF2YS9vcmcvYXBhY2hlL2h1ZGkvY29tbW9uL3ZlcnNpb25pbmcvY2xlYW4vQ2xlYW5WMk1pZ3JhdGlvbkhhbmRsZXIuamF2YQ==)
 | `94.87% <0%> (ø)` | `0 <0> (ø)` | :arrow_down: |
   | 
[.../apache/hudi/hive/MultiPartKeysValueExtractor.java](https://codecov.io/gh/apache/incubator-hudi/pull/1350/diff?src=pr&el=tree#diff-aHVkaS1oaXZlLXN5bmMvc3JjL21haW4vamF2YS9vcmcvYXBhY2hlL2h1ZGkvaGl2ZS9NdWx0aVBhcnRLZXlzVmFsdWVFeHRyYWN0b3IuamF2YQ==)
 | `55.55% <0%> (ø)` | `0 <0> (ø)` | :arrow_down: |
   | ... and [34 
more](https://codecov.io/gh/apache/incubator-hudi/pull/1350/diff?src=pr&el=tree-more)
 | |
   
   --
   
   [Continue to review full report at 
Codecov](https://codecov.io/gh/apache/incubator-hudi/pull/1350?src=pr&el=continue).
   > **Legend** - [Click here to learn 
more](https://docs.codecov.io/docs/codecov-delta)
 

[jira] [Closed] (HUDI-680) Update Jackson databind to 2.6.7.3

[Suneel Marthi (Jira)]

 [ 
https://issues.apache.org/jira/browse/HUDI-680?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Suneel Marthi closed HUDI-680.
--

> Update Jackson databind to 2.6.7.3
> --
>
> Key: HUDI-680
> URL: https://issues.apache.org/jira/browse/HUDI-680
> Project: Apache Hudi (incubating)
>  Issue Type: Improvement
>  Components: Common Core
>Reporter: Aki Tanaka
>Assignee: Aki Tanaka
>Priority: Major
>  Labels: pull-request-available
> Fix For: 0.5.2
>
>  Time Spent: 20m
>  Remaining Estimate: 0h
>
> I would like to update Jackson databind to 2.6.7.3. Because this version is 
> the latest jackson-databind of 2.6.7.x line and it has all CVE fixes up to 
> 2.9.10.
> https://github.com/FasterXML/jackson/wiki/Jackson-Release-2.6.7.x



--
This message was sent by Atlassian Jira
(v8.3.4#803005)

[jira] [Resolved] (HUDI-680) Update Jackson databind to 2.6.7.3

[Suneel Marthi (Jira)]

 [ 
https://issues.apache.org/jira/browse/HUDI-680?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Suneel Marthi resolved HUDI-680.

Resolution: Fixed

merged

> Update Jackson databind to 2.6.7.3
> --
>
> Key: HUDI-680
> URL: https://issues.apache.org/jira/browse/HUDI-680
> Project: Apache Hudi (incubating)
>  Issue Type: Improvement
>  Components: Common Core
>Reporter: Aki Tanaka
>Assignee: Aki Tanaka
>Priority: Major
>  Labels: pull-request-available
> Fix For: 0.5.2
>
>  Time Spent: 20m
>  Remaining Estimate: 0h
>
> I would like to update Jackson databind to 2.6.7.3. Because this version is 
> the latest jackson-databind of 2.6.7.x line and it has all CVE fixes up to 
> 2.9.10.
> https://github.com/FasterXML/jackson/wiki/Jackson-Release-2.6.7.x



--
This message was sent by Atlassian Jira
(v8.3.4#803005)

[GitHub] [incubator-hudi] smarthi merged pull request #1385: [HUDI-680] Update Jackson databind to 2.6.7.3

[GitBox]

smarthi merged pull request #1385: [HUDI-680] Update Jackson databind to 2.6.7.3
URL: https://github.com/apache/incubator-hudi/pull/1385
 
 
   


This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
 
For queries about this service, please contact Infrastructure at:
us...@infra.apache.org


With regards,
Apache Git Services

[incubator-hudi] branch master updated: [HUDI-680] Update Jackson databind to 2.6.7.3 (#1385)

[smarthi]

This is an automated email from the ASF dual-hosted git repository.

smarthi pushed a commit to branch master
in repository https://gitbox.apache.org/repos/asf/incubator-hudi.git


The following commit(s) were added to refs/heads/master by this push:
 new fdcd3b1  [HUDI-680] Update Jackson databind to 2.6.7.3 (#1385)
fdcd3b1 is described below

commit fdcd3b18b63d54e4b468a62d92c27497398d67ac
Author: Aki Tanaka 
AuthorDate: Sat Mar 7 14:22:19 2020 -0800

[HUDI-680] Update Jackson databind to 2.6.7.3 (#1385)
---
 pom.xml | 2 +-
 1 file changed, 1 insertion(+), 1 deletion(-)

diff --git a/pom.xml b/pom.xml
index 8d45a9c..52d2ce0 100644
--- a/pom.xml
+++ b/pom.xml
@@ -430,7 +430,7 @@
   
 com.fasterxml.jackson.core
 jackson-databind
-${fasterxml.version}.1
+${fasterxml.version}.3
   
   
 com.fasterxml.jackson.datatype

[GitHub] [incubator-hudi] smarthi commented on a change in pull request #1379: [HUDI-670] Added unit-test for DiskBasedMap.

[GitBox]

smarthi commented on a change in pull request #1379: [HUDI-670] Added unit-test 
for DiskBasedMap.
URL: https://github.com/apache/incubator-hudi/pull/1379#discussion_r389316363
 
 

 ##
 File path: 
hudi-common/src/test/java/org/apache/hudi/common/util/collection/TestDiskBasedMap.java
 ##
 @@ -184,6 +187,28 @@ public void testSizeEstimator() throws IOException, 
URISyntaxException {
 assertTrue(payloadSize > 0);
   }
 
+  @Test
+  public void testPutAll() throws IOException, URISyntaxException {
+DiskBasedMap records = new DiskBasedMap(basePath);
+List iRecords = SchemaTestUtil.generateHoodieTestRecords(0, 
100);
+Map recordMap = new HashMap();
 
 Review comment:
   change to Map recordMap = new HashMap<>();


This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
 
For queries about this service, please contact Infrastructure at:
us...@infra.apache.org


With regards,
Apache Git Services

[GitHub] [incubator-hudi] smarthi commented on a change in pull request #1380: [HUDI-668] Added unit-tests for HUDI metrics.

[GitBox]

smarthi commented on a change in pull request #1380: [HUDI-668] Added 
unit-tests for HUDI metrics.
URL: https://github.com/apache/incubator-hudi/pull/1380#discussion_r389316113
 
 

 ##
 File path: 
hudi-client/src/test/java/org/apache/hudi/metrics/TestHoodieMetrics.java
 ##
 @@ -18,29 +18,144 @@
 
 package org.apache.hudi.metrics;
 
+import org.apache.hudi.common.model.HoodieCommitMetadata;
 import org.apache.hudi.config.HoodieWriteConfig;
 
 import org.junit.Before;
 import org.junit.Test;
 
+import com.codahale.metrics.Timer;
+
 import static org.apache.hudi.metrics.Metrics.registerGauge;
 import static org.junit.Assert.assertEquals;
+import static org.junit.Assert.assertTrue;
 import static org.mockito.Mockito.mock;
 import static org.mockito.Mockito.when;
 
+import java.util.Arrays;
+import java.util.Random;
+
 
 Review comment:
   Move the static imports after other imports at the end


This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
 
For queries about this service, please contact Infrastructure at:
us...@infra.apache.org


With regards,
Apache Git Services

[GitHub] [incubator-hudi] lamber-ken edited a comment on issue #1373: [WIP] [HUDI-646] Re-enable TestUpdateSchemaEvolution to reproduce CI error

[GitBox]

lamber-ken edited a comment on issue #1373: [WIP] [HUDI-646] Re-enable 
TestUpdateSchemaEvolution to reproduce CI error
URL: https://github.com/apache/incubator-hudi/pull/1373#issuecomment-596139885
 
 
   Add `initFileSystem();` 
https://www.travis-ci.org/BigDataArtisans/incubator-hudi/builds/659639125
   ```
   ===
   --- 
hudi-client/src/test/java/org/apache/hudi/client/TestUpdateSchemaEvolution.java 
 (revision 90227eeda757516abdd06b436ae08a4adacc28e1)
   +++ 
hudi-client/src/test/java/org/apache/hudi/client/TestUpdateSchemaEvolution.java 
 (date 1583616789967)
   @@ -55,6 +55,7 @@
initPath();
HoodieTestUtils.init(HoodieTestUtils.getDefaultHadoopConf(), basePath);
initSparkContexts("TestUpdateSchemaEvolution");
   +initFileSystem();
  }

  @After
   ```
   
   
![image](https://user-images.githubusercontent.com/20113411/76152777-a9813b80-60fe-11ea-94f2-3f6c9080e020.png)
   


This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
 
For queries about this service, please contact Infrastructure at:
us...@infra.apache.org


With regards,
Apache Git Services

[jira] [Updated] (HUDI-680) Update Jackson databind to 2.6.7.3

[Suneel Marthi (Jira)]

 [ 
https://issues.apache.org/jira/browse/HUDI-680?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Suneel Marthi updated HUDI-680:
---
Fix Version/s: 0.5.2

> Update Jackson databind to 2.6.7.3
> --
>
> Key: HUDI-680
> URL: https://issues.apache.org/jira/browse/HUDI-680
> Project: Apache Hudi (incubating)
>  Issue Type: Improvement
>  Components: Common Core
>Reporter: Aki Tanaka
>Assignee: Aki Tanaka
>Priority: Major
>  Labels: pull-request-available
> Fix For: 0.5.2
>
>  Time Spent: 10m
>  Remaining Estimate: 0h
>
> I would like to update Jackson databind to 2.6.7.3. Because this version is 
> the latest jackson-databind of 2.6.7.x line and it has all CVE fixes up to 
> 2.9.10.
> https://github.com/FasterXML/jackson/wiki/Jackson-Release-2.6.7.x



--
This message was sent by Atlassian Jira
(v8.3.4#803005)

[jira] [Updated] (HUDI-680) Update Jackson databind to 2.6.7.3

[Suneel Marthi (Jira)]

 [ 
https://issues.apache.org/jira/browse/HUDI-680?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Suneel Marthi updated HUDI-680:
---
Status: Open  (was: New)

> Update Jackson databind to 2.6.7.3
> --
>
> Key: HUDI-680
> URL: https://issues.apache.org/jira/browse/HUDI-680
> Project: Apache Hudi (incubating)
>  Issue Type: Improvement
>  Components: Common Core
>Reporter: Aki Tanaka
>Assignee: Aki Tanaka
>Priority: Major
>  Labels: pull-request-available
> Fix For: 0.5.2
>
>  Time Spent: 10m
>  Remaining Estimate: 0h
>
> I would like to update Jackson databind to 2.6.7.3. Because this version is 
> the latest jackson-databind of 2.6.7.x line and it has all CVE fixes up to 
> 2.9.10.
> https://github.com/FasterXML/jackson/wiki/Jackson-Release-2.6.7.x



--
This message was sent by Atlassian Jira
(v8.3.4#803005)

[jira] [Updated] (HUDI-680) Update Jackson databind to 2.6.7.3

[Suneel Marthi (Jira)]

 [ 
https://issues.apache.org/jira/browse/HUDI-680?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Suneel Marthi updated HUDI-680:
---
Component/s: Common Core

> Update Jackson databind to 2.6.7.3
> --
>
> Key: HUDI-680
> URL: https://issues.apache.org/jira/browse/HUDI-680
> Project: Apache Hudi (incubating)
>  Issue Type: Improvement
>  Components: Common Core
>Reporter: Aki Tanaka
>Assignee: Aki Tanaka
>Priority: Major
>  Labels: pull-request-available
>  Time Spent: 10m
>  Remaining Estimate: 0h
>
> I would like to update Jackson databind to 2.6.7.3. Because this version is 
> the latest jackson-databind of 2.6.7.x line and it has all CVE fixes up to 
> 2.9.10.
> https://github.com/FasterXML/jackson/wiki/Jackson-Release-2.6.7.x



--
This message was sent by Atlassian Jira
(v8.3.4#803005)

[GitHub] [incubator-hudi] codecov-io commented on issue #1385: [HUDI-680] Update Jackson databind to 2.6.7.3

[GitBox]

codecov-io commented on issue #1385: [HUDI-680] Update Jackson databind to 
2.6.7.3
URL: https://github.com/apache/incubator-hudi/pull/1385#issuecomment-596140926
 
 
   # 
[Codecov](https://codecov.io/gh/apache/incubator-hudi/pull/1385?src=pr&el=h1) 
Report
   > Merging 
[#1385](https://codecov.io/gh/apache/incubator-hudi/pull/1385?src=pr&el=desc) 
into 
[master](https://codecov.io/gh/apache/incubator-hudi/commit/90227eeda757516abdd06b436ae08a4adacc28e1?src=pr&el=desc)
 will **increase** coverage by `<.01%`.
   > The diff coverage is `n/a`.
   
   [![Impacted file tree 
graph](https://codecov.io/gh/apache/incubator-hudi/pull/1385/graphs/tree.svg?width=650&token=VTTXabwbs2&height=150&src=pr)](https://codecov.io/gh/apache/incubator-hudi/pull/1385?src=pr&el=tree)
   
   ```diff
   @@ Coverage Diff  @@
   ## master#1385  +/-   ##
   
   + Coverage 66.95%   66.96%   +<.01% 
 Complexity  223  223  
   
 Files   335  335  
 Lines 1627916279  
 Branches   1661 1661  
   
   + Hits  1090010901   +1 
   + Misses 4640 4639   -1 
 Partials739  739
   ```
   
   
   | [Impacted 
Files](https://codecov.io/gh/apache/incubator-hudi/pull/1385?src=pr&el=tree) | 
Coverage Δ | Complexity Δ | |
   |---|---|---|---|
   | 
[...che/hudi/common/util/BufferedRandomAccessFile.java](https://codecov.io/gh/apache/incubator-hudi/pull/1385/diff?src=pr&el=tree#diff-aHVkaS1jb21tb24vc3JjL21haW4vamF2YS9vcmcvYXBhY2hlL2h1ZGkvY29tbW9uL3V0aWwvQnVmZmVyZWRSYW5kb21BY2Nlc3NGaWxlLmphdmE=)
 | `55.26% <0%> (+0.87%)` | `0% <0%> (ø)` | :arrow_down: |
   
   --
   
   [Continue to review full report at 
Codecov](https://codecov.io/gh/apache/incubator-hudi/pull/1385?src=pr&el=continue).
   > **Legend** - [Click here to learn 
more](https://docs.codecov.io/docs/codecov-delta)
   > `Δ = absolute  (impact)`, `ø = not affected`, `? = missing data`
   > Powered by 
[Codecov](https://codecov.io/gh/apache/incubator-hudi/pull/1385?src=pr&el=footer).
 Last update 
[90227ee...6ac56b1](https://codecov.io/gh/apache/incubator-hudi/pull/1385?src=pr&el=lastupdated).
 Read the [comment docs](https://docs.codecov.io/docs/pull-request-comments).
   


This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
 
For queries about this service, please contact Infrastructure at:
us...@infra.apache.org


With regards,
Apache Git Services

[GitHub] [incubator-hudi] lamber-ken commented on issue #1373: [WIP] [HUDI-646] Re-enable TestUpdateSchemaEvolution to reproduce CI error

[GitBox]

lamber-ken commented on issue #1373: [WIP] [HUDI-646] Re-enable 
TestUpdateSchemaEvolution to reproduce CI error
URL: https://github.com/apache/incubator-hudi/pull/1373#issuecomment-596139885
 
 
   Add `initFileSystem();`
   ```
   ===
   --- 
hudi-client/src/test/java/org/apache/hudi/client/TestUpdateSchemaEvolution.java 
 (revision 90227eeda757516abdd06b436ae08a4adacc28e1)
   +++ 
hudi-client/src/test/java/org/apache/hudi/client/TestUpdateSchemaEvolution.java 
 (date 1583616789967)
   @@ -55,6 +55,7 @@
initPath();
HoodieTestUtils.init(HoodieTestUtils.getDefaultHadoopConf(), basePath);
initSparkContexts("TestUpdateSchemaEvolution");
   +initFileSystem();
  }

  @After
   ```
   
   
![image](https://user-images.githubusercontent.com/20113411/76152777-a9813b80-60fe-11ea-94f2-3f6c9080e020.png)
   


This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
 
For queries about this service, please contact Infrastructure at:
us...@infra.apache.org


With regards,
Apache Git Services

[jira] [Assigned] (HUDI-680) Update Jackson databind to 2.6.7.3

[Suneel Marthi (Jira)]

 [ 
https://issues.apache.org/jira/browse/HUDI-680?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Suneel Marthi reassigned HUDI-680:
--

Assignee: Aki Tanaka

> Update Jackson databind to 2.6.7.3
> --
>
> Key: HUDI-680
> URL: https://issues.apache.org/jira/browse/HUDI-680
> Project: Apache Hudi (incubating)
>  Issue Type: Improvement
>Reporter: Aki Tanaka
>Assignee: Aki Tanaka
>Priority: Major
>  Labels: pull-request-available
>  Time Spent: 10m
>  Remaining Estimate: 0h
>
> I would like to update Jackson databind to 2.6.7.3. Because this version is 
> the latest jackson-databind of 2.6.7.x line and it has all CVE fixes up to 
> 2.9.10.
> https://github.com/FasterXML/jackson/wiki/Jackson-Release-2.6.7.x



--
This message was sent by Atlassian Jira
(v8.3.4#803005)

[jira] [Commented] (HUDI-680) Update Jackson databind to 2.6.7.3

[Aki Tanaka (Jira)]

[ 
https://issues.apache.org/jira/browse/HUDI-680?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17054211#comment-17054211
 ] 

Aki Tanaka commented on HUDI-680:
-

Created the pull request for this 
https://github.com/apache/incubator-hudi/pull/1385

> Update Jackson databind to 2.6.7.3
> --
>
> Key: HUDI-680
> URL: https://issues.apache.org/jira/browse/HUDI-680
> Project: Apache Hudi (incubating)
>  Issue Type: Improvement
>Reporter: Aki Tanaka
>Priority: Major
>  Labels: pull-request-available
>  Time Spent: 10m
>  Remaining Estimate: 0h
>
> I would like to update Jackson databind to 2.6.7.3. Because this version is 
> the latest jackson-databind of 2.6.7.x line and it has all CVE fixes up to 
> 2.9.10.
> https://github.com/FasterXML/jackson/wiki/Jackson-Release-2.6.7.x



--
This message was sent by Atlassian Jira
(v8.3.4#803005)

[GitHub] [incubator-hudi] akitanaka opened a new pull request #1385: [HUDI-680] Update Jackson databind to 2.6.7.3

[GitBox]

akitanaka opened a new pull request #1385: [HUDI-680] Update Jackson databind 
to 2.6.7.3
URL: https://github.com/apache/incubator-hudi/pull/1385
 
 
   
   ## What is the purpose of the pull request
   
   https://issues.apache.org/jira/browse/HUDI-680
   
   I would like to update Jackson databind to 2.6.7.3. Because this version is 
the latest jackson-databind of 2.6.7.x line and it has all CVE fixes up to 
2.9.10.
   
   https://github.com/FasterXML/jackson/wiki/Jackson-Release-2.6.7.x
   
   ## Brief change log
   
   - Update Jackson databind to 2.6.7.3
   
   ## Verify this pull request
   
   Tested this change by building and running some sample job locally.
   
   
   ## Committer checklist
   
- [ ] Has a corresponding JIRA in PR title & commit

- [ ] Commit message is descriptive of the change

- [ ] CI is green
   
- [ ] Necessary doc changes done or have another open PR
  
- [ ] For large changes, please consider breaking it into sub-tasks under 
an umbrella JIRA.


This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
 
For queries about this service, please contact Infrastructure at:
us...@infra.apache.org


With regards,
Apache Git Services

[jira] [Updated] (HUDI-680) Update Jackson databind to 2.6.7.3

[ASF GitHub Bot (Jira)]

 [ 
https://issues.apache.org/jira/browse/HUDI-680?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

ASF GitHub Bot updated HUDI-680:

Labels: pull-request-available  (was: )

> Update Jackson databind to 2.6.7.3
> --
>
> Key: HUDI-680
> URL: https://issues.apache.org/jira/browse/HUDI-680
> Project: Apache Hudi (incubating)
>  Issue Type: Improvement
>Reporter: Aki Tanaka
>Priority: Major
>  Labels: pull-request-available
>
> I would like to update Jackson databind to 2.6.7.3. Because this version is 
> the latest jackson-databind of 2.6.7.x line and it has all CVE fixes up to 
> 2.9.10.
> https://github.com/FasterXML/jackson/wiki/Jackson-Release-2.6.7.x



--
This message was sent by Atlassian Jira
(v8.3.4#803005)

[jira] [Commented] (HUDI-680) Update Jackson databind to 2.6.7.3

[Suneel Marthi (Jira)]

[ 
https://issues.apache.org/jira/browse/HUDI-680?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17054210#comment-17054210
 ] 

Suneel Marthi commented on HUDI-680:


Thanks, would you like to work on this?

> Update Jackson databind to 2.6.7.3
> --
>
> Key: HUDI-680
> URL: https://issues.apache.org/jira/browse/HUDI-680
> Project: Apache Hudi (incubating)
>  Issue Type: Improvement
>Reporter: Aki Tanaka
>Priority: Major
>
> I would like to update Jackson databind to 2.6.7.3. Because this version is 
> the latest jackson-databind of 2.6.7.x line and it has all CVE fixes up to 
> 2.9.10.
> https://github.com/FasterXML/jackson/wiki/Jackson-Release-2.6.7.x



--
This message was sent by Atlassian Jira
(v8.3.4#803005)

[jira] [Created] (HUDI-680) Update Jackson databind to 2.6.7.3

[Aki Tanaka (Jira)]

Aki Tanaka created HUDI-680:
---

 Summary: Update Jackson databind to 2.6.7.3
 Key: HUDI-680
 URL: https://issues.apache.org/jira/browse/HUDI-680
 Project: Apache Hudi (incubating)
  Issue Type: Improvement
Reporter: Aki Tanaka


I would like to update Jackson databind to 2.6.7.3. Because this version is the 
latest jackson-databind of 2.6.7.x line and it has all CVE fixes up to 2.9.10.

https://github.com/FasterXML/jackson/wiki/Jackson-Release-2.6.7.x



--
This message was sent by Atlassian Jira
(v8.3.4#803005)

[GitHub] [incubator-hudi] utk-spartan opened a new issue #1384: [SUPPORT] Hudi datastore missing updates for many records

[GitBox]

utk-spartan opened a new issue #1384: [SUPPORT] Hudi datastore missing updates 
for many records
URL: https://github.com/apache/incubator-hudi/issues/1384
 
 
   **_Tips before filing an issue_**
   
   - Have you gone through our 
[FAQs](https://cwiki.apache.org/confluence/display/HUDI/FAQ)?
   
   - Join the mailing list to engage in conversations and get faster support at 
dev-subscr...@hudi.apache.org.
   
   - If you have triaged this as a bug, then file an 
[issue](https://issues.apache.org/jira/projects/HUDI/issues) directly.
   
   **Describe the problem you faced**
   
   Overview of the flow
   Mysql-Maxwell -> Kafka -> Spark preprocessing(Sorting, dedup etc.) -> Hudi 
upsert via spark datasource writer (with Hivesync)
   
   Hudi tables in S3 are missing updates for some records.
   
   
   To pinpoint the issue in our entire flow we are writing dataframe to S3 
after each stage and we observed that all the updates are present in the 
dataframe upon which the hudi datasource writer is called on, but some of these 
updates are applied in data present in hudi table.
   
   We were initially using 0.4.7 and have upgraded to hudi 0.5.1 and recreated 
the entire hudi table but the issue still persists.
   
   The count of records matches exactly but we are not sure if inserts are also 
getting dropped as any one of the captured update event for a record will 
create its entry, as everything is treated as an upsert. We are analyzing our 
data currently for this scenario.
   
   These records having inconsistent updates don't seem to correspond to any 
pattern or table size or batch size.
   Upon replaying the batch some of these missed updates are applied i.e. only 
some arbitrary percent of updates are applied each time the batch is processed.
   
   We will be further digging in hudi code, and find a way to replicate it in 
non S3 env.
   
   **To Reproduce**
   
   Steps to reproduce the behavior:
   
   Currently not able to reproduce this behaviour properly on our dev env, will 
update here.
   
   **Expected behavior**
   
   Both updates and inserts should be 100% consistent with source db.
   
   **Environment Description**
   
   * Hudi version : 0.5.1
   
   * Spark version : 2.4.0
   
   * Hive version : 2.3.0
   
   * Hadoop version : 2.6.5
   
   * Storage (HDFS/S3/GCS..) : S3
   
   * Running on Docker? (yes/no) : no
   
   
   **Additional context**
   
   Logs generated from hudi and aws-sdk for s3 have no WARN or ERROR level 
statements, nothing out of normal in INFO level logs.
   
   **Config params for datasource writer**
   DataSourceWriteOptions.OPERATION_OPT_KEY, "upsert"
   "hoodie.bulkinsert.shuffle.parallelism", "100"
   "hoodie.upsert.shuffle.parallelism", "100"
   "hoodie.insert.shuffle.parallelism", "100"
   HoodieCompactionConfig.PARQUET_SMALL_FILE_LIMIT_BYTES, 256 * 1024 * 1024
   HoodieStorageConfig.PARQUET_BLOCK_SIZE_BYTES, 64 * 1024 * 1024
   HoodieCompactionConfig.CLEANER_COMMITS_RETAINED_PROP, 2
   HIVE_SYNC_ENABLED_OPT_KEY, true
   
   PARQUET_COMPRESSION_CODEC, "uncompressed"
   
   **Stacktrace**
   
   ```Add the stacktrace of the error.```
   
   


This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
 
For queries about this service, please contact Infrastructure at:
us...@infra.apache.org


With regards,
Apache Git Services

[GitHub] [incubator-hudi] bvaradar commented on issue #1322: [SUPPORT] where is 0.4.8 release as mentioned in 'Migration Guide' ?

[GitBox]

bvaradar commented on issue #1322: [SUPPORT] where is 0.4.8 release as 
mentioned in 'Migration Guide' ?
URL: https://github.com/apache/incubator-hudi/issues/1322#issuecomment-596122528
 
 
   Thanks @tooptoop4  for reporting the issue. It should have been 0.4.7. I 
have updated the wiki 


This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
 
For queries about this service, please contact Infrastructure at:
us...@infra.apache.org


With regards,
Apache Git Services

[GitHub] [incubator-hudi] bvaradar closed issue #1322: [SUPPORT] where is 0.4.8 release as mentioned in 'Migration Guide' ?

[GitBox]

bvaradar closed issue #1322: [SUPPORT] where is 0.4.8 release as mentioned in 
'Migration Guide' ?
URL: https://github.com/apache/incubator-hudi/issues/1322
 
 
   


This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
 
For queries about this service, please contact Infrastructure at:
us...@infra.apache.org


With regards,
Apache Git Services

[GitHub] [incubator-hudi] bvaradar commented on issue #1376: Problem Sync Hudi table with Hive

[GitBox]

bvaradar commented on issue #1376: Problem  Sync Hudi table with Hive
URL: https://github.com/apache/incubator-hudi/issues/1376#issuecomment-59619
 
 
   Thanks @lamber-ken. 


This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
 
For queries about this service, please contact Infrastructure at:
us...@infra.apache.org


With regards,
Apache Git Services

[GitHub] [incubator-hudi] bvaradar commented on issue #1284: [SUPPORT]

[GitBox]

bvaradar commented on issue #1284: [SUPPORT]
URL: https://github.com/apache/incubator-hudi/issues/1284#issuecomment-596121471
 
 
   Thanks @lamber-ken. Will wait for @haospotai to confirm if there are no more 
issues and we can close this ticket.


This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
 
For queries about this service, please contact Infrastructure at:
us...@infra.apache.org


With regards,
Apache Git Services

[GitHub] [incubator-hudi] codecov-io edited a comment on issue #1350: [HUDI-629]: Replace Guava's Hashing with an equivalent in NumericUtils.java

[GitBox]

codecov-io edited a comment on issue #1350: [HUDI-629]: Replace Guava's Hashing 
with an equivalent in NumericUtils.java
URL: https://github.com/apache/incubator-hudi/pull/1350#issuecomment-59868
 
 
   # 
[Codecov](https://codecov.io/gh/apache/incubator-hudi/pull/1350?src=pr&el=h1) 
Report
   > Merging 
[#1350](https://codecov.io/gh/apache/incubator-hudi/pull/1350?src=pr&el=desc) 
into 
[master](https://codecov.io/gh/apache/incubator-hudi/commit/90227eeda757516abdd06b436ae08a4adacc28e1?src=pr&el=desc)
 will **decrease** coverage by `0.02%`.
   > The diff coverage is `58.5%`.
   
   [![Impacted file tree 
graph](https://codecov.io/gh/apache/incubator-hudi/pull/1350/graphs/tree.svg?width=650&token=VTTXabwbs2&height=150&src=pr)](https://codecov.io/gh/apache/incubator-hudi/pull/1350?src=pr&el=tree)
   
   ```diff
   @@ Coverage Diff  @@
   ## master#1350  +/-   ##
   
   - Coverage 66.95%   66.93%   -0.03% 
 Complexity  223  223  
   
 Files   335  336   +1 
 Lines 1627916299  +20 
 Branches   1661 1661  
   
   + Hits  1090010909   +9 
   - Misses 4640 4647   +7 
   - Partials739  743   +4
   ```
   
   
   | [Impacted 
Files](https://codecov.io/gh/apache/incubator-hudi/pull/1350?src=pr&el=tree) | 
Coverage Δ | Complexity Δ | |
   |---|---|---|---|
   | 
[...java/org/apache/hudi/config/HoodieWriteConfig.java](https://codecov.io/gh/apache/incubator-hudi/pull/1350/diff?src=pr&el=tree#diff-aHVkaS1jbGllbnQvc3JjL21haW4vamF2YS9vcmcvYXBhY2hlL2h1ZGkvY29uZmlnL0hvb2RpZVdyaXRlQ29uZmlnLmphdmE=)
 | `83.84% <ø> (ø)` | `0 <0> (ø)` | :arrow_down: |
   | 
[...pache/hudi/utilities/HoodieWithTimelineServer.java](https://codecov.io/gh/apache/incubator-hudi/pull/1350/diff?src=pr&el=tree#diff-aHVkaS11dGlsaXRpZXMvc3JjL21haW4vamF2YS9vcmcvYXBhY2hlL2h1ZGkvdXRpbGl0aWVzL0hvb2RpZVdpdGhUaW1lbGluZVNlcnZlci5qYXZh)
 | `0% <0%> (ø)` | `0 <0> (ø)` | :arrow_down: |
   | 
[...e/hudi/common/util/queue/BoundedInMemoryQueue.java](https://codecov.io/gh/apache/incubator-hudi/pull/1350/diff?src=pr&el=tree#diff-aHVkaS1jb21tb24vc3JjL21haW4vamF2YS9vcmcvYXBhY2hlL2h1ZGkvY29tbW9uL3V0aWwvcXVldWUvQm91bmRlZEluTWVtb3J5UXVldWUuamF2YQ==)
 | `91.13% <0%> (ø)` | `0 <0> (ø)` | :arrow_down: |
   | 
[...pache/hudi/common/model/TimelineLayoutVersion.java](https://codecov.io/gh/apache/incubator-hudi/pull/1350/diff?src=pr&el=tree#diff-aHVkaS1jb21tb24vc3JjL21haW4vamF2YS9vcmcvYXBhY2hlL2h1ZGkvY29tbW9uL21vZGVsL1RpbWVsaW5lTGF5b3V0VmVyc2lvbi5qYXZh)
 | `65% <0%> (ø)` | `0 <0> (ø)` | :arrow_down: |
   | 
[...pache/hudi/common/versioning/MetadataMigrator.java](https://codecov.io/gh/apache/incubator-hudi/pull/1350/diff?src=pr&el=tree#diff-aHVkaS1jb21tb24vc3JjL21haW4vamF2YS9vcmcvYXBhY2hlL2h1ZGkvY29tbW9uL3ZlcnNpb25pbmcvTWV0YWRhdGFNaWdyYXRvci5qYXZh)
 | `58.33% <0%> (ø)` | `0 <0> (ø)` | :arrow_down: |
   | 
[...common/table/view/FileSystemViewStorageConfig.java](https://codecov.io/gh/apache/incubator-hudi/pull/1350/diff?src=pr&el=tree#diff-aHVkaS1jb21tb24vc3JjL21haW4vamF2YS9vcmcvYXBhY2hlL2h1ZGkvY29tbW9uL3RhYmxlL3ZpZXcvRmlsZVN5c3RlbVZpZXdTdG9yYWdlQ29uZmlnLmphdmE=)
 | `84.12% <0%> (ø)` | `0 <0> (ø)` | :arrow_down: |
   | 
[...in/java/org/apache/hudi/utilities/UtilHelpers.java](https://codecov.io/gh/apache/incubator-hudi/pull/1350/diff?src=pr&el=tree#diff-aHVkaS11dGlsaXRpZXMvc3JjL21haW4vamF2YS9vcmcvYXBhY2hlL2h1ZGkvdXRpbGl0aWVzL1V0aWxIZWxwZXJzLmphdmE=)
 | `62.79% <0%> (ø)` | `20 <0> (ø)` | :arrow_down: |
   | 
[...pache/hudi/common/table/HoodieTableMetaClient.java](https://codecov.io/gh/apache/incubator-hudi/pull/1350/diff?src=pr&el=tree#diff-aHVkaS1jb21tb24vc3JjL21haW4vamF2YS9vcmcvYXBhY2hlL2h1ZGkvY29tbW9uL3RhYmxlL0hvb2RpZVRhYmxlTWV0YUNsaWVudC5qYXZh)
 | `76.77% <0%> (ø)` | `0 <0> (ø)` | :arrow_down: |
   | 
[...mmon/versioning/clean/CleanV2MigrationHandler.java](https://codecov.io/gh/apache/incubator-hudi/pull/1350/diff?src=pr&el=tree#diff-aHVkaS1jb21tb24vc3JjL21haW4vamF2YS9vcmcvYXBhY2hlL2h1ZGkvY29tbW9uL3ZlcnNpb25pbmcvY2xlYW4vQ2xlYW5WMk1pZ3JhdGlvbkhhbmRsZXIuamF2YQ==)
 | `94.87% <0%> (ø)` | `0 <0> (ø)` | :arrow_down: |
   | 
[.../apache/hudi/hive/MultiPartKeysValueExtractor.java](https://codecov.io/gh/apache/incubator-hudi/pull/1350/diff?src=pr&el=tree#diff-aHVkaS1oaXZlLXN5bmMvc3JjL21haW4vamF2YS9vcmcvYXBhY2hlL2h1ZGkvaGl2ZS9NdWx0aVBhcnRLZXlzVmFsdWVFeHRyYWN0b3IuamF2YQ==)
 | `55.55% <0%> (ø)` | `0 <0> (ø)` | :arrow_down: |
   | ... and [34 
more](https://codecov.io/gh/apache/incubator-hudi/pull/1350/diff?src=pr&el=tree-more)
 | |
   
   --
   
   [Continue to review full report at 
Codecov](https://codecov.io/gh/apache/incubator-hudi/pull/1350?src=pr&el=continue).
   > **Legend** - [Click here to learn 
more](https://docs.codecov.io/docs/codecov-delta)
 

[GitHub] [incubator-hudi] codecov-io edited a comment on issue #1159: [HUDI-479] Eliminate or Minimize use of Guava if possible

[GitBox]

codecov-io edited a comment on issue #1159: [HUDI-479] Eliminate or Minimize 
use of Guava if possible
URL: https://github.com/apache/incubator-hudi/pull/1159#issuecomment-596089314
 
 
   # 
[Codecov](https://codecov.io/gh/apache/incubator-hudi/pull/1159?src=pr&el=h1) 
Report
   > Merging 
[#1159](https://codecov.io/gh/apache/incubator-hudi/pull/1159?src=pr&el=desc) 
into 
[master](https://codecov.io/gh/apache/incubator-hudi/commit/90227eeda757516abdd06b436ae08a4adacc28e1?src=pr&el=desc)
 will **decrease** coverage by `0.16%`.
   > The diff coverage is `55%`.
   
   [![Impacted file tree 
graph](https://codecov.io/gh/apache/incubator-hudi/pull/1159/graphs/tree.svg?width=650&token=VTTXabwbs2&height=150&src=pr)](https://codecov.io/gh/apache/incubator-hudi/pull/1159?src=pr&el=tree)
   
   ```diff
   @@ Coverage Diff  @@
   ## master#1159  +/-   ##
   
   - Coverage 66.95%   66.79%   -0.17% 
 Complexity  223  223  
   
 Files   335  337   +2 
 Lines 1627916382 +103 
 Branches   1661 1673  +12 
   
   + Hits  1090010942  +42 
   - Misses 4640 4694  +54 
   - Partials739  746   +7
   ```
   
   
   | [Impacted 
Files](https://codecov.io/gh/apache/incubator-hudi/pull/1159?src=pr&el=tree) | 
Coverage Δ | Complexity Δ | |
   |---|---|---|---|
   | 
[...pache/hudi/utilities/sources/HoodieIncrSource.java](https://codecov.io/gh/apache/incubator-hudi/pull/1159/diff?src=pr&el=tree#diff-aHVkaS11dGlsaXRpZXMvc3JjL21haW4vamF2YS9vcmcvYXBhY2hlL2h1ZGkvdXRpbGl0aWVzL3NvdXJjZXMvSG9vZGllSW5jclNvdXJjZS5qYXZh)
 | `92.59% <ø> (ø)` | `7 <0> (ø)` | :arrow_down: |
   | 
[...in/java/org/apache/hudi/io/HoodieAppendHandle.java](https://codecov.io/gh/apache/incubator-hudi/pull/1159/diff?src=pr&el=tree#diff-aHVkaS1jbGllbnQvc3JjL21haW4vamF2YS9vcmcvYXBhY2hlL2h1ZGkvaW8vSG9vZGllQXBwZW5kSGFuZGxlLmphdmE=)
 | `83.76% <ø> (ø)` | `0 <0> (ø)` | :arrow_down: |
   | 
[...mmon/versioning/clean/CleanV1MigrationHandler.java](https://codecov.io/gh/apache/incubator-hudi/pull/1159/diff?src=pr&el=tree#diff-aHVkaS1jb21tb24vc3JjL21haW4vamF2YS9vcmcvYXBhY2hlL2h1ZGkvY29tbW9uL3ZlcnNpb25pbmcvY2xlYW4vQ2xlYW5WMU1pZ3JhdGlvbkhhbmRsZXIuamF2YQ==)
 | `90.24% <0%> (ø)` | `0 <0> (ø)` | :arrow_down: |
   | 
[...pache/hudi/utilities/HoodieWithTimelineServer.java](https://codecov.io/gh/apache/incubator-hudi/pull/1159/diff?src=pr&el=tree#diff-aHVkaS11dGlsaXRpZXMvc3JjL21haW4vamF2YS9vcmcvYXBhY2hlL2h1ZGkvdXRpbGl0aWVzL0hvb2RpZVdpdGhUaW1lbGluZVNlcnZlci5qYXZh)
 | `0% <0%> (ø)` | `0 <0> (ø)` | :arrow_down: |
   | 
[...e/hudi/common/util/queue/BoundedInMemoryQueue.java](https://codecov.io/gh/apache/incubator-hudi/pull/1159/diff?src=pr&el=tree#diff-aHVkaS1jb21tb24vc3JjL21haW4vamF2YS9vcmcvYXBhY2hlL2h1ZGkvY29tbW9uL3V0aWwvcXVldWUvQm91bmRlZEluTWVtb3J5UXVldWUuamF2YQ==)
 | `91.13% <0%> (ø)` | `0 <0> (ø)` | :arrow_down: |
   | 
[...oning/compaction/CompactionV2MigrationHandler.java](https://codecov.io/gh/apache/incubator-hudi/pull/1159/diff?src=pr&el=tree#diff-aHVkaS1jb21tb24vc3JjL21haW4vamF2YS9vcmcvYXBhY2hlL2h1ZGkvY29tbW9uL3ZlcnNpb25pbmcvY29tcGFjdGlvbi9Db21wYWN0aW9uVjJNaWdyYXRpb25IYW5kbGVyLmphdmE=)
 | `60% <0%> (ø)` | `0 <0> (ø)` | :arrow_down: |
   | 
[...mmon/versioning/clean/CleanV2MigrationHandler.java](https://codecov.io/gh/apache/incubator-hudi/pull/1159/diff?src=pr&el=tree#diff-aHVkaS1jb21tb24vc3JjL21haW4vamF2YS9vcmcvYXBhY2hlL2h1ZGkvY29tbW9uL3ZlcnNpb25pbmcvY2xlYW4vQ2xlYW5WMk1pZ3JhdGlvbkhhbmRsZXIuamF2YQ==)
 | `94.87% <0%> (ø)` | `0 <0> (ø)` | :arrow_down: |
   | 
[...che/hudi/common/table/log/HoodieLogFileReader.java](https://codecov.io/gh/apache/incubator-hudi/pull/1159/diff?src=pr&el=tree#diff-aHVkaS1jb21tb24vc3JjL21haW4vamF2YS9vcmcvYXBhY2hlL2h1ZGkvY29tbW9uL3RhYmxlL2xvZy9Ib29kaWVMb2dGaWxlUmVhZGVyLmphdmE=)
 | `74.02% <0%> (ø)` | `0 <0> (ø)` | :arrow_down: |
   | 
[...common/table/view/AbstractTableFileSystemView.java](https://codecov.io/gh/apache/incubator-hudi/pull/1159/diff?src=pr&el=tree#diff-aHVkaS1jb21tb24vc3JjL21haW4vamF2YS9vcmcvYXBhY2hlL2h1ZGkvY29tbW9uL3RhYmxlL3ZpZXcvQWJzdHJhY3RUYWJsZUZpbGVTeXN0ZW1WaWV3LmphdmE=)
 | `92.66% <0%> (ø)` | `0 <0> (ø)` | :arrow_down: |
   | 
[...pache/hudi/common/model/TimelineLayoutVersion.java](https://codecov.io/gh/apache/incubator-hudi/pull/1159/diff?src=pr&el=tree#diff-aHVkaS1jb21tb24vc3JjL21haW4vamF2YS9vcmcvYXBhY2hlL2h1ZGkvY29tbW9uL21vZGVsL1RpbWVsaW5lTGF5b3V0VmVyc2lvbi5qYXZh)
 | `65% <0%> (ø)` | `0 <0> (ø)` | :arrow_down: |
   | ... and [47 
more](https://codecov.io/gh/apache/incubator-hudi/pull/1159/diff?src=pr&el=tree-more)
 | |
   
   --
   
   [Continue to review full report at 
Codecov](https://codecov.io/gh/apache/incubator-hudi/pull/1159?src=pr&el=continue).
   > **Legend** - [Click here to learn 
more](https:

[GitHub] [incubator-hudi] codecov-io edited a comment on issue #1159: [HUDI-479] Eliminate or Minimize use of Guava if possible

[GitBox]

codecov-io edited a comment on issue #1159: [HUDI-479] Eliminate or Minimize 
use of Guava if possible
URL: https://github.com/apache/incubator-hudi/pull/1159#issuecomment-596089314
 
 
   # 
[Codecov](https://codecov.io/gh/apache/incubator-hudi/pull/1159?src=pr&el=h1) 
Report
   > Merging 
[#1159](https://codecov.io/gh/apache/incubator-hudi/pull/1159?src=pr&el=desc) 
into 
[master](https://codecov.io/gh/apache/incubator-hudi/commit/90227eeda757516abdd06b436ae08a4adacc28e1?src=pr&el=desc)
 will **decrease** coverage by `0.16%`.
   > The diff coverage is `55%`.
   
   [![Impacted file tree 
graph](https://codecov.io/gh/apache/incubator-hudi/pull/1159/graphs/tree.svg?width=650&token=VTTXabwbs2&height=150&src=pr)](https://codecov.io/gh/apache/incubator-hudi/pull/1159?src=pr&el=tree)
   
   ```diff
   @@ Coverage Diff  @@
   ## master#1159  +/-   ##
   
   - Coverage 66.95%   66.79%   -0.17% 
 Complexity  223  223  
   
 Files   335  337   +2 
 Lines 1627916382 +103 
 Branches   1661 1673  +12 
   
   + Hits  1090010942  +42 
   - Misses 4640 4694  +54 
   - Partials739  746   +7
   ```
   
   
   | [Impacted 
Files](https://codecov.io/gh/apache/incubator-hudi/pull/1159?src=pr&el=tree) | 
Coverage Δ | Complexity Δ | |
   |---|---|---|---|
   | 
[...pache/hudi/utilities/sources/HoodieIncrSource.java](https://codecov.io/gh/apache/incubator-hudi/pull/1159/diff?src=pr&el=tree#diff-aHVkaS11dGlsaXRpZXMvc3JjL21haW4vamF2YS9vcmcvYXBhY2hlL2h1ZGkvdXRpbGl0aWVzL3NvdXJjZXMvSG9vZGllSW5jclNvdXJjZS5qYXZh)
 | `92.59% <ø> (ø)` | `7 <0> (ø)` | :arrow_down: |
   | 
[...in/java/org/apache/hudi/io/HoodieAppendHandle.java](https://codecov.io/gh/apache/incubator-hudi/pull/1159/diff?src=pr&el=tree#diff-aHVkaS1jbGllbnQvc3JjL21haW4vamF2YS9vcmcvYXBhY2hlL2h1ZGkvaW8vSG9vZGllQXBwZW5kSGFuZGxlLmphdmE=)
 | `83.76% <ø> (ø)` | `0 <0> (ø)` | :arrow_down: |
   | 
[...mmon/versioning/clean/CleanV1MigrationHandler.java](https://codecov.io/gh/apache/incubator-hudi/pull/1159/diff?src=pr&el=tree#diff-aHVkaS1jb21tb24vc3JjL21haW4vamF2YS9vcmcvYXBhY2hlL2h1ZGkvY29tbW9uL3ZlcnNpb25pbmcvY2xlYW4vQ2xlYW5WMU1pZ3JhdGlvbkhhbmRsZXIuamF2YQ==)
 | `90.24% <0%> (ø)` | `0 <0> (ø)` | :arrow_down: |
   | 
[...pache/hudi/utilities/HoodieWithTimelineServer.java](https://codecov.io/gh/apache/incubator-hudi/pull/1159/diff?src=pr&el=tree#diff-aHVkaS11dGlsaXRpZXMvc3JjL21haW4vamF2YS9vcmcvYXBhY2hlL2h1ZGkvdXRpbGl0aWVzL0hvb2RpZVdpdGhUaW1lbGluZVNlcnZlci5qYXZh)
 | `0% <0%> (ø)` | `0 <0> (ø)` | :arrow_down: |
   | 
[...e/hudi/common/util/queue/BoundedInMemoryQueue.java](https://codecov.io/gh/apache/incubator-hudi/pull/1159/diff?src=pr&el=tree#diff-aHVkaS1jb21tb24vc3JjL21haW4vamF2YS9vcmcvYXBhY2hlL2h1ZGkvY29tbW9uL3V0aWwvcXVldWUvQm91bmRlZEluTWVtb3J5UXVldWUuamF2YQ==)
 | `91.13% <0%> (ø)` | `0 <0> (ø)` | :arrow_down: |
   | 
[...oning/compaction/CompactionV2MigrationHandler.java](https://codecov.io/gh/apache/incubator-hudi/pull/1159/diff?src=pr&el=tree#diff-aHVkaS1jb21tb24vc3JjL21haW4vamF2YS9vcmcvYXBhY2hlL2h1ZGkvY29tbW9uL3ZlcnNpb25pbmcvY29tcGFjdGlvbi9Db21wYWN0aW9uVjJNaWdyYXRpb25IYW5kbGVyLmphdmE=)
 | `60% <0%> (ø)` | `0 <0> (ø)` | :arrow_down: |
   | 
[...mmon/versioning/clean/CleanV2MigrationHandler.java](https://codecov.io/gh/apache/incubator-hudi/pull/1159/diff?src=pr&el=tree#diff-aHVkaS1jb21tb24vc3JjL21haW4vamF2YS9vcmcvYXBhY2hlL2h1ZGkvY29tbW9uL3ZlcnNpb25pbmcvY2xlYW4vQ2xlYW5WMk1pZ3JhdGlvbkhhbmRsZXIuamF2YQ==)
 | `94.87% <0%> (ø)` | `0 <0> (ø)` | :arrow_down: |
   | 
[...che/hudi/common/table/log/HoodieLogFileReader.java](https://codecov.io/gh/apache/incubator-hudi/pull/1159/diff?src=pr&el=tree#diff-aHVkaS1jb21tb24vc3JjL21haW4vamF2YS9vcmcvYXBhY2hlL2h1ZGkvY29tbW9uL3RhYmxlL2xvZy9Ib29kaWVMb2dGaWxlUmVhZGVyLmphdmE=)
 | `74.02% <0%> (ø)` | `0 <0> (ø)` | :arrow_down: |
   | 
[...common/table/view/AbstractTableFileSystemView.java](https://codecov.io/gh/apache/incubator-hudi/pull/1159/diff?src=pr&el=tree#diff-aHVkaS1jb21tb24vc3JjL21haW4vamF2YS9vcmcvYXBhY2hlL2h1ZGkvY29tbW9uL3RhYmxlL3ZpZXcvQWJzdHJhY3RUYWJsZUZpbGVTeXN0ZW1WaWV3LmphdmE=)
 | `92.66% <0%> (ø)` | `0 <0> (ø)` | :arrow_down: |
   | 
[...pache/hudi/common/model/TimelineLayoutVersion.java](https://codecov.io/gh/apache/incubator-hudi/pull/1159/diff?src=pr&el=tree#diff-aHVkaS1jb21tb24vc3JjL21haW4vamF2YS9vcmcvYXBhY2hlL2h1ZGkvY29tbW9uL21vZGVsL1RpbWVsaW5lTGF5b3V0VmVyc2lvbi5qYXZh)
 | `65% <0%> (ø)` | `0 <0> (ø)` | :arrow_down: |
   | ... and [47 
more](https://codecov.io/gh/apache/incubator-hudi/pull/1159/diff?src=pr&el=tree-more)
 | |
   
   --
   
   [Continue to review full report at 
Codecov](https://codecov.io/gh/apache/incubator-hudi/pull/1159?src=pr&el=continue).
   > **Legend** - [Click here to learn 
more](https:

[GitHub] [incubator-hudi] codecov-io edited a comment on issue #1354: [HUDI-581] NOTICE need more work as it missing content form included 3rd party ALv2 licensed NOTICE files

[GitBox]

codecov-io edited a comment on issue #1354: [HUDI-581] NOTICE need more work as 
it missing content form included 3rd party ALv2 licensed NOTICE files
URL: https://github.com/apache/incubator-hudi/pull/1354#issuecomment-593259405
 
 
   # 
[Codecov](https://codecov.io/gh/apache/incubator-hudi/pull/1354?src=pr&el=h1) 
Report
   > Merging 
[#1354](https://codecov.io/gh/apache/incubator-hudi/pull/1354?src=pr&el=desc) 
into 
[master](https://codecov.io/gh/apache/incubator-hudi/commit/90227eeda757516abdd06b436ae08a4adacc28e1?src=pr&el=desc)
 will **decrease** coverage by `0.01%`.
   > The diff coverage is `n/a`.
   
   [![Impacted file tree 
graph](https://codecov.io/gh/apache/incubator-hudi/pull/1354/graphs/tree.svg?width=650&token=VTTXabwbs2&height=150&src=pr)](https://codecov.io/gh/apache/incubator-hudi/pull/1354?src=pr&el=tree)
   
   ```diff
   @@ Coverage Diff  @@
   ## master#1354  +/-   ##
   
   - Coverage 66.95%   66.94%   -0.02% 
 Complexity  223  223  
   
 Files   335  335  
 Lines 1627916279  
 Branches   1661 1661  
   
   - Hits  1090010898   -2 
   - Misses 4640 4642   +2 
 Partials739  739
   ```
   
   
   | [Impacted 
Files](https://codecov.io/gh/apache/incubator-hudi/pull/1354?src=pr&el=tree) | 
Coverage Δ | Complexity Δ | |
   |---|---|---|---|
   | 
[...g/apache/hudi/metrics/InMemoryMetricsReporter.java](https://codecov.io/gh/apache/incubator-hudi/pull/1354/diff?src=pr&el=tree#diff-aHVkaS1jbGllbnQvc3JjL21haW4vamF2YS9vcmcvYXBhY2hlL2h1ZGkvbWV0cmljcy9Jbk1lbW9yeU1ldHJpY3NSZXBvcnRlci5qYXZh)
 | `25% <0%> (-50%)` | `0% <0%> (ø)` | |
   
   --
   
   [Continue to review full report at 
Codecov](https://codecov.io/gh/apache/incubator-hudi/pull/1354?src=pr&el=continue).
   > **Legend** - [Click here to learn 
more](https://docs.codecov.io/docs/codecov-delta)
   > `Δ = absolute  (impact)`, `ø = not affected`, `? = missing data`
   > Powered by 
[Codecov](https://codecov.io/gh/apache/incubator-hudi/pull/1354?src=pr&el=footer).
 Last update 
[90227ee...033f33a](https://codecov.io/gh/apache/incubator-hudi/pull/1354?src=pr&el=lastupdated).
 Read the [comment docs](https://docs.codecov.io/docs/pull-request-comments).
   


This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
 
For queries about this service, please contact Infrastructure at:
us...@infra.apache.org


With regards,
Apache Git Services

[GitHub] [incubator-hudi] smarthi commented on a change in pull request #1354: [HUDI-581] NOTICE need more work as it missing content form included 3rd party ALv2 licensed NOTICE files

[GitBox]

smarthi commented on a change in pull request #1354: [HUDI-581] NOTICE need 
more work as it missing content form included 3rd party ALv2 licensed NOTICE 
files
URL: https://github.com/apache/incubator-hudi/pull/1354#discussion_r389257719
 
 

 ##
 File path: NOTICE
 ##
 @@ -1,5 +1,86 @@
 Apache Hudi (incubating)
-Copyright 2020 The Apache Software Foundation
+Copyright 2019 and onwards The Apache Software Foundation
 
 This product includes software developed at
 The Apache Software Foundation (http://www.apache.org/).
+
+This project bundles the following dependencies
+
+
+Metrics
+Copyright 2010-2013 Coda Hale and Yammer, Inc.
+
+This product includes software developed by Coda Hale and Yammer, Inc.
+
+-
+Guava
+Copyright (C) 2007 The Guava Authors
+
+Licensed under the Apache License, Version 2.0
+
+-
+Kryo (https://github.com/EsotericSoftware/kryo)
+Copyright (c) 2008-2018, Nathan Sweet All rights reserved.
+
+Redistribution and use in source and binary forms, with or without 
modification, are permitted provided that the
+following conditions are met:
+
+Redistributions of source code must retain the above copyright notice, this 
list of conditions and the following disclaimer.
+Redistributions in binary form must reproduce the above copyright notice, this 
list of conditions and the following disclaimer in the documentation and/or 
other materials provided with the distribution.
+
+Neither the name of Esoteric Software nor the names of its contributors may be 
used to endorse or promote products derived from this software without specific 
prior written permission.
+THIS SOFTWARE IS PROVIDED BY THE COPYRIGHT HOLDERS AND CONTRIBUTORS "AS IS" 
AND ANY EXPRESS OR IMPLIED WARRANTIES, INCLUDING, BUT NOT LIMITED TO, THE 
IMPLIED WARRANTIES OF MERCHANTABILITY AND FITNESS FOR A PARTICULAR PURPOSE ARE 
DISCLAIMED. IN NO EVENT SHALL THE COPYRIGHT HOLDER OR CONTRIBUTORS BE LIABLE 
FOR ANY DIRECT, INDIRECT, INCIDENTAL, SPECIAL, EXEMPLARY, OR CONSEQUENTIAL 
DAMAGES (INCLUDING, BUT NOT LIMITED TO, PROCUREMENT OF SUBSTITUTE GOODS OR 
SERVICES; LOSS OF USE, DATA, OR PROFITS; OR BUSINESS INTERRUPTION) HOWEVER 
CAUSED AND ON ANY THEORY OF LIABILITY, WHETHER IN CONTRACT, STRICT LIABILITY, 
OR TORT (INCLUDING NEGLIGENCE OR OTHERWISE) ARISING IN ANY WAY OUT OF THE USE 
OF THIS SOFTWARE, EVEN IF ADVISED OF THE POSSIBILITY OF SUCH DAMAGE.
+
+
+Jackson JSON Processor
+
+This copy of Jackson JSON processor streaming parser/generator is licensed 
under the
+Apache (Software) License, version 2.0 ("the License").
+See the License for details about distribution rights, and the
+specific rights regarding derivate works.
+
+You may obtain a copy of the License at:
+
+http://www.apache.org/licenses/LICENSE-2.0
+
+--
+
+Gson
+Copyright 2008 Google Inc.
+
+Licensed under the Apache License, Version 2.0 (the "License");
+you may not use this file except in compliance with the License.
+You may obtain a copy of the License at
+
+http://www.apache.org/licenses/LICENSE-2.0
+
+Unless required by applicable law or agreed to in writing, software
+distributed under the License is distributed on an "AS IS" BASIS,
+WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
+See the License for the specific language governing permissions and
+limitations under the License.
+
+
+= Apache Hadoop 2.8.5 =
+Apache Hadoop
+Copyright 2009-2017 The Apache Software Foundation
+
+= Apache Hive 2.3.1 =
+Apache Hive
+Copyright 2008-2017 The Apache Software Foundation
+
+= Apache Spark 2.4.4 =
+Apache Spark
+Copyright 2014 and onwards The Apache Software Foundation
+
+= Apache Kafka 2.0.0 =
+Apache Kafka
+Copyright 2020 The Apache Software Foundation.
 
 Review comment:
   https://github.com/apache/kafka/blob/trunk/NOTICE


This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
 
For queries about this service, please contact Infrastructure at:
us...@infra.apache.org


With regards,
Apache Git Services

[jira] [Resolved] (HUDI-673) Rename hudi-hive-bundle to hudi-hive-sync-bundle

[lamber-ken (Jira)]

 [ 
https://issues.apache.org/jira/browse/HUDI-673?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

lamber-ken resolved HUDI-673.
-
Resolution: Fixed

> Rename hudi-hive-bundle to hudi-hive-sync-bundle
> 
>
> Key: HUDI-673
> URL: https://issues.apache.org/jira/browse/HUDI-673
> Project: Apache Hudi (incubating)
>  Issue Type: Sub-task
>  Components: Code Cleanup
>Reporter: lamber-ken
>Assignee: lamber-ken
>Priority: Major
>  Labels: pull-request-available
>  Time Spent: 20m
>  Remaining Estimate: 0h
>




--
This message was sent by Atlassian Jira
(v8.3.4#803005)

[incubator-hudi] branch asf-site updated: [MINOR] Update run_sync_tool.sh script path

[leesf]

This is an automated email from the ASF dual-hosted git repository.

leesf pushed a commit to branch asf-site
in repository https://gitbox.apache.org/repos/asf/incubator-hudi.git


The following commit(s) were added to refs/heads/asf-site by this push:
 new 67cc47e  [MINOR] Update run_sync_tool.sh script path
67cc47e is described below

commit 67cc47e23c8fb69b499ffa3dfdbe55387e2ec52d
Author: lamber-ken 
AuthorDate: Sat Mar 7 17:34:41 2020 +0800

[MINOR] Update run_sync_tool.sh script path
---
 docs/_docs/0_4_docker_demo.cn.md | 4 ++--
 docs/_docs/0_4_docker_demo.md| 4 ++--
 2 files changed, 4 insertions(+), 4 deletions(-)

diff --git a/docs/_docs/0_4_docker_demo.cn.md b/docs/_docs/0_4_docker_demo.cn.md
index 93a3c5f..b50e3b4 100644
--- a/docs/_docs/0_4_docker_demo.cn.md
+++ b/docs/_docs/0_4_docker_demo.cn.md
@@ -192,13 +192,13 @@ inorder to run Hive queries against those datasets.
 docker exec -it adhoc-2 /bin/bash
 
 # THis command takes in HIveServer URL and COW Hudi Dataset location in HDFS 
and sync the HDFS state to Hive
-/var/hoodie/ws/hudi-hive/run_sync_tool.sh  --jdbc-url 
jdbc:hive2://hiveserver:1 --user hive --pass hive --partitioned-by dt 
--base-path /user/hive/warehouse/stock_ticks_cow --database default --table 
stock_ticks_cow
+/var/hoodie/ws/hudi-hive-sync/run_sync_tool.sh  --jdbc-url 
jdbc:hive2://hiveserver:1 --user hive --pass hive --partitioned-by dt 
--base-path /user/hive/warehouse/stock_ticks_cow --database default --table 
stock_ticks_cow
 .
 2018-09-24 22:22:45,568 INFO  [main] hive.HiveSyncTool 
(HiveSyncTool.java:syncHoodieTable(112)) - Sync complete for stock_ticks_cow
 .
 
 # Now run hive-sync for the second data-set in HDFS using Merge-On-Read (MOR 
storage)
-/var/hoodie/ws/hudi-hive/run_sync_tool.sh  --jdbc-url 
jdbc:hive2://hiveserver:1 --user hive --pass hive --partitioned-by dt 
--base-path /user/hive/warehouse/stock_ticks_mor --database default --table 
stock_ticks_mor
+/var/hoodie/ws/hudi-hive-sync/run_sync_tool.sh  --jdbc-url 
jdbc:hive2://hiveserver:1 --user hive --pass hive --partitioned-by dt 
--base-path /user/hive/warehouse/stock_ticks_mor --database default --table 
stock_ticks_mor
 ...
 2018-09-24 22:23:09,171 INFO  [main] hive.HiveSyncTool 
(HiveSyncTool.java:syncHoodieTable(112)) - Sync complete for stock_ticks_mor
 ...
diff --git a/docs/_docs/0_4_docker_demo.md b/docs/_docs/0_4_docker_demo.md
index 306545e..448b5c1 100644
--- a/docs/_docs/0_4_docker_demo.md
+++ b/docs/_docs/0_4_docker_demo.md
@@ -206,7 +206,7 @@ inorder to run Hive queries against those tables.
 docker exec -it adhoc-2 /bin/bash
 
 # THis command takes in HIveServer URL and COW Hudi table location in HDFS and 
sync the HDFS state to Hive
-/var/hoodie/ws/hudi-hive/run_sync_tool.sh \
+/var/hoodie/ws/hudi-hive-sync/run_sync_tool.sh \
   --jdbc-url jdbc:hive2://hiveserver:1 \
   --user hive \
   --pass hive \
@@ -219,7 +219,7 @@ docker exec -it adhoc-2 /bin/bash
 .
 
 # Now run hive-sync for the second data-set in HDFS using Merge-On-Read (MOR 
table type)
-/var/hoodie/ws/hudi-hive/run_sync_tool.sh \
+/var/hoodie/ws/hudi-hive-sync/run_sync_tool.sh \
   --jdbc-url jdbc:hive2://hiveserver:1 \
   --user hive \
   --pass hive \

[GitHub] [incubator-hudi] leesf merged pull request #1382: [MINOR] Update run_sync_tool.sh script path

[GitBox]

leesf merged pull request #1382: [MINOR] Update run_sync_tool.sh script path
URL: https://github.com/apache/incubator-hudi/pull/1382
 
 
   


This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
 
For queries about this service, please contact Infrastructure at:
us...@infra.apache.org


With regards,
Apache Git Services

[jira] [Updated] (HUDI-679) Make io package spark free

[leesf (Jira)]

 [ 
https://issues.apache.org/jira/browse/HUDI-679?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

leesf updated HUDI-679:
---
Status: Open  (was: New)

> Make io package spark free
> --
>
> Key: HUDI-679
> URL: https://issues.apache.org/jira/browse/HUDI-679
> Project: Apache Hudi (incubating)
>  Issue Type: Sub-task
>Reporter: leesf
>Priority: Major
>




--
This message was sent by Atlassian Jira
(v8.3.4#803005)

[jira] [Assigned] (HUDI-679) Make io package spark free

[leesf (Jira)]

 [ 
https://issues.apache.org/jira/browse/HUDI-679?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

leesf reassigned HUDI-679:
--

Assignee: leesf

> Make io package spark free
> --
>
> Key: HUDI-679
> URL: https://issues.apache.org/jira/browse/HUDI-679
> Project: Apache Hudi (incubating)
>  Issue Type: Sub-task
>Reporter: leesf
>Assignee: leesf
>Priority: Major
>




--
This message was sent by Atlassian Jira
(v8.3.4#803005)

[jira] [Updated] (HUDI-678) Make config package spark free

[leesf (Jira)]

 [ 
https://issues.apache.org/jira/browse/HUDI-678?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

leesf updated HUDI-678:
---
Status: Open  (was: New)

> Make config package spark free
> --
>
> Key: HUDI-678
> URL: https://issues.apache.org/jira/browse/HUDI-678
> Project: Apache Hudi (incubating)
>  Issue Type: Sub-task
>Reporter: leesf
>Priority: Major
>




--
This message was sent by Atlassian Jira
(v8.3.4#803005)

[GitHub] [incubator-hudi] leesf merged pull request #1383: [HUDI-673] Rename hudi-hive-bundle to hudi-hive-sync-bundle

[GitBox]

leesf merged pull request #1383: [HUDI-673] Rename hudi-hive-bundle to 
hudi-hive-sync-bundle
URL: https://github.com/apache/incubator-hudi/pull/1383
 
 
   


This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
 
For queries about this service, please contact Infrastructure at:
us...@infra.apache.org


With regards,
Apache Git Services

[jira] [Assigned] (HUDI-678) Make config package spark free

[leesf (Jira)]

 [ 
https://issues.apache.org/jira/browse/HUDI-678?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

leesf reassigned HUDI-678:
--

Assignee: leesf

> Make config package spark free
> --
>
> Key: HUDI-678
> URL: https://issues.apache.org/jira/browse/HUDI-678
> Project: Apache Hudi (incubating)
>  Issue Type: Sub-task
>Reporter: leesf
>Assignee: leesf
>Priority: Major
>




--
This message was sent by Atlassian Jira
(v8.3.4#803005)

[incubator-hudi] branch master updated: [HUDI-673] Rename hudi-hive-bundle to hudi-hive-sync-bundle

[leesf]

This is an automated email from the ASF dual-hosted git repository.

leesf pushed a commit to branch master
in repository https://gitbox.apache.org/repos/asf/incubator-hudi.git


The following commit(s) were added to refs/heads/master by this push:
 new 90227ee  [HUDI-673] Rename hudi-hive-bundle to hudi-hive-sync-bundle
90227ee is described below

commit 90227eeda757516abdd06b436ae08a4adacc28e1
Author: lamber-ken 
AuthorDate: Sat Mar 7 15:55:31 2020 +0800

[HUDI-673] Rename hudi-hive-bundle to hudi-hive-sync-bundle
---
 docker/hoodie/hadoop/hive_base/Dockerfile | 2 +-
 docker/hoodie/hadoop/hive_base/pom.xml| 2 +-
 hudi-hive-sync/run_sync_tool.sh   | 2 +-
 hudi-hive-sync/src/main/java/org/apache/hudi/hive/HiveSyncTool.java   | 2 +-
 hudi-integ-test/src/test/java/org/apache/hudi/integ/ITTestBase.java   | 4 ++--
 packaging/{hudi-hive-bundle => hudi-hive-sync-bundle}/pom.xml | 2 +-
 .../src/main/java/org/apache/hudi/hive/bundle/Main.java   | 0
 pom.xml   | 2 +-
 8 files changed, 8 insertions(+), 8 deletions(-)

diff --git a/docker/hoodie/hadoop/hive_base/Dockerfile 
b/docker/hoodie/hadoop/hive_base/Dockerfile
index bd0e9c5..b8452d6 100644
--- a/docker/hoodie/hadoop/hive_base/Dockerfile
+++ b/docker/hoodie/hadoop/hive_base/Dockerfile
@@ -52,7 +52,7 @@ ADD conf/llap-daemon-log4j2.properties $HIVE_HOME/conf
 ADD target/ /var/hoodie/ws/docker/hoodie/hadoop/hive_base/target/
 
 ENV 
HUDI_HADOOP_BUNDLE=/var/hoodie/ws/docker/hoodie/hadoop/hive_base/target/hoodie-hadoop-mr-bundle.jar
-ENV 
HUDI_HIVE_BUNDLE=/var/hoodie/ws/docker/hoodie/hadoop/hive_base/target/hoodie-hive-bundle.jar
+ENV 
HUDI_HIVE_SYNC_BUNDLE=/var/hoodie/ws/docker/hoodie/hadoop/hive_base/target/hoodie-hive-sync-bundle.jar
 ENV 
HUDI_SPARK_BUNDLE=/var/hoodie/ws/docker/hoodie/hadoop/hive_base/target/hoodie-spark-bundle.jar
 ENV 
HUDI_UTILITIES_BUNDLE=/var/hoodie/ws/docker/hoodie/hadoop/hive_base/target/hoodie-utilities.jar
 
diff --git a/docker/hoodie/hadoop/hive_base/pom.xml 
b/docker/hoodie/hadoop/hive_base/pom.xml
index 04aac75..1a632eb 100644
--- a/docker/hoodie/hadoop/hive_base/pom.xml
+++ b/docker/hoodie/hadoop/hive_base/pom.xml
@@ -57,7 +57,7 @@
 
   
 
-
+
 
 
  * This utility will get the schema from the latest commit and will sync hive 
table schema Also this will sync the
  * partitions incrementally (all the partitions modified since the last commit)
diff --git 
a/hudi-integ-test/src/test/java/org/apache/hudi/integ/ITTestBase.java 
b/hudi-integ-test/src/test/java/org/apache/hudi/integ/ITTestBase.java
index 4a227c6..ee3b51e 100644
--- a/hudi-integ-test/src/test/java/org/apache/hudi/integ/ITTestBase.java
+++ b/hudi-integ-test/src/test/java/org/apache/hudi/integ/ITTestBase.java
@@ -59,8 +59,8 @@ public abstract class ITTestBase {
   protected static final String HOODIE_JAVA_APP = HOODIE_WS_ROOT + 
"/hudi-spark/run_hoodie_app.sh";
   protected static final String HUDI_HADOOP_BUNDLE =
   HOODIE_WS_ROOT + 
"/docker/hoodie/hadoop/hive_base/target/hoodie-hadoop-mr-bundle.jar";
-  protected static final String HUDI_HIVE_BUNDLE =
-  HOODIE_WS_ROOT + 
"/docker/hoodie/hadoop/hive_base/target/hoodie-hive-bundle.jar";
+  protected static final String HUDI_HIVE_SYNC_BUNDLE =
+  HOODIE_WS_ROOT + 
"/docker/hoodie/hadoop/hive_base/target/hoodie-hive-sync-bundle.jar";
   protected static final String HUDI_SPARK_BUNDLE =
   HOODIE_WS_ROOT + 
"/docker/hoodie/hadoop/hive_base/target/hoodie-spark-bundle.jar";
   protected static final String HUDI_UTILITIES_BUNDLE =
diff --git a/packaging/hudi-hive-bundle/pom.xml 
b/packaging/hudi-hive-sync-bundle/pom.xml
similarity index 99%
rename from packaging/hudi-hive-bundle/pom.xml
rename to packaging/hudi-hive-sync-bundle/pom.xml
index 668270a..0e9d894 100644
--- a/packaging/hudi-hive-bundle/pom.xml
+++ b/packaging/hudi-hive-sync-bundle/pom.xml
@@ -23,7 +23,7 @@
 ../../pom.xml
   
   4.0.0
-  hudi-hive-bundle
+  hudi-hive-sync-bundle
   jar
 
   
diff --git 
a/packaging/hudi-hive-bundle/src/main/java/org/apache/hudi/hive/bundle/Main.java
 
b/packaging/hudi-hive-sync-bundle/src/main/java/org/apache/hudi/hive/bundle/Main.java
similarity index 100%
rename from 
packaging/hudi-hive-bundle/src/main/java/org/apache/hudi/hive/bundle/Main.java
rename to 
packaging/hudi-hive-sync-bundle/src/main/java/org/apache/hudi/hive/bundle/Main.java
diff --git a/pom.xml b/pom.xml
index 4c2fb8b..8d45a9c 100644
--- a/pom.xml
+++ b/pom.xml
@@ -44,7 +44,7 @@
 hudi-timeline-service
 hudi-utilities
 packaging/hudi-hadoop-mr-bundle
-packaging/hudi-hive-bundle
+packaging/hudi-hive-sync-bundle
 packaging/hudi-spark-bundle
 packaging/hudi-presto-bundle
 packaging/hudi-utilities-bundle

[GitHub] [incubator-hudi] leesf commented on a change in pull request #1354: [HUDI-581] NOTICE need more work as it missing content form included 3rd party ALv2 licensed NOTICE files

[GitBox]

leesf commented on a change in pull request #1354: [HUDI-581] NOTICE need more 
work as it missing content form included 3rd party ALv2 licensed NOTICE files
URL: https://github.com/apache/incubator-hudi/pull/1354#discussion_r389255271
 
 

 ##
 File path: NOTICE
 ##
 @@ -1,5 +1,86 @@
 Apache Hudi (incubating)
-Copyright 2020 The Apache Software Foundation
+Copyright 2019 and onwards The Apache Software Foundation
 
 This product includes software developed at
 The Apache Software Foundation (http://www.apache.org/).
+
+This project bundles the following dependencies
+
+
+Metrics
+Copyright 2010-2013 Coda Hale and Yammer, Inc.
+
+This product includes software developed by Coda Hale and Yammer, Inc.
+
+-
+Guava
+Copyright (C) 2007 The Guava Authors
+
+Licensed under the Apache License, Version 2.0
+
+-
+Kryo (https://github.com/EsotericSoftware/kryo)
+Copyright (c) 2008-2018, Nathan Sweet All rights reserved.
+
+Redistribution and use in source and binary forms, with or without 
modification, are permitted provided that the
+following conditions are met:
+
+Redistributions of source code must retain the above copyright notice, this 
list of conditions and the following disclaimer.
+Redistributions in binary form must reproduce the above copyright notice, this 
list of conditions and the following disclaimer in the documentation and/or 
other materials provided with the distribution.
+
+Neither the name of Esoteric Software nor the names of its contributors may be 
used to endorse or promote products derived from this software without specific 
prior written permission.
+THIS SOFTWARE IS PROVIDED BY THE COPYRIGHT HOLDERS AND CONTRIBUTORS "AS IS" 
AND ANY EXPRESS OR IMPLIED WARRANTIES, INCLUDING, BUT NOT LIMITED TO, THE 
IMPLIED WARRANTIES OF MERCHANTABILITY AND FITNESS FOR A PARTICULAR PURPOSE ARE 
DISCLAIMED. IN NO EVENT SHALL THE COPYRIGHT HOLDER OR CONTRIBUTORS BE LIABLE 
FOR ANY DIRECT, INDIRECT, INCIDENTAL, SPECIAL, EXEMPLARY, OR CONSEQUENTIAL 
DAMAGES (INCLUDING, BUT NOT LIMITED TO, PROCUREMENT OF SUBSTITUTE GOODS OR 
SERVICES; LOSS OF USE, DATA, OR PROFITS; OR BUSINESS INTERRUPTION) HOWEVER 
CAUSED AND ON ANY THEORY OF LIABILITY, WHETHER IN CONTRACT, STRICT LIABILITY, 
OR TORT (INCLUDING NEGLIGENCE OR OTHERWISE) ARISING IN ANY WAY OUT OF THE USE 
OF THIS SOFTWARE, EVEN IF ADVISED OF THE POSSIBILITY OF SUCH DAMAGE.
+
+
+Jackson JSON Processor
+
+This copy of Jackson JSON processor streaming parser/generator is licensed 
under the
+Apache (Software) License, version 2.0 ("the License").
+See the License for details about distribution rights, and the
+specific rights regarding derivate works.
+
+You may obtain a copy of the License at:
+
+http://www.apache.org/licenses/LICENSE-2.0
+
+--
+
+Gson
+Copyright 2008 Google Inc.
+
+Licensed under the Apache License, Version 2.0 (the "License");
+you may not use this file except in compliance with the License.
+You may obtain a copy of the License at
+
+http://www.apache.org/licenses/LICENSE-2.0
+
+Unless required by applicable law or agreed to in writing, software
+distributed under the License is distributed on an "AS IS" BASIS,
+WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
+See the License for the specific language governing permissions and
+limitations under the License.
+
+
+= Apache Hadoop 2.8.5 =
+Apache Hadoop
+Copyright 2009-2017 The Apache Software Foundation
+
+= Apache Hive 2.3.1 =
+Apache Hive
+Copyright 2008-2017 The Apache Software Foundation
+
+= Apache Spark 2.4.4 =
+Apache Spark
+Copyright 2014 and onwards The Apache Software Foundation
+
+= Apache Kafka 2.0.0 =
+Apache Kafka
+Copyright 2020 The Apache Software Foundation.
 
 Review comment:
   this one is a little different. is 2020 correct?


This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
 
For queries about this service, please contact Infrastructure at:
us...@infra.apache.org


With regards,
Apache Git Services

[GitHub] [incubator-hudi] codecov-io commented on issue #1159: [HUDI-479] Eliminate or Minimize use of Guava if possible

[GitBox]

codecov-io commented on issue #1159: [HUDI-479] Eliminate or Minimize use of 
Guava if possible
URL: https://github.com/apache/incubator-hudi/pull/1159#issuecomment-596089314
 
 
   # 
[Codecov](https://codecov.io/gh/apache/incubator-hudi/pull/1159?src=pr&el=h1) 
Report
   > Merging 
[#1159](https://codecov.io/gh/apache/incubator-hudi/pull/1159?src=pr&el=desc) 
into 
[master](https://codecov.io/gh/apache/incubator-hudi/commit/170ee884578a85db53b87cee87f5208083f142aa?src=pr&el=desc)
 will **decrease** coverage by `0.18%`.
   > The diff coverage is `55%`.
   
   [![Impacted file tree 
graph](https://codecov.io/gh/apache/incubator-hudi/pull/1159/graphs/tree.svg?width=650&token=VTTXabwbs2&height=150&src=pr)](https://codecov.io/gh/apache/incubator-hudi/pull/1159?src=pr&el=tree)
   
   ```diff
   @@ Coverage Diff  @@
   ## master#1159  +/-   ##
   
   - Coverage 66.96%   66.78%   -0.19% 
 Complexity  223  223  
   
 Files   335  337   +2 
 Lines 1627916382 +103 
 Branches   1661 1673  +12 
   
   + Hits  1090110940  +39 
   - Misses 4639 4696  +57 
   - Partials739  746   +7
   ```
   
   
   | [Impacted 
Files](https://codecov.io/gh/apache/incubator-hudi/pull/1159?src=pr&el=tree) | 
Coverage Δ | Complexity Δ | |
   |---|---|---|---|
   | 
[...pache/hudi/utilities/sources/HoodieIncrSource.java](https://codecov.io/gh/apache/incubator-hudi/pull/1159/diff?src=pr&el=tree#diff-aHVkaS11dGlsaXRpZXMvc3JjL21haW4vamF2YS9vcmcvYXBhY2hlL2h1ZGkvdXRpbGl0aWVzL3NvdXJjZXMvSG9vZGllSW5jclNvdXJjZS5qYXZh)
 | `92.59% <ø> (ø)` | `7 <0> (ø)` | :arrow_down: |
   | 
[...in/java/org/apache/hudi/io/HoodieAppendHandle.java](https://codecov.io/gh/apache/incubator-hudi/pull/1159/diff?src=pr&el=tree#diff-aHVkaS1jbGllbnQvc3JjL21haW4vamF2YS9vcmcvYXBhY2hlL2h1ZGkvaW8vSG9vZGllQXBwZW5kSGFuZGxlLmphdmE=)
 | `83.76% <ø> (ø)` | `0 <0> (ø)` | :arrow_down: |
   | 
[...mmon/versioning/clean/CleanV1MigrationHandler.java](https://codecov.io/gh/apache/incubator-hudi/pull/1159/diff?src=pr&el=tree#diff-aHVkaS1jb21tb24vc3JjL21haW4vamF2YS9vcmcvYXBhY2hlL2h1ZGkvY29tbW9uL3ZlcnNpb25pbmcvY2xlYW4vQ2xlYW5WMU1pZ3JhdGlvbkhhbmRsZXIuamF2YQ==)
 | `90.24% <0%> (ø)` | `0 <0> (ø)` | :arrow_down: |
   | 
[...pache/hudi/utilities/HoodieWithTimelineServer.java](https://codecov.io/gh/apache/incubator-hudi/pull/1159/diff?src=pr&el=tree#diff-aHVkaS11dGlsaXRpZXMvc3JjL21haW4vamF2YS9vcmcvYXBhY2hlL2h1ZGkvdXRpbGl0aWVzL0hvb2RpZVdpdGhUaW1lbGluZVNlcnZlci5qYXZh)
 | `0% <0%> (ø)` | `0 <0> (ø)` | :arrow_down: |
   | 
[...e/hudi/common/util/queue/BoundedInMemoryQueue.java](https://codecov.io/gh/apache/incubator-hudi/pull/1159/diff?src=pr&el=tree#diff-aHVkaS1jb21tb24vc3JjL21haW4vamF2YS9vcmcvYXBhY2hlL2h1ZGkvY29tbW9uL3V0aWwvcXVldWUvQm91bmRlZEluTWVtb3J5UXVldWUuamF2YQ==)
 | `91.13% <0%> (ø)` | `0 <0> (ø)` | :arrow_down: |
   | 
[...oning/compaction/CompactionV2MigrationHandler.java](https://codecov.io/gh/apache/incubator-hudi/pull/1159/diff?src=pr&el=tree#diff-aHVkaS1jb21tb24vc3JjL21haW4vamF2YS9vcmcvYXBhY2hlL2h1ZGkvY29tbW9uL3ZlcnNpb25pbmcvY29tcGFjdGlvbi9Db21wYWN0aW9uVjJNaWdyYXRpb25IYW5kbGVyLmphdmE=)
 | `60% <0%> (ø)` | `0 <0> (ø)` | :arrow_down: |
   | 
[...mmon/versioning/clean/CleanV2MigrationHandler.java](https://codecov.io/gh/apache/incubator-hudi/pull/1159/diff?src=pr&el=tree#diff-aHVkaS1jb21tb24vc3JjL21haW4vamF2YS9vcmcvYXBhY2hlL2h1ZGkvY29tbW9uL3ZlcnNpb25pbmcvY2xlYW4vQ2xlYW5WMk1pZ3JhdGlvbkhhbmRsZXIuamF2YQ==)
 | `94.87% <0%> (ø)` | `0 <0> (ø)` | :arrow_down: |
   | 
[...che/hudi/common/table/log/HoodieLogFileReader.java](https://codecov.io/gh/apache/incubator-hudi/pull/1159/diff?src=pr&el=tree#diff-aHVkaS1jb21tb24vc3JjL21haW4vamF2YS9vcmcvYXBhY2hlL2h1ZGkvY29tbW9uL3RhYmxlL2xvZy9Ib29kaWVMb2dGaWxlUmVhZGVyLmphdmE=)
 | `74.02% <0%> (ø)` | `0 <0> (ø)` | :arrow_down: |
   | 
[...common/table/view/AbstractTableFileSystemView.java](https://codecov.io/gh/apache/incubator-hudi/pull/1159/diff?src=pr&el=tree#diff-aHVkaS1jb21tb24vc3JjL21haW4vamF2YS9vcmcvYXBhY2hlL2h1ZGkvY29tbW9uL3RhYmxlL3ZpZXcvQWJzdHJhY3RUYWJsZUZpbGVTeXN0ZW1WaWV3LmphdmE=)
 | `92.66% <0%> (ø)` | `0 <0> (ø)` | :arrow_down: |
   | 
[...pache/hudi/common/model/TimelineLayoutVersion.java](https://codecov.io/gh/apache/incubator-hudi/pull/1159/diff?src=pr&el=tree#diff-aHVkaS1jb21tb24vc3JjL21haW4vamF2YS9vcmcvYXBhY2hlL2h1ZGkvY29tbW9uL21vZGVsL1RpbWVsaW5lTGF5b3V0VmVyc2lvbi5qYXZh)
 | `65% <0%> (ø)` | `0 <0> (ø)` | :arrow_down: |
   | ... and [47 
more](https://codecov.io/gh/apache/incubator-hudi/pull/1159/diff?src=pr&el=tree-more)
 | |
   
   --
   
   [Continue to review full report at 
Codecov](https://codecov.io/gh/apache/incubator-hudi/pull/1159?src=pr&el=continue).
   > **Legend** - [Click here to learn 
more](https://docs.

[GitHub] [incubator-hudi] codecov-io edited a comment on issue #1350: [HUDI-629]: Replace Guava's Hashing with an equivalent in NumericUtils.java

[GitBox]

codecov-io edited a comment on issue #1350: [HUDI-629]: Replace Guava's Hashing 
with an equivalent in NumericUtils.java
URL: https://github.com/apache/incubator-hudi/pull/1350#issuecomment-59868
 
 
   # 
[Codecov](https://codecov.io/gh/apache/incubator-hudi/pull/1350?src=pr&el=h1) 
Report
   > Merging 
[#1350](https://codecov.io/gh/apache/incubator-hudi/pull/1350?src=pr&el=desc) 
into 
[master](https://codecov.io/gh/apache/incubator-hudi/commit/170ee884578a85db53b87cee87f5208083f142aa?src=pr&el=desc)
 will **decrease** coverage by `0.02%`.
   > The diff coverage is `58.5%`.
   
   [![Impacted file tree 
graph](https://codecov.io/gh/apache/incubator-hudi/pull/1350/graphs/tree.svg?width=650&token=VTTXabwbs2&height=150&src=pr)](https://codecov.io/gh/apache/incubator-hudi/pull/1350?src=pr&el=tree)
   
   ```diff
   @@ Coverage Diff  @@
   ## master#1350  +/-   ##
   
   - Coverage 66.96%   66.93%   -0.03% 
 Complexity  223  223  
   
 Files   335  336   +1 
 Lines 1627916299  +20 
 Branches   1661 1661  
   
   + Hits  1090110910   +9 
   - Misses 4639 4645   +6 
   - Partials739  744   +5
   ```
   
   
   | [Impacted 
Files](https://codecov.io/gh/apache/incubator-hudi/pull/1350?src=pr&el=tree) | 
Coverage Δ | Complexity Δ | |
   |---|---|---|---|
   | 
[...java/org/apache/hudi/config/HoodieWriteConfig.java](https://codecov.io/gh/apache/incubator-hudi/pull/1350/diff?src=pr&el=tree#diff-aHVkaS1jbGllbnQvc3JjL21haW4vamF2YS9vcmcvYXBhY2hlL2h1ZGkvY29uZmlnL0hvb2RpZVdyaXRlQ29uZmlnLmphdmE=)
 | `83.84% <ø> (ø)` | `0 <0> (ø)` | :arrow_down: |
   | 
[...pache/hudi/utilities/HoodieWithTimelineServer.java](https://codecov.io/gh/apache/incubator-hudi/pull/1350/diff?src=pr&el=tree#diff-aHVkaS11dGlsaXRpZXMvc3JjL21haW4vamF2YS9vcmcvYXBhY2hlL2h1ZGkvdXRpbGl0aWVzL0hvb2RpZVdpdGhUaW1lbGluZVNlcnZlci5qYXZh)
 | `0% <0%> (ø)` | `0 <0> (ø)` | :arrow_down: |
   | 
[...e/hudi/common/util/queue/BoundedInMemoryQueue.java](https://codecov.io/gh/apache/incubator-hudi/pull/1350/diff?src=pr&el=tree#diff-aHVkaS1jb21tb24vc3JjL21haW4vamF2YS9vcmcvYXBhY2hlL2h1ZGkvY29tbW9uL3V0aWwvcXVldWUvQm91bmRlZEluTWVtb3J5UXVldWUuamF2YQ==)
 | `91.13% <0%> (ø)` | `0 <0> (ø)` | :arrow_down: |
   | 
[...pache/hudi/common/model/TimelineLayoutVersion.java](https://codecov.io/gh/apache/incubator-hudi/pull/1350/diff?src=pr&el=tree#diff-aHVkaS1jb21tb24vc3JjL21haW4vamF2YS9vcmcvYXBhY2hlL2h1ZGkvY29tbW9uL21vZGVsL1RpbWVsaW5lTGF5b3V0VmVyc2lvbi5qYXZh)
 | `65% <0%> (ø)` | `0 <0> (ø)` | :arrow_down: |
   | 
[...pache/hudi/common/versioning/MetadataMigrator.java](https://codecov.io/gh/apache/incubator-hudi/pull/1350/diff?src=pr&el=tree#diff-aHVkaS1jb21tb24vc3JjL21haW4vamF2YS9vcmcvYXBhY2hlL2h1ZGkvY29tbW9uL3ZlcnNpb25pbmcvTWV0YWRhdGFNaWdyYXRvci5qYXZh)
 | `58.33% <0%> (ø)` | `0 <0> (ø)` | :arrow_down: |
   | 
[...common/table/view/FileSystemViewStorageConfig.java](https://codecov.io/gh/apache/incubator-hudi/pull/1350/diff?src=pr&el=tree#diff-aHVkaS1jb21tb24vc3JjL21haW4vamF2YS9vcmcvYXBhY2hlL2h1ZGkvY29tbW9uL3RhYmxlL3ZpZXcvRmlsZVN5c3RlbVZpZXdTdG9yYWdlQ29uZmlnLmphdmE=)
 | `84.12% <0%> (ø)` | `0 <0> (ø)` | :arrow_down: |
   | 
[...in/java/org/apache/hudi/utilities/UtilHelpers.java](https://codecov.io/gh/apache/incubator-hudi/pull/1350/diff?src=pr&el=tree#diff-aHVkaS11dGlsaXRpZXMvc3JjL21haW4vamF2YS9vcmcvYXBhY2hlL2h1ZGkvdXRpbGl0aWVzL1V0aWxIZWxwZXJzLmphdmE=)
 | `62.79% <0%> (ø)` | `20 <0> (ø)` | :arrow_down: |
   | 
[...pache/hudi/common/table/HoodieTableMetaClient.java](https://codecov.io/gh/apache/incubator-hudi/pull/1350/diff?src=pr&el=tree#diff-aHVkaS1jb21tb24vc3JjL21haW4vamF2YS9vcmcvYXBhY2hlL2h1ZGkvY29tbW9uL3RhYmxlL0hvb2RpZVRhYmxlTWV0YUNsaWVudC5qYXZh)
 | `76.77% <0%> (ø)` | `0 <0> (ø)` | :arrow_down: |
   | 
[...mmon/versioning/clean/CleanV2MigrationHandler.java](https://codecov.io/gh/apache/incubator-hudi/pull/1350/diff?src=pr&el=tree#diff-aHVkaS1jb21tb24vc3JjL21haW4vamF2YS9vcmcvYXBhY2hlL2h1ZGkvY29tbW9uL3ZlcnNpb25pbmcvY2xlYW4vQ2xlYW5WMk1pZ3JhdGlvbkhhbmRsZXIuamF2YQ==)
 | `94.87% <0%> (ø)` | `0 <0> (ø)` | :arrow_down: |
   | 
[.../apache/hudi/hive/MultiPartKeysValueExtractor.java](https://codecov.io/gh/apache/incubator-hudi/pull/1350/diff?src=pr&el=tree#diff-aHVkaS1oaXZlLXN5bmMvc3JjL21haW4vamF2YS9vcmcvYXBhY2hlL2h1ZGkvaGl2ZS9NdWx0aVBhcnRLZXlzVmFsdWVFeHRyYWN0b3IuamF2YQ==)
 | `55.55% <0%> (ø)` | `0 <0> (ø)` | :arrow_down: |
   | ... and [33 
more](https://codecov.io/gh/apache/incubator-hudi/pull/1350/diff?src=pr&el=tree-more)
 | |
   
   --
   
   [Continue to review full report at 
Codecov](https://codecov.io/gh/apache/incubator-hudi/pull/1350?src=pr&el=continue).
   > **Legend** - [Click here to learn 
more](https://docs.codecov.io/docs/codecov-delta)
 

[jira] [Created] (HUDI-679) Make io package spark free

[leesf (Jira)]

leesf created HUDI-679:
--

 Summary: Make io package spark free
 Key: HUDI-679
 URL: https://issues.apache.org/jira/browse/HUDI-679
 Project: Apache Hudi (incubating)
  Issue Type: Sub-task
Reporter: leesf






--
This message was sent by Atlassian Jira
(v8.3.4#803005)

[jira] [Created] (HUDI-678) Make config package spark free

[leesf (Jira)]

leesf created HUDI-678:
--

 Summary: Make config package spark free
 Key: HUDI-678
 URL: https://issues.apache.org/jira/browse/HUDI-678
 Project: Apache Hudi (incubating)
  Issue Type: Sub-task
Reporter: leesf






--
This message was sent by Atlassian Jira
(v8.3.4#803005)

[jira] [Updated] (HUDI-677) Abstract/Refactor all transaction management logic into a set of classes from HoodieWriteClient

[Vinoth Chandar (Jira)]

 [ 
https://issues.apache.org/jira/browse/HUDI-677?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Vinoth Chandar updated HUDI-677:

Status: Open  (was: New)

> Abstract/Refactor all transaction management logic into a set of classes from 
> HoodieWriteClient
> ---
>
> Key: HUDI-677
> URL: https://issues.apache.org/jira/browse/HUDI-677
> Project: Apache Hudi (incubating)
>  Issue Type: Sub-task
>  Components: Code Cleanup
>Reporter: Vinoth Chandar
>Assignee: Vinoth Chandar
>Priority: Major
> Fix For: 0.6.0
>
>




--
This message was sent by Atlassian Jira
(v8.3.4#803005)

[jira] [Created] (HUDI-677) Abstract/Refactor all transaction management logic into a set of classes from HoodieWriteClient

[Vinoth Chandar (Jira)]

Vinoth Chandar created HUDI-677:
---

 Summary: Abstract/Refactor all transaction management logic into a 
set of classes from HoodieWriteClient
 Key: HUDI-677
 URL: https://issues.apache.org/jira/browse/HUDI-677
 Project: Apache Hudi (incubating)
  Issue Type: Sub-task
  Components: Code Cleanup
Reporter: Vinoth Chandar
Assignee: Vinoth Chandar
 Fix For: 0.6.0






--
This message was sent by Atlassian Jira
(v8.3.4#803005)

[jira] [Resolved] (HUDI-652) Decouple HoodieReadClient and AbstractHoodieClient to break the inheritance chain

[Vinoth Chandar (Jira)]

 [ 
https://issues.apache.org/jira/browse/HUDI-652?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Vinoth Chandar resolved HUDI-652.
-
Resolution: Fixed

> Decouple HoodieReadClient and AbstractHoodieClient to break the inheritance 
> chain
> -
>
> Key: HUDI-652
> URL: https://issues.apache.org/jira/browse/HUDI-652
> Project: Apache Hudi (incubating)
>  Issue Type: Sub-task
>Reporter: vinoyang
>Assignee: vinoyang
>Priority: Major
>  Labels: pull-request-available
>  Time Spent: 20m
>  Remaining Estimate: 0h
>
> Since we decide to restructure the {{hudi-client}} module so that the 
> write-specific classes could be moved to {{hudi-write-common}}. Currently, 
> {{HoodieReadClient}} and {{HoodieWriteClient}} shared the same super class, 
> it's {{AbstractHoodieClient}}. To do that, we should decouple 
> {{HoodieReadClient}} and {{AbstractHoodieClient}}. Frome the source code, I 
> found {{HoodieReadClient}} does not depend on {{AbstractHoodieClient}} deeply.



--
This message was sent by Atlassian Jira
(v8.3.4#803005)

[jira] [Updated] (HUDI-652) Decouple HoodieReadClient and AbstractHoodieClient to break the inheritance chain

[Vinoth Chandar (Jira)]

 [ 
https://issues.apache.org/jira/browse/HUDI-652?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Vinoth Chandar updated HUDI-652:

Status: Open  (was: New)

> Decouple HoodieReadClient and AbstractHoodieClient to break the inheritance 
> chain
> -
>
> Key: HUDI-652
> URL: https://issues.apache.org/jira/browse/HUDI-652
> Project: Apache Hudi (incubating)
>  Issue Type: Sub-task
>Reporter: vinoyang
>Assignee: vinoyang
>Priority: Major
>  Labels: pull-request-available
>  Time Spent: 20m
>  Remaining Estimate: 0h
>
> Since we decide to restructure the {{hudi-client}} module so that the 
> write-specific classes could be moved to {{hudi-write-common}}. Currently, 
> {{HoodieReadClient}} and {{HoodieWriteClient}} shared the same super class, 
> it's {{AbstractHoodieClient}}. To do that, we should decouple 
> {{HoodieReadClient}} and {{AbstractHoodieClient}}. Frome the source code, I 
> found {{HoodieReadClient}} does not depend on {{AbstractHoodieClient}} deeply.



--
This message was sent by Atlassian Jira
(v8.3.4#803005)

[jira] [Created] (HUDI-676) Address issues towards removing use of WIP Disclaimer

[Vinoth Chandar (Jira)]

Vinoth Chandar created HUDI-676:
---

 Summary: Address issues towards removing use of WIP Disclaimer
 Key: HUDI-676
 URL: https://issues.apache.org/jira/browse/HUDI-676
 Project: Apache Hudi (incubating)
  Issue Type: Task
  Components: Release & Administrative
Reporter: Vinoth Chandar
Assignee: vinoyang
 Fix For: 0.5.2


https://incubator.apache.org/guides/releasemanagement.html#choice_of_disclaimers

Currently we use the
https://github.com/apache/incubator-hudi/blob/master/DISCLAIMER-WIP 

Addressing gaps to remove this is also a good step in the direction of being 
compliant 



--
This message was sent by Atlassian Jira
(v8.3.4#803005)

[jira] [Commented] (HUDI-662) Attribute binary dependencies that are included in the bundle jars

[Vinoth Chandar (Jira)]

[ 
https://issues.apache.org/jira/browse/HUDI-662?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17054011#comment-17054011
 ] 

Vinoth Chandar commented on HUDI-662:
-

Druid (recently graduated) has a mix in both NOTICE and LICENSE 
https://github.com/apache/druid/blob/master/NOTICE
https://github.com/apache/druid/blob/master/LICENSE



> Attribute binary dependencies that are included in the bundle jars
> --
>
> Key: HUDI-662
> URL: https://issues.apache.org/jira/browse/HUDI-662
> Project: Apache Hudi (incubating)
>  Issue Type: Bug
>  Components: Release & Administrative
>Reporter: Vinoth Chandar
>Assignee: Vinoth Chandar
>Priority: Blocker
> Fix For: 0.5.2
>
>




--
This message was sent by Atlassian Jira
(v8.3.4#803005)

[jira] [Commented] (HUDI-662) Attribute binary dependencies that are included in the bundle jars

[Vinoth Chandar (Jira)]

[ 
https://issues.apache.org/jira/browse/HUDI-662?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17054002#comment-17054002
 ] 

Vinoth Chandar commented on HUDI-662:
-

Flink calls out the binary/bundled dependencies in NOTICE and leaves LICENSE 
alone.
https://github.com/apache/flink/blob/master/NOTICE


> Attribute binary dependencies that are included in the bundle jars
> --
>
> Key: HUDI-662
> URL: https://issues.apache.org/jira/browse/HUDI-662
> Project: Apache Hudi (incubating)
>  Issue Type: Bug
>  Components: Release & Administrative
>Reporter: Vinoth Chandar
>Assignee: Vinoth Chandar
>Priority: Blocker
> Fix For: 0.5.2
>
>




--
This message was sent by Atlassian Jira
(v8.3.4#803005)

[jira] [Created] (HUDI-675) Add jdk13 to .travis.yml

[lamber-ken (Jira)]

lamber-ken created HUDI-675:
---

 Summary: Add jdk13 to .travis.yml
 Key: HUDI-675
 URL: https://issues.apache.org/jira/browse/HUDI-675
 Project: Apache Hudi (incubating)
  Issue Type: Improvement
  Components: Code Cleanup
Reporter: lamber-ken






--
This message was sent by Atlassian Jira
(v8.3.4#803005)

[jira] [Updated] (HUDI-675) Add jdk13 to .travis.yml

[lamber-ken (Jira)]

 [ 
https://issues.apache.org/jira/browse/HUDI-675?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

lamber-ken updated HUDI-675:

Status: Open  (was: New)

> Add jdk13 to .travis.yml
> 
>
> Key: HUDI-675
> URL: https://issues.apache.org/jira/browse/HUDI-675
> Project: Apache Hudi (incubating)
>  Issue Type: Improvement
>  Components: Code Cleanup
>Reporter: lamber-ken
>Priority: Major
>




--
This message was sent by Atlassian Jira
(v8.3.4#803005)

[jira] [Assigned] (HUDI-675) Add jdk13 to .travis.yml

[lamber-ken (Jira)]

 [ 
https://issues.apache.org/jira/browse/HUDI-675?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

lamber-ken reassigned HUDI-675:
---

Assignee: lamber-ken

> Add jdk13 to .travis.yml
> 
>
> Key: HUDI-675
> URL: https://issues.apache.org/jira/browse/HUDI-675
> Project: Apache Hudi (incubating)
>  Issue Type: Improvement
>  Components: Code Cleanup
>Reporter: lamber-ken
>Assignee: lamber-ken
>Priority: Major
>




--
This message was sent by Atlassian Jira
(v8.3.4#803005)

[jira] [Resolved] (HUDI-553) Building/Running Hudi on higher java versions

[lamber-ken (Jira)]

 [ 
https://issues.apache.org/jira/browse/HUDI-553?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

lamber-ken resolved HUDI-553.
-
Resolution: Fixed

Fixed at master 
[https://github.com/apache/incubator-hudi/commit/170ee884578a85db53b87cee87f5208083f142aa]

> Building/Running Hudi on higher java versions
> -
>
> Key: HUDI-553
> URL: https://issues.apache.org/jira/browse/HUDI-553
> Project: Apache Hudi (incubating)
>  Issue Type: Task
>  Components: Usability
>Reporter: Vinoth Chandar
>Assignee: lamber-ken
>Priority: Major
>  Labels: pull-request-available
> Fix For: 0.6.0
>
>  Time Spent: 20m
>  Remaining Estimate: 0h
>
> [https://github.com/apache/incubator-hudi/issues/1235] 



--
This message was sent by Atlassian Jira
(v8.3.4#803005)

[jira] [Closed] (HUDI-639) QU20: The project puts a very high priority on producing secure software.

[Suneel Marthi (Jira)]

 [ 
https://issues.apache.org/jira/browse/HUDI-639?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Suneel Marthi closed HUDI-639.
--

> QU20: The project puts a very high priority on producing secure software.
> -
>
> Key: HUDI-639
> URL: https://issues.apache.org/jira/browse/HUDI-639
> Project: Apache Hudi (incubating)
>  Issue Type: Sub-task
>Reporter: vinoyang
>Assignee: Vinoth Chandar
>Priority: Blocker
> Fix For: 0.5.2
>
>




--
This message was sent by Atlassian Jira
(v8.3.4#803005)

[jira] [Closed] (HUDI-638) Fix the asf compliant issues based on the maturity model

[Suneel Marthi (Jira)]

 [ 
https://issues.apache.org/jira/browse/HUDI-638?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Suneel Marthi closed HUDI-638.
--

> Fix the asf compliant issues based on the maturity model
> 
>
> Key: HUDI-638
> URL: https://issues.apache.org/jira/browse/HUDI-638
> Project: Apache Hudi (incubating)
>  Issue Type: Task
>  Components: Release & Administrative
>Reporter: vinoyang
>Assignee: Suneel Marthi
>Priority: Blocker
> Fix For: 0.5.2
>
>
> The Hudi's maturity model link is here: 
> https://cwiki.apache.org/confluence/display/HUDI/Apache+Hudi+Maturity+Matrix
> We should fix all of the compliant issues ASAP before releasing Hudi 0.5.2.



--
This message was sent by Atlassian Jira
(v8.3.4#803005)

[jira] [Resolved] (HUDI-639) QU20: The project puts a very high priority on producing secure software.

[Suneel Marthi (Jira)]

 [ 
https://issues.apache.org/jira/browse/HUDI-639?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Suneel Marthi resolved HUDI-639.

Resolution: Fixed

Marking as Resolved in light of the fix for HUDI-640

> QU20: The project puts a very high priority on producing secure software.
> -
>
> Key: HUDI-639
> URL: https://issues.apache.org/jira/browse/HUDI-639
> Project: Apache Hudi (incubating)
>  Issue Type: Sub-task
>Reporter: vinoyang
>Assignee: Vinoth Chandar
>Priority: Blocker
> Fix For: 0.5.2
>
>




--
This message was sent by Atlassian Jira
(v8.3.4#803005)

[jira] [Resolved] (HUDI-638) Fix the asf compliant issues based on the maturity model

[Suneel Marthi (Jira)]

 [ 
https://issues.apache.org/jira/browse/HUDI-638?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Suneel Marthi resolved HUDI-638.

Resolution: Fixed

> Fix the asf compliant issues based on the maturity model
> 
>
> Key: HUDI-638
> URL: https://issues.apache.org/jira/browse/HUDI-638
> Project: Apache Hudi (incubating)
>  Issue Type: Task
>  Components: Release & Administrative
>Reporter: vinoyang
>Assignee: Suneel Marthi
>Priority: Blocker
> Fix For: 0.5.2
>
>
> The Hudi's maturity model link is here: 
> https://cwiki.apache.org/confluence/display/HUDI/Apache+Hudi+Maturity+Matrix
> We should fix all of the compliant issues ASAP before releasing Hudi 0.5.2.



--
This message was sent by Atlassian Jira
(v8.3.4#803005)

[jira] [Updated] (HUDI-639) QU20: The project puts a very high priority on producing secure software.

[Suneel Marthi (Jira)]

 [ 
https://issues.apache.org/jira/browse/HUDI-639?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Suneel Marthi updated HUDI-639:
---
Fix Version/s: 0.5.2

> QU20: The project puts a very high priority on producing secure software.
> -
>
> Key: HUDI-639
> URL: https://issues.apache.org/jira/browse/HUDI-639
> Project: Apache Hudi (incubating)
>  Issue Type: Sub-task
>Reporter: vinoyang
>Assignee: Vinoth Chandar
>Priority: Blocker
> Fix For: 0.5.2
>
>




--
This message was sent by Atlassian Jira
(v8.3.4#803005)

[jira] [Updated] (HUDI-639) QU20: The project puts a very high priority on producing secure software.

[Suneel Marthi (Jira)]

 [ 
https://issues.apache.org/jira/browse/HUDI-639?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Suneel Marthi updated HUDI-639:
---
Status: Open  (was: New)

> QU20: The project puts a very high priority on producing secure software.
> -
>
> Key: HUDI-639
> URL: https://issues.apache.org/jira/browse/HUDI-639
> Project: Apache Hudi (incubating)
>  Issue Type: Sub-task
>Reporter: vinoyang
>Assignee: Vinoth Chandar
>Priority: Blocker
> Fix For: 0.5.2
>
>




--
This message was sent by Atlassian Jira
(v8.3.4#803005)

[jira] [Closed] (HUDI-642) CO70: The project strives to answer user questions in a timely manner.

[Suneel Marthi (Jira)]

 [ 
https://issues.apache.org/jira/browse/HUDI-642?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Suneel Marthi closed HUDI-642.
--

> CO70: The project strives to answer user questions in a timely manner.
> ---
>
> Key: HUDI-642
> URL: https://issues.apache.org/jira/browse/HUDI-642
> Project: Apache Hudi (incubating)
>  Issue Type: Sub-task
>Reporter: vinoyang
>Assignee: Suneel Marthi
>Priority: Blocker
> Fix For: 0.5.2
>
>




--
This message was sent by Atlassian Jira
(v8.3.4#803005)

[jira] [Resolved] (HUDI-642) CO70: The project strives to answer user questions in a timely manner.

[Suneel Marthi (Jira)]

 [ 
https://issues.apache.org/jira/browse/HUDI-642?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Suneel Marthi resolved HUDI-642.

Resolution: Fixed

Addressed in the comments for CO70 on Wiki by [~vinoth]

> CO70: The project strives to answer user questions in a timely manner.
> ---
>
> Key: HUDI-642
> URL: https://issues.apache.org/jira/browse/HUDI-642
> Project: Apache Hudi (incubating)
>  Issue Type: Sub-task
>Reporter: vinoyang
>Assignee: Suneel Marthi
>Priority: Blocker
> Fix For: 0.5.2
>
>




--
This message was sent by Atlassian Jira
(v8.3.4#803005)

[jira] [Updated] (HUDI-642) CO70: The project strives to answer user questions in a timely manner.

[Suneel Marthi (Jira)]

 [ 
https://issues.apache.org/jira/browse/HUDI-642?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Suneel Marthi updated HUDI-642:
---
Fix Version/s: 0.5.2

> CO70: The project strives to answer user questions in a timely manner.
> ---
>
> Key: HUDI-642
> URL: https://issues.apache.org/jira/browse/HUDI-642
> Project: Apache Hudi (incubating)
>  Issue Type: Sub-task
>Reporter: vinoyang
>Assignee: Suneel Marthi
>Priority: Blocker
> Fix For: 0.5.2
>
>




--
This message was sent by Atlassian Jira
(v8.3.4#803005)

[jira] [Updated] (HUDI-642) CO70: The project strives to answer user questions in a timely manner.

[Suneel Marthi (Jira)]

 [ 
https://issues.apache.org/jira/browse/HUDI-642?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Suneel Marthi updated HUDI-642:
---
Status: Open  (was: New)

> CO70: The project strives to answer user questions in a timely manner.
> ---
>
> Key: HUDI-642
> URL: https://issues.apache.org/jira/browse/HUDI-642
> Project: Apache Hudi (incubating)
>  Issue Type: Sub-task
>Reporter: vinoyang
>Assignee: Suneel Marthi
>Priority: Blocker
>




--
This message was sent by Atlassian Jira
(v8.3.4#803005)

[jira] [Assigned] (HUDI-642) CO70: The project strives to answer user questions in a timely manner.

[Suneel Marthi (Jira)]

 [ 
https://issues.apache.org/jira/browse/HUDI-642?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Suneel Marthi reassigned HUDI-642:
--

Assignee: Suneel Marthi

> CO70: The project strives to answer user questions in a timely manner.
> ---
>
> Key: HUDI-642
> URL: https://issues.apache.org/jira/browse/HUDI-642
> Project: Apache Hudi (incubating)
>  Issue Type: Sub-task
>Reporter: vinoyang
>Assignee: Suneel Marthi
>Priority: Blocker
>




--
This message was sent by Atlassian Jira
(v8.3.4#803005)

[jira] [Closed] (HUDI-640) QU30: The project provides a well-documented channel to report security issues, along with a documented way of responding to them.

[Suneel Marthi (Jira)]

 [ 
https://issues.apache.org/jira/browse/HUDI-640?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Suneel Marthi closed HUDI-640.
--

> QU30: The project provides a well-documented channel to report security 
> issues, along with a documented way of responding to them.
> ---
>
> Key: HUDI-640
> URL: https://issues.apache.org/jira/browse/HUDI-640
> Project: Apache Hudi (incubating)
>  Issue Type: Sub-task
>Reporter: vinoyang
>Assignee: Vinoth Chandar
>Priority: Blocker
> Fix For: 0.5.2
>
>




--
This message was sent by Atlassian Jira
(v8.3.4#803005)

[jira] [Updated] (HUDI-640) QU30: The project provides a well-documented channel to report security issues, along with a documented way of responding to them.

[Suneel Marthi (Jira)]

 [ 
https://issues.apache.org/jira/browse/HUDI-640?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Suneel Marthi updated HUDI-640:
---
Status: In Progress  (was: Open)

> QU30: The project provides a well-documented channel to report security 
> issues, along with a documented way of responding to them.
> ---
>
> Key: HUDI-640
> URL: https://issues.apache.org/jira/browse/HUDI-640
> Project: Apache Hudi (incubating)
>  Issue Type: Sub-task
>Reporter: vinoyang
>Assignee: Vinoth Chandar
>Priority: Blocker
> Fix For: 0.5.2
>
>




--
This message was sent by Atlassian Jira
(v8.3.4#803005)

[jira] [Updated] (HUDI-640) QU30: The project provides a well-documented channel to report security issues, along with a documented way of responding to them.

[Suneel Marthi (Jira)]

 [ 
https://issues.apache.org/jira/browse/HUDI-640?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Suneel Marthi updated HUDI-640:
---
Status: Open  (was: New)

> QU30: The project provides a well-documented channel to report security 
> issues, along with a documented way of responding to them.
> ---
>
> Key: HUDI-640
> URL: https://issues.apache.org/jira/browse/HUDI-640
> Project: Apache Hudi (incubating)
>  Issue Type: Sub-task
>Reporter: vinoyang
>Assignee: Vinoth Chandar
>Priority: Blocker
> Fix For: 0.5.2
>
>




--
This message was sent by Atlassian Jira
(v8.3.4#803005)

[jira] [Commented] (HUDI-640) QU30: The project provides a well-documented channel to report security issues, along with a documented way of responding to them.

[Suneel Marthi (Jira)]

[ 
https://issues.apache.org/jira/browse/HUDI-640?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17053974#comment-17053974
 ] 

Suneel Marthi commented on HUDI-640:


Updated QU30 on Wiki with the link for addressing Security issues -  
[http://hudi.apache.org/security]

> QU30: The project provides a well-documented channel to report security 
> issues, along with a documented way of responding to them.
> ---
>
> Key: HUDI-640
> URL: https://issues.apache.org/jira/browse/HUDI-640
> Project: Apache Hudi (incubating)
>  Issue Type: Sub-task
>Reporter: vinoyang
>Assignee: Vinoth Chandar
>Priority: Blocker
> Fix For: 0.5.2
>
>




--
This message was sent by Atlassian Jira
(v8.3.4#803005)

[jira] [Resolved] (HUDI-640) QU30: The project provides a well-documented channel to report security issues, along with a documented way of responding to them.

[Suneel Marthi (Jira)]

 [ 
https://issues.apache.org/jira/browse/HUDI-640?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Suneel Marthi resolved HUDI-640.

Resolution: Fixed

> QU30: The project provides a well-documented channel to report security 
> issues, along with a documented way of responding to them.
> ---
>
> Key: HUDI-640
> URL: https://issues.apache.org/jira/browse/HUDI-640
> Project: Apache Hudi (incubating)
>  Issue Type: Sub-task
>Reporter: vinoyang
>Assignee: Vinoth Chandar
>Priority: Blocker
> Fix For: 0.5.2
>
>




--
This message was sent by Atlassian Jira
(v8.3.4#803005)

[jira] [Resolved] (HUDI-643) Check and write comment for all the rule items

[Suneel Marthi (Jira)]

 [ 
https://issues.apache.org/jira/browse/HUDI-643?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Suneel Marthi resolved HUDI-643.

Resolution: Fixed

All of the rule items now have comments and no TODOs.

> Check and write comment for all the rule items
> --
>
> Key: HUDI-643
> URL: https://issues.apache.org/jira/browse/HUDI-643
> Project: Apache Hudi (incubating)
>  Issue Type: Sub-task
>Reporter: vinoyang
>Priority: Blocker
> Fix For: 0.5.2
>
>
> Some rule item does not contain "comment", we should check and write it.



--
This message was sent by Atlassian Jira
(v8.3.4#803005)

[jira] [Closed] (HUDI-643) Check and write comment for all the rule items

[Suneel Marthi (Jira)]

 [ 
https://issues.apache.org/jira/browse/HUDI-643?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Suneel Marthi closed HUDI-643.
--
Assignee: Suneel Marthi

> Check and write comment for all the rule items
> --
>
> Key: HUDI-643
> URL: https://issues.apache.org/jira/browse/HUDI-643
> Project: Apache Hudi (incubating)
>  Issue Type: Sub-task
>Reporter: vinoyang
>Assignee: Suneel Marthi
>Priority: Blocker
> Fix For: 0.5.2
>
>
> Some rule item does not contain "comment", we should check and write it.



--
This message was sent by Atlassian Jira
(v8.3.4#803005)