[jira] [Updated] (HUDI-743) Remove FileIOUtils.close()

2020-03-28 Thread Suneel Marthi (Jira)
[ https://issues.apache.org/jira/browse/HUDI-743?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Suneel Marthi updated HUDI-743: --- Status: Patch Available (was: In Progress) > Remove FileIOUtils.close() > --

[jira] [Updated] (HUDI-743) Remove FileIOUtils.close()

2020-03-28 Thread Suneel Marthi (Jira)
[ https://issues.apache.org/jira/browse/HUDI-743?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Suneel Marthi updated HUDI-743: --- Status: Open (was: New) > Remove FileIOUtils.close() > -- > >

[jira] [Updated] (HUDI-743) Remove FileIOUtils.close()

2020-03-28 Thread Suneel Marthi (Jira)
[ https://issues.apache.org/jira/browse/HUDI-743?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Suneel Marthi updated HUDI-743: --- Status: In Progress (was: Open) > Remove FileIOUtils.close() > -- > >

[GitHub] [incubator-hudi] codecov-io edited a comment on issue #1159: [HUDI-479] Eliminate or Minimize use of Guava if possible

2020-03-28 Thread GitBox
codecov-io edited a comment on issue #1159: [HUDI-479] Eliminate or Minimize use of Guava if possible URL: https://github.com/apache/incubator-hudi/pull/1159#issuecomment-596089314 # [Codecov](https://codecov.io/gh/apache/incubator-hudi/pull/1159?src=pr=h1) Report > Merging

[GitHub] [incubator-hudi] codecov-io edited a comment on issue #1159: [HUDI-479] Eliminate or Minimize use of Guava if possible

2020-03-28 Thread GitBox
codecov-io edited a comment on issue #1159: [HUDI-479] Eliminate or Minimize use of Guava if possible URL: https://github.com/apache/incubator-hudi/pull/1159#issuecomment-596089314 # [Codecov](https://codecov.io/gh/apache/incubator-hudi/pull/1159?src=pr=h1) Report > Merging

[GitHub] [incubator-hudi] leesf opened a new pull request #1460: [HUDI-679] Make io package Spark free

2020-03-28 Thread GitBox
leesf opened a new pull request #1460: [HUDI-679] Make io package Spark free URL: https://github.com/apache/incubator-hudi/pull/1460 ## *Tips* - *Thank you very much for contributing to Apache Hudi.* - *Please review https://hudi.apache.org/contributing.html before opening a pull

[GitHub] [incubator-hudi] leesf commented on issue #1460: [HUDI-679] Make io package Spark free

2020-03-28 Thread GitBox
leesf commented on issue #1460: [HUDI-679] Make io package Spark free URL: https://github.com/apache/incubator-hudi/pull/1460#issuecomment-605404425 @vinothchandar @yanghua Please take a look when you are free. Thanks This is

[jira] [Updated] (HUDI-679) Make io package spark free

2020-03-28 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HUDI-679?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated HUDI-679: Labels: pull-request-available (was: ) > Make io package spark free > -- >

[GitHub] [incubator-hudi] yanghua commented on issue #1449: [HUDI-698]Add unit test for CleansCommand

2020-03-28 Thread GitBox
yanghua commented on issue #1449: [HUDI-698]Add unit test for CleansCommand URL: https://github.com/apache/incubator-hudi/pull/1449#issuecomment-605409519 @hddong Still failed... This is an automated message from the Apache

[jira] [Created] (HUDI-743) Remove FileIOUtils.close()

2020-03-28 Thread Suneel Marthi (Jira)
Suneel Marthi created HUDI-743: -- Summary: Remove FileIOUtils.close() Key: HUDI-743 URL: https://issues.apache.org/jira/browse/HUDI-743 Project: Apache Hudi (incubating) Issue Type: Improvement

[jira] [Updated] (HUDI-743) Remove FileIOUtils.close()

2020-03-28 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HUDI-743?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated HUDI-743: Labels: pull-request-available (was: ) > Remove FileIOUtils.close() > -- >

[GitHub] [incubator-hudi] smarthi opened a new pull request #1461: [HUDI-743]: Remove FileIOUtils.close()

2020-03-28 Thread GitBox
smarthi opened a new pull request #1461: [HUDI-743]: Remove FileIOUtils.close() URL: https://github.com/apache/incubator-hudi/pull/1461 ## *Tips* - *Thank you very much for contributing to Apache Hudi.* - *Please review https://hudi.apache.org/contributing.html before opening a pull

[jira] [Updated] (HUDI-737) Simplify/Eliminate need for CollectionUtils#Maps/MapsBuilder

2020-03-28 Thread Suneel Marthi (Jira)
[ https://issues.apache.org/jira/browse/HUDI-737?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Suneel Marthi updated HUDI-737: --- Status: Closed (was: Patch Available) > Simplify/Eliminate need for CollectionUtils#Maps/MapsBuilder

[incubator-hudi] branch master updated: HUDI-479: Eliminate or Minimize use of Guava if possible (#1159)

2020-03-28 Thread smarthi
This is an automated email from the ASF dual-hosted git repository. smarthi pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/incubator-hudi.git The following commit(s) were added to refs/heads/master by this push: new 8c30013 HUDI-479: Eliminate or

[GitHub] [incubator-hudi] smarthi merged pull request #1159: [HUDI-479] Eliminate or Minimize use of Guava if possible

2020-03-28 Thread GitBox
smarthi merged pull request #1159: [HUDI-479] Eliminate or Minimize use of Guava if possible URL: https://github.com/apache/incubator-hudi/pull/1159 This is an automated message from the Apache Git Service. To respond to

[GitHub] [incubator-hudi] yanghua commented on a change in pull request #1452: [HUDI-740]Fix can not specify the sparkMaster of cleans run command

2020-03-28 Thread GitBox
yanghua commented on a change in pull request #1452: [HUDI-740]Fix can not specify the sparkMaster of cleans run command URL: https://github.com/apache/incubator-hudi/pull/1452#discussion_r399634497 ## File path: hudi-cli/src/main/java/org/apache/hudi/cli/commands/SparkMain.java

[jira] [Updated] (HUDI-479) Eliminate use of guava if possible

2020-03-28 Thread Suneel Marthi (Jira)
[ https://issues.apache.org/jira/browse/HUDI-479?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Suneel Marthi updated HUDI-479: --- Status: Closed (was: Patch Available) > Eliminate use of guava if possible >

[jira] [Reopened] (HUDI-743) Remove FileIOUtils.close()

2020-03-28 Thread vinoyang (Jira)
[ https://issues.apache.org/jira/browse/HUDI-743?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] vinoyang reopened HUDI-743: --- > Remove FileIOUtils.close() > -- > > Key: HUDI-743 > URL:

[jira] [Closed] (HUDI-743) Remove FileIOUtils.close()

2020-03-28 Thread vinoyang (Jira)
[ https://issues.apache.org/jira/browse/HUDI-743?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] vinoyang closed HUDI-743. - Resolution: Done Done via master branch: 04449f33feb300b99750c52ec37f2561aa644456 > Remove FileIOUtils.close() >

[GitHub] [incubator-hudi] pratyakshsharma commented on a change in pull request #1150: [HUDI-288]: Add support for ingesting multiple kafka streams in a single DeltaStreamer deployment

2020-03-28 Thread GitBox
pratyakshsharma commented on a change in pull request #1150: [HUDI-288]: Add support for ingesting multiple kafka streams in a single DeltaStreamer deployment URL: https://github.com/apache/incubator-hudi/pull/1150#discussion_r399646360 ## File path:

[GitHub] [incubator-hudi] yanghua commented on a change in pull request #1460: [HUDI-679] Make io package Spark free

2020-03-28 Thread GitBox
yanghua commented on a change in pull request #1460: [HUDI-679] Make io package Spark free URL: https://github.com/apache/incubator-hudi/pull/1460#discussion_r399649258 ## File path: hudi-client/src/main/java/org/apache/hudi/client/SparkSupplier.java ## @@ -0,0 +1,33 @@

[GitHub] [incubator-hudi] leesf commented on a change in pull request #1454: MINOR update doc to include inc query on partitions

2020-03-28 Thread GitBox
leesf commented on a change in pull request #1454: MINOR update doc to include inc query on partitions URL: https://github.com/apache/incubator-hudi/pull/1454#discussion_r399658424 ## File path: docs/_docs/0.5.2/2_3_querying_data.md ## @@ -146,8 +146,9 @@ The following

[GitHub] [incubator-hudi] hddong commented on issue #1449: [HUDI-698]Add unit test for CleansCommand

2020-03-28 Thread GitBox
hddong commented on issue #1449: [HUDI-698]Add unit test for CleansCommand URL: https://github.com/apache/incubator-hudi/pull/1449#issuecomment-605455411 @yanghua It's all passed locally, It's may be cause be two jsc read data from different dfs(HadoopConfig) in travis enviroment, I will

[GitHub] [incubator-hudi] leesf commented on a change in pull request #1460: [HUDI-679] Make io package Spark free

2020-03-28 Thread GitBox
leesf commented on a change in pull request #1460: [HUDI-679] Make io package Spark free URL: https://github.com/apache/incubator-hudi/pull/1460#discussion_r399673870 ## File path: hudi-client/src/main/java/org/apache/hudi/execution/CopyOnWriteLazyInsertIterable.java ##

[GitHub] [incubator-hudi] yanghua commented on a change in pull request #1460: [HUDI-679] Make io package Spark free

2020-03-28 Thread GitBox
yanghua commented on a change in pull request #1460: [HUDI-679] Make io package Spark free URL: https://github.com/apache/incubator-hudi/pull/1460#discussion_r399649196 ## File path: hudi-client/src/main/java/org/apache/hudi/client/SparkSupplier.java ## @@ -0,0 +1,33 @@

[GitHub] [incubator-hudi] hddong commented on a change in pull request #1452: [HUDI-740]Fix can not specify the sparkMaster of cleans run command

2020-03-28 Thread GitBox
hddong commented on a change in pull request #1452: [HUDI-740]Fix can not specify the sparkMaster of cleans run command URL: https://github.com/apache/incubator-hudi/pull/1452#discussion_r399670689 ## File path: hudi-cli/src/main/java/org/apache/hudi/cli/commands/SparkMain.java

[GitHub] [incubator-hudi] leesf commented on a change in pull request #1460: [HUDI-679] Make io package Spark free

2020-03-28 Thread GitBox
leesf commented on a change in pull request #1460: [HUDI-679] Make io package Spark free URL: https://github.com/apache/incubator-hudi/pull/1460#discussion_r399651507 ## File path: hudi-client/src/main/java/org/apache/hudi/client/SparkSupplier.java ## @@ -0,0 +1,33 @@ +/*

[GitHub] [incubator-hudi] leesf commented on a change in pull request #1460: [HUDI-679] Make io package Spark free

2020-03-28 Thread GitBox
leesf commented on a change in pull request #1460: [HUDI-679] Make io package Spark free URL: https://github.com/apache/incubator-hudi/pull/1460#discussion_r399651495 ## File path: hudi-client/src/main/java/org/apache/hudi/client/SparkSupplier.java ## @@ -0,0 +1,33 @@ +/*

[GitHub] [incubator-hudi] yanghua commented on a change in pull request #1460: [HUDI-679] Make io package Spark free

2020-03-28 Thread GitBox
yanghua commented on a change in pull request #1460: [HUDI-679] Make io package Spark free URL: https://github.com/apache/incubator-hudi/pull/1460#discussion_r399660372 ## File path: hudi-client/src/main/java/org/apache/hudi/execution/CopyOnWriteLazyInsertIterable.java ##

[GitHub] [incubator-hudi] yanghua commented on a change in pull request #1460: [HUDI-679] Make io package Spark free

2020-03-28 Thread GitBox
yanghua commented on a change in pull request #1460: [HUDI-679] Make io package Spark free URL: https://github.com/apache/incubator-hudi/pull/1460#discussion_r399660466 ## File path: hudi-client/src/main/java/org/apache/hudi/execution/CopyOnWriteLazyInsertIterable.java ##

[GitHub] [incubator-hudi] yanghua commented on a change in pull request #1460: [HUDI-679] Make io package Spark free

2020-03-28 Thread GitBox
yanghua commented on a change in pull request #1460: [HUDI-679] Make io package Spark free URL: https://github.com/apache/incubator-hudi/pull/1460#discussion_r399660338 ## File path: hudi-client/src/main/java/org/apache/hudi/execution/BulkInsertMapFunction.java ## @@

[GitHub] [incubator-hudi] yanghua commented on a change in pull request #1460: [HUDI-679] Make io package Spark free

2020-03-28 Thread GitBox
yanghua commented on a change in pull request #1460: [HUDI-679] Make io package Spark free URL: https://github.com/apache/incubator-hudi/pull/1460#discussion_r399660094 ## File path: hudi-client/src/main/java/org/apache/hudi/client/SparkTaskContextDetailSupplier.java ##

[GitHub] [incubator-hudi] yanghua commented on a change in pull request #1460: [HUDI-679] Make io package Spark free

2020-03-28 Thread GitBox
yanghua commented on a change in pull request #1460: [HUDI-679] Make io package Spark free URL: https://github.com/apache/incubator-hudi/pull/1460#discussion_r399660132 ## File path: hudi-client/src/main/java/org/apache/hudi/client/SparkTaskContextDetailSupplier.java ##

[GitHub] [incubator-hudi] yanghua commented on a change in pull request #1460: [HUDI-679] Make io package Spark free

2020-03-28 Thread GitBox
yanghua commented on a change in pull request #1460: [HUDI-679] Make io package Spark free URL: https://github.com/apache/incubator-hudi/pull/1460#discussion_r399660167 ## File path: hudi-client/src/main/java/org/apache/hudi/client/SparkTaskContextDetailSupplier.java ##

[GitHub] [incubator-hudi] yanghua commented on a change in pull request #1460: [HUDI-679] Make io package Spark free

2020-03-28 Thread GitBox
yanghua commented on a change in pull request #1460: [HUDI-679] Make io package Spark free URL: https://github.com/apache/incubator-hudi/pull/1460#discussion_r399660595 ## File path: hudi-client/src/main/java/org/apache/hudi/io/HoodieWriteHandle.java ## @@ -55,26 +55,32

[jira] [Updated] (HUDI-743) Remove FileIOUtils.close()

2020-03-28 Thread vinoyang (Jira)
[ https://issues.apache.org/jira/browse/HUDI-743?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] vinoyang updated HUDI-743: -- Status: Closed (was: Patch Available) > Remove FileIOUtils.close() > -- > >

[GitHub] [incubator-hudi] yanghua merged pull request #1461: [HUDI-743]: Remove FileIOUtils.close()

2020-03-28 Thread GitBox
yanghua merged pull request #1461: [HUDI-743]: Remove FileIOUtils.close() URL: https://github.com/apache/incubator-hudi/pull/1461 This is an automated message from the Apache Git Service. To respond to the message, please

[incubator-hudi] branch master updated: [HUDI-743]: Remove FileIOUtils.close() (#1461)

2020-03-28 Thread vinoyang
This is an automated email from the ASF dual-hosted git repository. vinoyang pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/incubator-hudi.git The following commit(s) were added to refs/heads/master by this push: new 04449f3 [HUDI-743]: Remove

[GitHub] [incubator-hudi] codecov-io edited a comment on issue #1461: [HUDI-743]: Remove FileIOUtils.close()

2020-03-28 Thread GitBox
codecov-io edited a comment on issue #1461: [HUDI-743]: Remove FileIOUtils.close() URL: https://github.com/apache/incubator-hudi/pull/1461#issuecomment-605422050 # [Codecov](https://codecov.io/gh/apache/incubator-hudi/pull/1461?src=pr=h1) Report > Merging

[GitHub] [incubator-hudi] leesf commented on issue #1460: [HUDI-679] Make io package Spark free

2020-03-28 Thread GitBox
leesf commented on issue #1460: [HUDI-679] Make io package Spark free URL: https://github.com/apache/incubator-hudi/pull/1460#issuecomment-605434298 @yanghua Updated this PR to address your comments. This is an automated

[GitHub] [incubator-hudi] leesf commented on issue #1460: [HUDI-679] Make io package Spark free

2020-03-28 Thread GitBox
leesf commented on issue #1460: [HUDI-679] Make io package Spark free URL: https://github.com/apache/incubator-hudi/pull/1460#issuecomment-605462038 @yanghua Updated this PR to package three suppliers into `Suppliers`. PTAL, thanks.

[jira] [Updated] (HUDI-736) Simplify ReflectionUtils#getTopLevelClasses

2020-03-28 Thread Suneel Marthi (Jira)
[ https://issues.apache.org/jira/browse/HUDI-736?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Suneel Marthi updated HUDI-736: --- Status: Open (was: New) > Simplify ReflectionUtils#getTopLevelClasses >

[jira] [Updated] (HUDI-736) Simplify ReflectionUtils#getTopLevelClasses

2020-03-28 Thread Suneel Marthi (Jira)
[ https://issues.apache.org/jira/browse/HUDI-736?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Suneel Marthi updated HUDI-736: --- Fix Version/s: 0.6.0 > Simplify ReflectionUtils#getTopLevelClasses >

[GitHub] [incubator-hudi] codecov-io commented on issue #1461: [HUDI-743]: Remove FileIOUtils.close()

2020-03-28 Thread GitBox
codecov-io commented on issue #1461: [HUDI-743]: Remove FileIOUtils.close() URL: https://github.com/apache/incubator-hudi/pull/1461#issuecomment-605422050 # [Codecov](https://codecov.io/gh/apache/incubator-hudi/pull/1461?src=pr=h1) Report > Merging

[GitHub] [incubator-hudi] codecov-io commented on issue #1460: [HUDI-679] Make io package Spark free

2020-03-28 Thread GitBox
codecov-io commented on issue #1460: [HUDI-679] Make io package Spark free URL: https://github.com/apache/incubator-hudi/pull/1460#issuecomment-605428358 # [Codecov](https://codecov.io/gh/apache/incubator-hudi/pull/1460?src=pr=h1) Report > Merging

[GitHub] [incubator-hudi] codecov-io edited a comment on issue #1460: [HUDI-679] Make io package Spark free

2020-03-28 Thread GitBox
codecov-io edited a comment on issue #1460: [HUDI-679] Make io package Spark free URL: https://github.com/apache/incubator-hudi/pull/1460#issuecomment-605428358 # [Codecov](https://codecov.io/gh/apache/incubator-hudi/pull/1460?src=pr=h1) Report > Merging

[GitHub] [incubator-hudi] pratyakshsharma commented on a change in pull request #1150: [HUDI-288]: Add support for ingesting multiple kafka streams in a single DeltaStreamer deployment

2020-03-28 Thread GitBox
pratyakshsharma commented on a change in pull request #1150: [HUDI-288]: Add support for ingesting multiple kafka streams in a single DeltaStreamer deployment URL: https://github.com/apache/incubator-hudi/pull/1150#discussion_r399646598 ## File path:

[GitHub] [incubator-hudi] umehrot2 commented on a change in pull request #1427: [HUDI-727]: Copy default values of fields if not present when rewriting incoming record with new schema

2020-03-28 Thread GitBox
umehrot2 commented on a change in pull request #1427: [HUDI-727]: Copy default values of fields if not present when rewriting incoming record with new schema URL: https://github.com/apache/incubator-hudi/pull/1427#discussion_r399722115 ## File path:

[GitHub] [incubator-hudi] umehrot2 commented on a change in pull request #1427: [HUDI-727]: Copy default values of fields if not present when rewriting incoming record with new schema

2020-03-28 Thread GitBox
umehrot2 commented on a change in pull request #1427: [HUDI-727]: Copy default values of fields if not present when rewriting incoming record with new schema URL: https://github.com/apache/incubator-hudi/pull/1427#discussion_r399722305 ## File path:

[GitHub] [incubator-hudi] umehrot2 commented on a change in pull request #1427: [HUDI-727]: Copy default values of fields if not present when rewriting incoming record with new schema

2020-03-28 Thread GitBox
umehrot2 commented on a change in pull request #1427: [HUDI-727]: Copy default values of fields if not present when rewriting incoming record with new schema URL: https://github.com/apache/incubator-hudi/pull/1427#discussion_r399719119 ## File path:

[GitHub] [incubator-hudi] umehrot2 commented on a change in pull request #1427: [HUDI-727]: Copy default values of fields if not present when rewriting incoming record with new schema

2020-03-28 Thread GitBox
umehrot2 commented on a change in pull request #1427: [HUDI-727]: Copy default values of fields if not present when rewriting incoming record with new schema URL: https://github.com/apache/incubator-hudi/pull/1427#discussion_r399721017 ## File path:

[GitHub] [incubator-hudi] umehrot2 commented on a change in pull request #1427: [HUDI-727]: Copy default values of fields if not present when rewriting incoming record with new schema

2020-03-28 Thread GitBox
umehrot2 commented on a change in pull request #1427: [HUDI-727]: Copy default values of fields if not present when rewriting incoming record with new schema URL: https://github.com/apache/incubator-hudi/pull/1427#discussion_r399722622 ## File path:

[jira] [Reopened] (HUDI-479) Eliminate use of guava if possible

2020-03-28 Thread Suneel Marthi (Jira)
[ https://issues.apache.org/jira/browse/HUDI-479?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Suneel Marthi reopened HUDI-479: > Eliminate use of guava if possible > -- > > Key:

[jira] [Resolved] (HUDI-479) Eliminate use of guava if possible

2020-03-28 Thread Suneel Marthi (Jira)
[ https://issues.apache.org/jira/browse/HUDI-479?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Suneel Marthi resolved HUDI-479. Resolution: Fixed > Eliminate use of guava if possible > -- > >

[jira] [Closed] (HUDI-479) Eliminate use of guava if possible

2020-03-28 Thread Suneel Marthi (Jira)
[ https://issues.apache.org/jira/browse/HUDI-479?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Suneel Marthi closed HUDI-479. -- > Eliminate use of guava if possible > -- > > Key: HUDI-479

[jira] [Assigned] (HUDI-736) Simplify ReflectionUtils#getTopLevelClasses

2020-03-28 Thread Suneel Marthi (Jira)
[ https://issues.apache.org/jira/browse/HUDI-736?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Suneel Marthi reassigned HUDI-736: -- Assignee: Suneel Marthi > Simplify ReflectionUtils#getTopLevelClasses >

[jira] [Updated] (HUDI-744) Redistribute files in hudi-common utils package

2020-03-28 Thread Vinoth Chandar (Jira)
[ https://issues.apache.org/jira/browse/HUDI-744?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vinoth Chandar updated HUDI-744: Status: Open (was: New) > Redistribute files in hudi-common utils package >

[jira] [Commented] (HUDI-737) Simplify/Eliminate need for CollectionUtils#Maps/MapsBuilder

2020-03-28 Thread Suneel Marthi (Jira)
[ https://issues.apache.org/jira/browse/HUDI-737?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17070158#comment-17070158 ] Suneel Marthi commented on HUDI-737: Fixed as part of HUDI-479 > Simplify/Eliminate need for

[GitHub] [incubator-hudi] vinothchandar commented on issue #1458: Issue with running compaction on a MOR dataset with org.apache.hudi.payload.AWSDmsAvroPayload

2020-03-28 Thread GitBox
vinothchandar commented on issue #1458: Issue with running compaction on a MOR dataset with org.apache.hudi.payload.AWSDmsAvroPayload URL: https://github.com/apache/incubator-hudi/issues/1458#issuecomment-605527152 @PhatakN1 This is because the `.AWSDmsAvroPayload` you used is not the cli

[GitHub] [incubator-hudi] umehrot2 commented on a change in pull request #1427: [HUDI-727]: Copy default values of fields if not present when rewriting incoming record with new schema

2020-03-28 Thread GitBox
umehrot2 commented on a change in pull request #1427: [HUDI-727]: Copy default values of fields if not present when rewriting incoming record with new schema URL: https://github.com/apache/incubator-hudi/pull/1427#discussion_r399718998 ## File path:

[jira] [Created] (HUDI-744) Redistribute files in hudi-common utils package

2020-03-28 Thread Vinoth Chandar (Jira)
Vinoth Chandar created HUDI-744: --- Summary: Redistribute files in hudi-common utils package Key: HUDI-744 URL: https://issues.apache.org/jira/browse/HUDI-744 Project: Apache Hudi (incubating)

[jira] [Commented] (HUDI-722) IndexOutOfBoundsException in MessageColumnIORecordConsumer.addBinary when writing parquet

2020-03-28 Thread Alexander Filipchik (Jira)
[ https://issues.apache.org/jira/browse/HUDI-722?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17069995#comment-17069995 ] Alexander Filipchik commented on HUDI-722: -- Sure. The context -> he have a very schema heavy

[GitHub] [incubator-hudi] garyli1019 commented on a change in pull request #1453: HUDI-644 kafka connect checkpoint provider

2020-03-28 Thread GitBox
garyli1019 commented on a change in pull request #1453: HUDI-644 kafka connect checkpoint provider URL: https://github.com/apache/incubator-hudi/pull/1453#discussion_r399703856 ## File path:

[GitHub] [incubator-hudi] pratyakshsharma commented on a change in pull request #1453: HUDI-644 kafka connect checkpoint provider

2020-03-28 Thread GitBox
pratyakshsharma commented on a change in pull request #1453: HUDI-644 kafka connect checkpoint provider URL: https://github.com/apache/incubator-hudi/pull/1453#discussion_r399679177 ## File path:

[GitHub] [incubator-hudi] pratyakshsharma commented on a change in pull request #1453: HUDI-644 kafka connect checkpoint provider

2020-03-28 Thread GitBox
pratyakshsharma commented on a change in pull request #1453: HUDI-644 kafka connect checkpoint provider URL: https://github.com/apache/incubator-hudi/pull/1453#discussion_r399679398 ## File path:

[incubator-hudi] branch master updated (04449f3 -> ac73bdc)

2020-03-28 Thread sivabalan
This is an automated email from the ASF dual-hosted git repository. sivabalan pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/incubator-hudi.git. from 04449f3 [HUDI-743]: Remove FileIOUtils.close() (#1461) add ac73bdc [HUDI-430] Adding

[GitHub] [incubator-hudi] nsivabalan merged pull request #1176: [HUDI-430] Adding InlineFileSystem to support embedding any file format as an InlineFile

2020-03-28 Thread GitBox
nsivabalan merged pull request #1176: [HUDI-430] Adding InlineFileSystem to support embedding any file format as an InlineFile URL: https://github.com/apache/incubator-hudi/pull/1176 This is an automated message from the

[GitHub] [incubator-hudi] vinothchandar commented on a change in pull request #1460: [HUDI-679] Make io package Spark free

2020-03-28 Thread GitBox
vinothchandar commented on a change in pull request #1460: [HUDI-679] Make io package Spark free URL: https://github.com/apache/incubator-hudi/pull/1460#discussion_r399699506 ## File path: hudi-client/src/main/java/org/apache/hudi/client/SparkTaskContextDetailSupplier.java

[GitHub] [incubator-hudi] vinothchandar commented on a change in pull request #1460: [HUDI-679] Make io package Spark free

2020-03-28 Thread GitBox
vinothchandar commented on a change in pull request #1460: [HUDI-679] Make io package Spark free URL: https://github.com/apache/incubator-hudi/pull/1460#discussion_r399699941 ## File path: hudi-client/src/main/java/org/apache/hudi/client/Suppliers.java ## @@ -0,0 +1,48 @@

[GitHub] [incubator-hudi] vinothchandar commented on a change in pull request #1460: [HUDI-679] Make io package Spark free

2020-03-28 Thread GitBox
vinothchandar commented on a change in pull request #1460: [HUDI-679] Make io package Spark free URL: https://github.com/apache/incubator-hudi/pull/1460#discussion_r399700184 ## File path: hudi-client/src/main/java/org/apache/hudi/io/HoodieWriteHandle.java ## @@ -55,26

[GitHub] [incubator-hudi] vinothchandar commented on issue #1457: [HUDI-741] Added checks to validate Hoodie's schema evolution.

2020-03-28 Thread GitBox
vinothchandar commented on issue #1457: [HUDI-741] Added checks to validate Hoodie's schema evolution. URL: https://github.com/apache/incubator-hudi/pull/1457#issuecomment-605508358 @pratyakshsharma @umehrot2 could you folks help review this, given your interests in this area

[GitHub] [incubator-hudi] vinothchandar commented on a change in pull request #1460: [HUDI-679] Make io package Spark free

2020-03-28 Thread GitBox
vinothchandar commented on a change in pull request #1460: [HUDI-679] Make io package Spark free URL: https://github.com/apache/incubator-hudi/pull/1460#discussion_r399700058 ## File path: hudi-client/src/main/java/org/apache/hudi/execution/MergeOnReadLazyInsertIterable.java

[GitHub] [incubator-hudi] vinothchandar commented on a change in pull request #1460: [HUDI-679] Make io package Spark free

2020-03-28 Thread GitBox
vinothchandar commented on a change in pull request #1460: [HUDI-679] Make io package Spark free URL: https://github.com/apache/incubator-hudi/pull/1460#discussion_r399699794 ## File path: hudi-client/src/main/java/org/apache/hudi/client/SparkTaskContextDetailSupplier.java

[GitHub] [incubator-hudi] garyli1019 commented on issue #1454: MINOR update doc to include inc query on partitions

2020-03-28 Thread GitBox
garyli1019 commented on issue #1454: MINOR update doc to include inc query on partitions URL: https://github.com/apache/incubator-hudi/pull/1454#issuecomment-605511322 thanks for reviewing! Addressed the comment This is an

[GitHub] [incubator-hudi] garyli1019 commented on a change in pull request #1454: MINOR update doc to include inc query on partitions

2020-03-28 Thread GitBox
garyli1019 commented on a change in pull request #1454: MINOR update doc to include inc query on partitions URL: https://github.com/apache/incubator-hudi/pull/1454#discussion_r399702927 ## File path: docs/_docs/0.5.2/2_3_querying_data.md ## @@ -146,8 +146,9 @@ The

[GitHub] [incubator-hudi] pratyakshsharma commented on a change in pull request #1452: [HUDI-740]Fix can not specify the sparkMaster of cleans run command

2020-03-28 Thread GitBox
pratyakshsharma commented on a change in pull request #1452: [HUDI-740]Fix can not specify the sparkMaster of cleans run command URL: https://github.com/apache/incubator-hudi/pull/1452#discussion_r399679036 ## File path:

[jira] [Assigned] (HUDI-677) Abstract/Refactor all transaction management logic into a set of classes from HoodieWriteClient

2020-03-28 Thread Vinoth Chandar (Jira)
[ https://issues.apache.org/jira/browse/HUDI-677?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vinoth Chandar reassigned HUDI-677: --- Assignee: Vinoth Chandar (was: hong dongdong) > Abstract/Refactor all transaction management

[GitHub] [incubator-hudi] vinothchandar commented on issue #1455: [SUPPORT] Hudi upsert run into exception: java.lang.NoSuchMethodError: java.lang.Math.floorMod(JI)I

2020-03-28 Thread GitBox
vinothchandar commented on issue #1455: [SUPPORT] Hudi upsert run into exception: java.lang.NoSuchMethodError: java.lang.Math.floorMod(JI)I URL: https://github.com/apache/incubator-hudi/issues/1455#issuecomment-605552838 Thanks @EdwinGuo and @lamber-ken .. Please raise a JIRA if there is

[GitHub] [incubator-hudi] leesf merged pull request #1454: MINOR update doc to include inc query on partitions

2020-03-28 Thread GitBox
leesf merged pull request #1454: MINOR update doc to include inc query on partitions URL: https://github.com/apache/incubator-hudi/pull/1454 This is an automated message from the Apache Git Service. To respond to the

[GitHub] [incubator-hudi] vinothchandar commented on issue #1421: [HUDI-724] Parallelize getSmallFiles for partitions

2020-03-28 Thread GitBox
vinothchandar commented on issue #1421: [HUDI-724] Parallelize getSmallFiles for partitions URL: https://github.com/apache/incubator-hudi/pull/1421#issuecomment-605552930 Took a pass. LGTM overall since @bvaradar is the assignee.. his call :)

[incubator-hudi] branch asf-site updated: [MINOR] Update doc to include inc query on partitions (#1454)

2020-03-28 Thread leesf
This is an automated email from the ASF dual-hosted git repository. leesf pushed a commit to branch asf-site in repository https://gitbox.apache.org/repos/asf/incubator-hudi.git The following commit(s) were added to refs/heads/asf-site by this push: new 18ce570 [MINOR] Update doc to

[GitHub] [incubator-hudi] leesf commented on issue #1460: [HUDI-679] Make io package Spark free

2020-03-28 Thread GitBox
leesf commented on issue #1460: [HUDI-679] Make io package Spark free URL: https://github.com/apache/incubator-hudi/pull/1460#issuecomment-605560443 @yanghua @vinothchandar Thanks for your review, just updated the PR to address your comments. PTAL.

[GitHub] [incubator-hudi] hddong commented on a change in pull request #1452: [HUDI-740]Fix can not specify the sparkMaster of cleans run command

2020-03-28 Thread GitBox
hddong commented on a change in pull request #1452: [HUDI-740]Fix can not specify the sparkMaster of cleans run command URL: https://github.com/apache/incubator-hudi/pull/1452#discussion_r399733435 ## File path: hudi-cli/src/main/java/org/apache/hudi/cli/commands/SparkMain.java

[jira] [Commented] (HUDI-677) Abstract/Refactor all transaction management logic into a set of classes from HoodieWriteClient

2020-03-28 Thread Vinoth Chandar (Jira)
[ https://issues.apache.org/jira/browse/HUDI-677?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17070195#comment-17070195 ] Vinoth Chandar commented on HUDI-677: - Let me take this over.. if you don't mind [~hongdongdong] .. we

[GitHub] [incubator-hudi] vinothchandar commented on issue #1453: HUDI-644 kafka connect checkpoint provider

2020-03-28 Thread GitBox
vinothchandar commented on issue #1453: HUDI-644 kafka connect checkpoint provider URL: https://github.com/apache/incubator-hudi/pull/1453#issuecomment-605552741 Slightly behind.. Will chime in here soon :) This is an

[incubator-hudi] branch asf-site updated: Travis CI build asf-site

2020-03-28 Thread vinoth
This is an automated email from the ASF dual-hosted git repository. vinoth pushed a commit to branch asf-site in repository https://gitbox.apache.org/repos/asf/incubator-hudi.git The following commit(s) were added to refs/heads/asf-site by this push: new 96f3d74 Travis CI build asf-site

[GitHub] [incubator-hudi] codecov-io edited a comment on issue #1460: [HUDI-679] Make io package Spark free

2020-03-28 Thread GitBox
codecov-io edited a comment on issue #1460: [HUDI-679] Make io package Spark free URL: https://github.com/apache/incubator-hudi/pull/1460#issuecomment-605428358 # [Codecov](https://codecov.io/gh/apache/incubator-hudi/pull/1460?src=pr=h1) Report > Merging

[jira] [Commented] (HUDI-677) Abstract/Refactor all transaction management logic into a set of classes from HoodieWriteClient

2020-03-28 Thread hong dongdong (Jira)
[ https://issues.apache.org/jira/browse/HUDI-677?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17070217#comment-17070217 ] hong dongdong commented on HUDI-677: [~vinoth] Of course not.  > Abstract/Refactor all transaction

[GitHub] [incubator-hudi] codecov-io edited a comment on issue #1460: [HUDI-679] Make io package Spark free

2020-03-28 Thread GitBox
codecov-io edited a comment on issue #1460: [HUDI-679] Make io package Spark free URL: https://github.com/apache/incubator-hudi/pull/1460#issuecomment-605428358 # [Codecov](https://codecov.io/gh/apache/incubator-hudi/pull/1460?src=pr=h1) Report > Merging

[GitHub] [incubator-hudi] codecov-io edited a comment on issue #1460: [HUDI-679] Make io package Spark free

2020-03-28 Thread GitBox
codecov-io edited a comment on issue #1460: [HUDI-679] Make io package Spark free URL: https://github.com/apache/incubator-hudi/pull/1460#issuecomment-605428358 # [Codecov](https://codecov.io/gh/apache/incubator-hudi/pull/1460?src=pr=h1) Report > Merging

[GitHub] [incubator-hudi] codecov-io edited a comment on issue #1460: [HUDI-679] Make io package Spark free

2020-03-28 Thread GitBox
codecov-io edited a comment on issue #1460: [HUDI-679] Make io package Spark free URL: https://github.com/apache/incubator-hudi/pull/1460#issuecomment-605428358 # [Codecov](https://codecov.io/gh/apache/incubator-hudi/pull/1460?src=pr=h1) Report > Merging

[GitHub] [incubator-hudi] yanghua commented on a change in pull request #1460: [HUDI-679] Make io package Spark free

2020-03-28 Thread GitBox
yanghua commented on a change in pull request #1460: [HUDI-679] Make io package Spark free URL: https://github.com/apache/incubator-hudi/pull/1460#discussion_r399737990 ## File path: hudi-client/src/main/java/org/apache/hudi/client/SparkTaskContextDetailSupplier.java ##

Build failed in Jenkins: hudi-snapshot-deployment-0.5 #231

2020-03-28 Thread Apache Jenkins Server
See Changes: -- [...truncated 2.40 KB...] /home/jenkins/tools/maven/apache-maven-3.5.4/conf: logging settings.xml toolchains.xml