[jira] [Updated] (HUDI-891) Improve websites for graduation required content

[ https://issues.apache.org/jira/browse/HUDI-891?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] lamber-ken updated HUDI-891: Status: Open (was: New) > Improve websites for graduation required content >

[jira] [Created] (HUDI-891) Improve websites for graduation required content

lamber-ken created HUDI-891: --- Summary: Improve websites for graduation required content Key: HUDI-891 URL: https://issues.apache.org/jira/browse/HUDI-891 Project: Apache Hudi (incubating) Issue

[jira] [Assigned] (HUDI-891) Improve websites for graduation required content

[ https://issues.apache.org/jira/browse/HUDI-891?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] lamber-ken reassigned HUDI-891: --- Assignee: lamber-ken > Improve websites for graduation required content >

[incubator-hudi] branch master updated (404c7e8 -> 32ea4c7)

This is an automated email from the ASF dual-hosted git repository. vinoyang pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/incubator-hudi.git. from 404c7e8 [HUDI-884] Shade avro and parquet-avro in hudi-hive-sync-bundle (#1618) add 32ea4c7

[jira] [Commented] (HUDI-890) Prepare for 0.5.3 patch release

[ https://issues.apache.org/jira/browse/HUDI-890?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17106542#comment-17106542 ] Bhavani Sudha commented on HUDI-890: Sounds good. I ll tag them additionally with 0.5.3 sometime today.

[jira] [Comment Edited] (HUDI-890) Prepare for 0.5.3 patch release

[ https://issues.apache.org/jira/browse/HUDI-890?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17106542#comment-17106542 ] Bhavani Sudha edited comment on HUDI-890 at 5/13/20, 6:09 PM: -- [~vinoth] 

[incubator-hudi] branch master updated: [HUDI-889] Writer supports useJdbc configuration when hive synchronization is enabled (#1627)

This is an automated email from the ASF dual-hosted git repository. leesf pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/incubator-hudi.git The following commit(s) were added to refs/heads/master by this push: new 32bada2 [HUDI-889] Writer supports

[jira] [Reopened] (HUDI-629) Replace Guava's Hashing with an equivalent in NumericUtils.java

[ https://issues.apache.org/jira/browse/HUDI-629?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vinoth Chandar reopened HUDI-629: - > Replace Guava's Hashing with an equivalent in NumericUtils.java >

[jira] [Resolved] (HUDI-629) Replace Guava's Hashing with an equivalent in NumericUtils.java

[ https://issues.apache.org/jira/browse/HUDI-629?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vinoth Chandar resolved HUDI-629. - Fix Version/s: 0.5.3 Resolution: Fixed > Replace Guava's Hashing with an equivalent in

[jira] [Commented] (HUDI-890) Prepare for 0.5.3 patch release

[ https://issues.apache.org/jira/browse/HUDI-890?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17106533#comment-17106533 ] Vinoth Chandar commented on HUDI-890: - [~bhavanisudha] JIRA lets you tag multiple issues with a fix

[jira] [Updated] (HUDI-652) Decouple HoodieReadClient and AbstractHoodieClient to break the inheritance chain

[ https://issues.apache.org/jira/browse/HUDI-652?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vinoth Chandar updated HUDI-652: Fix Version/s: 0.5.3 0.6.0 > Decouple HoodieReadClient and AbstractHoodieClient

[jira] [Commented] (HUDI-890) Prepare for 0.5.3 patch release

[ https://issues.apache.org/jira/browse/HUDI-890?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17106561#comment-17106561 ] Bhavani Sudha commented on HUDI-890: [~garyli1019] thanks Gary. I ll take a look soon. > Prepare for

[jira] [Created] (HUDI-893) Add spark datasource V2 reader support for Hudi tables

Nishith Agarwal created HUDI-893: Summary: Add spark datasource V2 reader support for Hudi tables Key: HUDI-893 URL: https://issues.apache.org/jira/browse/HUDI-893 Project: Apache Hudi (incubating)

[jira] [Resolved] (HUDI-891) Improve websites for graduation required content

[ https://issues.apache.org/jira/browse/HUDI-891?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] lamber-ken resolved HUDI-891. - Resolution: Fixed > Improve websites for graduation required content >

[jira] [Updated] (HUDI-894) Allow ability to use hive metastore thrift connection to register tables

[ https://issues.apache.org/jira/browse/HUDI-894?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated HUDI-894: Labels: pull-request-available (was: ) > Allow ability to use hive metastore thrift connection to

[GitHub] [incubator-hudi] ramachandranms commented on pull request #1619: [MINOR] Parallelize CI tests by modules

ramachandranms commented on pull request #1619: URL: https://github.com/apache/incubator-hudi/pull/1619#issuecomment-628259820 @bvaradar i think a better idea would be to see how we can optimize the tests than breaking up into multiple jenkins jobs. regarding missing coverage: the

[GitHub] [incubator-hudi] EdwinGuo opened a new issue #1630: [SUPPORT] Latest commit does not have any schema in commit metadata

EdwinGuo opened a new issue #1630: URL: https://github.com/apache/incubator-hudi/issues/1630 **_Tips before filing an issue_** - Have you gone through our [FAQs](https://cwiki.apache.org/confluence/display/HUDI/FAQ)? Yes - Join the mailing list to engage in conversations and

[GitHub] [incubator-hudi] xushiyan commented on pull request #1619: [MINOR] Parallelize CI tests by modules

xushiyan commented on pull request #1619: URL: https://github.com/apache/incubator-hudi/pull/1619#issuecomment-628260195 @bvaradar @ramachandranms thanks for chime in.. from the info @ramachandranms provides, hudi-spark-bundle report will be overwritten by the last submission and that

[GitHub] [incubator-hudi] bvaradar commented on pull request #1619: [MINOR] Parallelize CI tests by modules

bvaradar commented on pull request #1619: URL: https://github.com/apache/incubator-hudi/pull/1619#issuecomment-628293196 Optimizing/Redesigning tests should be definitely done from modularity, test-quality and maintenance perspective and having running-time reduction would be a good

[jira] [Commented] (HUDI-890) Prepare for 0.5.3 patch release

[ https://issues.apache.org/jira/browse/HUDI-890?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17106804#comment-17106804 ] hong dongdong commented on HUDI-890: Hi, [~bhavanisudha] take a look when free

[jira] [Created] (HUDI-895) Reduce listing .hoodie folder when using timeline server

Balaji Varadarajan created HUDI-895: --- Summary: Reduce listing .hoodie folder when using timeline server Key: HUDI-895 URL: https://issues.apache.org/jira/browse/HUDI-895 Project: Apache Hudi

[GitHub] [incubator-hudi] xushiyan commented on pull request #1584: fix schema provider issue

xushiyan commented on pull request #1584: URL: https://github.com/apache/incubator-hudi/pull/1584#issuecomment-628299745 @pratyakshsharma I had a new proposed change reflected in the last commit. The idea is to not throw exception when no data is fetched, so this is to loosen a bit

[GitHub] [incubator-hudi] vinothchandar commented on a change in pull request #1607: [HUDI-811] Restructure test packages

vinothchandar commented on a change in pull request #1607: URL: https://github.com/apache/incubator-hudi/pull/1607#discussion_r424769094 ## File path: hudi-hive-sync/src/test/java/org/apache/hudi/hive/testutils/TestUtil.java ## @@ -16,7 +16,7 @@ * limitations under the

[GitHub] [incubator-hudi] vinothchandar merged pull request #1607: [HUDI-811] Restructure test packages

vinothchandar merged pull request #1607: URL: https://github.com/apache/incubator-hudi/pull/1607 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL

[incubator-hudi] branch master updated: [HUDI-811] Restructure test packages (#1607)

This is an automated email from the ASF dual-hosted git repository. vinoth pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/incubator-hudi.git The following commit(s) were added to refs/heads/master by this push: new 0d4848b [HUDI-811] Restructure test

[GitHub] [incubator-hudi] vinothchandar commented on pull request #1557: [WIP] [HUDI-834] Concrete signature of HoodieRecordPayload#combineAndGetUpdateValue & HoodieRecordPayload#getInsertValue

vinothchandar commented on pull request #1557: URL: https://github.com/apache/incubator-hudi/pull/1557#issuecomment-628282107 Closing with a WIP tag for future follow up. This is an automated message from the Apache Git

[GitHub] [incubator-hudi] vinothchandar closed pull request #1557: [WIP] [HUDI-834] Concrete signature of HoodieRecordPayload#combineAndGetUpdateValue & HoodieRecordPayload#getInsertValue

vinothchandar closed pull request #1557: URL: https://github.com/apache/incubator-hudi/pull/1557 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL

[GitHub] [incubator-hudi] n3nash commented on a change in pull request #1605: Adding ability to use hive metastore client for hive table registration instead of jdbc

n3nash commented on a change in pull request #1605: URL: https://github.com/apache/incubator-hudi/pull/1605#discussion_r424727083 ## File path: hudi-spark/src/main/scala/org/apache/hudi/DataSourceOptions.scala ## @@ -264,6 +264,7 @@ object DataSourceWriteOptions { val

[GitHub] [incubator-hudi] bvaradar commented on pull request #1619: [MINOR] Parallelize CI tests by modules

bvaradar commented on pull request #1619: URL: https://github.com/apache/incubator-hudi/pull/1619#issuecomment-628250030 @ramachandranms : Jobs in travis-ci.org has a hard timeout of 50 mins. Splitting the jobs serves as the only way to be under this time-limit. From @xushiyan comment, I

[GitHub] [incubator-hudi] xushiyan edited a comment on pull request #1584: fix schema provider issue

xushiyan edited a comment on pull request #1584: URL: https://github.com/apache/incubator-hudi/pull/1584#issuecomment-628299745 @pratyakshsharma I had a new proposed change reflected in the last commit. The idea is to not throw exception when no data is fetched, so this is to

[jira] [Assigned] (HUDI-818) Optimize the default value of hoodie.memory.merge.max.size option

[ https://issues.apache.org/jira/browse/HUDI-818?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] sivabalan narayanan reassigned HUDI-818: Assignee: lamber-ken > Optimize the default value of hoodie.memory.merge.max.size

[incubator-hudi] branch master updated: [HUDI-793] Adding proper default to hudi metadata fields and proper handling to rewrite routine (#1513)

This is an automated email from the ASF dual-hosted git repository. vinoth pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/incubator-hudi.git The following commit(s) were added to refs/heads/master by this push: new 83796b3 [HUDI-793] Adding proper

[GitHub] [incubator-hudi] vinothchandar merged pull request #1513: [HUDI-793] Adding proper default to hudi metadata fields and proper handling to rewrite routine

vinothchandar merged pull request #1513: URL: https://github.com/apache/incubator-hudi/pull/1513 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL

[GitHub] [incubator-hudi] vinothchandar commented on a change in pull request #1513: [HUDI-793] Adding proper default to hudi metadata fields and proper handling to rewrite routine

vinothchandar commented on a change in pull request #1513: URL: https://github.com/apache/incubator-hudi/pull/1513#discussion_r424814160 ## File path: hudi-common/src/main/java/org/apache/hudi/avro/HoodieAvroUtils.java ## @@ -104,15 +105,15 @@ public static Schema

[jira] [Closed] (HUDI-894) Allow ability to use hive metastore thrift connection to register tables

[ https://issues.apache.org/jira/browse/HUDI-894?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Nishith Agarwal closed HUDI-894. Resolution: Duplicate > Allow ability to use hive metastore thrift connection to register tables >

[GitHub] [incubator-hudi] nandini57 opened a new issue #1629: [SUPPORT]

nandini57 opened a new issue #1629: URL: https://github.com/apache/incubator-hudi/issues/1629 In Hudi-0.5.1 HiveSyncTool.java why MERGE_ON_READ tables mandate a _rt suffix? case MERGE_ON_READ: this.snapshotTableName = cfg.tableName + SUFFIX_SNAPSHOT_TABLE; Also

[GitHub] [incubator-hudi] xushiyan commented on a change in pull request #1607: [HUDI-811] Restructure test packages

xushiyan commented on a change in pull request #1607: URL: https://github.com/apache/incubator-hudi/pull/1607#discussion_r424790740 ## File path: hudi-hive-sync/src/test/java/org/apache/hudi/hive/testutils/TestUtil.java ## @@ -16,7 +16,7 @@ * limitations under the License.

[GitHub] [incubator-hudi] nsivabalan commented on pull request #1596: [HUDI-863] get decimal properties from derived spark DataType

nsivabalan commented on pull request #1596: URL: https://github.com/apache/incubator-hudi/pull/1596#issuecomment-628305115 @rolandjohann : can you assign this ticket to yourself. https://issues.apache.org/jira/browse/HUDI-863 thanks.

[GitHub] [incubator-hudi] xushiyan commented on pull request #1603: [HUDI-836] Add configs for Datadog metrics reporter

xushiyan commented on pull request #1603: URL: https://github.com/apache/incubator-hudi/pull/1603#issuecomment-628304763 Note: blocked by #1572 This is an automated message from the Apache Git Service. To respond to the

[GitHub] [incubator-hudi] vinothchandar commented on pull request #1584: fix schema provider issue

vinothchandar commented on pull request #1584: URL: https://github.com/apache/incubator-hudi/pull/1584#issuecomment-628315469 Spending today and tomorrow on all the schema PRs.. stay tuned :) This is an automated message

[jira] [Commented] (HUDI-473) IllegalArgumentException in QuickstartUtils

[ https://issues.apache.org/jira/browse/HUDI-473?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17106755#comment-17106755 ] sivabalan narayanan commented on HUDI-473: -- [~zhangpu-paul]: are you still facing the issue? Can

[GitHub] [incubator-hudi] n3nash commented on pull request #1605: [HUDI-894] : Adding ability to use hive metastore client for hive table registration instead of jdbc

n3nash commented on pull request #1605: URL: https://github.com/apache/incubator-hudi/pull/1605#issuecomment-628245562 This has been addressed here -> https://github.com/apache/incubator-hudi/pull/1627 This is an automated

[jira] [Updated] (HUDI-894) Allow ability to use hive metastore thrift connection to register tables

[ https://issues.apache.org/jira/browse/HUDI-894?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Nishith Agarwal updated HUDI-894: - Status: In Progress (was: Open) > Allow ability to use hive metastore thrift connection to

[jira] [Updated] (HUDI-894) Allow ability to use hive metastore thrift connection to register tables

[ https://issues.apache.org/jira/browse/HUDI-894?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Nishith Agarwal updated HUDI-894: - Status: Open (was: New) > Allow ability to use hive metastore thrift connection to register

[GitHub] [incubator-hudi] vinothchandar commented on pull request #1502: [WIP] [HUDI-778] Adding codecov bagde to readme file

vinothchandar commented on pull request #1502: URL: https://github.com/apache/incubator-hudi/pull/1502#issuecomment-628282660 marker for later. closing to reduce clutter of WIP PRs This is an automated message from the

[GitHub] [incubator-hudi] vinothchandar closed pull request #1502: [WIP] [HUDI-778] Adding codecov bagde to readme file

vinothchandar closed pull request #1502: URL: https://github.com/apache/incubator-hudi/pull/1502 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL

[GitHub] [incubator-hudi] xushiyan commented on pull request #1623: [MINOR] Increase heap space for surefire

xushiyan commented on pull request #1623: URL: https://github.com/apache/incubator-hudi/pull/1623#issuecomment-628303823 @bvaradar Give me some time to get back to you...need to dig into some docs for this. This is an

[GitHub] [incubator-hudi] xushiyan commented on pull request #1572: [HUDI-836] Implement datadog metrics reporter

xushiyan commented on pull request #1572: URL: https://github.com/apache/incubator-hudi/pull/1572#issuecomment-628304476 Note: blocked by #1623 This is an automated message from the Apache Git Service. To respond to the

Build failed in Jenkins: hudi-snapshot-deployment-0.5 #277

See Changes: -- [...truncated 2.40 KB...] /home/jenkins/tools/maven/apache-maven-3.5.4/conf: logging settings.xml toolchains.xml

[jira] [Updated] (HUDI-896) CI tests improvements

[ https://issues.apache.org/jira/browse/HUDI-896?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Raymond Xu updated HUDI-896: Status: Open (was: New) > CI tests improvements > - > > Key: HUDI-896 >

[jira] [Created] (HUDI-896) CI tests improvements

Raymond Xu created HUDI-896: --- Summary: CI tests improvements Key: HUDI-896 URL: https://issues.apache.org/jira/browse/HUDI-896 Project: Apache Hudi (incubating) Issue Type: New Feature

[jira] [Assigned] (HUDI-767) Support transformation when export to Hudi

[ https://issues.apache.org/jira/browse/HUDI-767?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Raymond Xu reassigned HUDI-767: --- Assignee: (was: Raymond Xu) > Support transformation when export to Hudi >

[jira] [Updated] (HUDI-889) Writer supports useJdbc configuration when hive synchronization is enabled

[ https://issues.apache.org/jira/browse/HUDI-889?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] dzcxzl updated HUDI-889: Status: Closed (was: Patch Available) > Writer supports useJdbc configuration when hive synchronization is enabled

[jira] [Updated] (HUDI-889) Writer supports useJdbc configuration when hive synchronization is enabled

[ https://issues.apache.org/jira/browse/HUDI-889?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] dzcxzl updated HUDI-889: Status: Patch Available (was: In Progress) > Writer supports useJdbc configuration when hive synchronization is

[jira] [Updated] (HUDI-889) Writer supports useJdbc configuration when hive synchronization is enabled

[ https://issues.apache.org/jira/browse/HUDI-889?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] dzcxzl updated HUDI-889: Status: In Progress (was: Open) > Writer supports useJdbc configuration when hive synchronization is enabled >

[jira] [Updated] (HUDI-889) Writer supports useJdbc configuration when hive synchronization is enabled

[ https://issues.apache.org/jira/browse/HUDI-889?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] dzcxzl updated HUDI-889: Status: Open (was: New) > Writer supports useJdbc configuration when hive synchronization is enabled >

[jira] [Updated] (HUDI-896) CI tests improvements

[ https://issues.apache.org/jira/browse/HUDI-896?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Raymond Xu updated HUDI-896: Status: In Progress (was: Open) > CI tests improvements > - > > Key:

[jira] [Updated] (HUDI-767) Support transformation when export to Hudi

[ https://issues.apache.org/jira/browse/HUDI-767?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Raymond Xu updated HUDI-767: Status: New (was: Open) > Support transformation when export to Hudi >

[jira] [Updated] (HUDI-767) Support transformation when export to Hudi

[ https://issues.apache.org/jira/browse/HUDI-767?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Raymond Xu updated HUDI-767: Fix Version/s: (was: 0.6.0) 0.6.1 > Support transformation when export to Hudi >

[jira] [Updated] (HUDI-767) Support transformation when export to Hudi

[ https://issues.apache.org/jira/browse/HUDI-767?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Raymond Xu updated HUDI-767: Labels: (was: bug-bash-0.6.0) > Support transformation when export to Hudi >

[jira] [Commented] (HUDI-896) CI tests improvements

[ https://issues.apache.org/jira/browse/HUDI-896?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17106884#comment-17106884 ] Raymond Xu commented on HUDI-896: - https://github.com/apache/incubator-hudi/pull/1619

[jira] [Commented] (HUDI-774) Spark to Avro converter incorrectly generates optional fields

[ https://issues.apache.org/jira/browse/HUDI-774?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17106849#comment-17106849 ] Raymond Xu commented on HUDI-774: - I think this is a very important fix..+1 For any custom schema

[jira] [Commented] (HUDI-767) Support transformation when export to Hudi

[ https://issues.apache.org/jira/browse/HUDI-767?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17106877#comment-17106877 ] Raymond Xu commented on HUDI-767: - [~vinoth] I'm trying to clear up my queue a bit, hence deferring this to

[jira] [Created] (HUDI-892) RealtimeParquetInputFormat should skip adding projection columns if there are no log files

Vinoth Chandar created HUDI-892: --- Summary: RealtimeParquetInputFormat should skip adding projection columns if there are no log files Key: HUDI-892 URL: https://issues.apache.org/jira/browse/HUDI-892

[incubator-hudi] branch asf-site updated: [HUDI-891] Improve websites for graduation required content (#1628)

This is an automated email from the ASF dual-hosted git repository. vinoth pushed a commit to branch asf-site in repository https://gitbox.apache.org/repos/asf/incubator-hudi.git The following commit(s) were added to refs/heads/asf-site by this push: new 20a0ee2 [HUDI-891] Improve

[jira] [Closed] (HUDI-869) Add support for alluxio

[ https://issues.apache.org/jira/browse/HUDI-869?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] vinoyang closed HUDI-869. - Resolution: Implemented Implemented via master branch: 32ea4c70ff259798dee571670dbcc501cc477cb0 > Add support