[GitHub] [incubator-hudi] vinothchandar edited a comment on issue #1223: [HUDI-530] Fix conversion of Spark struct type to Avro schema

2020-01-14 Thread GitBox
vinothchandar edited a comment on issue #1223: [HUDI-530] Fix conversion of Spark struct type to Avro schema URL: https://github.com/apache/incubator-hudi/pull/1223#issuecomment-574015931 @umehrot2 is this by any way related to the quickstart breakage that @nsivabalan reported? EDIT: s

[incubator-hudi] branch hudi_test_suite_refactor updated (3dc85eb -> 0456214)

2020-01-14 Thread vinoyang
This is an automated email from the ASF dual-hosted git repository. vinoyang pushed a change to branch hudi_test_suite_refactor in repository https://gitbox.apache.org/repos/asf/incubator-hudi.git. discard 3dc85eb [HUDI-442] Fix TestComplexKeyGenerator#testSingleValueKeyGenerator and testMul

[GitHub] [incubator-hudi] bhasudha edited a comment on issue #1223: [HUDI-530] Fix conversion of Spark struct type to Avro schema

2020-01-14 Thread GitBox
bhasudha edited a comment on issue #1223: [HUDI-530] Fix conversion of Spark struct type to Avro schema URL: https://github.com/apache/incubator-hudi/pull/1223#issuecomment-574060570 Looks good to me. I was also able to quickly verify this in my local setup. Thanks @umehrot2. ---

[GitHub] [incubator-hudi] bhasudha commented on issue #1223: [HUDI-530] Fix conversion of Spark struct type to Avro schema

2020-01-14 Thread GitBox
bhasudha commented on issue #1223: [HUDI-530] Fix conversion of Spark struct type to Avro schema URL: https://github.com/apache/incubator-hudi/pull/1223#issuecomment-574060570 Looks goot to me. I was also able to quickly verify this in my local setup. Thanks @umehrot2. --

[GitHub] [incubator-hudi] bhasudha merged pull request #1223: [HUDI-530] Fix conversion of Spark struct type to Avro schema

2020-01-14 Thread GitBox
bhasudha merged pull request #1223: [HUDI-530] Fix conversion of Spark struct type to Avro schema URL: https://github.com/apache/incubator-hudi/pull/1223 This is an automated message from the Apache Git Service. To respond t

[incubator-hudi] branch master updated (fd8f1c7 -> 2bb0c21)

2020-01-14 Thread bhavanisudha
This is an automated email from the ASF dual-hosted git repository. bhavanisudha pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/incubator-hudi.git. from fd8f1c7 [MINOR] Reuse random object (#1222) add 2bb0c21 Fix conversion of Spark struct type to A

[GitHub] [incubator-hudi] vinothchandar commented on a change in pull request #1212: [WIP] [HUDI-509] Renaming code in sync with cWiki restructuring

2020-01-14 Thread GitBox
vinothchandar commented on a change in pull request #1212: [WIP] [HUDI-509] Renaming code in sync with cWiki restructuring URL: https://github.com/apache/incubator-hudi/pull/1212#discussion_r366207936 ## File path: hudi-utilities/src/main/java/org/apache/hudi/utilities/deltastreame

[GitHub] [incubator-hudi] vinothchandar commented on a change in pull request #1212: [WIP] [HUDI-509] Renaming code in sync with cWiki restructuring

2020-01-14 Thread GitBox
vinothchandar commented on a change in pull request #1212: [WIP] [HUDI-509] Renaming code in sync with cWiki restructuring URL: https://github.com/apache/incubator-hudi/pull/1212#discussion_r366214234 ## File path: hudi-spark/src/main/scala/org/apache/hudi/DefaultSource.scala #

[jira] [Created] (HUDI-533) Update Setup docs with lastest checkstyle

2020-01-14 Thread leesf (Jira)
leesf created HUDI-533: -- Summary: Update Setup docs with lastest checkstyle Key: HUDI-533 URL: https://issues.apache.org/jira/browse/HUDI-533 Project: Apache Hudi (incubating) Issue Type: Improvement

[jira] [Updated] (HUDI-533) Update Setup docs with lastest checkstyle

2020-01-14 Thread leesf (Jira)
[ https://issues.apache.org/jira/browse/HUDI-533?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] leesf updated HUDI-533: --- Priority: Minor (was: Major) > Update Setup docs with lastest checkstyle > - >

[jira] [Created] (HUDI-534) Explore a new way to fix import order

2020-01-14 Thread leesf (Jira)
leesf created HUDI-534: -- Summary: Explore a new way to fix import order Key: HUDI-534 URL: https://issues.apache.org/jira/browse/HUDI-534 Project: Apache Hudi (incubating) Issue Type: Improvement

[GitHub] [incubator-hudi] leesf commented on issue #1208: [HUDI-304] Bring back spotless plugin

2020-01-14 Thread GitBox
leesf commented on issue #1208: [HUDI-304] Bring back spotless plugin URL: https://github.com/apache/incubator-hudi/pull/1208#issuecomment-574102314 > > ocument that developers could use checkstyle.xml file in style folder in checkstyle plugin and things will go well > > I was able t

[GitHub] [incubator-hudi] OpenOpened opened a new pull request #1200: [HUDI-514] A schema provider to get metadata through Jdbc

2020-01-14 Thread GitBox
OpenOpened opened a new pull request #1200: [HUDI-514] A schema provider to get metadata through Jdbc URL: https://github.com/apache/incubator-hudi/pull/1200 ## What is the purpose of the pull request In our production environment, we usually need to synchronize data from mysql, and

[GitHub] [incubator-hudi] OpenOpened closed pull request #1200: [HUDI-514] A schema provider to get metadata through Jdbc

2020-01-14 Thread GitBox
OpenOpened closed pull request #1200: [HUDI-514] A schema provider to get metadata through Jdbc URL: https://github.com/apache/incubator-hudi/pull/1200 This is an automated message from the Apache Git Service. To respond to

[GitHub] [incubator-hudi] leesf edited a comment on issue #1208: [HUDI-304] Bring back spotless plugin

2020-01-14 Thread GitBox
leesf edited a comment on issue #1208: [HUDI-304] Bring back spotless plugin URL: https://github.com/apache/incubator-hudi/pull/1208#issuecomment-574102314 > > ocument that developers could use checkstyle.xml file in style folder in checkstyle plugin and things will go well > > I was

[GitHub] [incubator-hudi] leesf edited a comment on issue #1208: [HUDI-304] Bring back spotless plugin

2020-01-14 Thread GitBox
leesf edited a comment on issue #1208: [HUDI-304] Bring back spotless plugin URL: https://github.com/apache/incubator-hudi/pull/1208#issuecomment-574102314 > > ocument that developers could use checkstyle.xml file in style folder in checkstyle plugin and things will go well > > I was

[GitHub] [incubator-hudi] OpenOpened commented on a change in pull request #1200: [HUDI-514] A schema provider to get metadata through Jdbc

2020-01-14 Thread GitBox
OpenOpened commented on a change in pull request #1200: [HUDI-514] A schema provider to get metadata through Jdbc URL: https://github.com/apache/incubator-hudi/pull/1200#discussion_r366309238 ## File path: hudi-utilities/src/test/resources/delta-streamer-config/source-jdbc.avsc ##

[GitHub] [incubator-hudi] OpenOpened commented on a change in pull request #1200: [HUDI-514] A schema provider to get metadata through Jdbc

2020-01-14 Thread GitBox
OpenOpened commented on a change in pull request #1200: [HUDI-514] A schema provider to get metadata through Jdbc URL: https://github.com/apache/incubator-hudi/pull/1200#discussion_r366309913 ## File path: hudi-utilities/src/main/java/org/apache/hudi/utilities/UtilHelpers.java ###

[GitHub] [incubator-hudi] OpenOpened commented on issue #1200: [HUDI-514] A schema provider to get metadata through Jdbc

2020-01-14 Thread GitBox
OpenOpened commented on issue #1200: [HUDI-514] A schema provider to get metadata through Jdbc URL: https://github.com/apache/incubator-hudi/pull/1200#issuecomment-574151367 @vinothchandar Please check again This is an automa

[GitHub] [incubator-hudi] RonBarabash commented on issue #1202: [SUPPORT] com.uber.hoodie.exception.HoodieIOException: IOException when reading log file + Corrupted Log File

2020-01-14 Thread GitBox
RonBarabash commented on issue #1202: [SUPPORT] com.uber.hoodie.exception.HoodieIOException: IOException when reading log file + Corrupted Log File URL: https://github.com/apache/incubator-hudi/issues/1202#issuecomment-574166330 Input -> kafka, CDC events logs generated by debezium Proc

[GitHub] [incubator-hudi] RonBarabash commented on issue #1202: [SUPPORT] com.uber.hoodie.exception.HoodieIOException: IOException when reading log file + Corrupted Log File

2020-01-14 Thread GitBox
RonBarabash commented on issue #1202: [SUPPORT] com.uber.hoodie.exception.HoodieIOException: IOException when reading log file + Corrupted Log File URL: https://github.com/apache/incubator-hudi/issues/1202#issuecomment-574166866 this is the first error we are getting: ``` com.ube

[GitHub] [incubator-hudi] lamber-ken opened a new pull request #1227: [MINOR] Refactor unnecessary boxing inside TypedProperties code

2020-01-14 Thread GitBox
lamber-ken opened a new pull request #1227: [MINOR] Refactor unnecessary boxing inside TypedProperties code URL: https://github.com/apache/incubator-hudi/pull/1227 ## What is the purpose of the pull request Refactor unnecessary boxing inside TypedProperties. ## Brief change lo

[GitHub] [incubator-hudi] RonBarabash commented on issue #1202: [SUPPORT] com.uber.hoodie.exception.HoodieIOException: IOException when reading log file + Corrupted Log File

2020-01-14 Thread GitBox
RonBarabash commented on issue #1202: [SUPPORT] com.uber.hoodie.exception.HoodieIOException: IOException when reading log file + Corrupted Log File URL: https://github.com/apache/incubator-hudi/issues/1202#issuecomment-574294028 Hey, im thinking this might be an s3 issue with inconsistency

[jira] [Created] (HUDI-535) Compatibility Issue : Hudi Readers using newer layout version can see intermittent errors due to race conditions with concurrent compactions in MOR tables

2020-01-14 Thread Balaji Varadarajan (Jira)
Balaji Varadarajan created HUDI-535: --- Summary: Compatibility Issue : Hudi Readers using newer layout version can see intermittent errors due to race conditions with concurrent compactions in MOR tables Key: HUDI-535

[GitHub] [incubator-hudi] bvaradar commented on a change in pull request #1157: [HUDI-332]Add operation type (insert/upsert/bulkinsert/delete) to HoodieCommitMetadata

2020-01-14 Thread GitBox
bvaradar commented on a change in pull request #1157: [HUDI-332]Add operation type (insert/upsert/bulkinsert/delete) to HoodieCommitMetadata URL: https://github.com/apache/incubator-hudi/pull/1157#discussion_r366499639 ## File path: hudi-common/src/main/avro/HoodieCommitMetadata.avs

[GitHub] [incubator-hudi] bvaradar commented on issue #1157: [HUDI-332]Add operation type (insert/upsert/bulkinsert/delete) to HoodieCommitMetadata

2020-01-14 Thread GitBox
bvaradar commented on issue #1157: [HUDI-332]Add operation type (insert/upsert/bulkinsert/delete) to HoodieCommitMetadata URL: https://github.com/apache/incubator-hudi/pull/1157#issuecomment-574309467 @hddong : lgtm. Once you rebase this PR and resolve conflicts, we can merge -

[GitHub] [incubator-hudi] n3nash commented on a change in pull request #1194: [HUDI-326] Add support to delete records with only record_key

2020-01-14 Thread GitBox
n3nash commented on a change in pull request #1194: [HUDI-326] Add support to delete records with only record_key URL: https://github.com/apache/incubator-hudi/pull/1194#discussion_r366505359 ## File path: hudi-spark/src/main/java/org/apache/hudi/keygen/ComplexKeyGenerator.java ##

[GitHub] [incubator-hudi] n3nash commented on a change in pull request #1194: [HUDI-326] Add support to delete records with only record_key

2020-01-14 Thread GitBox
n3nash commented on a change in pull request #1194: [HUDI-326] Add support to delete records with only record_key URL: https://github.com/apache/incubator-hudi/pull/1194#discussion_r366506053 ## File path: hudi-spark/src/main/java/org/apache/hudi/keygen/GlobalDeleteKeyGenerator.jav

[GitHub] [incubator-hudi] n3nash commented on issue #1194: [HUDI-326] Add support to delete records with only record_key

2020-01-14 Thread GitBox
n3nash commented on issue #1194: [HUDI-326] Add support to delete records with only record_key URL: https://github.com/apache/incubator-hudi/pull/1194#issuecomment-574314023 @bschell Once you open up the JIRA for the backwards compatible package refactor, we can merge this. --

[GitHub] [incubator-hudi] bvaradar commented on a change in pull request #1208: [HUDI-304] Bring back spotless plugin

2020-01-14 Thread GitBox
bvaradar commented on a change in pull request #1208: [HUDI-304] Bring back spotless plugin URL: https://github.com/apache/incubator-hudi/pull/1208#discussion_r366507169 ## File path: hudi-cli/src/main/java/org/apache/hudi/cli/HoodieCLI.java ## @@ -64,8 +64,8 @@ private st

[GitHub] [incubator-hudi] bvaradar commented on issue #1208: [HUDI-304] Bring back spotless plugin

2020-01-14 Thread GitBox
bvaradar commented on issue #1208: [HUDI-304] Bring back spotless plugin URL: https://github.com/apache/incubator-hudi/pull/1208#issuecomment-574314755 """The changes in this PR has nothing to do with 120 character limit. And I randomly checked some modified files, they are modified after f

[GitHub] [incubator-hudi] zhedoubushishi commented on issue #1109: [HUDI-238] - Migrating to Scala 2.12

2020-01-14 Thread GitBox
zhedoubushishi commented on issue #1109: [HUDI-238] - Migrating to Scala 2.12 URL: https://github.com/apache/incubator-hudi/pull/1109#issuecomment-574321102 > > Sure. I will send another PR. Currently our work only supports 2.12, but I can try to see if it is possible to support both 2.11 a

[jira] [Updated] (HUDI-31) MOR - Allow partitioner to pick more than one small file for inserting new data #494

2020-01-14 Thread Pratyaksh Sharma (Jira)
[ https://issues.apache.org/jira/browse/HUDI-31?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Pratyaksh Sharma updated HUDI-31: - Status: In Progress (was: Open) > MOR - Allow partitioner to pick more than one small file for inse

[jira] [Updated] (HUDI-93) Enforce semantics on HoodieRecordPayload to allow for a consistent instantiation of custom payloads via reflection

2020-01-14 Thread Pratyaksh Sharma (Jira)
[ https://issues.apache.org/jira/browse/HUDI-93?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Pratyaksh Sharma updated HUDI-93: - Status: In Progress (was: Open) > Enforce semantics on HoodieRecordPayload to allow for a consisten

[GitHub] [incubator-hudi] vinothchandar commented on issue #1212: [HUDI-509] Renaming code in sync with cWiki restructuring

2020-01-14 Thread GitBox
vinothchandar commented on issue #1212: [HUDI-509] Renaming code in sync with cWiki restructuring URL: https://github.com/apache/incubator-hudi/pull/1212#issuecomment-574421454 @n3nash are you able to review this? or any other committer really.. (wish there was a gh team we could mention.

[jira] [Created] (HUDI-536) Update release notes to include KeyGenerator package changes

2020-01-14 Thread Brandon Scheller (Jira)
Brandon Scheller created HUDI-536: - Summary: Update release notes to include KeyGenerator package changes Key: HUDI-536 URL: https://issues.apache.org/jira/browse/HUDI-536 Project: Apache Hudi (incuba

[GitHub] [incubator-hudi] bschell commented on issue #1194: [HUDI-326] Add support to delete records with only record_key

2020-01-14 Thread GitBox
bschell commented on issue #1194: [HUDI-326] Add support to delete records with only record_key URL: https://github.com/apache/incubator-hudi/pull/1194#issuecomment-574421754 @n3nash Here is the JIRA: https://issues.apache.org/jira/browse/HUDI-536 -

[jira] [Updated] (HUDI-536) Update release notes to include KeyGenerator package changes

2020-01-14 Thread Brandon Scheller (Jira)
[ https://issues.apache.org/jira/browse/HUDI-536?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Brandon Scheller updated HUDI-536: -- Description: The change introduced here: [https://github.com/apache/incubator-hudi/pull/1194] R

[GitHub] [incubator-hudi] hddong commented on issue #1157: [HUDI-332]Add operation type (insert/upsert/bulkinsert/delete) to HoodieCommitMetadata

2020-01-14 Thread GitBox
hddong commented on issue #1157: [HUDI-332]Add operation type (insert/upsert/bulkinsert/delete) to HoodieCommitMetadata URL: https://github.com/apache/incubator-hudi/pull/1157#issuecomment-574427217 @bvaradar @vinothchandar Thanks. rebased this and there are no conflicts now. -

[GitHub] [incubator-hudi] ssomuah opened a new issue #1228: No FileSystem for scheme: abfss

2020-01-14 Thread GitBox
ssomuah opened a new issue #1228: No FileSystem for scheme: abfss URL: https://github.com/apache/incubator-hudi/issues/1228 Hi, I'm trying to use hudi to write to one of the Azure storage container file systems, ADLS Gen 2 (abfs://). The issue I'm facing is that in `HoodieROTablePathFil

[GitHub] [incubator-hudi] bvaradar commented on issue #1157: [HUDI-332]Add operation type (insert/upsert/bulkinsert/delete) to HoodieCommitMetadata

2020-01-14 Thread GitBox
bvaradar commented on issue #1157: [HUDI-332]Add operation type (insert/upsert/bulkinsert/delete) to HoodieCommitMetadata URL: https://github.com/apache/incubator-hudi/pull/1157#issuecomment-574440583 @hddong : Did you forgot to push the diff. Still seeing conflicts. -

[incubator-hudi] branch master updated (2bb0c21 -> 9b2944a)

2020-01-14 Thread vinoth
This is an automated email from the ASF dual-hosted git repository. vinoth pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/incubator-hudi.git. from 2bb0c21 Fix conversion of Spark struct type to Avro schema add 9b2944a [MINOR] Refactor unnecessary bo

[GitHub] [incubator-hudi] vinothchandar merged pull request #1227: [MINOR] Refactor unnecessary boxing inside TypedProperties code

2020-01-14 Thread GitBox
vinothchandar merged pull request #1227: [MINOR] Refactor unnecessary boxing inside TypedProperties code URL: https://github.com/apache/incubator-hudi/pull/1227 This is an automated message from the Apache Git Service. To re

Build failed in Jenkins: hudi-snapshot-deployment-0.5 #159

2020-01-14 Thread Apache Jenkins Server
See Changes: -- [...truncated 2.20 KB...] /home/jenkins/tools/maven/apache-maven-3.5.4/bin: m2.conf mvn mvn.cmd mvnDebug mvnDebug.cmd mvnyjp /home/jenkins/tools/maven/apach

[GitHub] [incubator-hudi] nsivabalan commented on issue #1225: [MINOR] Adding util methods to assist in adding deletion support to Quick Start

2020-01-14 Thread GitBox
nsivabalan commented on issue #1225: [MINOR] Adding util methods to assist in adding deletion support to Quick Start URL: https://github.com/apache/incubator-hudi/pull/1225#issuecomment-574492697 @bhasudha : I have changed the way we wanna generate deletes. Basically I pass in insert recor

[jira] [Created] (HUDI-537) Introduce administration CLI to update hoodie properties

2020-01-14 Thread Balaji Varadarajan (Jira)
Balaji Varadarajan created HUDI-537: --- Summary: Introduce administration CLI to update hoodie properties Key: HUDI-537 URL: https://issues.apache.org/jira/browse/HUDI-537 Project: Apache Hudi (incuba

[jira] [Assigned] (HUDI-537) Introduce administration CLI to update hoodie properties

2020-01-14 Thread Balaji Varadarajan (Jira)
[ https://issues.apache.org/jira/browse/HUDI-537?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Balaji Varadarajan reassigned HUDI-537: --- Assignee: Vinoth Chandar > Introduce administration CLI to update hoodie properties >

[jira] [Assigned] (HUDI-535) Compatibility Issue : Hudi Readers using newer layout version can see intermittent errors due to race conditions with concurrent compactions in MOR tables

2020-01-14 Thread Balaji Varadarajan (Jira)
[ https://issues.apache.org/jira/browse/HUDI-535?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Balaji Varadarajan reassigned HUDI-535: --- Assignee: Balaji Varadarajan > Compatibility Issue : Hudi Readers using newer layout v

[jira] [Updated] (HUDI-535) Compatibility Issue : Hudi Readers using newer layout version can see intermittent errors due to race conditions with concurrent compactions in MOR tables

2020-01-14 Thread Vinoth Chandar (Jira)
[ https://issues.apache.org/jira/browse/HUDI-535?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vinoth Chandar updated HUDI-535: Status: Open (was: New) > Compatibility Issue : Hudi Readers using newer layout version can see > i

[jira] [Updated] (HUDI-537) Introduce administration CLI to update hoodie properties

2020-01-14 Thread Vinoth Chandar (Jira)
[ https://issues.apache.org/jira/browse/HUDI-537?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vinoth Chandar updated HUDI-537: Status: Open (was: New) > Introduce administration CLI to update hoodie properties > --

[jira] [Updated] (HUDI-83) Support for timestamp datatype in Hudi

2020-01-14 Thread Vinoth Chandar (Jira)
[ https://issues.apache.org/jira/browse/HUDI-83?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vinoth Chandar updated HUDI-83: --- Status: Closed (was: Patch Available) > Support for timestamp datatype in Hudi > --

[jira] [Reopened] (HUDI-83) Support for timestamp datatype in Hudi

2020-01-14 Thread Vinoth Chandar (Jira)
[ https://issues.apache.org/jira/browse/HUDI-83?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vinoth Chandar reopened HUDI-83: > Support for timestamp datatype in Hudi > -- > > Key:

[jira] [Updated] (HUDI-507) Support \ t split hdfs source

2020-01-14 Thread Vinoth Chandar (Jira)
[ https://issues.apache.org/jira/browse/HUDI-507?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vinoth Chandar updated HUDI-507: Fix Version/s: (was: 0.5.1) 0.6.0 > Support \ t split hdfs source > --

[jira] [Updated] (HUDI-83) Support for timestamp datatype in Hudi

2020-01-14 Thread Vinoth Chandar (Jira)
[ https://issues.apache.org/jira/browse/HUDI-83?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vinoth Chandar updated HUDI-83: --- Fix Version/s: (was: 0.5.1) 0.6.0 > Support for timestamp datatype in Hudi >

[jira] [Updated] (HUDI-238) Make separate release for hudi spark/scala based packages for scala 2.12

2020-01-14 Thread Vinoth Chandar (Jira)
[ https://issues.apache.org/jira/browse/HUDI-238?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vinoth Chandar updated HUDI-238: Priority: Blocker (was: Major) > Make separate release for hudi spark/scala based packages for scala

[jira] [Updated] (HUDI-403) Publish a deployment guide talking about deployment options, upgrading etc

2020-01-14 Thread Vinoth Chandar (Jira)
[ https://issues.apache.org/jira/browse/HUDI-403?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vinoth Chandar updated HUDI-403: Priority: Blocker (was: Major) > Publish a deployment guide talking about deployment options, upgrad

[jira] [Assigned] (HUDI-403) Publish a deployment guide talking about deployment options, upgrading etc

2020-01-14 Thread Vinoth Chandar (Jira)
[ https://issues.apache.org/jira/browse/HUDI-403?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vinoth Chandar reassigned HUDI-403: --- Assignee: Balaji Varadarajan (was: Vinoth Chandar) > Publish a deployment guide talking about

[jira] [Updated] (HUDI-510) Update site documentation in sync with cWiki

2020-01-14 Thread Vinoth Chandar (Jira)
[ https://issues.apache.org/jira/browse/HUDI-510?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vinoth Chandar updated HUDI-510: Fix Version/s: 0.5.1 > Update site documentation in sync with cWiki > ---

[jira] [Updated] (HUDI-509) Rename "views" into "query types" according to cWiki

2020-01-14 Thread Vinoth Chandar (Jira)
[ https://issues.apache.org/jira/browse/HUDI-509?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vinoth Chandar updated HUDI-509: Priority: Blocker (was: Major) > Rename "views" into "query types" according to cWiki >

[jira] [Updated] (HUDI-509) Rename "views" into "query types" according to cWiki

2020-01-14 Thread Vinoth Chandar (Jira)
[ https://issues.apache.org/jira/browse/HUDI-509?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vinoth Chandar updated HUDI-509: Fix Version/s: 0.5.1 > Rename "views" into "query types" according to cWiki > ---

[jira] [Updated] (HUDI-295) Do one-time cleanup of Hudi git history

2020-01-14 Thread Vinoth Chandar (Jira)
[ https://issues.apache.org/jira/browse/HUDI-295?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vinoth Chandar updated HUDI-295: Fix Version/s: (was: 0.5.1) 0.6.0 > Do one-time cleanup of Hudi git history >

[jira] [Updated] (HUDI-537) Introduce administration CLI to update hoodie properties

2020-01-14 Thread Vinoth Chandar (Jira)
[ https://issues.apache.org/jira/browse/HUDI-537?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vinoth Chandar updated HUDI-537: Priority: Blocker (was: Major) > Introduce administration CLI to update hoodie properties > ---

[jira] [Updated] (HUDI-536) Update release notes to include KeyGenerator package changes

2020-01-14 Thread Vinoth Chandar (Jira)
[ https://issues.apache.org/jira/browse/HUDI-536?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vinoth Chandar updated HUDI-536: Fix Version/s: 0.5.1 > Update release notes to include KeyGenerator package changes > ---

[GitHub] [incubator-hudi] vinothchandar commented on issue #1150: [HUDI-288]: Add support for ingesting multiple kafka streams in a single DeltaStreamer deployment

2020-01-14 Thread GitBox
vinothchandar commented on issue #1150: [HUDI-288]: Add support for ingesting multiple kafka streams in a single DeltaStreamer deployment URL: https://github.com/apache/incubator-hudi/pull/1150#issuecomment-574501169 @pratyakshsharma any updates? -

[GitHub] [incubator-hudi] pratyakshsharma commented on issue #1150: [HUDI-288]: Add support for ingesting multiple kafka streams in a single DeltaStreamer deployment

2020-01-14 Thread GitBox
pratyakshsharma commented on issue #1150: [HUDI-288]: Add support for ingesting multiple kafka streams in a single DeltaStreamer deployment URL: https://github.com/apache/incubator-hudi/pull/1150#issuecomment-574505738 @vinothchandar @bvaradar Sorry was busy with some other stuff. Today I w

[GitHub] [incubator-hudi] liujianhuiouc commented on issue #1216: [HUDI-525] lack of insert info in delta_commit inflight

2020-01-14 Thread GitBox
liujianhuiouc commented on issue #1216: [HUDI-525] lack of insert info in delta_commit inflight URL: https://github.com/apache/incubator-hudi/pull/1216#issuecomment-574522300 sometimes will to know the num of record of bulk inserts as the inflight state not successful transition to complet