[GitHub] [incubator-hudi] bvaradar commented on a change in pull request #1004: [HUDI-328] Adding delete api to HoodieWriteClient

2019-11-18 Thread GitBox
bvaradar commented on a change in pull request #1004: [HUDI-328] Adding delete api to HoodieWriteClient URL: https://github.com/apache/incubator-hudi/pull/1004#discussion_r347752816 ## File path: hudi-client/src/main/java/org/apache/hudi/HoodieWriteClient.java ## @@

[GitHub] [incubator-hudi] bvaradar commented on a change in pull request #1004: [HUDI-328] Adding delete api to HoodieWriteClient

2019-11-18 Thread GitBox
bvaradar commented on a change in pull request #1004: [HUDI-328] Adding delete api to HoodieWriteClient URL: https://github.com/apache/incubator-hudi/pull/1004#discussion_r347751320 ## File path: hudi-client/src/main/java/org/apache/hudi/HoodieWriteClient.java ## @@

[GitHub] [incubator-hudi] bvaradar commented on a change in pull request #1004: [HUDI-328] Adding delete api to HoodieWriteClient

2019-11-18 Thread GitBox
bvaradar commented on a change in pull request #1004: [HUDI-328] Adding delete api to HoodieWriteClient URL: https://github.com/apache/incubator-hudi/pull/1004#discussion_r347754633 ## File path: hudi-client/src/main/java/org/apache/hudi/HoodieWriteClient.java ## @@ -96,6

[GitHub] [incubator-hudi] bvaradar commented on a change in pull request #1004: [HUDI-328] Adding delete api to HoodieWriteClient

2019-11-18 Thread GitBox
bvaradar commented on a change in pull request #1004: [HUDI-328] Adding delete api to HoodieWriteClient URL: https://github.com/apache/incubator-hudi/pull/1004#discussion_r347753713 ## File path: hudi-client/src/test/java/org/apache/hudi/TestHoodieClientOnCopyOnWriteStorage.java

[GitHub] [incubator-hudi] bvaradar commented on a change in pull request #1004: [HUDI-328] Adding delete api to HoodieWriteClient

2019-11-18 Thread GitBox
bvaradar commented on a change in pull request #1004: [HUDI-328] Adding delete api to HoodieWriteClient URL: https://github.com/apache/incubator-hudi/pull/1004#discussion_r347751623 ## File path: hudi-client/src/main/java/org/apache/hudi/HoodieWriteClient.java ## @@

[jira] [Closed] (HUDI-342) add pull request template for hudi project

2019-11-18 Thread leesf (Jira)
[ https://issues.apache.org/jira/browse/HUDI-342?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] leesf closed HUDI-342. -- Fix Version/s: 0.5.1 Resolution: Fixed Fixed via master: 66492498f702e9224da838d1869e9376111939ce > add pull

[GitHub] [incubator-hudi] leesf commented on a change in pull request #1025: [HUDI-346] Set allowMultipleEmptyLines property false for EmptyLineSeparator rule

2019-11-18 Thread GitBox
leesf commented on a change in pull request #1025: [HUDI-346] Set allowMultipleEmptyLines property false for EmptyLineSeparator rule URL: https://github.com/apache/incubator-hudi/pull/1025#discussion_r347747097 ## File path: style/checkstyle.xml ## @@ -101,6 +101,9 @@

[GitHub] [incubator-hudi] leesf commented on a change in pull request #1025: [HUDI-346] Set allowMultipleEmptyLines property false for EmptyLineSeparator rule

2019-11-18 Thread GitBox
leesf commented on a change in pull request #1025: [HUDI-346] Set allowMultipleEmptyLines property false for EmptyLineSeparator rule URL: https://github.com/apache/incubator-hudi/pull/1025#discussion_r347745844 ## File path: pom.xml ## @@ -914,7 +914,7 @@

[GitHub] [incubator-hudi] leesf commented on a change in pull request #1025: [HUDI-346] Set allowMultipleEmptyLines property false for EmptyLineSeparator rule

2019-11-18 Thread GitBox
leesf commented on a change in pull request #1025: [HUDI-346] Set allowMultipleEmptyLines property false for EmptyLineSeparator rule URL: https://github.com/apache/incubator-hudi/pull/1025#discussion_r347745844 ## File path: pom.xml ## @@ -914,7 +914,7 @@

[incubator-hudi] branch master updated (e806eb7 -> 6649249)

2019-11-18 Thread leesf
This is an automated email from the ASF dual-hosted git repository. leesf pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/incubator-hudi.git. from e806eb7 [HUDI-339] Add support of Azure cloud storage (#1019) add 6649249 [HUDI-342] add pull request

[GitHub] [incubator-hudi] leesf merged pull request #1022: [HUDI-342] add pull request template for hudi project

2019-11-18 Thread GitBox
leesf merged pull request #1022: [HUDI-342] add pull request template for hudi project URL: https://github.com/apache/incubator-hudi/pull/1022 This is an automated message from the Apache Git Service. To respond to the

[jira] [Commented] (HUDI-184) Integrate Hudi with Apache Flink

2019-11-18 Thread vinoyang (Jira)
[ https://issues.apache.org/jira/browse/HUDI-184?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16977141#comment-16977141 ] vinoyang commented on HUDI-184: --- [~taherk77] I know you have provided some thoughts before. Maybe we can pick

Build failed in Jenkins: hudi-snapshot-deployment-0.5 #103

2019-11-18 Thread Apache Jenkins Server
See Changes: -- [...truncated 2.14 KB...] /home/jenkins/tools/maven/apache-maven-3.5.4/bin: m2.conf mvn mvn.cmd mvnDebug mvnDebug.cmd mvnyjp

[GitHub] [incubator-hudi] lamber-ken commented on a change in pull request #1022: [HUDI-342] add pull request template for hudi project

2019-11-18 Thread GitBox
lamber-ken commented on a change in pull request #1022: [HUDI-342] add pull request template for hudi project URL: https://github.com/apache/incubator-hudi/pull/1022#discussion_r347735399 ## File path: .github/PULL_REQUEST_TEMPLATE.md ## @@ -0,0 +1,17 @@ +## *Tips* +-

[GitHub] [incubator-hudi] lamber-ken commented on a change in pull request #1022: [HUDI-342] add pull request template for hudi project

2019-11-18 Thread GitBox
lamber-ken commented on a change in pull request #1022: [HUDI-342] add pull request template for hudi project URL: https://github.com/apache/incubator-hudi/pull/1022#discussion_r347733901 ## File path: .github/PULL_REQUEST_TEMPLATE.md ## @@ -0,0 +1,34 @@ +## *Tips* +-

[GitHub] [incubator-hudi] nsivabalan commented on issue #976: [WIP] [HUDI-106] Adding support for DynamicBloomFilter

2019-11-18 Thread GitBox
nsivabalan commented on issue #976: [WIP] [HUDI-106] Adding support for DynamicBloomFilter URL: https://github.com/apache/incubator-hudi/pull/976#issuecomment-555335838 @vinothchandar : thnx. Here are the two pending items: 1. You suggested to check if there is a way to bound the max

[jira] [Commented] (HUDI-184) Integrate Hudi with Apache Flink

2019-11-18 Thread Taher Koitawala (Jira)
[ https://issues.apache.org/jira/browse/HUDI-184?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16977123#comment-16977123 ] Taher Koitawala commented on HUDI-184: -- Should we like try a small mock up of it? > Integrate Hudi

[GitHub] [incubator-hudi] leesf commented on a change in pull request #1022: [HUDI-342] add pull request template for hudi project

2019-11-18 Thread GitBox
leesf commented on a change in pull request #1022: [HUDI-342] add pull request template for hudi project URL: https://github.com/apache/incubator-hudi/pull/1022#discussion_r347729962 ## File path: .github/PULL_REQUEST_TEMPLATE.md ## @@ -0,0 +1,34 @@ +## *Tips* +- *Thank

[GitHub] [incubator-hudi] leesf commented on a change in pull request #1022: [HUDI-342] add pull request template for hudi project

2019-11-18 Thread GitBox
leesf commented on a change in pull request #1022: [HUDI-342] add pull request template for hudi project URL: https://github.com/apache/incubator-hudi/pull/1022#discussion_r347729962 ## File path: .github/PULL_REQUEST_TEMPLATE.md ## @@ -0,0 +1,34 @@ +## *Tips* +- *Thank

[jira] [Commented] (HUDI-184) Integrate Hudi with Apache Flink

2019-11-18 Thread Vinoth Chandar (Jira)
[ https://issues.apache.org/jira/browse/HUDI-184?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16977120#comment-16977120 ] Vinoth Chandar commented on HUDI-184: - Yes. I remember. But I was and is still unclear on how the micro

[jira] [Commented] (HUDI-184) Integrate Hudi with Apache Flink

2019-11-18 Thread Taher Koitawala (Jira)
[ https://issues.apache.org/jira/browse/HUDI-184?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16977101#comment-16977101 ] Taher Koitawala commented on HUDI-184: -- [~vinoth] The index checkpointed to dfs was something i was

[jira] [Commented] (HUDI-184) Integrate Hudi with Apache Flink

2019-11-18 Thread Vinoth Chandar (Jira)
[ https://issues.apache.org/jira/browse/HUDI-184?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16977098#comment-16977098 ] Vinoth Chandar commented on HUDI-184: - Interesting idea. [~yanghua] so IIUC, we can map one window to a

[GitHub] [incubator-hudi] lamber-ken edited a comment on issue #1022: [HUDI-342] add pull request template for hudi project

2019-11-18 Thread GitBox
lamber-ken edited a comment on issue #1022: [HUDI-342] add pull request template for hudi project URL: https://github.com/apache/incubator-hudi/pull/1022#issuecomment-555295925 hi, @leesf @vinothchandar. How about this one?? ## *Tips* - *Thank you very much for contributing to

[GitHub] [incubator-hudi] lamber-ken edited a comment on issue #1022: [HUDI-342] add pull request template for hudi project

2019-11-18 Thread GitBox
lamber-ken edited a comment on issue #1022: [HUDI-342] add pull request template for hudi project URL: https://github.com/apache/incubator-hudi/pull/1022#issuecomment-555295925 hi, @leesf @vinothchandar. How about this one?? ## *Tips* - *Thank you very much for contributing to

[jira] [Commented] (HUDI-76) CSV Source support for Hudi Delta Streamer

2019-11-18 Thread Vinoth Chandar (Jira)
[ https://issues.apache.org/jira/browse/HUDI-76?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16977094#comment-16977094 ] Vinoth Chandar commented on HUDI-76: Sg > CSV Source support for Hudi Delta Streamer >

[jira] [Commented] (HUDI-184) Integrate Hudi with Apache Flink

2019-11-18 Thread Taher Koitawala (Jira)
[ https://issues.apache.org/jira/browse/HUDI-184?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16977092#comment-16977092 ] Taher Koitawala commented on HUDI-184: -- [~vinoth] and [~vinoyang] I agree we can do windowing in

[jira] [Updated] (HUDI-346) Set allowMultipleEmptyLines property false for EmptyLineSeparator rule

2019-11-18 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HUDI-346?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated HUDI-346: Labels: pull-request-available (was: ) > Set allowMultipleEmptyLines property false for

[GitHub] [incubator-hudi] lamber-ken opened a new pull request #1025: [HUDI-346] Set allowMultipleEmptyLines property false for EmptyLineSeparator rule

2019-11-18 Thread GitBox
lamber-ken opened a new pull request #1025: [HUDI-346] Set allowMultipleEmptyLines property false for EmptyLineSeparator rule URL: https://github.com/apache/incubator-hudi/pull/1025 ## What is the purpose of the pull request Set allowMultipleEmptyLines property false for

[jira] [Commented] (HUDI-184) Integrate Hudi with Apache Flink

2019-11-18 Thread vinoyang (Jira)
[ https://issues.apache.org/jira/browse/HUDI-184?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16977090#comment-16977090 ] vinoyang commented on HUDI-184: --- bq. Also there are probably some bigger questions to answer first? e.g if we

[jira] [Created] (HUDI-346) Set allowMultipleEmptyLines property false for EmptyLineSeparator rule

2019-11-18 Thread lamber-ken (Jira)
lamber-ken created HUDI-346: --- Summary: Set allowMultipleEmptyLines property false for EmptyLineSeparator rule Key: HUDI-346 URL: https://issues.apache.org/jira/browse/HUDI-346 Project: Apache Hudi

[jira] [Updated] (HUDI-345) Fix used deprecated function

2019-11-18 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HUDI-345?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated HUDI-345: Labels: pull-request-available (was: ) > Fix used deprecated function >

[GitHub] [incubator-hudi] hddong opened a new pull request #1024: [HUDI-345] Fix used deprecated function

2019-11-18 Thread GitBox
hddong opened a new pull request #1024: [HUDI-345] Fix used deprecated function URL: https://github.com/apache/incubator-hudi/pull/1024 Fix used deprecated function to be compatible with higher version of hadoop. This is an

[jira] [Created] (HUDI-345) Fix used deprecated function

2019-11-18 Thread hong dongdong (Jira)
hong dongdong created HUDI-345: -- Summary: Fix used deprecated function Key: HUDI-345 URL: https://issues.apache.org/jira/browse/HUDI-345 Project: Apache Hudi (incubating) Issue Type:

[GitHub] [incubator-hudi] lamber-ken edited a comment on issue #1022: [HUDI-342] add pull request template for hudi project

2019-11-18 Thread GitBox
lamber-ken edited a comment on issue #1022: [HUDI-342] add pull request template for hudi project URL: https://github.com/apache/incubator-hudi/pull/1022#issuecomment-555295925 hi, @leesf @vinothchandar. How about this one?? ## *Tips* - *Thank you very much for contributing to

[GitHub] [incubator-hudi] lamber-ken edited a comment on issue #1022: [HUDI-342] add pull request template for hudi project

2019-11-18 Thread GitBox
lamber-ken edited a comment on issue #1022: [HUDI-342] add pull request template for hudi project URL: https://github.com/apache/incubator-hudi/pull/1022#issuecomment-555295925 hi, @leesf @vinothchandar. How about this one?? ## *Tips* - *Thank you very much for contributing to

[GitHub] [incubator-hudi] lamber-ken commented on issue #1022: [HUDI-342] add pull request template for hudi project

2019-11-18 Thread GitBox
lamber-ken commented on issue #1022: [HUDI-342] add pull request template for hudi project URL: https://github.com/apache/incubator-hudi/pull/1022#issuecomment-555295925 hi, @leesf @vinothchandar. How about this one?? ## *Tips* - *Thank you very much for contributing to Apache

[GitHub] [incubator-hudi] vinothchandar commented on issue #976: [WIP] [HUDI-106] Adding support for DynamicBloomFilter

2019-11-18 Thread GitBox
vinothchandar commented on issue #976: [WIP] [HUDI-106] Adding support for DynamicBloomFilter URL: https://github.com/apache/incubator-hudi/pull/976#issuecomment-555294451 Instead of `BLOOM_INDEX_AUTO_TUNE_ENABLE_PROP`, should we just make it `BLOOM_INDEX_FILTER_TYPE_PROP`? But higher

[GitHub] [incubator-hudi] vinothchandar commented on a change in pull request #1022: [HUDI-342] add pull request template for hudi project

2019-11-18 Thread GitBox
vinothchandar commented on a change in pull request #1022: [HUDI-342] add pull request template for hudi project URL: https://github.com/apache/incubator-hudi/pull/1022#discussion_r347696360 ## File path: .github/PULL_REQUEST_TEMPLATE.md ## @@ -0,0 +1,17 @@ +## *Tips* +-

[GitHub] [incubator-hudi] simonqin removed a comment on issue #1021: how can i deal this problem when partition's value changed with the same row_key?

2019-11-18 Thread GitBox
simonqin removed a comment on issue #1021: how can i deal this problem when partition's value changed with the same row_key? URL: https://github.com/apache/incubator-hudi/issues/1021#issuecomment-555290646 @bhasudha thanks for your reply. I set the index to GLOBAL_BLOOM. I understand

[GitHub] [incubator-hudi] lamber-ken commented on a change in pull request #1022: [HUDI-342] add pull request template for hudi project

2019-11-18 Thread GitBox
lamber-ken commented on a change in pull request #1022: [HUDI-342] add pull request template for hudi project URL: https://github.com/apache/incubator-hudi/pull/1022#discussion_r347694097 ## File path: .github/PULL_REQUEST_TEMPLATE.md ## @@ -0,0 +1,17 @@ +## *Tips* +-

[GitHub] [incubator-hudi] simonqin commented on issue #1021: how can i deal this problem when partition's value changed with the same row_key?

2019-11-18 Thread GitBox
simonqin commented on issue #1021: how can i deal this problem when partition's value changed with the same row_key? URL: https://github.com/apache/incubator-hudi/issues/1021#issuecomment-555290646 @bhasudha thanks for your reply. I set the index to GLOBAL_BLOOM. I understand that this

[GitHub] [incubator-hudi] simonqin commented on issue #1021: how can i deal this problem when partition's value changed with the same row_key?

2019-11-18 Thread GitBox
simonqin commented on issue #1021: how can i deal this problem when partition's value changed with the same row_key? URL: https://github.com/apache/incubator-hudi/issues/1021#issuecomment-555290637 @bhasudha thanks for your reply. I set the index to GLOBAL_BLOOM. I understand that this

[GitHub] [incubator-hudi] leesf commented on a change in pull request #1022: [HUDI-342] add pull request template for hudi project

2019-11-18 Thread GitBox
leesf commented on a change in pull request #1022: [HUDI-342] add pull request template for hudi project URL: https://github.com/apache/incubator-hudi/pull/1022#discussion_r347689339 ## File path: .github/PULL_REQUEST_TEMPLATE.md ## @@ -0,0 +1,17 @@ +## *Tips* +- *Thank

[GitHub] [incubator-hudi] umehrot2 commented on issue #1005: [HUDI-91][HUDI-12]Migrate to spark 2.4.4, migrate to spark-avro library instead of databricks-avro, add support for Decimal/Date types

2019-11-18 Thread GitBox
umehrot2 commented on issue #1005: [HUDI-91][HUDI-12]Migrate to spark 2.4.4, migrate to spark-avro library instead of databricks-avro, add support for Decimal/Date types URL: https://github.com/apache/incubator-hudi/pull/1005#issuecomment-555259474 @vinothchandar Yes updating quick start

[GitHub] [incubator-hudi] umehrot2 commented on issue #1005: [HUDI-91][HUDI-12]Migrate to spark 2.4.4, migrate to spark-avro library instead of databricks-avro, add support for Decimal/Date types

2019-11-18 Thread GitBox
umehrot2 commented on issue #1005: [HUDI-91][HUDI-12]Migrate to spark 2.4.4, migrate to spark-avro library instead of databricks-avro, add support for Decimal/Date types URL: https://github.com/apache/incubator-hudi/pull/1005#issuecomment-555259043 > @umehrot2 : Sorry for the

[jira] [Commented] (HUDI-76) CSV Source support for Hudi Delta Streamer

2019-11-18 Thread Ethan Guo (Jira)
[ https://issues.apache.org/jira/browse/HUDI-76?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16976901#comment-16976901 ] Ethan Guo commented on HUDI-76: --- [~vinoth]  I'm okay with the existing lastModifiedTimes approach.  Just

[GitHub] [incubator-hudi] bvaradar commented on issue #1005: [HUDI-91][HUDI-12]Migrate to spark 2.4.4, migrate to spark-avro library instead of databricks-avro, add support for Decimal/Date types

2019-11-18 Thread GitBox
bvaradar commented on issue #1005: [HUDI-91][HUDI-12]Migrate to spark 2.4.4, migrate to spark-avro library instead of databricks-avro, add support for Decimal/Date types URL: https://github.com/apache/incubator-hudi/pull/1005#issuecomment-555217609 @umehrot2 : Sorry for the back-and-forth

[GitHub] [incubator-hudi] bhasudha edited a comment on issue #1021: how can i deal this problem when partition's value changed with the same row_key?

2019-11-18 Thread GitBox
bhasudha edited a comment on issue #1021: how can i deal this problem when partition's value changed with the same row_key? URL: https://github.com/apache/incubator-hudi/issues/1021#issuecomment-555200348 "String partitionPath = "2016/04/15";" seems to be different from the insert

[GitHub] [incubator-hudi] bhasudha commented on issue #1021: how can i deal this problem when partition's value changed with the same row_key?

2019-11-18 Thread GitBox
bhasudha commented on issue #1021: how can i deal this problem when partition's value changed with the same row_key? URL: https://github.com/apache/incubator-hudi/issues/1021#issuecomment-555200348 "String partitionPath = "2016/04/15";" seems to be different from the insert partitionPath

[jira] [Updated] (HUDI-344) Hudi Dataset Snapshot Exporter

2019-11-18 Thread Raymond Xu (Jira)
[ https://issues.apache.org/jira/browse/HUDI-344?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Raymond Xu updated HUDI-344: Description: A dataset exporter tool for snapshotting. See

[jira] [Created] (HUDI-344) Hudi Dataset Snapshot Exporter

2019-11-18 Thread Raymond Xu (Jira)
Raymond Xu created HUDI-344: --- Summary: Hudi Dataset Snapshot Exporter Key: HUDI-344 URL: https://issues.apache.org/jira/browse/HUDI-344 Project: Apache Hudi (incubating) Issue Type: New Feature

[jira] [Updated] (HUDI-336) Improve page related content on Hudi website

2019-11-18 Thread Vinoth Chandar (Jira)
[ https://issues.apache.org/jira/browse/HUDI-336?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vinoth Chandar updated HUDI-336: Summary: Improve page related content on Hudi website (was: Improve landing page related content on

[jira] [Commented] (HUDI-184) Integrate Hudi with Apache Flink

2019-11-18 Thread Vinoth Chandar (Jira)
[ https://issues.apache.org/jira/browse/HUDI-184?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16976791#comment-16976791 ] Vinoth Chandar commented on HUDI-184: - [~yanghua]  been thinking a bit around what we could do to

[jira] [Created] (HUDI-343) Create a DOAP File for Hudi

2019-11-18 Thread Vinoth Chandar (Jira)
Vinoth Chandar created HUDI-343: --- Summary: Create a DOAP File for Hudi Key: HUDI-343 URL: https://issues.apache.org/jira/browse/HUDI-343 Project: Apache Hudi (incubating) Issue Type: New

[GitHub] [incubator-hudi] lamber-ken opened a new pull request #1023: [HOTFIX] Fix error configuration item of dockerfile-maven-plugin

2019-11-18 Thread GitBox
lamber-ken opened a new pull request #1023: [HOTFIX] Fix error configuration item of dockerfile-maven-plugin URL: https://github.com/apache/incubator-hudi/pull/1023 ## What is the purpose of the pull request Fix error configuration item of dockerfile-maven-plugin, chang `forceTags`

[GitHub] [incubator-hudi] vinothchandar commented on issue #991: Hudi Test Suite (Refactor)

2019-11-18 Thread GitBox
vinothchandar commented on issue #991: Hudi Test Suite (Refactor) URL: https://github.com/apache/incubator-hudi/pull/991#issuecomment-555058508 @n3nash Have not read thru all the responses you had yet. Will do in sometime . But just wanted to highlight 1 issue that I feel strongly

[jira] [Commented] (HUDI-76) CSV Source support for Hudi Delta Streamer

2019-11-18 Thread Vinoth Chandar (Jira)
[ https://issues.apache.org/jira/browse/HUDI-76?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16976607#comment-16976607 ] Vinoth Chandar commented on HUDI-76: [~guoyihua] any reason this has to be different than the existing

[GitHub] [incubator-hudi] lamber-ken commented on issue #1022: [HUDI-342] add pull request template for hudi project

2019-11-18 Thread GitBox
lamber-ken commented on issue #1022: [HUDI-342] add pull request template for hudi project URL: https://github.com/apache/incubator-hudi/pull/1022#issuecomment-555049265 Any suggestion is welcome, thanks. This is an

[jira] [Commented] (HUDI-309) General Redesign of Archived Timeline for efficient scan and management

2019-11-18 Thread Vinoth Chandar (Jira)
[ https://issues.apache.org/jira/browse/HUDI-309?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16976589#comment-16976589 ] Vinoth Chandar commented on HUDI-309: - [~rxu] We typically look up timeline by its action type

[jira] [Updated] (HUDI-342) add pull request template for hudi project

2019-11-18 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HUDI-342?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated HUDI-342: Labels: pull-request-available (was: ) > add pull request template for hudi project >

[GitHub] [incubator-hudi] lamber-ken opened a new pull request #1022: [HUDI-342] add pull request template for hudi project

2019-11-18 Thread GitBox
lamber-ken opened a new pull request #1022: [HUDI-342] add pull request template for hudi project URL: https://github.com/apache/incubator-hudi/pull/1022 ## *Tips* - *Thank you very much for contributing to Apache Hudi.* - *Please review https://hudi.apache.org/contributing.html

[jira] [Comment Edited] (HUDI-288) Add support for ingesting multiple kafka streams in a single DeltaStreamer deployment

2019-11-18 Thread leesf (Jira)
[ https://issues.apache.org/jira/browse/HUDI-288?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16976500#comment-16976500 ] leesf edited comment on HUDI-288 at 11/18/19 12:37 PM: --- [~vinoth] Sorry for late

[jira] [Comment Edited] (HUDI-288) Add support for ingesting multiple kafka streams in a single DeltaStreamer deployment

2019-11-18 Thread leesf (Jira)
[ https://issues.apache.org/jira/browse/HUDI-288?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16976500#comment-16976500 ] leesf edited comment on HUDI-288 at 11/18/19 12:36 PM: --- [~vinoth] Sorry for late

[jira] [Commented] (HUDI-288) Add support for ingesting multiple kafka streams in a single DeltaStreamer deployment

2019-11-18 Thread leesf (Jira)
[ https://issues.apache.org/jira/browse/HUDI-288?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16976500#comment-16976500 ] leesf commented on HUDI-288: [~vinoth] Sorry for late feedback. After a closer look to code paths, I prefer

[jira] [Closed] (HUDI-339) Add support of Azure cloud storage

2019-11-18 Thread Benoit Rousseau (Jira)
[ https://issues.apache.org/jira/browse/HUDI-339?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Benoit Rousseau closed HUDI-339. PR merged > Add support of Azure cloud storage > -- > >

[jira] [Resolved] (HUDI-339) Add support of Azure cloud storage

2019-11-18 Thread Benoit Rousseau (Jira)
[ https://issues.apache.org/jira/browse/HUDI-339?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Benoit Rousseau resolved HUDI-339. -- Resolution: Done > Add support of Azure cloud storage > -- > >

[jira] [Comment Edited] (HUDI-64) Estimation of compression ratio & other dynamic storage knobs based on historical stats

2019-11-18 Thread vinoyang (Jira)
[ https://issues.apache.org/jira/browse/HUDI-64?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16976473#comment-16976473 ] vinoyang edited comment on HUDI-64 at 11/18/19 11:39 AM: - [~thw] Since you have been

[jira] [Commented] (HUDI-64) Estimation of compression ratio & other dynamic storage knobs based on historical stats

2019-11-18 Thread vinoyang (Jira)
[ https://issues.apache.org/jira/browse/HUDI-64?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16976473#comment-16976473 ] vinoyang commented on HUDI-64: -- [~thomasWeise] Since you have been Flink PMC for a long time, can you help me

[GitHub] [incubator-hudi] simonqin opened a new issue #1021: how can i deal this problem when partition's value changed with the same row_key?

2019-11-18 Thread GitBox
simonqin opened a new issue #1021: how can i deal this problem when partition's value changed with the same row_key? URL: https://github.com/apache/incubator-hudi/issues/1021 // Create the write client to write some records in HoodieWriteConfig cfg =

[GitHub] [incubator-hudi] n3nash commented on a change in pull request #1009: [HUDI-308] Avoid Renames for tracking state transitions of all actions on dataset

2019-11-18 Thread GitBox
n3nash commented on a change in pull request #1009: [HUDI-308] Avoid Renames for tracking state transitions of all actions on dataset URL: https://github.com/apache/incubator-hudi/pull/1009#discussion_r347283486 ## File path:

[GitHub] [incubator-hudi] n3nash commented on a change in pull request #1009: [HUDI-308] Avoid Renames for tracking state transitions of all actions on dataset

2019-11-18 Thread GitBox
n3nash commented on a change in pull request #1009: [HUDI-308] Avoid Renames for tracking state transitions of all actions on dataset URL: https://github.com/apache/incubator-hudi/pull/1009#discussion_r347283486 ## File path:

[GitHub] [incubator-hudi] n3nash commented on a change in pull request #1009: [HUDI-308] Avoid Renames for tracking state transitions of all actions on dataset

2019-11-18 Thread GitBox
n3nash commented on a change in pull request #1009: [HUDI-308] Avoid Renames for tracking state transitions of all actions on dataset URL: https://github.com/apache/incubator-hudi/pull/1009#discussion_r347283209 ## File path:

[GitHub] [incubator-hudi] n3nash commented on a change in pull request #1009: [HUDI-308] Avoid Renames for tracking state transitions of all actions on dataset

2019-11-18 Thread GitBox
n3nash commented on a change in pull request #1009: [HUDI-308] Avoid Renames for tracking state transitions of all actions on dataset URL: https://github.com/apache/incubator-hudi/pull/1009#discussion_r347282266 ## File path:

[GitHub] [incubator-hudi] n3nash commented on a change in pull request #1009: [HUDI-308] Avoid Renames for tracking state transitions of all actions on dataset

2019-11-18 Thread GitBox
n3nash commented on a change in pull request #1009: [HUDI-308] Avoid Renames for tracking state transitions of all actions on dataset URL: https://github.com/apache/incubator-hudi/pull/1009#discussion_r347281272 ## File path:

[GitHub] [incubator-hudi] n3nash commented on a change in pull request #1009: [HUDI-308] Avoid Renames for tracking state transitions of all actions on dataset

2019-11-18 Thread GitBox
n3nash commented on a change in pull request #1009: [HUDI-308] Avoid Renames for tracking state transitions of all actions on dataset URL: https://github.com/apache/incubator-hudi/pull/1009#discussion_r347280266 ## File path:

[GitHub] [incubator-hudi] n3nash commented on a change in pull request #1009: [HUDI-308] Avoid Renames for tracking state transitions of all actions on dataset

2019-11-18 Thread GitBox
n3nash commented on a change in pull request #1009: [HUDI-308] Avoid Renames for tracking state transitions of all actions on dataset URL: https://github.com/apache/incubator-hudi/pull/1009#discussion_r347278728 ## File path:

[GitHub] [incubator-hudi] n3nash commented on a change in pull request #1009: [HUDI-308] Avoid Renames for tracking state transitions of all actions on dataset

2019-11-18 Thread GitBox
n3nash commented on a change in pull request #1009: [HUDI-308] Avoid Renames for tracking state transitions of all actions on dataset URL: https://github.com/apache/incubator-hudi/pull/1009#discussion_r347270327 ## File path:

[jira] [Created] (HUDI-342) add pull request template for hudi project

2019-11-18 Thread lamber-ken (Jira)
lamber-ken created HUDI-342: --- Summary: add pull request template for hudi project Key: HUDI-342 URL: https://issues.apache.org/jira/browse/HUDI-342 Project: Apache Hudi (incubating) Issue Type:

[GitHub] [incubator-hudi] yanghua commented on issue #991: Hudi Test Suite (Refactor)

2019-11-18 Thread GitBox
yanghua commented on issue #991: Hudi Test Suite (Refactor) URL: https://github.com/apache/incubator-hudi/pull/991#issuecomment-554912438 > @yanghua I'd like to first understand our plan for iterating on this feature before we can decide to move it to a feature branch. > > 1. Can