[jira] [Updated] (HUDI-1636) Support Builder Pattern To Build Table Properties For HoodieTableConfig

2021-03-04 Thread vinoyang (Jira)
[ https://issues.apache.org/jira/browse/HUDI-1636?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] vinoyang updated HUDI-1636: --- Fix Version/s: 0.8.0 > Support Builder Pattern To Build Table Properties For HoodieTableCon

[jira] [Closed] (HUDI-1636) Support Builder Pattern To Build Table Properties For HoodieTableConfig

2021-03-04 Thread vinoyang (Jira)
[ https://issues.apache.org/jira/browse/HUDI-1636?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] vinoyang closed HUDI-1636. -- Resolution: Done > Support Builder Pattern To Build Table Properties For HoodieTableCon

[jira] [Commented] (HUDI-1672) packaging fails w/ scala 12 (due to flink)

2021-03-07 Thread vinoyang (Jira)
[ https://issues.apache.org/jira/browse/HUDI-1672?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17297085#comment-17297085 ] vinoyang commented on HUDI-1672: [~shivnarayan] It's strange. I did not find th

[jira] [Closed] (HUDI-1663) Streaming read for Flink MOR table

2021-03-10 Thread vinoyang (Jira)
[ https://issues.apache.org/jira/browse/HUDI-1663?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] vinoyang closed HUDI-1663. -- Resolution: Implemented Implemented via master branch: 2fdae6835ce3fcad3111205d2373a69b34788483 > Stream

[jira] [Assigned] (HUDI-1678) Row level delete for Flink sink

2021-03-11 Thread vinoyang (Jira)
[ https://issues.apache.org/jira/browse/HUDI-1678?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] vinoyang reassigned HUDI-1678: -- Assignee: Danny Chen > Row level delete for Flink s

[jira] [Updated] (HUDI-1678) Row level delete for Flink sink

2021-03-11 Thread vinoyang (Jira)
[ https://issues.apache.org/jira/browse/HUDI-1678?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] vinoyang updated HUDI-1678: --- Fix Version/s: 0.8.0 > Row level delete for Flink s

[jira] [Closed] (HUDI-1678) Row level delete for Flink sink

2021-03-11 Thread vinoyang (Jira)
[ https://issues.apache.org/jira/browse/HUDI-1678?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] vinoyang closed HUDI-1678. -- Resolution: Implemented 12ff562d2bd77b6dc8676eac79cbd631185dac3c > Row level delete for Flink s

[jira] [Closed] (HUDI-1664) Avro schema inference for Flink SQL table

2021-03-11 Thread vinoyang (Jira)
[ https://issues.apache.org/jira/browse/HUDI-1664?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] vinoyang closed HUDI-1664. -- Resolution: Implemented e8e6708aea1ace4aecaba594d7fd84a0b5cac635 > Avro schema inference for Flink SQL ta

[jira] [Assigned] (HUDI-1681) Support object storage for Flink writer

2021-03-12 Thread vinoyang (Jira)
[ https://issues.apache.org/jira/browse/HUDI-1681?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] vinoyang reassigned HUDI-1681: -- Assignee: Danny Chen > Support object storage for Flink wri

[jira] [Closed] (HUDI-1681) Support object storage for Flink writer

2021-03-12 Thread vinoyang (Jira)
[ https://issues.apache.org/jira/browse/HUDI-1681?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] vinoyang closed HUDI-1681. -- Resolution: Implemented 20786ab8a2a1e7735ab846e92802fb9f4449adc9 > Support object storage for Flink wri

[jira] [Created] (HUDI-1691) Enrich HDFS data importer

2021-03-15 Thread vinoyang (Jira)
vinoyang created HUDI-1691: -- Summary: Enrich HDFS data importer Key: HUDI-1691 URL: https://issues.apache.org/jira/browse/HUDI-1691 Project: Apache Hudi Issue Type: Improvement Components

[jira] [Closed] (HUDI-1684) Tweak hudi-flink-bundle module pom and re-organize the pacakges for hudi-flink module

2021-03-15 Thread vinoyang (Jira)
[ https://issues.apache.org/jira/browse/HUDI-1684?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] vinoyang closed HUDI-1684. -- Resolution: Done fc6c5f4285098d18cd7f6e81785f59e68a3b6862 > Tweak hudi-flink-bundle module pom and re-organ

[jira] [Assigned] (HUDI-1684) Tweak hudi-flink-bundle module pom and re-organize the pacakges for hudi-flink module

2021-03-15 Thread vinoyang (Jira)
[ https://issues.apache.org/jira/browse/HUDI-1684?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] vinoyang reassigned HUDI-1684: -- Assignee: Danny Chen > Tweak hudi-flink-bundle module pom and re-organize the pacakges for >

[jira] [Closed] (HUDI-1692) Bounded source for stream writer

2021-03-15 Thread vinoyang (Jira)
[ https://issues.apache.org/jira/browse/HUDI-1692?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] vinoyang closed HUDI-1692. -- Resolution: Done 76bf2cc790edc0be10dfa2454c42687c38e7e5fc > Bounded source for stream wri

[jira] [Closed] (HUDI-1693) Add document about HUDI Flink integration

2021-03-16 Thread vinoyang (Jira)
[ https://issues.apache.org/jira/browse/HUDI-1693?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] vinoyang closed HUDI-1693. -- Resolution: Done db9cb1c568d4180125dd654e815afa64fa2aeb2a > Add document about HUDI Flink integrat

[jira] [Closed] (HUDI-1701) Implement HoodieTableSource.explainSource for all kinds of pushing down

2021-03-17 Thread vinoyang (Jira)
[ https://issues.apache.org/jira/browse/HUDI-1701?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] vinoyang closed HUDI-1701. -- Resolution: Done 968488fa3a3c67962ed5b60e00836e71c730a9a5 > Implement HoodieTableSource.explainSource for

[jira] [Closed] (HUDI-1704) Use PRIMARY KEY syntax to define record keys for Flink Hudi table

2021-03-18 Thread vinoyang (Jira)
[ https://issues.apache.org/jira/browse/HUDI-1704?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] vinoyang closed HUDI-1704. -- Resolution: Done f1e0018f12b66770ba3785be7aa8f5f6a80bab6f > Use PRIMARY KEY syntax to define record keys

[jira] [Closed] (HUDI-1705) Flush as per data bucket for mini-batch write

2021-03-19 Thread vinoyang (Jira)
[ https://issues.apache.org/jira/browse/HUDI-1705?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] vinoyang closed HUDI-1705. -- Resolution: Done f74828fca10ca5539c1aaad2c5e99bb1ddb373c5 > Flush as per data bucket for mini-batch wr

[jira] [Updated] (HUDI-708) Add unit test for TempViewCommand

2020-07-22 Thread vinoyang (Jira)
[ https://issues.apache.org/jira/browse/HUDI-708?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] vinoyang updated HUDI-708: -- Status: Open (was: New) > Add unit test for TempViewComm

[jira] [Closed] (HUDI-708) Add unit test for TempViewCommand

2020-07-22 Thread vinoyang (Jira)
[ https://issues.apache.org/jira/browse/HUDI-708?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] vinoyang closed HUDI-708. - Fix Version/s: 0.6.0 Resolution: Implemented Implemented via master branch

[jira] [Updated] (HUDI-1037) Introduce a write committed callback hook

2020-07-23 Thread vinoyang (Jira)
[ https://issues.apache.org/jira/browse/HUDI-1037?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] vinoyang updated HUDI-1037: --- Status: Open (was: New) > Introduce a write committed callback h

[jira] [Closed] (HUDI-1037) Introduce a write committed callback hook

2020-07-23 Thread vinoyang (Jira)
[ https://issues.apache.org/jira/browse/HUDI-1037?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] vinoyang closed HUDI-1037. -- Fix Version/s: 0.6.0 Resolution: Done Done via master branch: da106803b6d0bdbb37f22b9bd73b9b3a77f77063

[jira] [Commented] (HUDI-995) Organize test utils methods and classes

2020-07-27 Thread vinoyang (Jira)
[ https://issues.apache.org/jira/browse/HUDI-995?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17165635#comment-17165635 ] vinoyang commented on HUDI-995: --- [~rxu] Does this ticket still contain other unfinished

[jira] [Updated] (HUDI-703) Add unit test for HoodieSyncCommand

2020-07-27 Thread vinoyang (Jira)
[ https://issues.apache.org/jira/browse/HUDI-703?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] vinoyang updated HUDI-703: -- Status: Open (was: New) > Add unit test for HoodieSyncComm

[jira] [Resolved] (HUDI-703) Add unit test for HoodieSyncCommand

2020-07-27 Thread vinoyang (Jira)
[ https://issues.apache.org/jira/browse/HUDI-703?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] vinoyang resolved HUDI-703. --- Fix Version/s: 0.6.0 Resolution: Done Done via master branch: fa419213f62d2006aeea228180302024977feb16

[jira] [Commented] (HUDI-995) Organize test utils methods and classes

2020-08-01 Thread vinoyang (Jira)
[ https://issues.apache.org/jira/browse/HUDI-995?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17169290#comment-17169290 ] vinoyang commented on HUDI-995: --- [~rxu] if the work of this ticket has been finished, pl

[jira] [Closed] (HUDI-1151) Fix NPE when no new data in kafka using HoodieDeltaStreamer

2020-08-06 Thread vinoyang (Jira)
[ https://issues.apache.org/jira/browse/HUDI-1151?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] vinoyang closed HUDI-1151. -- Resolution: Fixed Fixed via master branch: b51646dcc76acc68e97dd6a67cc7557e362b590d > Fix NPE when no new d

[jira] [Updated] (HUDI-1121) Provide a document describing how to use callback

2020-08-10 Thread vinoyang (Jira)
[ https://issues.apache.org/jira/browse/HUDI-1121?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] vinoyang updated HUDI-1121: --- Status: Open (was: New) > Provide a document describing how to use callb

[jira] [Closed] (HUDI-1121) Provide a document describing how to use callback

2020-08-10 Thread vinoyang (Jira)
[ https://issues.apache.org/jira/browse/HUDI-1121?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] vinoyang closed HUDI-1121. -- Resolution: Done Done via asf-site branch: a6f991c4c2d72166fe8c898b6f63bb1d16ccd7a0 > Provide a docum

[jira] [Commented] (HUDI-1192) Fix the failure of creating hive database

2020-08-16 Thread vinoyang (Jira)
[ https://issues.apache.org/jira/browse/HUDI-1192?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17178672#comment-17178672 ] vinoyang commented on HUDI-1192: [~liujinhui] Please describe the title of the issue

[jira] [Updated] (HUDI-1206) Remove unused variable in Compactor

2020-08-20 Thread vinoyang (Jira)
[ https://issues.apache.org/jira/browse/HUDI-1206?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] vinoyang updated HUDI-1206: --- Status: Open (was: New) > Remove unused variable in Compac

[jira] [Closed] (HUDI-1206) Remove unused variable in Compactor

2020-08-20 Thread vinoyang (Jira)
[ https://issues.apache.org/jira/browse/HUDI-1206?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] vinoyang closed HUDI-1206. -- Resolution: Done Done via master branch: bd7814dadf9f6f5faa5b9ab61ff5f6bbfe5da5e2 > Remove unused variable

[jira] [Updated] (HUDI-1122) Introduce a kafka implementation of hoodie write commit callback

2020-08-20 Thread vinoyang (Jira)
[ https://issues.apache.org/jira/browse/HUDI-1122?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] vinoyang updated HUDI-1122: --- Issue Type: New Feature (was: Task) > Introduce a kafka implementation of hoodie write commit callb

[jira] [Closed] (HUDI-1122) Introduce a kafka implementation of hoodie write commit callback

2020-08-20 Thread vinoyang (Jira)
[ https://issues.apache.org/jira/browse/HUDI-1122?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] vinoyang closed HUDI-1122. -- Resolution: Implemented Implemented via master branch: b883b6d2682a3043eaf263c86182b19922660fd9 > Introduc

[jira] [Updated] (HUDI-1186) Add description of write commit callback by kafka to document

2020-08-22 Thread vinoyang (Jira)
[ https://issues.apache.org/jira/browse/HUDI-1186?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] vinoyang updated HUDI-1186: --- Status: Open (was: New) > Add description of write commit callback by kafka to docum

[jira] [Closed] (HUDI-1186) Add description of write commit callback by kafka to document

2020-08-22 Thread vinoyang (Jira)
[ https://issues.apache.org/jira/browse/HUDI-1186?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] vinoyang closed HUDI-1186. -- Resolution: Done Done via master branch: ce51638a434a40bc50a8f7ae64b8fce00ad98817 > Add description of wr

[jira] [Assigned] (HUDI-1216) Create chinese version of pyspark quickstart example

2020-08-23 Thread vinoyang (Jira)
[ https://issues.apache.org/jira/browse/HUDI-1216?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] vinoyang reassigned HUDI-1216: -- Assignee: wangxianghu (was: vinoyang) > Create chinese version of pyspark quickstart exam

[jira] [Closed] (HUDI-1150) Fix unable to parse input partition field :1 exception when using TimestampBasedKeyGenerator

2020-08-23 Thread vinoyang (Jira)
[ https://issues.apache.org/jira/browse/HUDI-1150?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] vinoyang closed HUDI-1150. -- Resolution: Fixed Fixed via master branch: 35b21855da209c812e006c1afff3d940d5ac2a18 > Fix unable to pa

[jira] [Updated] (HUDI-1217) Improve avroToBytes method of HoodieAvroUtils

2020-08-24 Thread vinoyang (Jira)
[ https://issues.apache.org/jira/browse/HUDI-1217?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] vinoyang updated HUDI-1217: --- Fix Version/s: 0.6.1 > Improve avroToBytes method of HoodieAvroUt

[jira] [Updated] (HUDI-1217) Improve avroToBytes method of HoodieAvroUtils

2020-08-24 Thread vinoyang (Jira)
[ https://issues.apache.org/jira/browse/HUDI-1217?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] vinoyang updated HUDI-1217: --- Status: Open (was: New) > Improve avroToBytes method of HoodieAvroUt

[jira] [Updated] (HUDI-1217) Improve avroToBytes method of HoodieAvroUtils

2020-08-24 Thread vinoyang (Jira)
[ https://issues.apache.org/jira/browse/HUDI-1217?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] vinoyang updated HUDI-1217: --- Issue Type: Improvement (was: Task) > Improve avroToBytes method of HoodieAvroUt

[jira] [Closed] (HUDI-1217) Improve avroToBytes method of HoodieAvroUtils

2020-08-24 Thread vinoyang (Jira)
[ https://issues.apache.org/jira/browse/HUDI-1217?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] vinoyang closed HUDI-1217. -- Resolution: Done Done via master branch: f8dcd5334effb0157cfa764c4f6a08976eb346e1 > Improve avroToBytes met

[jira] [Updated] (HUDI-1218) Introduce BulkInsertSortMode as Independent class

2020-08-25 Thread vinoyang (Jira)
[ https://issues.apache.org/jira/browse/HUDI-1218?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] vinoyang updated HUDI-1218: --- Status: Open (was: New) > Introduce BulkInsertSortMode as Independent cl

[jira] [Closed] (HUDI-1218) Introduce BulkInsertSortMode as Independent class

2020-08-25 Thread vinoyang (Jira)
[ https://issues.apache.org/jira/browse/HUDI-1218?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] vinoyang closed HUDI-1218. -- Resolution: Done Done via master branch: 6a4dc7384c8f7efbbce729b8e57b3eaaf5cab104 > Introd

[jira] [Assigned] (HUDI-1221) Ensure docker demo page reflects the latest support on all query engines

2020-08-25 Thread vinoyang (Jira)
[ https://issues.apache.org/jira/browse/HUDI-1221?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] vinoyang reassigned HUDI-1221: -- Assignee: wangxianghu (was: vinoyang) > Ensure docker demo page reflects the latest support on

[jira] [Updated] (HUDI-1223) Remove unused UpdateHandler class in HoodieCopyOnWriteTable

2020-08-25 Thread vinoyang (Jira)
[ https://issues.apache.org/jira/browse/HUDI-1223?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] vinoyang updated HUDI-1223: --- Issue Type: Improvement (was: Task) > Remove unused UpdateHandler class in HoodieCopyOnWriteTa

[jira] [Updated] (HUDI-1223) Remove unused UpdateHandler class in HoodieCopyOnWriteTable

2020-08-25 Thread vinoyang (Jira)
[ https://issues.apache.org/jira/browse/HUDI-1223?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] vinoyang updated HUDI-1223: --- Status: Open (was: New) > Remove unused UpdateHandler class in HoodieCopyOnWriteTa

[jira] [Closed] (HUDI-1223) Remove unused UpdateHandler class in HoodieCopyOnWriteTable

2020-08-25 Thread vinoyang (Jira)
[ https://issues.apache.org/jira/browse/HUDI-1223?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] vinoyang closed HUDI-1223. -- Resolution: Done Done via master branch: 7e68c42eb19bfe955217f0e8e25acbeb4a6974b5 > Remove unu

[jira] [Updated] (HUDI-1223) Remove unused UpdateHandler class in HoodieCopyOnWriteTable

2020-08-25 Thread vinoyang (Jira)
[ https://issues.apache.org/jira/browse/HUDI-1223?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] vinoyang updated HUDI-1223: --- Priority: Trivial (was: Major) > Remove unused UpdateHandler class in HoodieCopyOnWriteTa

[jira] [Updated] (HUDI-532) Add java doc for hudi test suite test classes

2020-08-25 Thread vinoyang (Jira)
[ https://issues.apache.org/jira/browse/HUDI-532?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] vinoyang updated HUDI-532: -- Priority: Minor (was: Major) > Add java doc for hudi test suite test clas

[jira] [Closed] (HUDI-532) Add java doc for hudi test suite test classes

2020-08-25 Thread vinoyang (Jira)
[ https://issues.apache.org/jira/browse/HUDI-532?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] vinoyang closed HUDI-532. - Fix Version/s: 0.6.1 Resolution: Done Done via asf-site branch: df8f099c999379038bf189491ff71dfb958806dd

[jira] [Updated] (HUDI-978) Specify version information for each component separately

2020-08-26 Thread vinoyang (Jira)
[ https://issues.apache.org/jira/browse/HUDI-978?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] vinoyang updated HUDI-978: -- Status: Open (was: New) > Specify version information for each component separat

[jira] [Closed] (HUDI-978) Specify version information for each component separately

2020-08-26 Thread vinoyang (Jira)
[ https://issues.apache.org/jira/browse/HUDI-978?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] vinoyang closed HUDI-978. - Resolution: Implemented Implemented via master branch: dedc4517dd7014af697169130f5a72c1e90469b7 > Specify vers

[jira] [Closed] (HUDI-531) Add java doc for hudi test suite general classes

2020-08-27 Thread vinoyang (Jira)
[ https://issues.apache.org/jira/browse/HUDI-531?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] vinoyang closed HUDI-531. - Resolution: Done Done via master branch: fa812482473f0cc8c2f34e2db07366cc3e5f7066 > Add java doc for hudi t

[jira] [Updated] (HUDI-531) Add java doc for hudi test suite general classes

2020-08-27 Thread vinoyang (Jira)
[ https://issues.apache.org/jira/browse/HUDI-531?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] vinoyang updated HUDI-531: -- Fix Version/s: 0.5.1 > Add java doc for hudi test suite general clas

[jira] [Commented] (HUDI-195) Bump jackson-databind to prevent deserialization loophole

2020-08-30 Thread vinoyang (Jira)
[ https://issues.apache.org/jira/browse/HUDI-195?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17187151#comment-17187151 ] vinoyang commented on HUDI-195: --- [~shivnarayan] Will verify the version. > Bump

[jira] [Created] (HUDI-1259) Cache some framework binaries to speed up the progress of build docker image in local env

2020-09-01 Thread vinoyang (Jira)
vinoyang created HUDI-1259: -- Summary: Cache some framework binaries to speed up the progress of build docker image in local env Key: HUDI-1259 URL: https://issues.apache.org/jira/browse/HUDI-1259 Project

[jira] [Closed] (HUDI-1282) Check whether the topic exists before deltastrmer consumes Kafka

2020-09-15 Thread vinoyang (Jira)
[ https://issues.apache.org/jira/browse/HUDI-1282?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] vinoyang closed HUDI-1282. -- Resolution: Fixed Fixed via master branch: 6c84ef20ac737087ed76c12b2f3e40d9c3aa4b30 > Check whether the to

[jira] [Updated] (HUDI-1282) Check whether the topic exists before deltastrmer consumes Kafka

2020-09-15 Thread vinoyang (Jira)
[ https://issues.apache.org/jira/browse/HUDI-1282?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] vinoyang updated HUDI-1282: --- Summary: Check whether the topic exists before deltastrmer consumes Kafka (was: Should check whether the

[jira] [Updated] (HUDI-1282) Check whether the topic exists before deltastrmer consumes Kafka

2020-09-15 Thread vinoyang (Jira)
[ https://issues.apache.org/jira/browse/HUDI-1282?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] vinoyang updated HUDI-1282: --- Fix Version/s: 0.6.1 > Check whether the topic exists before deltastrmer consumes Ka

[jira] [Updated] (HUDI-1282) Check whether the topic exists before deltastrmer consumes Kafka

2020-09-15 Thread vinoyang (Jira)
[ https://issues.apache.org/jira/browse/HUDI-1282?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] vinoyang updated HUDI-1282: --- Status: Open (was: New) > Check whether the topic exists before deltastrmer consumes Ka

[jira] [Commented] (HUDI-995) Organize test utils methods and classes

2020-09-17 Thread vinoyang (Jira)
[ https://issues.apache.org/jira/browse/HUDI-995?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17198065#comment-17198065 ] vinoyang commented on HUDI-995: --- bq. Working on the 3rd point in the description. After

[jira] [Closed] (HUDI-796) Rewrite DedupeSparkJob.scala without considering the _hoodie_commit_time

2020-09-18 Thread vinoyang (Jira)
[ https://issues.apache.org/jira/browse/HUDI-796?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] vinoyang closed HUDI-796. - Fix Version/s: 0.6.1 Resolution: Done Done via master branch: 73e5b4c7bbd1306a6a2686f6e8d85a2c871ac7ff

[jira] [Closed] (HUDI-769) Write blog about HoodieMultiTableDeltaStreamer in cwiki

2020-09-18 Thread vinoyang (Jira)
[ https://issues.apache.org/jira/browse/HUDI-769?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] vinoyang closed HUDI-769. - Resolution: Done Done via asf-site branch: d5f3f65df714abd980f59167e4766b4fab69dd72 > Write blog ab

[jira] [Commented] (HUDI-995) Organize test utils methods and classes

2020-09-19 Thread vinoyang (Jira)
[ https://issues.apache.org/jira/browse/HUDI-995?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17198693#comment-17198693 ] vinoyang commented on HUDI-995: --- As you mentioned before, can we close this umbrella i

[jira] [Updated] (HUDI-1259) Cache some framework binaries to speed up the progress of build docker image in local env

2020-09-20 Thread vinoyang (Jira)
[ https://issues.apache.org/jira/browse/HUDI-1259?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] vinoyang updated HUDI-1259: --- Status: Open (was: New) > Cache some framework binaries to speed up the progress of build docker image &

[jira] [Closed] (HUDI-1259) Cache some framework binaries to speed up the progress of build docker image in local env

2020-09-20 Thread vinoyang (Jira)
[ https://issues.apache.org/jira/browse/HUDI-1259?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] vinoyang closed HUDI-1259. -- Resolution: Not A Problem Hudi has mounted its workspace into docker. So it has supported this feature

[jira] [Commented] (HUDI-995) Organize test utils methods and classes

2020-09-20 Thread vinoyang (Jira)
[ https://issues.apache.org/jira/browse/HUDI-995?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17199174#comment-17199174 ] vinoyang commented on HUDI-995: --- [~xushiyan] OK, will delay until you finish it > O

[jira] [Closed] (HUDI-1192) Make create hive database automatically configurable

2020-09-26 Thread vinoyang (Jira)
[ https://issues.apache.org/jira/browse/HUDI-1192?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] vinoyang closed HUDI-1192. -- Resolution: Implemented Implemented via master branch: a86f5574ed68333f03165ae560a4d88812ba7478 > Make cre

[jira] [Updated] (HUDI-1192) Make create hive database automatically configurable

2020-09-26 Thread vinoyang (Jira)
[ https://issues.apache.org/jira/browse/HUDI-1192?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] vinoyang updated HUDI-1192: --- Issue Type: Improvement (was: Bug) > Make create hive database automatically configura

[jira] [Updated] (HUDI-1233) deltastreamer Kafka consumption delay reporting indicators

2020-09-28 Thread vinoyang (Jira)
[ https://issues.apache.org/jira/browse/HUDI-1233?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] vinoyang updated HUDI-1233: --- Fix Version/s: 0.6.1 > deltastreamer Kafka consumption delay reporting indicat

[jira] [Closed] (HUDI-1233) deltastreamer Kafka consumption delay reporting indicators

2020-09-28 Thread vinoyang (Jira)
[ https://issues.apache.org/jira/browse/HUDI-1233?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] vinoyang closed HUDI-1233. -- Resolution: Implemented Implemented via master branch: 20b9b399c980270afdd60cc5fbce783c700a8376

[jira] [Closed] (HUDI-1495) Bump Flink version to 1.12.0

2021-03-25 Thread vinoyang (Jira)
[ https://issues.apache.org/jira/browse/HUDI-1495?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] vinoyang closed HUDI-1495. -- Resolution: Done 8b774fe3313757a8b94ca408079327c62b4a664c > Bump Flink version to 1.1

[jira] [Closed] (HUDI-1729) Asynchronous Hive sync and commits cleaning for Flink writer

2021-03-28 Thread vinoyang (Jira)
[ https://issues.apache.org/jira/browse/HUDI-1729?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] vinoyang closed HUDI-1729. -- Resolution: Done d415d45416707ca4d5b1dbad65dc80e6fccfa378 > Asynchronous Hive sync and commits cleaning

[jira] [Assigned] (HUDI-1731) Rename UpsertPartitioner in both hudi-java-client and hudi-spark-client to differentiate them from each other

2021-03-29 Thread vinoyang (Jira)
[ https://issues.apache.org/jira/browse/HUDI-1731?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] vinoyang reassigned HUDI-1731: -- Assignee: Leo Zhu > Rename UpsertPartitioner in both hudi-java-client and hudi-spark-client

[jira] [Commented] (HUDI-1731) Rename UpsertPartitioner in both hudi-java-client and hudi-spark-client to differentiate them from each other

2021-03-29 Thread vinoyang (Jira)
[ https://issues.apache.org/jira/browse/HUDI-1731?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17310530#comment-17310530 ] vinoyang commented on HUDI-1731: [~pandaman1984] Thanks for reporting this issue. I

[jira] [Created] (HUDI-1735) hudi-examples missed MapredParquetInputFormat class

2021-03-29 Thread vinoyang (Jira)
vinoyang created HUDI-1735: -- Summary: hudi-examples missed MapredParquetInputFormat class Key: HUDI-1735 URL: https://issues.apache.org/jira/browse/HUDI-1735 Project: Apache Hudi Issue Type: Bug

[jira] [Updated] (HUDI-1731) Rename UpsertPartitioner in both hudi-java-client and hudi-spark-client to differentiate them from each other

2021-03-30 Thread vinoyang (Jira)
[ https://issues.apache.org/jira/browse/HUDI-1731?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] vinoyang updated HUDI-1731: --- Status: Closed (was: Patch Available) > Rename UpsertPartitioner in both hudi-java-client and hudi-sp

[jira] [Reopened] (HUDI-1731) Rename UpsertPartitioner in both hudi-java-client and hudi-spark-client to differentiate them from each other

2021-03-30 Thread vinoyang (Jira)
[ https://issues.apache.org/jira/browse/HUDI-1731?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] vinoyang reopened HUDI-1731: > Rename UpsertPartitioner in both hudi-java-client and hudi-spark-client to > differentiate them fro

[jira] [Closed] (HUDI-1731) Rename UpsertPartitioner in both hudi-java-client and hudi-spark-client to differentiate them from each other

2021-03-30 Thread vinoyang (Jira)
[ https://issues.apache.org/jira/browse/HUDI-1731?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] vinoyang closed HUDI-1731. -- Fix Version/s: 0.9.0 Resolution: Done 8bc65b93189e249be43fe6cba2387ca83babc2c8 > Ren

[jira] [Closed] (HUDI-1738) Emit deletes for Flink MOR table streaming read

2021-04-01 Thread vinoyang (Jira)
[ https://issues.apache.org/jira/browse/HUDI-1738?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] vinoyang closed HUDI-1738. -- Resolution: Implemented 9804662bc8e17d6936c20326f17ec7c0360dcaf6 > Emit deletes for Flink MOR table stream

[jira] [Closed] (HUDI-1737) Extract common method in HoodieCreateHandle & FlinkCreateHandle

2021-04-01 Thread vinoyang (Jira)
[ https://issues.apache.org/jira/browse/HUDI-1737?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] vinoyang closed HUDI-1737. -- Resolution: Done 94a5e72f16620da86bd2ca7ef27bb9abc266cc47 > Extract common method in HoodieCreateHan

[jira] [Updated] (HUDI-1737) Extract common method in HoodieCreateHandle & FlinkCreateHandle

2021-04-01 Thread vinoyang (Jira)
[ https://issues.apache.org/jira/browse/HUDI-1737?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] vinoyang updated HUDI-1737: --- Fix Version/s: 0.9.0 > Extract common method in HoodieCreateHandle & FlinkCreat

[jira] [Updated] (HUDI-1757) Assigns the buckets by record key for Flink writer

2021-04-06 Thread vinoyang (Jira)
[ https://issues.apache.org/jira/browse/HUDI-1757?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] vinoyang updated HUDI-1757: --- Fix Version/s: 0.9.0 > Assigns the buckets by record key for Flink wri

[jira] [Closed] (HUDI-1757) Assigns the buckets by record key for Flink writer

2021-04-06 Thread vinoyang (Jira)
[ https://issues.apache.org/jira/browse/HUDI-1757?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] vinoyang closed HUDI-1757. -- Resolution: Done 9c369c607df2816ea2cd1221fb6d879e3fb8f74c > Assigns the buckets by record key for Flink wri

[jira] [Commented] (HUDI-1767) Add setter to HoodieKey and HoodieRecordLocation to have better SE/DE performance for Flink

2021-04-06 Thread vinoyang (Jira)
[ https://issues.apache.org/jira/browse/HUDI-1767?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17315994#comment-17315994 ] vinoyang commented on HUDI-1767: [~hiscat] I have given you Jira contributor permis

[jira] [Closed] (HUDI-1767) Add setter to HoodieKey and HoodieRecordLocation to have better SE/DE performance for Flink

2021-04-06 Thread vinoyang (Jira)
[ https://issues.apache.org/jira/browse/HUDI-1767?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] vinoyang closed HUDI-1767. -- Resolution: Fixed d035fcbb3cf7aa33bafdd902a5e6a76f549e7ee1 > Add setter to HoodieKey and HoodieRecordLocat

[jira] [Assigned] (HUDI-1767) Add setter to HoodieKey and HoodieRecordLocation to have better SE/DE performance for Flink

2021-04-06 Thread vinoyang (Jira)
[ https://issues.apache.org/jira/browse/HUDI-1767?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] vinoyang reassigned HUDI-1767: -- Assignee: 谢波 > Add setter to HoodieKey and HoodieRecordLocation to have better SE/DE > perfo

[jira] [Closed] (HUDI-1772) HoodieFileGroupId compareTo logical error(fileId self compare)

2021-04-07 Thread vinoyang (Jira)
[ https://issues.apache.org/jira/browse/HUDI-1772?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] vinoyang closed HUDI-1772. -- Resolution: Fixed f4f9dd9d83a6a852c0e733802c6c49747cde5531 > HoodieFileGroupId compareTo logical error(fil

[jira] [Updated] (HUDI-1773) HoodieFileGroup code optimize

2021-04-07 Thread vinoyang (Jira)
[ https://issues.apache.org/jira/browse/HUDI-1773?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] vinoyang updated HUDI-1773: --- Fix Version/s: 0.9.0 > HoodieFileGroup code optimize > - > >

[jira] [Closed] (HUDI-1773) HoodieFileGroup code optimize

2021-04-07 Thread vinoyang (Jira)
[ https://issues.apache.org/jira/browse/HUDI-1773?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] vinoyang closed HUDI-1773. -- Resolution: Done 3a926aacf6552fc06005db4a7880a233db904330 > HoodieFileGroup code optim

[jira] [Updated] (HUDI-699) Add unit test for CompactionCommand

2021-04-08 Thread vinoyang (Jira)
[ https://issues.apache.org/jira/browse/HUDI-699?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] vinoyang updated HUDI-699: -- Fix Version/s: 0.9.0 > Add unit test for CompactionComm

[jira] [Updated] (HUDI-699) Add unit test for CompactionCommand

2021-04-08 Thread vinoyang (Jira)
[ https://issues.apache.org/jira/browse/HUDI-699?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] vinoyang updated HUDI-699: -- Status: Open (was: New) > Add unit test for CompactionComm

[jira] [Closed] (HUDI-699) Add unit test for CompactionCommand

2021-04-08 Thread vinoyang (Jira)
[ https://issues.apache.org/jira/browse/HUDI-699?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] vinoyang closed HUDI-699. - Resolution: Done ecdbd2517fd8157d9e96f3d9abf195a589e191ae > Add unit test for CompactionComm

[jira] [Updated] (HUDI-1778) Add setter to CompactionPlanEvent and CompactionCommitEvent to have better SE/DE performance for Flink

2021-04-08 Thread vinoyang (Jira)
[ https://issues.apache.org/jira/browse/HUDI-1778?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] vinoyang updated HUDI-1778: --- Fix Version/s: 0.9.0 > Add setter to CompactionPlanEvent and CompactionCommitEvent to have better >

[jira] [Closed] (HUDI-1778) Add setter to CompactionPlanEvent and CompactionCommitEvent to have better SE/DE performance for Flink

2021-04-08 Thread vinoyang (Jira)
[ https://issues.apache.org/jira/browse/HUDI-1778?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] vinoyang closed HUDI-1778. -- Resolution: Done 5b3608f14951e3aaf4ef7b5238bf32f524c24bb0 > Add setter to CompactionPlanEvent

[jira] [Updated] (HUDI-1775) Add option for compaction parallelism

2021-04-08 Thread vinoyang (Jira)
[ https://issues.apache.org/jira/browse/HUDI-1775?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] vinoyang updated HUDI-1775: --- Fix Version/s: 0.9.0 > Add option for compaction parallel

[jira] [Assigned] (HUDI-1775) Add option for compaction parallelism

2021-04-08 Thread vinoyang (Jira)
[ https://issues.apache.org/jira/browse/HUDI-1775?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] vinoyang reassigned HUDI-1775: -- Assignee: Danny Chen > Add option for compaction parallel

[jira] [Closed] (HUDI-1775) Add option for compaction parallelism

2021-04-08 Thread vinoyang (Jira)
[ https://issues.apache.org/jira/browse/HUDI-1775?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] vinoyang closed HUDI-1775. -- Resolution: Done 6786581c4842e47e1a8a8e942f54003dc151c7c6 > Add option for compaction parallel

[jira] [Updated] (HUDI-1783) Support Huawei Cloud Object Storage

2021-04-09 Thread vinoyang (Jira)
[ https://issues.apache.org/jira/browse/HUDI-1783?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] vinoyang updated HUDI-1783: --- Summary: Support Huawei Cloud Object Storage (was: support Huawei Cloud Object Storage) > Support Hua

<    2   3   4   5   6   7   8   9   10   11   >