[jira] [Closed] (HUDI-245) Refactor code references that call HoodieTimeline.getInstants() and reverse to directly use method HoodieTimeline.getReverseOrderedInstants

2019-11-07 Thread leesf (Jira)
[ https://issues.apache.org/jira/browse/HUDI-245?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] leesf closed HUDI-245. -- Fix Version/s: 0.5.1 Resolution: Fixed Fixed via master: 0863b1cfd947402c66221afa8d1f18fd2bd8273b > Refactor

[jira] [Commented] (HUDI-354) Introduce stricter comment and code style validation rules

2019-11-21 Thread leesf (Jira)
[ https://issues.apache.org/jira/browse/HUDI-354?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16979225#comment-16979225 ] leesf commented on HUDI-354: I verified in my local dev. If set_ severity_ property to _info_, the checkstyle

[jira] [Reopened] (HUDI-350) Update javadocs in HoodieCleanHelper to reflect correct defaults for retained commits

2019-11-21 Thread leesf (Jira)
[ https://issues.apache.org/jira/browse/HUDI-350?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] leesf reopened HUDI-350: > Update javadocs in HoodieCleanHelper to reflect correct defaults for retained > commits >

[jira] [Closed] (HUDI-350) Update javadocs in HoodieCleanHelper to reflect correct defaults for retained commits

2019-11-21 Thread leesf (Jira)
[ https://issues.apache.org/jira/browse/HUDI-350?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] leesf closed HUDI-350. -- Fix Version/s: 0.5.1 Resolution: Fixed > Update javadocs in HoodieCleanHelper to reflect correct defaults for

[jira] [Comment Edited] (HUDI-350) Update javadocs in HoodieCleanHelper to reflect correct defaults for retained commits

2019-11-21 Thread leesf (Jira)
[ https://issues.apache.org/jira/browse/HUDI-350?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16979258#comment-16979258 ] leesf edited comment on HUDI-350 at 11/21/19 1:05 PM: -- Fixed(reopen and close)

[jira] [Commented] (HUDI-350) Update javadocs in HoodieCleanHelper to reflect correct defaults for retained commits

2019-11-21 Thread leesf (Jira)
[ https://issues.apache.org/jira/browse/HUDI-350?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16979258#comment-16979258 ] leesf commented on HUDI-350: Fixed [~Pratyaksh] and thanks for your contributing. > Update javadocs in

[jira] [Commented] (HUDI-354) Introduce stricter comment and code style validation rules

2019-11-21 Thread leesf (Jira)
[ https://issues.apache.org/jira/browse/HUDI-354?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16979227#comment-16979227 ] leesf commented on HUDI-354: Also, when we fix the comment error, should we also fix some semantic errors of

[jira] [Commented] (HUDI-350) Update javadocs in HoodieCleanHelper to reflect correct defaults for retained commits

2019-11-21 Thread leesf (Jira)
[ https://issues.apache.org/jira/browse/HUDI-350?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16979243#comment-16979243 ] leesf commented on HUDI-350: [~Pratyaksh][~vbalaji], Hi, I think we had better mark the jira resolved instead

[jira] [Commented] (HUDI-288) Add support for ingesting multiple kafka streams in a single DeltaStreamer deployment

2019-12-02 Thread leesf (Jira)
[ https://issues.apache.org/jira/browse/HUDI-288?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16986680#comment-16986680 ] leesf commented on HUDI-288: > Thank you for letting me drive this work. I was thinking if we should add >

[jira] [Commented] (HUDI-233) Redo log statements using SLF4J

2019-12-03 Thread leesf (Jira)
[ https://issues.apache.org/jira/browse/HUDI-233?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16986863#comment-16986863 ] leesf commented on HUDI-233: Is the time to start the work? [~vinoth] > Redo log statements using SLF4J >

[jira] [Closed] (HUDI-355) Refactor hudi-common based on new comment and code style rules

2019-12-08 Thread leesf (Jira)
[ https://issues.apache.org/jira/browse/HUDI-355?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] leesf closed HUDI-355. -- Fix Version/s: 0.5.1 Resolution: Fixed Fixed via master: 84602c888298e70ea5e64029c14e862172d32f99 > Refactor

[jira] [Commented] (HUDI-395) hudi does not support scheme s3n when wrtiing to S3

2019-12-09 Thread leesf (Jira)
[ https://issues.apache.org/jira/browse/HUDI-395?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16992040#comment-16992040 ] leesf commented on HUDI-395: Hi, thanks for reporting this, right now, s3n is not supported yet, s3 and s3a is

[jira] [Closed] (HUDI-368) Code clean up in TestAsyncCompaction class

2019-12-10 Thread leesf (Jira)
[ https://issues.apache.org/jira/browse/HUDI-368?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] leesf closed HUDI-368. -- Resolution: Fixed Fixed via master: 3790b75e059a06e6f5467c8b8d549ef38cd6b98a > Code clean up in TestAsyncCompaction

[jira] [Closed] (HUDI-390) Hive Sync should support keywords are table names

2019-12-10 Thread leesf (Jira)
[ https://issues.apache.org/jira/browse/HUDI-390?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] leesf closed HUDI-390. -- Resolution: Fixed Fixed via master: 8df4b83017f74173b8289ab50b0f723a38e8eebe > Hive Sync should support keywords are

[jira] [Commented] (HUDI-410) HFile inlining into the log file

2019-12-13 Thread leesf (Jira)
[ https://issues.apache.org/jira/browse/HUDI-410?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16996218#comment-16996218 ] leesf commented on HUDI-410: Hi [~nagarwal], any more context here? > HFile inlining into the log file >

[jira] [Commented] (HUDI-409) Replace Log Magic header with a secure hash to avoid clashes with data

2019-12-13 Thread leesf (Jira)
[ https://issues.apache.org/jira/browse/HUDI-409?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16996221#comment-16996221 ] leesf commented on HUDI-409: A hash code for all files? how about generating hash with Apache HUDI? > Replace

[jira] [Updated] (HUDI-398) Add set env for spark launcher

2019-12-13 Thread leesf (Jira)
[ https://issues.apache.org/jira/browse/HUDI-398?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] leesf updated HUDI-398: --- Status: Closed (was: Patch Available) > Add set env for spark launcher > -- > >

[jira] [Closed] (HUDI-398) Add set env for spark launcher

2019-12-13 Thread leesf (Jira)
[ https://issues.apache.org/jira/browse/HUDI-398?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] leesf closed HUDI-398. -- Resolution: Fixed Fixed via master: 8963a68e6a3f4875de6787dfc206543e9ca824d9 > Add set env for spark launcher >

[jira] [Reopened] (HUDI-398) Add set env for spark launcher

2019-12-13 Thread leesf (Jira)
[ https://issues.apache.org/jira/browse/HUDI-398?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] leesf reopened HUDI-398: > Add set env for spark launcher > -- > > Key: HUDI-398 >

[jira] [Commented] (HUDI-331) Fix java docs for all public apis (HoodieWriteClient)

2019-12-16 Thread leesf (Jira)
[ https://issues.apache.org/jira/browse/HUDI-331?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16997800#comment-16997800 ] leesf commented on HUDI-331: [~hongdongdong] Thanks. > Fix java docs for all public apis (HoodieWriteClient) >

[jira] [Created] (HUDI-400) Add more checks to TestCompactionUtils#testUpgradeDowngrade

2019-12-11 Thread leesf (Jira)
leesf created HUDI-400: -- Summary: Add more checks to TestCompactionUtils#testUpgradeDowngrade Key: HUDI-400 URL: https://issues.apache.org/jira/browse/HUDI-400 Project: Apache Hudi (incubating) Issue

[jira] [Commented] (HUDI-322) DeltaSteamer should pick checkpoints off only deltacommits for MOR tables

2019-12-11 Thread leesf (Jira)
[ https://issues.apache.org/jira/browse/HUDI-322?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16993922#comment-16993922 ] leesf commented on HUDI-322: You are welcome.:) just do it. > DeltaSteamer should pick checkpoints off only

[jira] [Assigned] (HUDI-383) Introduce TransactionHandle abstraction to manage state transitions in hudi clients

2019-12-05 Thread leesf (Jira)
[ https://issues.apache.org/jira/browse/HUDI-383?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] leesf reassigned HUDI-383: -- Assignee: leesf > Introduce TransactionHandle abstraction to manage state transitions in hudi > clients >

[jira] [Closed] (HUDI-381) Refactor hudi-client based on new comment and code style rules

2019-12-06 Thread leesf (Jira)
[ https://issues.apache.org/jira/browse/HUDI-381?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] leesf closed HUDI-381. -- Resolution: Duplicate > Refactor hudi-client based on new comment and code style rules >

[jira] [Closed] (HUDI-294) Delete Paths written in Cleaner plan needs to be relative to partition-path

2019-12-03 Thread leesf (Jira)
[ https://issues.apache.org/jira/browse/HUDI-294?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] leesf closed HUDI-294. -- Resolution: Fixed Fixed via master: 98ab33bb6e1637d18c8fab7a9ddd50daeaf56962 > Delete Paths written in Cleaner plan

[jira] [Assigned] (HUDI-414) Refactor handling of layout version filters in active timeline

2019-12-15 Thread leesf (Jira)
[ https://issues.apache.org/jira/browse/HUDI-414?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] leesf reassigned HUDI-414: -- Assignee: leesf > Refactor handling of layout version filters in active timeline >

[jira] [Comment Edited] (HUDI-395) hudi does not support scheme s3n when wrtiing to S3

2019-12-09 Thread leesf (Jira)
[ https://issues.apache.org/jira/browse/HUDI-395?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16992040#comment-16992040 ] leesf edited comment on HUDI-395 at 12/10/19 1:39 AM: -- Hi, thanks for reporting this,

[jira] [Assigned] (HUDI-343) Create a DOAP File for Hudi

2019-12-11 Thread leesf (Jira)
[ https://issues.apache.org/jira/browse/HUDI-343?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] leesf reassigned HUDI-343: -- Assignee: leesf > Create a DOAP File for Hudi > --- > > Key: HUDI-343 >

[jira] [Commented] (HUDI-248) CLI doesn't allow rolling back a Delta commit

2019-12-11 Thread leesf (Jira)
[ https://issues.apache.org/jira/browse/HUDI-248?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16994055#comment-16994055 ] leesf commented on HUDI-248: hi [~rbhartia], do you have interest in working it? > CLI doesn't allow rolling

[jira] [Commented] (HUDI-343) Create a DOAP File for Hudi

2019-12-11 Thread leesf (Jira)
[ https://issues.apache.org/jira/browse/HUDI-343?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16994056#comment-16994056 ] leesf commented on HUDI-343: [~vinoth] I can help to work on it together with you. > Create a DOAP File for

[jira] [Commented] (HUDI-331) Fix java docs for all public apis (HoodieWriteClient)

2019-12-11 Thread leesf (Jira)
[ https://issues.apache.org/jira/browse/HUDI-331?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16994059#comment-16994059 ] leesf commented on HUDI-331: Hi [~shivnarayan], do you have interest working on it? > Fix java docs for all

[jira] [Commented] (HUDI-376) AWS Glue dependency issue for EMR 5.28.0

2019-12-11 Thread leesf (Jira)
[ https://issues.apache.org/jira/browse/HUDI-376?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16994048#comment-16994048 ] leesf commented on HUDI-376: [~XingXPan] Would you please send a PR to fix it? > AWS Glue dependency issue for

[jira] [Commented] (HUDI-304) Bring back spotless plugin

2019-12-11 Thread leesf (Jira)
[ https://issues.apache.org/jira/browse/HUDI-304?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16994051#comment-16994051 ] leesf commented on HUDI-304: [~vbalaji] Sorry for lately response maybe for the missing of notification. Will

[jira] [Assigned] (HUDI-304) Bring back spotless plugin

2019-12-11 Thread leesf (Jira)
[ https://issues.apache.org/jira/browse/HUDI-304?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] leesf reassigned HUDI-304: -- Assignee: leesf > Bring back spotless plugin > --- > > Key: HUDI-304 >

[jira] [Commented] (HUDI-312) Investigate recent flaky CI runs

2019-10-28 Thread leesf (Jira)
[ https://issues.apache.org/jira/browse/HUDI-312?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16961014#comment-16961014 ] leesf commented on HUDI-312: For vm crashes, the following information is useful.

[jira] [Commented] (HUDI-312) Investigate recent flaky CI runs

2019-10-28 Thread leesf (Jira)
[ https://issues.apache.org/jira/browse/HUDI-312?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16961205#comment-16961205 ] leesf commented on HUDI-312: Wil send a PR later today. > Investigate recent flaky CI runs >

[jira] [Closed] (HUDI-283) Look at spark-shell and ensure that auto-tune for memory for spillable map has sane defaults

2019-10-21 Thread leesf (Jira)
[ https://issues.apache.org/jira/browse/HUDI-283?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] leesf closed HUDI-283. -- Resolution: Fixed Fixed via master: dfdc0e40e1f85c49e580b31204621758e3d76ac5 > Look at spark-shell and ensure that

[jira] [Comment Edited] (HUDI-304) Bring back spotless plugin

2019-10-16 Thread leesf (Jira)
[ https://issues.apache.org/jira/browse/HUDI-304?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16952639#comment-16952639 ] leesf edited comment on HUDI-304 at 10/16/19 9:19 AM: -- [~vbalaji] got it. PS: I

[jira] [Commented] (HUDI-304) Bring back spotless plugin

2019-10-16 Thread leesf (Jira)
[ https://issues.apache.org/jira/browse/HUDI-304?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16952639#comment-16952639 ] leesf commented on HUDI-304: [~vbalaji] got it. > Bring back spotless plugin > --- >

[jira] [Commented] (HUDI-221) Translate concept page

2019-10-14 Thread leesf (Jira)
[ https://issues.apache.org/jira/browse/HUDI-221?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16951479#comment-16951479 ] leesf commented on HUDI-221: OK, please assign the ticket to me. > Translate concept page >

[jira] [Reopened] (HUDI-232) Implement sealing/unsealing for HoodieRecord class

2019-10-16 Thread leesf (Jira)
[ https://issues.apache.org/jira/browse/HUDI-232?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] leesf reopened HUDI-232: > Implement sealing/unsealing for HoodieRecord class > -- > >

[jira] [Closed] (HUDI-232) Implement sealing/unsealing for HoodieRecord class

2019-10-16 Thread leesf (Jira)
[ https://issues.apache.org/jira/browse/HUDI-232?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] leesf closed HUDI-232. -- Resolution: Fixed > Implement sealing/unsealing for HoodieRecord class >

[jira] [Commented] (HUDI-312) Investigate recent flaky CI runs

2019-10-24 Thread leesf (Jira)
[ https://issues.apache.org/jira/browse/HUDI-312?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16959125#comment-16959125 ] leesf commented on HUDI-312: I will invertigate the frequently VM exit crash error when get a circle. >

[jira] [Assigned] (HUDI-312) Investigate recent flaky CI runs

2019-10-29 Thread leesf (Jira)
[ https://issues.apache.org/jira/browse/HUDI-312?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] leesf reassigned HUDI-312: -- Assignee: leesf > Investigate recent flaky CI runs > > > Key:

[jira] [Commented] (HUDI-312) Investigate recent flaky CI runs

2019-10-29 Thread leesf (Jira)
[ https://issues.apache.org/jira/browse/HUDI-312?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16961772#comment-16961772 ] leesf commented on HUDI-312: On no output, I changed the

[jira] [Comment Edited] (HUDI-312) Investigate recent flaky CI runs

2019-10-29 Thread leesf (Jira)
[ https://issues.apache.org/jira/browse/HUDI-312?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16961772#comment-16961772 ] leesf edited comment on HUDI-312 at 10/29/19 7:50 AM: -- On no output, I changed the

[jira] [Commented] (HUDI-312) Investigate recent flaky CI runs

2019-10-28 Thread leesf (Jira)
[ https://issues.apache.org/jira/browse/HUDI-312?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16961627#comment-16961627 ] leesf commented on HUDI-312: another build error (No output has been received in the last 10m0s, this

[jira] [Commented] (HUDI-312) Investigate recent flaky CI runs

2019-10-29 Thread leesf (Jira)
[ https://issues.apache.org/jira/browse/HUDI-312?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16962467#comment-16962467 ] leesf commented on HUDI-312: Will provide a PR soon. Of cause it is suitable to open a new issue to track integ

[jira] [Closed] (HUDI-290) Normalize test class name of all test classes

2019-10-23 Thread leesf (Jira)
[ https://issues.apache.org/jira/browse/HUDI-290?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] leesf closed HUDI-290. -- Fix Version/s: 0.5.1 Resolution: Fixed Fixed via master: e4c91ed13f16e1d0d55d9d690395bb62ab2b4fa0 > Normalize

[jira] [Comment Edited] (HUDI-233) Redo log statements using SLF4J

2019-10-23 Thread leesf (Jira)
[ https://issues.apache.org/jira/browse/HUDI-233?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16958408#comment-16958408 ] leesf edited comment on HUDI-233 at 10/23/19 11:51 PM: --- [~shivnarayan] Thanks for

[jira] [Comment Edited] (HUDI-304) Bring back spotless plugin

2019-10-16 Thread leesf (Jira)
[ https://issues.apache.org/jira/browse/HUDI-304?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16953401#comment-16953401 ] leesf edited comment on HUDI-304 at 10/17/19 4:47 AM: -- yeah, of casuse wait for the

[jira] [Commented] (HUDI-304) Bring back spotless plugin

2019-10-16 Thread leesf (Jira)
[ https://issues.apache.org/jira/browse/HUDI-304?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16953401#comment-16953401 ] leesf commented on HUDI-304: of casuse wait for the release. > Bring back spotless plugin >

[jira] [Closed] (HUDI-273) Translate Documentation -> Writing Data page

2019-10-17 Thread leesf (Jira)
[ https://issues.apache.org/jira/browse/HUDI-273?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] leesf closed HUDI-273. -- Resolution: Fixed Fixed via asf-site: 9cd67ba81875d66c05a630e2948073ed33ec0548 > Translate Documentation -> Writing

[jira] [Closed] (HUDI-342) add pull request template for hudi project

2019-11-18 Thread leesf (Jira)
[ https://issues.apache.org/jira/browse/HUDI-342?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] leesf closed HUDI-342. -- Fix Version/s: 0.5.1 Resolution: Fixed Fixed via master: 66492498f702e9224da838d1869e9376111939ce > add pull

[jira] [Commented] (HUDI-288) Add support for ingesting multiple kafka streams in a single DeltaStreamer deployment

2019-11-20 Thread leesf (Jira)
[ https://issues.apache.org/jira/browse/HUDI-288?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16978324#comment-16978324 ] leesf commented on HUDI-288: > I think we can stick to the same whitelist/blacklist that Kafka itself uses? 

[jira] [Closed] (HUDI-346) Set allowMultipleEmptyLines property false for EmptyLineSeparator rule

2019-11-19 Thread leesf (Jira)
[ https://issues.apache.org/jira/browse/HUDI-346?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] leesf closed HUDI-346. -- Fix Version/s: 0.5.1 Resolution: Fixed Fixed via master: 804e348d0e8176ceced046fa9e87963907aecc38 > Set

[jira] [Closed] (HUDI-340) Increase Default max events to read from kafka source

2019-11-26 Thread leesf (Jira)
[ https://issues.apache.org/jira/browse/HUDI-340?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] leesf closed HUDI-340. -- Fix Version/s: 0.5.1 Resolution: Fixed Fixed via master: 2a4cfb47c76a0c8800d4998453ec356711807c83 > Increase

[jira] [Closed] (HUDI-327) Introduce "null" supporting KeyGenerator

2019-11-26 Thread leesf (Jira)
[ https://issues.apache.org/jira/browse/HUDI-327?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] leesf closed HUDI-327. -- Fix Version/s: 0.5.1 Resolution: Fixed Fixed via master: 60fed21dc7e4cb66b154ae9be77dfada0f3071a5 > Introduce

[jira] [Commented] (HUDI-288) Add support for ingesting multiple kafka streams in a single DeltaStreamer deployment

2019-11-26 Thread leesf (Jira)
[ https://issues.apache.org/jira/browse/HUDI-288?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16982492#comment-16982492 ] leesf commented on HUDI-288: [~Pratyaksh] Of cause and glad that you have implemented the similar wrapper, it

[jira] [Closed] (HUDI-348) Add Issue template for the project

2019-11-24 Thread leesf (Jira)
[ https://issues.apache.org/jira/browse/HUDI-348?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] leesf closed HUDI-348. -- Resolution: Fixed Fixed via master: 17eaf41c54411344916fdf4ace80163438e9bee2 > Add Issue template for the project >

[jira] [Closed] (HUDI-328) Add support for Delete api in HoodieWriteClient

2019-11-24 Thread leesf (Jira)
[ https://issues.apache.org/jira/browse/HUDI-328?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] leesf closed HUDI-328. -- Resolution: Fixed Fixed via master: c3355109b1fa8f3055a2ba57d6e2b49679581db5 > Add support for Delete api in

[jira] [Closed] (HUDI-345) Fix used deprecated function

2019-11-24 Thread leesf (Jira)
[ https://issues.apache.org/jira/browse/HUDI-345?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] leesf closed HUDI-345. -- Fix Version/s: 0.5.1 Resolution: Fixed Fixed via master: 7bc08cbfdce337ad980bb544ec9fc3dbdf9c > Fix used

[jira] [Commented] (HUDI-294) Delete Paths written in Cleaner plan needs to be relative to partition-path

2019-11-26 Thread leesf (Jira)
[ https://issues.apache.org/jira/browse/HUDI-294?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16983187#comment-16983187 ] leesf commented on HUDI-294: yeah, still working. > Delete Paths written in Cleaner plan needs to be relative

[jira] [Closed] (HUDI-357) Refactor hudi-cli based on new comment and code style rules

2019-12-01 Thread leesf (Jira)
[ https://issues.apache.org/jira/browse/HUDI-357?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] leesf closed HUDI-357. -- Fix Version/s: 0.5.1 Resolution: Fixed Fixed via master: 75132c139f0faf9ef68bb461b3a551238a377455 > Refactor

[jira] [Closed] (HUDI-374) Unable to generateUpdates in QuickstartUtils

2019-12-01 Thread leesf (Jira)
[ https://issues.apache.org/jira/browse/HUDI-374?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] leesf closed HUDI-374. -- Fix Version/s: 0.5.1 Resolution: Fixed Fixed via master: b65a897856259e7872e39a9e3e68661926592d7b > Unable to

[jira] [Closed] (HUDI-370) Refactor hudi-common based on new ImportOrder code style rule

2019-12-01 Thread leesf (Jira)
[ https://issues.apache.org/jira/browse/HUDI-370?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] leesf closed HUDI-370. -- Resolution: Fixed Fixed via master: 784e3ad0b65ce8f7e0de2e2935032fb2573d5a26 > Refactor hudi-common based on new

[jira] [Commented] (HUDI-288) Add support for ingesting multiple kafka streams in a single DeltaStreamer deployment

2019-12-02 Thread leesf (Jira)
[ https://issues.apache.org/jira/browse/HUDI-288?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16986433#comment-16986433 ] leesf commented on HUDI-288: Hi [~vinoth]. Since [~Pratyaksh] have completed most of the code, I would like to

[jira] [Closed] (HUDI-356) Sync translation and code in quickstart.cn and admin_guide.cn pages

2019-11-21 Thread leesf (Jira)
[ https://issues.apache.org/jira/browse/HUDI-356?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] leesf closed HUDI-356. -- Fix Version/s: 0.5.1 Resolution: Fixed Fix via asf-site: 46a1546259fcfb629a26508e829d3d3e4b9cee21 > Sync

[jira] [Closed] (HUDI-358) Add Java-doc and importOrder checkstyle rule

2019-11-25 Thread leesf (Jira)
[ https://issues.apache.org/jira/browse/HUDI-358?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] leesf closed HUDI-358. -- Fix Version/s: 0.5.1 Resolution: Fixed Fixed via master: 212282c8aaf623f451e3f72674ed4d3ed550602d > Add Java-doc

[jira] [Closed] (HUDI-359) Add hudi-env for hudi-cli module

2019-11-25 Thread leesf (Jira)
[ https://issues.apache.org/jira/browse/HUDI-359?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] leesf closed HUDI-359. -- Fix Version/s: 0.5.1 Resolution: Fixed Fixed via master: a7e07cd910425b5cfe9886677e780bfb2ae96c52 > Add hudi-env

[jira] [Closed] (HUDI-362) Adds a check for the existence of field

2019-11-25 Thread leesf (Jira)
[ https://issues.apache.org/jira/browse/HUDI-362?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] leesf closed HUDI-362. -- Fix Version/s: 0.5.1 Resolution: Fixed Fixed via master: 44823041a37601fed8163502272a8fcb7a5be45d > Adds a check

[jira] [Commented] (HUDI-288) Add support for ingesting multiple kafka streams in a single DeltaStreamer deployment

2019-11-28 Thread leesf (Jira)
[ https://issues.apache.org/jira/browse/HUDI-288?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16984368#comment-16984368 ] leesf commented on HUDI-288: Thanks for your sharing. Looks very comprehensive. I have some thoughts.

[jira] [Closed] (HUDI-209) Implement JMX metrics reporter

2019-11-28 Thread leesf (Jira)
[ https://issues.apache.org/jira/browse/HUDI-209?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] leesf closed HUDI-209. -- Fix Version/s: 0.5.1 Resolution: Fixed Fixed via master: 0b52ae3ac2685c5afa7821d663854b526b5a1cff > Implement

[jira] [Closed] (HUDI-277) Translate Documentation -> Performance page

2019-11-12 Thread leesf (Jira)
[ https://issues.apache.org/jira/browse/HUDI-277?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] leesf closed HUDI-277. -- Resolution: Fixed Fixed via asf-site: 747a1d4e21dd7900085b8cc0f695daa147727241 > Translate Documentation -> Performance

[jira] [Closed] (HUDI-255) Translate Talks & Powered By page

2019-09-22 Thread leesf (Jira)
[ https://issues.apache.org/jira/browse/HUDI-255?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] leesf closed HUDI-255. -- Resolution: Fixed Fixed via asf-site: 8cfe93700bba8cb3025babe9182e9ad63a7e1035 > Translate Talks & Powered By page >

[jira] [Commented] (HUDI-232) Implement sealing/unsealing for HoodieRecord class

2019-09-25 Thread leesf (Jira)
[ https://issues.apache.org/jira/browse/HUDI-232?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16937477#comment-16937477 ] leesf commented on HUDI-232: How about add seal and unseal methods to HoodieRecord? Error will thrown if

[jira] [Created] (HUDI-278) Translate Administering page

2019-09-24 Thread leesf (Jira)
leesf created HUDI-278: -- Summary: Translate Administering page Key: HUDI-278 URL: https://issues.apache.org/jira/browse/HUDI-278 Project: Apache Hudi (incubating) Issue Type: Sub-task

[jira] [Assigned] (HUDI-296) Explore use of spotless to auto fix formatting errors

2019-10-08 Thread leesf (Jira)
[ https://issues.apache.org/jira/browse/HUDI-296?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] leesf reassigned HUDI-296: -- Assignee: leesf > Explore use of spotless to auto fix formatting errors >

[jira] [Commented] (HUDI-292) Consume more entries from kafka than specified sourceLimit.

2019-10-07 Thread leesf (Jira)
[ https://issues.apache.org/jira/browse/HUDI-292?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16946383#comment-16946383 ] leesf commented on HUDI-292: `long toOffset = Math.min(toOffsetMax, range.untilOffset() +

[jira] [Commented] (HUDI-295) Do one-time cleanup of Hudi git history

2019-10-07 Thread leesf (Jira)
[ https://issues.apache.org/jira/browse/HUDI-295?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16946399#comment-16946399 ] leesf commented on HUDI-295: In order to clean up git history, it seems that we need rebase and force push

[jira] [Updated] (HUDI-300) Explore use of spotbugs to find bugs

2019-10-10 Thread leesf (Jira)
[ https://issues.apache.org/jira/browse/HUDI-300?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] leesf updated HUDI-300: --- Description: https://spotbugs.github.io/ https://github.com/apache/incubator-hudi/pull/945

[jira] [Closed] (HUDI-265) Failed to delete tmp dirs created in unit tests

2019-10-03 Thread leesf (Jira)
[ https://issues.apache.org/jira/browse/HUDI-265?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] leesf closed HUDI-265. -- Resolution: Fixed Fixed via master: 3dedc7e5fdd5f885915e81e47e110b845a905dbf > Failed to delete tmp dirs created in

[jira] [Created] (HUDI-292) Consume more entries from kafka than specified sourceLimit.

2019-10-04 Thread leesf (Jira)
leesf created HUDI-292: -- Summary: Consume more entries from kafka than specified sourceLimit. Key: HUDI-292 URL: https://issues.apache.org/jira/browse/HUDI-292 Project: Apache Hudi (incubating) Issue

[jira] [Closed] (HUDI-285) Implement HoodieStorageWriter based on actual file type

2019-10-04 Thread leesf (Jira)
[ https://issues.apache.org/jira/browse/HUDI-285?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] leesf closed HUDI-285. -- Resolution: Fixed Fixed via master: 7dd9c74b1bb28c3a934e46d560abbb4c5b6d4586 > Implement HoodieStorageWriter based on

[jira] [Commented] (HUDI-290) Normalize Test class name of HoodieWriteConfigTest

2019-10-03 Thread leesf (Jira)
[ https://issues.apache.org/jira/browse/HUDI-290?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16943558#comment-16943558 ] leesf commented on HUDI-290: +1 rename to TestHoodieWriteConfig, and i see many UTs start already start with

[jira] [Assigned] (HUDI-288) Add support for ingesting multiple kafka streams in a single DeltaStreamer deployment

2019-10-03 Thread leesf (Jira)
[ https://issues.apache.org/jira/browse/HUDI-288?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] leesf reassigned HUDI-288: -- Assignee: leesf > Add support for ingesting multiple kafka streams in a single DeltaStreamer > deployment >

[jira] [Comment Edited] (HUDI-290) Normalize Test class name of HoodieWriteConfigTest

2019-10-03 Thread leesf (Jira)
[ https://issues.apache.org/jira/browse/HUDI-290?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16943558#comment-16943558 ] leesf edited comment on HUDI-290 at 10/3/19 2:53 PM: - +1 rename to

[jira] [Closed] (HUDI-292) Consume more entries from kafka than specified sourceLimit.

2019-10-11 Thread leesf (Jira)
[ https://issues.apache.org/jira/browse/HUDI-292?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] leesf closed HUDI-292. -- Resolution: Fixed Fixed via master: e10e06918e4758917513c55f9bc02c35dad99128 > Consume more entries from kafka than

[jira] [Created] (HUDI-437) Support user-defined index

2019-12-17 Thread leesf (Jira)
leesf created HUDI-437: -- Summary: Support user-defined index Key: HUDI-437 URL: https://issues.apache.org/jira/browse/HUDI-437 Project: Apache Hudi (incubating) Issue Type: Improvement

[jira] [Closed] (HUDI-386) Refactor hudi scala checkstyle rules

2019-12-21 Thread leesf (Jira)
[ https://issues.apache.org/jira/browse/HUDI-386?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] leesf closed HUDI-386. -- Fix Version/s: 0.5.1 Resolution: Fixed Fixed via master: b284091783af44341f20af11825ea9b6e3ba23da > Refactor

[jira] [Updated] (HUDI-415) HoodieSparkSqlWriter Commit time not representing the Spark job starting time

2019-12-20 Thread leesf (Jira)
[ https://issues.apache.org/jira/browse/HUDI-415?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] leesf updated HUDI-415: --- Fix Version/s: 0.5.1 > HoodieSparkSqlWriter Commit time not representing the Spark job starting time >

[jira] [Assigned] (HUDI-93) Enforce semantics on HoodieRecordPayload to allow for a consistent instantiation of custom payloads via reflection

2019-12-25 Thread leesf (Jira)
[ https://issues.apache.org/jira/browse/HUDI-93?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] leesf reassigned HUDI-93: - Assignee: leesf > Enforce semantics on HoodieRecordPayload to allow for a consistent > instantiation of custom

[jira] [Assigned] (HUDI-248) CLI doesn't allow rolling back a Delta commit

2019-12-25 Thread leesf (Jira)
[ https://issues.apache.org/jira/browse/HUDI-248?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] leesf reassigned HUDI-248: -- Assignee: leesf > CLI doesn't allow rolling back a Delta commit > -

[jira] [Closed] (HUDI-211) Maintain Chinese docs for Hudi

2019-12-25 Thread leesf (Jira)
[ https://issues.apache.org/jira/browse/HUDI-211?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] leesf closed HUDI-211. -- Fix Version/s: 0.5.1 Resolution: Fixed > Maintain Chinese docs for Hudi > -- > >

[jira] [Closed] (HUDI-333) Improve page navigation using TOC

2019-12-25 Thread leesf (Jira)
[ https://issues.apache.org/jira/browse/HUDI-333?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] leesf closed HUDI-333. -- Fix Version/s: 0.5.1 Resolution: Fixed Fixed via asf-site: 1fd0439a84c65ae12e025a64b6e0a0087aa7295e > Improve

[jira] [Closed] (HUDI-380) Update IDE set up documentation for IDE related errors

2019-12-25 Thread leesf (Jira)
[ https://issues.apache.org/jira/browse/HUDI-380?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] leesf closed HUDI-380. -- Fix Version/s: 0.5.1 Resolution: Fixed Fixed via asf-site: 9e30add249bdadb6b94cf0ff0090c4eaac625d68 > Update IDE

[jira] [Assigned] (HUDI-67) Tool to convert sequence file based archived commits to log format #224

2019-12-25 Thread leesf (Jira)
[ https://issues.apache.org/jira/browse/HUDI-67?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] leesf reassigned HUDI-67: - Assignee: leesf > Tool to convert sequence file based archived commits to log format #224 >

[jira] [Closed] (HUDI-213) Add gem dependencies installation step for building doc description

2019-12-25 Thread leesf (Jira)
[ https://issues.apache.org/jira/browse/HUDI-213?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] leesf closed HUDI-213. -- Fix Version/s: 0.5.1 Resolution: Fixed Fixed via asf-site: 09525c1fb4e066e981047957e85bbefbd3b3ae91 > Add gem

[jira] [Assigned] (HUDI-427) Implement CLI support for performing bootstrap

2019-12-25 Thread leesf (Jira)
[ https://issues.apache.org/jira/browse/HUDI-427?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] leesf reassigned HUDI-427: -- Assignee: leesf > Implement CLI support for performing bootstrap >

[jira] [Closed] (HUDI-416) Improve hint information for Cli

2019-12-25 Thread leesf (Jira)
[ https://issues.apache.org/jira/browse/HUDI-416?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] leesf closed HUDI-416. -- Fix Version/s: 0.5.1 Resolution: Fixed Fixed via master: 8affdf8bcbb4c7b236283e97c3afad186d5b6a3e > Improve hint

<    1   2   3   4   5   6   7   8   >