[jira] [Created] (HUDI-1393) Add compaction action in archive command

2020-11-10 Thread hong dongdong (Jira)
hong dongdong created HUDI-1393: --- Summary: Add compaction action in archive command Key: HUDI-1393 URL: https://issues.apache.org/jira/browse/HUDI-1393 Project: Apache Hudi Issue Type: Bug

[jira] [Commented] (HUDI-487) Unit tests for hudi-cli

2020-08-30 Thread hong dongdong (Jira)
[ https://issues.apache.org/jira/browse/HUDI-487?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17187369#comment-17187369 ] hong dongdong commented on HUDI-487: [~shivnarayan]: yes, recently, I have been entangl

[jira] [Created] (HUDI-1176) Support log4j2 config

2020-08-10 Thread hong dongdong (Jira)
hong dongdong created HUDI-1176: --- Summary: Support log4j2 config Key: HUDI-1176 URL: https://issues.apache.org/jira/browse/HUDI-1176 Project: Apache Hudi Issue Type: Bug Components: T

[jira] [Updated] (HUDI-1085) Support specifies archived path in HoodieSparkSqlWriter

2020-07-10 Thread hong dongdong (Jira)
[ https://issues.apache.org/jira/browse/HUDI-1085?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] hong dongdong updated HUDI-1085: Description: The default archived path is '' before. Now, we can specifies archived path by overwri

[jira] [Updated] (HUDI-1085) Support specifies archived path in HoodieSparkSqlWriter

2020-07-10 Thread hong dongdong (Jira)
[ https://issues.apache.org/jira/browse/HUDI-1085?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] hong dongdong updated HUDI-1085: Summary: Support specifies archived path in HoodieSparkSqlWriter (was: Doc for archived commits com

[jira] [Updated] (HUDI-544) Archived commits command code cleanup

2020-07-10 Thread hong dongdong (Jira)
[ https://issues.apache.org/jira/browse/HUDI-544?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] hong dongdong updated HUDI-544: --- Summary: Archived commits command code cleanup (was: Adjust the read and write path of archive) > Arc

[jira] [Updated] (HUDI-1085) Doc for archived commits command code cleanup

2020-07-10 Thread hong dongdong (Jira)
[ https://issues.apache.org/jira/browse/HUDI-1085?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] hong dongdong updated HUDI-1085: Component/s: Release & Administrative > Doc for archived commits command code cleanup >

[jira] [Created] (HUDI-1085) Doc for archived commits command code cleanup

2020-07-10 Thread hong dongdong (Jira)
hong dongdong created HUDI-1085: --- Summary: Doc for archived commits command code cleanup Key: HUDI-1085 URL: https://issues.apache.org/jira/browse/HUDI-1085 Project: Apache Hudi Issue Type: Tas

[jira] [Commented] (HUDI-1033) Remove redundant CLI tests

2020-06-22 Thread hong dongdong (Jira)
[ https://issues.apache.org/jira/browse/HUDI-1033?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17141836#comment-17141836 ] hong dongdong commented on HUDI-1033: - [~vbalaji]: Somethings that I had not explained

[jira] [Commented] (HUDI-1033) Remove redundant CLI tests

2020-06-21 Thread hong dongdong (Jira)
[ https://issues.apache.org/jira/browse/HUDI-1033?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17141624#comment-17141624 ] hong dongdong commented on HUDI-1033: - Hi [~vbalaji] : as [~yanghua] said there is dif

[jira] [Created] (HUDI-1019) Clean refresh command in CLI

2020-06-10 Thread hong dongdong (Jira)
hong dongdong created HUDI-1019: --- Summary: Clean refresh command in CLI Key: HUDI-1019 URL: https://issues.apache.org/jira/browse/HUDI-1019 Project: Apache Hudi Issue Type: Improvement

[jira] [Created] (HUDI-989) Support long options for prepare_integration_suite

2020-06-02 Thread hong dongdong (Jira)
hong dongdong created HUDI-989: -- Summary: Support long options for prepare_integration_suite Key: HUDI-989 URL: https://issues.apache.org/jira/browse/HUDI-989 Project: Apache Hudi Issue Type: Su

[jira] [Updated] (HUDI-978) Specify version information for each component separately

2020-05-29 Thread hong dongdong (Jira)
[ https://issues.apache.org/jira/browse/HUDI-978?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] hong dongdong updated HUDI-978: --- Fix Version/s: 0.6.0 > Specify version information for each component separately > ---

[jira] [Created] (HUDI-978) Specify version information for each component separately

2020-05-29 Thread hong dongdong (Jira)
hong dongdong created HUDI-978: -- Summary: Specify version information for each component separately Key: HUDI-978 URL: https://issues.apache.org/jira/browse/HUDI-978 Project: Apache Hudi Issue

[jira] [Assigned] (HUDI-593) Use scala_version placeholder to replace scala version hard code e.g. 2.11

2020-05-28 Thread hong dongdong (Jira)
[ https://issues.apache.org/jira/browse/HUDI-593?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] hong dongdong reassigned HUDI-593: -- Assignee: hong dongdong > Use scala_version placeholder to replace scala version hard code e.g.

[jira] [Commented] (HUDI-859) Improve documentation around key generators

2020-05-24 Thread hong dongdong (Jira)
[ https://issues.apache.org/jira/browse/HUDI-859?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17115315#comment-17115315 ] hong dongdong commented on HUDI-859: [~Pratyaksh] I have been trapped by other things t

[jira] [Assigned] (HUDI-859) Improve documentation around key generators

2020-05-24 Thread hong dongdong (Jira)
[ https://issues.apache.org/jira/browse/HUDI-859?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] hong dongdong reassigned HUDI-859: -- Assignee: Pratyaksh Sharma (was: hong dongdong) > Improve documentation around key generators >

[jira] [Created] (HUDI-919) Run hudi-cli ITTest in docker.

2020-05-21 Thread hong dongdong (Jira)
hong dongdong created HUDI-919: -- Summary: Run hudi-cli ITTest in docker. Key: HUDI-919 URL: https://issues.apache.org/jira/browse/HUDI-919 Project: Apache Hudi (incubating) Issue Type: Improveme

[jira] [Updated] (HUDI-861) Add Github and Twitter Widget on Hudi's official website

2020-05-21 Thread hong dongdong (Jira)
[ https://issues.apache.org/jira/browse/HUDI-861?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] hong dongdong updated HUDI-861: --- Status: In Progress (was: Open) > Add Github and Twitter Widget on Hudi's official website > -

[jira] [Updated] (HUDI-861) Add Github and Twitter Widget on Hudi's official website

2020-05-21 Thread hong dongdong (Jira)
[ https://issues.apache.org/jira/browse/HUDI-861?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] hong dongdong updated HUDI-861: --- Status: Open (was: New) > Add Github and Twitter Widget on Hudi's official website > -

[jira] [Updated] (HUDI-706) Add unit test for SavepointsCommand

2020-05-20 Thread hong dongdong (Jira)
[ https://issues.apache.org/jira/browse/HUDI-706?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] hong dongdong updated HUDI-706: --- Status: Open (was: New) > Add unit test for SavepointsCommand > --- >

[jira] [Closed] (HUDI-706) Add unit test for SavepointsCommand

2020-05-20 Thread hong dongdong (Jira)
[ https://issues.apache.org/jira/browse/HUDI-706?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] hong dongdong closed HUDI-706. -- Fix Version/s: 0.6.0 Resolution: Fixed > Add unit test for SavepointsCommand > ---

[jira] [Commented] (HUDI-859) Improve documentation around key generators

2020-05-16 Thread hong dongdong (Jira)
[ https://issues.apache.org/jira/browse/HUDI-859?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17109353#comment-17109353 ] hong dongdong commented on HUDI-859: [~shivnarayan]: I'll discuss with [~Pratyaksh]  fo

[jira] [Commented] (HUDI-890) Prepare for 0.5.3 patch release

2020-05-13 Thread hong dongdong (Jira)
[ https://issues.apache.org/jira/browse/HUDI-890?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17106804#comment-17106804 ] hong dongdong commented on HUDI-890: Hi, [~bhavanisudha] take a look when free https:/

[jira] [Updated] (HUDI-840) Clean blank file created by HoodieLogFormatWriter

2020-04-27 Thread hong dongdong (Jira)
[ https://issues.apache.org/jira/browse/HUDI-840?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] hong dongdong updated HUDI-840: --- Description: When roll over is true,  HoodieLogFormatWriter will create next version log file. But it a

[jira] [Updated] (HUDI-840) Clean blank file created by HoodieLogFormatWriter

2020-04-27 Thread hong dongdong (Jira)
[ https://issues.apache.org/jira/browse/HUDI-840?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] hong dongdong updated HUDI-840: --- Description: When roll over is true,  > Clean blank file created by HoodieLogFormatWriter > ---

[jira] [Created] (HUDI-840) Clean blank file created by HoodieLogFormatWriter

2020-04-27 Thread hong dongdong (Jira)
hong dongdong created HUDI-840: -- Summary: Clean blank file created by HoodieLogFormatWriter Key: HUDI-840 URL: https://issues.apache.org/jira/browse/HUDI-840 Project: Apache Hudi (incubating) Is

[jira] [Created] (HUDI-789) Adjust logic of upsert in HDFSParquetImporter

2020-04-13 Thread hong dongdong (Jira)
hong dongdong created HUDI-789: -- Summary: Adjust logic of upsert in HDFSParquetImporter Key: HUDI-789 URL: https://issues.apache.org/jira/browse/HUDI-789 Project: Apache Hudi (incubating) Issue

[jira] [Updated] (HUDI-740) Fix can not specify the sparkMaster and code clean for SparkUtil

2020-04-07 Thread hong dongdong (Jira)
[ https://issues.apache.org/jira/browse/HUDI-740?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] hong dongdong updated HUDI-740: --- Summary: Fix can not specify the sparkMaster and code clean for SparkUtil (was: [HUDI-740]Fix can not

[jira] [Updated] (HUDI-740) [HUDI-740]Fix can not specify the sparkMaster of clean and compact commands

2020-04-07 Thread hong dongdong (Jira)
[ https://issues.apache.org/jira/browse/HUDI-740?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] hong dongdong updated HUDI-740: --- Summary: [HUDI-740]Fix can not specify the sparkMaster of clean and compact commands (was: Fix can no

[jira] [Updated] (HUDI-752) Make CompactionAdminClient spark-free

2020-03-31 Thread hong dongdong (Jira)
[ https://issues.apache.org/jira/browse/HUDI-752?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] hong dongdong updated HUDI-752: --- Description: Now, we always pass jsc, there can only one sparkContext in JVM. So, we can store it in a

[jira] [Created] (HUDI-752) Make CompactionAdminClient spark-free

2020-03-31 Thread hong dongdong (Jira)
hong dongdong created HUDI-752: -- Summary: Make CompactionAdminClient spark-free Key: HUDI-752 URL: https://issues.apache.org/jira/browse/HUDI-752 Project: Apache Hudi (incubating) Issue Type: Su

[jira] [Created] (HUDI-750) Make AbstractHoodieClient spark-free

2020-03-30 Thread hong dongdong (Jira)
hong dongdong created HUDI-750: -- Summary: Make AbstractHoodieClient spark-free Key: HUDI-750 URL: https://issues.apache.org/jira/browse/HUDI-750 Project: Apache Hudi (incubating) Issue Type: Sub

[jira] [Commented] (HUDI-677) Abstract/Refactor all transaction management logic into a set of classes from HoodieWriteClient

2020-03-28 Thread hong dongdong (Jira)
[ https://issues.apache.org/jira/browse/HUDI-677?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17070217#comment-17070217 ] hong dongdong commented on HUDI-677: [~vinoth] Of course not.  > Abstract/Refactor all

[jira] [Created] (HUDI-740) Fix can not specify the sparkMaster of cleans run command

2020-03-26 Thread hong dongdong (Jira)
hong dongdong created HUDI-740: -- Summary: Fix can not specify the sparkMaster of cleans run command Key: HUDI-740 URL: https://issues.apache.org/jira/browse/HUDI-740 Project: Apache Hudi (incubating)

[jira] [Commented] (HUDI-677) Abstract/Refactor all transaction management logic into a set of classes from HoodieWriteClient

2020-03-26 Thread hong dongdong (Jira)
[ https://issues.apache.org/jira/browse/HUDI-677?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17067538#comment-17067538 ] hong dongdong commented on HUDI-677: [~vinoth] As summary said, all transaction need m

[jira] [Created] (HUDI-715) Fix duplicate name in TableCommand

2020-03-16 Thread hong dongdong (Jira)
hong dongdong created HUDI-715: -- Summary: Fix duplicate name in TableCommand Key: HUDI-715 URL: https://issues.apache.org/jira/browse/HUDI-715 Project: Apache Hudi (incubating) Issue Type: Bug

[jira] [Closed] (HUDI-692) Add delete savepoint for cli

2020-03-15 Thread hong dongdong (Jira)
[ https://issues.apache.org/jira/browse/HUDI-692?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] hong dongdong closed HUDI-692. -- Fix Version/s: 0.6.0 Resolution: Implemented > Add delete savepoint for cli >

[jira] [Updated] (HUDI-692) Add delete savepoint for cli

2020-03-15 Thread hong dongdong (Jira)
[ https://issues.apache.org/jira/browse/HUDI-692?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] hong dongdong updated HUDI-692: --- Status: Open (was: New) > Add delete savepoint for cli > > >

[jira] [Created] (HUDI-709) Add unit test for UtilsCommand

2020-03-12 Thread hong dongdong (Jira)
hong dongdong created HUDI-709: -- Summary: Add unit test for UtilsCommand Key: HUDI-709 URL: https://issues.apache.org/jira/browse/HUDI-709 Project: Apache Hudi (incubating) Issue Type: Sub-task

[jira] [Created] (HUDI-708) Add unit test for TempViewCommand

2020-03-12 Thread hong dongdong (Jira)
hong dongdong created HUDI-708: -- Summary: Add unit test for TempViewCommand Key: HUDI-708 URL: https://issues.apache.org/jira/browse/HUDI-708 Project: Apache Hudi (incubating) Issue Type: Sub-ta

[jira] [Created] (HUDI-707) Add unit test for StatsCommand

2020-03-12 Thread hong dongdong (Jira)
hong dongdong created HUDI-707: -- Summary: Add unit test for StatsCommand Key: HUDI-707 URL: https://issues.apache.org/jira/browse/HUDI-707 Project: Apache Hudi (incubating) Issue Type: Sub-task

[jira] [Created] (HUDI-706) Add unit test for SavepointsCommand

2020-03-12 Thread hong dongdong (Jira)
hong dongdong created HUDI-706: -- Summary: Add unit test for SavepointsCommand Key: HUDI-706 URL: https://issues.apache.org/jira/browse/HUDI-706 Project: Apache Hudi (incubating) Issue Type: Sub-

[jira] [Created] (HUDI-705) Add unit test for RollbacksCommand

2020-03-12 Thread hong dongdong (Jira)
hong dongdong created HUDI-705: -- Summary: Add unit test for RollbacksCommand Key: HUDI-705 URL: https://issues.apache.org/jira/browse/HUDI-705 Project: Apache Hudi (incubating) Issue Type: Sub-t

[jira] [Created] (HUDI-703) Add unit test for HoodieSyncCommand

2020-03-12 Thread hong dongdong (Jira)
hong dongdong created HUDI-703: -- Summary: Add unit test for HoodieSyncCommand Key: HUDI-703 URL: https://issues.apache.org/jira/browse/HUDI-703 Project: Apache Hudi (incubating) Issue Type: Sub-

[jira] [Created] (HUDI-704) Add unit test for RepairsCommand

2020-03-12 Thread hong dongdong (Jira)
hong dongdong created HUDI-704: -- Summary: Add unit test for RepairsCommand Key: HUDI-704 URL: https://issues.apache.org/jira/browse/HUDI-704 Project: Apache Hudi (incubating) Issue Type: Sub-tas

[jira] [Created] (HUDI-702) Add unit test for HoodieLogFileCommand

2020-03-12 Thread hong dongdong (Jira)
hong dongdong created HUDI-702: -- Summary: Add unit test for HoodieLogFileCommand Key: HUDI-702 URL: https://issues.apache.org/jira/browse/HUDI-702 Project: Apache Hudi (incubating) Issue Type: S

[jira] [Created] (HUDI-700) Add unit test for FileSystemViewCommand

2020-03-12 Thread hong dongdong (Jira)
hong dongdong created HUDI-700: -- Summary: Add unit test for FileSystemViewCommand Key: HUDI-700 URL: https://issues.apache.org/jira/browse/HUDI-700 Project: Apache Hudi (incubating) Issue Type:

[jira] [Created] (HUDI-701) Add unit test for HDFSParquetImportCommand

2020-03-12 Thread hong dongdong (Jira)
hong dongdong created HUDI-701: -- Summary: Add unit test for HDFSParquetImportCommand Key: HUDI-701 URL: https://issues.apache.org/jira/browse/HUDI-701 Project: Apache Hudi (incubating) Issue Typ

[jira] [Created] (HUDI-699) Add unit test for CompactionCommand

2020-03-12 Thread hong dongdong (Jira)
hong dongdong created HUDI-699: -- Summary: Add unit test for CompactionCommand Key: HUDI-699 URL: https://issues.apache.org/jira/browse/HUDI-699 Project: Apache Hudi (incubating) Issue Type: Sub-

[jira] [Created] (HUDI-698) Add unit test for CleansCommand

2020-03-12 Thread hong dongdong (Jira)
hong dongdong created HUDI-698: -- Summary: Add unit test for CleansCommand Key: HUDI-698 URL: https://issues.apache.org/jira/browse/HUDI-698 Project: Apache Hudi (incubating) Issue Type: Sub-task

[jira] [Created] (HUDI-697) Add unit test for ArchivedCommitsCommand

2020-03-12 Thread hong dongdong (Jira)
hong dongdong created HUDI-697: -- Summary: Add unit test for ArchivedCommitsCommand Key: HUDI-697 URL: https://issues.apache.org/jira/browse/HUDI-697 Project: Apache Hudi (incubating) Issue Type:

[jira] [Created] (HUDI-696) Add unit test for CommitsCommand

2020-03-12 Thread hong dongdong (Jira)
hong dongdong created HUDI-696: -- Summary: Add unit test for CommitsCommand Key: HUDI-696 URL: https://issues.apache.org/jira/browse/HUDI-696 Project: Apache Hudi (incubating) Issue Type: Sub-tas

[jira] [Updated] (HUDI-695) Add unit test for TableCommand

2020-03-12 Thread hong dongdong (Jira)
[ https://issues.apache.org/jira/browse/HUDI-695?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] hong dongdong updated HUDI-695: --- Parent: HUDI-487 Issue Type: Sub-task (was: Bug) > Add unit test for TableCommand > --

[jira] [Created] (HUDI-695) Add unit test for TableCommand

2020-03-12 Thread hong dongdong (Jira)
hong dongdong created HUDI-695: -- Summary: Add unit test for TableCommand Key: HUDI-695 URL: https://issues.apache.org/jira/browse/HUDI-695 Project: Apache Hudi (incubating) Issue Type: Bug

[jira] [Created] (HUDI-694) Add unit test for SparkEnvCommand

2020-03-12 Thread hong dongdong (Jira)
hong dongdong created HUDI-694: -- Summary: Add unit test for SparkEnvCommand Key: HUDI-694 URL: https://issues.apache.org/jira/browse/HUDI-694 Project: Apache Hudi (incubating) Issue Type: Sub-ta

[jira] [Assigned] (HUDI-693) Add unit test for hudi-cli module

2020-03-12 Thread hong dongdong (Jira)
[ https://issues.apache.org/jira/browse/HUDI-693?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] hong dongdong reassigned HUDI-693: -- Assignee: hong dongdong > Add unit test for hudi-cli module > -

[jira] [Assigned] (HUDI-487) Unit tests for hudi-cli

2020-03-12 Thread hong dongdong (Jira)
[ https://issues.apache.org/jira/browse/HUDI-487?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] hong dongdong reassigned HUDI-487: -- Assignee: hong dongdong (was: Forward Xu) > Unit tests for hudi-cli > --- >

[jira] [Commented] (HUDI-487) Unit tests for hudi-cli

2020-03-12 Thread hong dongdong (Jira)
[ https://issues.apache.org/jira/browse/HUDI-487?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17057670#comment-17057670 ] hong dongdong commented on HUDI-487: [~vinoth] I will do it.  > Unit tests for hudi-cl

[jira] [Created] (HUDI-693) Add unit test for hudi-cli module

2020-03-11 Thread hong dongdong (Jira)
hong dongdong created HUDI-693: -- Summary: Add unit test for hudi-cli module Key: HUDI-693 URL: https://issues.apache.org/jira/browse/HUDI-693 Project: Apache Hudi (incubating) Issue Type: New Fe

[jira] [Assigned] (HUDI-692) Add delete savepoint for cli

2020-03-10 Thread hong dongdong (Jira)
[ https://issues.apache.org/jira/browse/HUDI-692?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] hong dongdong reassigned HUDI-692: -- Assignee: hong dongdong > Add delete savepoint for cli > > >

[jira] [Created] (HUDI-692) Add delete savepoint for cli

2020-03-10 Thread hong dongdong (Jira)
hong dongdong created HUDI-692: -- Summary: Add delete savepoint for cli Key: HUDI-692 URL: https://issues.apache.org/jira/browse/HUDI-692 Project: Apache Hudi (incubating) Issue Type: New Feature

[jira] [Commented] (HUDI-677) Abstract/Refactor all transaction management logic into a set of classes from HoodieWriteClient

2020-03-08 Thread hong dongdong (Jira)
[ https://issues.apache.org/jira/browse/HUDI-677?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17054391#comment-17054391 ] hong dongdong commented on HUDI-677: yep,I will try with this issue. > Abstract/Refact

[jira] [Updated] (HUDI-544) Adjust the read and write path of archive

2020-01-17 Thread hong dongdong (Jira)
[ https://issues.apache.org/jira/browse/HUDI-544?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] hong dongdong updated HUDI-544: --- Description: Now, archive path have two different default value: "archived" and "". It cause a bug. [

[jira] [Created] (HUDI-544) Adjust the read and write path of archive

2020-01-17 Thread hong dongdong (Jira)
hong dongdong created HUDI-544: -- Summary: Adjust the read and write path of archive Key: HUDI-544 URL: https://issues.apache.org/jira/browse/HUDI-544 Project: Apache Hudi (incubating) Issue Type

[jira] [Commented] (HUDI-538) Restructuring hudi client module for multi engine support

2020-01-16 Thread hong dongdong (Jira)
[ https://issues.apache.org/jira/browse/HUDI-538?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17017648#comment-17017648 ] hong dongdong commented on HUDI-538: [~yanghua] I am interesting in this work, please @

[jira] [Commented] (HUDI-539) No FileSystem for scheme: abfss

2020-01-16 Thread hong dongdong (Jira)
[ https://issues.apache.org/jira/browse/HUDI-539?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17017644#comment-17017644 ] hong dongdong commented on HUDI-539: [~ssomuah] As far as I know, ABFS was support afte

[jira] [Assigned] (HUDI-540) Incorrect archive directory path in show archived commits cli

2020-01-16 Thread hong dongdong (Jira)
[ https://issues.apache.org/jira/browse/HUDI-540?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] hong dongdong reassigned HUDI-540: -- Assignee: hong dongdong > Incorrect archive directory path in show archived commits cli > --

[jira] [Commented] (HUDI-540) Incorrect archive directory path in show archived commits cli

2020-01-16 Thread hong dongdong (Jira)
[ https://issues.apache.org/jira/browse/HUDI-540?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17017639#comment-17017639 ] hong dongdong commented on HUDI-540: [~venkee14] It‘s need  {code:java} @CliOption(key

[jira] [Updated] (HUDI-523) Upgrade Hudi to Spark DataSource V2

2020-01-13 Thread hong dongdong (Jira)
[ https://issues.apache.org/jira/browse/HUDI-523?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] hong dongdong updated HUDI-523: --- Description: May be need spark3 (was: As spark upgrade to 2.4, we can upgrade to datasource api v2 now

[jira] [Assigned] (HUDI-523) Upgrade Hudi to Spark DataSource V2

2020-01-13 Thread hong dongdong (Jira)
[ https://issues.apache.org/jira/browse/HUDI-523?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] hong dongdong reassigned HUDI-523: -- Assignee: (was: hong dongdong) > Upgrade Hudi to Spark DataSource V2 > -

[jira] [Created] (HUDI-523) Upgrade Hudi to Spark DataSource V2

2020-01-12 Thread hong dongdong (Jira)
hong dongdong created HUDI-523: -- Summary: Upgrade Hudi to Spark DataSource V2 Key: HUDI-523 URL: https://issues.apache.org/jira/browse/HUDI-523 Project: Apache Hudi (incubating) Issue Type: Impr

[jira] [Assigned] (HUDI-523) Upgrade Hudi to Spark DataSource V2

2020-01-12 Thread hong dongdong (Jira)
[ https://issues.apache.org/jira/browse/HUDI-523?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] hong dongdong reassigned HUDI-523: -- Assignee: hong dongdong > Upgrade Hudi to Spark DataSource V2 >

[jira] [Commented] (HUDI-492) show env all CLI command can not work in hudi-cli

2020-01-02 Thread hong dongdong (Jira)
[ https://issues.apache.org/jira/browse/HUDI-492?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17007211#comment-17007211 ] hong dongdong commented on HUDI-492: [~yanghua] [~vinoth] [~lamber-ken] please see pr [

[jira] [Comment Edited] (HUDI-492) show env all CLI command can not work in hudi-cli

2020-01-02 Thread hong dongdong (Jira)
[ https://issues.apache.org/jira/browse/HUDI-492?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17007188#comment-17007188 ] hong dongdong edited comment on HUDI-492 at 1/3/20 2:59 AM: [~y

[jira] [Commented] (HUDI-492) show env all CLI command can not work in hudi-cli

2020-01-02 Thread hong dongdong (Jira)
[ https://issues.apache.org/jira/browse/HUDI-492?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17007188#comment-17007188 ] hong dongdong commented on HUDI-492: [~yanghua] thanks, I found there are problem in `s

[jira] [Comment Edited] (HUDI-492) show env all CLI command can not work in hudi-cli

2020-01-02 Thread hong dongdong (Jira)
[ https://issues.apache.org/jira/browse/HUDI-492?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17007175#comment-17007175 ] hong dongdong edited comment on HUDI-492 at 1/3/20 2:27 AM: !hu

[jira] [Updated] (HUDI-492) show env all CLI command can not work in hudi-cli

2020-01-02 Thread hong dongdong (Jira)
[ https://issues.apache.org/jira/browse/HUDI-492?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] hong dongdong updated HUDI-492: --- Attachment: hudi-11.png > show env all CLI command can not work in hudi-cli > -

[jira] [Commented] (HUDI-492) show env all CLI command can not work in hudi-cli

2020-01-02 Thread hong dongdong (Jira)
[ https://issues.apache.org/jira/browse/HUDI-492?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17007175#comment-17007175 ] hong dongdong commented on HUDI-492: [~yanghua] can you give a picture which with comma

[jira] [Created] (HUDI-438) Merge duplicated code fragment in HoodieSparkSqlWriter.scala

2019-12-18 Thread hong dongdong (Jira)
hong dongdong created HUDI-438: -- Summary: Merge duplicated code fragment in HoodieSparkSqlWriter.scala Key: HUDI-438 URL: https://issues.apache.org/jira/browse/HUDI-438 Project: Apache Hudi (incubating)

[jira] [Commented] (HUDI-332) Add operation type (insert/upsert/bulkinsert/delete) to HoodieCommitMetadata

2019-12-18 Thread hong dongdong (Jira)
[ https://issues.apache.org/jira/browse/HUDI-332?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16999705#comment-16999705 ] hong dongdong commented on HUDI-332: [~vinoth] Thanks, I will take care of your remind.

[jira] [Assigned] (HUDI-332) Add operation type (insert/upsert/bulkinsert/delete) to HoodieCommitMetadata

2019-12-18 Thread hong dongdong (Jira)
[ https://issues.apache.org/jira/browse/HUDI-332?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] hong dongdong reassigned HUDI-332: -- Assignee: hong dongdong > Add operation type (insert/upsert/bulkinsert/delete) to HoodieCommitMe

[jira] [Commented] (HUDI-332) Add operation type (insert/upsert/bulkinsert/delete) to HoodieCommitMetadata

2019-12-18 Thread hong dongdong (Jira)
[ https://issues.apache.org/jira/browse/HUDI-332?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16999686#comment-16999686 ] hong dongdong commented on HUDI-332: [~shivnarayan] [~vinoth] Is any one working on th

[jira] [Created] (HUDI-416) Improve hint information for Cli

2019-12-16 Thread hong dongdong (Jira)
hong dongdong created HUDI-416: -- Summary: Improve hint information for Cli Key: HUDI-416 URL: https://issues.apache.org/jira/browse/HUDI-416 Project: Apache Hudi (incubating) Issue Type: Improve

[jira] [Commented] (HUDI-331) Fix java docs for all public apis (HoodieWriteClient)

2019-12-16 Thread hong dongdong (Jira)
[ https://issues.apache.org/jira/browse/HUDI-331?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16997780#comment-16997780 ] hong dongdong commented on HUDI-331: I will working on it. [~xleesf] > Fix java docs f

[jira] [Created] (HUDI-401) Remove unnecessary use of spark in savepoint timeline

2019-12-11 Thread hong dongdong (Jira)
hong dongdong created HUDI-401: -- Summary: Remove unnecessary use of spark in savepoint timeline Key: HUDI-401 URL: https://issues.apache.org/jira/browse/HUDI-401 Project: Apache Hudi (incubating)

[jira] [Created] (HUDI-398) Add set env for spark launcher

2019-12-10 Thread hong dongdong (Jira)
hong dongdong created HUDI-398: -- Summary: Add set env for spark launcher Key: HUDI-398 URL: https://issues.apache.org/jira/browse/HUDI-398 Project: Apache Hudi (incubating) Issue Type: New Featu

[jira] [Created] (HUDI-374) Unable to generateUpdates in QuickstartUtils

2019-11-28 Thread hong dongdong (Jira)
hong dongdong created HUDI-374: -- Summary: Unable to generateUpdates in QuickstartUtils Key: HUDI-374 URL: https://issues.apache.org/jira/browse/HUDI-374 Project: Apache Hudi (incubating) Issue T

[jira] [Updated] (HUDI-362) Adds a check for the existence of field

2019-11-24 Thread hong dongdong (Jira)
[ https://issues.apache.org/jira/browse/HUDI-362?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] hong dongdong updated HUDI-362: --- Attachment: image-2019-11-25-15-33-21-610.png > Adds a check for the existence of field > -

[jira] [Updated] (HUDI-362) Adds a check for the existence of field

2019-11-24 Thread hong dongdong (Jira)
[ https://issues.apache.org/jira/browse/HUDI-362?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] hong dongdong updated HUDI-362: --- Description: Use command {code:java} commits show --sortBy "Total Bytes Written" --desc true --limit 10

[jira] [Updated] (HUDI-362) Adds a check for the existence of field

2019-11-24 Thread hong dongdong (Jira)
[ https://issues.apache.org/jira/browse/HUDI-362?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] hong dongdong updated HUDI-362: --- Attachment: image-2019-11-25-15-32-14-057.png > Adds a check for the existence of field > -

[jira] [Updated] (HUDI-362) Adds a check for the existence of field

2019-11-24 Thread hong dongdong (Jira)
[ https://issues.apache.org/jira/browse/HUDI-362?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] hong dongdong updated HUDI-362: --- Summary: Adds a check for the existence of field (was: Add a check if field in columns.) > Adds a che

[jira] [Created] (HUDI-362) Add a check if field in columns.

2019-11-24 Thread hong dongdong (Jira)
hong dongdong created HUDI-362: -- Summary: Add a check if field in columns. Key: HUDI-362 URL: https://issues.apache.org/jira/browse/HUDI-362 Project: Apache Hudi (incubating) Issue Type: Improve

[jira] [Created] (HUDI-359) Add hudi-env for hudi-cli module

2019-11-21 Thread hong dongdong (Jira)
hong dongdong created HUDI-359: -- Summary: Add hudi-env for hudi-cli module Key: HUDI-359 URL: https://issues.apache.org/jira/browse/HUDI-359 Project: Apache Hudi (incubating) Issue Type: Improve

[jira] [Created] (HUDI-356) Sync translation and code in quickstart.cn and admin_guide.cn pages

2019-11-20 Thread hong dongdong (Jira)
hong dongdong created HUDI-356: -- Summary: Sync translation and code in quickstart.cn and admin_guide.cn pages Key: HUDI-356 URL: https://issues.apache.org/jira/browse/HUDI-356 Project: Apache Hudi (incub

[jira] [Created] (HUDI-345) Fix used deprecated function

2019-11-18 Thread hong dongdong (Jira)
hong dongdong created HUDI-345: -- Summary: Fix used deprecated function Key: HUDI-345 URL: https://issues.apache.org/jira/browse/HUDI-345 Project: Apache Hudi (incubating) Issue Type: Improvement