[jira] [Updated] (HUDI-2008) Add an annotation to suppress the compiler warnings

2021-06-13 Thread Wei (Jira)
[ https://issues.apache.org/jira/browse/HUDI-2008?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei updated HUDI-2008: -- Status: In Progress (was: Open) > Add an annotation to suppress the compiler warnings > ---

[jira] [Assigned] (HUDI-2009) Fix extra commit metadata in row writer path

2021-06-13 Thread sivabalan narayanan (Jira)
[ https://issues.apache.org/jira/browse/HUDI-2009?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] sivabalan narayanan reassigned HUDI-2009: - Assignee: sivabalan narayanan > Fix extra commit metadata in row writer path > --

[jira] [Created] (HUDI-2009) Fix extra commit metadata in row writer path

2021-06-13 Thread sivabalan narayanan (Jira)
sivabalan narayanan created HUDI-2009: - Summary: Fix extra commit metadata in row writer path Key: HUDI-2009 URL: https://issues.apache.org/jira/browse/HUDI-2009 Project: Apache Hudi Issu

[jira] [Updated] (HUDI-2008) Add an annotation to suppress the compiler warnings

2021-06-13 Thread Wei (Jira)
[ https://issues.apache.org/jira/browse/HUDI-2008?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei updated HUDI-2008: -- Summary: Add an annotation to suppress the compiler warnings (was: The SparkRDDWriteClient instance don't use raw Types

[jira] [Commented] (HUDI-1975) Upgrade java-prometheus-client from 3.1.2 to 4.x

2021-06-13 Thread Vinay (Jira)
[ https://issues.apache.org/jira/browse/HUDI-1975?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17362691#comment-17362691 ] Vinay commented on HUDI-1975: - Updated the metrics.version in pom to 3.1.2 , the build fails w

[jira] [Created] (HUDI-2008) The SparkRDDWriteClient instance don't use raw Types to avoid compiler warnings

2021-06-13 Thread Wei (Jira)
Wei created HUDI-2008: - Summary: The SparkRDDWriteClient instance don't use raw Types to avoid compiler warnings Key: HUDI-2008 URL: https://issues.apache.org/jira/browse/HUDI-2008 Project: Apache Hudi

[jira] [Commented] (HUDI-1910) Supporting Kafka based checkpointing for HoodieDeltaStreamer

2021-06-13 Thread Vinay (Jira)
[ https://issues.apache.org/jira/browse/HUDI-1910?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17362688#comment-17362688 ] Vinay commented on HUDI-1910: - [~nishith29] Make sense, so you suggesting to include COMMIT_OF

[jira] [Created] (HUDI-2007) Adding spark bulk insert node

2021-06-13 Thread sivabalan narayanan (Jira)
sivabalan narayanan created HUDI-2007: - Summary: Adding spark bulk insert node Key: HUDI-2007 URL: https://issues.apache.org/jira/browse/HUDI-2007 Project: Apache Hudi Issue Type: Improve

[jira] [Assigned] (HUDI-2007) Adding spark bulk insert node

2021-06-13 Thread sivabalan narayanan (Jira)
[ https://issues.apache.org/jira/browse/HUDI-2007?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] sivabalan narayanan reassigned HUDI-2007: - Assignee: sivabalan narayanan > Adding spark bulk insert node > -

[hudi] branch master updated: [HUDI-1991] Fixing drop dups exception in bulk insert row writer path (#3055)

2021-06-13 Thread leesf
This is an automated email from the ASF dual-hosted git repository. leesf pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/hudi.git The following commit(s) were added to refs/heads/master by this push: new 7d9f9d7 [HUDI-1991] Fixing drop dups exception in

[hudi] branch asf-site updated: Travis CI build asf-site

2021-06-13 Thread vinoth
This is an automated email from the ASF dual-hosted git repository. vinoth pushed a commit to branch asf-site in repository https://gitbox.apache.org/repos/asf/hudi.git The following commit(s) were added to refs/heads/asf-site by this push: new 498a5b5 Travis CI build asf-site 498a5b5 is d

[hudi] branch asf-site updated (25c5f04 -> 4ad5c74)

2021-06-13 Thread sivabalan
This is an automated email from the ASF dual-hosted git repository. sivabalan pushed a change to branch asf-site in repository https://gitbox.apache.org/repos/asf/hudi.git. from 25c5f04 Travis CI build asf-site add 4ad5c74 [HUDI-1766] Added blog for Hudi cleaner service (#2967) No ne

[jira] [Updated] (HUDI-2001) SnapshotRead on MOR table runs into NoSuchMethodError w/ PartitionedFile.init in MergeOnReadSnapshotRelation

2021-06-13 Thread sivabalan narayanan (Jira)
[ https://issues.apache.org/jira/browse/HUDI-2001?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] sivabalan narayanan updated HUDI-2001: -- Summary: SnapshotRead on MOR table runs into NoSuchMethodError w/ PartitionedFile.init i

[jira] [Comment Edited] (HUDI-2005) Audit and remove references of fs.listStatus()

2021-06-13 Thread Nishith Agarwal (Jira)
[ https://issues.apache.org/jira/browse/HUDI-2005?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17362662#comment-17362662 ] Nishith Agarwal edited comment on HUDI-2005 at 6/13/21, 10:54 PM: --

[jira] [Comment Edited] (HUDI-2005) Audit and remove references of fs.listStatus()

2021-06-13 Thread Nishith Agarwal (Jira)
[ https://issues.apache.org/jira/browse/HUDI-2005?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17362662#comment-17362662 ] Nishith Agarwal edited comment on HUDI-2005 at 6/13/21, 10:49 PM: --

[jira] [Assigned] (HUDI-2005) Audit and remove references of fs.listStatus()

2021-06-13 Thread Nishith Agarwal (Jira)
[ https://issues.apache.org/jira/browse/HUDI-2005?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Nishith Agarwal reassigned HUDI-2005: - Assignee: Prashant Wason (was: Nishith Agarwal) > Audit and remove references of fs.list

[jira] [Commented] (HUDI-2005) Audit and remove references of fs.listStatus()

2021-06-13 Thread Nishith Agarwal (Jira)
[ https://issues.apache.org/jira/browse/HUDI-2005?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17362662#comment-17362662 ] Nishith Agarwal commented on HUDI-2005: --- 1.  org.apache.hudi.metadata.HoodieBackedTa

[jira] [Assigned] (HUDI-2006) Add more yamls to test suite

2021-06-13 Thread sivabalan narayanan (Jira)
[ https://issues.apache.org/jira/browse/HUDI-2006?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] sivabalan narayanan reassigned HUDI-2006: - Assignee: sivabalan narayanan > Add more yamls to test suite > -

[jira] [Created] (HUDI-2006) Add more yamls to test suite

2021-06-13 Thread sivabalan narayanan (Jira)
sivabalan narayanan created HUDI-2006: - Summary: Add more yamls to test suite Key: HUDI-2006 URL: https://issues.apache.org/jira/browse/HUDI-2006 Project: Apache Hudi Issue Type: Improve

[jira] [Created] (HUDI-2005) Audit and remove references of fs.listStatus()

2021-06-13 Thread Nishith Agarwal (Jira)
Nishith Agarwal created HUDI-2005: - Summary: Audit and remove references of fs.listStatus() Key: HUDI-2005 URL: https://issues.apache.org/jira/browse/HUDI-2005 Project: Apache Hudi Issue Type

[jira] [Updated] (HUDI-1457) Add multi writing to Hudi tables using DFS based locking (only HDFS atomic renames)

2021-06-13 Thread Nishith Agarwal (Jira)
[ https://issues.apache.org/jira/browse/HUDI-1457?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Nishith Agarwal updated HUDI-1457: -- Summary: Add multi writing to Hudi tables using DFS based locking (only HDFS atomic renames) (w

[jira] [Updated] (HUDI-1457) Add multi writing to Hudi tables using DFS based locking

2021-06-13 Thread Nishith Agarwal (Jira)
[ https://issues.apache.org/jira/browse/HUDI-1457?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Nishith Agarwal updated HUDI-1457: -- Summary: Add multi writing to Hudi tables using DFS based locking (was: Add parallel writing to

[jira] [Resolved] (HUDI-1679) Add example to docker for optimistic lock use

2021-06-13 Thread Nishith Agarwal (Jira)
[ https://issues.apache.org/jira/browse/HUDI-1679?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Nishith Agarwal resolved HUDI-1679. --- Fix Version/s: 0.8.0 Resolution: Fixed > Add example to docker for optimistic lock use

[jira] [Updated] (HUDI-1623) Support start_commit_time & end_commit_times for serializable incremental pull

2021-06-13 Thread Nishith Agarwal (Jira)
[ https://issues.apache.org/jira/browse/HUDI-1623?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Nishith Agarwal updated HUDI-1623: -- Fix Version/s: 0.10.0 > Support start_commit_time & end_commit_times for serializable incrementa

[jira] [Updated] (HUDI-1575) Early detection by periodically checking last written commit

2021-06-13 Thread Nishith Agarwal (Jira)
[ https://issues.apache.org/jira/browse/HUDI-1575?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Nishith Agarwal updated HUDI-1575: -- Summary: Early detection by periodically checking last written commit (was: Early detection, la

[jira] [Updated] (HUDI-1575) Early detection by periodically checking last written commit

2021-06-13 Thread Nishith Agarwal (Jira)
[ https://issues.apache.org/jira/browse/HUDI-1575?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Nishith Agarwal updated HUDI-1575: -- Description: Check if there are more commits, try to do resolution, and abort for a currently ru

[jira] [Commented] (HUDI-944) Support more complete concurrency control when writing data

2021-06-13 Thread Nishith Agarwal (Jira)
[ https://issues.apache.org/jira/browse/HUDI-944?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17362627#comment-17362627 ] Nishith Agarwal commented on HUDI-944: -- Concurrent writing to HUDI tables is now suppo

[jira] [Resolved] (HUDI-944) Support more complete concurrency control when writing data

2021-06-13 Thread Nishith Agarwal (Jira)
[ https://issues.apache.org/jira/browse/HUDI-944?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Nishith Agarwal resolved HUDI-944. -- Fix Version/s: 0.8.0 Resolution: Fixed > Support more complete concurrency control when w

[jira] [Updated] (HUDI-1577) Document that multi-writer cannot be used within the same write client

2021-06-13 Thread Nishith Agarwal (Jira)
[ https://issues.apache.org/jira/browse/HUDI-1577?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Nishith Agarwal updated HUDI-1577: -- Fix Version/s: 0.9.0 > Document that multi-writer cannot be used within the same write client >

[jira] [Updated] (HUDI-1577) Document that multi-writer cannot be used within the same write client

2021-06-13 Thread Nishith Agarwal (Jira)
[ https://issues.apache.org/jira/browse/HUDI-1577?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Nishith Agarwal updated HUDI-1577: -- Priority: Blocker (was: Major) > Document that multi-writer cannot be used within the same writ

[jira] [Updated] (HUDI-1706) Test flakiness w/ multiwriter test

2021-06-13 Thread Nishith Agarwal (Jira)
[ https://issues.apache.org/jira/browse/HUDI-1706?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Nishith Agarwal updated HUDI-1706: -- Parent: HUDI-1456 Issue Type: Sub-task (was: Bug) > Test flakiness w/ multiwriter test

[jira] [Updated] (HUDI-1456) [UMBRELLA] Concurrent Writing (multiwriter) to Hudi tables

2021-06-13 Thread Nishith Agarwal (Jira)
[ https://issues.apache.org/jira/browse/HUDI-1456?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Nishith Agarwal updated HUDI-1456: -- Summary: [UMBRELLA] Concurrent Writing (multiwriter) to Hudi tables (was: [UMBRELLA] Concurrent

[jira] [Updated] (HUDI-1698) Multiwriting for Flink / Java

2021-06-13 Thread Nishith Agarwal (Jira)
[ https://issues.apache.org/jira/browse/HUDI-1698?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Nishith Agarwal updated HUDI-1698: -- Parent: HUDI-1456 Issue Type: Sub-task (was: Improvement) > Multiwriting for Flink / Ja

[jira] [Updated] (HUDI-1047) Support asynchronize clustering in CoW mode

2021-06-13 Thread Nishith Agarwal (Jira)
[ https://issues.apache.org/jira/browse/HUDI-1047?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Nishith Agarwal updated HUDI-1047: -- Summary: Support asynchronize clustering in CoW mode (was: Support synchronize clustering in Co

[jira] [Updated] (HUDI-1048) Support Asynchronize clustering in MoR mode

2021-06-13 Thread Nishith Agarwal (Jira)
[ https://issues.apache.org/jira/browse/HUDI-1048?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Nishith Agarwal updated HUDI-1048: -- Summary: Support Asynchronize clustering in MoR mode (was: Support synchronize clustering in Mo

[jira] [Updated] (HUDI-1077) Integration tests to validate clustering

2021-06-13 Thread Nishith Agarwal (Jira)
[ https://issues.apache.org/jira/browse/HUDI-1077?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Nishith Agarwal updated HUDI-1077: -- Fix Version/s: 0.9.0 > Integration tests to validate clustering > --

[jira] [Updated] (HUDI-1353) Incremental timeline support for pending clustering operations

2021-06-13 Thread Nishith Agarwal (Jira)
[ https://issues.apache.org/jira/browse/HUDI-1353?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Nishith Agarwal updated HUDI-1353: -- Priority: Blocker (was: Major) > Incremental timeline support for pending clustering operations

[jira] [Assigned] (HUDI-1468) incremental read support with clustering

2021-06-13 Thread Nishith Agarwal (Jira)
[ https://issues.apache.org/jira/browse/HUDI-1468?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Nishith Agarwal reassigned HUDI-1468: - Assignee: liwei > incremental read support with clustering >

[jira] [Updated] (HUDI-1468) incremental read support with clustering

2021-06-13 Thread Nishith Agarwal (Jira)
[ https://issues.apache.org/jira/browse/HUDI-1468?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Nishith Agarwal updated HUDI-1468: -- Priority: Blocker (was: Major) > incremental read support with clustering > ---

[jira] [Updated] (HUDI-1077) Integration tests to validate clustering

2021-06-13 Thread Nishith Agarwal (Jira)
[ https://issues.apache.org/jira/browse/HUDI-1077?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Nishith Agarwal updated HUDI-1077: -- Priority: Blocker (was: Major) > Integration tests to validate clustering > ---

[jira] [Updated] (HUDI-1482) async clustering for spark streaming

2021-06-13 Thread Nishith Agarwal (Jira)
[ https://issues.apache.org/jira/browse/HUDI-1482?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Nishith Agarwal updated HUDI-1482: -- Priority: Blocker (was: Major) > async clustering for spark streaming > ---

[jira] [Updated] (HUDI-1483) async clustering for deltastreamer

2021-06-13 Thread Nishith Agarwal (Jira)
[ https://issues.apache.org/jira/browse/HUDI-1483?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Nishith Agarwal updated HUDI-1483: -- Fix Version/s: 0.9.0 > async clustering for deltastreamer > -- >

[jira] [Updated] (HUDI-1482) async clustering for spark streaming

2021-06-13 Thread Nishith Agarwal (Jira)
[ https://issues.apache.org/jira/browse/HUDI-1482?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Nishith Agarwal updated HUDI-1482: -- Fix Version/s: 0.9.0 > async clustering for spark streaming > --

[jira] [Updated] (HUDI-1500) support incremental read clustering commit in deltastreamer

2021-06-13 Thread Nishith Agarwal (Jira)
[ https://issues.apache.org/jira/browse/HUDI-1500?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Nishith Agarwal updated HUDI-1500: -- Priority: Blocker (was: Major) > support incremental read clustering commit in deltastreamer >

[jira] [Updated] (HUDI-1500) support incremental read clustering commit in deltastreamer

2021-06-13 Thread Nishith Agarwal (Jira)
[ https://issues.apache.org/jira/browse/HUDI-1500?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Nishith Agarwal updated HUDI-1500: -- Fix Version/s: 0.9.0 > support incremental read clustering commit in deltastreamer > --

[jira] [Updated] (HUDI-1483) async clustering for deltastreamer

2021-06-13 Thread Nishith Agarwal (Jira)
[ https://issues.apache.org/jira/browse/HUDI-1483?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Nishith Agarwal updated HUDI-1483: -- Priority: Blocker (was: Major) > async clustering for deltastreamer > -

[jira] [Assigned] (HUDI-1500) support incremental read clustering commit in deltastreamer

2021-06-13 Thread Nishith Agarwal (Jira)
[ https://issues.apache.org/jira/browse/HUDI-1500?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Nishith Agarwal reassigned HUDI-1500: - Assignee: satish > support incremental read clustering commit in deltastreamer > ---

[jira] [Assigned] (HUDI-1937) When clustering fail, generating unfinished replacecommit timeline.

2021-06-13 Thread Nishith Agarwal (Jira)
[ https://issues.apache.org/jira/browse/HUDI-1937?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Nishith Agarwal reassigned HUDI-1937: - Assignee: liwei > When clustering fail, generating unfinished replacecommit timeline. > -

[jira] [Updated] (HUDI-1937) When clustering fail, generating unfinished replacecommit timeline.

2021-06-13 Thread Nishith Agarwal (Jira)
[ https://issues.apache.org/jira/browse/HUDI-1937?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Nishith Agarwal updated HUDI-1937: -- Parent: HUDI-1042 Issue Type: Sub-task (was: Bug) > When clustering fail, generating un

[jira] [Updated] (HUDI-1937) When clustering fail, generating unfinished replacecommit timeline.

2021-06-13 Thread Nishith Agarwal (Jira)
[ https://issues.apache.org/jira/browse/HUDI-1937?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Nishith Agarwal updated HUDI-1937: -- Priority: Blocker (was: Critical) > When clustering fail, generating unfinished replacecommit t

[jira] [Commented] (HUDI-1937) When clustering fail, generating unfinished replacecommit timeline.

2021-06-13 Thread Nishith Agarwal (Jira)
[ https://issues.apache.org/jira/browse/HUDI-1937?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17362624#comment-17362624 ] Nishith Agarwal commented on HUDI-1937: --- [~satish] [~309637554] Can one of you take

[jira] [Updated] (HUDI-1937) When clustering fail, generating unfinished replacecommit timeline.

2021-06-13 Thread Nishith Agarwal (Jira)
[ https://issues.apache.org/jira/browse/HUDI-1937?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Nishith Agarwal updated HUDI-1937: -- Fix Version/s: 0.9.0 > When clustering fail, generating unfinished replacecommit timeline. > ---

[jira] [Commented] (HUDI-1309) Listing Metadata unreadable in S3 as the log block is deemed corrupted

2021-06-13 Thread Nishith Agarwal (Jira)
[ https://issues.apache.org/jira/browse/HUDI-1309?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17362623#comment-17362623 ] Nishith Agarwal commented on HUDI-1309: --- [~vbalaji] Is this something you still see

[jira] [Commented] (HUDI-1537) Move validation of file listings to something that happens before each write

2021-06-13 Thread Nishith Agarwal (Jira)
[ https://issues.apache.org/jira/browse/HUDI-1537?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17362622#comment-17362622 ] Nishith Agarwal commented on HUDI-1537: --- [~pwason] Is validation of file listing app

[jira] [Updated] (HUDI-1309) Listing Metadata unreadable in S3 as the log block is deemed corrupted

2021-06-13 Thread Nishith Agarwal (Jira)
[ https://issues.apache.org/jira/browse/HUDI-1309?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Nishith Agarwal updated HUDI-1309: -- Priority: Blocker (was: Major) > Listing Metadata unreadable in S3 as the log block is deemed c

[jira] [Commented] (HUDI-1649) Bugs with Metadata Table in 0.7 release

2021-06-13 Thread Nishith Agarwal (Jira)
[ https://issues.apache.org/jira/browse/HUDI-1649?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17362621#comment-17362621 ] Nishith Agarwal commented on HUDI-1649: --- [~pwason] Are you going to open a PR to add

[jira] [Updated] (HUDI-1537) Move validation of file listings to something that happens before each write

2021-06-13 Thread Nishith Agarwal (Jira)
[ https://issues.apache.org/jira/browse/HUDI-1537?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Nishith Agarwal updated HUDI-1537: -- Priority: Blocker (was: Major) > Move validation of file listings to something that happens bef

[jira] [Updated] (HUDI-1542) Fix Flaky test : TestHoodieMetadata#testSync

2021-06-13 Thread Nishith Agarwal (Jira)
[ https://issues.apache.org/jira/browse/HUDI-1542?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Nishith Agarwal updated HUDI-1542: -- Priority: Blocker (was: Major) > Fix Flaky test : TestHoodieMetadata#testSync > ---

[jira] [Resolved] (HUDI-1962) Add a blog/docs for shuffle paralelism

2021-06-13 Thread Nishith Agarwal (Jira)
[ https://issues.apache.org/jira/browse/HUDI-1962?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Nishith Agarwal resolved HUDI-1962. --- Resolution: Fixed > Add a blog/docs for shuffle paralelism > -

[jira] [Commented] (HUDI-1962) Add a blog/docs for shuffle paralelism

2021-06-13 Thread Nishith Agarwal (Jira)
[ https://issues.apache.org/jira/browse/HUDI-1962?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17362619#comment-17362619 ] Nishith Agarwal commented on HUDI-1962: --- Added a FAQ ->  https://cwiki.apache.org/co

[jira] [Commented] (HUDI-1959) Add links to small file handling and clustering to the config section

2021-06-13 Thread Nishith Agarwal (Jira)
[ https://issues.apache.org/jira/browse/HUDI-1959?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17362615#comment-17362615 ] Nishith Agarwal commented on HUDI-1959: --- Added a FAQ here ->  https://cwiki.apache.o

[jira] [Resolved] (HUDI-1959) Add links to small file handling and clustering to the config section

2021-06-13 Thread Nishith Agarwal (Jira)
[ https://issues.apache.org/jira/browse/HUDI-1959?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Nishith Agarwal resolved HUDI-1959. --- Fix Version/s: 0.9.0 Resolution: Fixed > Add links to small file handling and clusterin

[jira] [Resolved] (HUDI-1960) Add documentation to be able to disable parquet configs

2021-06-13 Thread Nishith Agarwal (Jira)
[ https://issues.apache.org/jira/browse/HUDI-1960?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Nishith Agarwal resolved HUDI-1960. --- Fix Version/s: 0.9.0 Resolution: Fixed > Add documentation to be able to disable parque

[jira] [Commented] (HUDI-1960) Add documentation to be able to disable parquet configs

2021-06-13 Thread Nishith Agarwal (Jira)
[ https://issues.apache.org/jira/browse/HUDI-1960?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17362607#comment-17362607 ] Nishith Agarwal commented on HUDI-1960: --- Added a FAQ here -> https://cwiki.apache.or

[jira] [Commented] (HUDI-1975) Upgrade java-prometheus-client from 3.1.2 to 4.x

2021-06-13 Thread Nishith Agarwal (Jira)
[ https://issues.apache.org/jira/browse/HUDI-1975?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17362604#comment-17362604 ] Nishith Agarwal commented on HUDI-1975: --- [~vinaypatil18] It looks like even the late

[jira] [Updated] (HUDI-1975) Upgrade java-prometheus-client from 3.1.2 to 4.x

2021-06-13 Thread Nishith Agarwal (Jira)
[ https://issues.apache.org/jira/browse/HUDI-1975?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Nishith Agarwal updated HUDI-1975: -- Description: Find more details here ->  https://github.com/apache/hudi/issues/2774 > Upgrade jav

[jira] [Deleted] (HUDI-1945) Support Hudi to read from Kafka Consumer Group Offset

2021-06-13 Thread Nishith Agarwal (Jira)
[ https://issues.apache.org/jira/browse/HUDI-1945?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Nishith Agarwal deleted HUDI-1945: -- > Support Hudi to read from Kafka Consumer Group Offset > -

[jira] [Commented] (HUDI-1910) Supporting Kafka based checkpointing for HoodieDeltaStreamer

2021-06-13 Thread Nishith Agarwal (Jira)
[ https://issues.apache.org/jira/browse/HUDI-1910?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17362600#comment-17362600 ] Nishith Agarwal commented on HUDI-1910: --- [~vinaypatil18] Thanks for sharing your app

[jira] [Commented] (HUDI-1175) Investigate CI test flakiness (hangs)

2021-06-13 Thread Raymond Xu (Jira)
[ https://issues.apache.org/jira/browse/HUDI-1175?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17362593#comment-17362593 ] Raymond Xu commented on HUDI-1175: -- [~shivnarayan] looks like there is one PR for this. c

[jira] [Commented] (HUDI-1910) Supporting Kafka based checkpointing for HoodieDeltaStreamer

2021-06-13 Thread Vinay (Jira)
[ https://issues.apache.org/jira/browse/HUDI-1910?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17362564#comment-17362564 ] Vinay commented on HUDI-1910: - [~nishith29]  Instead of Updating the HoodieWriteCommitCallback

[jira] [Updated] (HUDI-1910) Supporting Kafka based checkpointing for HoodieDeltaStreamer

2021-06-13 Thread Vinay (Jira)
[ https://issues.apache.org/jira/browse/HUDI-1910?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vinay updated HUDI-1910: Status: In Progress (was: Open) > Supporting Kafka based checkpointing for HoodieDeltaStreamer > --

[jira] [Reopened] (HUDI-1997) Fix hoodie.datasource.hive_sync.auto_create_database documentation

2021-06-13 Thread Vinay (Jira)
[ https://issues.apache.org/jira/browse/HUDI-1997?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vinay reopened HUDI-1997: - > Fix hoodie.datasource.hive_sync.auto_create_database documentation > --

[jira] [Resolved] (HUDI-1997) Fix hoodie.datasource.hive_sync.auto_create_database documentation

2021-06-13 Thread Vinay (Jira)
[ https://issues.apache.org/jira/browse/HUDI-1997?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vinay resolved HUDI-1997. - Resolution: Fixed > Fix hoodie.datasource.hive_sync.auto_create_database documentation >

[jira] [Commented] (HUDI-1997) Fix hoodie.datasource.hive_sync.auto_create_database documentation

2021-06-13 Thread Vinay (Jira)
[ https://issues.apache.org/jira/browse/HUDI-1997?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17362550#comment-17362550 ] Vinay commented on HUDI-1997: - Fixed - 64a8f53b25dd21fb737f783a5cf5d316fc0ae56d > Fix hoodie.

[jira] [Updated] (HUDI-1997) Fix hoodie.datasource.hive_sync.auto_create_database documentation

2021-06-13 Thread Vinay (Jira)
[ https://issues.apache.org/jira/browse/HUDI-1997?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vinay updated HUDI-1997: Status: Closed (was: Patch Available) > Fix hoodie.datasource.hive_sync.auto_create_database documentation > -

[jira] [Commented] (HUDI-2004) Move KafkaOffsetGen.CheckpointUtils test cases to independent class and improve coverage

2021-06-13 Thread Vinay (Jira)
[ https://issues.apache.org/jira/browse/HUDI-2004?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17362549#comment-17362549 ] Vinay commented on HUDI-2004: - Created PR - https://github.com/apache/hudi/pull/3072 > Move K

[jira] [Updated] (HUDI-2004) Move KafkaOffsetGen.CheckpointUtils test cases to independent class and improve coverage

2021-06-13 Thread Vinay (Jira)
[ https://issues.apache.org/jira/browse/HUDI-2004?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vinay updated HUDI-2004: Labels: pull-request-available (was: ) > Move KafkaOffsetGen.CheckpointUtils test cases to independent class and >

[jira] [Commented] (HUDI-1138) Re-implement marker files via timeline server

2021-06-13 Thread liwei (Jira)
[ https://issues.apache.org/jira/browse/HUDI-1138?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17362535#comment-17362535 ] liwei commented on HUDI-1138: - [~guoyihua] [~vinoth]:D hello , i have a question  * "When usi

[hudi] branch asf-site updated: Travis CI build asf-site

2021-06-13 Thread vinoth
This is an automated email from the ASF dual-hosted git repository. vinoth pushed a commit to branch asf-site in repository https://gitbox.apache.org/repos/asf/hudi.git The following commit(s) were added to refs/heads/asf-site by this push: new 25c5f04 Travis CI build asf-site 25c5f04 is d

[hudi] branch master updated: [HUDI-2000] Release file writer for merge handle #close (#3068)

2021-06-13 Thread leesf
This is an automated email from the ASF dual-hosted git repository. leesf pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/hudi.git The following commit(s) were added to refs/heads/master by this push: new 6e78682 [HUDI-2000] Release file writer for merge

[hudi] branch asf-site updated: [HUDI-1997] Adding Note for explicitly setting HIVE_AUTO_CREATE_DATABASE_OPT_KEY config (#3066)

2021-06-13 Thread leesf
This is an automated email from the ASF dual-hosted git repository. leesf pushed a commit to branch asf-site in repository https://gitbox.apache.org/repos/asf/hudi.git The following commit(s) were added to refs/heads/asf-site by this push: new 64a8f53 [HUDI-1997] Adding Note for explicitly

[hudi] branch master updated: [HUDI-1984] Support independent flink hudi compaction function (#3046)

2021-06-13 Thread garyli
This is an automated email from the ASF dual-hosted git repository. garyli pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/hudi.git The following commit(s) were added to refs/heads/master by this push: new 0c4f2fd [HUDI-1984] Support independent flink hud