[jira] [Created] (HUDI-6586) Add Incremental scan support to dbt

2023-07-24 Thread Vinoth Govindarajan (Jira)
Vinoth Govindarajan created HUDI-6586: - Summary: Add Incremental scan support to dbt Key: HUDI-6586 URL: https://issues.apache.org/jira/browse/HUDI-6586 Project: Apache Hudi Issue Type:

[jira] [Created] (HUDI-4254) Refactor SnowflakeSyncTool and BigQuerySyncTool

2022-06-14 Thread Vinoth Govindarajan (Jira)
Vinoth Govindarajan created HUDI-4254: - Summary: Refactor SnowflakeSyncTool and BigQuerySyncTool Key: HUDI-4254 URL: https://issues.apache.org/jira/browse/HUDI-4254 Project: Apache Hudi

[jira] [Created] (HUDI-4220) Create a utility to convert json records to avro

2022-06-09 Thread Vinoth Govindarajan (Jira)
Vinoth Govindarajan created HUDI-4220: - Summary: Create a utility to convert json records to avro Key: HUDI-4220 URL: https://issues.apache.org/jira/browse/HUDI-4220 Project: Apache Hudi

[jira] [Updated] (HUDI-2832) [Umbrella] [RFC-40] Integrated Hudi with Snowflake

2022-05-22 Thread Vinoth Govindarajan (Jira)
[ https://issues.apache.org/jira/browse/HUDI-2832?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vinoth Govindarajan updated HUDI-2832: -- Summary: [Umbrella] [RFC-40] Integrated Hudi with Snowflake (was: [Umbrella] [RFC-40]

[jira] [Created] (HUDI-4137) Implement SnowflakeSyncTool to support Hudi to Snowflake Integration

2022-05-22 Thread Vinoth Govindarajan (Jira)
Vinoth Govindarajan created HUDI-4137: - Summary: Implement SnowflakeSyncTool to support Hudi to Snowflake Integration Key: HUDI-4137 URL: https://issues.apache.org/jira/browse/HUDI-4137 Project:

[jira] [Updated] (HUDI-4000) Docs around DBT

2022-05-04 Thread Vinoth Govindarajan (Jira)
[ https://issues.apache.org/jira/browse/HUDI-4000?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vinoth Govindarajan updated HUDI-4000: -- Status: Patch Available (was: In Progress) > Docs around DBT > --- > >

[jira] [Updated] (HUDI-4000) Docs around DBT

2022-05-04 Thread Vinoth Govindarajan (Jira)
[ https://issues.apache.org/jira/browse/HUDI-4000?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vinoth Govindarajan updated HUDI-4000: -- Status: In Progress (was: Open) > Docs around DBT > --- > >

[jira] [Closed] (HUDI-1743) Add support for Spark SQL File based transformer for deltastreamer

2022-04-24 Thread Vinoth Govindarajan (Jira)
[ https://issues.apache.org/jira/browse/HUDI-1743?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vinoth Govindarajan closed HUDI-1743. - Resolution: Fixed > Add support for Spark SQL File based transformer for deltastreamer >

[jira] [Reopened] (HUDI-1743) Add support for Spark SQL File based transformer for deltastreamer

2022-04-24 Thread Vinoth Govindarajan (Jira)
[ https://issues.apache.org/jira/browse/HUDI-1743?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vinoth Govindarajan reopened HUDI-1743: --- > Add support for Spark SQL File based transformer for deltastreamer >

[jira] [Resolved] (HUDI-1743) Add support for Spark SQL File based transformer for deltastreamer

2022-04-24 Thread Vinoth Govindarajan (Jira)
[ https://issues.apache.org/jira/browse/HUDI-1743?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vinoth Govindarajan resolved HUDI-1743. --- > Add support for Spark SQL File based transformer for deltastreamer >

[jira] [Closed] (HUDI-1790) Add SqlSource for DeltaStreamer to support backfill use cases

2022-04-24 Thread Vinoth Govindarajan (Jira)
[ https://issues.apache.org/jira/browse/HUDI-1790?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vinoth Govindarajan closed HUDI-1790. - Resolution: Fixed > Add SqlSource for DeltaStreamer to support backfill use cases >

[jira] [Resolved] (HUDI-1762) Hive Sync is not working with Hive Style Partitioning

2022-04-24 Thread Vinoth Govindarajan (Jira)
[ https://issues.apache.org/jira/browse/HUDI-1762?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vinoth Govindarajan resolved HUDI-1762. --- > Hive Sync is not working with Hive Style Partitioning >

[jira] [Closed] (HUDI-1762) Hive Sync is not working with Hive Style Partitioning

2022-04-24 Thread Vinoth Govindarajan (Jira)
[ https://issues.apache.org/jira/browse/HUDI-1762?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vinoth Govindarajan closed HUDI-1762. - Resolution: Fixed > Hive Sync is not working with Hive Style Partitioning >

[jira] [Reopened] (HUDI-1762) Hive Sync is not working with Hive Style Partitioning

2022-04-24 Thread Vinoth Govindarajan (Jira)
[ https://issues.apache.org/jira/browse/HUDI-1762?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vinoth Govindarajan reopened HUDI-1762: --- > Hive Sync is not working with Hive Style Partitioning >

[jira] [Reopened] (HUDI-1790) Add SqlSource for DeltaStreamer to support backfill use cases

2022-04-24 Thread Vinoth Govindarajan (Jira)
[ https://issues.apache.org/jira/browse/HUDI-1790?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vinoth Govindarajan reopened HUDI-1790: --- > Add SqlSource for DeltaStreamer to support backfill use cases >

[jira] [Resolved] (HUDI-1790) Add SqlSource for DeltaStreamer to support backfill use cases

2022-04-24 Thread Vinoth Govindarajan (Jira)
[ https://issues.apache.org/jira/browse/HUDI-1790?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vinoth Govindarajan resolved HUDI-1790. --- > Add SqlSource for DeltaStreamer to support backfill use cases >

[jira] [Closed] (HUDI-2319) Integrate hudi with dbt (data build tool)

2022-04-12 Thread Vinoth Govindarajan (Jira)
[ https://issues.apache.org/jira/browse/HUDI-2319?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vinoth Govindarajan closed HUDI-2319. - Resolution: Fixed > Integrate hudi with dbt (data build tool) >

[jira] [Resolved] (HUDI-3838) Make Drop partition column config work with deltastreamer

2022-04-12 Thread Vinoth Govindarajan (Jira)
[ https://issues.apache.org/jira/browse/HUDI-3838?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vinoth Govindarajan resolved HUDI-3838. --- > Make Drop partition column config work with deltastreamer >

[jira] [Commented] (HUDI-3838) Make Drop partition column config work with deltastreamer

2022-04-12 Thread Vinoth Govindarajan (Jira)
[ https://issues.apache.org/jira/browse/HUDI-3838?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17521370#comment-17521370 ] Vinoth Govindarajan commented on HUDI-3838: --- Added the support, see the linked PR for more

[jira] [Closed] (HUDI-3838) Make Drop partition column config work with deltastreamer

2022-04-12 Thread Vinoth Govindarajan (Jira)
[ https://issues.apache.org/jira/browse/HUDI-3838?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vinoth Govindarajan closed HUDI-3838. - Resolution: Fixed > Make Drop partition column config work with deltastreamer >

[jira] [Updated] (HUDI-3838) Make Drop partition column config work with deltastreamer

2022-04-11 Thread Vinoth Govindarajan (Jira)
[ https://issues.apache.org/jira/browse/HUDI-3838?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vinoth Govindarajan updated HUDI-3838: -- Status: Patch Available (was: In Progress) > Make Drop partition column config work

[jira] [Updated] (HUDI-2438) [Umbrella] [RFC-34] Implement BigQuerySyncTool for BigQuery Sync

2022-04-04 Thread Vinoth Govindarajan (Jira)
[ https://issues.apache.org/jira/browse/HUDI-2438?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vinoth Govindarajan updated HUDI-2438: -- Status: In Progress (was: Open) > [Umbrella] [RFC-34] Implement BigQuerySyncTool for

[jira] [Updated] (HUDI-3371) Add Dremio integration support to hudi

2022-04-04 Thread Vinoth Govindarajan (Jira)
[ https://issues.apache.org/jira/browse/HUDI-3371?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vinoth Govindarajan updated HUDI-3371: -- Issue Type: New Feature (was: Task) > Add Dremio integration support to hudi >

[jira] [Comment Edited] (HUDI-2438) [Umbrella] [RFC-34] Implement BigQuerySyncTool for BigQuery Sync

2022-04-03 Thread Vinoth Govindarajan (Jira)
[ https://issues.apache.org/jira/browse/HUDI-2438?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17516608#comment-17516608 ] Vinoth Govindarajan edited comment on HUDI-2438 at 4/4/22 3:07 AM: --- Hi

[jira] [Commented] (HUDI-2438) [Umbrella] [RFC-34] Implement BigQuerySyncTool for BigQuery Sync

2022-04-03 Thread Vinoth Govindarajan (Jira)
[ https://issues.apache.org/jira/browse/HUDI-2438?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17516608#comment-17516608 ] Vinoth Govindarajan commented on HUDI-2438: --- Hi [~gauravrai0x] & [~l0s01w3], There is a way to

[jira] [Updated] (HUDI-3748) Hudi fails to insert into a partitioned table when the partition column is dropped from the parquet schema

2022-03-29 Thread Vinoth Govindarajan (Jira)
[ https://issues.apache.org/jira/browse/HUDI-3748?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vinoth Govindarajan updated HUDI-3748: -- Description: When you add this config to drop the partition column from the parquet

[jira] [Created] (HUDI-3748) Hudi fails to insert into a partitioned table when the partition column is dropped from the parquet schema

2022-03-29 Thread Vinoth Govindarajan (Jira)
Vinoth Govindarajan created HUDI-3748: - Summary: Hudi fails to insert into a partitioned table when the partition column is dropped from the parquet schema Key: HUDI-3748 URL:

[jira] [Updated] (HUDI-3020) Create a utility to generate mainfest file

2022-03-28 Thread Vinoth Govindarajan (Jira)
[ https://issues.apache.org/jira/browse/HUDI-3020?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vinoth Govindarajan updated HUDI-3020: -- Status: Patch Available (was: In Progress) > Create a utility to generate mainfest

[jira] [Updated] (HUDI-3020) Create a utility to generate mainfest file

2022-03-28 Thread Vinoth Govindarajan (Jira)
[ https://issues.apache.org/jira/browse/HUDI-3020?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vinoth Govindarajan updated HUDI-3020: -- Epic Link: HUDI-2438 (was: HUDI-2832) > Create a utility to generate mainfest file >

[jira] [Updated] (HUDI-3357) Implement the BigQuerySyncTool

2022-03-25 Thread Vinoth Govindarajan (Jira)
[ https://issues.apache.org/jira/browse/HUDI-3357?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vinoth Govindarajan updated HUDI-3357: -- Status: Patch Available (was: In Progress) > Implement the BigQuerySyncTool >

[jira] [Commented] (HUDI-3357) Implement the BigQuerySyncTool

2022-03-24 Thread Vinoth Govindarajan (Jira)
[ https://issues.apache.org/jira/browse/HUDI-3357?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17512104#comment-17512104 ] Vinoth Govindarajan commented on HUDI-3357: --- [~xushiyan] - Thanks for the remainder and being

[jira] [Assigned] (HUDI-3020) Create a utility to generate mainfest file

2022-03-08 Thread Vinoth Govindarajan (Jira)
[ https://issues.apache.org/jira/browse/HUDI-3020?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vinoth Govindarajan reassigned HUDI-3020: - Assignee: Prashant Wason (was: Vinoth Govindarajan) > Create a utility to

[jira] [Created] (HUDI-3570) [Umbrella] [RFC-TBD] Integrate Hudi with Dremio

2022-03-06 Thread Vinoth Govindarajan (Jira)
Vinoth Govindarajan created HUDI-3570: - Summary: [Umbrella] [RFC-TBD] Integrate Hudi with Dremio Key: HUDI-3570 URL: https://issues.apache.org/jira/browse/HUDI-3570 Project: Apache Hudi

[jira] [Assigned] (HUDI-3371) Add Dremio integration support to hudi

2022-02-07 Thread Vinoth Govindarajan (Jira)
[ https://issues.apache.org/jira/browse/HUDI-3371?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vinoth Govindarajan reassigned HUDI-3371: - Assignee: Vinoth Govindarajan > Add Dremio integration support to hudi >

[jira] [Created] (HUDI-3357) Implement the BigQuerySyncTool

2022-01-31 Thread Vinoth Govindarajan (Jira)
Vinoth Govindarajan created HUDI-3357: - Summary: Implement the BigQuerySyncTool Key: HUDI-3357 URL: https://issues.apache.org/jira/browse/HUDI-3357 Project: Apache Hudi Issue Type: New

[jira] [Assigned] (HUDI-3357) Implement the BigQuerySyncTool

2022-01-31 Thread Vinoth Govindarajan (Jira)
[ https://issues.apache.org/jira/browse/HUDI-3357?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vinoth Govindarajan reassigned HUDI-3357: - Assignee: Vinoth Govindarajan > Implement the BigQuerySyncTool >

[jira] [Assigned] (HUDI-3290) Make the .hoodie-partition-metadata as empty parquet file

2022-01-26 Thread Vinoth Govindarajan (Jira)
[ https://issues.apache.org/jira/browse/HUDI-3290?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vinoth Govindarajan reassigned HUDI-3290: - Assignee: Prashant Wason (was: Vinoth Govindarajan) > Make the

[jira] [Created] (HUDI-3290) Make the .hoodie-partition-metadata as empty parquet file

2022-01-20 Thread Vinoth Govindarajan (Jira)
Vinoth Govindarajan created HUDI-3290: - Summary: Make the .hoodie-partition-metadata as empty parquet file Key: HUDI-3290 URL: https://issues.apache.org/jira/browse/HUDI-3290 Project: Apache Hudi

[jira] [Comment Edited] (HUDI-2438) [Umbrella] [RFC-34] Implement BigQuerySyncTool for BigQuery Sync

2021-12-27 Thread Vinoth Govindarajan (Jira)
[ https://issues.apache.org/jira/browse/HUDI-2438?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17465859#comment-17465859 ] Vinoth Govindarajan edited comment on HUDI-2438 at 12/27/21, 8:01 PM: --

[jira] [Comment Edited] (HUDI-2438) [Umbrella] [RFC-34] Implement BigQuerySyncTool for BigQuery Sync

2021-12-27 Thread Vinoth Govindarajan (Jira)
[ https://issues.apache.org/jira/browse/HUDI-2438?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17465859#comment-17465859 ] Vinoth Govindarajan edited comment on HUDI-2438 at 12/27/21, 8:00 PM: --

[jira] [Commented] (HUDI-2438) [Umbrella] [RFC-34] Implement BigQuerySyncTool for BigQuery Sync

2021-12-27 Thread Vinoth Govindarajan (Jira)
[ https://issues.apache.org/jira/browse/HUDI-2438?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17465859#comment-17465859 ] Vinoth Govindarajan commented on HUDI-2438: --- Hi [~qiao.xu] - Good news!! I found a way to

[jira] [Created] (HUDI-3091) Make simple index as the default hoodie.index.type

2021-12-21 Thread Vinoth Govindarajan (Jira)
Vinoth Govindarajan created HUDI-3091: - Summary: Make simple index as the default hoodie.index.type Key: HUDI-3091 URL: https://issues.apache.org/jira/browse/HUDI-3091 Project: Apache Hudi

[jira] [Created] (HUDI-3020) Create a utility to generate mainfest file

2021-12-14 Thread Vinoth Govindarajan (Jira)
Vinoth Govindarajan created HUDI-3020: - Summary: Create a utility to generate mainfest file Key: HUDI-3020 URL: https://issues.apache.org/jira/browse/HUDI-3020 Project: Apache Hudi Issue

[jira] [Updated] (HUDI-2832) [Umbrella] [RFC-40] Implement SnowflakeSyncTool to support Hudi to Snowflake Integration

2021-12-14 Thread Vinoth Govindarajan (Jira)
[ https://issues.apache.org/jira/browse/HUDI-2832?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vinoth Govindarajan updated HUDI-2832: -- Status: In Progress (was: Open) > [Umbrella] [RFC-40] Implement SnowflakeSyncTool to

[jira] [Updated] (HUDI-2319) Integrate hudi with dbt (data build tool)

2021-12-07 Thread Vinoth Govindarajan (Jira)
[ https://issues.apache.org/jira/browse/HUDI-2319?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vinoth Govindarajan updated HUDI-2319: -- Fix Version/s: 0.10.0 (was: 0.11.0) > Integrate hudi with dbt

[jira] [Updated] (HUDI-2319) Integrate hudi with dbt (data build tool)

2021-12-07 Thread Vinoth Govindarajan (Jira)
[ https://issues.apache.org/jira/browse/HUDI-2319?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vinoth Govindarajan updated HUDI-2319: -- Status: Resolved (was: Patch Available) > Integrate hudi with dbt (data build tool) >

[jira] [Commented] (HUDI-2319) Integrate hudi with dbt (data build tool)

2021-12-07 Thread Vinoth Govindarajan (Jira)
[ https://issues.apache.org/jira/browse/HUDI-2319?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17454963#comment-17454963 ] Vinoth Govindarajan commented on HUDI-2319: --- Hudi support has been added to dbt, here is the

[jira] [Updated] (HUDI-2832) [Umbrella] [RFC-40] Implement SnowflakeSyncTool for Hudi to Snowflake Integration

2021-11-22 Thread Vinoth Govindarajan (Jira)
[ https://issues.apache.org/jira/browse/HUDI-2832?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vinoth Govindarajan updated HUDI-2832: -- Description: Snowflake is a fully managed service that’s simple to use but can power a

[jira] [Updated] (HUDI-2832) [Umbrella] [RFC-40] Implement SnowflakeSyncTool to support Hudi to Snowflake Integration

2021-11-22 Thread Vinoth Govindarajan (Jira)
[ https://issues.apache.org/jira/browse/HUDI-2832?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vinoth Govindarajan updated HUDI-2832: -- Summary: [Umbrella] [RFC-40] Implement SnowflakeSyncTool to support Hudi to Snowflake

[jira] [Created] (HUDI-2832) [Umbrella] [RFC-40] Implement SnowflakeSyncTool for Hudi to Snowflake Integration

2021-11-22 Thread Vinoth Govindarajan (Jira)
Vinoth Govindarajan created HUDI-2832: - Summary: [Umbrella] [RFC-40] Implement SnowflakeSyncTool for Hudi to Snowflake Integration Key: HUDI-2832 URL: https://issues.apache.org/jira/browse/HUDI-2832

[jira] [Commented] (HUDI-2438) [Umbrella] [RFC-34] Implement BigQuerySyncTool for BigQuery Sync

2021-11-22 Thread Vinoth Govindarajan (Jira)
[ https://issues.apache.org/jira/browse/HUDI-2438?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17447608#comment-17447608 ] Vinoth Govindarajan commented on HUDI-2438: --- Hi [~qiao.xu]!  After investigation, I've found

[jira] [Assigned] (HUDI-2681) Make hoodie record_key and preCombine_key optional

2021-11-03 Thread Vinoth Govindarajan (Jira)
[ https://issues.apache.org/jira/browse/HUDI-2681?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vinoth Govindarajan reassigned HUDI-2681: - Assignee: sivabalan narayanan > Make hoodie record_key and preCombine_key

[jira] [Created] (HUDI-2681) Make hoodie record_key and preCombine_key optional

2021-11-03 Thread Vinoth Govindarajan (Jira)
Vinoth Govindarajan created HUDI-2681: - Summary: Make hoodie record_key and preCombine_key optional Key: HUDI-2681 URL: https://issues.apache.org/jira/browse/HUDI-2681 Project: Apache Hudi

[jira] [Updated] (HUDI-2510) QuickStart html page is showing 404

2021-10-05 Thread Vinoth Govindarajan (Jira)
[ https://issues.apache.org/jira/browse/HUDI-2510?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vinoth Govindarajan updated HUDI-2510: -- Status: In Progress (was: Open) > QuickStart html page is showing 404 >

[jira] [Updated] (HUDI-2510) QuickStart html page is showing 404

2021-10-05 Thread Vinoth Govindarajan (Jira)
[ https://issues.apache.org/jira/browse/HUDI-2510?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vinoth Govindarajan updated HUDI-2510: -- Status: Patch Available (was: In Progress) > QuickStart html page is showing 404 >

[jira] [Commented] (HUDI-2510) QuickStart html page is showing 404

2021-10-05 Thread Vinoth Govindarajan (Jira)
[ https://issues.apache.org/jira/browse/HUDI-2510?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17424790#comment-17424790 ] Vinoth Govindarajan commented on HUDI-2510: --- [~rmahindra] - I have explored the option to add a

[jira] [Updated] (HUDI-2438) [Umbrella] [RFC-34] Implement BigQuerySyncTool for BigQuery Sync

2021-09-15 Thread Vinoth Govindarajan (Jira)
[ https://issues.apache.org/jira/browse/HUDI-2438?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vinoth Govindarajan updated HUDI-2438: -- Description: BigQuery is Google Cloud's fully managed, petabyte-scale, and

[jira] [Updated] (HUDI-2438) [Umbrella] [RFC-34] Implement BigQuerySyncTool for BigQuery Sync

2021-09-15 Thread Vinoth Govindarajan (Jira)
[ https://issues.apache.org/jira/browse/HUDI-2438?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vinoth Govindarajan updated HUDI-2438: -- Description: BigQuery is Google Cloud's fully managed, petabyte-scale, and

[jira] [Created] (HUDI-2438) [Umbrella] [RFC-34] Implement BigQuerySyncTool for BigQuery Sync

2021-09-15 Thread Vinoth Govindarajan (Jira)
Vinoth Govindarajan created HUDI-2438: - Summary: [Umbrella] [RFC-34] Implement BigQuerySyncTool for BigQuery Sync Key: HUDI-2438 URL: https://issues.apache.org/jira/browse/HUDI-2438 Project:

[jira] [Created] (HUDI-2407) [Website] Support staging site for per pull request

2021-09-08 Thread Vinoth Govindarajan (Jira)
Vinoth Govindarajan created HUDI-2407: - Summary: [Website] Support staging site for per pull request Key: HUDI-2407 URL: https://issues.apache.org/jira/browse/HUDI-2407 Project: Apache Hudi

[jira] [Updated] (HUDI-2357) MERGE INTO doesn't work for tables created using CTAS

2021-08-24 Thread Vinoth Govindarajan (Jira)
[ https://issues.apache.org/jira/browse/HUDI-2357?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vinoth Govindarajan updated HUDI-2357: -- Description: MERGE INTO command doesn't select the correct primary key for tables

[jira] [Updated] (HUDI-2357) MERGE INTO doesn't work for tables created using CTAS

2021-08-24 Thread Vinoth Govindarajan (Jira)
[ https://issues.apache.org/jira/browse/HUDI-2357?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vinoth Govindarajan updated HUDI-2357: -- Description: MERGE INTO command doesn't select the correct primary key for tables

[jira] [Created] (HUDI-2357) MERGE INTO doesn't work for tables created using CTAS

2021-08-24 Thread Vinoth Govindarajan (Jira)
Vinoth Govindarajan created HUDI-2357: - Summary: MERGE INTO doesn't work for tables created using CTAS Key: HUDI-2357 URL: https://issues.apache.org/jira/browse/HUDI-2357 Project: Apache Hudi

[jira] [Updated] (HUDI-2319) Integrate hudi with dbt (data build tool)

2021-08-18 Thread Vinoth Govindarajan (Jira)
[ https://issues.apache.org/jira/browse/HUDI-2319?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vinoth Govindarajan updated HUDI-2319: -- Summary: Integrate hudi with dbt (data build tool) (was: Integrate hudi with dbt) >

[jira] [Updated] (HUDI-2319) Integrate hudi with dbt

2021-08-18 Thread Vinoth Govindarajan (Jira)
[ https://issues.apache.org/jira/browse/HUDI-2319?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vinoth Govindarajan updated HUDI-2319: -- Status: In Progress (was: Open) > Integrate hudi with dbt > --- >

[jira] [Created] (HUDI-2319) Integrate hudi with dbt

2021-08-18 Thread Vinoth Govindarajan (Jira)
Vinoth Govindarajan created HUDI-2319: - Summary: Integrate hudi with dbt Key: HUDI-2319 URL: https://issues.apache.org/jira/browse/HUDI-2319 Project: Apache Hudi Issue Type: New Feature

[jira] [Commented] (HUDI-2275) HoodieDeltaStreamerException when using OCC and a second concurrent writer

2021-08-11 Thread Vinoth Govindarajan (Jira)
[ https://issues.apache.org/jira/browse/HUDI-2275?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17397526#comment-17397526 ] Vinoth Govindarajan commented on HUDI-2275: --- I can confirm that the is the correct settings to

[jira] [Updated] (HUDI-1985) Website re-design implementation

2021-07-29 Thread Vinoth Govindarajan (Jira)
[ https://issues.apache.org/jira/browse/HUDI-1985?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vinoth Govindarajan updated HUDI-1985: -- Status: In Progress (was: Open) > Website re-design implementation >

[jira] [Assigned] (HUDI-1985) Website re-design implementation

2021-07-14 Thread Vinoth Govindarajan (Jira)
[ https://issues.apache.org/jira/browse/HUDI-1985?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vinoth Govindarajan reassigned HUDI-1985: - Assignee: Vinoth Govindarajan > Website re-design implementation >

[jira] [Commented] (HUDI-1985) Website re-design implementation

2021-07-12 Thread Vinoth Govindarajan (Jira)
[ https://issues.apache.org/jira/browse/HUDI-1985?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17379583#comment-17379583 ] Vinoth Govindarajan commented on HUDI-1985: --- Hi [~xushiyan], I have experience in the past

[jira] [Commented] (HUDI-1117) Add tdunning json library to spark and utilities bundle

2021-07-09 Thread Vinoth Govindarajan (Jira)
[ https://issues.apache.org/jira/browse/HUDI-1117?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17378256#comment-17378256 ] Vinoth Govindarajan commented on HUDI-1117: ---  Even after adding the JSON jar to the classpath,

[jira] [Updated] (HUDI-1743) Add support for Spark SQL File based transformer for deltastreamer

2021-06-09 Thread Vinoth Govindarajan (Jira)
[ https://issues.apache.org/jira/browse/HUDI-1743?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vinoth Govindarajan updated HUDI-1743: -- Status: Closed (was: Patch Available) > Add support for Spark SQL File based

[jira] [Updated] (HUDI-1790) Add SqlSource for DeltaStreamer to support backfill use cases

2021-04-28 Thread Vinoth Govindarajan (Jira)
[ https://issues.apache.org/jira/browse/HUDI-1790?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vinoth Govindarajan updated HUDI-1790: -- Status: Patch Available (was: In Progress) > Add SqlSource for DeltaStreamer to

[jira] [Commented] (HUDI-1747) Deltastreamer incremental read is not working on the MOR table

2021-04-19 Thread Vinoth Govindarajan (Jira)
[ https://issues.apache.org/jira/browse/HUDI-1747?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17325466#comment-17325466 ] Vinoth Govindarajan commented on HUDI-1747: --- [~shivnarayan] - Here are the answers: * Do you

[jira] [Updated] (HUDI-1790) Add SqlSource for DeltaStreamer to support backfill use cases

2021-04-12 Thread Vinoth Govindarajan (Jira)
[ https://issues.apache.org/jira/browse/HUDI-1790?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vinoth Govindarajan updated HUDI-1790: -- Status: In Progress (was: Open) > Add SqlSource for DeltaStreamer to support backfill

[jira] [Created] (HUDI-1790) Add SqlSource for DeltaStreamer to support backfill use cases

2021-04-12 Thread Vinoth Govindarajan (Jira)
Vinoth Govindarajan created HUDI-1790: - Summary: Add SqlSource for DeltaStreamer to support backfill use cases Key: HUDI-1790 URL: https://issues.apache.org/jira/browse/HUDI-1790 Project: Apache

[jira] [Updated] (HUDI-1743) Add support for Spark SQL File based transformer for deltastreamer

2021-04-08 Thread Vinoth Govindarajan (Jira)
[ https://issues.apache.org/jira/browse/HUDI-1743?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vinoth Govindarajan updated HUDI-1743: -- Status: Patch Available (was: In Progress) > Add support for Spark SQL File based

[jira] [Updated] (HUDI-1743) Add support for Spark SQL File based transformer for deltastreamer

2021-04-08 Thread Vinoth Govindarajan (Jira)
[ https://issues.apache.org/jira/browse/HUDI-1743?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vinoth Govindarajan updated HUDI-1743: -- Status: In Progress (was: Open) > Add support for Spark SQL File based transformer for

[jira] [Commented] (HUDI-1762) Hive Sync is not working with Hive Style Partitioning

2021-04-08 Thread Vinoth Govindarajan (Jira)
[ https://issues.apache.org/jira/browse/HUDI-1762?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17317655#comment-17317655 ] Vinoth Govindarajan commented on HUDI-1762: --- PR merged. > Hive Sync is not working with Hive

[jira] [Updated] (HUDI-1762) Hive Sync is not working with Hive Style Partitioning

2021-04-08 Thread Vinoth Govindarajan (Jira)
[ https://issues.apache.org/jira/browse/HUDI-1762?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vinoth Govindarajan updated HUDI-1762: -- Status: Closed (was: Patch Available) > Hive Sync is not working with Hive Style

[jira] [Updated] (HUDI-1770) Deltastreamer throws errors when not running frequently

2021-04-06 Thread Vinoth Govindarajan (Jira)
[ https://issues.apache.org/jira/browse/HUDI-1770?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vinoth Govindarajan updated HUDI-1770: -- Affects Version/s: 0.7.0 > Deltastreamer throws errors when not running frequently >

[jira] [Updated] (HUDI-1770) Deltastreamer throws errors when not running frequently

2021-04-06 Thread Vinoth Govindarajan (Jira)
[ https://issues.apache.org/jira/browse/HUDI-1770?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vinoth Govindarajan updated HUDI-1770: -- Affects Version/s: 0.8.0 > Deltastreamer throws errors when not running frequently >

[jira] [Updated] (HUDI-1770) Deltastreamer throws errors when not running frequently

2021-04-06 Thread Vinoth Govindarajan (Jira)
[ https://issues.apache.org/jira/browse/HUDI-1770?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vinoth Govindarajan updated HUDI-1770: -- Description: When delta streamer is using HoodieIncrSource from another parent Hudi

[jira] [Created] (HUDI-1770) Deltastreamer throws errors when not running frequently

2021-04-06 Thread Vinoth Govindarajan (Jira)
Vinoth Govindarajan created HUDI-1770: - Summary: Deltastreamer throws errors when not running frequently Key: HUDI-1770 URL: https://issues.apache.org/jira/browse/HUDI-1770 Project: Apache Hudi

[jira] [Updated] (HUDI-1762) Hive Sync is not working with Hive Style Partitioning

2021-04-04 Thread Vinoth Govindarajan (Jira)
[ https://issues.apache.org/jira/browse/HUDI-1762?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vinoth Govindarajan updated HUDI-1762: -- Status: Patch Available (was: In Progress) > Hive Sync is not working with Hive Style

[jira] [Updated] (HUDI-1762) Hive Sync is not working with Hive Style Partitioning

2021-04-04 Thread Vinoth Govindarajan (Jira)
[ https://issues.apache.org/jira/browse/HUDI-1762?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vinoth Govindarajan updated HUDI-1762: -- Status: In Progress (was: Open) > Hive Sync is not working with Hive Style

[jira] [Created] (HUDI-1762) Hive Sync is not working with Hive Style Partitioning

2021-04-04 Thread Vinoth Govindarajan (Jira)
Vinoth Govindarajan created HUDI-1762: - Summary: Hive Sync is not working with Hive Style Partitioning Key: HUDI-1762 URL: https://issues.apache.org/jira/browse/HUDI-1762 Project: Apache Hudi

[jira] [Created] (HUDI-1747) Deltastreamer incremental read is not working on the MOR table

2021-03-31 Thread Vinoth Govindarajan (Jira)
Vinoth Govindarajan created HUDI-1747: - Summary: Deltastreamer incremental read is not working on the MOR table Key: HUDI-1747 URL: https://issues.apache.org/jira/browse/HUDI-1747 Project: Apache

[jira] [Created] (HUDI-1743) Add support for Spark SQL File based transformer for deltastreamer

2021-03-30 Thread Vinoth Govindarajan (Jira)
Vinoth Govindarajan created HUDI-1743: - Summary: Add support for Spark SQL File based transformer for deltastreamer Key: HUDI-1743 URL: https://issues.apache.org/jira/browse/HUDI-1743 Project:

[jira] [Closed] (HUDI-783) Add official python support to create hudi datasets using pyspark

2021-03-30 Thread Vinoth Govindarajan (Jira)
[ https://issues.apache.org/jira/browse/HUDI-783?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vinoth Govindarajan closed HUDI-783. > Add official python support to create hudi datasets using pyspark >

[jira] [Resolved] (HUDI-1695) Deltastreamer HoodieIncrSource exception error messaging is incorrect

2021-03-16 Thread Vinoth Govindarajan (Jira)
[ https://issues.apache.org/jira/browse/HUDI-1695?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vinoth Govindarajan resolved HUDI-1695. --- Resolution: Fixed > Deltastreamer HoodieIncrSource exception error messaging is

[jira] [Closed] (HUDI-1695) Deltastreamer HoodieIncrSource exception error messaging is incorrect

2021-03-16 Thread Vinoth Govindarajan (Jira)
[ https://issues.apache.org/jira/browse/HUDI-1695?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vinoth Govindarajan closed HUDI-1695. - > Deltastreamer HoodieIncrSource exception error messaging is incorrect >

[jira] [Commented] (HUDI-1695) Deltastreamer HoodieIncrSource exception error messaging is incorrect

2021-03-15 Thread Vinoth Govindarajan (Jira)
[ https://issues.apache.org/jira/browse/HUDI-1695?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17302235#comment-17302235 ] Vinoth Govindarajan commented on HUDI-1695: --- PR has been merged. > Deltastreamer

[jira] [Updated] (HUDI-1695) Deltastreamer HoodieIncrSource exception error messaging is incorrect

2021-03-15 Thread Vinoth Govindarajan (Jira)
[ https://issues.apache.org/jira/browse/HUDI-1695?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vinoth Govindarajan updated HUDI-1695: -- Summary: Deltastreamer HoodieIncrSource exception error messaging is incorrect (was:

[jira] [Created] (HUDI-1695) Deltastream HoodieIncrSource exception error messaging is incorrect

2021-03-15 Thread Vinoth Govindarajan (Jira)
Vinoth Govindarajan created HUDI-1695: - Summary: Deltastream HoodieIncrSource exception error messaging is incorrect Key: HUDI-1695 URL: https://issues.apache.org/jira/browse/HUDI-1695 Project:

[jira] [Updated] (HUDI-825) Write a small blog on how to use hudi-spark with pyspark

2021-01-26 Thread Vinoth Govindarajan (Jira)
[ https://issues.apache.org/jira/browse/HUDI-825?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vinoth Govindarajan updated HUDI-825: - Status: Open (was: New) > Write a small blog on how to use hudi-spark with pyspark >

[jira] [Commented] (HUDI-824) Register hudi-spark package with spark packages repo for easier usage of Hudi

2021-01-26 Thread Vinoth Govindarajan (Jira)
[ https://issues.apache.org/jira/browse/HUDI-824?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17272397#comment-17272397 ] Vinoth Govindarajan commented on HUDI-824: -- [~nagarwal] - All the apache projects are available

[jira] [Updated] (HUDI-824) Register hudi-spark package with spark packages repo for easier usage of Hudi

2021-01-26 Thread Vinoth Govindarajan (Jira)
[ https://issues.apache.org/jira/browse/HUDI-824?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vinoth Govindarajan updated HUDI-824: - Status: Open (was: New) > Register hudi-spark package with spark packages repo for easier

[jira] [Commented] (HUDI-783) Add official python support to create hudi datasets using pyspark

2020-06-10 Thread Vinoth Govindarajan (Jira)
[ https://issues.apache.org/jira/browse/HUDI-783?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17130943#comment-17130943 ] Vinoth Govindarajan commented on HUDI-783: -- Status update: * -Explain how to read/write hudi

[jira] [Commented] (HUDI-783) Add official python support to create hudi datasets using pyspark

2020-04-16 Thread Vinoth Govindarajan (Jira)
[ https://issues.apache.org/jira/browse/HUDI-783?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17085253#comment-17085253 ] Vinoth Govindarajan commented on HUDI-783: -- Thanks, [~vinoth]! We don't need to write any wrapper

  1   2   >