[jira] [Updated] (HUDI-1629) Change partitioner abstraction to implement multiple strategies

2022-03-27 Thread Raymond Xu (Jira)
[ https://issues.apache.org/jira/browse/HUDI-1629?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Raymond Xu updated HUDI-1629: - Labels: refactoring (was: ) > Change partitioner abstraction to implement multiple strategies >

[GitHub] [hudi] XuQianJin-Stars opened a new pull request #5147: [HUDI-2520] fix drop partition issue when sync to hive

2022-03-27 Thread GitBox
XuQianJin-Stars opened a new pull request #5147: URL: https://github.com/apache/hudi/pull/5147 ## *Tips* - *Thank you very much for contributing to Apache Hudi.* - *Please review https://hudi.apache.org/contribute/how-to-contribute before opening a pull request.* ## What is

[jira] [Updated] (HUDI-1629) Change partitioner abstraction to implement multiple strategies

2022-03-27 Thread Raymond Xu (Jira)
[ https://issues.apache.org/jira/browse/HUDI-1629?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Raymond Xu updated HUDI-1629: - Fix Version/s: (was: 0.11.0) > Change partitioner abstraction to implement multiple strategies >

[jira] [Updated] (HUDI-1629) Change partitioner abstraction to implement multiple strategies

2022-03-27 Thread Raymond Xu (Jira)
[ https://issues.apache.org/jira/browse/HUDI-1629?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Raymond Xu updated HUDI-1629: - Issue Type: New Feature (was: Task) > Change partitioner abstraction to implement multiple strategies >

[jira] [Updated] (HUDI-1616) Abstract out one off operations within dag

2022-03-27 Thread Raymond Xu (Jira)
[ https://issues.apache.org/jira/browse/HUDI-1616?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Raymond Xu updated HUDI-1616: - Issue Type: Test (was: Task) > Abstract out one off operations within dag >

[jira] [Updated] (HUDI-1616) Abstract out one off operations within dag

2022-03-27 Thread Raymond Xu (Jira)
[ https://issues.apache.org/jira/browse/HUDI-1616?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Raymond Xu updated HUDI-1616: - Fix Version/s: 0.12.0 > Abstract out one off operations within dag >

[jira] [Commented] (HUDI-1616) Abstract out one off operations within dag

2022-03-27 Thread Raymond Xu (Jira)
[ https://issues.apache.org/jira/browse/HUDI-1616?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17512965#comment-17512965 ] Raymond Xu commented on HUDI-1616: -- [~shivnarayan] is this done? or push to 0.12? > Abstract out one off

[jira] [Commented] (HUDI-1613) Document for interfaces for Spark on Hive & Spark Datasource integrations with index

2022-03-27 Thread Raymond Xu (Jira)
[ https://issues.apache.org/jira/browse/HUDI-1613?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17512964#comment-17512964 ] Raymond Xu commented on HUDI-1613: -- hi [~uditme] [~nishith29] [~ryanpife] what's the status for this? it

[jira] [Updated] (HUDI-1605) Add more documentation around archival process and configs

2022-03-27 Thread Raymond Xu (Jira)
[ https://issues.apache.org/jira/browse/HUDI-1605?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Raymond Xu updated HUDI-1605: - Issue Type: Task (was: Improvement) > Add more documentation around archival process and configs >

[jira] [Updated] (HUDI-1600) Fix document to reflect Hudi supports MOR for spark datasource for incremental queries

2022-03-27 Thread Raymond Xu (Jira)
[ https://issues.apache.org/jira/browse/HUDI-1600?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Raymond Xu updated HUDI-1600: - Issue Type: Task (was: Improvement) > Fix document to reflect Hudi supports MOR for spark datasource for

[jira] [Updated] (HUDI-1600) Fix document to reflect Hudi supports MOR for spark datasource for incremental queries

2022-03-27 Thread Raymond Xu (Jira)
[ https://issues.apache.org/jira/browse/HUDI-1600?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Raymond Xu updated HUDI-1600: - Fix Version/s: (was: 0.11.0) > Fix document to reflect Hudi supports MOR for spark datasource for >

[jira] [Updated] (HUDI-1599) enable cross AZ consistency by adding GloballyConsistentMetaClient

2022-03-27 Thread Raymond Xu (Jira)
[ https://issues.apache.org/jira/browse/HUDI-1599?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Raymond Xu updated HUDI-1599: - Fix Version/s: (was: 0.11.0) > enable cross AZ consistency by adding GloballyConsistentMetaClient >

[jira] [Updated] (HUDI-1599) enable cross AZ consistency by adding GloballyConsistentMetaClient

2022-03-27 Thread Raymond Xu (Jira)
[ https://issues.apache.org/jira/browse/HUDI-1599?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Raymond Xu updated HUDI-1599: - Component/s: meta-sync > enable cross AZ consistency by adding GloballyConsistentMetaClient >

[jira] [Updated] (HUDI-1593) Add support for "show restore" in hudi-cli

2022-03-27 Thread Raymond Xu (Jira)
[ https://issues.apache.org/jira/browse/HUDI-1593?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Raymond Xu updated HUDI-1593: - Epic Link: HUDI-1388 Fix Version/s: (was: 0.11.0) Labels: user-support-issues

[jira] [Updated] (HUDI-1593) Add support for "show restore" in hudi-cli

2022-03-27 Thread Raymond Xu (Jira)
[ https://issues.apache.org/jira/browse/HUDI-1593?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Raymond Xu updated HUDI-1593: - Issue Type: New Feature (was: Improvement) > Add support for "show restore" in hudi-cli >

[jira] [Updated] (HUDI-1593) Add support for "show restore" in hudi-cli

2022-03-27 Thread Raymond Xu (Jira)
[ https://issues.apache.org/jira/browse/HUDI-1593?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Raymond Xu updated HUDI-1593: - Component/s: cli > Add support for "show restore" in hudi-cli >

[jira] [Updated] (HUDI-1590) Support async clustering w/ test suite job

2022-03-27 Thread Raymond Xu (Jira)
[ https://issues.apache.org/jira/browse/HUDI-1590?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Raymond Xu updated HUDI-1590: - Issue Type: Test (was: Improvement) > Support async clustering w/ test suite job >

[jira] [Commented] (HUDI-1590) Support async clustering w/ test suite job

2022-03-27 Thread Raymond Xu (Jira)
[ https://issues.apache.org/jira/browse/HUDI-1590?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17512958#comment-17512958 ] Raymond Xu commented on HUDI-1590: -- [~legendtkl] did you get a chance to work on this? > Support async

[jira] [Updated] (HUDI-1590) Support async clustering w/ test suite job

2022-03-27 Thread Raymond Xu (Jira)
[ https://issues.apache.org/jira/browse/HUDI-1590?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Raymond Xu updated HUDI-1590: - Fix Version/s: 0.12.0 > Support async clustering w/ test suite job >

[jira] [Updated] (HUDI-1580) Disaster Recovery in case where HBASE index table becomes unrecoverable

2022-03-27 Thread Raymond Xu (Jira)
[ https://issues.apache.org/jira/browse/HUDI-1580?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Raymond Xu updated HUDI-1580: - Fix Version/s: (was: 0.11.0) > Disaster Recovery in case where HBASE index table becomes

[jira] [Updated] (HUDI-1580) Disaster Recovery in case where HBASE index table becomes unrecoverable

2022-03-27 Thread Raymond Xu (Jira)
[ https://issues.apache.org/jira/browse/HUDI-1580?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Raymond Xu updated HUDI-1580: - Labels: user-support-issues (was: sev:high user-support-issues) > Disaster Recovery in case where HBASE

[jira] [Updated] (HUDI-1575) Early detection by periodically checking last written commit & active markers

2022-03-27 Thread Raymond Xu (Jira)
[ https://issues.apache.org/jira/browse/HUDI-1575?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Raymond Xu updated HUDI-1575: - Issue Type: New Feature (was: Task) > Early detection by periodically checking last written commit &

[jira] [Updated] (HUDI-1575) Early detection by periodically checking last written commit & active markers

2022-03-27 Thread Raymond Xu (Jira)
[ https://issues.apache.org/jira/browse/HUDI-1575?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Raymond Xu updated HUDI-1575: - Fix Version/s: (was: 0.11.0) > Early detection by periodically checking last written commit & active

[jira] [Updated] (HUDI-1556) Add App Id and App name to HoodieDeltaStreamerMetrics

2022-03-27 Thread Raymond Xu (Jira)
[ https://issues.apache.org/jira/browse/HUDI-1556?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Raymond Xu updated HUDI-1556: - Fix Version/s: 0.12.0 (was: 0.11.0) > Add App Id and App name to

[jira] [Updated] (HUDI-1556) Add App Id and App name to HoodieDeltaStreamerMetrics

2022-03-27 Thread Raymond Xu (Jira)
[ https://issues.apache.org/jira/browse/HUDI-1556?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Raymond Xu updated HUDI-1556: - Issue Type: New Feature (was: Task) > Add App Id and App name to HoodieDeltaStreamerMetrics >

[jira] [Updated] (HUDI-1530) Make HoodieDeltaStreamer and SparkDataSource support HiveMetaStore

2022-03-27 Thread Raymond Xu (Jira)
[ https://issues.apache.org/jira/browse/HUDI-1530?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Raymond Xu updated HUDI-1530: - Fix Version/s: (was: 0.11.0) > Make HoodieDeltaStreamer and SparkDataSource support HiveMetaStore >

[jira] [Updated] (HUDI-1530) Make HoodieDeltaStreamer and SparkDataSource support HiveMetaStore

2022-03-27 Thread Raymond Xu (Jira)
[ https://issues.apache.org/jira/browse/HUDI-1530?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Raymond Xu updated HUDI-1530: - Component/s: deltastreamer spark > Make HoodieDeltaStreamer and SparkDataSource support

[jira] [Commented] (HUDI-1530) Make HoodieDeltaStreamer and SparkDataSource support HiveMetaStore

2022-03-27 Thread Raymond Xu (Jira)
[ https://issues.apache.org/jira/browse/HUDI-1530?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17512957#comment-17512957 ] Raymond Xu commented on HUDI-1530: -- hi [~Trevorzhang] can you add more details to this pls ? > Make

[jira] [Updated] (HUDI-1530) Make HoodieDeltaStreamer and SparkDataSource support HiveMetaStore

2022-03-27 Thread Raymond Xu (Jira)
[ https://issues.apache.org/jira/browse/HUDI-1530?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Raymond Xu updated HUDI-1530: - Issue Type: New Feature (was: Improvement) > Make HoodieDeltaStreamer and SparkDataSource support

[jira] [Updated] (HUDI-1505) Allow pluggable option to write error records to side table, queue

2022-03-27 Thread Raymond Xu (Jira)
[ https://issues.apache.org/jira/browse/HUDI-1505?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Raymond Xu updated HUDI-1505: - Component/s: writer-core > Allow pluggable option to write error records to side table, queue >

[jira] [Updated] (HUDI-1505) Allow pluggable option to write error records to side table, queue

2022-03-27 Thread Raymond Xu (Jira)
[ https://issues.apache.org/jira/browse/HUDI-1505?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Raymond Xu updated HUDI-1505: - Fix Version/s: (was: 0.12.0) > Allow pluggable option to write error records to side table, queue >

[jira] [Updated] (HUDI-1505) Allow pluggable option to write error records to side table, queue

2022-03-27 Thread Raymond Xu (Jira)
[ https://issues.apache.org/jira/browse/HUDI-1505?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Raymond Xu updated HUDI-1505: - Fix Version/s: 0.12.0 (was: 0.11.0) > Allow pluggable option to write error

[jira] [Updated] (HUDI-1440) Allow option to override schema when doing spark.write

2022-03-27 Thread Raymond Xu (Jira)
[ https://issues.apache.org/jira/browse/HUDI-1440?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Raymond Xu updated HUDI-1440: - Epic Link: (was: HUDI-1239) > Allow option to override schema when doing spark.write >

[jira] [Updated] (HUDI-1440) Allow option to override schema when doing spark.write

2022-03-27 Thread Raymond Xu (Jira)
[ https://issues.apache.org/jira/browse/HUDI-1440?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Raymond Xu updated HUDI-1440: - Epic Link: HUDI-1239 > Allow option to override schema when doing spark.write >

[jira] [Updated] (HUDI-1440) Allow option to override schema when doing spark.write

2022-03-27 Thread Raymond Xu (Jira)
[ https://issues.apache.org/jira/browse/HUDI-1440?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Raymond Xu updated HUDI-1440: - Fix Version/s: 0.12.0 (was: 0.11.0) > Allow option to override schema when doing

[jira] [Updated] (HUDI-1440) Allow option to override schema when doing spark.write

2022-03-27 Thread Raymond Xu (Jira)
[ https://issues.apache.org/jira/browse/HUDI-1440?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Raymond Xu updated HUDI-1440: - Labels: user-support-issues (was: sev:normal user-support-issues) > Allow option to override schema when

[jira] [Closed] (HUDI-3725) no primary key error when spark read flink hudi table use default uuid

2022-03-27 Thread wulingqi (Jira)
[ https://issues.apache.org/jira/browse/HUDI-3725?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] wulingqi closed HUDI-3725. -- Resolution: Not A Bug > no primary key error when spark read flink hudi table use default uuid >

[jira] [Updated] (HUDI-1438) Move DataSourceOptions to hudi-client-common to reuse more code

2022-03-27 Thread Raymond Xu (Jira)
[ https://issues.apache.org/jira/browse/HUDI-1438?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Raymond Xu updated HUDI-1438: - Fix Version/s: 0.12.0 (was: 0.11.0) > Move DataSourceOptions to hudi-client-common

[jira] [Updated] (HUDI-1438) Move DataSourceOptions to hudi-client-common to reuse more code

2022-03-27 Thread Raymond Xu (Jira)
[ https://issues.apache.org/jira/browse/HUDI-1438?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Raymond Xu updated HUDI-1438: - Component/s: spark > Move DataSourceOptions to hudi-client-common to reuse more code >

[jira] [Updated] (HUDI-1438) Move DataSourceOptions to hudi-client-common to reuse more code

2022-03-27 Thread Raymond Xu (Jira)
[ https://issues.apache.org/jira/browse/HUDI-1438?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Raymond Xu updated HUDI-1438: - Labels: refactoring (was: ) > Move DataSourceOptions to hudi-client-common to reuse more code >

[jira] [Updated] (HUDI-1414) HoodieInputFormat support for bucketed partitions

2022-03-27 Thread Raymond Xu (Jira)
[ https://issues.apache.org/jira/browse/HUDI-1414?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Raymond Xu updated HUDI-1414: - Fix Version/s: (was: 0.11.0) > HoodieInputFormat support for bucketed partitions >

[jira] [Updated] (HUDI-1413) Need binary release of Hudi to distribute tools like hudi-cli.sh and hudi-sync

2022-03-27 Thread Raymond Xu (Jira)
[ https://issues.apache.org/jira/browse/HUDI-1413?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Raymond Xu updated HUDI-1413: - Epic Link: HUDI-1388 > Need binary release of Hudi to distribute tools like hudi-cli.sh and hudi-sync >

[jira] [Updated] (HUDI-1388) [UMBRELLA] Improve CLI features and usabilities

2022-03-27 Thread Raymond Xu (Jira)
[ https://issues.apache.org/jira/browse/HUDI-1388?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Raymond Xu updated HUDI-1388: - Epic Name: Improve Hudi CLI (was: Hudi CLI) > [UMBRELLA] Improve CLI features and usabilities >

[jira] [Updated] (HUDI-1413) Need binary release of Hudi to distribute tools like hudi-cli.sh and hudi-sync

2022-03-27 Thread Raymond Xu (Jira)
[ https://issues.apache.org/jira/browse/HUDI-1413?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Raymond Xu updated HUDI-1413: - Labels: (was: sev:normal) > Need binary release of Hudi to distribute tools like hudi-cli.sh and

[jira] [Updated] (HUDI-1413) Need binary release of Hudi to distribute tools like hudi-cli.sh and hudi-sync

2022-03-27 Thread Raymond Xu (Jira)
[ https://issues.apache.org/jira/browse/HUDI-1413?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Raymond Xu updated HUDI-1413: - Fix Version/s: (was: 0.11.0) > Need binary release of Hudi to distribute tools like hudi-cli.sh and

[jira] [Updated] (HUDI-1413) Need binary release of Hudi to distribute tools like hudi-cli.sh and hudi-sync

2022-03-27 Thread Raymond Xu (Jira)
[ https://issues.apache.org/jira/browse/HUDI-1413?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Raymond Xu updated HUDI-1413: - Component/s: cli > Need binary release of Hudi to distribute tools like hudi-cli.sh and hudi-sync >

[jira] [Updated] (HUDI-915) Partition Columns missing in files upserted after Metadata Bootstrap

2022-03-27 Thread Raymond Xu (Jira)
[ https://issues.apache.org/jira/browse/HUDI-915?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Raymond Xu updated HUDI-915: Fix Version/s: (was: 0.11.0) > Partition Columns missing in files upserted after Metadata Bootstrap >

[jira] [Updated] (HUDI-1380) Async cleaning does not work with Timeline Server

2022-03-27 Thread Raymond Xu (Jira)
[ https://issues.apache.org/jira/browse/HUDI-1380?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Raymond Xu updated HUDI-1380: - Story Points: (was: 4) > Async cleaning does not work with Timeline Server >

[jira] [Updated] (HUDI-1380) Async cleaning does not work with Timeline Server

2022-03-27 Thread Raymond Xu (Jira)
[ https://issues.apache.org/jira/browse/HUDI-1380?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Raymond Xu updated HUDI-1380: - Issue Type: Bug (was: Improvement) > Async cleaning does not work with Timeline Server >

[jira] [Updated] (HUDI-1380) Async cleaning does not work with Timeline Server

2022-03-27 Thread Raymond Xu (Jira)
[ https://issues.apache.org/jira/browse/HUDI-1380?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Raymond Xu updated HUDI-1380: - Priority: Major (was: Critical) > Async cleaning does not work with Timeline Server >

[jira] [Updated] (HUDI-1380) Async cleaning does not work with Timeline Server

2022-03-27 Thread Raymond Xu (Jira)
[ https://issues.apache.org/jira/browse/HUDI-1380?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Raymond Xu updated HUDI-1380: - Component/s: table-service timeline-server > Async cleaning does not work with Timeline

[jira] [Updated] (HUDI-1380) Async cleaning does not work with Timeline Server

2022-03-27 Thread Raymond Xu (Jira)
[ https://issues.apache.org/jira/browse/HUDI-1380?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Raymond Xu updated HUDI-1380: - Fix Version/s: 0.12.0 (was: 0.11.0) > Async cleaning does not work with Timeline

[jira] [Updated] (HUDI-1368) Merge On Read Snapshot Reader not working for Databricks on ADLS Gen2

2022-03-27 Thread Raymond Xu (Jira)
[ https://issues.apache.org/jira/browse/HUDI-1368?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Raymond Xu updated HUDI-1368: - Fix Version/s: (was: 0.11.0) > Merge On Read Snapshot Reader not working for Databricks on ADLS Gen2

[jira] [Updated] (HUDI-1368) Merge On Read Snapshot Reader not working for Databricks on ADLS Gen2

2022-03-27 Thread Raymond Xu (Jira)
[ https://issues.apache.org/jira/browse/HUDI-1368?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Raymond Xu updated HUDI-1368: - Labels: user-support-issues (was: adls query-eng sev:high user-support-issues) > Merge On Read Snapshot

[jira] [Updated] (HUDI-1368) Merge On Read Snapshot Reader not working for Databricks on ADLS Gen2

2022-03-27 Thread Raymond Xu (Jira)
[ https://issues.apache.org/jira/browse/HUDI-1368?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Raymond Xu updated HUDI-1368: - Component/s: reader-core > Merge On Read Snapshot Reader not working for Databricks on ADLS Gen2 >

[jira] [Updated] (HUDI-1329) Support async compaction in spark DF write()

2022-03-27 Thread Raymond Xu (Jira)
[ https://issues.apache.org/jira/browse/HUDI-1329?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Raymond Xu updated HUDI-1329: - Component/s: spark > Support async compaction in spark DF write() >

[jira] [Updated] (HUDI-1329) Support async compaction in spark DF write()

2022-03-27 Thread Raymond Xu (Jira)
[ https://issues.apache.org/jira/browse/HUDI-1329?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Raymond Xu updated HUDI-1329: - Component/s: table-service > Support async compaction in spark DF write() >

[jira] [Updated] (HUDI-1329) Support async compaction in spark DF write()

2022-03-27 Thread Raymond Xu (Jira)
[ https://issues.apache.org/jira/browse/HUDI-1329?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Raymond Xu updated HUDI-1329: - Fix Version/s: 0.12.0 (was: 0.11.0) > Support async compaction in spark DF write()

[GitHub] [hudi] hudi-bot removed a comment on pull request #5145: [HUDI-2520] fix CTAS statment issue when sync to hive

2022-03-27 Thread GitBox
hudi-bot removed a comment on pull request #5145: URL: https://github.com/apache/hudi/pull/5145#issuecomment-1079917024 ## CI report: * 05246d21de4705aca24d3c984b24025f0ddb62d8 Azure:

[GitHub] [hudi] hudi-bot commented on pull request #5145: [HUDI-2520] fix CTAS statment issue when sync to hive

2022-03-27 Thread GitBox
hudi-bot commented on pull request #5145: URL: https://github.com/apache/hudi/pull/5145#issuecomment-1079931620 ## CI report: * 05246d21de4705aca24d3c984b24025f0ddb62d8 Azure:

[jira] [Commented] (HUDI-3725) no primary key error when spark read flink hudi table use default uuid

2022-03-27 Thread wulingqi (Jira)
[ https://issues.apache.org/jira/browse/HUDI-3725?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17512947#comment-17512947 ] wulingqi commented on HUDI-3725: {code:java} Exception in thread "main"

[jira] [Created] (HUDI-3725) no primary key error when spark read flink hudi table use default uuid

2022-03-27 Thread wulingqi (Jira)
wulingqi created HUDI-3725: -- Summary: no primary key error when spark read flink hudi table use default uuid Key: HUDI-3725 URL: https://issues.apache.org/jira/browse/HUDI-3725 Project: Apache Hudi

[GitHub] [hudi] melin opened a new issue #5146: [SUPPORT] Optimize snapshot management, such as specifying snapshot names, support Branch, tag

2022-03-27 Thread GitBox
melin opened a new issue #5146: URL: https://github.com/apache/hudi/issues/5146 The discussion of iceberg : https://docs.google.com/document/d/1PvxK_0ebEoX3s7nS6-LOJJZdBYr_olTWH9oepNUfJ-A/edit# -- This is an automated message from the Apache Git Service. To respond to the message,

[jira] [Updated] (HUDI-1329) Support async compaction in spark DF write()

2022-03-27 Thread Raymond Xu (Jira)
[ https://issues.apache.org/jira/browse/HUDI-1329?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Raymond Xu updated HUDI-1329: - Issue Type: New Feature (was: Improvement) > Support async compaction in spark DF write() >

[jira] [Updated] (HUDI-1286) Merge On Read queries (_rt) fails on docker demo for test suite

2022-03-27 Thread Raymond Xu (Jira)
[ https://issues.apache.org/jira/browse/HUDI-1286?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Raymond Xu updated HUDI-1286: - Fix Version/s: 0.12.0 (was: 0.11.0) > Merge On Read queries (_rt) fails on docker

[jira] [Updated] (HUDI-1286) Merge On Read queries (_rt) fails on docker demo for test suite

2022-03-27 Thread Raymond Xu (Jira)
[ https://issues.apache.org/jira/browse/HUDI-1286?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Raymond Xu updated HUDI-1286: - Component/s: tests-ci > Merge On Read queries (_rt) fails on docker demo for test suite >

[jira] [Updated] (HUDI-1286) Merge On Read queries (_rt) fails on docker demo for test suite

2022-03-27 Thread Raymond Xu (Jira)
[ https://issues.apache.org/jira/browse/HUDI-1286?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Raymond Xu updated HUDI-1286: - Component/s: dev-experience > Merge On Read queries (_rt) fails on docker demo for test suite >

[jira] [Updated] (HUDI-1278) Need a generic payload class which can skip late arriving data based on specific fields

2022-03-27 Thread Raymond Xu (Jira)
[ https://issues.apache.org/jira/browse/HUDI-1278?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Raymond Xu updated HUDI-1278: - Component/s: writer-core > Need a generic payload class which can skip late arriving data based on >

[jira] [Updated] (HUDI-1278) Need a generic payload class which can skip late arriving data based on specific fields

2022-03-27 Thread Raymond Xu (Jira)
[ https://issues.apache.org/jira/browse/HUDI-1278?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Raymond Xu updated HUDI-1278: - Labels: user-support-issues (was: core-flow-ds sev:normal user-support-issues) > Need a generic payload

[jira] [Updated] (HUDI-1278) Need a generic payload class which can skip late arriving data based on specific fields

2022-03-27 Thread Raymond Xu (Jira)
[ https://issues.apache.org/jira/browse/HUDI-1278?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Raymond Xu updated HUDI-1278: - Fix Version/s: 0.12.0 (was: 0.11.0) > Need a generic payload class which can skip

[jira] [Updated] (HUDI-1275) Incremental TImeline Syncing causes compaction to fail with FileNotFound exception

2022-03-27 Thread Raymond Xu (Jira)
[ https://issues.apache.org/jira/browse/HUDI-1275?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Raymond Xu updated HUDI-1275: - Issue Type: Bug (was: Improvement) > Incremental TImeline Syncing causes compaction to fail with

[jira] [Updated] (HUDI-1275) Incremental TImeline Syncing causes compaction to fail with FileNotFound exception

2022-03-27 Thread Raymond Xu (Jira)
[ https://issues.apache.org/jira/browse/HUDI-1275?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Raymond Xu updated HUDI-1275: - Fix Version/s: 0.12.0 > Incremental TImeline Syncing causes compaction to fail with FileNotFound >

[jira] [Updated] (HUDI-1275) Incremental TImeline Syncing causes compaction to fail with FileNotFound exception

2022-03-27 Thread Raymond Xu (Jira)
[ https://issues.apache.org/jira/browse/HUDI-1275?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Raymond Xu updated HUDI-1275: - Labels: (was: hudi-on-call) > Incremental TImeline Syncing causes compaction to fail with FileNotFound

[jira] [Updated] (HUDI-1271) Add utility scripts to perform Restores

2022-03-27 Thread Raymond Xu (Jira)
[ https://issues.apache.org/jira/browse/HUDI-1271?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Raymond Xu updated HUDI-1271: - Fix Version/s: 0.12.0 (was: 0.11.0) > Add utility scripts to perform Restores >

[jira] [Updated] (HUDI-1271) Add utility scripts to perform Restores

2022-03-27 Thread Raymond Xu (Jira)
[ https://issues.apache.org/jira/browse/HUDI-1271?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Raymond Xu updated HUDI-1271: - Epic Link: HUDI-1388 (was: HUDI-1297) > Add utility scripts to perform Restores >

[jira] [Updated] (HUDI-1271) Add utility scripts to perform Restores

2022-03-27 Thread Raymond Xu (Jira)
[ https://issues.apache.org/jira/browse/HUDI-1271?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Raymond Xu updated HUDI-1271: - Issue Type: New Feature (was: Task) > Add utility scripts to perform Restores >

[jira] [Updated] (HUDI-1272) Add utility scripts to manage Savepoints

2022-03-27 Thread Raymond Xu (Jira)
[ https://issues.apache.org/jira/browse/HUDI-1272?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Raymond Xu updated HUDI-1272: - Fix Version/s: 0.12.0 (was: 0.11.0) > Add utility scripts to manage Savepoints >

[jira] [Updated] (HUDI-1272) Add utility scripts to manage Savepoints

2022-03-27 Thread Raymond Xu (Jira)
[ https://issues.apache.org/jira/browse/HUDI-1272?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Raymond Xu updated HUDI-1272: - Issue Type: New Feature (was: Task) > Add utility scripts to manage Savepoints >

[jira] [Updated] (HUDI-1272) Add utility scripts to manage Savepoints

2022-03-27 Thread Raymond Xu (Jira)
[ https://issues.apache.org/jira/browse/HUDI-1272?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Raymond Xu updated HUDI-1272: - Epic Link: HUDI-1388 (was: HUDI-1297) > Add utility scripts to manage Savepoints >

[jira] [Updated] (HUDI-2520) Certify sync with Hive 3

2022-03-27 Thread Forward Xu (Jira)
[ https://issues.apache.org/jira/browse/HUDI-2520?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Forward Xu updated HUDI-2520: - Attachment: image-2022-03-27-20-13-12-001.png > Certify sync with Hive 3 > > >

[jira] [Commented] (HUDI-2520) Certify sync with Hive 3

2022-03-27 Thread Forward Xu (Jira)
[ https://issues.apache.org/jira/browse/HUDI-2520?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17512940#comment-17512940 ] Forward Xu commented on HUDI-2520: -- hi [~rex_xiong]  Question 3, I did not reproduce this problem under

[jira] [Updated] (HUDI-2520) Certify sync with Hive 3

2022-03-27 Thread Forward Xu (Jira)
[ https://issues.apache.org/jira/browse/HUDI-2520?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Forward Xu updated HUDI-2520: - Attachment: image-2022-03-27-20-11-38-189.png > Certify sync with Hive 3 > > >

[jira] [Assigned] (HUDI-2520) Certify sync with Hive 3

2022-03-27 Thread Forward Xu (Jira)
[ https://issues.apache.org/jira/browse/HUDI-2520?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Forward Xu reassigned HUDI-2520: Assignee: Forward Xu (was: rex xiong) > Certify sync with Hive 3 > > >

[GitHub] [hudi] hudi-bot removed a comment on pull request #5145: [HUDI-2520] fix CTAS statment issue when sync to hive

2022-03-27 Thread GitBox
hudi-bot removed a comment on pull request #5145: URL: https://github.com/apache/hudi/pull/5145#issuecomment-1079916388 ## CI report: * 05246d21de4705aca24d3c984b24025f0ddb62d8 UNKNOWN Bot commands @hudi-bot supports the following commands: - `@hudi-bot

[GitHub] [hudi] hudi-bot commented on pull request #5145: [HUDI-2520] fix CTAS statment issue when sync to hive

2022-03-27 Thread GitBox
hudi-bot commented on pull request #5145: URL: https://github.com/apache/hudi/pull/5145#issuecomment-1079917024 ## CI report: * 05246d21de4705aca24d3c984b24025f0ddb62d8 Azure:

[GitHub] [hudi] hudi-bot commented on pull request #5145: [HUDI-2520] fix CTAS statment issue when sync to hive

2022-03-27 Thread GitBox
hudi-bot commented on pull request #5145: URL: https://github.com/apache/hudi/pull/5145#issuecomment-1079916388 ## CI report: * 05246d21de4705aca24d3c984b24025f0ddb62d8 UNKNOWN Bot commands @hudi-bot supports the following commands: - `@hudi-bot run azure`

[GitHub] [hudi] XuQianJin-Stars opened a new pull request #5145: [HUDI-2520] fix CTAS statment issue when sync to hive

2022-03-27 Thread GitBox
XuQianJin-Stars opened a new pull request #5145: URL: https://github.com/apache/hudi/pull/5145 ## *Tips* - *Thank you very much for contributing to Apache Hudi.* - *Please review https://hudi.apache.org/contribute/how-to-contribute before opening a pull request.* ## What is

[jira] [Updated] (HUDI-1267) Additional Metadata Details for Hudi Transactions

2022-03-27 Thread Raymond Xu (Jira)
[ https://issues.apache.org/jira/browse/HUDI-1267?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Raymond Xu updated HUDI-1267: - Labels: (was: features) > Additional Metadata Details for Hudi Transactions >

[jira] [Updated] (HUDI-1267) Additional Metadata Details for Hudi Transactions

2022-03-27 Thread Raymond Xu (Jira)
[ https://issues.apache.org/jira/browse/HUDI-1267?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Raymond Xu updated HUDI-1267: - Component/s: writer-core > Additional Metadata Details for Hudi Transactions >

[jira] [Updated] (HUDI-1267) Additional Metadata Details for Hudi Transactions

2022-03-27 Thread Raymond Xu (Jira)
[ https://issues.apache.org/jira/browse/HUDI-1267?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Raymond Xu updated HUDI-1267: - Fix Version/s: 0.12.0 (was: 0.11.0) > Additional Metadata Details for Hudi

[jira] [Updated] (HUDI-1262) Documentation Update for Insert Overwrite

2022-03-27 Thread Raymond Xu (Jira)
[ https://issues.apache.org/jira/browse/HUDI-1262?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Raymond Xu updated HUDI-1262: - Component/s: docs > Documentation Update for Insert Overwrite > -

[jira] [Updated] (HUDI-1261) CLI tools update to support REPLACE and insert overwrite

2022-03-27 Thread Raymond Xu (Jira)
[ https://issues.apache.org/jira/browse/HUDI-1261?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Raymond Xu updated HUDI-1261: - Component/s: cli > CLI tools update to support REPLACE and insert overwrite >

[jira] [Updated] (HUDI-1261) CLI tools update to support REPLACE and insert overwrite

2022-03-27 Thread Raymond Xu (Jira)
[ https://issues.apache.org/jira/browse/HUDI-1261?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Raymond Xu updated HUDI-1261: - Issue Type: New Feature (was: Task) > CLI tools update to support REPLACE and insert overwrite >

[jira] [Updated] (HUDI-1261) CLI tools update to support REPLACE and insert overwrite

2022-03-27 Thread Raymond Xu (Jira)
[ https://issues.apache.org/jira/browse/HUDI-1261?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Raymond Xu updated HUDI-1261: - Fix Version/s: 0.12.0 (was: 0.11.0) > CLI tools update to support REPLACE and

[jira] [Updated] (HUDI-1262) Documentation Update for Insert Overwrite

2022-03-27 Thread Raymond Xu (Jira)
[ https://issues.apache.org/jira/browse/HUDI-1262?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Raymond Xu updated HUDI-1262: - Fix Version/s: (was: 0.11.0) > Documentation Update for Insert Overwrite >

[jira] [Updated] (HUDI-1256) Follow on code improvements to HFile tables

2022-03-27 Thread Raymond Xu (Jira)
[ https://issues.apache.org/jira/browse/HUDI-1256?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Raymond Xu updated HUDI-1256: - Fix Version/s: 0.12.0 (was: 0.11.0) > Follow on code improvements to HFile tables

[jira] [Updated] (HUDI-1256) Follow on code improvements to HFile tables

2022-03-27 Thread Raymond Xu (Jira)
[ https://issues.apache.org/jira/browse/HUDI-1256?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Raymond Xu updated HUDI-1256: - Component/s: metadata (was: dev-experience) > Follow on code improvements to HFile

[jira] [Updated] (HUDI-1256) Follow on code improvements to HFile tables

2022-03-27 Thread Raymond Xu (Jira)
[ https://issues.apache.org/jira/browse/HUDI-1256?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Raymond Xu updated HUDI-1256: - Component/s: dev-experience > Follow on code improvements to HFile tables >

[jira] [Updated] (HUDI-1256) Follow on code improvements to HFile tables

2022-03-27 Thread Raymond Xu (Jira)
[ https://issues.apache.org/jira/browse/HUDI-1256?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Raymond Xu updated HUDI-1256: - Labels: refactoring (was: ) > Follow on code improvements to HFile tables >

[jira] [Updated] (HUDI-1247) Add jmh based benchmarking to hudi

2022-03-27 Thread Raymond Xu (Jira)
[ https://issues.apache.org/jira/browse/HUDI-1247?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Raymond Xu updated HUDI-1247: - Labels: performance (was: ) > Add jmh based benchmarking to hudi > -- >

<    1   2   3   4   5   6   7   >