[jira] [Created] (HUDI-235) Log files generated after pending compaction does not get deleted

2019-09-02 Thread Nishith Agarwal (Jira)
Nishith Agarwal created HUDI-235: Summary: Log files generated after pending compaction does not get deleted Key: HUDI-235 URL: https://issues.apache.org/jira/browse/HUDI-235 Project: Apache Hudi

[jira] [Created] (HUDI-283) Look at spark-shell and ensure that auto-tune for memory for spillable map has sane defaults

2019-09-25 Thread Nishith Agarwal (Jira)
Nishith Agarwal created HUDI-283: Summary: Look at spark-shell and ensure that auto-tune for memory for spillable map has sane defaults Key: HUDI-283 URL: https://issues.apache.org/jira/browse/HUDI-283

[jira] [Commented] (HUDI-180) Move HiveSyncTool registration from hive server (jdbc) to metastore (thrift)

2019-09-25 Thread Nishith Agarwal (Jira)
[ https://issues.apache.org/jira/browse/HUDI-180?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16938144#comment-16938144 ] Nishith Agarwal commented on HUDI-180: -- As of now, we did not shed any dependencies but provided

[jira] [Comment Edited] (HUDI-180) Move HiveSyncTool registration from hive server (jdbc) to metastore (thrift)

2019-09-25 Thread Nishith Agarwal (Jira)
[ https://issues.apache.org/jira/browse/HUDI-180?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16938144#comment-16938144 ] Nishith Agarwal edited comment on HUDI-180 at 9/26/19 12:10 AM: As of now,

[jira] [Updated] (HUDI-180) Move HiveSyncTool registration from hive server (jdbc) to metastore (thrift)

2019-09-25 Thread Nishith Agarwal (Jira)
[ https://issues.apache.org/jira/browse/HUDI-180?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Nishith Agarwal updated HUDI-180: - Status: Closed (was: Patch Available) > Move HiveSyncTool registration from hive server (jdbc) to

[jira] [Commented] (HUDI-114) Allow for clients to overwrite the payload implementation in hoodie.properties

2019-11-08 Thread Nishith Agarwal (Jira)
[ https://issues.apache.org/jira/browse/HUDI-114?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16970427#comment-16970427 ] Nishith Agarwal commented on HUDI-114: -- [~Pratyaksh] The payload class could be a custom

[jira] [Commented] (HUDI-289) Implement a long running test for Hudi writing and querying end-end

2019-10-31 Thread Nishith Agarwal (Jira)
[ https://issues.apache.org/jira/browse/HUDI-289?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16964261#comment-16964261 ] Nishith Agarwal commented on HUDI-289: -- [~yanghua] I'm working on resolving the comments on this PR : 

[jira] [Comment Edited] (HUDI-289) Implement a long running test for Hudi writing and querying end-end

2019-10-31 Thread Nishith Agarwal (Jira)
[ https://issues.apache.org/jira/browse/HUDI-289?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16964261#comment-16964261 ] Nishith Agarwal edited comment on HUDI-289 at 10/31/19 6:04 PM: [~yanghua] 

[jira] [Created] (HUDI-341) Append semantics support for Azure

2019-11-17 Thread Nishith Agarwal (Jira)
Nishith Agarwal created HUDI-341: Summary: Append semantics support for Azure Key: HUDI-341 URL: https://issues.apache.org/jira/browse/HUDI-341 Project: Apache Hudi (incubating) Issue Type:

[jira] [Created] (HUDI-337) Merge on Read incremental pull has in-consistent results

2019-11-16 Thread Nishith Agarwal (Jira)
Nishith Agarwal created HUDI-337: Summary: Merge on Read incremental pull has in-consistent results Key: HUDI-337 URL: https://issues.apache.org/jira/browse/HUDI-337 Project: Apache Hudi (incubating)

[jira] [Created] (HUDI-338) Reduce Hoodie commit/instant time granularity to millis from secs

2019-11-16 Thread Nishith Agarwal (Jira)
Nishith Agarwal created HUDI-338: Summary: Reduce Hoodie commit/instant time granularity to millis from secs Key: HUDI-338 URL: https://issues.apache.org/jira/browse/HUDI-338 Project: Apache Hudi

[jira] [Assigned] (HUDI-114) Allow for clients to overwrite the payload implementation in hoodie.properties

2019-11-06 Thread Nishith Agarwal (Jira)
[ https://issues.apache.org/jira/browse/HUDI-114?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Nishith Agarwal reassigned HUDI-114: Assignee: Pratyaksh Sharma (was: Nishith Agarwal) > Allow for clients to overwrite the

[jira] [Commented] (HUDI-114) Allow for clients to overwrite the payload implementation in hoodie.properties

2019-11-06 Thread Nishith Agarwal (Jira)
[ https://issues.apache.org/jira/browse/HUDI-114?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16968525#comment-16968525 ] Nishith Agarwal commented on HUDI-114: -- [~Pratyaksh] Glad to have you pick this up! Let me know if you

[jira] [Created] (HUDI-408) [Umbrella] Refactor/Code clean up hoodie write client

2019-12-13 Thread Nishith Agarwal (Jira)
Nishith Agarwal created HUDI-408: Summary: [Umbrella] Refactor/Code clean up hoodie write client Key: HUDI-408 URL: https://issues.apache.org/jira/browse/HUDI-408 Project: Apache Hudi (incubating)

[jira] [Created] (HUDI-410) HFile inlining into the log file

2019-12-13 Thread Nishith Agarwal (Jira)
Nishith Agarwal created HUDI-410: Summary: HFile inlining into the log file Key: HUDI-410 URL: https://issues.apache.org/jira/browse/HUDI-410 Project: Apache Hudi (incubating) Issue Type:

[jira] [Created] (HUDI-409) Replace Log Magic header with a secure hash to avoid clashes with data

2019-12-13 Thread Nishith Agarwal (Jira)
Nishith Agarwal created HUDI-409: Summary: Replace Log Magic header with a secure hash to avoid clashes with data Key: HUDI-409 URL: https://issues.apache.org/jira/browse/HUDI-409 Project: Apache

[jira] [Updated] (HUDI-408) [Umbrella] Refactor/Code clean up hoodie write client

2019-12-13 Thread Nishith Agarwal (Jira)
[ https://issues.apache.org/jira/browse/HUDI-408?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Nishith Agarwal updated HUDI-408: - Issue Type: Improvement (was: Bug) > [Umbrella] Refactor/Code clean up hoodie write client >

[jira] [Commented] (HUDI-410) HFile inlining into the log file

2019-12-14 Thread Nishith Agarwal (Jira)
[ https://issues.apache.org/jira/browse/HUDI-410?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16996460#comment-16996460 ] Nishith Agarwal commented on HUDI-410: -- At the moment, we can only stuff Avro inside a log block.

[jira] [Commented] (HUDI-409) Replace Log Magic header with a secure hash to avoid clashes with data

2019-12-14 Thread Nishith Agarwal (Jira)
[ https://issues.apache.org/jira/browse/HUDI-409?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16996462#comment-16996462 ] Nishith Agarwal commented on HUDI-409: -- No, the delta/log files can contain multiple log blocks. Each

[jira] [Created] (HUDI-371) CombineInputFormat for realtime tables

2019-11-26 Thread Nishith Agarwal (Jira)
Nishith Agarwal created HUDI-371: Summary: CombineInputFormat for realtime tables Key: HUDI-371 URL: https://issues.apache.org/jira/browse/HUDI-371 Project: Apache Hudi (incubating) Issue

[jira] [Assigned] (HUDI-371) CombineInputFormat for realtime tables

2019-11-26 Thread Nishith Agarwal (Jira)
[ https://issues.apache.org/jira/browse/HUDI-371?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Nishith Agarwal reassigned HUDI-371: Assignee: Nishith Agarwal > CombineInputFormat for realtime tables >

[jira] [Closed] (HUDI-56) Dynamically configure the number of entries in BloomFilter index based on size of the record #70

2019-10-02 Thread Nishith Agarwal (Jira)
[ https://issues.apache.org/jira/browse/HUDI-56?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Nishith Agarwal closed HUDI-56. --- Resolution: Duplicate > Dynamically configure the number of entries in BloomFilter index based on >

[jira] [Commented] (HUDI-56) Dynamically configure the number of entries in BloomFilter index based on size of the record #70

2019-10-02 Thread Nishith Agarwal (Jira)
[ https://issues.apache.org/jira/browse/HUDI-56?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16943316#comment-16943316 ] Nishith Agarwal commented on HUDI-56: - Closing this in favor of : 

[jira] [Assigned] (HUDI-258) Hive Query engine not supporting join queries between RT and RO tables

2019-10-02 Thread Nishith Agarwal (Jira)
[ https://issues.apache.org/jira/browse/HUDI-258?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Nishith Agarwal reassigned HUDI-258: Assignee: Nishith Agarwal > Hive Query engine not supporting join queries between RT and RO

[jira] [Commented] (HUDI-392) Introduce DIstributedTestDataSource to generate test data

2019-12-18 Thread Nishith Agarwal (Jira)
[ https://issues.apache.org/jira/browse/HUDI-392?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16999616#comment-16999616 ] Nishith Agarwal commented on HUDI-392: -- Great, will look out for it > Introduce

[jira] [Commented] (HUDI-34) HoodieArchivedTimeline not reading archived commits in CLI #425

2020-02-10 Thread Nishith Agarwal (Jira)
[ https://issues.apache.org/jira/browse/HUDI-34?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17034000#comment-17034000 ] Nishith Agarwal commented on HUDI-34: - [~satishkotha] is this one addressed now ? >

[jira] [Commented] (HUDI-92) Include custom names for spark HUDI spark DAG stages for easier understanding

2020-02-10 Thread Nishith Agarwal (Jira)
[ https://issues.apache.org/jira/browse/HUDI-92?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17034002#comment-17034002 ] Nishith Agarwal commented on HUDI-92: - [~pwason] are you working on this ? > Include custom names for

[jira] [Created] (HUDI-600) Cleaner fails with AVRO exception when upgrading from 0.5.0 to master

2020-02-05 Thread Nishith Agarwal (Jira)
Nishith Agarwal created HUDI-600: Summary: Cleaner fails with AVRO exception when upgrading from 0.5.0 to master Key: HUDI-600 URL: https://issues.apache.org/jira/browse/HUDI-600 Project: Apache Hudi

[jira] [Commented] (HUDI-573) Rolling stats written twice onto commit metadata

2020-01-24 Thread Nishith Agarwal (Jira)
[ https://issues.apache.org/jira/browse/HUDI-573?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17023171#comment-17023171 ] Nishith Agarwal commented on HUDI-573: -- The following PR

[jira] [Commented] (HUDI-515) Resolve API conflict for Hive 2 and Hive 3

2020-01-09 Thread Nishith Agarwal (Jira)
[ https://issues.apache.org/jira/browse/HUDI-515?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17012405#comment-17012405 ] Nishith Agarwal commented on HUDI-515: -- [~wenningd] Most of the code of 

[jira] [Created] (HUDI-464) Move to using classifier "core" for hive-exec for hive 2.x

2019-12-23 Thread Nishith Agarwal (Jira)
Nishith Agarwal created HUDI-464: Summary: Move to using classifier "core" for hive-exec for hive 2.x Key: HUDI-464 URL: https://issues.apache.org/jira/browse/HUDI-464 Project: Apache Hudi

[jira] [Commented] (HUDI-464) Move to using classifier "core" for hive-exec for hive 2.x

2019-12-23 Thread Nishith Agarwal (Jira)
[ https://issues.apache.org/jira/browse/HUDI-464?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17002572#comment-17002572 ] Nishith Agarwal commented on HUDI-464: -- [~akmodi] Can you please claim this ticket and add the

[jira] [Closed] (HUDI-410) HFile inlining into the log file

2019-12-24 Thread Nishith Agarwal (Jira)
[ https://issues.apache.org/jira/browse/HUDI-410?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Nishith Agarwal closed HUDI-410. Resolution: Duplicate > HFile inlining into the log file > > >

[jira] [Commented] (HUDI-410) HFile inlining into the log file

2019-12-24 Thread Nishith Agarwal (Jira)
[ https://issues.apache.org/jira/browse/HUDI-410?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17003116#comment-17003116 ] Nishith Agarwal commented on HUDI-410: -- [~shivnarayan] sounds good > HFile inlining into the log file

[jira] [Commented] (HUDI-397) Normalize log print statement

2020-01-07 Thread Nishith Agarwal (Jira)
[ https://issues.apache.org/jira/browse/HUDI-397?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17010096#comment-17010096 ] Nishith Agarwal commented on HUDI-397: -- [~yanghua] I agree, this was introduced by me during tests to

[jira] [Commented] (HUDI-433) Improve the way log block magic header is identified when a corrupt block is encountered #416

2020-01-07 Thread Nishith Agarwal (Jira)
[ https://issues.apache.org/jira/browse/HUDI-433?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17010098#comment-17010098 ] Nishith Agarwal commented on HUDI-433: -- Yes, we should close this one. > Improve the way log block

[jira] [Comment Edited] (HUDI-433) Improve the way log block magic header is identified when a corrupt block is encountered #416

2020-01-07 Thread Nishith Agarwal (Jira)
[ https://issues.apache.org/jira/browse/HUDI-433?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17010098#comment-17010098 ] Nishith Agarwal edited comment on HUDI-433 at 1/7/20 9:20 PM: -- Yes, we should

[jira] [Comment Edited] (HUDI-433) Improve the way log block magic header is identified when a corrupt block is encountered #416

2020-01-07 Thread Nishith Agarwal (Jira)
[ https://issues.apache.org/jira/browse/HUDI-433?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17010098#comment-17010098 ] Nishith Agarwal edited comment on HUDI-433 at 1/7/20 9:20 PM: -- [~vinoth]  Yes,

[jira] [Commented] (HUDI-41) Get rid of special casing Global Index for MOR rollback #394

2020-01-07 Thread Nishith Agarwal (Jira)
[ https://issues.apache.org/jira/browse/HUDI-41?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17010103#comment-17010103 ] Nishith Agarwal commented on HUDI-41: - We do have some special casing 

[jira] [Assigned] (HUDI-741) Fix Hoodie's schema evolution checks

2020-04-01 Thread Nishith Agarwal (Jira)
[ https://issues.apache.org/jira/browse/HUDI-741?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Nishith Agarwal reassigned HUDI-741: Assignee: Prashant Wason > Fix Hoodie's schema evolution checks >

[jira] [Assigned] (HUDI-266) Utility Script to restore Hudi dataset to previous instant

2020-04-01 Thread Nishith Agarwal (Jira)
[ https://issues.apache.org/jira/browse/HUDI-266?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Nishith Agarwal reassigned HUDI-266: Assignee: Ramachandran M S > Utility Script to restore Hudi dataset to previous instant >

[jira] [Assigned] (HUDI-825) Write a small blog on how to use hudi-spark with pyspark

2020-04-21 Thread Nishith Agarwal (Jira)
[ https://issues.apache.org/jira/browse/HUDI-825?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Nishith Agarwal reassigned HUDI-825: Assignee: Vinoth Govindarajan > Write a small blog on how to use hudi-spark with pyspark >

[jira] [Commented] (HUDI-824) Register hudi-spark package with spark packages repo for easier usage of Hudi

2020-04-21 Thread Nishith Agarwal (Jira)
[ https://issues.apache.org/jira/browse/HUDI-824?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17089020#comment-17089020 ] Nishith Agarwal commented on HUDI-824: -- [~vino] Assigning this to you like we discussed > Register

[jira] [Created] (HUDI-825) Write a small blog on how to use hudi-spark with pyspark

2020-04-21 Thread Nishith Agarwal (Jira)
Nishith Agarwal created HUDI-825: Summary: Write a small blog on how to use hudi-spark with pyspark Key: HUDI-825 URL: https://issues.apache.org/jira/browse/HUDI-825 Project: Apache Hudi (incubating)

[jira] [Created] (HUDI-824) Register hudi-spark package with spark packages repo for easier usage of Hudi

2020-04-21 Thread Nishith Agarwal (Jira)
Nishith Agarwal created HUDI-824: Summary: Register hudi-spark package with spark packages repo for easier usage of Hudi Key: HUDI-824 URL: https://issues.apache.org/jira/browse/HUDI-824 Project:

[jira] [Commented] (HUDI-825) Write a small blog on how to use hudi-spark with pyspark

2020-04-21 Thread Nishith Agarwal (Jira)
[ https://issues.apache.org/jira/browse/HUDI-825?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17089026#comment-17089026 ] Nishith Agarwal commented on HUDI-825: -- [~vino] Would you be able to write up a small blog post on how

[jira] [Comment Edited] (HUDI-824) Register hudi-spark package with spark packages repo for easier usage of Hudi

2020-04-21 Thread Nishith Agarwal (Jira)
[ https://issues.apache.org/jira/browse/HUDI-824?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17089020#comment-17089020 ] Nishith Agarwal edited comment on HUDI-824 at 4/21/20, 8:04 PM: [~vino] 

[jira] [Assigned] (HUDI-824) Register hudi-spark package with spark packages repo for easier usage of Hudi

2020-04-21 Thread Nishith Agarwal (Jira)
[ https://issues.apache.org/jira/browse/HUDI-824?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Nishith Agarwal reassigned HUDI-824: Assignee: Vinoth Govindarajan > Register hudi-spark package with spark packages repo for

[jira] [Created] (HUDI-831) Augment the existing DAG with more complex use-cases seen at Uber

2020-04-22 Thread Nishith Agarwal (Jira)
Nishith Agarwal created HUDI-831: Summary: Augment the existing DAG with more complex use-cases seen at Uber Key: HUDI-831 URL: https://issues.apache.org/jira/browse/HUDI-831 Project: Apache Hudi

[jira] [Created] (HUDI-832) Add ability to induce failures to catch issues

2020-04-22 Thread Nishith Agarwal (Jira)
Nishith Agarwal created HUDI-832: Summary: Add ability to induce failures to catch issues Key: HUDI-832 URL: https://issues.apache.org/jira/browse/HUDI-832 Project: Apache Hudi (incubating)

[jira] [Assigned] (HUDI-830) Fix issues related to running the test suite in docker due to Hive 2.x

2020-04-22 Thread Nishith Agarwal (Jira)
[ https://issues.apache.org/jira/browse/HUDI-830?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Nishith Agarwal reassigned HUDI-830: Assignee: Abhishek Modi > Fix issues related to running the test suite in docker due to

[jira] [Created] (HUDI-829) Reading Hudi tables through spark-shell slow (even with spark.sql.hive.convertMetastoreParquet)

2020-04-22 Thread Nishith Agarwal (Jira)
Nishith Agarwal created HUDI-829: Summary: Reading Hudi tables through spark-shell slow (even with spark.sql.hive.convertMetastoreParquet) Key: HUDI-829 URL: https://issues.apache.org/jira/browse/HUDI-829

[jira] [Updated] (HUDI-829) Reading Hudi tables through spark-shell is slow (even with spark.sql.hive.convertMetastoreParquet)

2020-04-22 Thread Nishith Agarwal (Jira)
[ https://issues.apache.org/jira/browse/HUDI-829?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Nishith Agarwal updated HUDI-829: - Summary: Reading Hudi tables through spark-shell is slow (even with

[jira] [Created] (HUDI-833) Allow test suite to change hudi write configs for any dag node

2020-04-22 Thread Nishith Agarwal (Jira)
Nishith Agarwal created HUDI-833: Summary: Allow test suite to change hudi write configs for any dag node Key: HUDI-833 URL: https://issues.apache.org/jira/browse/HUDI-833 Project: Apache Hudi

[jira] [Created] (HUDI-830) Fix issues related to running the test suite in docker due to Hive 2.x

2020-04-22 Thread Nishith Agarwal (Jira)
Nishith Agarwal created HUDI-830: Summary: Fix issues related to running the test suite in docker due to Hive 2.x Key: HUDI-830 URL: https://issues.apache.org/jira/browse/HUDI-830 Project: Apache

[jira] [Updated] (HUDI-829) Efficiently reading hudi tables through spark-shell

2020-04-22 Thread Nishith Agarwal (Jira)
[ https://issues.apache.org/jira/browse/HUDI-829?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Nishith Agarwal updated HUDI-829: - Summary: Efficiently reading hudi tables through spark-shell (was: Reading Hudi tables through

[jira] [Updated] (HUDI-829) Efficiently reading hudi tables through spark-shell

2020-04-22 Thread Nishith Agarwal (Jira)
[ https://issues.apache.org/jira/browse/HUDI-829?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Nishith Agarwal updated HUDI-829: - Description: [~uditme] Created this ticket to track some discussion on read/query path of spark

[jira] [Created] (HUDI-856) Supporting multiple insert/upsert operations before commit()

2020-04-30 Thread Nishith Agarwal (Jira)
Nishith Agarwal created HUDI-856: Summary: Supporting multiple insert/upsert operations before commit() Key: HUDI-856 URL: https://issues.apache.org/jira/browse/HUDI-856 Project: Apache Hudi

[jira] [Created] (HUDI-893) Add spark datasource V2 reader support for Hudi tables

2020-05-13 Thread Nishith Agarwal (Jira)
Nishith Agarwal created HUDI-893: Summary: Add spark datasource V2 reader support for Hudi tables Key: HUDI-893 URL: https://issues.apache.org/jira/browse/HUDI-893 Project: Apache Hudi (incubating)

[jira] [Closed] (HUDI-894) Allow ability to use hive metastore thrift connection to register tables

2020-05-13 Thread Nishith Agarwal (Jira)
[ https://issues.apache.org/jira/browse/HUDI-894?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Nishith Agarwal closed HUDI-894. Resolution: Duplicate > Allow ability to use hive metastore thrift connection to register tables >

[jira] [Updated] (HUDI-894) Allow ability to use hive metastore thrift connection to register tables

2020-05-13 Thread Nishith Agarwal (Jira)
[ https://issues.apache.org/jira/browse/HUDI-894?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Nishith Agarwal updated HUDI-894: - Status: In Progress (was: Open) > Allow ability to use hive metastore thrift connection to

[jira] [Updated] (HUDI-894) Allow ability to use hive metastore thrift connection to register tables

2020-05-13 Thread Nishith Agarwal (Jira)
[ https://issues.apache.org/jira/browse/HUDI-894?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Nishith Agarwal updated HUDI-894: - Status: Open (was: New) > Allow ability to use hive metastore thrift connection to register

[jira] [Created] (HUDI-1286) Merge On Read queries (_rt) fails on docker demo for test suite

2020-09-15 Thread Nishith Agarwal (Jira)
Nishith Agarwal created HUDI-1286: - Summary: Merge On Read queries (_rt) fails on docker demo for test suite Key: HUDI-1286 URL: https://issues.apache.org/jira/browse/HUDI-1286 Project: Apache Hudi

[jira] [Created] (HUDI-1285) Merge On Read DAG incorrect in docker demo

2020-09-15 Thread Nishith Agarwal (Jira)
Nishith Agarwal created HUDI-1285: - Summary: Merge On Read DAG incorrect in docker demo Key: HUDI-1285 URL: https://issues.apache.org/jira/browse/HUDI-1285 Project: Apache Hudi Issue Type:

[jira] [Updated] (HUDI-1286) Merge On Read queries (_rt) fails on docker demo for test suite

2020-09-15 Thread Nishith Agarwal (Jira)
[ https://issues.apache.org/jira/browse/HUDI-1286?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Nishith Agarwal updated HUDI-1286: -- Description: When running the following query ->  {code:java} select count(*) from

[jira] [Updated] (HUDI-1286) Merge On Read queries (_rt) fails on docker demo for test suite

2020-09-15 Thread Nishith Agarwal (Jira)
[ https://issues.apache.org/jira/browse/HUDI-1286?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Nishith Agarwal updated HUDI-1286: -- Description: When running the following query ->  {code:java} select count(*) from

[jira] [Created] (HUDI-1316) Enhance logging of configs such as timeline layout, upgrade/downgrade, backwards compatible configs

2020-10-07 Thread Nishith Agarwal (Jira)
Nishith Agarwal created HUDI-1316: - Summary: Enhance logging of configs such as timeline layout, upgrade/downgrade, backwards compatible configs Key: HUDI-1316 URL: https://issues.apache.org/jira/browse/HUDI-1316

[jira] [Comment Edited] (HUDI-1204) NoClassDefFoundError with AbstractSyncTool while running HoodieTestSuiteJob

2020-08-20 Thread Nishith Agarwal (Jira)
[ https://issues.apache.org/jira/browse/HUDI-1204?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17181350#comment-17181350 ] Nishith Agarwal edited comment on HUDI-1204 at 8/20/20, 5:37 PM: - Can you

[jira] [Updated] (HUDI-1204) NoClassDefFoundError with AbstractSyncTool while running HoodieTestSuiteJob

2020-08-20 Thread Nishith Agarwal (Jira)
[ https://issues.apache.org/jira/browse/HUDI-1204?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Nishith Agarwal updated HUDI-1204: -- Attachment: complex-dag-cow-2.yaml > NoClassDefFoundError with AbstractSyncTool while running

[jira] [Commented] (HUDI-1204) NoClassDefFoundError with AbstractSyncTool while running HoodieTestSuiteJob

2020-08-20 Thread Nishith Agarwal (Jira)
[ https://issues.apache.org/jira/browse/HUDI-1204?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17181395#comment-17181395 ] Nishith Agarwal commented on HUDI-1204: --- [~vinoth] The setup works for me now on my local docker.

[jira] [Comment Edited] (HUDI-1204) NoClassDefFoundError with AbstractSyncTool while running HoodieTestSuiteJob

2020-08-20 Thread Nishith Agarwal (Jira)
[ https://issues.apache.org/jira/browse/HUDI-1204?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17181350#comment-17181350 ] Nishith Agarwal edited comment on HUDI-1204 at 8/20/20, 5:36 PM: - Can you

[jira] [Comment Edited] (HUDI-1204) NoClassDefFoundError with AbstractSyncTool while running HoodieTestSuiteJob

2020-08-20 Thread Nishith Agarwal (Jira)
[ https://issues.apache.org/jira/browse/HUDI-1204?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17181350#comment-17181350 ] Nishith Agarwal edited comment on HUDI-1204 at 8/20/20, 5:34 PM: - Can you

[jira] [Commented] (HUDI-1204) NoClassDefFoundError with AbstractSyncTool while running HoodieTestSuiteJob

2020-08-20 Thread Nishith Agarwal (Jira)
[ https://issues.apache.org/jira/browse/HUDI-1204?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17181350#comment-17181350 ] Nishith Agarwal commented on HUDI-1204: --- Can you replace this in the dag [~shivnarayan] and try -

[jira] [Commented] (HUDI-1204) NoClassDefFoundError with AbstractSyncTool while running HoodieTestSuiteJob

2020-08-19 Thread Nishith Agarwal (Jira)
[ https://issues.apache.org/jira/browse/HUDI-1204?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17180952#comment-17180952 ] Nishith Agarwal commented on HUDI-1204: --- Able to run one of the tests through Junit but not through

[jira] [Commented] (HUDI-1204) NoClassDefFoundError with AbstractSyncTool while running HoodieTestSuiteJob

2020-08-20 Thread Nishith Agarwal (Jira)
[ https://issues.apache.org/jira/browse/HUDI-1204?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17181499#comment-17181499 ] Nishith Agarwal commented on HUDI-1204: --- Here is the PR to run the tests -> 

[jira] [Commented] (HUDI-1204) NoClassDefFoundError with AbstractSyncTool while running HoodieTestSuiteJob

2020-08-20 Thread Nishith Agarwal (Jira)
[ https://issues.apache.org/jira/browse/HUDI-1204?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17181065#comment-17181065 ] Nishith Agarwal commented on HUDI-1204: --- Perform the following changes to run the test suite in

[jira] [Commented] (HUDI-1204) NoClassDefFoundError with AbstractSyncTool while running HoodieTestSuiteJob

2020-08-20 Thread Nishith Agarwal (Jira)
[ https://issues.apache.org/jira/browse/HUDI-1204?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17181067#comment-17181067 ] Nishith Agarwal commented on HUDI-1204: --- I will make a diff sometime tomorrow but this might not go

[jira] [Commented] (HUDI-1204) NoClassDefFoundError with AbstractSyncTool while running HoodieTestSuiteJob

2020-08-20 Thread Nishith Agarwal (Jira)
[ https://issues.apache.org/jira/browse/HUDI-1204?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17180979#comment-17180979 ] Nishith Agarwal commented on HUDI-1204: --- After some minor changes due to code refactoring and config

[jira] [Comment Edited] (HUDI-1204) NoClassDefFoundError with AbstractSyncTool while running HoodieTestSuiteJob

2020-08-20 Thread Nishith Agarwal (Jira)
[ https://issues.apache.org/jira/browse/HUDI-1204?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17180979#comment-17180979 ] Nishith Agarwal edited comment on HUDI-1204 at 8/20/20, 6:12 AM: - After

[jira] [Created] (HUDI-1299) Add youtube link for DC_THURS chat

2020-09-23 Thread Nishith Agarwal (Jira)
Nishith Agarwal created HUDI-1299: - Summary: Add youtube link for DC_THURS chat Key: HUDI-1299 URL: https://issues.apache.org/jira/browse/HUDI-1299 Project: Apache Hudi Issue Type:

[jira] [Created] (HUDI-1298) Add better error messages when IOException occurs during log file reading

2020-09-23 Thread Nishith Agarwal (Jira)
Nishith Agarwal created HUDI-1298: - Summary: Add better error messages when IOException occurs during log file reading Key: HUDI-1298 URL: https://issues.apache.org/jira/browse/HUDI-1298 Project:

[jira] [Commented] (HUDI-1298) Add better error messages when IOException occurs during log file reading

2020-09-29 Thread Nishith Agarwal (Jira)
[ https://issues.apache.org/jira/browse/HUDI-1298?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17203720#comment-17203720 ] Nishith Agarwal commented on HUDI-1298: --- [~309637554] I'd be glad to get some help on this, assigned

[jira] [Assigned] (HUDI-1298) Add better error messages when IOException occurs during log file reading

2020-09-29 Thread Nishith Agarwal (Jira)
[ https://issues.apache.org/jira/browse/HUDI-1298?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Nishith Agarwal reassigned HUDI-1298: - Assignee: liwei (was: Nishith Agarwal) > Add better error messages when IOException

[jira] [Commented] (HUDI-258) Hive Query engine not supporting join queries between RT and RO tables

2020-05-25 Thread Nishith Agarwal (Jira)
[ https://issues.apache.org/jira/browse/HUDI-258?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17116433#comment-17116433 ] Nishith Agarwal commented on HUDI-258: -- [~shivnarayan] I didn't get a chance to look into this after

[jira] [Created] (HUDI-962) HoodieLogFormatWriter and HoodieLogFileReader support for HoodieHFileDataBlock

2020-05-26 Thread Nishith Agarwal (Jira)
Nishith Agarwal created HUDI-962: Summary: HoodieLogFormatWriter and HoodieLogFileReader support for HoodieHFileDataBlock Key: HUDI-962 URL: https://issues.apache.org/jira/browse/HUDI-962 Project:

[jira] [Created] (HUDI-961) Implement HoodieHFileDataBlock to allow for logging Hfile to log blocks

2020-05-26 Thread Nishith Agarwal (Jira)
Nishith Agarwal created HUDI-961: Summary: Implement HoodieHFileDataBlock to allow for logging Hfile to log blocks Key: HUDI-961 URL: https://issues.apache.org/jira/browse/HUDI-961 Project: Apache

[jira] [Created] (HUDI-966) Rehaul hoodie table tests to absorb the hoodie table abstraction design

2020-05-26 Thread Nishith Agarwal (Jira)
Nishith Agarwal created HUDI-966: Summary: Rehaul hoodie table tests to absorb the hoodie table abstraction design Key: HUDI-966 URL: https://issues.apache.org/jira/browse/HUDI-966 Project: Apache

[jira] [Created] (HUDI-968) Creation of first base/snapshot metadata (similar to onboarding/bootstrapping)

2020-05-26 Thread Nishith Agarwal (Jira)
Nishith Agarwal created HUDI-968: Summary: Creation of first base/snapshot metadata (similar to onboarding/bootstrapping) Key: HUDI-968 URL: https://issues.apache.org/jira/browse/HUDI-968 Project:

[jira] [Created] (HUDI-957) Umbrella ticket for sequencing common tasks required to progress/unblock RFC-08, RFC-15 & RFC-19

2020-05-26 Thread Nishith Agarwal (Jira)
Nishith Agarwal created HUDI-957: Summary: Umbrella ticket for sequencing common tasks required to progress/unblock RFC-08, RFC-15 & RFC-19 Key: HUDI-957 URL: https://issues.apache.org/jira/browse/HUDI-957

[jira] [Reopened] (HUDI-435) Make async compaction/cleaning extensible to new usages

2020-05-26 Thread Nishith Agarwal (Jira)
[ https://issues.apache.org/jira/browse/HUDI-435?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Nishith Agarwal reopened HUDI-435: -- Assignee: Nishith Agarwal (was: sivabalan narayanan) > Make async compaction/cleaning

[jira] [Created] (HUDI-964) Multi Table Commits when modeling Index, consolidated metadata and data as a Hoodie Table

2020-05-26 Thread Nishith Agarwal (Jira)
Nishith Agarwal created HUDI-964: Summary: Multi Table Commits when modeling Index, consolidated metadata and data as a Hoodie Table Key: HUDI-964 URL: https://issues.apache.org/jira/browse/HUDI-964

[jira] [Created] (HUDI-965) HUDICLI support for new table abstraction implementation

2020-05-26 Thread Nishith Agarwal (Jira)
Nishith Agarwal created HUDI-965: Summary: HUDICLI support for new table abstraction implementation Key: HUDI-965 URL: https://issues.apache.org/jira/browse/HUDI-965 Project: Apache Hudi

[jira] [Assigned] (HUDI-957) Umbrella ticket for sequencing common tasks required to progress/unblock RFC-08, RFC-15 & RFC-19

2020-05-26 Thread Nishith Agarwal (Jira)
[ https://issues.apache.org/jira/browse/HUDI-957?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Nishith Agarwal reassigned HUDI-957: Assignee: Nishith Agarwal > Umbrella ticket for sequencing common tasks required to

[jira] [Assigned] (HUDI-435) Make async compaction/cleaning extensible to new usages

2020-05-26 Thread Nishith Agarwal (Jira)
[ https://issues.apache.org/jira/browse/HUDI-435?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Nishith Agarwal reassigned HUDI-435: Assignee: sivabalan narayanan (was: Nishith Agarwal) > Make async compaction/cleaning

[jira] [Created] (HUDI-958) Implementation for managing compaction across multiple Hudi tables (index, metadata, data..)

2020-05-26 Thread Nishith Agarwal (Jira)
Nishith Agarwal created HUDI-958: Summary: Implementation for managing compaction across multiple Hudi tables (index, metadata, data..) Key: HUDI-958 URL: https://issues.apache.org/jira/browse/HUDI-958

[jira] [Created] (HUDI-967) Configs rehaul to support table abstraction for metadata table, index table etc

2020-05-26 Thread Nishith Agarwal (Jira)
Nishith Agarwal created HUDI-967: Summary: Configs rehaul to support table abstraction for metadata table, index table etc Key: HUDI-967 URL: https://issues.apache.org/jira/browse/HUDI-967 Project:

[jira] [Created] (HUDI-960) HFile Writer and HFile Reader and plugging them into the HoodieFileGroupIO

2020-05-26 Thread Nishith Agarwal (Jira)
Nishith Agarwal created HUDI-960: Summary: HFile Writer and HFile Reader and plugging them into the HoodieFileGroupIO Key: HUDI-960 URL: https://issues.apache.org/jira/browse/HUDI-960 Project: Apache

[jira] [Created] (HUDI-959) HoodieTable abstraction with pluggable Base and Log formats

2020-05-26 Thread Nishith Agarwal (Jira)
Nishith Agarwal created HUDI-959: Summary: HoodieTable abstraction with pluggable Base and Log formats Key: HUDI-959 URL: https://issues.apache.org/jira/browse/HUDI-959 Project: Apache Hudi

[jira] [Created] (HUDI-963) HoodieMergedLogRecordScanner support for HoodieHFileDataBlocks

2020-05-26 Thread Nishith Agarwal (Jira)
Nishith Agarwal created HUDI-963: Summary: HoodieMergedLogRecordScanner support for HoodieHFileDataBlocks Key: HUDI-963 URL: https://issues.apache.org/jira/browse/HUDI-963 Project: Apache Hudi

[jira] [Created] (HUDI-969) Implement compaction strategies for consolidated metadata table

2020-05-26 Thread Nishith Agarwal (Jira)
Nishith Agarwal created HUDI-969: Summary: Implement compaction strategies for consolidated metadata table Key: HUDI-969 URL: https://issues.apache.org/jira/browse/HUDI-969 Project: Apache Hudi

  1   2   3   4   5   >