[jira] [Commented] (HUDI-444) Refactor the codes based on scala codestyle NullChecker rule

2020-04-10 Thread Kotomi (Jira)
[ https://issues.apache.org/jira/browse/HUDI-444?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17080383#comment-17080383 ] Kotomi commented on HUDI-444: - removing `return` may cause different behavior.   for example: in

[jira] [Commented] (HUDI-764) Implement HoodieOrcWriter

2020-04-10 Thread renyi.bao (Jira)
[ https://issues.apache.org/jira/browse/HUDI-764?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17080447#comment-17080447 ] renyi.bao commented on HUDI-764: Sorry, I made a mistake > Implement HoodieOrcWriter >

[GitHub] [incubator-hudi] bhasudha opened a new pull request #1505: [HUDI - 738] Add validation to DeltaStreamer when filtetDupes is enabled on UPSERT mode

2020-04-10 Thread GitBox
bhasudha opened a new pull request #1505: [HUDI - 738] Add validation to DeltaStreamer when filtetDupes is enabled on UPSERT mode URL: https://github.com/apache/incubator-hudi/pull/1505 Summary: This fix ensures for UPSERT operation, '--filter-dupes' is disabled and fails fast if not.

[jira] [Updated] (HUDI-764) Implement HoodieOrcWriter

2020-04-10 Thread renyi.bao (Jira)
[ https://issues.apache.org/jira/browse/HUDI-764?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] renyi.bao updated HUDI-764: --- Status: In Progress (was: Open) > Implement HoodieOrcWriter > - > >

[jira] [Updated] (HUDI-764) Implement HoodieOrcWriter

2020-04-10 Thread renyi.bao (Jira)
[ https://issues.apache.org/jira/browse/HUDI-764?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] renyi.bao updated HUDI-764: --- Status: Patch Available (was: In Progress) > Implement HoodieOrcWriter > - > >

[GitHub] [incubator-hudi] garyli1019 commented on issue #1486: [HUDI-759] Integrate checkpoint privoder with delta streamer

2020-04-10 Thread GitBox
garyli1019 commented on issue #1486: [HUDI-759] Integrate checkpoint privoder with delta streamer URL: https://github.com/apache/incubator-hudi/pull/1486#issuecomment-611891832 hmm... Looks like the checkstyle auto-fix something...Let me see what's going...

[GitHub] [incubator-hudi] garyli1019 commented on issue #1486: [HUDI-759] Integrate checkpoint privoder with delta streamer

2020-04-10 Thread GitBox
garyli1019 commented on issue #1486: [HUDI-759] Integrate checkpoint privoder with delta streamer URL: https://github.com/apache/incubator-hudi/pull/1486#issuecomment-611897189 I added the save action and checkstyle as documented, not sure which one triggered all those `final` and `this`.

[GitHub] [incubator-hudi] lamber-ken commented on issue #1491: [SUPPORT] OutOfMemoryError during upsert 53M records

2020-04-10 Thread GitBox
lamber-ken commented on issue #1491: [SUPPORT] OutOfMemoryError during upsert 53M records URL: https://github.com/apache/incubator-hudi/issues/1491#issuecomment-611921813 Hi, here is spark command ``` export SPARK_HOME=/work/BigData/install/spark/spark-2.4.4-bin-hadoop2.7

[GitHub] [incubator-hudi] garyli1019 commented on a change in pull request #1486: [HUDI-759] Integrate checkpoint privoder with delta streamer

2020-04-10 Thread GitBox
garyli1019 commented on a change in pull request #1486: [HUDI-759] Integrate checkpoint privoder with delta streamer URL: https://github.com/apache/incubator-hudi/pull/1486#discussion_r406617505 ## File path:

[GitHub] [incubator-hudi] garyli1019 commented on a change in pull request #1486: [HUDI-759] Integrate checkpoint privoder with delta streamer

2020-04-10 Thread GitBox
garyli1019 commented on a change in pull request #1486: [HUDI-759] Integrate checkpoint privoder with delta streamer URL: https://github.com/apache/incubator-hudi/pull/1486#discussion_r406617783 ## File path:

[jira] [Created] (HUDI-783) Add official python support to create hudi datasets using pyspark

2020-04-10 Thread Vinoth Govindarajan (Jira)
Vinoth Govindarajan created HUDI-783: Summary: Add official python support to create hudi datasets using pyspark Key: HUDI-783 URL: https://issues.apache.org/jira/browse/HUDI-783 Project: Apache

[GitHub] [incubator-hudi] garyli1019 commented on a change in pull request #1486: [HUDI-759] Integrate checkpoint privoder with delta streamer

2020-04-10 Thread GitBox
garyli1019 commented on a change in pull request #1486: [HUDI-759] Integrate checkpoint privoder with delta streamer URL: https://github.com/apache/incubator-hudi/pull/1486#discussion_r406617865 ## File path:

[jira] [Updated] (HUDI-783) Add official python support to create hudi datasets using pyspark

2020-04-10 Thread Vinoth Govindarajan (Jira)
[ https://issues.apache.org/jira/browse/HUDI-783?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vinoth Govindarajan updated HUDI-783: - Description: *Goal:* As a pyspark user, I would like to read/write hudi datasets using

[jira] [Updated] (HUDI-783) Add official python support to create hudi datasets using pyspark

2020-04-10 Thread Vinoth Govindarajan (Jira)
[ https://issues.apache.org/jira/browse/HUDI-783?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vinoth Govindarajan updated HUDI-783: - Description: *Goal:* As a pyspark user, I would like to read/write hudi datasets using

[GitHub] [incubator-hudi] tverdokhlebd commented on issue #1491: [SUPPORT] OutOfMemoryError during upsert 53M records

2020-04-10 Thread GitBox
tverdokhlebd commented on issue #1491: [SUPPORT] OutOfMemoryError during upsert 53M records URL: https://github.com/apache/incubator-hudi/issues/1491#issuecomment-611920831 > I run those operations with local[2] and 6GB driver memory, still worked fine. How did you set memory? I

[GitHub] [incubator-hudi] hddong commented on issue #1452: [HUDI-740]Fix can not specify the sparkMaster and code clean for SparkUtil

2020-04-10 Thread GitBox
hddong commented on issue #1452: [HUDI-740]Fix can not specify the sparkMaster and code clean for SparkUtil URL: https://github.com/apache/incubator-hudi/pull/1452#issuecomment-612052977 @yanghua @pratyakshsharma thanks for your review.

[jira] [Commented] (HUDI-783) Add official python support to create hudi datasets using pyspark

2020-04-10 Thread Vinoth Chandar (Jira)
[ https://issues.apache.org/jira/browse/HUDI-783?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17080527#comment-17080527 ] Vinoth Chandar commented on HUDI-783: - This is great stuff.. Look forward to this.. We could probably

[jira] [Updated] (HUDI-783) Add official python support to create hudi datasets using pyspark

2020-04-10 Thread Vinoth Chandar (Jira)
[ https://issues.apache.org/jira/browse/HUDI-783?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vinoth Chandar updated HUDI-783: Status: Open (was: New) > Add official python support to create hudi datasets using pyspark >

[incubator-hudi] branch master updated: [HUDI - 738] Add validation to DeltaStreamer to fail fast when filterDupes is enabled on UPSERT mode. (#1505)

2020-04-10 Thread bhavanisudha
This is an automated email from the ASF dual-hosted git repository. bhavanisudha pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/incubator-hudi.git The following commit(s) were added to refs/heads/master by this push: new 8c7cef3 [HUDI - 738] Add

[GitHub] [incubator-hudi] bhasudha merged pull request #1505: [HUDI-738] Add validation to DeltaStreamer when filtetDupes is enabled on UPSERT mode

2020-04-10 Thread GitBox
bhasudha merged pull request #1505: [HUDI-738] Add validation to DeltaStreamer when filtetDupes is enabled on UPSERT mode URL: https://github.com/apache/incubator-hudi/pull/1505 This is an automated message from the Apache

[jira] [Updated] (HUDI-738) Add error msg in DeltaStreamer if `filterDupes=true` is enabled for `operation=UPSERT`.

2020-04-10 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HUDI-738?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated HUDI-738: Labels: pull-request-available (was: ) > Add error msg in DeltaStreamer if `filterDupes=true` is

[GitHub] [incubator-hudi] bvaradar commented on issue #1498: Migrating parquet table to hudi issue [SUPPORT]

2020-04-10 Thread GitBox
bvaradar commented on issue #1498: Migrating parquet table to hudi issue [SUPPORT] URL: https://github.com/apache/incubator-hudi/issues/1498#issuecomment-612113721 @vontman : This looks to me like the columnar file creation is taking close to 17 mins out of 25 mins. Can you also attach

[GitHub] [incubator-hudi] vinothchandar commented on issue #1504: [HUDI-780] Add junit 5

2020-04-10 Thread GitBox
vinothchandar commented on issue #1504: [HUDI-780] Add junit 5 URL: https://github.com/apache/incubator-hudi/pull/1504#issuecomment-612058285 @yanghua @xushiyan my style has been to only use javadocs when it warrants them. forced writing of trivial/obvious docs is not very helpful.. That

[GitHub] [incubator-hudi] lamber-ken closed issue #1499: [SUPPORT] DeltaStreamer - NoClassDefFoundError for HiveDriver

2020-04-10 Thread GitBox
lamber-ken closed issue #1499: [SUPPORT] DeltaStreamer - NoClassDefFoundError for HiveDriver URL: https://github.com/apache/incubator-hudi/issues/1499 This is an automated message from the Apache Git Service. To respond to

[jira] [Commented] (HUDI-432) Benchmark HFile for scan vs seek

2020-04-10 Thread Vinoth Chandar (Jira)
[ https://issues.apache.org/jira/browse/HUDI-432?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17080532#comment-17080532 ] Vinoth Chandar commented on HUDI-432: - On s3, we should also consider the random read optimizations..

[jira] [Commented] (HUDI-783) Add official python support to create hudi datasets using pyspark

2020-04-10 Thread Vinoth Chandar (Jira)
[ https://issues.apache.org/jira/browse/HUDI-783?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17080530#comment-17080530 ] Vinoth Chandar commented on HUDI-783: - Gave you contributor permissions .. and assigned the ticket to

[GitHub] [incubator-hudi] codecov-io commented on issue #1505: [HUDI-738] Add validation to DeltaStreamer when filtetDupes is enabled on UPSERT mode

2020-04-10 Thread GitBox
codecov-io commented on issue #1505: [HUDI-738] Add validation to DeltaStreamer when filtetDupes is enabled on UPSERT mode URL: https://github.com/apache/incubator-hudi/pull/1505#issuecomment-612079202 # [Codecov](https://codecov.io/gh/apache/incubator-hudi/pull/1505?src=pr=h1) Report

[jira] [Updated] (HUDI-738) Add error msg in DeltaStreamer if `filterDupes=true` is enabled for `operation=UPSERT`.

2020-04-10 Thread Bhavani Sudha (Jira)
[ https://issues.apache.org/jira/browse/HUDI-738?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bhavani Sudha updated HUDI-738: --- Status: Closed (was: Patch Available) > Add error msg in DeltaStreamer if `filterDupes=true` is

[jira] [Updated] (HUDI-738) Add error msg in DeltaStreamer if `filterDupes=true` is enabled for `operation=UPSERT`.

2020-04-10 Thread Bhavani Sudha (Jira)
[ https://issues.apache.org/jira/browse/HUDI-738?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bhavani Sudha updated HUDI-738: --- Status: Patch Available (was: In Progress) > Add error msg in DeltaStreamer if `filterDupes=true` is

[GitHub] [incubator-hudi] codecov-io edited a comment on issue #1486: [HUDI-759] Integrate checkpoint privoder with delta streamer

2020-04-10 Thread GitBox
codecov-io edited a comment on issue #1486: [HUDI-759] Integrate checkpoint privoder with delta streamer URL: https://github.com/apache/incubator-hudi/pull/1486#issuecomment-609364046 # [Codecov](https://codecov.io/gh/apache/incubator-hudi/pull/1486?src=pr=h1) Report > Merging

[GitHub] [incubator-hudi] n3nash commented on issue #1053: [HUDI-371] : Support CombineInputFormat for RT tables

2020-04-10 Thread GitBox
n3nash commented on issue #1053: [HUDI-371] : Support CombineInputFormat for RT tables URL: https://github.com/apache/incubator-hudi/pull/1053#issuecomment-612245263 Closing this in favor of #1503 This is an automated

[GitHub] [incubator-hudi] n3nash closed pull request #1053: [HUDI-371] : Support CombineInputFormat for RT tables

2020-04-10 Thread GitBox
n3nash closed pull request #1053: [HUDI-371] : Support CombineInputFormat for RT tables URL: https://github.com/apache/incubator-hudi/pull/1053 This is an automated message from the Apache Git Service. To respond to the

[jira] [Updated] (HUDI-371) CombineInputFormat for realtime tables

2020-04-10 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HUDI-371?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated HUDI-371: Labels: pull-request-available (was: ) > CombineInputFormat for realtime tables >

[jira] [Updated] (HUDI-687) incremental reads on MOR tables using RO view can lead to missing updates

2020-04-10 Thread satish (Jira)
[ https://issues.apache.org/jira/browse/HUDI-687?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] satish updated HUDI-687: Status: In Progress (was: Open) > incremental reads on MOR tables using RO view can lead to missing updates >

[jira] [Updated] (HUDI-687) incremental reads on MOR tables using RO view can lead to missing updates

2020-04-10 Thread satish (Jira)
[ https://issues.apache.org/jira/browse/HUDI-687?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] satish updated HUDI-687: Status: Open (was: New) > incremental reads on MOR tables using RO view can lead to missing updates >

[GitHub] [incubator-hudi] vontman commented on issue #1498: Migrating parquet table to hudi issue [SUPPORT]

2020-04-10 Thread GitBox
vontman commented on issue #1498: Migrating parquet table to hudi issue [SUPPORT] URL: https://github.com/apache/incubator-hudi/issues/1498#issuecomment-612156801 @bvaradar The `.commit` file: https://gist.github.com/vontman/e2242b6b0bd3cfc126ed725bb85ccdea This is the schema

[jira] [Reopened] (HUDI-571) Modify Hudi CLI to show archived commits

2020-04-10 Thread satish (Jira)
[ https://issues.apache.org/jira/browse/HUDI-571?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] satish reopened HUDI-571: - > Modify Hudi CLI to show archived commits > > > Key:

[GitHub] [incubator-hudi] garyli1019 commented on issue #1486: [HUDI-759] Integrate checkpoint privoder with delta streamer

2020-04-10 Thread GitBox
garyli1019 commented on issue #1486: [HUDI-759] Integrate checkpoint privoder with delta streamer URL: https://github.com/apache/incubator-hudi/pull/1486#issuecomment-612171042 Addressed some comments, summary: - Removed `--bootstrap-from` option in the delta streamer. Use

[incubator-hudi] branch hudi_test_suite_refactor updated (5ee8a85 -> d2d2866)

2020-04-10 Thread nagarwal
This is an automated email from the ASF dual-hosted git repository. nagarwal pushed a change to branch hudi_test_suite_refactor in repository https://gitbox.apache.org/repos/asf/incubator-hudi.git. discard 5ee8a85 Build fixes after rebase discard 3e2e710 Fix Compilation Issues + Port Bug

[GitHub] [incubator-hudi] bvaradar merged pull request #1396: [HUDI-687] Stop incremental reader on RO table before a pending compaction

2020-04-10 Thread GitBox
bvaradar merged pull request #1396: [HUDI-687] Stop incremental reader on RO table before a pending compaction URL: https://github.com/apache/incubator-hudi/pull/1396 This is an automated message from the Apache Git

[jira] [Resolved] (HUDI-633) archival fails with large clean files

2020-04-10 Thread satish (Jira)
[ https://issues.apache.org/jira/browse/HUDI-633?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] satish resolved HUDI-633. - Resolution: Won't Fix Decided to go with different approach by not restricting size of clean files > archival

[jira] [Updated] (HUDI-633) archival fails with large clean files

2020-04-10 Thread satish (Jira)
[ https://issues.apache.org/jira/browse/HUDI-633?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] satish updated HUDI-633: Status: Open (was: New) > archival fails with large clean files > - > >

[GitHub] [incubator-hudi] n3nash commented on issue #1503: [HUDI-371] : Supporting combine input format RT tables

2020-04-10 Thread GitBox
n3nash commented on issue #1503: [HUDI-371] : Supporting combine input format RT tables URL: https://github.com/apache/incubator-hudi/pull/1503#issuecomment-612151106 Closed PR -> https://github.com/apache/incubator-hudi/pull/1053 in favor of this one. @bvaradar PTAL

[incubator-hudi] branch master updated (8c7cef3 -> c0f96e0)

2020-04-10 Thread vbalaji
This is an automated email from the ASF dual-hosted git repository. vbalaji pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/incubator-hudi.git. from 8c7cef3 [HUDI - 738] Add validation to DeltaStreamer to fail fast when filterDupes is enabled on UPSERT

[jira] [Resolved] (HUDI-571) Modify Hudi CLI to show archived commits

2020-04-10 Thread satish (Jira)
[ https://issues.apache.org/jira/browse/HUDI-571?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] satish resolved HUDI-571. - Resolution: Resolved > Modify Hudi CLI to show archived commits > > >

[jira] [Commented] (HUDI-741) Fix Hoodie's schema evolution checks

2020-04-10 Thread Prashant Wason (Jira)
[ https://issues.apache.org/jira/browse/HUDI-741?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17081014#comment-17081014 ] Prashant Wason commented on HUDI-741: - Update: [~varadarb] informed me that schema is also available in

[GitHub] [incubator-hudi] prashantwason commented on issue #1457: [HUDI-741] Added checks to validate Hoodie's schema evolution.

2020-04-10 Thread GitBox
prashantwason commented on issue #1457: [HUDI-741] Added checks to validate Hoodie's schema evolution. URL: https://github.com/apache/incubator-hudi/pull/1457#issuecomment-612258453 > Structure looks much better now. thanks @prashantwason .. > > I raised an issue on the need to copy

[jira] [Commented] (HUDI-773) Hudi On Azure Data Lake Storage V2

2020-04-10 Thread Vinoth Chandar (Jira)
[ https://issues.apache.org/jira/browse/HUDI-773?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17081081#comment-17081081 ] Vinoth Chandar commented on HUDI-773: - yeah it should be fine.. Few things to check 1. do we have all

[GitHub] [incubator-hudi] vinothchandar edited a comment on issue #1498: Migrating parquet table to hudi issue [SUPPORT]

2020-04-10 Thread GitBox
vinothchandar edited a comment on issue #1498: Migrating parquet table to hudi issue [SUPPORT] URL: https://github.com/apache/incubator-hudi/issues/1498#issuecomment-612252471 @vontman @ahmed-elfar First of all. Thanks for all the detailed information! Answers to the good questions

[GitHub] [incubator-hudi] vinothchandar commented on issue #1498: Migrating parquet table to hudi issue [SUPPORT]

2020-04-10 Thread GitBox
vinothchandar commented on issue #1498: Migrating parquet table to hudi issue [SUPPORT] URL: https://github.com/apache/incubator-hudi/issues/1498#issuecomment-612252471 @vontman @ahmed-elfar First of all. Thanks for all the detailed information! Answers to the good questions you

[GitHub] [incubator-hudi] vinothchandar edited a comment on issue #1498: Migrating parquet table to hudi issue [SUPPORT]

2020-04-10 Thread GitBox
vinothchandar edited a comment on issue #1498: Migrating parquet table to hudi issue [SUPPORT] URL: https://github.com/apache/incubator-hudi/issues/1498#issuecomment-612252471 @vontman @ahmed-elfar First of all. Thanks for all the detailed information! Answers to the good questions

[GitHub] [incubator-hudi] prashantwason commented on a change in pull request #1457: [HUDI-741] Added checks to validate Hoodie's schema evolution.

2020-04-10 Thread GitBox
prashantwason commented on a change in pull request #1457: [HUDI-741] Added checks to validate Hoodie's schema evolution. URL: https://github.com/apache/incubator-hudi/pull/1457#discussion_r406973747 ## File path:

[GitHub] [incubator-hudi] prashantwason commented on a change in pull request #1457: [HUDI-741] Added checks to validate Hoodie's schema evolution.

2020-04-10 Thread GitBox
prashantwason commented on a change in pull request #1457: [HUDI-741] Added checks to validate Hoodie's schema evolution. URL: https://github.com/apache/incubator-hudi/pull/1457#discussion_r406973660 ## File path:

[GitHub] [incubator-hudi] prashantwason commented on a change in pull request #1457: [HUDI-741] Added checks to validate Hoodie's schema evolution.

2020-04-10 Thread GitBox
prashantwason commented on a change in pull request #1457: [HUDI-741] Added checks to validate Hoodie's schema evolution. URL: https://github.com/apache/incubator-hudi/pull/1457#discussion_r406976510 ## File path:

[GitHub] [incubator-hudi] prashantwason edited a comment on issue #1457: [HUDI-741] Added checks to validate Hoodie's schema evolution.

2020-04-10 Thread GitBox
prashantwason edited a comment on issue #1457: [HUDI-741] Added checks to validate Hoodie's schema evolution. URL: https://github.com/apache/incubator-hudi/pull/1457#issuecomment-612262645 > What will happen if there is incompatible message in Kafka? Will pipeline stall? What will be the

[GitHub] [incubator-hudi] prashantwason edited a comment on issue #1457: [HUDI-741] Added checks to validate Hoodie's schema evolution.

2020-04-10 Thread GitBox
prashantwason edited a comment on issue #1457: [HUDI-741] Added checks to validate Hoodie's schema evolution. URL: https://github.com/apache/incubator-hudi/pull/1457#issuecomment-612258453 > Structure looks much better now. thanks @prashantwason .. > > I raised an issue on the need

[jira] [Commented] (HUDI-773) Hudi On Azure Data Lake Storage V2

2020-04-10 Thread Yanjia Gary Li (Jira)
[ https://issues.apache.org/jira/browse/HUDI-773?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17081030#comment-17081030 ] Yanjia Gary Li commented on HUDI-773: - surprisingly easy...I tried the following test using Spark2.4

[GitHub] [incubator-hudi] prashantwason commented on issue #1457: [HUDI-741] Added checks to validate Hoodie's schema evolution.

2020-04-10 Thread GitBox
prashantwason commented on issue #1457: [HUDI-741] Added checks to validate Hoodie's schema evolution. URL: https://github.com/apache/incubator-hudi/pull/1457#issuecomment-612262645 > What will happen if there is incompatible message in Kafka? Will pipeline stall? What will be the way to

[jira] [Commented] (HUDI-773) Hudi On Azure Data Lake Storage V2

2020-04-10 Thread Yanjia Gary Li (Jira)
[ https://issues.apache.org/jira/browse/HUDI-773?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17081032#comment-17081032 ] Yanjia Gary Li commented on HUDI-773: - Any extra tests needed? What tests have you guys done for AWS

[incubator-hudi] branch master updated: [HUDI-700]Add unit test for FileSystemViewCommand (#1490)

2020-04-10 Thread vinoyang
This is an automated email from the ASF dual-hosted git repository. vinoyang pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/incubator-hudi.git The following commit(s) were added to refs/heads/master by this push: new a464a29 [HUDI-700]Add unit test for

[GitHub] [incubator-hudi] yanghua merged pull request #1490: [HUDI-700]Add unit test for FileSystemViewCommand

2020-04-10 Thread GitBox
yanghua merged pull request #1490: [HUDI-700]Add unit test for FileSystemViewCommand URL: https://github.com/apache/incubator-hudi/pull/1490 This is an automated message from the Apache Git Service. To respond to the

[jira] [Updated] (HUDI-700) Add unit test for FileSystemViewCommand

2020-04-10 Thread vinoyang (Jira)
[ https://issues.apache.org/jira/browse/HUDI-700?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] vinoyang updated HUDI-700: -- Fix Version/s: 0.6.0 > Add unit test for FileSystemViewCommand > --- > >

[jira] [Closed] (HUDI-700) Add unit test for FileSystemViewCommand

2020-04-10 Thread vinoyang (Jira)
[ https://issues.apache.org/jira/browse/HUDI-700?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] vinoyang closed HUDI-700. - Resolution: Done Done via master branch: a464a2972e83e648585277ebe567703c8285cf1e > Add unit test for

[jira] [Updated] (HUDI-700) Add unit test for FileSystemViewCommand

2020-04-10 Thread vinoyang (Jira)
[ https://issues.apache.org/jira/browse/HUDI-700?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] vinoyang updated HUDI-700: -- Status: Open (was: New) > Add unit test for FileSystemViewCommand > --- > >

[GitHub] [incubator-hudi] prashantwason commented on a change in pull request #1457: [HUDI-741] Added checks to validate Hoodie's schema evolution.

2020-04-10 Thread GitBox
prashantwason commented on a change in pull request #1457: [HUDI-741] Added checks to validate Hoodie's schema evolution. URL: https://github.com/apache/incubator-hudi/pull/1457#discussion_r406974059 ## File path:

[jira] [Commented] (HUDI-741) Fix Hoodie's schema evolution checks

2020-04-10 Thread Prashant Wason (Jira)
[ https://issues.apache.org/jira/browse/HUDI-741?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17081025#comment-17081025 ] Prashant Wason commented on HUDI-741: - HUDI requires a Schema to be specified in HoodieWriteConfig and

[GitHub] [incubator-hudi] prashantwason commented on a change in pull request #1457: [HUDI-741] Added checks to validate Hoodie's schema evolution.

2020-04-10 Thread GitBox
prashantwason commented on a change in pull request #1457: [HUDI-741] Added checks to validate Hoodie's schema evolution. URL: https://github.com/apache/incubator-hudi/pull/1457#discussion_r406978802 ## File path:

[jira] [Updated] (HUDI-773) Hudi On Azure Data Lake Storage V2

2020-04-10 Thread Yanjia Gary Li (Jira)
[ https://issues.apache.org/jira/browse/HUDI-773?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yanjia Gary Li updated HUDI-773: Status: In Progress (was: Open) > Hudi On Azure Data Lake Storage V2 >

[jira] [Updated] (HUDI-773) Hudi On Azure Data Lake Storage V2

2020-04-10 Thread Yanjia Gary Li (Jira)
[ https://issues.apache.org/jira/browse/HUDI-773?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yanjia Gary Li updated HUDI-773: Fix Version/s: 0.6.0 > Hudi On Azure Data Lake Storage V2 > -- > >

[jira] [Updated] (HUDI-782) Add support for aliyun OSS

2020-04-10 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HUDI-782?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated HUDI-782: Labels: pull-request-available (was: ) > Add support for aliyun OSS > -- >

[GitHub] [incubator-hudi] yanghua commented on issue #1504: [HUDI-780] Add junit 5

2020-04-10 Thread GitBox
yanghua commented on issue #1504: [HUDI-780] Add junit 5 URL: https://github.com/apache/incubator-hudi/pull/1504#issuecomment-612297922 > @yanghua @xushiyan my style has been to only use javadocs when it warrants them. forced writing of trivial/obvious docs is not very helpful.. That said,

[GitHub] [incubator-hudi] shenh062326 opened a new pull request #1506: [HUDI-782] Add support of Aliyun object storage service.

2020-04-10 Thread GitBox
shenh062326 opened a new pull request #1506: [HUDI-782] Add support of Aliyun object storage service. URL: https://github.com/apache/incubator-hudi/pull/1506 ## What is the purpose of the pull request Add support of Aliyun object storage service. ## Brief change log - Modify

Build failed in Jenkins: hudi-snapshot-deployment-0.5 #244

2020-04-10 Thread Apache Jenkins Server
See Changes: -- [...truncated 2.36 KB...] /home/jenkins/tools/maven/apache-maven-3.5.4/conf: logging settings.xml toolchains.xml