Build failed in Jenkins: hudi-snapshot-deployment-0.5 #121

2019-12-06 Thread Apache Jenkins Server
See Changes: -- [...truncated 2.20 KB...] /home/jenkins/tools/maven/apache-maven-3.5.4/bin: m2.conf mvn mvn.cmd mvnDebug mvnDebug.cmd mvnyjp /home/jenkins/tools/maven/apach

[GitHub] [incubator-hudi] vinothchandar edited a comment on issue #1057: Hudi Test Suite

2019-12-06 Thread GitBox
vinothchandar edited a comment on issue #1057: Hudi Test Suite URL: https://github.com/apache/incubator-hudi/pull/1057#issuecomment-562752759 Great to see this making progress.. @n3nash Not to nit, but just coz you raised these points, I feel obligated to layout some facts

[GitHub] [incubator-hudi] vinothchandar commented on issue #1057: Hudi Test Suite

2019-12-06 Thread GitBox
vinothchandar commented on issue #1057: Hudi Test Suite URL: https://github.com/apache/incubator-hudi/pull/1057#issuecomment-562752759 Great to see this making progress.. @n3nash Not to nit, but just coz you raised these points, I feel obligated to layout some facts >

[GitHub] [incubator-hudi] n3nash commented on a change in pull request #1080: [HUDI-118]: Options provided for passing properties to Cleaner, compactor and importer commands

2019-12-06 Thread GitBox
n3nash commented on a change in pull request #1080: [HUDI-118]: Options provided for passing properties to Cleaner, compactor and importer commands URL: https://github.com/apache/incubator-hudi/pull/1080#discussion_r355043611 ## File path: hudi-cli/src/main/java/org/apache/hudi/cli/

[GitHub] [incubator-hudi] n3nash commented on a change in pull request #1080: [HUDI-118]: Options provided for passing properties to Cleaner, compactor and importer commands

2019-12-06 Thread GitBox
n3nash commented on a change in pull request #1080: [HUDI-118]: Options provided for passing properties to Cleaner, compactor and importer commands URL: https://github.com/apache/incubator-hudi/pull/1080#discussion_r355043611 ## File path: hudi-cli/src/main/java/org/apache/hudi/cli/

[GitHub] [incubator-hudi] n3nash commented on a change in pull request #1080: [HUDI-118]: Options provided for passing properties to Cleaner, compactor and importer commands

2019-12-06 Thread GitBox
n3nash commented on a change in pull request #1080: [HUDI-118]: Options provided for passing properties to Cleaner, compactor and importer commands URL: https://github.com/apache/incubator-hudi/pull/1080#discussion_r355042940 ## File path: hudi-cli/src/main/java/org/apache/hudi/cli

[GitHub] [incubator-hudi] n3nash commented on a change in pull request #1080: [HUDI-118]: Options provided for passing properties to Cleaner, compactor and importer commands

2019-12-06 Thread GitBox
n3nash commented on a change in pull request #1080: [HUDI-118]: Options provided for passing properties to Cleaner, compactor and importer commands URL: https://github.com/apache/incubator-hudi/pull/1080#discussion_r355042774 ## File path: hudi-cli/src/main/java/org/apache/hudi/cli

[GitHub] [incubator-hudi] n3nash edited a comment on issue #1057: Hudi Test Suite

2019-12-06 Thread GitBox
n3nash edited a comment on issue #1057: Hudi Test Suite URL: https://github.com/apache/incubator-hudi/pull/1057#issuecomment-562695857 @yanghua The branch was fixed a couple of days ago and I pushed the changes to https://github.com/apache/incubator-hudi/tree/hudi_test_suite_refactor. A

[GitHub] [incubator-hudi] n3nash edited a comment on issue #1057: Hudi Test Suite

2019-12-06 Thread GitBox
n3nash edited a comment on issue #1057: Hudi Test Suite URL: https://github.com/apache/incubator-hudi/pull/1057#issuecomment-562695857 @yanghua The branch was fixed a couple of days ago and I pushed the changes to https://github.com/apache/incubator-hudi/tree/hudi_test_suite_refactor. A

[jira] [Closed] (HUDI-381) Refactor hudi-client based on new comment and code style rules

2019-12-06 Thread leesf (Jira)
[ https://issues.apache.org/jira/browse/HUDI-381?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] leesf closed HUDI-381. -- Resolution: Duplicate > Refactor hudi-client based on new comment and code style rules >

[GitHub] [incubator-hudi] bvaradar commented on issue #1070: How to do the bulk update .?

2019-12-06 Thread GitBox
bvaradar commented on issue #1070: How to do the bulk update .? URL: https://github.com/apache/incubator-hudi/issues/1070#issuecomment-562716063 Added a FAQ entry : https://cwiki.apache.org/confluence/display/HUDI/FAQ#FAQ-IhaveanexistingdatasetandwanttoevaluateHudiusingportionofthatdata? -

[GitHub] [incubator-hudi] n3nash edited a comment on issue #1057: Hudi Test Suite

2019-12-06 Thread GitBox
n3nash edited a comment on issue #1057: Hudi Test Suite URL: https://github.com/apache/incubator-hudi/pull/1057#issuecomment-562695857 @yanghua The branch was fixed a couple of days ago and I pushed the changes to https://github.com/apache/incubator-hudi/tree/hudi_test_suite_refactor. A

[GitHub] [incubator-hudi] n3nash edited a comment on issue #1057: Hudi Test Suite

2019-12-06 Thread GitBox
n3nash edited a comment on issue #1057: Hudi Test Suite URL: https://github.com/apache/incubator-hudi/pull/1057#issuecomment-562695857 @yanghua The branch was fixed a couple of days ago and I pushed the changes to https://github.com/apache/incubator-hudi/tree/hudi_test_suite_refactor. A

[GitHub] [incubator-hudi] n3nash commented on issue #1057: Hudi Test Suite

2019-12-06 Thread GitBox
n3nash commented on issue #1057: Hudi Test Suite URL: https://github.com/apache/incubator-hudi/pull/1057#issuecomment-562695857 @yanghua The branch was fixed a couple of days ago and I pushed the changes to https://github.com/apache/incubator-hudi/tree/hudi_test_suite_refactor. Are you

[jira] [Commented] (HUDI-375) Refactor the configure framework of hudi project

2019-12-06 Thread lamber-ken (Jira)
[ https://issues.apache.org/jira/browse/HUDI-375?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16990067#comment-16990067 ] lamber-ken commented on HUDI-375: - Hi, [~vinoth] the main purpose of this issue is to solve

[jira] [Comment Edited] (HUDI-375) Refactor the configure framework of hudi project

2019-12-06 Thread lamber-ken (Jira)
[ https://issues.apache.org/jira/browse/HUDI-375?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16990067#comment-16990067 ] lamber-ken edited comment on HUDI-375 at 12/6/19 6:36 PM: -- Hi, [~v

[GitHub] [incubator-hudi] vinothchandar commented on issue #1057: Hudi Test Suite

2019-12-06 Thread GitBox
vinothchandar commented on issue #1057: Hudi Test Suite URL: https://github.com/apache/incubator-hudi/pull/1057#issuecomment-562683462 @n3nash is there an ETA for fixing conflicts and having a buildable branch here? I would also like to understand if you are actively working on this..

[jira] [Commented] (HUDI-233) Redo log statements using SLF4J

2019-12-06 Thread Vinoth Chandar (Jira)
[ https://issues.apache.org/jira/browse/HUDI-233?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16990047#comment-16990047 ] Vinoth Chandar commented on HUDI-233: - We can! Just be sure to test all bundles once yo

[GitHub] [incubator-hudi] vinothchandar commented on issue #1061: Hudi output just parquet even-though input is snappy.parquet

2019-12-06 Thread GitBox
vinothchandar commented on issue #1061: Hudi output just parquet even-though input is snappy.parquet URL: https://github.com/apache/incubator-hudi/issues/1061#issuecomment-562678990 visible to queries? queries dont go by file name, IIUC they read this metadata from within files to actuall

[GitHub] [incubator-hudi] vinothchandar commented on issue #1067: How to do multiple partition

2019-12-06 Thread GitBox
vinothchandar commented on issue #1067: How to do multiple partition URL: https://github.com/apache/incubator-hudi/issues/1067#issuecomment-562678485 you should be able to keep same kind of partitioning.. Responded with suggestions on the other issue.. I suggest we close this issue and use

[GitHub] [incubator-hudi] vinothchandar closed issue #1067: How to do multiple partition

2019-12-06 Thread GitBox
vinothchandar closed issue #1067: How to do multiple partition URL: https://github.com/apache/incubator-hudi/issues/1067 This is an automated message from the Apache Git Service. To respond to the message, please log on to G

[GitHub] [incubator-hudi] vinothchandar commented on issue #1070: How to do the bulk update .?

2019-12-06 Thread GitBox
vinothchandar commented on issue #1070: How to do the bulk update .? URL: https://github.com/apache/incubator-hudi/issues/1070#issuecomment-562678009 that helps! So I would suggest the following concrete steps 1. Do a first bulk import for the same one month of data.. `spark.read.p

[jira] [Commented] (HUDI-309) General Redesign of Archived Timeline for efficient scan and management

2019-12-06 Thread Vinoth Chandar (Jira)
[ https://issues.apache.org/jira/browse/HUDI-309?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16990037#comment-16990037 ] Vinoth Chandar commented on HUDI-309: - [~vbalaji] is actually driving the plan (may be

[jira] [Commented] (HUDI-375) Refactor the configure framework of hudi project

2019-12-06 Thread Vinoth Chandar (Jira)
[ https://issues.apache.org/jira/browse/HUDI-375?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16990036#comment-16990036 ] Vinoth Chandar commented on HUDI-375: - I am okay with introducing a class that binds th

[GitHub] [incubator-hudi] nisheet195 opened a new issue #1084: Hive Sync fails when table name is a keyword

2019-12-06 Thread GitBox
nisheet195 opened a new issue #1084: Hive Sync fails when table name is a keyword URL: https://github.com/apache/incubator-hudi/issues/1084 **Describe the problem you faced** I am writing to s3 using Hudi COW strategy with Hive sync enabled. When the table/database name is a hive ke

[jira] [Assigned] (HUDI-386) Refactor hudi scala checkstyle rules

2019-12-06 Thread lamber-ken (Jira)
[ https://issues.apache.org/jira/browse/HUDI-386?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] lamber-ken reassigned HUDI-386: --- Assignee: lamber-ken > Refactor hudi scala checkstyle rules > > >

[jira] [Created] (HUDI-386) Refactor hudi scala checkstyle rules

2019-12-06 Thread lamber-ken (Jira)
lamber-ken created HUDI-386: --- Summary: Refactor hudi scala checkstyle rules Key: HUDI-386 URL: https://issues.apache.org/jira/browse/HUDI-386 Project: Apache Hudi (incubating) Issue Type: Sub-task

[GitHub] [incubator-hudi] nsivabalan commented on a change in pull request #976: [HUDI-106] Adding support for DynamicBloomFilter

2019-12-06 Thread GitBox
nsivabalan commented on a change in pull request #976: [HUDI-106] Adding support for DynamicBloomFilter URL: https://github.com/apache/incubator-hudi/pull/976#discussion_r354866808 ## File path: hudi-common/src/main/java/org/apache/hudi/common/bloom/filter/BloomFilterUtils.java ##

[jira] [Assigned] (HUDI-385) Refactor hudi scala checkstyle

2019-12-06 Thread lamber-ken (Jira)
[ https://issues.apache.org/jira/browse/HUDI-385?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] lamber-ken reassigned HUDI-385: --- Assignee: lamber-ken > Refactor hudi scala checkstyle > -- > >

[GitHub] [incubator-hudi] nsivabalan commented on a change in pull request #976: [HUDI-106] Adding support for DynamicBloomFilter

2019-12-06 Thread GitBox
nsivabalan commented on a change in pull request #976: [HUDI-106] Adding support for DynamicBloomFilter URL: https://github.com/apache/incubator-hudi/pull/976#discussion_r354862090 ## File path: hudi-common/src/main/java/org/apache/hudi/common/bloom/filter/HoodieDynamicBoundedBloom