[jira] [Updated] (HUDI-526) inline compact not work

2020-01-15 Thread leesf (Jira)
[ https://issues.apache.org/jira/browse/HUDI-526?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] leesf updated HUDI-526: --- Status: Open (was: New) > inline compact not work > --- > > Key: HUDI-526 >

[jira] [Resolved] (HUDI-530) Datasource Writer throws error on resolving struct fields

2020-01-15 Thread leesf (Jira)
[ https://issues.apache.org/jira/browse/HUDI-530?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] leesf resolved HUDI-530. Fix Version/s: 0.5.1 Resolution: Fixed Fixed via master: 2bb0c21a3dd29687e49d362ed34f050380ff47ae >

[jira] [Updated] (HUDI-530) Datasource Writer throws error on resolving struct fields

2020-01-15 Thread leesf (Jira)
[ https://issues.apache.org/jira/browse/HUDI-530?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] leesf updated HUDI-530: --- Status: Open (was: New) > Datasource Writer throws error on resolving struct fields >

[GitHub] [incubator-hudi] hddong commented on issue #1157: [HUDI-332]Add operation type (insert/upsert/bulkinsert/delete) to HoodieCommitMetadata

2020-01-15 Thread GitBox
hddong commented on issue #1157: [HUDI-332]Add operation type (insert/upsert/bulkinsert/delete) to HoodieCommitMetadata URL: https://github.com/apache/incubator-hudi/pull/1157#issuecomment-575021883 @bvaradar I tried what you suggest, but there are some other problems. I tried another way

[GitHub] [incubator-hudi] smarthi closed issue #1235: Compilation errors when following docker demo and building Hudi. Missing some java packages

2020-01-15 Thread GitBox
smarthi closed issue #1235: Compilation errors when following docker demo and building Hudi. Missing some java packages URL: https://github.com/apache/incubator-hudi/issues/1235 This is an automated message from the Apache

[GitHub] [incubator-hudi] tomas-sobotik commented on issue #1235: Compilation errors when following docker demo and building Hudi. Missing some java packages

2020-01-15 Thread GitBox
tomas-sobotik commented on issue #1235: Compilation errors when following docker demo and building Hudi. Missing some java packages URL: https://github.com/apache/incubator-hudi/issues/1235#issuecomment-575017771 Thanks I will install java 8 and try again

[GitHub] [incubator-hudi] smarthi commented on issue #1235: Compilation errors when following docker demo and building Hudi. Missing some java packages

2020-01-15 Thread GitBox
smarthi commented on issue #1235: Compilation errors when following docker demo and building Hudi. Missing some java packages URL: https://github.com/apache/incubator-hudi/issues/1235#issuecomment-575017351 U need Java 8 - not compatible yet with higher versions of Java

[GitHub] [incubator-hudi] tomas-sobotik commented on issue #1235: Compilation errors when following docker demo and building Hudi. Missing some java packages

2020-01-15 Thread GitBox
tomas-sobotik commented on issue #1235: Compilation errors when following docker demo and building Hudi. Missing some java packages URL: https://github.com/apache/incubator-hudi/issues/1235#issuecomment-575016791 Oh, having Java 13.. `java 13.0.1 2019-10-15`

[GitHub] [incubator-hudi] smarthi commented on issue #1235: Compilation errors when following docker demo and building Hudi. Missing some java packages

2020-01-15 Thread GitBox
smarthi commented on issue #1235: Compilation errors when following docker demo and building Hudi. Missing some java packages URL: https://github.com/apache/incubator-hudi/issues/1235#issuecomment-575016195 Are u running Java 8?

[GitHub] [incubator-hudi] tomas-sobotik opened a new issue #1235: Compilation errors when following docker demo and building Hudi. Missing some java packages

2020-01-15 Thread GitBox
tomas-sobotik opened a new issue #1235: Compilation errors when following docker demo and building Hudi. Missing some java packages URL: https://github.com/apache/incubator-hudi/issues/1235 Hello, I wanted to try Hudi and do the demo here:

[jira] [Created] (HUDI-538) Restructuring hudi client module for multi engine support

2020-01-15 Thread vinoyang (Jira)
vinoyang created HUDI-538: - Summary: Restructuring hudi client module for multi engine support Key: HUDI-538 URL: https://issues.apache.org/jira/browse/HUDI-538 Project: Apache Hudi (incubating)

[GitHub] [incubator-hudi] zhedoubushishi commented on a change in pull request #1226: [HUDI-238] Make Hudi support Scala 2.12

2020-01-15 Thread GitBox
zhedoubushishi commented on a change in pull request #1226: [HUDI-238] Make Hudi support Scala 2.12 URL: https://github.com/apache/incubator-hudi/pull/1226#discussion_r367250686 ## File path: docker/hoodie/hadoop/hive_base/pom.xml ## @@ -57,10 +57,10 @@

[GitHub] [incubator-hudi] bvaradar commented on issue #1226: [HUDI-238] Make Hudi support Scala 2.12

2020-01-15 Thread GitBox
bvaradar commented on issue #1226: [HUDI-238] Make Hudi support Scala 2.12 URL: https://github.com/apache/incubator-hudi/pull/1226#issuecomment-574986730 @leesf : FYI : This diff will have implication on how we release packages. We will be changing the names of packages : hudi-spark,

[GitHub] [incubator-hudi] bvaradar commented on a change in pull request #1226: [HUDI-238] Make Hudi support Scala 2.12

2020-01-15 Thread GitBox
bvaradar commented on a change in pull request #1226: [HUDI-238] Make Hudi support Scala 2.12 URL: https://github.com/apache/incubator-hudi/pull/1226#discussion_r367232920 ## File path: docker/hoodie/hadoop/hive_base/pom.xml ## @@ -57,10 +57,10 @@

[GitHub] [incubator-hudi] bvaradar commented on a change in pull request #1229: [HUDI-535] Ensure Compaction Plan is always written in .aux folder to avoid 0.5.0/0.5.1 reader-writer compatibility issu

2020-01-15 Thread GitBox
bvaradar commented on a change in pull request #1229: [HUDI-535] Ensure Compaction Plan is always written in .aux folder to avoid 0.5.0/0.5.1 reader-writer compatibility issues URL: https://github.com/apache/incubator-hudi/pull/1229#discussion_r367229596 ## File path:

[GitHub] [incubator-hudi] bvaradar commented on issue #1229: [HUDI-535] Ensure Compaction Plan is always written in .aux folder to avoid 0.5.0/0.5.1 reader-writer compatibility issues

2020-01-15 Thread GitBox
bvaradar commented on issue #1229: [HUDI-535] Ensure Compaction Plan is always written in .aux folder to avoid 0.5.0/0.5.1 reader-writer compatibility issues URL: https://github.com/apache/incubator-hudi/pull/1229#issuecomment-574981683 @vinothchandar : I have made changes to handle the

[incubator-hudi] branch master updated (1daba24 -> b39458b)

2020-01-15 Thread leesf
This is an automated email from the ASF dual-hosted git repository. leesf pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/incubator-hudi.git. from 1daba24 Add GlobalDeleteKeyGenerator add b39458b [MINOR] Make constant fields final in

[GitHub] [incubator-hudi] leesf merged pull request #1234: [MINOR] Make constant fields final in HoodieTestDataGenerator

2020-01-15 Thread GitBox
leesf merged pull request #1234: [MINOR] Make constant fields final in HoodieTestDataGenerator URL: https://github.com/apache/incubator-hudi/pull/1234 This is an automated message from the Apache Git Service. To respond to

Build failed in Jenkins: hudi-snapshot-deployment-0.5 #160

2020-01-15 Thread Apache Jenkins Server
See Changes: -- [...truncated 2.15 KB...] /home/jenkins/tools/maven/apache-maven-3.5.4/bin: m2.conf mvn mvn.cmd mvnDebug mvnDebug.cmd mvnyjp

[GitHub] [incubator-hudi] hmatu commented on issue #1234: [MINOR] Make constant fields final in HoodieTestDataGenerator

2020-01-15 Thread GitBox
hmatu commented on issue #1234: [MINOR] Make constant fields final in HoodieTestDataGenerator URL: https://github.com/apache/incubator-hudi/pull/1234#issuecomment-574964656 Great job This is an automated message from the

[GitHub] [incubator-hudi] yanghua commented on issue #1191: [HUDI-503] Add hudi test suite documentation into the README file of the test suite module

2020-01-15 Thread GitBox
yanghua commented on issue #1191: [HUDI-503] Add hudi test suite documentation into the README file of the test suite module URL: https://github.com/apache/incubator-hudi/pull/1191#issuecomment-574950075 > I verified them, looks ok, please fix the build and I can merge this. > >

[GitHub] [incubator-hudi] leesf commented on issue #1225: [MINOR] Adding util methods to assist in adding deletion support to Quick Start

2020-01-15 Thread GitBox
leesf commented on issue #1225: [MINOR] Adding util methods to assist in adding deletion support to Quick Start URL: https://github.com/apache/incubator-hudi/pull/1225#issuecomment-574947582 > @nsivabalan please squash your commits into one with a clear commit message pre merge :)

[GitHub] [incubator-hudi] bvaradar commented on issue #1157: [HUDI-332]Add operation type (insert/upsert/bulkinsert/delete) to HoodieCommitMetadata

2020-01-15 Thread GitBox
bvaradar commented on issue #1157: [HUDI-332]Add operation type (insert/upsert/bulkinsert/delete) to HoodieCommitMetadata URL: https://github.com/apache/incubator-hudi/pull/1157#issuecomment-574945396 @hddong : If possible try to see if you can run it again ? pull master, rebase and

[GitHub] [incubator-hudi] bvaradar commented on issue #1157: [HUDI-332]Add operation type (insert/upsert/bulkinsert/delete) to HoodieCommitMetadata

2020-01-15 Thread GitBox
bvaradar commented on issue #1157: [HUDI-332]Add operation type (insert/upsert/bulkinsert/delete) to HoodieCommitMetadata URL: https://github.com/apache/incubator-hudi/pull/1157#issuecomment-574945171

[GitHub] [incubator-hudi] bvaradar commented on issue #1109: [HUDI-238] - Migrating to Scala 2.12

2020-01-15 Thread GitBox
bvaradar commented on issue #1109: [HUDI-238] - Migrating to Scala 2.12 URL: https://github.com/apache/incubator-hudi/pull/1109#issuecomment-574944571 > > @ezhux : I see a bunch of earlier comments. Some of these are addressed in PR #1226 . Do you think you will be able to address the

[GitHub] [incubator-hudi] hddong commented on issue #1157: [HUDI-332]Add operation type (insert/upsert/bulkinsert/delete) to HoodieCommitMetadata

2020-01-15 Thread GitBox
hddong commented on issue #1157: [HUDI-332]Add operation type (insert/upsert/bulkinsert/delete) to HoodieCommitMetadata URL: https://github.com/apache/incubator-hudi/pull/1157#issuecomment-574938954 @bvaradar this was weird. In my side, this web page shows there are no conflicts, it's all

[jira] [Resolved] (HUDI-335) Improvements to DiskBasedMap

2020-01-15 Thread leesf (Jira)
[ https://issues.apache.org/jira/browse/HUDI-335?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] leesf resolved HUDI-335. Resolution: Fixed Fixed via master: dd09abb56d9e4074f5c2558fcfd001a33570e98c > Improvements to DiskBasedMap >

[jira] [Resolved] (HUDI-326) Support deleting records with only record_key

2020-01-15 Thread leesf (Jira)
[ https://issues.apache.org/jira/browse/HUDI-326?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] leesf resolved HUDI-326. Fix Version/s: 0.5.1 Resolution: Resolved Fixed via master: 1daba24065959dcab3606836bd1d789b3d74cc15 >

[jira] [Updated] (HUDI-403) Publish a deployment guide talking about deployment options, upgrading etc

2020-01-15 Thread Vinoth Chandar (Jira)
[ https://issues.apache.org/jira/browse/HUDI-403?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vinoth Chandar updated HUDI-403: Description: Things to cover  # Upgrade readers first, Upgrade writers next, Principles of

[GitHub] [incubator-hudi] vinothchandar commented on a change in pull request #1212: [HUDI-509] Renaming code in sync with cWiki restructuring

2020-01-15 Thread GitBox
vinothchandar commented on a change in pull request #1212: [HUDI-509] Renaming code in sync with cWiki restructuring URL: https://github.com/apache/incubator-hudi/pull/1212#discussion_r367190262 ## File path: hudi-hive/src/main/java/org/apache/hudi/hive/HiveSyncTool.java

[GitHub] [incubator-hudi] vinothchandar commented on issue #1228: No FileSystem for scheme: abfss

2020-01-15 Thread GitBox
vinothchandar commented on issue #1228: No FileSystem for scheme: abfss URL: https://github.com/apache/incubator-hudi/issues/1228#issuecomment-574936095 hi.. Hudi only supports these schemes.. ``` // Azure WASB WASB("wasb", false), WASBS("wasbs", false), // Azure ADLS

[GitHub] [incubator-hudi] yihua opened a new pull request #1234: [MINOR] Make constant fields final in HoodieTestDataGenerator

2020-01-15 Thread GitBox
yihua opened a new pull request #1234: [MINOR] Make constant fields final in HoodieTestDataGenerator URL: https://github.com/apache/incubator-hudi/pull/1234 ## What is the purpose of the pull request Make constant fields final in `HoodieTestDataGenerator` class and rename them

[GitHub] [incubator-hudi] n3nash merged pull request #1194: [HUDI-326] Add support to delete records with only record_key

2020-01-15 Thread GitBox
n3nash merged pull request #1194: [HUDI-326] Add support to delete records with only record_key URL: https://github.com/apache/incubator-hudi/pull/1194 This is an automated message from the Apache Git Service. To respond to

[incubator-hudi] branch master updated (dd09abb -> 1daba24)

2020-01-15 Thread nagarwal
This is an automated email from the ASF dual-hosted git repository. nagarwal pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/incubator-hudi.git. from dd09abb [HUDI-335] Improvements to DiskBasedMap used by ExternalSpillableMap, for write and

[GitHub] [incubator-hudi] cdmikechen edited a comment on issue #1230: java.lang.NoSuchMethodError: org.apache.avro.Schema.getLogicalType()Lorg/apache/avro/LogicalType

2020-01-15 Thread GitBox
cdmikechen edited a comment on issue #1230: java.lang.NoSuchMethodError: org.apache.avro.Schema.getLogicalType()Lorg/apache/avro/LogicalType URL: https://github.com/apache/incubator-hudi/issues/1230#issuecomment-574925131 In master branch right now, we use spark 2.4 with avro 1.8.2,

[incubator-hudi] branch master updated (7aa3ce3 -> dd09abb)

2020-01-15 Thread nagarwal
This is an automated email from the ASF dual-hosted git repository. nagarwal pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/incubator-hudi.git. from 7aa3ce3 [MINOR] Fix redundant judgment statement (#1231) add dd09abb [HUDI-335] Improvements to

[GitHub] [incubator-hudi] n3nash merged pull request #1233: [HUDI-335] Improvements to DiskBasedMap used by ExternalSpillableMap,…

2020-01-15 Thread GitBox
n3nash merged pull request #1233: [HUDI-335] Improvements to DiskBasedMap used by ExternalSpillableMap,… URL: https://github.com/apache/incubator-hudi/pull/1233 This is an automated message from the Apache Git Service. To

[GitHub] [incubator-hudi] cdmikechen edited a comment on issue #1230: java.lang.NoSuchMethodError: org.apache.avro.Schema.getLogicalType()Lorg/apache/avro/LogicalType

2020-01-15 Thread GitBox
cdmikechen edited a comment on issue #1230: java.lang.NoSuchMethodError: org.apache.avro.Schema.getLogicalType()Lorg/apache/avro/LogicalType URL: https://github.com/apache/incubator-hudi/issues/1230#issuecomment-574925131 In master branch right now, we use spark 2.4 with avro 1.8.2,

[GitHub] [incubator-hudi] n3nash commented on issue #1191: [HUDI-503] Add hudi test suite documentation into the README file of the test suite module

2020-01-15 Thread GitBox
n3nash commented on issue #1191: [HUDI-503] Add hudi test suite documentation into the README file of the test suite module URL: https://github.com/apache/incubator-hudi/pull/1191#issuecomment-574925392 I verified them, looks ok, please fix the build and I can merge this. @yanghua

[GitHub] [incubator-hudi] cdmikechen commented on issue #1230: java.lang.NoSuchMethodError: org.apache.avro.Schema.getLogicalType()Lorg/apache/avro/LogicalType

2020-01-15 Thread GitBox
cdmikechen commented on issue #1230: java.lang.NoSuchMethodError: org.apache.avro.Schema.getLogicalType()Lorg/apache/avro/LogicalType URL: https://github.com/apache/incubator-hudi/issues/1230#issuecomment-574925131 In master branch right now, we need to use spark 2.4 with avro 1.8.2. If

[GitHub] [incubator-hudi] n3nash commented on a change in pull request #1212: [HUDI-509] Renaming code in sync with cWiki restructuring

2020-01-15 Thread GitBox
n3nash commented on a change in pull request #1212: [HUDI-509] Renaming code in sync with cWiki restructuring URL: https://github.com/apache/incubator-hudi/pull/1212#discussion_r367179366 ## File path:

[GitHub] [incubator-hudi] vinothchandar commented on issue #1225: [MINOR] Adding util methods to assist in adding deletion support to Quick Start

2020-01-15 Thread GitBox
vinothchandar commented on issue #1225: [MINOR] Adding util methods to assist in adding deletion support to Quick Start URL: https://github.com/apache/incubator-hudi/pull/1225#issuecomment-574922819 @nsivabalan please squash your commits into one with a clear commit message pre merge :)

[incubator-hudi] branch master updated (2248fd9 -> 7aa3ce3)

2020-01-15 Thread vinoth
This is an automated email from the ASF dual-hosted git repository. vinoth pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/incubator-hudi.git. from 2248fd9 Fixing checkstyle issues add 7aa3ce3 [MINOR] Fix redundant judgment statement (#1231) No new

[GitHub] [incubator-hudi] zhedoubushishi commented on issue #1109: [HUDI-238] - Migrating to Scala 2.12

2020-01-15 Thread GitBox
zhedoubushishi commented on issue #1109: [HUDI-238] - Migrating to Scala 2.12 URL: https://github.com/apache/incubator-hudi/pull/1109#issuecomment-574918036 > @ezhux : I see a bunch of earlier comments. Some of these are addressed in PR #1226 . Do you think you will be able to address the

[GitHub] [incubator-hudi] nbalajee opened a new pull request #1233: [HUDI-335] Improvements to DiskBasedMap used by ExternalSpillableMap,…

2020-01-15 Thread GitBox
nbalajee opened a new pull request #1233: [HUDI-335] Improvements to DiskBasedMap used by ExternalSpillableMap,… URL: https://github.com/apache/incubator-hudi/pull/1233 [HUDI-335] Improvements to DiskBasedMap used by ExternalSpillableMap, for write and random/sequential read paths, by

[GitHub] [incubator-hudi] zhedoubushishi commented on issue #1226: [HUDI-238] Make Hudi support Scala 2.12

2020-01-15 Thread GitBox
zhedoubushishi commented on issue #1226: [HUDI-238] Make Hudi support Scala 2.12 URL: https://github.com/apache/incubator-hudi/pull/1226#issuecomment-574917561 I am trying to use the Spark way to support Scala 2.12. (https://spark.apache.org/docs/latest/building-spark.html) To build

[GitHub] [incubator-hudi] vinothchandar commented on a change in pull request #1229: [HUDI-535] Ensure Compaction Plan is always written in .aux folder to avoid 0.5.0/0.5.1 reader-writer compatibility

2020-01-15 Thread GitBox
vinothchandar commented on a change in pull request #1229: [HUDI-535] Ensure Compaction Plan is always written in .aux folder to avoid 0.5.0/0.5.1 reader-writer compatibility issues URL: https://github.com/apache/incubator-hudi/pull/1229#discussion_r367167688 ## File path:

[GitHub] [incubator-hudi] zhedoubushishi commented on issue #1109: [HUDI-238] - Migrating to Scala 2.12

2020-01-15 Thread GitBox
zhedoubushishi commented on issue #1109: [HUDI-238] - Migrating to Scala 2.12 URL: https://github.com/apache/incubator-hudi/pull/1109#issuecomment-574886880 > > @bvaradar : I reviewed #1226 and see that it does the same as my PR, but is cleaner (I have force-pushed multiple times). So if

[GitHub] [incubator-hudi] bhasudha merged pull request #1225: [MINOR] Adding util methods to assist in adding deletion support to Quick Start

2020-01-15 Thread GitBox
bhasudha merged pull request #1225: [MINOR] Adding util methods to assist in adding deletion support to Quick Start URL: https://github.com/apache/incubator-hudi/pull/1225 This is an automated message from the Apache Git

[jira] [Updated] (HUDI-529) Enable cobertura coverage reporting

2020-01-15 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HUDI-529?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated HUDI-529: Labels: pull-request-available (was: ) > Enable cobertura coverage reporting >

[GitHub] [incubator-hudi] prashantwason opened a new pull request #1232: [HUDI-529] Added cobertura coverage reporting support.

2020-01-15 Thread GitBox
prashantwason opened a new pull request #1232: [HUDI-529] Added cobertura coverage reporting support. URL: https://github.com/apache/incubator-hudi/pull/1232 ## What is the purpose of the pull request Hudi project has code coverage enabled via the jacoco plugin. Jenkins has better

[GitHub] [incubator-hudi] nsivabalan commented on issue #1225: [MINOR] Adding util methods to assist in adding deletion support to Quick Start

2020-01-15 Thread GitBox
nsivabalan commented on issue #1225: [MINOR] Adding util methods to assist in adding deletion support to Quick Start URL: https://github.com/apache/incubator-hudi/pull/1225#issuecomment-574834841 @bhasudha : done. This is

[GitHub] [incubator-hudi] bvaradar commented on issue #1109: [HUDI-238] - Migrating to Scala 2.12

2020-01-15 Thread GitBox
bvaradar commented on issue #1109: [HUDI-238] - Migrating to Scala 2.12 URL: https://github.com/apache/incubator-hudi/pull/1109#issuecomment-574815517 > @bvaradar : I reviewed #1226 and see that it does the same as my PR, but is cleaner (I have force-pushed multiple times). So if #1226

[GitHub] [incubator-hudi] bhasudha commented on issue #1225: [MINOR] Adding util methods to assist in adding deletion support to Quick Start

2020-01-15 Thread GitBox
bhasudha commented on issue #1225: [MINOR] Adding util methods to assist in adding deletion support to Quick Start URL: https://github.com/apache/incubator-hudi/pull/1225#issuecomment-574785486 > @bhasudha : I have changed the way we wanna generate deletes. Basically I pass in insert

[GitHub] [incubator-hudi] bvaradar commented on a change in pull request #1109: [HUDI-238] - Migrating to Scala 2.12

2020-01-15 Thread GitBox
bvaradar commented on a change in pull request #1109: [HUDI-238] - Migrating to Scala 2.12 URL: https://github.com/apache/incubator-hudi/pull/1109#discussion_r367015341 ## File path: hudi-utilities/src/main/java/org/apache/hudi/utilities/sources/helpers/KafkaOffsetGen.java

[GitHub] [incubator-hudi] bvaradar commented on a change in pull request #1109: [HUDI-238] - Migrating to Scala 2.12

2020-01-15 Thread GitBox
bvaradar commented on a change in pull request #1109: [HUDI-238] - Migrating to Scala 2.12 URL: https://github.com/apache/incubator-hudi/pull/1109#discussion_r367016866 ## File path: pom.xml ## @@ -465,25 +466,32 @@ provided + + Review

[GitHub] [incubator-hudi] lamber-ken opened a new pull request #1231: [MINOR] Fix redundant judgment statement

2020-01-15 Thread GitBox
lamber-ken opened a new pull request #1231: [MINOR] Fix redundant judgment statement URL: https://github.com/apache/incubator-hudi/pull/1231 ## What is the purpose of the pull request 1, Redundant judgment statement, because if `writer` is null, will throw NPE. ```

[GitHub] [incubator-hudi] bvaradar commented on issue #1229: [HUDI-535] Ensure Compaction Plan is always written in .aux folder to avoid 0.5.0/0.5.1 reader-writer compatibility issues

2020-01-15 Thread GitBox
bvaradar commented on issue #1229: [HUDI-535] Ensure Compaction Plan is always written in .aux folder to avoid 0.5.0/0.5.1 reader-writer compatibility issues URL: https://github.com/apache/incubator-hudi/pull/1229#issuecomment-574758128 @vinothchandar : when you get a chance, please take a

[jira] [Updated] (HUDI-403) Publish a deployment guide talking about deployment options, upgrading etc

2020-01-15 Thread Vinoth Chandar (Jira)
[ https://issues.apache.org/jira/browse/HUDI-403?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vinoth Chandar updated HUDI-403: Description: Things to cover  # Upgrade readers first, Upgrade writers next, Principles of

[GitHub] [incubator-hudi] vinothchandar closed issue #1034: Datasource Writer throws error on resolving struct fields

2020-01-15 Thread GitBox
vinothchandar closed issue #1034: Datasource Writer throws error on resolving struct fields URL: https://github.com/apache/incubator-hudi/issues/1034 This is an automated message from the Apache Git Service. To respond to

[GitHub] [incubator-hudi] vinothchandar commented on issue #1034: Datasource Writer throws error on resolving struct fields

2020-01-15 Thread GitBox
vinothchandar commented on issue #1034: Datasource Writer throws error on resolving struct fields URL: https://github.com/apache/incubator-hudi/issues/1034#issuecomment-574737632 This has been landed and verified! This is

[GitHub] [incubator-hudi] yanbigot opened a new issue #1230: java.lang.NoSuchMethodError: org.apache.avro.Schema.getLogicalType()Lorg/apache/avro/LogicalType

2020-01-15 Thread GitBox
yanbigot opened a new issue #1230: java.lang.NoSuchMethodError: org.apache.avro.Schema.getLogicalType()Lorg/apache/avro/LogicalType URL: https://github.com/apache/incubator-hudi/issues/1230 While running on yarn cluster with: - spark 2.2.0 - hdp 2.6.4 Works on local env.

[GitHub] [incubator-hudi] ChethanUK edited a comment on issue #143: Tracking ticket for folks to be added to slack group

2020-01-15 Thread GitBox
ChethanUK edited a comment on issue #143: Tracking ticket for folks to be added to slack group URL: https://github.com/apache/incubator-hudi/issues/143#issuecomment-574550650 > add me Use this link to join the group:

[GitHub] [incubator-hudi] ChethanUK commented on issue #143: Tracking ticket for folks to be added to slack group

2020-01-15 Thread GitBox
ChethanUK commented on issue #143: Tracking ticket for folks to be added to slack group URL: https://github.com/apache/incubator-hudi/issues/143#issuecomment-574550650 > add me

[jira] [Updated] (HUDI-535) Compatibility Issue : Hudi Readers using newer layout version can see intermittent errors due to race conditions with concurrent compactions in MOR tables

2020-01-15 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HUDI-535?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated HUDI-535: Labels: pull-request-available (was: ) > Compatibility Issue : Hudi Readers using newer layout

[GitHub] [incubator-hudi] bvaradar opened a new pull request #1229: [HUDI-535] Ensure Compaction Plan is always written in .aux folder to avoid 0.5.0/0.5.1 reader-writer compatibility issues

2020-01-15 Thread GitBox
bvaradar opened a new pull request #1229: [HUDI-535] Ensure Compaction Plan is always written in .aux folder to avoid 0.5.0/0.5.1 reader-writer compatibility issues URL: https://github.com/apache/incubator-hudi/pull/1229 ## What is the purpose of the pull request PR #1009

[GitHub] [incubator-hudi] loupipalien commented on issue #143: Tracking ticket for folks to be added to slack group

2020-01-15 Thread GitBox
loupipalien commented on issue #143: Tracking ticket for folks to be added to slack group URL: https://github.com/apache/incubator-hudi/issues/143#issuecomment-574542039 Please add me: loupipal...@gmail.com, thanks! This is