[GitHub] [incubator-hudi] vinothchandar merged pull request #619: Fixed HUDI-87 : Remove schemastr from BaseAvroPayload

vinothchandar merged pull request #619: Fixed HUDI-87 : Remove schemastr from BaseAvroPayload URL: https://github.com/apache/incubator-hudi/pull/619 This is an automated message from the Apache Git Service. To respond to the

[incubator-hudi] branch master updated: Fixed HUDI-87 : Remove schemastr from BaseAvroPayload

This is an automated email from the ASF dual-hosted git repository. vinoth pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/incubator-hudi.git The following commit(s) were added to refs/heads/master by this push: new e56c161 Fixed HUDI-87 : Remove schemast

[GitHub] [incubator-hudi] vinothchandar opened a new pull request #620: Fix HUDI-27 : Support num_cores > 1 for writing through spark

vinothchandar opened a new pull request #620: Fix HUDI-27 : Support num_cores > 1 for writing through spark URL: https://github.com/apache/incubator-hudi/pull/620 - Users using spark.executor.cores > 1 used to fail due to "FileSystem closed" - This is due to HoodieWrapperFileSystem cl

[GitHub] [incubator-hudi] daikon12 commented on issue #581: ClassNotFoundException:HoodieInputFormat

daikon12 commented on issue #581: ClassNotFoundException:HoodieInputFormat URL: https://github.com/apache/incubator-hudi/issues/581#issuecomment-477407030 > @daikon12 : Is run_hive_sync tool working fine now ? Thank you @vinothchandar @bvaradar You inspire me , This problem is probabl

[GitHub] [incubator-hudi] n3nash commented on a change in pull request #619: Fixed HUDI-87 : Remove schemastr from BaseAvroPayload

n3nash commented on a change in pull request #619: Fixed HUDI-87 : Remove schemastr from BaseAvroPayload URL: https://github.com/apache/incubator-hudi/pull/619#discussion_r269821594 ## File path: hoodie-client/src/main/java/com/uber/hoodie/io/HoodieMergeHandle.java ## @@

[GitHub] [incubator-hudi] vinothchandar opened a new pull request #619: Fixed HUDI-87 : Remove schemastr from BaseAvroPayload

vinothchandar opened a new pull request #619: Fixed HUDI-87 : Remove schemastr from BaseAvroPayload URL: https://github.com/apache/incubator-hudi/pull/619 - This will reduce the shuffle volume for datasource and deltastreamer significantly

[GitHub] [incubator-hudi] vinothchandar commented on issue #616: Fixes HUDI-38: Reduce memory overhead of WriteStatus

vinothchandar commented on issue #616: Fixes HUDI-38: Reduce memory overhead of WriteStatus URL: https://github.com/apache/incubator-hudi/pull/616#issuecomment-477284353 yes @ovj @n3nash the custom WriteStatus need to change post release. its okay for you to ignore the args though.. Once

[incubator-hudi] branch master updated: Fixes HUDI-9 : Check precondition minInstantsToKeep > cleanerCommitsRetained

This is an automated email from the ASF dual-hosted git repository. vinoth pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/incubator-hudi.git The following commit(s) were added to refs/heads/master by this push: new 372fbc4 Fixes HUDI-9 : Check preconditi

[GitHub] [incubator-hudi] vinothchandar merged pull request #617: Fixes HUDI-9 : Check precondition minInstantsToKeep > cleanerCommitsR…

vinothchandar merged pull request #617: Fixes HUDI-9 : Check precondition minInstantsToKeep > cleanerCommitsR… URL: https://github.com/apache/incubator-hudi/pull/617 This is an automated message from the Apache Git Service.

[GitHub] [incubator-hudi] bvaradar commented on a change in pull request #616: Fixes HUDI-38: Reduce memory overhead of WriteStatus

bvaradar commented on a change in pull request #616: Fixes HUDI-38: Reduce memory overhead of WriteStatus URL: https://github.com/apache/incubator-hudi/pull/616#discussion_r269691293 ## File path: hoodie-client/src/main/java/com/uber/hoodie/WriteStatus.java ## @@ -48,6 +51

[GitHub] [incubator-hudi] vinothchandar commented on a change in pull request #617: Fixes HUDI-9 : Check precondition minInstantsToKeep > cleanerCommitsR…

vinothchandar commented on a change in pull request #617: Fixes HUDI-9 : Check precondition minInstantsToKeep > cleanerCommitsR… URL: https://github.com/apache/incubator-hudi/pull/617#discussion_r269683323 ## File path: hoodie-client/src/main/java/com/uber/hoodie/config/HoodieCompa

[GitHub] [incubator-hudi] vinothchandar commented on issue #615: how change HoodieDeltaStreamer with Real-time calculation

vinothchandar commented on issue #615: how change HoodieDeltaStreamer with Real-time calculation URL: https://github.com/apache/incubator-hudi/issues/615#issuecomment-477248903 lets continue on the mailing list.. ! This i

[GitHub] [incubator-hudi] vinothchandar commented on issue #615: how change HoodieDeltaStreamer with Real-time calculation

vinothchandar commented on issue #615: how change HoodieDeltaStreamer with Real-time calculation URL: https://github.com/apache/incubator-hudi/issues/615#issuecomment-477248778 @leilinen please post on the mailing list for faster response. https://hudi.apache.org/community.html

[GitHub] [incubator-hudi] leilinen commented on issue #615: how change HoodieDeltaStreamer with Real-time calculation

leilinen commented on issue #615: how change HoodieDeltaStreamer with Real-time calculation URL: https://github.com/apache/incubator-hudi/issues/615#issuecomment-477158609 I noticed that the dstream consumed from kafka topic was empty, for dstream.foreachRDD resulted nothing. But the kaf