jsbali commented on issue #2707:
URL: https://github.com/apache/hudi/issues/2707#issuecomment-812980356
Sure @ssdong. You can pick either of the qbove
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to
aditiwari01 commented on a change in pull request #2762:
URL: https://github.com/apache/hudi/pull/2762#discussion_r606761470
##
File path:
hudi-client/hudi-spark-client/src/main/scala/org/apache/hudi/AvroConversionUtils.scala
##
@@ -49,13 +50,45 @@ object AvroConversionUtils
pratyakshsharma commented on a change in pull request #2714:
URL: https://github.com/apache/hudi/pull/2714#discussion_r606796160
##
File path:
hudi-sync/hudi-hive-sync/src/main/java/org/apache/hudi/hive/util/HiveSchemaUtil.java
##
@@ -109,7 +109,7 @@ public static
pratyakshsharma commented on pull request #2714:
URL: https://github.com/apache/hudi/pull/2714#issuecomment-813027238
@vburenin Can you please fix the build? There are test failures.
Just one minor comment from my side and rest looks good. :)
--
This is an automated message from
aditiwari01 opened a new pull request #2763:
URL: https://github.com/apache/hudi/pull/2763
For Union schema types, avro expects "null" to be first entry for null to be
considered as default value. But since Hudi leverages
SchemaConverters.toAvroType(...) from org.apache.spark:spark-avro_*
codecov-io commented on pull request #2765:
URL: https://github.com/apache/hudi/pull/2765#issuecomment-813008111
# [Codecov](https://codecov.io/gh/apache/hudi/pull/2765?src=pr=h1) Report
> Merging
[#2765](https://codecov.io/gh/apache/hudi/pull/2765?src=pr=desc) (7761117)
into
codecov-io edited a comment on pull request #2765:
URL: https://github.com/apache/hudi/pull/2765#issuecomment-813008111
# [Codecov](https://codecov.io/gh/apache/hudi/pull/2765?src=pr=h1) Report
> Merging
[#2765](https://codecov.io/gh/apache/hudi/pull/2765?src=pr=desc) (7761117)
into
aditiwari01 closed pull request #2763:
URL: https://github.com/apache/hudi/pull/2763
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service,
aditiwari01 commented on issue #2756:
URL: https://github.com/apache/hudi/issues/2756#issuecomment-813006720
Can we change the tag for the issue? Or is there anythinng required from my
side?
--
This is an automated message from the Apache Git Service.
To respond to the message, please
pratyakshsharma opened a new pull request #2766:
URL: https://github.com/apache/hudi/pull/2766
## *Tips*
- *Thank you very much for contributing to Apache Hudi.*
- *Please review https://hudi.apache.org/contributing.html before opening a
pull request.*
## What is the purpose
jsbali edited a comment on issue #2707:
URL: https://github.com/apache/hudi/issues/2707#issuecomment-812980356
Sure @ssdong. You can pick either of the above
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL
aditiwari01 commented on pull request #2762:
URL: https://github.com/apache/hudi/pull/2762#issuecomment-812985549
> @bvaradar : I see that SchemaConverters.toAvroType(...) is used in 3
places in hudi code base. 2 of those have been fixed as part of this patch.
Wondering if we need to fix
aditiwari01 opened a new pull request #2764:
URL: https://github.com/apache/hudi/pull/2764
For Union schema types, avro expects "null" to be first entry for null to be
considered as default value. But since Hudi leverages
SchemaConverters.toAvroType(...) from org.apache.spark:spark-avro_*
codecov-io edited a comment on pull request #2765:
URL: https://github.com/apache/hudi/pull/2765#issuecomment-813008111
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For
codecov-io edited a comment on pull request #2765:
URL: https://github.com/apache/hudi/pull/2765#issuecomment-813008111
# [Codecov](https://codecov.io/gh/apache/hudi/pull/2765?src=pr=h1) Report
> Merging
[#2765](https://codecov.io/gh/apache/hudi/pull/2765?src=pr=desc) (7761117)
into
pratyakshsharma commented on a change in pull request #2739:
URL: https://github.com/apache/hudi/pull/2739#discussion_r606795459
##
File path: docs/_posts/2021-02-13-hudi-key-generators.md
##
@@ -5,18 +5,16 @@ author: shivnarayan
category: blog
---
-Every record in Hudi is
codecov-io commented on pull request #2764:
URL: https://github.com/apache/hudi/pull/2764#issuecomment-813003454
# [Codecov](https://codecov.io/gh/apache/hudi/pull/2764?src=pr=h1) Report
> Merging
[#2764](https://codecov.io/gh/apache/hudi/pull/2764?src=pr=desc) (0ed6e5b)
into
aditiwari01 closed pull request #2764:
URL: https://github.com/apache/hudi/pull/2764
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service,
aditiwari01 opened a new pull request #2765:
URL: https://github.com/apache/hudi/pull/2765
## What is the purpose of the pull request
For Union schema types, avro expects "null" to be first entry for null to be
considered as default value. But since Hudi leverages
aditiwari01 closed pull request #2765:
URL: https://github.com/apache/hudi/pull/2765
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service,
pratyakshsharma commented on a change in pull request #2739:
URL: https://github.com/apache/hudi/pull/2739#discussion_r606795373
##
File path: docs/_posts/2021-02-13-hudi-key-generators.md
##
@@ -5,18 +5,16 @@ author: shivnarayan
category: blog
---
-Every record in Hudi is
codecov-io edited a comment on pull request #2757:
URL: https://github.com/apache/hudi/pull/2757#issuecomment-812247500
# [Codecov](https://codecov.io/gh/apache/hudi/pull/2757?src=pr=h1) Report
> Merging
[#2757](https://codecov.io/gh/apache/hudi/pull/2757?src=pr=desc) (7419a66)
into
pratyakshsharma commented on pull request #1565:
URL: https://github.com/apache/hudi/pull/1565#issuecomment-813088110
> @afilipchik @pratyakshsharma : can you folks summarize whats pending wrt
this patch. I can take this up and try to get this in upcoming release. Would
appreciate if you
codecov-io edited a comment on pull request #2767:
URL: https://github.com/apache/hudi/pull/2767#issuecomment-813067816
# [Codecov](https://codecov.io/gh/apache/hudi/pull/2767?src=pr=h1) Report
> Merging
[#2767](https://codecov.io/gh/apache/hudi/pull/2767?src=pr=desc) (dca9350)
into
pratyakshsharma commented on a change in pull request #2619:
URL: https://github.com/apache/hudi/pull/2619#discussion_r606841751
##
File path:
hudi-utilities/src/test/java/org/apache/hudi/utilities/deser/TestKafkaAvroSchemaDeserializer.java
##
@@ -0,0 +1,141 @@
+/*
+ *
[
https://issues.apache.org/jira/browse/HUDI-1762?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Vinoth Govindarajan updated HUDI-1762:
--
Status: Patch Available (was: In Progress)
> Hive Sync is not working with Hive Style
codecov-io commented on pull request #2769:
URL: https://github.com/apache/hudi/pull/2769#issuecomment-813086549
# [Codecov](https://codecov.io/gh/apache/hudi/pull/2769?src=pr=h1) Report
> Merging
[#2769](https://codecov.io/gh/apache/hudi/pull/2769?src=pr=desc) (bd962cb)
into
codecov-io edited a comment on pull request #2757:
URL: https://github.com/apache/hudi/pull/2757#issuecomment-812247500
# [Codecov](https://codecov.io/gh/apache/hudi/pull/2757?src=pr=h1) Report
> Merging
[#2757](https://codecov.io/gh/apache/hudi/pull/2757?src=pr=desc) (7419a66)
into
codecov-io edited a comment on pull request #2757:
URL: https://github.com/apache/hudi/pull/2757#issuecomment-812247500
# [Codecov](https://codecov.io/gh/apache/hudi/pull/2757?src=pr=h1) Report
> Merging
[#2757](https://codecov.io/gh/apache/hudi/pull/2757?src=pr=desc) (02cee2d)
into
[
https://issues.apache.org/jira/browse/HUDI-485?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
ASF GitHub Bot updated HUDI-485:
Labels: pull-request-available (was: )
> Check for where clause is wrong in HiveIncrementalPuller
>
pratyakshsharma opened a new pull request #2768:
URL: https://github.com/apache/hudi/pull/2768
## *Tips*
- *Thank you very much for contributing to Apache Hudi.*
- *Please review https://hudi.apache.org/contributing.html before opening a
pull request.*
## What is the purpose
codecov-io commented on pull request #2768:
URL: https://github.com/apache/hudi/pull/2768#issuecomment-813079061
# [Codecov](https://codecov.io/gh/apache/hudi/pull/2768?src=pr=h1) Report
> Merging
[#2768](https://codecov.io/gh/apache/hudi/pull/2768?src=pr=desc) (5d32a15)
into
Vinoth Govindarajan created HUDI-1762:
-
Summary: Hive Sync is not working with Hive Style Partitioning
Key: HUDI-1762
URL: https://issues.apache.org/jira/browse/HUDI-1762
Project: Apache Hudi
pratyakshsharma commented on pull request #1650:
URL: https://github.com/apache/hudi/pull/1650#issuecomment-813030279
@bvaradar Got chance to take a pass?
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above
[
https://issues.apache.org/jira/browse/HUDI-1761?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
sivabalan narayanan updated HUDI-1761:
--
Labels: sev:normal (was: )
> Add support to test custom schema w/ QuickStart
>
[
https://issues.apache.org/jira/browse/HUDI-1761?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
sivabalan narayanan reassigned HUDI-1761:
-
Assignee: sivabalan narayanan
> Add support to test custom schema w/ QuickStart
sivabalan narayanan created HUDI-1761:
-
Summary: Add support to test custom schema w/ QuickStart
Key: HUDI-1761
URL: https://issues.apache.org/jira/browse/HUDI-1761
Project: Apache Hudi
nsivabalan opened a new pull request #2767:
URL: https://github.com/apache/hudi/pull/2767
## What is the purpose of the pull request
Quick start in hudi has a statically defined schema. But it would be nice
for users to try our their own schema with QuickStart. This patch adds such
[
https://issues.apache.org/jira/browse/HUDI-1761?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
ASF GitHub Bot updated HUDI-1761:
-
Labels: pull-request-available sev:normal (was: sev:normal)
> Add support to test custom schema
[
https://issues.apache.org/jira/browse/HUDI-485?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Pratyaksh Sharma updated HUDI-485:
--
Status: Open (was: New)
> Check for where clause is wrong in HiveIncrementalPuller
>
[
https://issues.apache.org/jira/browse/HUDI-485?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Pratyaksh Sharma updated HUDI-485:
--
Status: In Progress (was: Open)
> Check for where clause is wrong in HiveIncrementalPuller
>
[
https://issues.apache.org/jira/browse/HUDI-1723?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17314571#comment-17314571
]
Raymond Xu commented on HUDI-1723:
--
[~shivnarayan] sure. I've actually encountered this issue in
[
https://issues.apache.org/jira/browse/HUDI-485?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Pratyaksh Sharma updated HUDI-485:
--
Status: Patch Available (was: In Progress)
> Check for where clause is wrong in
codecov-io edited a comment on pull request #2768:
URL: https://github.com/apache/hudi/pull/2768#issuecomment-813079061
# [Codecov](https://codecov.io/gh/apache/hudi/pull/2768?src=pr=h1) Report
> Merging
[#2768](https://codecov.io/gh/apache/hudi/pull/2768?src=pr=desc) (5d32a15)
into
pratyakshsharma commented on a change in pull request #2619:
URL: https://github.com/apache/hudi/pull/2619#discussion_r606840133
##
File path:
hudi-utilities/src/test/java/org/apache/hudi/utilities/deser/TestKafkaAvroSchemaDeserializer.java
##
@@ -0,0 +1,141 @@
+/*
+ *
[
https://issues.apache.org/jira/browse/HUDI-1762?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
ASF GitHub Bot updated HUDI-1762:
-
Labels: hive pull-request-available (was: hive)
> Hive Sync is not working with Hive Style
[
https://issues.apache.org/jira/browse/HUDI-1762?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Vinoth Govindarajan updated HUDI-1762:
--
Status: In Progress (was: Open)
> Hive Sync is not working with Hive Style
vingov opened a new pull request #2769:
URL: https://github.com/apache/hudi/pull/2769
## What is the purpose of the pull request
*This pull request adds a new partition extractor class to support Hive
style partitioning: HiveStylePartitionExtractor.*
## Brief change log
pratyakshsharma commented on pull request #1565:
URL: https://github.com/apache/hudi/pull/1565#issuecomment-813086786
> @pratyakshsharma I'm referring to this commit -> 900de34
@n3nash I went through the commit you are referring to. It basically takes
care of passing in custom
vburenin commented on pull request #2714:
URL: https://github.com/apache/hudi/pull/2714#issuecomment-813088782
I wonder what could cause those failures as the only change I made is log
level and some extra config print out... unless tests are looking into the
logs... which is not good.
codecov-io edited a comment on pull request #2714:
URL: https://github.com/apache/hudi/pull/2714#issuecomment-813089246
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For
codecov-io edited a comment on pull request #2714:
URL: https://github.com/apache/hudi/pull/2714#issuecomment-813089246
# [Codecov](https://codecov.io/gh/apache/hudi/pull/2714?src=pr=h1) Report
> Merging
[#2714](https://codecov.io/gh/apache/hudi/pull/2714?src=pr=desc) (ae99a64)
into
codecov-io edited a comment on pull request #2769:
URL: https://github.com/apache/hudi/pull/2769#issuecomment-813086549
# [Codecov](https://codecov.io/gh/apache/hudi/pull/2769?src=pr=h1) Report
> Merging
[#2769](https://codecov.io/gh/apache/hudi/pull/2769?src=pr=desc) (bd962cb)
into
hudi-bot edited a comment on pull request #2643:
URL: https://github.com/apache/hudi/pull/2643#issuecomment-792368481
## CI report:
* 9831a6c50e9f49f8a71c02fc6ac50ae1446f7c1f UNKNOWN
* a569dbe9409910fbb83b3764b300574c0e52612e Azure:
nsivabalan commented on issue #1786:
URL: https://github.com/apache/hudi/issues/1786#issuecomment-813111663
Closing this due to inactivity. Feel free to reopen to create a new ticket
if you need help.
--
This is an automated message from the Apache Git Service.
To respond to the
nsivabalan closed issue #1786:
URL: https://github.com/apache/hudi/issues/1786
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please
nsivabalan commented on issue #2508:
URL: https://github.com/apache/hudi/issues/2508#issuecomment-813124159
Sure. Keep us posted.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific
rubenssoto opened a new issue #2508:
URL: https://github.com/apache/hudi/issues/2508
[20210131210931.inflight.zip](https://github.com/apache/hudi/files/5900666/20210131210931.inflight.zip)
Hello,
Hudi Version: 0.7.0
Spark: 3.0.1
Emr 6.2.0
Spark Submit: spark-submit
nsivabalan removed a comment on issue #2508:
URL: https://github.com/apache/hudi/issues/2508#issuecomment-813124159
Sure. Keep us posted.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the
codecov-io edited a comment on pull request #2714:
URL: https://github.com/apache/hudi/pull/2714#issuecomment-813089246
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For
kimberlyamandalu commented on issue #2696:
URL: https://github.com/apache/hudi/issues/2696#issuecomment-813103178
> @kimberlyamandalu Yes, you should be able to switch off your metadata
table without any side-effect. Although, if you want to later turn on the
metadata table, you will need
nsivabalan edited a comment on issue #1757:
URL: https://github.com/apache/hudi/issues/1757#issuecomment-813112202
Hudi also has an optimized version of bulk insert with row writing which is
~30 to 40% faster than regular bulk_insert. You can enable this by setting this
config
nsivabalan commented on issue #1757:
URL: https://github.com/apache/hudi/issues/1757#issuecomment-813112202
Hudi also has an optimized version of bulk insert with row writing which is
~30 to 40% faster than regular bulk_insert. You can enable this by setting this
config
nsivabalan closed issue #1757:
URL: https://github.com/apache/hudi/issues/1757
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please
codecov-io commented on pull request #2714:
URL: https://github.com/apache/hudi/pull/2714#issuecomment-813089246
# [Codecov](https://codecov.io/gh/apache/hudi/pull/2714?src=pr=h1) Report
> Merging
[#2714](https://codecov.io/gh/apache/hudi/pull/2714?src=pr=desc) (700751e)
into
nsivabalan merged pull request #2766:
URL: https://github.com/apache/hudi/pull/2766
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service,
This is an automated email from the ASF dual-hosted git repository.
sivabalan pushed a commit to branch asf-site
in repository https://gitbox.apache.org/repos/asf/hudi.git
The following commit(s) were added to refs/heads/asf-site by this push:
new 80c4d46 [MINOR] minor corrections in
This is an automated email from the ASF dual-hosted git repository.
garyli pushed a change to annotated tag release-0.8.0
in repository https://gitbox.apache.org/repos/asf/hudi.git.
*** WARNING: tag release-0.8.0 was modified! ***
from da65d3c (commit)
to 5406f22 (tag)
tagging
nsivabalan commented on issue #2637:
URL: https://github.com/apache/hudi/issues/2637#issuecomment-813175861
We can close out this issue as we have a tracking jira and a PR being
actively reviewed.
--
This is an automated message from the Apache Git Service.
To respond to the message,
nsivabalan commented on a change in pull request #2769:
URL: https://github.com/apache/hudi/pull/2769#discussion_r606914161
##
File path:
hudi-sync/hudi-hive-sync/src/main/java/org/apache/hudi/hive/HiveStylePartitionValueExtractor.java
##
@@ -0,0 +1,37 @@
+/*
+ * Licensed to
This is an automated email from the ASF dual-hosted git repository.
vinoth pushed a commit to branch asf-site
in repository https://gitbox.apache.org/repos/asf/hudi.git
The following commit(s) were added to refs/heads/asf-site by this push:
new 076e846 Travis CI build asf-site
076e846 is
nsivabalan commented on issue #2760:
URL: https://github.com/apache/hudi/issues/2760#issuecomment-813177853
CC @garyli1019
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
Sugamber closed issue #2637:
URL: https://github.com/apache/hudi/issues/2637
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please
This is an automated email from the ASF dual-hosted git repository.
garyli pushed a change to annotated tag release-0.8.0
in repository https://gitbox.apache.org/repos/asf/hudi.git.
*** WARNING: tag release-0.8.0 was modified! ***
from da65d3c (commit)
to afd61aa (tag)
tagging
nsivabalan commented on issue #2743:
URL: https://github.com/apache/hudi/issues/2743#issuecomment-813194180
Yeah, we don't recommend deleting partitions outside of hudi. Hudi support
insert_override operation. But not sure if it can just delete partition w/o
ingesting any data.
nsivabalan commented on issue #2760:
URL: https://github.com/apache/hudi/issues/2760#issuecomment-813194590
Closing the GH issue as we have tracking jira.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL
nsivabalan closed issue #2760:
URL: https://github.com/apache/hudi/issues/2760
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please
77 matches
Mail list logo
