codecov-io edited a comment on pull request #2651:
URL: https://github.com/apache/hudi/pull/2651#issuecomment-794945140
# [Codecov](https://codecov.io/gh/apache/hudi/pull/2651?src=pr=h1) Report
> Merging
[#2651](https://codecov.io/gh/apache/hudi/pull/2651?src=pr=desc) (a717c4b)
into
codecov-io edited a comment on pull request #2651:
URL: https://github.com/apache/hudi/pull/2651#issuecomment-794945140
# [Codecov](https://codecov.io/gh/apache/hudi/pull/2651?src=pr=h1) Report
> Merging
[#2651](https://codecov.io/gh/apache/hudi/pull/2651?src=pr=desc) (6fa86b8)
into
Tandoy commented on issue #2668:
URL: https://github.com/apache/hudi/issues/2668#issuecomment-797881238
**Solution**
1.Replace cdh-spark with parquet and avro jar packages of
hudi/hudi-cli/target/lib/
2.Start command modification `spark-shell \ --packages
Tandoy closed issue #2668:
URL: https://github.com/apache/hudi/issues/2668
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the
codecov-io edited a comment on pull request #2651:
URL: https://github.com/apache/hudi/pull/2651#issuecomment-794945140
# [Codecov](https://codecov.io/gh/apache/hudi/pull/2651?src=pr=h1) Report
> Merging
[#2651](https://codecov.io/gh/apache/hudi/pull/2651?src=pr=desc) (a717c4b)
into
pengzhiwei2018 commented on pull request #2651:
URL: https://github.com/apache/hudi/pull/2651#issuecomment-797880725
Hi @umehrot2 , I have update the code.
Main changes:
1) Use `HoodieTableMetadata` to load files in partition.
2) Cancel the limit of enable the
pengzhiwei2018 commented on a change in pull request #2651:
URL: https://github.com/apache/hudi/pull/2651#discussion_r593682460
##
File path:
hudi-spark-datasource/hudi-spark/src/main/scala/org/apache/hudi/HoodieFileIndex.scala
##
@@ -0,0 +1,273 @@
+/*
+ * Licensed to the
garyli1019 commented on issue #2657:
URL: https://github.com/apache/hudi/issues/2657#issuecomment-797866333
hi @stackfun , thanks for reporting this issue. Would you try spark
datasource to query as well? We can narrow this issue down if it only happens
to hive.
pengzhiwei2018 commented on a change in pull request #2651:
URL: https://github.com/apache/hudi/pull/2651#discussion_r593551029
##
File path:
hudi-spark-datasource/hudi-spark/src/main/scala/org/apache/hudi/HoodieFileIndex.scala
##
@@ -0,0 +1,273 @@
+/*
+ * Licensed to the
pengzhiwei2018 commented on a change in pull request #2651:
URL: https://github.com/apache/hudi/pull/2651#discussion_r593551029
##
File path:
hudi-spark-datasource/hudi-spark/src/main/scala/org/apache/hudi/HoodieFileIndex.scala
##
@@ -0,0 +1,273 @@
+/*
+ * Licensed to the
pengzhiwei2018 commented on a change in pull request #2651:
URL: https://github.com/apache/hudi/pull/2651#discussion_r593551029
##
File path:
hudi-spark-datasource/hudi-spark/src/main/scala/org/apache/hudi/HoodieFileIndex.scala
##
@@ -0,0 +1,273 @@
+/*
+ * Licensed to the
pengzhiwei2018 commented on a change in pull request #2651:
URL: https://github.com/apache/hudi/pull/2651#discussion_r593550642
##
File path:
hudi-spark-datasource/hudi-spark/src/main/scala/org/apache/hudi/HoodieFileIndex.scala
##
@@ -0,0 +1,273 @@
+/*
+ * Licensed to the
pengzhiwei2018 commented on a change in pull request #2651:
URL: https://github.com/apache/hudi/pull/2651#discussion_r593550517
##
File path:
hudi-spark-datasource/hudi-spark/src/main/scala/org/apache/hudi/HoodieFileIndex.scala
##
@@ -0,0 +1,273 @@
+/*
+ * Licensed to the
pengzhiwei2018 commented on a change in pull request #2651:
URL: https://github.com/apache/hudi/pull/2651#discussion_r593550517
##
File path:
hudi-spark-datasource/hudi-spark/src/main/scala/org/apache/hudi/HoodieFileIndex.scala
##
@@ -0,0 +1,273 @@
+/*
+ * Licensed to the
pengzhiwei2018 commented on a change in pull request #2651:
URL: https://github.com/apache/hudi/pull/2651#discussion_r593550517
##
File path:
hudi-spark-datasource/hudi-spark/src/main/scala/org/apache/hudi/HoodieFileIndex.scala
##
@@ -0,0 +1,273 @@
+/*
+ * Licensed to the
pengzhiwei2018 commented on a change in pull request #2651:
URL: https://github.com/apache/hudi/pull/2651#discussion_r593549485
##
File path:
hudi-spark-datasource/hudi-spark/src/main/scala/org/apache/hudi/HoodieFileIndex.scala
##
@@ -0,0 +1,273 @@
+/*
+ * Licensed to the
pengzhiwei2018 commented on a change in pull request #2651:
URL: https://github.com/apache/hudi/pull/2651#discussion_r593548510
##
File path:
hudi-spark-datasource/hudi-spark/src/main/scala/org/apache/hudi/HoodieFileIndex.scala
##
@@ -0,0 +1,273 @@
+/*
+ * Licensed to the
pengzhiwei2018 commented on a change in pull request #2651:
URL: https://github.com/apache/hudi/pull/2651#discussion_r593548510
##
File path:
hudi-spark-datasource/hudi-spark/src/main/scala/org/apache/hudi/HoodieFileIndex.scala
##
@@ -0,0 +1,273 @@
+/*
+ * Licensed to the
pengzhiwei2018 commented on a change in pull request #2651:
URL: https://github.com/apache/hudi/pull/2651#discussion_r593547532
##
File path:
hudi-spark-datasource/hudi-spark/src/main/scala/org/apache/hudi/DefaultSource.scala
##
@@ -79,39 +82,58 @@ class DefaultSource extends
umehrot2 commented on a change in pull request #2651:
URL: https://github.com/apache/hudi/pull/2651#discussion_r593531717
##
File path:
hudi-spark-datasource/hudi-spark/src/main/scala/org/apache/hudi/DefaultSource.scala
##
@@ -79,39 +82,58 @@ class DefaultSource extends
codecov-io edited a comment on pull request #2580:
URL: https://github.com/apache/hudi/pull/2580#issuecomment-780218110
# [Codecov](https://codecov.io/gh/apache/hudi/pull/2580?src=pr=h1) Report
> Merging
[#2580](https://codecov.io/gh/apache/hudi/pull/2580?src=pr=desc) (1fd75aa)
into
This is an automated email from the ASF dual-hosted git repository.
xushiyan pushed a commit to branch master
in repository https://gitbox.apache.org/repos/asf/hudi.git
The following commit(s) were added to refs/heads/master by this push:
new f5e31be [HUDI-1685] keep updating current date
xushiyan merged pull request #2671:
URL: https://github.com/apache/hudi/pull/2671
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to
n3nash edited a comment on pull request #2374:
URL: https://github.com/apache/hudi/pull/2374#issuecomment-797797580
@vinothchandar Addressed your feedback comments and build is ready. Some
more things to note:
1. Added explicit dependency on `curator` to control the versions,
n3nash edited a comment on pull request #2374:
URL: https://github.com/apache/hudi/pull/2374#issuecomment-797797580
@vinothchandar Addressed your feedback comments and build is ready. Some
more things to note:
1. Added explicit dependency on `curator` to control the versions,
n3nash commented on pull request #2374:
URL: https://github.com/apache/hudi/pull/2374#issuecomment-797797580
@vinothchandar Addressed your feedback comments. Some more things to note:
1. Added explicit dependency on `curator` to control the versions, earlier
brought in through
codecov-io commented on pull request #2671:
URL: https://github.com/apache/hudi/pull/2671#issuecomment-797759321
# [Codecov](https://codecov.io/gh/apache/hudi/pull/2671?src=pr=h1) Report
> Merging
[#2671](https://codecov.io/gh/apache/hudi/pull/2671?src=pr=desc) (e3dff4d)
into
codecov-io edited a comment on pull request #2374:
URL: https://github.com/apache/hudi/pull/2374#issuecomment-750782300
# [Codecov](https://codecov.io/gh/apache/hudi/pull/2374?src=pr=h1) Report
> Merging
[#2374](https://codecov.io/gh/apache/hudi/pull/2374?src=pr=desc) (99b341e)
into
Nishith Agarwal created HUDI-1686:
-
Summary: Source Ordering field breaks Tests in
TestHoodieTestSuiteJob
Key: HUDI-1686
URL: https://issues.apache.org/jira/browse/HUDI-1686
Project: Apache Hudi
[
https://issues.apache.org/jira/browse/HUDI-1685?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
ASF GitHub Bot updated HUDI-1685:
-
Labels: pull-request-available (was: )
> Current date should not be initialized in the
xushiyan commented on a change in pull request #2671:
URL: https://github.com/apache/hudi/pull/2671#discussion_r593402899
##
File path:
hudi-utilities/src/main/java/org/apache/hudi/utilities/sources/helpers/DatePartitionPathSelector.java
##
@@ -173,7 +171,8 @@ public
[
https://issues.apache.org/jira/browse/HUDI-1685?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Ankush Kanungo updated HUDI-1685:
-
Description:
The current date within `DatePartitionPathSelector` should not be initialized
in
[
https://issues.apache.org/jira/browse/HUDI-1685?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Ankush Kanungo updated HUDI-1685:
-
Status: In Progress (was: Open)
> Current date should not be initialized in the constructor
>
Ankush Kanungo created HUDI-1685:
Summary: Current date should not be initialized in the constructor
Key: HUDI-1685
URL: https://issues.apache.org/jira/browse/HUDI-1685
Project: Apache Hudi
prashantwason commented on pull request #2494:
URL: https://github.com/apache/hudi/pull/2494#issuecomment-797665038
@vinothchandar PTAL.
This is an automated message from the Apache Git Service.
To respond to the message,
xushiyan commented on pull request #2671:
URL: https://github.com/apache/hudi/pull/2671#issuecomment-797661017
@akanungoz we need to file a bug and link the ticket id to this.
This is an automated message from the Apache Git
akanungoz opened a new pull request #2671:
URL: https://github.com/apache/hudi/pull/2671
## What is the purpose of the pull request
*When current date is not specified as config setting, the current system
date should keep getting updated and should not be initialized in the
This is an automated email from the ASF dual-hosted git repository.
vinoth pushed a commit to branch asf-site
in repository https://gitbox.apache.org/repos/asf/hudi.git
The following commit(s) were added to refs/heads/asf-site by this push:
new c401e9a Travis CI build asf-site
c401e9a is
This is an automated email from the ASF dual-hosted git repository.
leesf pushed a commit to branch asf-site
in repository https://gitbox.apache.org/repos/asf/hudi.git
The following commit(s) were added to refs/heads/asf-site by this push:
new 3b0f971 Added article #18 (#2670)
3b0f971 is
leesf merged pull request #2670:
URL: https://github.com/apache/hudi/pull/2670
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the
brandon-stanley opened a new pull request #2670:
URL: https://github.com/apache/hudi/pull/2670
Added the following article: "Data Lakehouse: Building the Next Generation
of Data Lakes using Apache Hudi".
Link:
[
https://issues.apache.org/jira/browse/HUDI-1684?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Danny Chen updated HUDI-1684:
-
Description:
- Add required dependencies for hudi-flink-bundle module
- Some package reorganize of
codecov-io commented on pull request #2669:
URL: https://github.com/apache/hudi/pull/2669#issuecomment-797515929
# [Codecov](https://codecov.io/gh/apache/hudi/pull/2669?src=pr=h1) Report
> Merging
[#2669](https://codecov.io/gh/apache/hudi/pull/2669?src=pr=desc) (e604fa5)
into
[
https://issues.apache.org/jira/browse/HUDI-1684?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
ASF GitHub Bot updated HUDI-1684:
-
Labels: pull-request-available (was: )
> Tweak hudi-flink-bundle module pom and re-organize the
danny0405 opened a new pull request #2669:
URL: https://github.com/apache/hudi/pull/2669
…cakges for hudi-flink module
## What is the purpose of the pull request
- Add required dependencies for hudi-flink-bundle module
- Some package re-organize of hudi-flink module
jonashartwig commented on issue #2661:
URL: https://github.com/apache/hudi/issues/2661#issuecomment-797434562
I checked the config section again. There is a property to set to create
proper hive partitions. Here is the fixed code:
```scala
import org.apache.spark.sql.Row
val
jonashartwig closed issue #2661:
URL: https://github.com/apache/hudi/issues/2661
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to
[
https://issues.apache.org/jira/browse/HUDI-648?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17300188#comment-17300188
]
liujinhui commented on HUDI-648:
[~xushiyan] [~vinoth]
When querying the error record, we introduce a
Danny Chen created HUDI-1684:
Summary: Tweak hudi-flink-bundle module pom and re-organize the
pacakges for hudi-flink module
Key: HUDI-1684
URL: https://issues.apache.org/jira/browse/HUDI-1684
Project:
codecov-io commented on pull request #2666:
URL: https://github.com/apache/hudi/pull/2666#issuecomment-797350759
# [Codecov](https://codecov.io/gh/apache/hudi/pull/2666?src=pr=h1) Report
> Merging
[#2666](https://codecov.io/gh/apache/hudi/pull/2666?src=pr=desc) (ac8d024)
into
codecov-io edited a comment on pull request #2374:
URL: https://github.com/apache/hudi/pull/2374#issuecomment-750782300
# [Codecov](https://codecov.io/gh/apache/hudi/pull/2374?src=pr=h1) Report
> Merging
[#2374](https://codecov.io/gh/apache/hudi/pull/2374?src=pr=desc) (b5c5c98)
into
Tandoy opened a new issue #2668:
URL: https://github.com/apache/hudi/issues/2668
**Steps to reproduce the behavior:**
1. `spark-shell \
--packages org.apache.spark:spark-avro_2.11:2.4.0 \
--conf 'spark.serializer=org.apache.spark.serializer.KryoSerializer' \
Tandoy closed issue #2667:
URL: https://github.com/apache/hudi/issues/2667
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the
Tandoy opened a new issue #2667:
URL: https://github.com/apache/hudi/issues/2667
**Steps to reproduce the behavior:**
1. `spark-shell \
--packages org.apache.spark:spark-avro_2.11:2.4.0 \
--conf 'spark.serializer=org.apache.spark.serializer.KryoSerializer' \
[
https://issues.apache.org/jira/browse/HUDI-1681?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
vinoyang closed HUDI-1681.
--
Resolution: Implemented
20786ab8a2a1e7735ab846e92802fb9f4449adc9
> Support object storage for Flink writer
>
[
https://issues.apache.org/jira/browse/HUDI-1681?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
vinoyang reassigned HUDI-1681:
--
Assignee: Danny Chen
> Support object storage for Flink writer
>
This is an automated email from the ASF dual-hosted git repository.
vinoyang pushed a commit to branch master
in repository https://gitbox.apache.org/repos/asf/hudi.git
The following commit(s) were added to refs/heads/master by this push:
new 20786ab [HUDI-1681] Support object storage for
yanghua merged pull request #2662:
URL: https://github.com/apache/hudi/pull/2662
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to
codecov-io edited a comment on pull request #2662:
URL: https://github.com/apache/hudi/pull/2662#issuecomment-796847977
# [Codecov](https://codecov.io/gh/apache/hudi/pull/2662?src=pr=h1) Report
> Merging
[#2662](https://codecov.io/gh/apache/hudi/pull/2662?src=pr=desc) (01978ab)
into
59 matches
Mail list logo
