soumilshah1995 commented on issue #10165:
URL: https://github.com/apache/hudi/issues/10165#issuecomment-1828865064
# Test Passed
Ran Delta Streamer in CONT Mode
```
spark-submit \
--class org.apache.hudi.utilities.streamer.HoodieStreamer \
--packages
soumilshah1995 closed issue #10165: [SUPPORT] Async Clustering: Seeking Help on
Specific Partitioning and Regex Pattern
URL: https://github.com/apache/hudi/issues/10165
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
soumilshah1995 commented on issue #10165:
URL: https://github.com/apache/hudi/issues/10165#issuecomment-1828853204
Well I was testing this out looked fine for few run why is it clustering
2023-11 ?
```
None
soumilshah1995 commented on issue #10165:
URL: https://github.com/apache/hudi/issues/10165#issuecomment-1828848290
I am looking fwd to make YouTube videos on this topics
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and
soumilshah1995 commented on issue #10165:
URL: https://github.com/apache/hudi/issues/10165#issuecomment-1828844187
Issue has been resolved
I had to pass this in quotes
```
--hoodie-conf
'hoodie.clustering.plan.strategy.partition.regex.pattern=^2023-10-[0-9][0-9]$'
\
soumilshah1995 closed issue #10165: [SUPPORT] Async Clustering: Seeking Help on
Specific Partitioning and Regex Pattern
URL: https://github.com/apache/hudi/issues/10165
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
soumilshah1995 commented on issue #10165:
URL: https://github.com/apache/hudi/issues/10165#issuecomment-1828824587
@noahtaite you are right
I did set the flag and now I can see all partition that were clustered
```
noahtaite commented on issue #10165:
URL: https://github.com/apache/hudi/issues/10165#issuecomment-1828736370
@soumilshah1995 I did a bit of digging,
https://hudi.apache.org/docs/procedures/ doesn't explicitly say it, but there
appears to be a `show_involved_partition` boolean flag we
soumilshah1995 commented on issue #10165:
URL: https://github.com/apache/hudi/issues/10165#issuecomment-1828671661
Here is my replacement commits
https://github.com/apache/hudi/assets/39345855/1d5d32ef-0e78-4b19-96e6-3e9dc450231f;>
```
{
"partitionToWriteStats" : {
soumilshah1995 commented on issue #10165:
URL: https://github.com/apache/hudi/issues/10165#issuecomment-1828669324
if i am missing any config please let me know happy to learn from experts
here
--
This is an automated message from the Apache Git Service.
To respond to
soumilshah1995 commented on issue #10165:
URL: https://github.com/apache/hudi/issues/10165#issuecomment-1828665873
I changed my partition to look like this
https://github.com/apache/hudi/assets/39345855/b645db43-f074-4880-bb26-1952752e7683;>
Hudi configs
```
subash-metica commented on issue #10165:
URL: https://github.com/apache/hudi/issues/10165#issuecomment-1828598815
> The partition paths in your example, does it contain only dates in the
format of -MM-dd ?
@noahtaite is right! Looks like your partition path is not -MM-dd
noahtaite commented on issue #10165:
URL: https://github.com/apache/hudi/issues/10165#issuecomment-1828595136
>
soumilshah1995 commented on issue #10165:
URL: https://github.com/apache/hudi/issues/10165#issuecomment-1827927924
https://github.com/apache/hudi/assets/39345855/1b019a83-1924-441f-bf07-a1816aea2b93;>
Ran show clustering
```
soumilshah1995 opened a new issue, #10165:
URL: https://github.com/apache/hudi/issues/10165
Subject : Async Clustering: Seeking Help on Specific Partitioning and Regex
Pattern
I'm currently exploring async clustering in Apache Hudi, and this is also
intended for a community
15 matches
Mail list logo
