teeyog commented on pull request #2475:
URL: https://github.com/apache/hudi/pull/2475#issuecomment-774578774
> > Of course it can, but it is specified by the parameter
basePath=../2020/_/_
>
> I want to clarify this a bit. do you mean `val READ_PATHS_OPT_KEY =
"hoodie.datasource.read.paths"` ?
>
> if I do the following, I see that we reset the `path` in options to
`basePath + "/*/*/*/*`. How does Spark parquet source know to only look for
2020 and 2021 for e,g?
>
> ```
> val snapshotDF1 = spark.read.format("org.apache.hudi")
> .load(basePath + "/202*/*/*/*")
> ```
I understand what you mean. The situation you said is really not supported,
because the data path will be automatically inferred to cover the path
configured by the user, but you only check the requirements of 2020 and 2021,
you can use dadaframe when Filter again, or do I need to judge whether the path
specified by the user contains *, if it does, the data path is not
automatically inferred, what do you think?
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
[email protected]
