ad1happy2go commented on issue #10852:
URL: https://github.com/apache/hudi/issues/10852#issuecomment-1991416169
@jayesh2424 Sorry but I am not exactly clear of the question.
In case you are asking how to read a specific part of table, You can read a
data frame and do where/filter on that. If your dataset is partitioned and if
you apply the partition column filter then it is only going to read those
subdirectories only (in case you meant that by part of data lake)
In case you want to use sql, you can do -
df.createOrReplaceTempView("temp_table")
spark.sql("select * from temp_table where a = 1")
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: [email protected]
For queries about this service, please contact Infrastructure at:
[email protected]
