parisni commented on PR #8716:
URL: https://github.com/apache/hudi/pull/8716#issuecomment-1550795124
Sorry not fully understood what you want. What is Parquet SSBF? Do you mean
how spark itself handle parquet blooms ?
On May 17, 2023 2:44:07 AM UTC, Danny Chan ***@***.***> wrote:
>@danny0405 commented on this pull request.
>
>
>
>>
> public HoodieBaseParquetWriter(Path file,
> HoodieParquetConfig<? extends
WriteSupport<R>> parquetConfig) throws IOException {
>- super(HoodieWrapperFileSystem.convertToHoodiePath(file,
parquetConfig.getHadoopConf()),
>- ParquetFileWriter.Mode.CREATE,
>- parquetConfig.getWriteSupport(),
>- parquetConfig.getCompressionCodecName(),
>- parquetConfig.getBlockSize(),
>- parquetConfig.getPageSize(),
>- parquetConfig.getPageSize(),
>- parquetConfig.dictionaryEnabled(),
>- DEFAULT_IS_VALIDATING_ENABLED,
>- DEFAULT_WRITER_VERSION,
>- FSUtils.registerFileSystem(file, parquetConfig.getHadoopConf()));
>+ ParquetWriter.Builder parquetWriterbuilder = new
ParquetWriter.Builder(HoodieWrapperFileSystem.convertToHoodiePath(file,
parquetConfig.getHadoopConf())) {
>+ @Override
>+ protected ParquetWriter.Builder self() {
>
>Can you show me the code how spark adapter to the Parquet SSBF support?
>
>--
>Reply to this email directly or view it on GitHub:
>https://github.com/apache/hudi/pull/8716#pullrequestreview-1429707369
>You are receiving this because you authored the thread.
>
>Message ID: ***@***.***>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: [email protected]
For queries about this service, please contact Infrastructure at:
[email protected]
