[
https://issues.apache.org/jira/browse/BEAM-10284?focusedWorklogId=449880&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-449880
]
ASF GitHub Bot logged work on BEAM-10284:
-----------------------------------------
Author: ASF GitHub Bot
Created on: 23/Jun/20 15:51
Start Date: 23/Jun/20 15:51
Worklog Time Spent: 10m
Work Description: iemejia commented on pull request #12064:
URL: https://github.com/apache/beam/pull/12064#issuecomment-648252297
Hi, PR looks perfect but I have a question. Why do you need to pass a
`Configuration` object or in other words what are you trying to configure?
Something FileSystem related or Parquet related?
Just with this in mind. We are trying to keep ParquetIO public API a bit
'isolated' of Hadoop API to make evolution 'easier' for not Hadoop cases
(https://issues.apache.org/jira/browse/PARQUET-1126) I am even feeling inclined
if what you want to achieve is Parquet configuration
(`parquet.avro.add-list-element-records`,
`parquet.avro.write-old-list-structure`) to pass those in a Map. But if what
you want is FileSystem configuration I am wondering why the configuration on
HDFS does not make it, did you try that if that's the case?
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
[email protected]
Issue Time Tracking
-------------------
Worklog Id: (was: 449880)
Time Spent: 1h (was: 50m)
> Allow to pass config to Parquet sink
> ------------------------------------
>
> Key: BEAM-10284
> URL: https://issues.apache.org/jira/browse/BEAM-10284
> Project: Beam
> Issue Type: New Feature
> Components: io-java-parquet
> Affects Versions: 2.22.0
> Reporter: Jozef Vilcek
> Assignee: Jozef Vilcek
> Priority: P2
> Time Spent: 1h
> Remaining Estimate: 0h
>
> Add to ParquetIO.Sink possibility to pass in configuration for underlying
> parquet writer.
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
