[
https://issues.apache.org/jira/browse/BEAM-11527?focusedWorklogId=529020&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-529020
]
ASF GitHub Bot logged work on BEAM-11527:
-----------------------------------------
Author: ASF GitHub Bot
Created on: 29/Dec/20 04:15
Start Date: 29/Dec/20 04:15
Worklog Time Spent: 10m
Work Description: anantdamle commented on a change in pull request #13619:
URL: https://github.com/apache/beam/pull/13619#discussion_r549561833
##########
File path:
sdks/java/io/parquet/src/main/java/org/apache/beam/sdk/io/parquet/ParquetIO.java
##########
@@ -1058,6 +1128,18 @@ public GenericRecord apply(GenericRecord input) {
private GenericRecordPassthroughFn() {}
}
+ /** Returns a new Hadoop {@link Configuration} instance with provided flags.
*/
+ private static SerializableConfiguration makeHadoopConfigurationUsingFlags(
Review comment:
Done.
Initially I was contemplating this alternative but discarded to reduce
touching more files.
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
[email protected]
Issue Time Tracking
-------------------
Worklog Id: (was: 529020)
Time Spent: 40m (was: 0.5h)
> Support user configurable Hadoop Configuration flags for ParquetIO
> ------------------------------------------------------------------
>
> Key: BEAM-11527
> URL: https://issues.apache.org/jira/browse/BEAM-11527
> Project: Beam
> Issue Type: Improvement
> Components: io-java-parquet
> Reporter: Anant Damle
> Assignee: Anant Damle
> Priority: P2
> Labels: parquet
> Time Spent: 40m
> Remaining Estimate: 0h
>
> Provide an user configurable interface to provide/input Hadoop configuration
> for ParquetIO.
> Current behaviour supports only
> \{code}AvroReadSupport.AVRO_COMPATIBILITY\{code} flag.
>
> There are now more options supported for reader as introduced through
> [PARQUET-1928|https://issues.apache.org/jira/browse/PARQUET-1928] and
> [PR/831|https://github.com/apache/parquet-mr/pull/831]
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
