[
https://issues.apache.org/jira/browse/PARQUET-1587?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
jincongho reassigned PARQUET-1587:
----------------------------------
Assignee: jincongho
> Parquet Writer doesn't support to write list of Groups directly into hadoop
> ---------------------------------------------------------------------------
>
> Key: PARQUET-1587
> URL: https://issues.apache.org/jira/browse/PARQUET-1587
> Project: Parquet
> Issue Type: Bug
> Components: parquet-mr
> Affects Versions: 1.10.1
> Reporter: Udit Joshi
> Assignee: jincongho
> Priority: Blocker
> Attachments: image-2019-05-31-10-41-45-674.png
>
>
> *Problem :-* Parquet Writer doesn't support to write list of Groups directly
> into hadoop.
> Cause of Problem :- Suitable classes are not available
> Constructors are not visible
> *All possible solution which i tried -*
> * ParquetWriter
> * ParquetFileWriter
> * ExampleParquetWriter
> * ParquetRecordWriter
> *Gradle dependency*
> {quote}compile group: 'org.apache.parquet', name: 'parquet-hadoop', version:
> '1.10.1'
> {quote}
>
> *Is there any way to writer parquet file into Hadoop with GroupSupport?*
>
> *Problem description*
> I am trying to create the object of {color:#d04437}ParquetWriter{color} class
> which accepts the argument (OutputFile, Mode, WriteSupport,
> CompressionCodecName, int, boolean, Configuration, int, ParquetProperties).
> But this constructor has default access modifier. I can't able to access it.
> I also used {color:#d04437}ParquetFileWriter{color} class but it doesn't
> show any group support.
>
> {color:#205081}*ParquetWriter*{color}
> *!image-2019-05-31-10-41-45-674.png!*
> *{color:#205081}ParquetFileWriter{color}*
> {code:java}
> ParquetFileWriter writer = new
> ParquetFileWriter(HadoopOutputFile.fromPath(writePathFile, configuration),
> schema, Mode.CREATE, DEFAULT_BLOCK_SIZE, MAX_PADDING_SIZE_DEFAULT) ;
> writer.start();{code}
>
> It creates to create parquet file in hadoop but can't facilitates to write
> List of Groups in parquet file
>
> *{color:#205081}ExampleParquetWriter{color}*
> {code:java}
> ParquetWriter<Group> writer =
> ExampleParquetWriter.builder(writePathFile).withConf(configuration).withType(getSchema()).build();
>
> System.out.println("Number of groups to write:" + groups.size());
> for (Group g : groups) {
> writer.write(g);
> } {code}
> Doesn't support for writing parquet file in hadoop
>
>
>
>
--
This message was sent by Atlassian Jira
(v8.20.1#820001)
