aromanenko-dev commented on a change in pull request #14227:
URL: https://github.com/apache/beam/pull/14227#discussion_r595074164
##########
File path:
sdks/java/io/parquet/src/main/java/org/apache/beam/sdk/io/parquet/ParquetIO.java
##########
@@ -1054,6 +1054,7 @@ public static Sink sink(Schema schema) {
return new AutoValue_ParquetIO_Sink.Builder()
.setJsonSchema(schema.toString())
.setCompressionCodec(CompressionCodecName.SNAPPY)
+ .setRowGroupSize(0)
Review comment:
Would it make sense to set a default size here instead of just `0`?
##########
File path:
sdks/java/io/parquet/src/main/java/org/apache/beam/sdk/io/parquet/ParquetIO.java
##########
@@ -1097,6 +1102,12 @@ public Sink withConfiguration(Configuration
configuration) {
return toBuilder().setConfiguration(new
SerializableConfiguration(configuration)).build();
}
+ /** Specify row-group size; if not set, a default will be used by the
underlying writer. */
+ public Sink withRowGroupSize(int rowGroupSize) {
+ checkArgument(rowGroupSize > 0, "rowGroupSize should be positive");
Review comment:
nit: "**must** be"
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
[email protected]
