[
https://issues.apache.org/jira/browse/PARQUET-1421?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16622123#comment-16622123
]
ASF GitHub Bot commented on PARQUET-1421:
-----------------------------------------
gszadovszky closed pull request #526: PARQUET-1421: InternalParquetRecordWriter
logs debug messages at the INFO level
URL: https://github.com/apache/parquet-mr/pull/526
This is a PR merged from a forked repository.
As GitHub hides the original diff on merge, it is displayed below for
the sake of provenance:
As this is a foreign pull request (from a fork), the diff is supplied
below (as it won't show otherwise due to GitHub magic):
diff --git
a/parquet-hadoop/src/main/java/org/apache/parquet/hadoop/InternalParquetRecordWriter.java
b/parquet-hadoop/src/main/java/org/apache/parquet/hadoop/InternalParquetRecordWriter.java
index d9e9b5e15..9743f9ff3 100644
---
a/parquet-hadoop/src/main/java/org/apache/parquet/hadoop/InternalParquetRecordWriter.java
+++
b/parquet-hadoop/src/main/java/org/apache/parquet/hadoop/InternalParquetRecordWriter.java
@@ -144,7 +144,7 @@ private void checkBlockSizeReached() throws IOException {
// flush the row group if it is within ~2 records of the limit
// it is much better to be slightly under size than to be over at all
if (memSize > (nextRowGroupSize - 2 * recordSize)) {
- LOG.info("mem size {} > {}: flushing {} records to disk.", memSize,
nextRowGroupSize, recordCount);
+ LOG.debug("mem size {} > {}: flushing {} records to disk.", memSize,
nextRowGroupSize, recordCount);
flushRowGroupToStore();
initStore();
recordCountForNextMemCheck = min(max(MINIMUM_RECORD_COUNT_FOR_CHECK,
recordCount / 2), MAXIMUM_RECORD_COUNT_FOR_CHECK);
@@ -162,7 +162,7 @@ private void checkBlockSizeReached() throws IOException {
private void flushRowGroupToStore()
throws IOException {
recordConsumer.flush();
- LOG.info("Flushing mem columnStore to file. allocated memory: {}",
columnStore.getAllocatedSize());
+ LOG.debug("Flushing mem columnStore to file. allocated memory: {}",
columnStore.getAllocatedSize());
if (columnStore.getAllocatedSize() > (3 * rowGroupSizeThreshold)) {
LOG.warn("Too much memory used: {}", columnStore.memUsageString());
}
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
[email protected]
> InternalParquetRecordWriter logs debug messages at the INFO level
> -----------------------------------------------------------------
>
> Key: PARQUET-1421
> URL: https://issues.apache.org/jira/browse/PARQUET-1421
> Project: Parquet
> Issue Type: Bug
> Reporter: Zoltan Ivanfi
> Assignee: Zoltan Ivanfi
> Priority: Major
> Labels: pull-request-available
>
> The superflous log messages clutter the output and may make Travis build due
> to too long output.
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
