[jira] [Commented] (HIVE-17302) ReduceRecordSource should not add batch string to Exception message

[slim bouguerra (JIRA)]

[ 
https://issues.apache.org/jira/browse/HIVE-17302?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16137162#comment-16137162
 ] 

slim bouguerra commented on HIVE-17302:
---

[~ashutoshc] can we check this in ? 

> ReduceRecordSource should not add batch string to Exception message
> ---
>
> Key: HIVE-17302
> URL: https://issues.apache.org/jira/browse/HIVE-17302
> Project: Hive
>  Issue Type: Bug
>Reporter: slim bouguerra
>Assignee: slim bouguerra
> Attachments: HIVE-17302.patch, stack.txt
>
>
> ReduceRecordSource is adding the batch data as a string to the exception 
> stack, this can lead to an OOM of the Query AM when the query fails due to 
> other issue.



--
This message was sent by Atlassian JIRA
(v6.4.14#64029)

[jira] [Commented] (HIVE-17302) ReduceRecordSource should not add batch string to Exception message

[Hive QA (JIRA)]

[ 
https://issues.apache.org/jira/browse/HIVE-17302?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16124450#comment-16124450
 ] 

Hive QA commented on HIVE-17302:




Here are the results of testing the latest attachment:
https://issues.apache.org/jira/secure/attachment/12881552/HIVE-17302.patch

{color:red}ERROR:{color} -1 due to no test(s) being added or modified.

{color:red}ERROR:{color} -1 due to 10 failed/errored test(s), 11004 tests 
executed
*Failed tests:*
{noformat}
org.apache.hadoop.hive.cli.TestBlobstoreCliDriver.testCliDriver[insert_overwrite_dynamic_partitions_merge_move]
 (batchId=243)
org.apache.hadoop.hive.cli.TestBlobstoreCliDriver.testCliDriver[insert_overwrite_dynamic_partitions_merge_only]
 (batchId=243)
org.apache.hadoop.hive.cli.TestBlobstoreCliDriver.testCliDriver[insert_overwrite_dynamic_partitions_move_only]
 (batchId=243)
org.apache.hadoop.hive.cli.TestMiniSparkOnYarnCliDriver.testCliDriver[spark_dynamic_partition_pruning]
 (batchId=169)
org.apache.hadoop.hive.cli.TestMiniSparkOnYarnCliDriver.testCliDriver[spark_dynamic_partition_pruning_mapjoin_only]
 (batchId=170)
org.apache.hadoop.hive.cli.TestMiniSparkOnYarnCliDriver.testCliDriver[spark_vectorized_dynamic_partition_pruning]
 (batchId=169)
org.apache.hadoop.hive.cli.TestPerfCliDriver.testCliDriver[query14] 
(batchId=235)
org.apache.hive.hcatalog.api.TestHCatClient.testPartitionRegistrationWithCustomSchema
 (batchId=180)
org.apache.hive.hcatalog.api.TestHCatClient.testPartitionSpecRegistrationWithCustomSchema
 (batchId=180)
org.apache.hive.hcatalog.api.TestHCatClient.testTableSchemaPropagation 
(batchId=180)
{noformat}

Test results: https://builds.apache.org/job/PreCommit-HIVE-Build/6363/testReport
Console output: https://builds.apache.org/job/PreCommit-HIVE-Build/6363/console
Test logs: http://104.198.109.242/logs/PreCommit-HIVE-Build-6363/

Messages:
{noformat}
Executing org.apache.hive.ptest.execution.TestCheckPhase
Executing org.apache.hive.ptest.execution.PrepPhase
Executing org.apache.hive.ptest.execution.ExecutionPhase
Executing org.apache.hive.ptest.execution.ReportingPhase
Tests exited with: TestsFailedException: 10 tests failed
{noformat}

This message is automatically generated.

ATTACHMENT ID: 12881552 - PreCommit-HIVE-Build

> ReduceRecordSource should not add batch string to Exception message
> ---
>
> Key: HIVE-17302
> URL: https://issues.apache.org/jira/browse/HIVE-17302
> Project: Hive
>  Issue Type: Bug
>Reporter: slim bouguerra
>Assignee: slim bouguerra
> Attachments: HIVE-17302.patch, stack.txt
>
>
> ReduceRecordSource is adding the batch data as a string to the exception 
> stack, this can lead to an OOM of the Query AM when the query fails due to 
> other issue.



--
This message was sent by Atlassian JIRA
(v6.4.14#64029)

[jira] [Commented] (HIVE-17302) ReduceRecordSource should not add batch string to Exception message

[Prasanth Jayachandran (JIRA)]

[ 
https://issues.apache.org/jira/browse/HIVE-17302?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16124183#comment-16124183
 ] 

Prasanth Jayachandran commented on HIVE-17302:
--

+1, pending tests

> ReduceRecordSource should not add batch string to Exception message
> ---
>
> Key: HIVE-17302
> URL: https://issues.apache.org/jira/browse/HIVE-17302
> Project: Hive
>  Issue Type: Bug
>Reporter: slim bouguerra
>Assignee: slim bouguerra
> Attachments: HIVE-17302.patch, stack.txt
>
>
> ReduceRecordSource is adding the batch data as a string to the exception 
> stack, this can lead to an OOM of the Query AM when the query fails due to 
> other issue.



--
This message was sent by Atlassian JIRA
(v6.4.14#64029)

[jira] [Commented] (HIVE-17302) ReduceRecordSource should not add batch string to Exception message

[slim bouguerra (JIRA)]

[ 
https://issues.apache.org/jira/browse/HIVE-17302?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16124164#comment-16124164
 ] 

slim bouguerra commented on HIVE-17302:
---

[~ashutoshc] can you check this out.

> ReduceRecordSource should not add batch string to Exception message
> ---
>
> Key: HIVE-17302
> URL: https://issues.apache.org/jira/browse/HIVE-17302
> Project: Hive
>  Issue Type: Bug
>Reporter: slim bouguerra
>Assignee: slim bouguerra
> Attachments: HIVE-17302.patch, stack.txt
>
>
> ReduceRecordSource is adding the batch data as a string to the exception 
> stack, this can lead to an OOM of the Query AM when the query fails due to 
> other issue.



--
This message was sent by Atlassian JIRA
(v6.4.14#64029)