[jira] [Commented] (HIVE-16856) Allow For Customization Of Buffer Size In MapJoinTableContainerSerDe

2017-11-03 Thread Ashutosh Chauhan (JIRA) 

[ 
https://issues.apache.org/jira/browse/HIVE-16856?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16238563#comment-16238563
 ] 

Ashutosh Chauhan commented on HIVE-16856:
-

+1

> Allow For Customization Of Buffer Size In MapJoinTableContainerSerDe
> 
>
> Key: HIVE-16856
> URL: https://issues.apache.org/jira/browse/HIVE-16856
> Project: Hive
>  Issue Type: Improvement
>Reporter: BELUGA BEHR
>Assignee: BELUGA BEHR
> Attachments: HIVE-16856.1.patch
>
>
> MapJoinTableContainerSerDe currently hard-codes the buffer sizes as 4K.  If 
> we remove the explicit buffer size, it will fall back to using the customized 
> buffer size (or 4K):
> {code}
>public FSDataInputStream open(Path f) throws IOException {
>  return open(f, getConf().getInt("io.file.buffer.size", 4096));
>}
> {code}



--
This message was sent by Atlassian JIRA
(v6.4.14#64029)

[jira] [Commented] (HIVE-16856) Allow For Customization Of Buffer Size In MapJoinTableContainerSerDe

2017-06-28 Thread BELUGA BEHR (JIRA) 

[ 
https://issues.apache.org/jira/browse/HIVE-16856?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16066449#comment-16066449
 ] 

BELUGA BEHR commented on HIVE-16856:


Test errors unrelated

> Allow For Customization Of Buffer Size In MapJoinTableContainerSerDe
> 
>
> Key: HIVE-16856
> URL: https://issues.apache.org/jira/browse/HIVE-16856
> Project: Hive
>  Issue Type: Improvement
>Reporter: BELUGA BEHR
>Assignee: BELUGA BEHR
>Priority: Trivial
> Attachments: HIVE-16856.1.patch
>
>
> MapJoinTableContainerSerDe currently hard-codes the buffer sizes as 4K.  If 
> we remove the explicit buffer size, it will fall back to using the customized 
> buffer size (or 4K):
> {code}
>public FSDataInputStream open(Path f) throws IOException {
>  return open(f, getConf().getInt("io.file.buffer.size", 4096));
>}
> {code}



--
This message was sent by Atlassian JIRA
(v6.4.14#64029)

[jira] [Commented] (HIVE-16856) Allow For Customization Of Buffer Size In MapJoinTableContainerSerDe

2017-06-23 Thread Hive QA (JIRA) 

[ 
https://issues.apache.org/jira/browse/HIVE-16856?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16061283#comment-16061283
 ] 

Hive QA commented on HIVE-16856:




Here are the results of testing the latest attachment:
https://issues.apache.org/jira/secure/attachment/12871986/HIVE-16856.1.patch

{color:red}ERROR:{color} -1 due to no test(s) being added or modified.

{color:red}ERROR:{color} -1 due to 13 failed/errored test(s), 10845 tests 
executed
*Failed tests:*
{noformat}
org.apache.hadoop.hive.cli.TestMiniLlapLocalCliDriver.testCliDriver[tez_smb_main]
 (batchId=150)
org.apache.hadoop.hive.cli.TestMiniLlapLocalCliDriver.testCliDriver[vector_if_expr]
 (batchId=146)
org.apache.hadoop.hive.cli.TestPerfCliDriver.testCliDriver[query16] 
(batchId=233)
org.apache.hadoop.hive.cli.TestPerfCliDriver.testCliDriver[query23] 
(batchId=233)
org.apache.hadoop.hive.cli.TestPerfCliDriver.testCliDriver[query94] 
(batchId=233)
org.apache.hadoop.hive.cli.TestSparkCliDriver.testCliDriver[union24] 
(batchId=125)
org.apache.hadoop.hive.ql.parse.TestReplicationScenariosAcrossInstances.testBootstrapFunctionReplication
 (batchId=217)
org.apache.hadoop.hive.ql.parse.TestReplicationScenariosAcrossInstances.testCreateFunctionIncrementalReplication
 (batchId=217)
org.apache.hadoop.hive.ql.parse.TestReplicationScenariosAcrossInstances.testCreateFunctionWithFunctionBinaryJarsOnHDFS
 (batchId=217)
org.apache.hive.hcatalog.api.TestHCatClient.testPartitionRegistrationWithCustomSchema
 (batchId=178)
org.apache.hive.hcatalog.api.TestHCatClient.testPartitionSpecRegistrationWithCustomSchema
 (batchId=178)
org.apache.hive.hcatalog.api.TestHCatClient.testTableSchemaPropagation 
(batchId=178)
org.apache.hive.jdbc.TestJdbcWithMiniHS2.testHttpRetryOnServerIdleTimeout 
(batchId=227)
{noformat}

Test results: https://builds.apache.org/job/PreCommit-HIVE-Build/5750/testReport
Console output: https://builds.apache.org/job/PreCommit-HIVE-Build/5750/console
Test logs: http://104.198.109.242/logs/PreCommit-HIVE-Build-5750/

Messages:
{noformat}
Executing org.apache.hive.ptest.execution.TestCheckPhase
Executing org.apache.hive.ptest.execution.PrepPhase
Executing org.apache.hive.ptest.execution.ExecutionPhase
Executing org.apache.hive.ptest.execution.ReportingPhase
Tests exited with: TestsFailedException: 13 tests failed
{noformat}

This message is automatically generated.

ATTACHMENT ID: 12871986 - PreCommit-HIVE-Build

> Allow For Customization Of Buffer Size In MapJoinTableContainerSerDe
> 
>
> Key: HIVE-16856
> URL: https://issues.apache.org/jira/browse/HIVE-16856
> Project: Hive
>  Issue Type: Improvement
>Reporter: BELUGA BEHR
>Assignee: BELUGA BEHR
>Priority: Trivial
> Attachments: HIVE-16856.1.patch
>
>
> MapJoinTableContainerSerDe currently hard-codes the buffer sizes as 4K.  If 
> we remove the explicit buffer size, it will fall back to using the customized 
> buffer size (or 4K):
> {code}
>public FSDataInputStream open(Path f) throws IOException {
>  return open(f, getConf().getInt("io.file.buffer.size", 4096));
>}
> {code}



--
This message was sent by Atlassian JIRA
(v6.4.14#64029)