[jira] [Assigned] (TEZ-2607) SIMD-based bitonic merge sorting

2015-07-15 Thread Tsuyoshi Ozawa (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-2607?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tsuyoshi Ozawa reassigned TEZ-2607: --- Assignee: Tsuyoshi Ozawa SIMD-based bitonic merge sorting

[jira] [Commented] (TEZ-2606) Cache-friendly data structure for sorting

2015-07-14 Thread Tsuyoshi Ozawa (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-2606?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14626192#comment-14626192 ] Tsuyoshi Ozawa commented on TEZ-2606: - [~gopalv] Thank you for the clarification. I

[jira] [Commented] (TEZ-2607) SIMD-based bitonic merge sorting

2015-07-14 Thread Tsuyoshi Ozawa (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-2607?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14627425#comment-14627425 ] Tsuyoshi Ozawa commented on TEZ-2607: - [~saikatr] thank you for being interested in

[jira] [Commented] (TEZ-2616) Fix build warning by undefined version of maven-findbugs-plugin

2015-07-13 Thread Tsuyoshi Ozawa (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-2616?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14624545#comment-14624545 ] Tsuyoshi Ozawa commented on TEZ-2616: - [~hitesh] could you take a look? Fix build

[jira] [Commented] (TEZ-2616) Fix build warning by undefined version of maven-findbugs-plugin

2015-07-13 Thread Tsuyoshi Ozawa (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-2616?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14625734#comment-14625734 ] Tsuyoshi Ozawa commented on TEZ-2616: - [~hitesh] oh, that's my mistake. Thank you for

[jira] [Created] (TEZ-2616) Fix build warning by undefined version of maven-findbugs-plugin

2015-07-13 Thread Tsuyoshi Ozawa (JIRA)
Tsuyoshi Ozawa created TEZ-2616: --- Summary: Fix build warning by undefined version of maven-findbugs-plugin Key: TEZ-2616 URL: https://issues.apache.org/jira/browse/TEZ-2616 Project: Apache Tez

[jira] [Updated] (TEZ-2616) Fix build warning by undefined version of maven-findbugs-plugin

2015-07-13 Thread Tsuyoshi Ozawa (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-2616?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tsuyoshi Ozawa updated TEZ-2616: Attachment: TEZ-2616.001.patch Attaching a first patch. Fix build warning by undefined version of

[jira] [Updated] (TEZ-2616) Fix build warning by undefined version of maven-findbugs-plugin

2015-07-13 Thread Tsuyoshi Ozawa (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-2616?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tsuyoshi Ozawa updated TEZ-2616: Description: {quote} [WARNING] Some problems were encountered while building the effective model for

[jira] [Commented] (TEZ-2602) Throwing EOFException when launching MR job

2015-07-13 Thread Tsuyoshi Ozawa (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-2602?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14624310#comment-14624310 ] Tsuyoshi Ozawa commented on TEZ-2602: - [~rajesh.balamohan] +1(non-binding), verified new

[jira] [Commented] (TEZ-2602) Throwing EOFException when launching MR job

2015-07-10 Thread Tsuyoshi Ozawa (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-2602?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14622040#comment-14622040 ] Tsuyoshi Ozawa commented on TEZ-2602: - [~rajesh.balamohan] it works well with the patch!

[jira] [Commented] (TEZ-2606) Cache-friendly data structure for sorting

2015-07-09 Thread Tsuyoshi Ozawa (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-2606?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14620628#comment-14620628 ] Tsuyoshi Ozawa commented on TEZ-2606: - [~gopalv] I think this change is only checking

[jira] [Commented] (TEZ-2602) Throwing EOFException when launching MR job

2015-07-09 Thread Tsuyoshi Ozawa (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-2602?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14619961#comment-14619961 ] Tsuyoshi Ozawa commented on TEZ-2602: - [~rajesh.balamohan] could you produce the

[jira] [Commented] (TEZ-2602) Throwing EOFException when launching MR job

2015-07-09 Thread Tsuyoshi Ozawa (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-2602?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14620106#comment-14620106 ] Tsuyoshi Ozawa commented on TEZ-2602: - The data was generated by randomtextwriter

[jira] [Commented] (TEZ-2602) Throwing EOFException when launching MR job

2015-07-09 Thread Tsuyoshi Ozawa (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-2602?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14620104#comment-14620104 ] Tsuyoshi Ozawa commented on TEZ-2602: - [~rajesh.balamohan] Oh, sorry, my input size was

[jira] [Commented] (TEZ-2602) Throwing EOFException when launching MR job

2015-07-09 Thread Tsuyoshi Ozawa (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-2602?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14620165#comment-14620165 ] Tsuyoshi Ozawa commented on TEZ-2602: - Trying to reproduce the problem with smaller

[jira] [Commented] (TEZ-2602) Throwing EOFException when launching MR job

2015-07-09 Thread Tsuyoshi Ozawa (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-2602?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14620164#comment-14620164 ] Tsuyoshi Ozawa commented on TEZ-2602: - Trying to reproduce the problem with smaller

[jira] [Commented] (TEZ-2602) Throwing EOFException when launching MR job

2015-07-09 Thread Tsuyoshi Ozawa (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-2602?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14620174#comment-14620174 ] Tsuyoshi Ozawa commented on TEZ-2602: - [~rajesh.balamohan] I could reproduce the problem

[jira] [Created] (TEZ-2606) Cache-friendly data structure for sorting

2015-07-08 Thread Tsuyoshi Ozawa (JIRA)
Tsuyoshi Ozawa created TEZ-2606: --- Summary: Cache-friendly data structure for sorting Key: TEZ-2606 URL: https://issues.apache.org/jira/browse/TEZ-2606 Project: Apache Tez Issue Type: Sub-task

[jira] [Created] (TEZ-2605) [Umbrella] CPU optimizations for hotspots

2015-07-08 Thread Tsuyoshi Ozawa (JIRA)
Tsuyoshi Ozawa created TEZ-2605: --- Summary: [Umbrella] CPU optimizations for hotspots Key: TEZ-2605 URL: https://issues.apache.org/jira/browse/TEZ-2605 Project: Apache Tez Issue Type:

[jira] [Updated] (TEZ-2605) [Umbrella] CPU optimizations for hotspots

2015-07-08 Thread Tsuyoshi Ozawa (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-2605?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tsuyoshi Ozawa updated TEZ-2605: Description: There are some CPU hotpots when processing large data when IO is highly optimized: 1.

[jira] [Created] (TEZ-2607) SIMD-based bitonic merge sorting

2015-07-08 Thread Tsuyoshi Ozawa (JIRA)
Tsuyoshi Ozawa created TEZ-2607: --- Summary: SIMD-based bitonic merge sorting Key: TEZ-2607 URL: https://issues.apache.org/jira/browse/TEZ-2607 Project: Apache Tez Issue Type: Sub-task

[jira] [Created] (TEZ-2608) UnorderedPartitionedKVWriter should override write(Object key, IterableObject values)

2015-07-08 Thread Tsuyoshi Ozawa (JIRA)
Tsuyoshi Ozawa created TEZ-2608: --- Summary: UnorderedPartitionedKVWriter should override write(Object key, IterableObject values) Key: TEZ-2608 URL: https://issues.apache.org/jira/browse/TEZ-2608

[jira] [Updated] (TEZ-2608) UnorderedPartitionedKVWriter should override write(Object key, IterableObject values)

2015-07-08 Thread Tsuyoshi Ozawa (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-2608?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tsuyoshi Ozawa updated TEZ-2608: Attachment: TEZ-2608.001.patch Attaching a first patch. UnorderedPartitionedKVWriter should

[jira] [Commented] (TEZ-2602) Throwing EOFException when launching MR job

2015-07-07 Thread Tsuyoshi Ozawa (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-2602?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14617594#comment-14617594 ] Tsuyoshi Ozawa commented on TEZ-2602: - [~hitesh] no, no fail with LEGACY sorter.

[jira] [Updated] (TEZ-2604) PipelinedSorter doesn't use number of items when creating SortSpan

2015-07-07 Thread Tsuyoshi Ozawa (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-2604?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tsuyoshi Ozawa updated TEZ-2604: Affects Version/s: 0.8.0 PipelinedSorter doesn't use number of items when creating SortSpan

[jira] [Updated] (TEZ-2604) PipelinedSorter doesn't use number of items when creating SortSpan

2015-07-07 Thread Tsuyoshi Ozawa (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-2604?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tsuyoshi Ozawa updated TEZ-2604: Attachment: TEZ-2604.001.patch Attaching a first patch. PipelinedSorter doesn't use number of items

[jira] [Created] (TEZ-2604) PipelinedSorter doesn't use number of items when creating SortSpan

2015-07-07 Thread Tsuyoshi Ozawa (JIRA)
Tsuyoshi Ozawa created TEZ-2604: --- Summary: PipelinedSorter doesn't use number of items when creating SortSpan Key: TEZ-2604 URL: https://issues.apache.org/jira/browse/TEZ-2604 Project: Apache Tez

[jira] [Commented] (TEZ-2602) Throwing EOFException when launching MR job

2015-07-07 Thread Tsuyoshi Ozawa (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-2602?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14616764#comment-14616764 ] Tsuyoshi Ozawa commented on TEZ-2602: - If making -Dtez.runtime.ifile.readahead false,

[jira] [Commented] (TEZ-1421) MRCombiner throws NPE in MapredWordCount on master branch

2015-07-07 Thread Tsuyoshi Ozawa (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-1421?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14616765#comment-14616765 ] Tsuyoshi Ozawa commented on TEZ-1421: - The current error I faced is not NPE, but

[jira] [Created] (TEZ-2602) Throwing EOFException when launching MR job

2015-07-07 Thread Tsuyoshi Ozawa (JIRA)
Tsuyoshi Ozawa created TEZ-2602: --- Summary: Throwing EOFException when launching MR job Key: TEZ-2602 URL: https://issues.apache.org/jira/browse/TEZ-2602 Project: Apache Tez Issue Type: Bug

[jira] [Commented] (TEZ-1421) MRCombiner throws NPE in MapredWordCount on master branch

2015-07-07 Thread Tsuyoshi Ozawa (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-1421?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14616670#comment-14616670 ] Tsuyoshi Ozawa commented on TEZ-1421: - Sorry for the delay. I met this bug again.

[jira] [Commented] (TEZ-2602) Throwing EOFException when launching MR job

2015-07-07 Thread Tsuyoshi Ozawa (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-2602?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14617955#comment-14617955 ] Tsuyoshi Ozawa commented on TEZ-2602: - [~rajesh.balamohan] I could reproduce the error

[jira] [Commented] (TEZ-2604) PipelinedSorter doesn't use number of items when creating SortSpan

2015-07-07 Thread Tsuyoshi Ozawa (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-2604?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14617946#comment-14617946 ] Tsuyoshi Ozawa commented on TEZ-2604: - [~rajesh.balamohan] Thanks for the sharing!

[jira] [Updated] (TEZ-2602) Throwing EOFException when launching MR job

2015-07-07 Thread Tsuyoshi Ozawa (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-2602?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tsuyoshi Ozawa updated TEZ-2602: Affects Version/s: 0.8.0 Throwing EOFException when launching MR job

[jira] [Commented] (TEZ-145) Support a combiner processor that can run non-local to map/reduce nodes

2015-04-17 Thread Tsuyoshi Ozawa (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-145?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14500397#comment-14500397 ] Tsuyoshi Ozawa commented on TEZ-145: [~gopalv] [~bikassaha] thank you for your comments.

[jira] [Commented] (TEZ-145) Support a combiner processor that can run non-local to map/reduce nodes

2015-04-10 Thread Tsuyoshi Ozawa (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-145?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14490647#comment-14490647 ] Tsuyoshi Ozawa commented on TEZ-145: [~bikassaha] [~gopalv] As Gopal mentioned, this

[jira] [Comment Edited] (TEZ-145) Support a combiner processor that can run non-local to map/reduce nodes

2015-04-10 Thread Tsuyoshi Ozawa (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-145?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14490647#comment-14490647 ] Tsuyoshi Ozawa edited comment on TEZ-145 at 4/11/15 1:08 AM: -

[jira] [Commented] (TEZ-145) Support a combiner processor that can run non-local to map/reduce nodes

2015-04-09 Thread Tsuyoshi Ozawa (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-145?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14487627#comment-14487627 ] Tsuyoshi Ozawa commented on TEZ-145: [~gopalv] thanks for taking a look at my patch and

[jira] [Commented] (TEZ-145) Support a combiner processor that can run non-local to map/reduce nodes

2015-04-01 Thread Tsuyoshi Ozawa (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-145?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14390034#comment-14390034 ] Tsuyoshi Ozawa commented on TEZ-145: @Gopal V [~bikassaha] How can we go ahead with this

[jira] [Commented] (TEZ-2240) Fix toUpperCase/toLowerCase to use Locale.ENGLISH

2015-03-30 Thread Tsuyoshi Ozawa (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-2240?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14386863#comment-14386863 ] Tsuyoshi Ozawa commented on TEZ-2240: - [~hitesh], could you review this? Fix

[jira] [Commented] (TEZ-2240) Fix toUpperCase/toLowerCase to use Locale.ENGLISH

2015-03-30 Thread Tsuyoshi Ozawa (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-2240?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14388017#comment-14388017 ] Tsuyoshi Ozawa commented on TEZ-2240: - Thank you for committing, Hitesh! Fix

[jira] [Updated] (TEZ-2240) Fix toUpperCase/toLowerCase to use Locale.ENGLISH

2015-03-26 Thread Tsuyoshi Ozawa (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-2240?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tsuyoshi Ozawa updated TEZ-2240: Attachment: TEZ-2240.1.patch Attaching a patch. Fix toUpperCase/toLowerCase to use Locale.ENGLISH

[jira] [Created] (TEZ-2240) Fix toUpperCase/toLowerCase to use Locale.ENGLISH

2015-03-26 Thread Tsuyoshi Ozawa (JIRA)
Tsuyoshi Ozawa created TEZ-2240: --- Summary: Fix toUpperCase/toLowerCase to use Locale.ENGLISH Key: TEZ-2240 URL: https://issues.apache.org/jira/browse/TEZ-2240 Project: Apache Tez Issue Type:

[jira] [Assigned] (TEZ-2240) Fix toUpperCase/toLowerCase to use Locale.ENGLISH

2015-03-26 Thread Tsuyoshi Ozawa (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-2240?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tsuyoshi Ozawa reassigned TEZ-2240: --- Assignee: Tsuyoshi Ozawa Fix toUpperCase/toLowerCase to use Locale.ENGLISH

[jira] [Issue Comment Deleted] (TEZ-1421) MRCombiner throws NPE in MapredWordCount on master branch

2015-03-23 Thread Tsuyoshi Ozawa (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-1421?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tsuyoshi Ozawa updated TEZ-1421: Comment: was deleted (was: [~hitesh] Yes, I agree with you.) MRCombiner throws NPE in

[jira] [Commented] (TEZ-1421) MRCombiner throws NPE in MapredWordCount on master branch

2015-03-23 Thread Tsuyoshi Ozawa (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-1421?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14377293#comment-14377293 ] Tsuyoshi Ozawa commented on TEZ-1421: - [~hitesh] Yes, I agree with you. MRCombiner

[jira] [Commented] (TEZ-1421) MRCombiner throws NPE in MapredWordCount on master branch

2015-03-22 Thread Tsuyoshi Ozawa (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-1421?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14375411#comment-14375411 ] Tsuyoshi Ozawa commented on TEZ-1421: - [~jeagles], thank you for your help! I'm dealing

[jira] [Commented] (TEZ-145) Support a combiner processor that can run non-local to map/reduce nodes

2015-03-19 Thread Tsuyoshi Ozawa (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-145?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14369717#comment-14369717 ] Tsuyoshi Ozawa commented on TEZ-145: [~gopalv] [~bikassaha] thank you for the feedback! I

[jira] [Updated] (TEZ-145) Support a combiner processor that can run non-local to map/reduce nodes

2015-03-18 Thread Tsuyoshi Ozawa (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-145?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tsuyoshi Ozawa updated TEZ-145: --- Attachment: TEZ-145.2.patch Fix warnings by findbugs. Support a combiner processor that can run

[jira] [Commented] (TEZ-1421) MRCombiner throws NPE in MapredWordCount on master branch

2015-03-13 Thread Tsuyoshi Ozawa (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-1421?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14360111#comment-14360111 ] Tsuyoshi Ozawa commented on TEZ-1421: - I've investigated this deeply: this bug happens

[jira] [Commented] (TEZ-145) Support a combiner processor that can run non-local to map/reduce nodes

2015-03-12 Thread Tsuyoshi Ozawa (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-145?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14357178#comment-14357178 ] Tsuyoshi Ozawa commented on TEZ-145: {code} +if (hasFinalReduceStage) { +

[jira] [Updated] (TEZ-145) Support a combiner processor that can run non-local to map/reduce nodes

2015-03-12 Thread Tsuyoshi Ozawa (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-145?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tsuyoshi Ozawa updated TEZ-145: --- Attachment: WIP-TEZ-145-001.patch Support a combiner processor that can run non-local to map/reduce

[jira] [Commented] (TEZ-145) Support a combiner processor that can run non-local to map/reduce nodes

2015-03-12 Thread Tsuyoshi Ozawa (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-145?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14358908#comment-14358908 ] Tsuyoshi Ozawa commented on TEZ-145: [~bikassaha] Sure, no problem. [~gopalv] looking

[jira] [Updated] (TEZ-145) Support a combiner processor that can run non-local to map/reduce nodes

2015-03-11 Thread Tsuyoshi Ozawa (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-145?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tsuyoshi Ozawa updated TEZ-145: --- Attachment: WIP-TEZ-145-001.patch Attaching WIP patch. Support a combiner processor that can run

[jira] [Commented] (TEZ-145) Support a combiner processor that can run non-local to map/reduce nodes

2015-03-11 Thread Tsuyoshi Ozawa (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-145?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14357137#comment-14357137 ] Tsuyoshi Ozawa commented on TEZ-145: [~bikassaha] [~hitesh] I prototyped CombineProcessor

[jira] [Updated] (TEZ-145) Support a combiner processor that can run non-local to map/reduce nodes

2015-03-11 Thread Tsuyoshi Ozawa (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-145?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tsuyoshi Ozawa updated TEZ-145: --- Attachment: (was: WIP-TEZ-145-001.patch) Support a combiner processor that can run non-local to

[jira] [Commented] (TEZ-1421) MRCombiner throws NPE in MapredWordCount on master branch

2015-03-01 Thread Tsuyoshi Ozawa (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-1421?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14342724#comment-14342724 ] Tsuyoshi Ozawa commented on TEZ-1421: - [~jeagles] can I take over this issue? Please let

[jira] [Commented] (TEZ-167) Create tests for MR Combiner

2015-02-17 Thread Tsuyoshi OZAWA (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-167?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14325454#comment-14325454 ] Tsuyoshi OZAWA commented on TEZ-167: [~hitesh], Thank you for taking a look. Please let

[jira] [Commented] (TEZ-167) Create tests for MR Combiner

2015-02-16 Thread Tsuyoshi OZAWA (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-167?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14322842#comment-14322842 ] Tsuyoshi OZAWA commented on TEZ-167: [~hitesh] do you mind taking a look? Create tests

[jira] [Commented] (TEZ-145) Support a combiner processor that can run non-local to map/reduce nodes

2015-02-15 Thread Tsuyoshi OZAWA (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-145?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14321802#comment-14321802 ] Tsuyoshi OZAWA commented on TEZ-145: [~hitesh] Sorry for the delay. Maybe I can throw a

[jira] [Commented] (TEZ-145) Support a combiner processor that can run non-local to map/reduce nodes

2015-02-15 Thread Tsuyoshi OZAWA (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-145?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14321804#comment-14321804 ] Tsuyoshi OZAWA commented on TEZ-145: [~bikassaha] [~gopalv] I meant following

[jira] [Commented] (TEZ-2100) Fix findbug issue in TaskAttemptListenerImpTezDag.getTask

2015-02-15 Thread Tsuyoshi OZAWA (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-2100?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14321819#comment-14321819 ] Tsuyoshi OZAWA commented on TEZ-2100: - Is this fixed on TEZ-2045? Fix findbug issue in

[jira] [Commented] (TEZ-1421) MRCombiner throws NPE in MapredWordCount on master branch

2015-01-16 Thread Tsuyoshi OZAWA (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-1421?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14279972#comment-14279972 ] Tsuyoshi OZAWA commented on TEZ-1421: - Feel free to contact me if you cannot reproduce

[jira] [Commented] (TEZ-1421) MRCombiner throws NPE in MapredWordCount on master branch

2015-01-15 Thread Tsuyoshi OZAWA (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-1421?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14278600#comment-14278600 ] Tsuyoshi OZAWA commented on TEZ-1421: - Build Step: I'm using Hadoop 2.6.0 and Tez trunk.

[jira] [Commented] (TEZ-1421) MRCombiner throws NPE in MapredWordCount on master branch

2015-01-15 Thread Tsuyoshi OZAWA (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-1421?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14278597#comment-14278597 ] Tsuyoshi OZAWA commented on TEZ-1421: - Attaching a stack trace I faced recently:

[jira] [Commented] (TEZ-1421) MRCombiner throws NPE in MapredWordCount on master branch

2015-01-09 Thread Tsuyoshi OZAWA (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-1421?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14270761#comment-14270761 ] Tsuyoshi OZAWA commented on TEZ-1421: - [~jeagles] yes, I still got same error with

[jira] [Commented] (TEZ-1421) MRCombiner throws NPE in MapredWordCount on master branch

2015-01-08 Thread Tsuyoshi OZAWA (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-1421?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14270711#comment-14270711 ] Tsuyoshi OZAWA commented on TEZ-1421: - Sure, wait a moment. MRCombiner throws NPE in

[jira] [Commented] (TEZ-1825) Aborting jobs by TezUncheckedException: Attempting to add duplicate resource

2014-12-10 Thread Tsuyoshi OZAWA (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-1825?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14240829#comment-14240829 ] Tsuyoshi OZAWA commented on TEZ-1825: - [~hitesh] [~sseth] Thanks for your comments! OK,

[jira] [Created] (TEZ-1825) Aborting jobs by TezUncheckedException: Attempting to add duplicate resource

2014-12-06 Thread Tsuyoshi OZAWA (JIRA)
Tsuyoshi OZAWA created TEZ-1825: --- Summary: Aborting jobs by TezUncheckedException: Attempting to add duplicate resource Key: TEZ-1825 URL: https://issues.apache.org/jira/browse/TEZ-1825 Project: Apache

[jira] [Updated] (TEZ-1825) Aborting jobs by TezUncheckedException: Attempting to add duplicate resource

2014-12-06 Thread Tsuyoshi OZAWA (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-1825?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tsuyoshi OZAWA updated TEZ-1825: Attachment: TEZ-1825.1.patch Aborting jobs by TezUncheckedException: Attempting to add duplicate

[jira] [Commented] (TEZ-1421) MRCombiner throws NPE in MapredWordCount on master branch

2014-12-05 Thread Tsuyoshi OZAWA (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-1421?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14236195#comment-14236195 ] Tsuyoshi OZAWA commented on TEZ-1421: - Current trunk code still have the same bug.

[jira] [Commented] (TEZ-1808) Job can fail since name of intermediate files can be too long in specific situation

2014-12-04 Thread Tsuyoshi OZAWA (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-1808?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14234768#comment-14234768 ] Tsuyoshi OZAWA commented on TEZ-1808: - Thanks a lot! Job can fail since name of

[jira] [Updated] (TEZ-1808) Job can fail since name of intermediate files can be too long in specific situation

2014-12-03 Thread Tsuyoshi OZAWA (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-1808?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tsuyoshi OZAWA updated TEZ-1808: Attachment: TEZ-1808.2.patch [~sseth], thanks for your review. Updating a patch based on integer

[jira] [Resolved] (TEZ-1804) PipelinedSorter fails with large TEZ_RUNTIME_IO_SORT_MB(2047)

2014-12-03 Thread Tsuyoshi OZAWA (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-1804?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tsuyoshi OZAWA resolved TEZ-1804. - Resolution: Duplicate PipelinedSorter fails with large TEZ_RUNTIME_IO_SORT_MB(2047)

[jira] [Commented] (TEZ-1808) Job can fail since name of intermediate files can be too long in specific situation

2014-12-01 Thread Tsuyoshi OZAWA (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-1808?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14230543#comment-14230543 ] Tsuyoshi OZAWA commented on TEZ-1808: - [~rajesh.balamohan] [~gopalv] could you take a

[jira] [Created] (TEZ-1807) BoundedByteArrayOutputStream throw EOFException because of Reach the limit of the buffer

2014-11-29 Thread Tsuyoshi OZAWA (JIRA)
Tsuyoshi OZAWA created TEZ-1807: --- Summary: BoundedByteArrayOutputStream throw EOFException because of Reach the limit of the buffer Key: TEZ-1807 URL: https://issues.apache.org/jira/browse/TEZ-1807

[jira] [Updated] (TEZ-1807) BoundedByteArrayOutputStream throw EOFException because of Reach the limit of the buffer

2014-11-29 Thread Tsuyoshi OZAWA (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-1807?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tsuyoshi OZAWA updated TEZ-1807: Description: I ran Hive 0.14 on Tez 0.5.2. Data size is 100GB texts generated by RandomTextWriter.

[jira] [Created] (TEZ-1808) Job can fail since name of intermediate files can be too long in specific situation

2014-11-29 Thread Tsuyoshi OZAWA (JIRA)
Tsuyoshi OZAWA created TEZ-1808: --- Summary: Job can fail since name of intermediate files can be too long in specific situation Key: TEZ-1808 URL: https://issues.apache.org/jira/browse/TEZ-1808 Project:

[jira] [Commented] (TEZ-1808) Job can fail since name of intermediate files can be too long in specific situation

2014-11-29 Thread Tsuyoshi OZAWA (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-1808?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14228779#comment-14228779 ] Tsuyoshi OZAWA commented on TEZ-1808: - I found that the WIP patch is not enough. It

[jira] [Updated] (TEZ-1808) Job can fail since name of intermediate files can be too long in specific situation

2014-11-29 Thread Tsuyoshi OZAWA (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-1808?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tsuyoshi OZAWA updated TEZ-1808: Attachment: TEZ-1808.1.patch Uploading a first patch to fix the issue. Job can fail since name of

[jira] [Created] (TEZ-1804) PipelinedSorter fails with large TEZ_RUNTIME_IO_SORT_MB(2047)

2014-11-27 Thread Tsuyoshi OZAWA (JIRA)
Tsuyoshi OZAWA created TEZ-1804: --- Summary: PipelinedSorter fails with large TEZ_RUNTIME_IO_SORT_MB(2047) Key: TEZ-1804 URL: https://issues.apache.org/jira/browse/TEZ-1804 Project: Apache Tez

[jira] [Commented] (TEZ-1804) PipelinedSorter fails with large TEZ_RUNTIME_IO_SORT_MB(2047)

2014-11-27 Thread Tsuyoshi OZAWA (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-1804?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14228027#comment-14228027 ] Tsuyoshi OZAWA commented on TEZ-1804: - DefaultSorter also fails with large

[jira] [Created] (TEZ-1806) Out of Memory with large TEZ_RUNTIME_IO_SORT_MB

2014-11-27 Thread Tsuyoshi OZAWA (JIRA)
Tsuyoshi OZAWA created TEZ-1806: --- Summary: Out of Memory with large TEZ_RUNTIME_IO_SORT_MB Key: TEZ-1806 URL: https://issues.apache.org/jira/browse/TEZ-1806 Project: Apache Tez Issue Type: Bug

[jira] [Updated] (TEZ-1785) Upgrading snappy-java to 1.1.1.6

2014-11-20 Thread Tsuyoshi OZAWA (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-1785?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tsuyoshi OZAWA updated TEZ-1785: Attachment: TEZ-1785.3.patch [~sseth] [~hitesh] OK, let's remove the dependency once and add it back

[jira] [Updated] (TEZ-1785) Upgrading snappy-java to 1.1.1.6

2014-11-18 Thread Tsuyoshi OZAWA (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-1785?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tsuyoshi OZAWA updated TEZ-1785: Attachment: TEZ-1785.2.patch [~hitesh] updated in tez-tools. I confirmed to the author of snappy-java

[jira] [Issue Comment Deleted] (TEZ-1785) Upgrading snappy-java to 1.1.1.6

2014-11-18 Thread Tsuyoshi OZAWA (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-1785?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tsuyoshi OZAWA updated TEZ-1785: Comment: was deleted (was: One additional point is that we can use different snappy-java version if

[jira] [Created] (TEZ-1785) Upgrading snappy-java to 1.1.1.6

2014-11-17 Thread Tsuyoshi OZAWA (JIRA)
Tsuyoshi OZAWA created TEZ-1785: --- Summary: Upgrading snappy-java to 1.1.1.6 Key: TEZ-1785 URL: https://issues.apache.org/jira/browse/TEZ-1785 Project: Apache Tez Issue Type: Improvement

[jira] [Updated] (TEZ-1785) Upgrading snappy-java to 1.1.1.6

2014-11-17 Thread Tsuyoshi OZAWA (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-1785?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tsuyoshi OZAWA updated TEZ-1785: Attachment: TEZ-1785.1.patch Attaching first patch. Upgrading snappy-java to 1.1.1.6

[jira] [Commented] (TEZ-1785) Upgrading snappy-java to 1.1.1.6

2014-11-17 Thread Tsuyoshi OZAWA (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-1785?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14215821#comment-14215821 ] Tsuyoshi OZAWA commented on TEZ-1785: - [~hitesh] could you review this? Upgrading

[jira] [Commented] (TEZ-1632) NPE at TestPreemption.testPreemptionWithoutSession line 105

2014-10-16 Thread Tsuyoshi OZAWA (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-1632?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14173840#comment-14173840 ] Tsuyoshi OZAWA commented on TEZ-1632: - Reproduced same issue on my local. NPE at

[jira] [Commented] (TEZ-145) Support a combiner processor that can run non-local to map/reduce nodes

2014-09-02 Thread Tsuyoshi OZAWA (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-145?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14118030#comment-14118030 ] Tsuyoshi OZAWA commented on TEZ-145: Thanks for good suggestions, [~gopalv] and

[jira] [Commented] (TEZ-1528) Native support for multi cluster aggregations

2014-09-01 Thread Tsuyoshi OZAWA (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-1528?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14117315#comment-14117315 ] Tsuyoshi OZAWA commented on TEZ-1528: - Thanks for an interesting proposal, Arun. It's

[jira] [Commented] (TEZ-1473) TEZ_RUNTIME_SHUFFLE_BUFFER is too large by default

2014-08-21 Thread Tsuyoshi OZAWA (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-1473?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14106448#comment-14106448 ] Tsuyoshi OZAWA commented on TEZ-1473: - The workload is wordcount against 20 GB data

[jira] [Created] (TEZ-1473) TEZ_RUNTIME_SHUFFLE_BUFFER is too large by default

2014-08-20 Thread Tsuyoshi OZAWA (JIRA)
Tsuyoshi OZAWA created TEZ-1473: --- Summary: TEZ_RUNTIME_SHUFFLE_BUFFER is too large by default Key: TEZ-1473 URL: https://issues.apache.org/jira/browse/TEZ-1473 Project: Apache Tez Issue Type:

[jira] [Comment Edited] (TEZ-1473) TEZ_RUNTIME_SHUFFLE_BUFFER is too large by default

2014-08-20 Thread Tsuyoshi OZAWA (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-1473?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14104937#comment-14104937 ] Tsuyoshi OZAWA edited comment on TEZ-1473 at 8/21/14 1:49 AM: --

[jira] [Updated] (TEZ-1473) TEZ_RUNTIME_SHUFFLE_BUFFER is too large by default

2014-08-20 Thread Tsuyoshi OZAWA (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-1473?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tsuyoshi OZAWA updated TEZ-1473: Attachment: TEZ-1473.1.patch I prefer to the default value is determined by fraction of

[jira] [Created] (TEZ-1457) Taking 10 minutes to start a middle size job after submitting a job

2014-08-19 Thread Tsuyoshi OZAWA (JIRA)
Tsuyoshi OZAWA created TEZ-1457: --- Summary: Taking 10 minutes to start a middle size job after submitting a job Key: TEZ-1457 URL: https://issues.apache.org/jira/browse/TEZ-1457 Project: Apache Tez

[jira] [Comment Edited] (TEZ-1457) Taking 10 minutes to start a middle size job after submitting a job

2014-08-19 Thread Tsuyoshi OZAWA (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-1457?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14102122#comment-14102122 ] Tsuyoshi OZAWA edited comment on TEZ-1457 at 8/19/14 11:15 AM: ---

[jira] [Commented] (TEZ-743) Fix MRCombiner to use correct comparator as per changes in MAPREDUCE-3310

2014-08-19 Thread Tsuyoshi OZAWA (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-743?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14103326#comment-14103326 ] Tsuyoshi OZAWA commented on TEZ-743: Hi, is this related to TEZ-1421? Fix MRCombiner to

[jira] [Commented] (TEZ-1390) Replace byte[] with ByteBuffer as the type of user payload in the API

2014-08-18 Thread Tsuyoshi OZAWA (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-1390?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14101619#comment-14101619 ] Tsuyoshi OZAWA commented on TEZ-1390: - Thank you for reviewing and updating, Sid, Gopal,

<    1   2   3   >