[jira] [Commented] (TEZ-2606) Cache-friendly data structure for sorting

2015-07-09 Thread Tsuyoshi Ozawa (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-2606?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14620628#comment-14620628 ] Tsuyoshi Ozawa commented on TEZ-2606: - [~gopalv] I think this change is only checking

[jira] [Commented] (TEZ-2600) When use HDFS federation(viewfs) ,tez will throw a error

2015-07-09 Thread Prakash Ramachandran (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-2600?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14620710#comment-14620710 ] Prakash Ramachandran commented on TEZ-2600: --- the symlink was just one example. the

[jira] [Updated] (TEZ-2602) Throwing EOFException when launching MR job

2015-07-09 Thread Rajesh Balamohan (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-2602?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rajesh Balamohan updated TEZ-2602: -- Attachment: TEZ-2602.WIP.1.patch Attaching a WIP patch. Basically spill() was not invoked when

[jira] [Commented] (TEZ-2609) Consider calling TaskReporter...-..heartbeat() when there are no more events to be processed in LogicalIOProcessorRuntimeTask

2015-07-09 Thread Bikas Saha (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-2609?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14621000#comment-14621000 ] Bikas Saha commented on TEZ-2609: - On the AM the randomness would have to be weighted by the

[jira] [Commented] (TEZ-2606) Cache-friendly data structure for sorting

2015-07-09 Thread Gopal V (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-2606?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14621065#comment-14621065 ] Gopal V commented on TEZ-2606: -- bq. My idea is kvmeta's including new prefix of key's binary.

[jira] [Comment Edited] (TEZ-2606) Cache-friendly data structure for sorting

2015-07-09 Thread Gopal V (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-2606?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14621075#comment-14621075 ] Gopal V edited comment on TEZ-2606 at 7/9/15 6:58 PM: -- bq. And even

Failed: TEZ-2610 PreCommit Build #893

2015-07-09 Thread Apache Jenkins Server
Jira: https://issues.apache.org/jira/browse/TEZ-2610 Build: https://builds.apache.org/job/PreCommit-TEZ-Build/893/ ### ## LAST 60 LINES OF THE CONSOLE ### [...truncated

[jira] [Commented] (TEZ-2610) Swimlane for DAGs that use containers from previous DAGs

2015-07-09 Thread TezQA (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-2610?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14621578#comment-14621578 ] TezQA commented on TEZ-2610: {color:red}-1 overall{color}. Here are the results of testing the

[jira] [Commented] (TEZ-2610) Swimlane for DAGs that use containers from previous DAGs

2015-07-09 Thread Gopal V (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-2610?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14621636#comment-14621636 ] Gopal V commented on TEZ-2610: -- The patch seems to work just fine, between releases too -

[jira] [Commented] (TEZ-2602) Throwing EOFException when launching MR job

2015-07-09 Thread Rajesh Balamohan (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-2602?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14620098#comment-14620098 ] Rajesh Balamohan commented on TEZ-2602: --- Not yet [~ozawa], tried with different

[jira] [Commented] (TEZ-2609) Consider calling TaskReporter...-..heartbeat() when there are no more events to be processed in LogicalIOProcessorRuntimeTask

2015-07-09 Thread Bikas Saha (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-2609?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14620033#comment-14620033 ] Bikas Saha commented on TEZ-2609: - There is probably an existing jira to make the AM send

[jira] [Commented] (TEZ-2602) Throwing EOFException when launching MR job

2015-07-09 Thread Tsuyoshi Ozawa (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-2602?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14619961#comment-14619961 ] Tsuyoshi Ozawa commented on TEZ-2602: - [~rajesh.balamohan] could you produce the

[jira] [Commented] (TEZ-2602) Throwing EOFException when launching MR job

2015-07-09 Thread Tsuyoshi Ozawa (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-2602?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14620106#comment-14620106 ] Tsuyoshi Ozawa commented on TEZ-2602: - The data was generated by randomtextwriter

[jira] [Commented] (TEZ-2602) Throwing EOFException when launching MR job

2015-07-09 Thread Tsuyoshi Ozawa (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-2602?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14620104#comment-14620104 ] Tsuyoshi Ozawa commented on TEZ-2602: - [~rajesh.balamohan] Oh, sorry, my input size was

[jira] [Commented] (TEZ-2602) Throwing EOFException when launching MR job

2015-07-09 Thread Tsuyoshi Ozawa (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-2602?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14620165#comment-14620165 ] Tsuyoshi Ozawa commented on TEZ-2602: - Trying to reproduce the problem with smaller

[jira] [Commented] (TEZ-2602) Throwing EOFException when launching MR job

2015-07-09 Thread Tsuyoshi Ozawa (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-2602?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14620164#comment-14620164 ] Tsuyoshi Ozawa commented on TEZ-2602: - Trying to reproduce the problem with smaller

[jira] [Commented] (TEZ-2600) When use HDFS federation(viewfs) ,tez will throw a error

2015-07-09 Thread xiaowei wang (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-2600?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14620018#comment-14620018 ] xiaowei wang commented on TEZ-2600: --- Befor invoke resolvePath() ,is it nesscary to judge

[jira] [Commented] (TEZ-2600) When use HDFS federation(viewfs) ,tez will throw a error

2015-07-09 Thread TezQA (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-2600?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14620417#comment-14620417 ] TezQA commented on TEZ-2600: {color:red}-1 overall{color}. Here are the results of testing the

[jira] [Commented] (TEZ-2602) Throwing EOFException when launching MR job

2015-07-09 Thread Tsuyoshi Ozawa (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-2602?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14620174#comment-14620174 ] Tsuyoshi Ozawa commented on TEZ-2602: - [~rajesh.balamohan] I could reproduce the problem

[jira] [Updated] (TEZ-2602) Throwing EOFException when launching MR job

2015-07-09 Thread Hitesh Shah (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-2602?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hitesh Shah updated TEZ-2602: - Affects Version/s: 0.6.0 0.7.0 Throwing EOFException when launching MR job

[jira] [Commented] (TEZ-2609) Consider calling TaskReporter...-..heartbeat() when there are no more events to be processed in LogicalIOProcessorRuntimeTask

2015-07-09 Thread Rajesh Balamohan (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-2609?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14621411#comment-14621411 ] Rajesh Balamohan commented on TEZ-2609: --- This JIRA is for the task side improvements

[jira] [Commented] (TEZ-2609) Consider calling TaskReporter...-..heartbeat() when there are no more events to be processed in LogicalIOProcessorRuntimeTask

2015-07-09 Thread Jeff Zhang (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-2609?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14620553#comment-14620553 ] Jeff Zhang commented on TEZ-2609: - Maybe we could add some randomness on the heartbeat

[jira] [Commented] (TEZ-2172) FetcherOrderedGrouped using List to store InputAttemptIdentifier can lead to some inefficiency during remove() operation

2015-07-09 Thread Saikat (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-2172?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14621362#comment-14621362 ] Saikat commented on TEZ-2172: - A solution could be to make a

[jira] [Commented] (TEZ-2172) FetcherOrderedGrouped using List to store InputAttemptIdentifier can lead to some inefficiency during remove() operation

2015-07-09 Thread Saikat (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-2172?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14621328#comment-14621328 ] Saikat commented on TEZ-2172: - [~rajesh.balamohan] I am interested in working on this JIRA.

[jira] [Assigned] (TEZ-2172) FetcherOrderedGrouped using List to store InputAttemptIdentifier can lead to some inefficiency during remove() operation

2015-07-09 Thread Saikat (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-2172?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Saikat reassigned TEZ-2172: --- Assignee: Saikat FetcherOrderedGrouped using List to store InputAttemptIdentifier can lead to some

[jira] [Created] (TEZ-2610) Swimlane for DAGs that use containers from previous DAG

2015-07-09 Thread Yi Zhang (JIRA)
Yi Zhang created TEZ-2610: - Summary: Swimlane for DAGs that use containers from previous DAG Key: TEZ-2610 URL: https://issues.apache.org/jira/browse/TEZ-2610 Project: Apache Tez Issue Type: Bug

[jira] [Updated] (TEZ-2610) Swimlane for DAGs that use containers from previous DAGs

2015-07-09 Thread Yi Zhang (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-2610?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yi Zhang updated TEZ-2610: -- Summary: Swimlane for DAGs that use containers from previous DAGs (was: Swimlane for DAGs that use containers

[jira] [Assigned] (TEZ-2610) Swimlane for DAGs that use containers from previous DAGs

2015-07-09 Thread Gopal V (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-2610?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gopal V reassigned TEZ-2610: Assignee: Gopal V Swimlane for DAGs that use containers from previous DAGs

[jira] [Updated] (TEZ-2610) Swimlane for DAGs that use containers from previous DAGs

2015-07-09 Thread Gopal V (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-2610?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gopal V updated TEZ-2610: - Attachment: TEZ-2610.patch [~yeeza]: preliminary patch - this should work, still refining the view Swimlane for