[jira] [Comment Edited] (TEZ-1752) Inputs / Outputs in the Runtime library should be interruptable

2015-04-28 Thread Rajesh Balamohan (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-1752?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14516988#comment-14516988 ] Rajesh Balamohan edited comment on TEZ-1752 at 4/28/15 1:01 PM:

[jira] [Commented] (TEZ-1752) Inputs / Outputs in the Runtime library should be interruptable

2015-04-28 Thread TezQA (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-1752?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14517007#comment-14517007 ] TezQA commented on TEZ-1752: {color:red}-1 overall{color}. Here are the results of testing the

[jira] [Commented] (TEZ-2231) Create project by-laws

2015-04-28 Thread Hitesh Shah (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-2231?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14517927#comment-14517927 ] Hitesh Shah commented on TEZ-2231: -- This one has been open for quite some time. [~sseth]

[jira] [Updated] (TEZ-1522) Scheduling can result in out of order execution and slowdown of upstream work

2015-04-28 Thread Siddharth Seth (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-1522?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Siddharth Seth updated TEZ-1522: Target Version/s: 0.8.0 Scheduling can result in out of order execution and slowdown of upstream

[jira] [Updated] (TEZ-924) InputFailedEvent handling for Shuffle

2015-04-28 Thread Siddharth Seth (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-924?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Siddharth Seth updated TEZ-924: --- Target Version/s: 0.8.0 (was: 0.7.0) InputFailedEvent handling for Shuffle

[jira] [Commented] (TEZ-2379) org.apache.hadoop.yarn.state.InvalidStateTransitonException: Invalid event: T_ATTEMPT_KILLED at KILLED

2015-04-28 Thread Bikas Saha (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-2379?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14518321#comment-14518321 ] Bikas Saha commented on TEZ-2379: - deleting log as it had private server names and ip

[jira] [Commented] (TEZ-2379) org.apache.hadoop.yarn.state.InvalidStateTransitonException: Invalid event: T_ATTEMPT_KILLED at KILLED

2015-04-28 Thread Bikas Saha (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-2379?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14518337#comment-14518337 ] Bikas Saha commented on TEZ-2379: - 1) Client issued dag kill that caused all tasks to get

[jira] [Updated] (TEZ-1897) Create a concurrent version of AsyncDispatcher

2015-04-28 Thread Bikas Saha (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-1897?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bikas Saha updated TEZ-1897: Attachment: TEZ-1897.6.patch Patch addresses comments and adds a new test. Create a concurrent version of

[jira] [Updated] (TEZ-776) Reduce AM mem usage caused by storing TezEvents

2015-04-28 Thread Bikas Saha (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-776?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bikas Saha updated TEZ-776: --- Attachment: TEZ-776.6.B.patch Reduce AM mem usage caused by storing TezEvents

Success: TEZ-1897 PreCommit Build #567

2015-04-28 Thread Apache Jenkins Server
Jira: https://issues.apache.org/jira/browse/TEZ-1897 Build: https://builds.apache.org/job/PreCommit-TEZ-Build/567/ ### ## LAST 60 LINES OF THE CONSOLE ### [...truncated

[jira] [Commented] (TEZ-2379) org.apache.hadoop.yarn.state.InvalidStateTransitonException: Invalid event: T_ATTEMPT_KILLED at KILLED

2015-04-28 Thread Rajesh Balamohan (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-2379?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14518350#comment-14518350 ] Rajesh Balamohan commented on TEZ-2379: --- speculation was not enabled in this case.

Failed: TEZ-2380 PreCommit Build #566

2015-04-28 Thread Apache Jenkins Server
Jira: https://issues.apache.org/jira/browse/TEZ-2380 Build: https://builds.apache.org/job/PreCommit-TEZ-Build/566/ ### ## LAST 60 LINES OF THE CONSOLE ### [...truncated

[jira] [Updated] (TEZ-2256) Avoid use of BufferTooSmallException to signal end of buffer in UnorderedPartitionedKVWriter

2015-04-28 Thread Hitesh Shah (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-2256?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hitesh Shah updated TEZ-2256: - Assignee: Hitesh Shah (was: Cyrille Chépélov) Avoid use of BufferTooSmallException to signal end of

[jira] [Updated] (TEZ-2256) Avoid use of BufferTooSmallException to signal end of buffer in UnorderedPartitionedKVWriter

2015-04-28 Thread Hitesh Shah (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-2256?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hitesh Shah updated TEZ-2256: - Issue Type: Bug (was: Improvement) Avoid use of BufferTooSmallException to signal end of buffer in

[jira] [Updated] (TEZ-2256) Avoid use of BufferTooSmallException to signal end of buffer in UnorderedPartitionedKVWriter

2015-04-28 Thread Hitesh Shah (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-2256?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hitesh Shah updated TEZ-2256: - Issue Type: Improvement (was: Bug) Avoid use of BufferTooSmallException to signal end of buffer in

[jira] [Commented] (TEZ-2256) Avoid use of BufferTooSmallException to signal end of buffer in UnorderedPartitionedKVWriter

2015-04-28 Thread Hitesh Shah (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-2256?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14518457#comment-14518457 ] Hitesh Shah commented on TEZ-2256: -- Change status to patch available to trigger pre-commit.

[jira] [Commented] (TEZ-2256) Avoid use of BufferTooSmallException to signal end of buffer in UnorderedPartitionedKVWriter

2015-04-28 Thread TezQA (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-2256?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14518581#comment-14518581 ] TezQA commented on TEZ-2256: {color:red}-1 overall{color}. Here are the results of testing the

Failed: TEZ-2256 PreCommit Build #569

2015-04-28 Thread Apache Jenkins Server
Jira: https://issues.apache.org/jira/browse/TEZ-2256 Build: https://builds.apache.org/job/PreCommit-TEZ-Build/569/ ### ## LAST 60 LINES OF THE CONSOLE ### [...truncated

Success: TEZ-776 PreCommit Build #565

2015-04-28 Thread Apache Jenkins Server
Jira: https://issues.apache.org/jira/browse/TEZ-776 Build: https://builds.apache.org/job/PreCommit-TEZ-Build/565/ ### ## LAST 60 LINES OF THE CONSOLE ### [...truncated

[jira] [Updated] (TEZ-2237) Complex DAG freezes and fails (was BufferTooSmallException raised in UnorderedPartitionedKVWriter then DAG lingers)

2015-04-28 Thread Hitesh Shah (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-2237?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hitesh Shah updated TEZ-2237: - Assignee: Siddharth Seth Complex DAG freezes and fails (was BufferTooSmallException raised in

[jira] [Updated] (TEZ-2237) Complex DAG freezes and fails (was BufferTooSmallException raised in UnorderedPartitionedKVWriter then DAG lingers)

2015-04-28 Thread Hitesh Shah (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-2237?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hitesh Shah updated TEZ-2237: - Priority: Critical (was: Major) Complex DAG freezes and fails (was BufferTooSmallException raised in

[jira] [Updated] (TEZ-2237) Complex DAG freezes and fails (was BufferTooSmallException raised in UnorderedPartitionedKVWriter then DAG lingers)

2015-04-28 Thread Hitesh Shah (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-2237?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hitesh Shah updated TEZ-2237: - Target Version/s: 0.6.1 Complex DAG freezes and fails (was BufferTooSmallException raised in

[jira] [Commented] (TEZ-1897) Create a concurrent version of AsyncDispatcher

2015-04-28 Thread Bikas Saha (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-1897?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14518254#comment-14518254 ] Bikas Saha commented on TEZ-1897: - bq. Rename registerAndCreateDispatcher to

[jira] [Commented] (TEZ-776) Reduce AM mem usage caused by storing TezEvents

2015-04-28 Thread Bikas Saha (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-776?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14518380#comment-14518380 ] Bikas Saha commented on TEZ-776: TEZ-776.6.A and TEZ-776.6.B are 2 versions of the API with

[jira] [Commented] (TEZ-2380) Disable fall back to reading from timeline if timeline disabled

2015-04-28 Thread TezQA (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-2380?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14518386#comment-14518386 ] TezQA commented on TEZ-2380: {color:red}-1 overall{color}. Here are the results of testing the

[jira] [Resolved] (TEZ-2359) Deadlock in DAGAppMaster

2015-04-28 Thread Jeff Zhang (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-2359?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jeff Zhang resolved TEZ-2359. - Resolution: Invalid My mistake, it's an issue when I work on TEZ-1273, not on the master. Deadlock in

[jira] [Created] (TEZ-2382) Publish counters to timeline for failed/killed attempts

2015-04-28 Thread Hitesh Shah (JIRA)
Hitesh Shah created TEZ-2382: Summary: Publish counters to timeline for failed/killed attempts Key: TEZ-2382 URL: https://issues.apache.org/jira/browse/TEZ-2382 Project: Apache Tez Issue Type:

[jira] [Commented] (TEZ-776) Reduce AM mem usage caused by storing TezEvents

2015-04-28 Thread TezQA (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-776?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14518330#comment-14518330 ] TezQA commented on TEZ-776: --- {color:green}+1 overall{color}. Here are the results of testing the

[jira] [Issue Comment Deleted] (TEZ-2379) org.apache.hadoop.yarn.state.InvalidStateTransitonException: Invalid event: T_ATTEMPT_KILLED at KILLED

2015-04-28 Thread Jeff Zhang (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-2379?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jeff Zhang updated TEZ-2379: Comment: was deleted (was: I think the following the code may cause the issue. There may be already some

[jira] [Commented] (TEZ-776) Reduce AM mem usage caused by storing TezEvents

2015-04-28 Thread TezQA (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-776?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14518543#comment-14518543 ] TezQA commented on TEZ-776: --- {color:red}-1 overall{color}. Here are the results of testing the

Failed: TEZ-776 PreCommit Build #568

2015-04-28 Thread Apache Jenkins Server
Jira: https://issues.apache.org/jira/browse/TEZ-776 Build: https://builds.apache.org/job/PreCommit-TEZ-Build/568/ ### ## LAST 60 LINES OF THE CONSOLE ### [...truncated

[jira] [Commented] (TEZ-2380) Disable fall back to reading from timeline if timeline disabled

2015-04-28 Thread Hitesh Shah (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-2380?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14518276#comment-14518276 ] Hitesh Shah commented on TEZ-2380: -- \cc [~pramachandran] Disable fall back to reading

[jira] [Created] (TEZ-2383) release sort buffers on close

2015-04-28 Thread Rajesh Balamohan (JIRA)
Rajesh Balamohan created TEZ-2383: - Summary: release sort buffers on close Key: TEZ-2383 URL: https://issues.apache.org/jira/browse/TEZ-2383 Project: Apache Tez Issue Type: Bug

[jira] [Updated] (TEZ-2305) MR compatibility sleep job fails with IOException: Undefined job output-path

2015-04-28 Thread Jeff Zhang (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-2305?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jeff Zhang updated TEZ-2305: Attachment: TEZ-2305-5.patch [~hitesh] Upload new patch based on TEZ-2305.2.patch. (Add unit test to

[jira] [Commented] (TEZ-2305) MR compatibility sleep job fails with IOException: Undefined job output-path

2015-04-28 Thread Hitesh Shah (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-2305?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14518612#comment-14518612 ] Hitesh Shah commented on TEZ-2305: -- +1 pending pre-commit . MR compatibility sleep job

[jira] [Updated] (TEZ-1752) Inputs / Outputs in the Runtime library should be interruptable

2015-04-28 Thread Rajesh Balamohan (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-1752?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rajesh Balamohan updated TEZ-1752: -- Attachment: TEZ-1752.4.patch - If the task is running, thread running the processor is

Failed: TEZ-1752 PreCommit Build #562

2015-04-28 Thread Apache Jenkins Server
Jira: https://issues.apache.org/jira/browse/TEZ-1752 Build: https://builds.apache.org/job/PreCommit-TEZ-Build/562/ ### ## LAST 60 LINES OF THE CONSOLE ### [...truncated

[jira] [Commented] (TEZ-2377) RandomWriter ends up using TextOutputFormat instead of SequenceFileOutputFormat

2015-04-28 Thread Jeff Zhang (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-2377?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14516952#comment-14516952 ] Jeff Zhang commented on TEZ-2377: - Suppose it can be solved by TEZ-2305. [~rajesh.balamohan]

[jira] [Commented] (TEZ-2377) RandomWriter ends up using TextOutputFormat instead of SequenceFileOutputFormat

2015-04-28 Thread Rajesh Balamohan (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-2377?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14516993#comment-14516993 ] Rajesh Balamohan commented on TEZ-2377: --- Thanks [~zjffdu], TEZ-2305 (.2 patch) has the

[jira] [Created] (TEZ-2379) org.apache.hadoop.yarn.state.InvalidStateTransitonException: Invalid event: T_ATTEMPT_KILLED at KILLED

2015-04-28 Thread Rajesh Balamohan (JIRA)
Rajesh Balamohan created TEZ-2379: - Summary: org.apache.hadoop.yarn.state.InvalidStateTransitonException: Invalid event: T_ATTEMPT_KILLED at KILLED Key: TEZ-2379 URL:

[jira] [Updated] (TEZ-2379) org.apache.hadoop.yarn.state.InvalidStateTransitonException: Invalid event: T_ATTEMPT_KILLED at KILLED

2015-04-28 Thread Rajesh Balamohan (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-2379?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rajesh Balamohan updated TEZ-2379: -- Attachment: application_1429683757595_0479.log Attaching AM log

[jira] [Commented] (TEZ-2374) Fix build break against hadoop-2.2 due to TEZ-2325

2015-04-28 Thread Prakash Ramachandran (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-2374?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14516848#comment-14516848 ] Prakash Ramachandran commented on TEZ-2374: --- +1 LGTM thanks hitesh was trying to

[jira] [Created] (TEZ-2378) In case Fetcher (unordered) fails to do local fetch, log in debug mode to reduce log size

2015-04-28 Thread Rajesh Balamohan (JIRA)
Rajesh Balamohan created TEZ-2378: - Summary: In case Fetcher (unordered) fails to do local fetch, log in debug mode to reduce log size Key: TEZ-2378 URL: https://issues.apache.org/jira/browse/TEZ-2378

[jira] [Commented] (TEZ-2379) org.apache.hadoop.yarn.state.InvalidStateTransitonException: Invalid event: T_ATTEMPT_KILLED at KILLED

2015-04-28 Thread Jeff Zhang (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-2379?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14517010#comment-14517010 ] Jeff Zhang commented on TEZ-2379: - I think the following the code may cause the issue. There

[jira] [Updated] (TEZ-2380) Disable fall back to reading from timeline if timeline disabled

2015-04-28 Thread Chang Li (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-2380?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chang Li updated TEZ-2380: -- Attachment: TEZ-2380.1.patch Disable fall back to reading from timeline if timeline disabled

[jira] [Commented] (TEZ-2380) Disable fall back to reading from timeline if timeline disabled

2015-04-28 Thread Chang Li (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-2380?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14518277#comment-14518277 ] Chang Li commented on TEZ-2380: --- [~hitesh], I have updated DAGClientImpl, and have verified

[jira] [Updated] (TEZ-2256) Avoid use of BufferTooSmallException to signal end of buffer in UnorderedPartitionedKVWriter

2015-04-28 Thread Rajesh Balamohan (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-2256?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rajesh Balamohan updated TEZ-2256: -- Priority: Critical (was: Minor) Target Version/s: 0.6.1 Avoid use of

[jira] [Commented] (TEZ-1897) Create a concurrent version of AsyncDispatcher

2015-04-28 Thread TezQA (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-1897?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14518493#comment-14518493 ] TezQA commented on TEZ-1897: {color:green}+1 overall{color}. Here are the results of testing

[jira] [Commented] (TEZ-1752) Inputs / Outputs in the Runtime library should be interruptable

2015-04-28 Thread TezQA (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-1752?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14517294#comment-14517294 ] TezQA commented on TEZ-1752: {color:green}+1 overall{color}. Here are the results of testing

[jira] [Updated] (TEZ-1752) Inputs / Outputs in the Runtime library should be interruptable

2015-04-28 Thread Rajesh Balamohan (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-1752?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rajesh Balamohan updated TEZ-1752: -- Attachment: TEZ-1752.5.patch Inputs / Outputs in the Runtime library should be interruptable

[jira] [Updated] (TEZ-2379) org.apache.hadoop.yarn.state.InvalidStateTransitonException: Invalid event: T_ATTEMPT_KILLED at KILLED

2015-04-28 Thread Hitesh Shah (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-2379?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hitesh Shah updated TEZ-2379: - Priority: Blocker (was: Major) org.apache.hadoop.yarn.state.InvalidStateTransitonException: Invalid

[jira] [Commented] (TEZ-2226) Disable writing history to timeline if domain creation fails.

2015-04-28 Thread Prakash Ramachandran (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-2226?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14517127#comment-14517127 ] Prakash Ramachandran commented on TEZ-2226: --- +1 LGTM. one minor item (separate

Success: TEZ-1752 PreCommit Build #563

2015-04-28 Thread Apache Jenkins Server
Jira: https://issues.apache.org/jira/browse/TEZ-1752 Build: https://builds.apache.org/job/PreCommit-TEZ-Build/563/ ### ## LAST 60 LINES OF THE CONSOLE ### [...truncated

[jira] [Updated] (TEZ-2383) release sort buffers on close

2015-04-28 Thread Rajesh Balamohan (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-2383?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rajesh Balamohan updated TEZ-2383: -- Attachment: TEZ-2383.1.patch [~sseth] - Can you please review when you find time? release sort

[jira] [Assigned] (TEZ-2383) release sort buffers on close

2015-04-28 Thread Rajesh Balamohan (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-2383?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rajesh Balamohan reassigned TEZ-2383: - Assignee: Rajesh Balamohan release sort buffers on close -

[jira] [Updated] (TEZ-2360) per-io counters flag should generate both overall and per-edge counters

2015-04-28 Thread Prakash Ramachandran (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-2360?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Prakash Ramachandran updated TEZ-2360: -- Attachment: TEZ-2360.3.patch added Test case to check per io counters are aggregated.

[jira] [Updated] (TEZ-2305) MR compatibility sleep job fails with IOException: Undefined job output-path

2015-04-28 Thread Hitesh Shah (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-2305?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hitesh Shah updated TEZ-2305: - Target Version/s: 0.5.4, 0.6.1 Affects Version/s: (was: 0.7.0) MR compatibility sleep job fails

[jira] [Commented] (TEZ-2383) release sort buffers on close

2015-04-28 Thread Gopal V (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-2383?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14518728#comment-14518728 ] Gopal V commented on TEZ-2383: -- [~rajesh.balamohan]: This is likely to be a fix limited to the

[jira] [Commented] (TEZ-2226) Disable writing history to timeline if domain creation fails.

2015-04-28 Thread Hitesh Shah (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-2226?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14517354#comment-14517354 ] Hitesh Shah commented on TEZ-2226: -- Good catch [~pramachandran]. Will file a separate jira

[jira] [Commented] (TEZ-924) InputFailedEvent handling for Shuffle

2015-04-28 Thread Hitesh Shah (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-924?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14517398#comment-14517398 ] Hitesh Shah commented on TEZ-924: - [~rajesh.balamohan] [~sseth] Is this still for 0.7 ? or

[jira] [Created] (TEZ-2380) Disable fall back to reading from timeline if timeline disabled

2015-04-28 Thread Hitesh Shah (JIRA)
Hitesh Shah created TEZ-2380: Summary: Disable fall back to reading from timeline if timeline disabled Key: TEZ-2380 URL: https://issues.apache.org/jira/browse/TEZ-2380 Project: Apache Tez

[jira] [Updated] (TEZ-122) Finalize v1 DAGPlan and consider versioning support

2015-04-28 Thread Hitesh Shah (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-122?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hitesh Shah updated TEZ-122: Target Version/s: 0.8.0 (was: 0.7.0) Finalize v1 DAGPlan and consider versioning support

[jira] [Commented] (TEZ-2309) Fix slf4j dependencies for tez modules

2015-04-28 Thread Hitesh Shah (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-2309?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14517403#comment-14517403 ] Hitesh Shah commented on TEZ-2309: -- [~vasanthkumar] Mind filing a separate jira for fixing

[jira] [Commented] (TEZ-2226) Disable writing history to timeline if domain creation fails.

2015-04-28 Thread Hitesh Shah (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-2226?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14517387#comment-14517387 ] Hitesh Shah commented on TEZ-2226: -- Created TEZ-2380 for [~pramachandran]'s comment.

[jira] [Commented] (TEZ-1138) Access to some mapred counters is broken after TEZ-901

2015-04-28 Thread Hitesh Shah (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-1138?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14517407#comment-14517407 ] Hitesh Shah commented on TEZ-1138: -- [~sseth] [~rekhajoshm] Will either of you be looking at

[jira] [Commented] (TEZ-1421) MRCombiner throws NPE in MapredWordCount on master branch

2015-04-28 Thread Hitesh Shah (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-1421?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14517405#comment-14517405 ] Hitesh Shah commented on TEZ-1421: -- [~ozawa] Did you manage to get a chance to look at

[jira] [Resolved] (TEZ-2046) Make timeline server putDomain exceptions non-fatal - full feature

2015-04-28 Thread Hitesh Shah (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-2046?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hitesh Shah resolved TEZ-2046. -- Resolution: Fixed Make timeline server putDomain exceptions non-fatal - full feature

[jira] [Updated] (TEZ-2164) Shade the guava version used by Tez

2015-04-28 Thread Hitesh Shah (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-2164?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hitesh Shah updated TEZ-2164: - Target Version/s: 0.8.0 (was: 0.7.0) Shade the guava version used by Tez

[jira] [Commented] (TEZ-2164) Shade the guava version used by Tez

2015-04-28 Thread Hitesh Shah (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-2164?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14517395#comment-14517395 ] Hitesh Shah commented on TEZ-2164: -- Moving to 0.8.0 as this work may result in some level

[jira] [Updated] (TEZ-2309) Fix slf4j dependencies for tez modules

2015-04-28 Thread Hitesh Shah (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-2309?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hitesh Shah updated TEZ-2309: - Target Version/s: 0.8.0 (was: 0.7.0) Fix slf4j dependencies for tez modules

[jira] [Updated] (TEZ-2381) Fixes after rebase 04/28

2015-04-28 Thread Siddharth Seth (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-2381?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Siddharth Seth updated TEZ-2381: Attachment: TEZ-2381.1.txt Fixes after rebase 04/28 Key:

[jira] [Updated] (TEZ-1912) Merge exceptions are thrown when enabling tez.runtime.shuffle.memory-to-memory.enable tez.runtime.shuffle.memory-to-memory.segments

2015-04-28 Thread Hitesh Shah (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-1912?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hitesh Shah updated TEZ-1912: - Fix Version/s: 0.7.0 Merge exceptions are thrown when enabling

[jira] [Updated] (TEZ-1912) Merge exceptions are thrown when enabling tez.runtime.shuffle.memory-to-memory.enable tez.runtime.shuffle.memory-to-memory.segments

2015-04-28 Thread Hitesh Shah (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-1912?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hitesh Shah updated TEZ-1912: - Assignee: Rajesh Balamohan Merge exceptions are thrown when enabling

[jira] [Commented] (TEZ-2377) RandomWriter ends up using TextOutputFormat instead of SequenceFileOutputFormat

2015-04-28 Thread Bikas Saha (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-2377?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14518144#comment-14518144 ] Bikas Saha commented on TEZ-2377: - Does the same fix need to be made to MRInput(Base)?

[jira] [Updated] (TEZ-776) Reduce AM mem usage caused by storing TezEvents

2015-04-28 Thread Bikas Saha (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-776?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bikas Saha updated TEZ-776: --- Attachment: TEZ-776.6.A.patch Patch with test issues fixed. Reduce AM mem usage caused by storing TezEvents

[jira] [Updated] (TEZ-946) Tez loses buffer-cache performance by running interleaved vertexes

2015-04-28 Thread Hitesh Shah (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-946?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hitesh Shah updated TEZ-946: Target Version/s: 0.8.0 (was: 0.7.0) Tez loses buffer-cache performance by running interleaved vertexes

[jira] [Resolved] (TEZ-2381) Fixes after rebase 04/28

2015-04-28 Thread Siddharth Seth (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-2381?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Siddharth Seth resolved TEZ-2381. - Resolution: Fixed Fix Version/s: TEZ-2003 Fixes after rebase 04/28

[jira] [Commented] (TEZ-2379) org.apache.hadoop.yarn.state.InvalidStateTransitonException: Invalid event: T_ATTEMPT_KILLED at KILLED

2015-04-28 Thread Hitesh Shah (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-2379?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14518219#comment-14518219 ] Hitesh Shah commented on TEZ-2379: -- Additional question: speculation enabled?

[jira] [Comment Edited] (TEZ-2379) org.apache.hadoop.yarn.state.InvalidStateTransitonException: Invalid event: T_ATTEMPT_KILLED at KILLED

2015-04-28 Thread Hitesh Shah (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-2379?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14518219#comment-14518219 ] Hitesh Shah edited comment on TEZ-2379 at 4/28/15 10:19 PM:

[jira] [Updated] (TEZ-1348) Setup configs required for local mode automatically, instead of relying on changes to tez-site

2015-04-28 Thread Hitesh Shah (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-1348?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hitesh Shah updated TEZ-1348: - Target Version/s: 0.8.0 (was: 0.6.0) Setup configs required for local mode automatically, instead of

[jira] [Updated] (TEZ-1537) Expose edge information in I/P/IContexts

2015-04-28 Thread Hitesh Shah (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-1537?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hitesh Shah updated TEZ-1537: - Target Version/s: 0.8.0 (was: 0.6.0) Expose edge information in I/P/IContexts

[jira] [Updated] (TEZ-568) Allow I/P/Os to report spescific time information to the AM

2015-04-28 Thread Hitesh Shah (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-568?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hitesh Shah updated TEZ-568: Target Version/s: 0.8.0 (was: 0.7.0) Allow I/P/Os to report spescific time information to the AM

[jira] [Commented] (TEZ-568) Allow I/P/Os to report spescific time information to the AM

2015-04-28 Thread Hitesh Shah (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-568?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14518193#comment-14518193 ] Hitesh Shah commented on TEZ-568: - Moving to 0.8 Allow I/P/Os to report spescific time

[jira] [Commented] (TEZ-2379) org.apache.hadoop.yarn.state.InvalidStateTransitonException: Invalid event: T_ATTEMPT_KILLED at KILLED

2015-04-28 Thread Rajesh Balamohan (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-2379?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14518194#comment-14518194 ] Rajesh Balamohan commented on TEZ-2379: --- [~hitesh] - Yes, this is with master

[jira] [Updated] (TEZ-1564) State machine error: Invalid event: T_SCHEDULE at SCHEDULED

2015-04-28 Thread Hitesh Shah (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-1564?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hitesh Shah updated TEZ-1564: - Target Version/s: 0.7.0 (was: 0.6.0) State machine error: Invalid event: T_SCHEDULE at SCHEDULED

[jira] [Updated] (TEZ-1564) State machine error: Invalid event: T_SCHEDULE at SCHEDULED

2015-04-28 Thread Hitesh Shah (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-1564?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hitesh Shah updated TEZ-1564: - Target Version/s: 0.7.0, 0.6.1 (was: 0.7.0) State machine error: Invalid event: T_SCHEDULE at SCHEDULED

[jira] [Commented] (TEZ-1897) Create a concurrent version of AsyncDispatcher

2015-04-28 Thread Siddharth Seth (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-1897?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14517978#comment-14517978 ] Siddharth Seth commented on TEZ-1897: - Quick glance. This should be disabled by default.

[jira] [Created] (TEZ-2381) Fixes after rebase 04/28

2015-04-28 Thread Siddharth Seth (JIRA)
Siddharth Seth created TEZ-2381: --- Summary: Fixes after rebase 04/28 Key: TEZ-2381 URL: https://issues.apache.org/jira/browse/TEZ-2381 Project: Apache Tez Issue Type: Sub-task

[jira] [Commented] (TEZ-1897) Create a concurrent version of AsyncDispatcher

2015-04-28 Thread Bikas Saha (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-1897?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14517996#comment-14517996 ] Bikas Saha commented on TEZ-1897: - the patch enabled it by default to get the jenkins run

[jira] [Updated] (TEZ-776) Reduce AM mem usage caused by storing TezEvents

2015-04-28 Thread Bikas Saha (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-776?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bikas Saha updated TEZ-776: --- Attachment: TEZ-776.6.A.patch Re-uploading patch as the previous one had incomplete diffs. Reduce AM mem usage

[jira] [Updated] (TEZ-776) Reduce AM mem usage caused by storing TezEvents

2015-04-28 Thread Bikas Saha (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-776?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bikas Saha updated TEZ-776: --- Attachment: (was: TEZ-776.6.A.patch) Reduce AM mem usage caused by storing TezEvents

[jira] [Commented] (TEZ-2376) Remove TaskAttemptEventType.TA_DIAGNOSTICS_UPDATE

2015-04-28 Thread TezQA (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-2376?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14516639#comment-14516639 ] TezQA commented on TEZ-2376: {color:red}-1 overall{color}. Here are the results of testing the

[jira] [Commented] (TEZ-1897) Create a concurrent version of AsyncDispatcher

2015-04-28 Thread Jeff Zhang (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-1897?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14516643#comment-14516643 ] Jeff Zhang commented on TEZ-1897: - Comments: * Rename registerAndCreateDispatcher to

[jira] [Updated] (TEZ-776) Reduce AM mem usage caused by storing TezEvents

2015-04-28 Thread Bikas Saha (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-776?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bikas Saha updated TEZ-776: --- Attachment: TEZ-776.5.patch Cancelling and re-uploading patch due to build error. Triggering build again.

[jira] [Commented] (TEZ-776) Reduce AM mem usage caused by storing TezEvents

2015-04-28 Thread TezQA (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-776?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14517533#comment-14517533 ] TezQA commented on TEZ-776: --- {color:red}-1 overall{color}. Here are the results of testing the

[jira] [Commented] (TEZ-2372) TestAMRecovery failing in latest build

2015-04-28 Thread Hitesh Shah (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-2372?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14517516#comment-14517516 ] Hitesh Shah commented on TEZ-2372: -- For the next failure, take a look at

[jira] [Updated] (TEZ-776) Reduce AM mem usage caused by storing TezEvents

2015-04-28 Thread Bikas Saha (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-776?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bikas Saha updated TEZ-776: --- Attachment: (was: TEZ-776.5.patch) Reduce AM mem usage caused by storing TezEvents

[jira] [Assigned] (TEZ-2380) Disable fall back to reading from timeline if timeline disabled

2015-04-28 Thread Chang Li (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-2380?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chang Li reassigned TEZ-2380: - Assignee: Chang Li Disable fall back to reading from timeline if timeline disabled

[jira] [Commented] (TEZ-2376) Remove TaskAttemptEventType.TA_DIAGNOSTICS_UPDATE

2015-04-28 Thread TezQA (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-2376?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14516571#comment-14516571 ] TezQA commented on TEZ-2376: {color:red}-1 overall{color}. Here are the results of testing the

Failed: TEZ-2376 PreCommit Build #559

2015-04-28 Thread Apache Jenkins Server
Jira: https://issues.apache.org/jira/browse/TEZ-2376 Build: https://builds.apache.org/job/PreCommit-TEZ-Build/559/ ### ## LAST 60 LINES OF THE CONSOLE ### [...truncated

  1   2   >