[jira] [Commented] (TEZ-3645) Reuse SerializationFactory while sorting, merging, and writing IFiles

2017-03-03 Thread Jonathan Eagles (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-3645?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15894708#comment-15894708 ] Jonathan Eagles commented on TEZ-3645: -- [~rajesh.balamohan], noticed SerializationFactory creation

[jira] [Created] (TEZ-3648) IFile.Write#close has an extra output stream flush

2017-03-03 Thread Jonathan Eagles (JIRA)
Jonathan Eagles created TEZ-3648: Summary: IFile.Write#close has an extra output stream flush Key: TEZ-3648 URL: https://issues.apache.org/jira/browse/TEZ-3648 Project: Apache Tez Issue

[jira] [Updated] (TEZ-3645) Reuse SerializationFactory while sorting, merging, and writing IFiles

2017-03-02 Thread Jonathan Eagles (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-3645?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jonathan Eagles updated TEZ-3645: - Attachment: TEZ-3645.2.patch > Reuse SerializationFactory while sorting, merging, and writing

[jira] [Updated] (TEZ-3646) IFile.Writer has an extra output stream flush call

2017-03-02 Thread Jonathan Eagles (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-3646?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jonathan Eagles updated TEZ-3646: - Attachment: (was: TEZ-3546.1.patch) > IFile.Writer has an extra output stream flush call >

[jira] [Updated] (TEZ-3646) IFile.Writer has an extra output stream flush call

2017-03-02 Thread Jonathan Eagles (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-3646?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jonathan Eagles updated TEZ-3646: - Attachment: TEZ-3646.1.patch > IFile.Writer has an extra output stream flush call >

[jira] [Updated] (TEZ-3646) IFile.Writer has an extra output stream flush call

2017-03-01 Thread Jonathan Eagles (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-3646?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jonathan Eagles updated TEZ-3646: - Attachment: TEZ-3546.1.patch > IFile.Writer has an extra output stream flush call >

[jira] [Created] (TEZ-3646) IFile.Writer has an extra output stream flush call

2017-03-01 Thread Jonathan Eagles (JIRA)
Jonathan Eagles created TEZ-3646: Summary: IFile.Writer has an extra output stream flush call Key: TEZ-3646 URL: https://issues.apache.org/jira/browse/TEZ-3646 Project: Apache Tez Issue

[jira] [Updated] (TEZ-3645) Reuse SerializationFactory while sorting, merging, and writing IFiles

2017-03-01 Thread Jonathan Eagles (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-3645?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jonathan Eagles updated TEZ-3645: - Attachment: TEZ-3645.1.patch > Reuse SerializationFactory while sorting, merging, and writing

[jira] [Created] (TEZ-3645) Reuse SerializationFactory while sorting, merging, and writing IFiles

2017-03-01 Thread Jonathan Eagles (JIRA)
Jonathan Eagles created TEZ-3645: Summary: Reuse SerializationFactory while sorting, merging, and writing IFiles Key: TEZ-3645 URL: https://issues.apache.org/jira/browse/TEZ-3645 Project: Apache Tez

[jira] [Resolved] (TEZ-3638) VertexImpl logs too much at info when removing tasks after auto-reduce parallelism

2017-02-27 Thread Jonathan Eagles (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-3638?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jonathan Eagles resolved TEZ-3638. -- Resolution: Fixed Fix Version/s: 0.9.0 Thanks, [~rajesh.balamohan]. Committed this patch

[jira] [Commented] (TEZ-3638) VertexImpl logs too much at info when removing tasks after auto-reduce parallelism

2017-02-27 Thread Jonathan Eagles (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-3638?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15886321#comment-15886321 ] Jonathan Eagles commented on TEZ-3638: -- [~rajesh.balamohan], do I have your _+1_ on this patch? Want to

[jira] [Commented] (TEZ-3638) VertexImpl logs too much at info when removing tasks after auto-reduce parallelism

2017-02-24 Thread Jonathan Eagles (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-3638?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15884068#comment-15884068 ] Jonathan Eagles commented on TEZ-3638: -- [~rajesh.balamohan], Found the below line is already printed as

[jira] [Updated] (TEZ-3638) VertexImpl logs too much at info when removing tasks after auto-reduce parallelism

2017-02-24 Thread Jonathan Eagles (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-3638?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jonathan Eagles updated TEZ-3638: - Attachment: TEZ-3638.1.patch [~rajesh.balamohan], was wonder if we should log at debug, remove, or

[jira] [Commented] (TEZ-3638) VertexImpl logs too much at info when removing tasks after auto-reduce parallelism

2017-02-24 Thread Jonathan Eagles (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-3638?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15884029#comment-15884029 ] Jonathan Eagles commented on TEZ-3638: -- Not sure what info if any should be logged here. Posting patch

[jira] [Created] (TEZ-3638) VertexImpl logs too much at info when removing tasks after auto-reduce parallelism

2017-02-24 Thread Jonathan Eagles (JIRA)
Jonathan Eagles created TEZ-3638: Summary: VertexImpl logs too much at info when removing tasks after auto-reduce parallelism Key: TEZ-3638 URL: https://issues.apache.org/jira/browse/TEZ-3638

[jira] [Updated] (TEZ-1526) LoadingCache for TezTaskID slow for large jobs

2017-02-24 Thread Jonathan Eagles (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-1526?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jonathan Eagles updated TEZ-1526: - Attachment: TEZ-1526.6.patch > LoadingCache for TezTaskID slow for large jobs >

[jira] [Commented] (TEZ-3633) Implement keep-alive timeout in tez shuffle handler

2017-02-23 Thread Jonathan Eagles (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-3633?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15880617#comment-15880617 ] Jonathan Eagles commented on TEZ-3633: -- [~rajesh.balamohan], I will go ahead and file a MapReduce jira

[jira] [Comment Edited] (TEZ-3633) Implement keep-alive timeout in tez shuffle handler

2017-02-22 Thread Jonathan Eagles (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-3633?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15877721#comment-15877721 ] Jonathan Eagles edited comment on TEZ-3633 at 2/22/17 4:17 PM: ---

[jira] [Comment Edited] (TEZ-3633) Implement keep-alive timeout in tez shuffle handler

2017-02-22 Thread Jonathan Eagles (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-3633?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15877721#comment-15877721 ] Jonathan Eagles edited comment on TEZ-3633 at 2/22/17 7:59 AM: ---

[jira] [Commented] (TEZ-3633) Implement keep-alive timeout in tez shuffle handler

2017-02-21 Thread Jonathan Eagles (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-3633?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15877721#comment-15877721 ] Jonathan Eagles commented on TEZ-3633: -- [~rajesh.balamohan], I used the above logging technique to

[jira] [Commented] (TEZ-3633) Implement keep-alive timeout in tez shuffle handler

2017-02-21 Thread Jonathan Eagles (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-3633?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15876954#comment-15876954 ] Jonathan Eagles commented on TEZ-3633: -- [~rajesh.balamohan], added a patch that I hope will clarify. To

[jira] [Updated] (TEZ-3633) Implement keep-alive timeout in tez shuffle handler

2017-02-21 Thread Jonathan Eagles (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-3633?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jonathan Eagles updated TEZ-3633: - Attachment: TEZ-3633.1.patch > Implement keep-alive timeout in tez shuffle handler >

[jira] [Commented] (TEZ-3633) Implement keep-alive timeout in tez shuffle handler

2017-02-21 Thread Jonathan Eagles (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-3633?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15876823#comment-15876823 ] Jonathan Eagles commented on TEZ-3633: -- Patch based on recommended design from netty docs.

[jira] [Created] (TEZ-3633) Implement keep-alive timeout in tez shuffle handler

2017-02-21 Thread Jonathan Eagles (JIRA)
Jonathan Eagles created TEZ-3633: Summary: Implement keep-alive timeout in tez shuffle handler Key: TEZ-3633 URL: https://issues.apache.org/jira/browse/TEZ-3633 Project: Apache Tez Issue

[jira] [Commented] (TEZ-3628) Give Tez shuffle handler threads custom names

2017-02-17 Thread Jonathan Eagles (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-3628?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15872806#comment-15872806 ] Jonathan Eagles commented on TEZ-3628: -- [~kshukla], can you have a look at the patch? > Give Tez

[jira] [Updated] (TEZ-3628) Give Tez shuffle handler threads custom names

2017-02-17 Thread Jonathan Eagles (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-3628?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jonathan Eagles updated TEZ-3628: - Attachment: TEZ-3628.1.patch Attaching a patch that allows for custom naming of tez shuffle handler

[jira] [Created] (TEZ-3628) Give Tez shuffle handler threads custom names

2017-02-17 Thread Jonathan Eagles (JIRA)
Jonathan Eagles created TEZ-3628: Summary: Give Tez shuffle handler threads custom names Key: TEZ-3628 URL: https://issues.apache.org/jira/browse/TEZ-3628 Project: Apache Tez Issue Type:

[jira] [Commented] (TEZ-3626) Tez UI: First Task Start Time & Last Task Finish Time values are showing up incorrectly

2017-02-15 Thread Jonathan Eagles (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-3626?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15868114#comment-15868114 ] Jonathan Eagles commented on TEZ-3626: -- Should the check be less than *_or equal to_* 0? > Tez UI:

[jira] [Commented] (TEZ-3610) TEZ UI 0.7 0.9 compatibility for url query params and tez-app sub-routes

2017-02-13 Thread Jonathan Eagles (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-3610?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15865089#comment-15865089 ] Jonathan Eagles commented on TEZ-3610: -- [~Sreenath], can you review this patch? This allows Tez 0.7 url

[jira] [Commented] (TEZ-3617) TestHistoryParser#testParserWithSuccessfulJob fails intermittently

2017-02-13 Thread Jonathan Eagles (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-3617?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15864671#comment-15864671 ] Jonathan Eagles commented on TEZ-3617: -- [~Sonia], Do you have any surefire test logs to go with this

[jira] [Commented] (TEZ-3622) Updated hadoop dependency from 2.6.0 to 2.6.3

2017-02-13 Thread Jonathan Eagles (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-3622?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15864621#comment-15864621 ] Jonathan Eagles commented on TEZ-3622: -- Of course, there is 2.6.4 and 2.6.5 to consider. To my

[jira] [Updated] (TEZ-3622) Updated hadoop dependency from 2.6.0 to 2.6.3

2017-02-13 Thread Jonathan Eagles (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-3622?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jonathan Eagles updated TEZ-3622: - Attachment: TEZ-3622.1.patch > Updated hadoop dependency from 2.6.0 to 2.6.3 >

[jira] [Created] (TEZ-3622) Updated hadoop dependency from 2.6.0 to 2.6.3

2017-02-13 Thread Jonathan Eagles (JIRA)
Jonathan Eagles created TEZ-3622: Summary: Updated hadoop dependency from 2.6.0 to 2.6.3 Key: TEZ-3622 URL: https://issues.apache.org/jira/browse/TEZ-3622 Project: Apache Tez Issue Type: Bug

[jira] [Resolved] (TEZ-3621) Optimize the Shuffle Handler content length calculation for keep alive

2017-02-13 Thread Jonathan Eagles (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-3621?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jonathan Eagles resolved TEZ-3621. -- Resolution: Fixed Fix Version/s: TEZ-3334 Thanks for catching a good bug, [~kshukla].

[jira] [Commented] (TEZ-3621) Optimize the Shuffle Handler content length calculation for keep alive

2017-02-13 Thread Jonathan Eagles (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-3621?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15864181#comment-15864181 ] Jonathan Eagles commented on TEZ-3621: -- [~kshukla], posted a new version with the header corrected. >

[jira] [Updated] (TEZ-3621) Optimize the Shuffle Handler content length calculation for keep alive

2017-02-13 Thread Jonathan Eagles (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-3621?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jonathan Eagles updated TEZ-3621: - Attachment: TEZ-3621.3.patch > Optimize the Shuffle Handler content length calculation for keep

[jira] [Updated] (TEZ-3621) Optimize the Shuffle Handler content length calculation for keep alive

2017-02-13 Thread Jonathan Eagles (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-3621?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jonathan Eagles updated TEZ-3621: - Attachment: TEZ-3621.2.patch > Optimize the Shuffle Handler content length calculation for keep

[jira] [Commented] (TEZ-3621) Optimize the Shuffle Handler content length calculation for keep alive

2017-02-13 Thread Jonathan Eagles (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-3621?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15863999#comment-15863999 ] Jonathan Eagles commented on TEZ-3621: -- [~kshukla], can you have a look at this patch? > Optimize the

[jira] [Updated] (TEZ-3621) Optimize the Shuffle Handler content length calculation for keep alive

2017-02-13 Thread Jonathan Eagles (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-3621?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jonathan Eagles updated TEZ-3621: - Attachment: TEZ-3621.1.patch > Optimize the Shuffle Handler content length calculation for keep

[jira] [Created] (TEZ-3621) Optimize the Shuffle Handler content length calculation for keep alive

2017-02-13 Thread Jonathan Eagles (JIRA)
Jonathan Eagles created TEZ-3621: Summary: Optimize the Shuffle Handler content length calculation for keep alive Key: TEZ-3621 URL: https://issues.apache.org/jira/browse/TEZ-3621 Project: Apache Tez

[jira] [Resolved] (TEZ-3620) UnorderedPartitionedKVOutput is missing the shuffle service config in the confKeys set

2017-02-10 Thread Jonathan Eagles (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-3620?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jonathan Eagles resolved TEZ-3620. -- Resolution: Fixed Fix Version/s: TEZ-3334 +1. Thanks, [~kshukla]. Verify fix does allow

[jira] [Resolved] (TEZ-3618) Shuffle Handler Loading cache equality tests always results is false

2017-02-10 Thread Jonathan Eagles (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-3618?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jonathan Eagles resolved TEZ-3618. -- Resolution: Fixed Fix Version/s: TEZ-3334 Thanks, [~kshukla]. Committed this to feature

[jira] [Updated] (TEZ-3618) Shuffle Handler Loading cache equality tests always results is false

2017-02-10 Thread Jonathan Eagles (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-3618?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jonathan Eagles updated TEZ-3618: - Attachment: TEZ-3618.2.patch Thanks, [~kshukla]. Removed the redundant dag id check in equals and

[jira] [Commented] (TEZ-3618) Shuffle Handler Loading cache equality tests always results is false

2017-02-10 Thread Jonathan Eagles (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-3618?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15861623#comment-15861623 ] Jonathan Eagles commented on TEZ-3618: -- [~kshukla], should the hash and equality check be changed to

[jira] [Updated] (TEZ-3618) Shuffle Handler Loading cache equality tests always results is false

2017-02-10 Thread Jonathan Eagles (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-3618?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jonathan Eagles updated TEZ-3618: - Attachment: TEZ-3618.1.patch > Shuffle Handler Loading cache equality tests always results is false

[jira] [Created] (TEZ-3618) Shuffle Handler Loading cache equality tests always results is false

2017-02-10 Thread Jonathan Eagles (JIRA)
Jonathan Eagles created TEZ-3618: Summary: Shuffle Handler Loading cache equality tests always results is false Key: TEZ-3618 URL: https://issues.apache.org/jira/browse/TEZ-3618 Project: Apache Tez

[jira] [Resolved] (TEZ-3612) Tez Shuffle Handler Content length does not match actual

2017-02-09 Thread Jonathan Eagles (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-3612?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jonathan Eagles resolved TEZ-3612. -- Resolution: Fixed Fix Version/s: TEZ-3334 Thanks, [~kshukla]. Committed to TEZ-3334

[jira] [Updated] (TEZ-3612) Tez Shuffle Handler Content length does not match actual

2017-02-09 Thread Jonathan Eagles (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-3612?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jonathan Eagles updated TEZ-3612: - Attachment: TEZ-3612.1.patch > Tez Shuffle Handler Content length does not match actual >

[jira] [Created] (TEZ-3612) Tez Shuffle Handler Content length does not match actual

2017-02-07 Thread Jonathan Eagles (JIRA)
Jonathan Eagles created TEZ-3612: Summary: Tez Shuffle Handler Content length does not match actual Key: TEZ-3612 URL: https://issues.apache.org/jira/browse/TEZ-3612 Project: Apache Tez

[jira] [Commented] (TEZ-3610) TEZ UI 0.7 0.9 compatibility for url query params and tez-app sub-routes

2017-02-07 Thread Jonathan Eagles (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-3610?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15856556#comment-15856556 ] Jonathan Eagles commented on TEZ-3610: -- [~Sreenath], I been able to verify tez 0.7 urls work with the

[jira] [Updated] (TEZ-3610) TEZ UI 0.7 0.9 compatibility for url query params and tez-app sub-routes

2017-02-07 Thread Jonathan Eagles (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-3610?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jonathan Eagles updated TEZ-3610: - Attachment: TEZ-3610.1.patch > TEZ UI 0.7 0.9 compatibility for url query params and tez-app

[jira] [Created] (TEZ-3610) TEZ UI 0.7 0.9 compatibility for url query params and tez-app sub-routes

2017-02-07 Thread Jonathan Eagles (JIRA)
Jonathan Eagles created TEZ-3610: Summary: TEZ UI 0.7 0.9 compatibility for url query params and tez-app sub-routes Key: TEZ-3610 URL: https://issues.apache.org/jira/browse/TEZ-3610 Project: Apache

[jira] [Resolved] (TEZ-3608) Fetcher can hang if copyMapOutput/fetchInputs returns early

2017-02-03 Thread Jonathan Eagles (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-3608?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jonathan Eagles resolved TEZ-3608. -- Resolution: Fixed Assignee: Kuhu Shukla Fix Version/s: TEZ-3334 +1. Committed to

[jira] [Commented] (TEZ-3607) ShuffleScheduler#allEventsReceived check is too tight

2017-02-03 Thread Jonathan Eagles (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-3607?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15852149#comment-15852149 ] Jonathan Eagles commented on TEZ-3607: -- [~kshukla], could allEventsReceived also return true too early

[jira] [Resolved] (TEZ-3606) Fix debug log for empty partitions to the expanded partitionId in the Composite case

2017-02-03 Thread Jonathan Eagles (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-3606?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jonathan Eagles resolved TEZ-3606. -- Resolution: Fixed Fix Version/s: TEZ-3334 +1. Committed to feature branch TEZ-3334 > Fix

[jira] [Resolved] (TEZ-3604) Remove the compositeInputAttemptIdentifier from remaining list upon fetch completion in the Ordered case

2017-02-03 Thread Jonathan Eagles (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-3604?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jonathan Eagles resolved TEZ-3604. -- Resolution: Fixed Fix Version/s: TEZ-3334 +1. Committed to feature branch TEZ-3334 >

[jira] [Resolved] (TEZ-3599) Unordered Fetcher can hang if empty partitions are present

2017-02-02 Thread Jonathan Eagles (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-3599?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jonathan Eagles resolved TEZ-3599. -- Resolution: Fixed Fix Version/s: TEZ-3334 +1. Thanks, [~kshukla]. I made a small change to

[jira] [Resolved] (TEZ-3596) Number of Empty DME logged for Composite fetch is too high

2017-01-31 Thread Jonathan Eagles (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-3596?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jonathan Eagles resolved TEZ-3596. -- Resolution: Fixed Fix Version/s: TEZ-3334 > Number of Empty DME logged for Composite fetch

[jira] [Resolved] (TEZ-3597) Composite Fetch hangs on certain DME empty events.

2017-01-31 Thread Jonathan Eagles (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-3597?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jonathan Eagles resolved TEZ-3597. -- Resolution: Fixed Fix Version/s: TEZ-3334 > Composite Fetch hangs on certain DME empty

[jira] [Updated] (TEZ-3597) Composite Fetch hangs on certain DME empty events.

2017-01-31 Thread Jonathan Eagles (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-3597?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jonathan Eagles updated TEZ-3597: - Attachment: TEZ-3597.1.patch > Composite Fetch hangs on certain DME empty events. >

[jira] [Created] (TEZ-3597) Composite Fetch hangs on certain DME empty events.

2017-01-31 Thread Jonathan Eagles (JIRA)
Jonathan Eagles created TEZ-3597: Summary: Composite Fetch hangs on certain DME empty events. Key: TEZ-3597 URL: https://issues.apache.org/jira/browse/TEZ-3597 Project: Apache Tez Issue

[jira] (TEZ-3596) Number of Empty DME logged for Composite fetch is too high

2017-01-31 Thread Jonathan Eagles (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-3596?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jonathan Eagles updated TEZ-3596: - Attachment: TEZ-3596.1.patch > Number of Empty DME logged for Composite fetch is too high >

[jira] (TEZ-3596) Number of Empty DME logged for Composite fetch is too high

2017-01-31 Thread Jonathan Eagles (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-3596?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jonathan Eagles updated TEZ-3596: - Priority: Minor (was: Major) > Number of Empty DME logged for Composite fetch is too high >

[jira] (TEZ-3596) Number of Empty DME logged for Composite fetch is too high

2017-01-31 Thread Jonathan Eagles (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-3596?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jonathan Eagles updated TEZ-3596: - Description: Empty dme events are logged count * empty count instead of just incremented once per

[jira] (TEZ-3596) Number of Empty DME logged for Composite fetch is too high

2017-01-31 Thread Jonathan Eagles (JIRA)
Jonathan Eagles created TEZ-3596: Summary: Number of Empty DME logged for Composite fetch is too high Key: TEZ-3596 URL: https://issues.apache.org/jira/browse/TEZ-3596 Project: Apache Tez

[jira] (TEZ-3595) Composite Fetch account error for disk direct

2017-01-30 Thread Jonathan Eagles (JIRA)
Title: Message Title Jonathan Eagles resolved as Fixed

[jira] (TEZ-3595) Composite Fetch account error for disk direct

2017-01-30 Thread Jonathan Eagles (JIRA)
Title: Message Title Jonathan Eagles commented on TEZ-3595

[jira] (TEZ-3595) Composite Fetch account error for disk direct

2017-01-30 Thread Jonathan Eagles (JIRA)
Title: Message Title Jonathan Eagles edited a comment on TEZ-3595

[jira] (TEZ-3595) Composite Fetch account error for disk direct

2017-01-30 Thread Jonathan Eagles (JIRA)
Title: Message Title Jonathan Eagles updated an issue

[jira] (TEZ-3595) Composite Fetch account error for disk direct

2017-01-30 Thread Jonathan Eagles (JIRA)
Title: Message Title Jonathan Eagles updated an issue

[jira] (TEZ-3595) Composite Fetch account error for disk direct

2017-01-30 Thread Jonathan Eagles (JIRA)
Title: Message Title Jonathan Eagles updated an issue

[jira] (TEZ-3595) Composite Fetch account error for disk direct

2017-01-30 Thread Jonathan Eagles (JIRA)
Title: Message Title Jonathan Eagles updated an issue

[jira] (TEZ-3595) Composite Fetch account error for disk direct

2017-01-30 Thread Jonathan Eagles (JIRA)
Title: Message Title Jonathan Eagles updated an issue

[jira] [Updated] (TEZ-3595) Composite Fetch account error for disk direct

2017-01-26 Thread Jonathan Eagles (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-3595?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jonathan Eagles updated TEZ-3595: - Attachment: TEZ-3595.1.patch > Composite Fetch account error for disk direct >

[jira] [Created] (TEZ-3595) Composite Fetch account error for disk direct

2017-01-26 Thread Jonathan Eagles (JIRA)
Jonathan Eagles created TEZ-3595: Summary: Composite Fetch account error for disk direct Key: TEZ-3595 URL: https://issues.apache.org/jira/browse/TEZ-3595 Project: Apache Tez Issue Type:

[jira] [Commented] (TEZ-3590) Remove google.protobuf from the tez-auxservices shaded jar

2017-01-26 Thread Jonathan Eagles (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-3590?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15840515#comment-15840515 ] Jonathan Eagles commented on TEZ-3590: -- Thanks [~kshukla]. Committed to TEZ-3334 feature branch. >

[jira] [Resolved] (TEZ-3590) Remove google.protobuf from the tez-auxservices shaded jar

2017-01-26 Thread Jonathan Eagles (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-3590?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jonathan Eagles resolved TEZ-3590. -- Resolution: Fixed Fix Version/s: TEZ-3334 > Remove google.protobuf from the

[jira] [Updated] (TEZ-3590) Remove google.protobuf from the tez-auxservices shaded jar

2017-01-26 Thread Jonathan Eagles (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-3590?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jonathan Eagles updated TEZ-3590: - Attachment: TEZ-3590.1.patch > Remove google.protobuf from the tez-auxservices shaded jar >

[jira] [Created] (TEZ-3590) Remove google.protobuf from the tez-auxservices shaded jar

2017-01-26 Thread Jonathan Eagles (JIRA)
Jonathan Eagles created TEZ-3590: Summary: Remove google.protobuf from the tez-auxservices shaded jar Key: TEZ-3590 URL: https://issues.apache.org/jira/browse/TEZ-3590 Project: Apache Tez

[jira] [Updated] (TEZ-3417) Reduce sleep time on AM shutdown to reduce test runtimes

2017-01-25 Thread Jonathan Eagles (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-3417?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jonathan Eagles updated TEZ-3417: - Attachment: TEZ-3417.3.patch +1. Posted a version 3 rebased version of the patch that shows at

[jira] [Resolved] (TEZ-3587) Fetcher fetchInputs() can NPE on srcAttempt due to missing entry in pathToAttemptMap

2017-01-19 Thread Jonathan Eagles (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-3587?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jonathan Eagles resolved TEZ-3587. -- Resolution: Fixed Fix Version/s: TEZ-3334 committed to feature branch TEZ-3334 > Fetcher

[jira] [Commented] (TEZ-3587) Fetcher fetchInputs() can NPE on srcAttempt due to missing entry in pathToAttemptMap

2017-01-19 Thread Jonathan Eagles (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-3587?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15830784#comment-15830784 ] Jonathan Eagles commented on TEZ-3587: -- +1. Thanks, [~kshukla]. > Fetcher fetchInputs() can NPE on

[jira] [Resolved] (TEZ-3586) Remove fusesource.leveldbjni from the tez-auxservices shaded jar

2017-01-19 Thread Jonathan Eagles (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-3586?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jonathan Eagles resolved TEZ-3586. -- Resolution: Fixed Fix Version/s: TEZ-3334 committed to feature branch TEZ-3334 > Remove

[jira] [Commented] (TEZ-3586) Remove fusesource.leveldbjni from the tez-auxservices shaded jar

2017-01-19 Thread Jonathan Eagles (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-3586?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15830425#comment-15830425 ] Jonathan Eagles commented on TEZ-3586: -- +1. Provided is the correct scope since we directly depend on

[jira] [Commented] (TEZ-3585) Better escaping of header in AMWebController

2017-01-19 Thread Jonathan Eagles (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-3585?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15830119#comment-15830119 ] Jonathan Eagles commented on TEZ-3585: -- The technique used in

[jira] [Resolved] (TEZ-3532) Backport MAPREDUCE-6808. Log map attempts as part of shuffle handler audit log

2016-12-19 Thread Jonathan Eagles (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-3532?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jonathan Eagles resolved TEZ-3532. -- Resolution: Fixed Fix Version/s: TEZ-3334 Committed to feature branch TEZ-3334 > Backport

[jira] [Commented] (TEZ-3532) Backport MAPREDUCE-6808. Log map attempts as part of shuffle handler audit log

2016-12-19 Thread Jonathan Eagles (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-3532?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15762201#comment-15762201 ] Jonathan Eagles commented on TEZ-3532: -- +1. Thanks, [~kshukla]. Will commit this to feature branch

[jira] [Resolved] (TEZ-3563) Tez Shuffle Handler logging fails to initialize

2016-12-16 Thread Jonathan Eagles (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-3563?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jonathan Eagles resolved TEZ-3563. -- Resolution: Fixed Fix Version/s: TEZ-3334 Committed to TEZ-3334 feature branch. Thanks,

[jira] [Updated] (TEZ-3563) Tez Shuffle Handler logging fails to initialize

2016-12-16 Thread Jonathan Eagles (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-3563?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jonathan Eagles updated TEZ-3563: - Summary: Tez Shuffle Handler logging fails to initialize (was: Tez Shuffle Handler logging) > Tez

[jira] [Resolved] (TEZ-3564) TezConfiguration#TEZ_DELETION_TRACKER_CLASS has the wrong config key-name

2016-12-16 Thread Jonathan Eagles (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-3564?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jonathan Eagles resolved TEZ-3564. -- Resolution: Fixed Fix Version/s: TEZ-3334 +1. Committed this to the TEZ-3334 feature

[jira] [Commented] (TEZ-3563) Tez Shuffle Handler logging

2016-12-16 Thread Jonathan Eagles (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-3563?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15755243#comment-15755243 ] Jonathan Eagles commented on TEZ-3563: -- Need to rely on the provided log4j and slf4j. [~kshukla], can

[jira] [Updated] (TEZ-3563) Tez Shuffle Handler logging

2016-12-16 Thread Jonathan Eagles (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-3563?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jonathan Eagles updated TEZ-3563: - Attachment: TEZ-3563.1.patch > Tez Shuffle Handler logging > --- > >

[jira] [Created] (TEZ-3563) Tez Shuffle Handler logging

2016-12-16 Thread Jonathan Eagles (JIRA)
Jonathan Eagles created TEZ-3563: Summary: Tez Shuffle Handler logging Key: TEZ-3563 URL: https://issues.apache.org/jira/browse/TEZ-3563 Project: Apache Tez Issue Type: Sub-task

[jira] [Commented] (TEZ-3562) Attempt completion gets printed to STDOUT and STDERR

2016-12-16 Thread Jonathan Eagles (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-3562?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15754752#comment-15754752 ] Jonathan Eagles commented on TEZ-3562: -- Users wanted to be able to use their existing UDFs without

[jira] [Commented] (TEZ-3562) Attempt completion gets printed to STDOUT and STDERR

2016-12-15 Thread Jonathan Eagles (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-3562?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15752820#comment-15752820 ] Jonathan Eagles commented on TEZ-3562: -- [~prasanth_j], this is actually intentional. If user code is

[jira] [Resolved] (TEZ-3557) TEZ-3362 causes TestContainerLauncherWrapper#testDelegation to fail

2016-12-15 Thread Jonathan Eagles (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-3557?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jonathan Eagles resolved TEZ-3557. -- Resolution: Fixed Fix Version/s: TEZ-3334 +1. Committed to TEZ-3334 feature branch. >

[jira] [Commented] (TEZ-3559) TEZ_LIB_URIS doesn't work with schemes different than the defaultFS

2016-12-15 Thread Jonathan Eagles (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-3559?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15752420#comment-15752420 ] Jonathan Eagles commented on TEZ-3559: -- +1 pending pre-commit. [~ebadger], is this an issue in 0.7 as

[jira] [Comment Edited] (TEZ-3549) TaskAttemptImpl does not initialize TEZ_TASK_PROGRESS_STUCK_INTERVAL_MS correctly

2016-12-08 Thread Jonathan Eagles (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-3549?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15732832#comment-15732832 ] Jonathan Eagles edited comment on TEZ-3549 at 12/8/16 5:29 PM: --- Thanks,

[jira] [Resolved] (TEZ-3549) TaskAttemptImpl does not initialize TEZ_TASK_PROGRESS_STUCK_INTERVAL_MS correctly

2016-12-08 Thread Jonathan Eagles (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-3549?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jonathan Eagles resolved TEZ-3549. -- Resolution: Fixed Thanks, [~kshukla]. > TaskAttemptImpl does not initialize

[jira] [Reopened] (TEZ-3549) TaskAttemptImpl does not initialize TEZ_TASK_PROGRESS_STUCK_INTERVAL_MS correctly

2016-12-08 Thread Jonathan Eagles (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-3549?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jonathan Eagles reopened TEZ-3549: -- reopening to wait for a branch-0.7 specific patch. > TaskAttemptImpl does not initialize

<    4   5   6   7   8   9   10   11   12   13   >