[jira] [Commented] (TEZ-4404) Hive on tez report IndexOutofBoundary Exception when query hive external table

2022-07-10 Thread Chen He (Jira)
[ https://issues.apache.org/jira/browse/TEZ-4404?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17564723#comment-17564723 ] Chen He commented on TEZ-4404: -- 1. what's tez version? (need to find where this exception is thrown from

[jira] [Created] (TEZ-4404) Hive on tez report IndexOutofBoundary Exception when query hive external table

2022-04-14 Thread Chen He (Jira)
Chen He created TEZ-4404: Summary: Hive on tez report IndexOutofBoundary Exception when query hive external table Key: TEZ-4404 URL: https://issues.apache.org/jira/browse/TEZ-4404 Project: Apache Tez

[jira] [Commented] (TEZ-1844) Shouldn't invoke system.exit in local mode when AM is failed to start

2014-12-19 Thread Chen He (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-1844?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14253724#comment-14253724 ] Chen He commented on TEZ-1844: -- {quote} I think this is for avoiding resource localization.

[jira] [Commented] (TEZ-684) Uber/Local modes for Tez

2014-12-17 Thread Chen He (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-684?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14250190#comment-14250190 ] Chen He commented on TEZ-684: - Sounds good to me. Uber/Local modes for Tez

[jira] [Assigned] (TEZ-684) Uber/Local modes for Tez

2014-12-17 Thread Chen He (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-684?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chen He reassigned TEZ-684: --- Assignee: Chen He Uber/Local modes for Tez Key: TEZ-684

[jira] [Commented] (TEZ-684) Uber/Local modes for Tez

2014-12-17 Thread Chen He (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-684?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14251058#comment-14251058 ] Chen He commented on TEZ-684: - Other Tez umbrella JIRAs that many contributors work on it have

[jira] [Comment Edited] (TEZ-684) Uber/Local modes for Tez

2014-12-17 Thread Chen He (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-684?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14251058#comment-14251058 ] Chen He edited comment on TEZ-684 at 12/18/14 2:51 AM: --- Other Tez

[jira] [Commented] (TEZ-684) Uber/Local modes for Tez

2014-12-17 Thread Chen He (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-684?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14251075#comment-14251075 ] Chen He commented on TEZ-684: - It may hurt TEZ's popularity and prevent people from using and

[jira] [Commented] (TEZ-684) Uber/Local modes for Tez

2014-12-17 Thread Chen He (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-684?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14251131#comment-14251131 ] Chen He commented on TEZ-684: - Thank you for the explanation, [~bikassaha]. Since Jan 2014, I

[jira] [Comment Edited] (TEZ-684) Uber/Local modes for Tez

2014-12-17 Thread Chen He (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-684?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14251131#comment-14251131 ] Chen He edited comment on TEZ-684 at 12/18/14 3:53 AM: --- Thank you for

[jira] [Commented] (TEZ-1844) Shouldn't invoke system.exit in local mode when AM is failed to start

2014-12-17 Thread Chen He (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-1844?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14251155#comment-14251155 ] Chen He commented on TEZ-1844: -- Thank you for the patch, [~zjffdu]. Two nits. 1) dagAmThread

[jira] [Comment Edited] (TEZ-1844) Shouldn't invoke system.exit in local mode when AM is failed to start

2014-12-17 Thread Chen He (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-1844?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14251155#comment-14251155 ] Chen He edited comment on TEZ-1844 at 12/18/14 4:25 AM: Thank you

[jira] [Commented] (TEZ-1844) Shouldn't invoke system.exit in local mode when AM is failed to start

2014-12-12 Thread Chen He (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-1844?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14244499#comment-14244499 ] Chen He commented on TEZ-1844: -- Thank [~zjffdu] for reporting this issue. Shouldn't invoke

[jira] [Updated] (TEZ-1839) TestTezClientUtils leaves files under the target directory after completing

2014-12-12 Thread Chen He (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-1839?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chen He updated TEZ-1839: - Attachment: TEZ-1837.patch Put temp files into System.getProperty(java.io.tmpdir) if test.build.data is not

[jira] [Updated] (TEZ-1839) TestTezClientUtils leaves files under the target directory after completing

2014-12-12 Thread Chen He (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-1839?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chen He updated TEZ-1839: - Attachment: TEZ-1837.patch TestTezClientUtils leaves files under the target directory after completing

[jira] [Commented] (TEZ-1839) TestTezClientUtils leaves files under the target directory after completing

2014-12-12 Thread Chen He (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-1839?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14244618#comment-14244618 ] Chen He commented on TEZ-1839: -- Thank you [~hitesh] for the review. I uploaded the wrong patch.

[jira] [Comment Edited] (TEZ-1839) TestTezClientUtils leaves files under the target directory after completing

2014-12-12 Thread Chen He (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-1839?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14244618#comment-14244618 ] Chen He edited comment on TEZ-1839 at 12/12/14 7:04 PM: Thank you

[jira] [Commented] (TEZ-1837) Avoid updating environment when running in local mode

2014-12-11 Thread Chen He (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-1837?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14243249#comment-14243249 ] Chen He commented on TEZ-1837: -- Hi [~sseth], would you mind I connect this JIRA to TEZ-684?

[jira] [Commented] (TEZ-1542) Local Mode crashes on concurrentModificationException

2014-10-23 Thread Chen He (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-1542?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14181603#comment-14181603 ] Chen He commented on TEZ-1542: -- Thank you for the suggestion. I did some research on how it

[jira] [Updated] (TEZ-1542) Local Mode crashes on concurrentModificationException

2014-10-23 Thread Chen He (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-1542?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chen He updated TEZ-1542: - Attachment: TEZ-1542-5.patch Local Mode crashes on concurrentModificationException

[jira] [Updated] (TEZ-1542) Local Mode crashes on concurrentModificationException

2014-10-23 Thread Chen He (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-1542?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chen He updated TEZ-1542: - Attachment: (was: TEZ-1542-5.patch) Local Mode crashes on concurrentModificationException

[jira] [Commented] (TEZ-1542) Local Mode crashes on concurrentModificationException

2014-10-23 Thread Chen He (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-1542?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14182475#comment-14182475 ] Chen He commented on TEZ-1542: -- You are right, [~seth.siddha...@gmail.com]. It is more

[jira] [Updated] (TEZ-1542) Local Mode crashes on concurrentModificationException

2014-10-23 Thread Chen He (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-1542?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chen He updated TEZ-1542: - Attachment: TEZ-1542-6.patch Local Mode crashes on concurrentModificationException

[jira] [Updated] (TEZ-1542) Local Mode crashes on concurrentModificationException

2014-10-23 Thread Chen He (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-1542?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chen He updated TEZ-1542: - Attachment: (was: TEZ-1542-6.patch) Local Mode crashes on concurrentModificationException

[jira] [Updated] (TEZ-1542) Local Mode crashes on concurrentModificationException

2014-10-23 Thread Chen He (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-1542?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chen He updated TEZ-1542: - Attachment: TEZ-1542-6.patch Local Mode crashes on concurrentModificationException

[jira] [Commented] (TEZ-14) Support for speculation of slow tasks

2014-10-22 Thread Chen He (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-14?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14180048#comment-14180048 ] Chen He commented on TEZ-14: Hi, [~bikassaha], it is nice work. I have a question. Since there are

[jira] [Updated] (TEZ-1618) LocalTaskSchedulerService.getTotalResources() and getAvailableResources() can get negative if JVM memory is larger than 2GB

2014-09-25 Thread Chen He (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-1618?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chen He updated TEZ-1618: - Attachment: TEZ-1618-2.patch patch updated. LocalTaskSchedulerService.getTotalResources() and

[jira] [Updated] (TEZ-1618) LocalTaskSchedulerService.getTotalResources() and getAvailableResources() can get negative if JVM memory is larger than 2GB

2014-09-25 Thread Chen He (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-1618?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chen He updated TEZ-1618: - Attachment: TEZ-1618-3.patch LocalTaskSchedulerService.getTotalResources() and getAvailableResources() can get

[jira] [Updated] (TEZ-1618) LocalTaskSchedulerService.getTotalResources() and getAvailableResources() can get negative if JVM memory is larger than 2GB

2014-09-25 Thread Chen He (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-1618?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chen He updated TEZ-1618: - Attachment: TEZ-1618-3.patch LocalTaskSchedulerService.getTotalResources() and getAvailableResources() can get

[jira] [Updated] (TEZ-1618) LocalTaskSchedulerService.getTotalResources() and getAvailableResources() can get negative if JVM memory is larger than 2GB

2014-09-25 Thread Chen He (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-1618?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chen He updated TEZ-1618: - Attachment: (was: TEZ-1618-3.patch) LocalTaskSchedulerService.getTotalResources() and getAvailableResources()

[jira] [Commented] (TEZ-1618) LocalTaskSchedulerService.getTotalResources() and getAvailableResources() can get negative if JVM memory is larger than 2GB

2014-09-25 Thread Chen He (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-1618?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14148086#comment-14148086 ] Chen He commented on TEZ-1618: -- patch updated, replace ExceptionExpect with try---catch.

[jira] [Updated] (TEZ-1591) Add multiDAG session test and move TestLocalMode to tez-tests

2014-09-23 Thread Chen He (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-1591?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chen He updated TEZ-1591: - Description: Move TestLocalMode to tez-tests. It enable TestLocalMode to use more examples from tez-examples

[jira] [Updated] (TEZ-1542) Local Mode crashes on concurrentModificationException

2014-09-23 Thread Chen He (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-1542?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chen He updated TEZ-1542: - Attachment: TEZ-1542-4.patch Thank you for remindering me, [~jeagles]. Patch updated. Local Mode crashes on

[jira] [Created] (TEZ-1618) LocalTaskSchedulerService.getTotalResources() and getAvailableResources() can get negative if JVM memory is larger than 2GB

2014-09-23 Thread Chen He (JIRA)
Chen He created TEZ-1618: Summary: LocalTaskSchedulerService.getTotalResources() and getAvailableResources() can get negative if JVM memory is larger than 2GB Key: TEZ-1618 URL:

[jira] [Updated] (TEZ-1618) LocalTaskSchedulerService.getTotalResources() and getAvailableResources() can get negative if JVM memory is larger than 2GB

2014-09-23 Thread Chen He (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-1618?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chen He updated TEZ-1618: - Description: Tez job can get failed because of negative headroom value; org.apache.tez.dag.app.dag.impl.VertexImpl

[jira] [Updated] (TEZ-1618) LocalTaskSchedulerService.getTotalResources() and getAvailableResources() can get negative if JVM memory is larger than 2GB

2014-09-23 Thread Chen He (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-1618?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chen He updated TEZ-1618: - Description: Tez job can get failed because of negative headroom value; org.apache.tez.dag.app.dag.impl.VertexImpl

[jira] [Assigned] (TEZ-1618) LocalTaskSchedulerService.getTotalResources() and getAvailableResources() can get negative if JVM memory is larger than 2GB

2014-09-23 Thread Chen He (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-1618?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chen He reassigned TEZ-1618: Assignee: Chen He LocalTaskSchedulerService.getTotalResources() and getAvailableResources() can get

[jira] [Commented] (TEZ-1591) Move TestLocalMode to tez-tests

2014-09-21 Thread Chen He (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-1591?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14142458#comment-14142458 ] Chen He commented on TEZ-1591: -- Sorry about the confusion. I added a testing method

[jira] [Updated] (TEZ-1591) Move TestLocalMode to tez-tests

2014-09-20 Thread Chen He (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-1591?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chen He updated TEZ-1591: - Attachment: TEZ-1591-1.patch [~zjffdu], Thank you for your review. Sorry about typing your email wrong. I did

[jira] [Created] (TEZ-1591) Move TestLocalMode to tez-tests

2014-09-17 Thread Chen He (JIRA)
Chen He created TEZ-1591: Summary: Move TestLocalMode to tez-tests Key: TEZ-1591 URL: https://issues.apache.org/jira/browse/TEZ-1591 Project: Apache Tez Issue Type: Improvement Reporter:

[jira] [Updated] (TEZ-1591) Move TestLocalMode to tez-tests

2014-09-17 Thread Chen He (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-1591?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chen He updated TEZ-1591: - Issue Type: Sub-task (was: Improvement) Parent: TEZ-684 Move TestLocalMode to tez-tests

[jira] [Updated] (TEZ-1591) Move TestLocalMode to tez-tests

2014-09-17 Thread Chen He (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-1591?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chen He updated TEZ-1591: - Affects Version/s: 0.5.0 Move TestLocalMode to tez-tests --- Key:

[jira] [Updated] (TEZ-1591) Move TestLocalMode to tez-tests

2014-09-17 Thread Chen He (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-1591?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chen He updated TEZ-1591: - Attachment: TEZ-1591.patch move TestLocalMode to tez-tests and add a new unit test to test testMultiDAGonSession

[jira] [Commented] (TEZ-1591) Move TestLocalMode to tez-tests

2014-09-17 Thread Chen He (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-1591?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14137508#comment-14137508 ] Chen He commented on TEZ-1591: -- [~jeffzhang], can you take a look? Move TestLocalMode to

[jira] [Assigned] (TEZ-1572) Add throw Exception for method handleEvents of OutputFrameworkInterface and ProcessorFrameworkInterface

2014-09-12 Thread Chen He (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-1572?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chen He reassigned TEZ-1572: Assignee: Chen He Add throw Exception for method handleEvents of OutputFrameworkInterface and

[jira] [Comment Edited] (TEZ-1572) Add throw Exception for method handleEvents of OutputFrameworkInterface and ProcessorFrameworkInterface

2014-09-12 Thread Chen He (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-1572?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14130124#comment-14130124 ] Chen He edited comment on TEZ-1572 at 9/12/14 2:24 PM: --- add throw

[jira] [Updated] (TEZ-1572) Add throw Exception for method handleEvents of OutputFrameworkInterface and ProcessorFrameworkInterface

2014-09-11 Thread Chen He (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-1572?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chen He updated TEZ-1572: - Attachment: TEZ-1572.patch add throw exception to OutputFrameworkInterface and ProcessorFrameworkInterface, also

[jira] [Updated] (TEZ-1542) Local Mode crashes on concurrentModificationException

2014-09-10 Thread Chen He (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-1542?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chen He updated TEZ-1542: - Attachment: TEZ-1542-2.patch add concurrent unit test Local Mode crashes on concurrentModificationException

[jira] [Updated] (TEZ-1542) Local Mode crashes on concurrentModificationException

2014-09-10 Thread Chen He (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-1542?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chen He updated TEZ-1542: - Attachment: TEZ-1542-3.patch shutdown threadpool after test. Local Mode crashes on

[jira] [Updated] (TEZ-1542) Local Mode crashes on concurrentModificationException

2014-09-10 Thread Chen He (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-1542?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chen He updated TEZ-1542: - Attachment: TEZ-1542-3.patch Local Mode crashes on concurrentModificationException

[jira] [Updated] (TEZ-1542) Local Mode crashes on concurrentModificationException

2014-09-10 Thread Chen He (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-1542?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chen He updated TEZ-1542: - Attachment: (was: TEZ-1542-3.patch) Local Mode crashes on concurrentModificationException

[jira] [Commented] (TEZ-1538) Tez Local Mode fails if fs.defaultFS is not set to be file:///' in core-site.xml

2014-09-09 Thread Chen He (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-1538?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14127323#comment-14127323 ] Chen He commented on TEZ-1538: -- Agreed. I mark this one as duplicated of TEZ-1534. Tez Local

[jira] [Comment Edited] (TEZ-1376) Investigate independent parallel DAGs execution in Local Mode

2014-09-07 Thread Chen He (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-1376?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14125093#comment-14125093 ] Chen He edited comment on TEZ-1376 at 9/7/14 11:16 PM: ---

[jira] [Commented] (TEZ-1376) Investigate independent parallel DAGs execution in Local Mode

2014-09-07 Thread Chen He (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-1376?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14125093#comment-14125093 ] Chen He commented on TEZ-1376: -- TezChild.ContainerExecutionResult is static in TEZ-870. It is

[jira] [Comment Edited] (TEZ-1376) Investigate independent parallel DAGs execution in Local Mode

2014-09-07 Thread Chen He (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-1376?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14125093#comment-14125093 ] Chen He edited comment on TEZ-1376 at 9/7/14 11:16 PM: ---

[jira] [Created] (TEZ-1542) Local Mode crashes on concurrentModificationException

2014-09-04 Thread Chen He (JIRA)
Chen He created TEZ-1542: Summary: Local Mode crashes on concurrentModificationException Key: TEZ-1542 URL: https://issues.apache.org/jira/browse/TEZ-1542 Project: Apache Tez Issue Type: Sub-task

[jira] [Updated] (TEZ-1542) Local Mode crashes on concurrentModificationException

2014-09-04 Thread Chen He (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-1542?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chen He updated TEZ-1542: - Attachment: TEZ-1542.patch EnvironmentUtils does not consider concurrency. This patch fixes this problem. Local

[jira] [Assigned] (TEZ-1542) Local Mode crashes on concurrentModificationException

2014-09-04 Thread Chen He (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-1542?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chen He reassigned TEZ-1542: Assignee: Chen He Local Mode crashes on concurrentModificationException

[jira] [Assigned] (TEZ-1538) Tez Local Mode fails if fs.defaultFS is not set to be file:///' in core-site.xml

2014-09-04 Thread Chen He (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-1538?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chen He reassigned TEZ-1538: Assignee: Chen He Tez Local Mode fails if fs.defaultFS is not set to be file:///' in core-site.xml

[jira] [Created] (TEZ-1538) Tez Local Mode fails if fs.defaultFS is not set to be file:///' in core-site.xml

2014-09-03 Thread Chen He (JIRA)
Chen He created TEZ-1538: Summary: Tez Local Mode fails if fs.defaultFS is not set to be file:///' in core-site.xml Key: TEZ-1538 URL: https://issues.apache.org/jira/browse/TEZ-1538 Project: Apache Tez

[jira] [Updated] (TEZ-1538) Tez Local Mode fails if fs.defaultFS is not set to be file:///' in core-site.xml

2014-09-03 Thread Chen He (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-1538?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chen He updated TEZ-1538: - Attachment: TEZ-1538.patch Tez Local Mode fails if fs.defaultFS is not set to be file:///' in core-site.xml

[jira] [Updated] (TEZ-1376) Investigate independent parallel DAGs execution in Local Mode

2014-08-28 Thread Chen He (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-1376?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chen He updated TEZ-1376: - Summary: Investigate independent parallel DAGs execution in Local Mode (was: Support independent parallel DAGs

[jira] [Assigned] (TEZ-1376) Investigate independent parallel DAGs execution in Local Mode

2014-08-28 Thread Chen He (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-1376?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chen He reassigned TEZ-1376: Assignee: Chen He Investigate independent parallel DAGs execution in Local Mode

[jira] [Updated] (TEZ-1376) Investigate independent parallel DAGs execution in Local Mode

2014-08-28 Thread Chen He (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-1376?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chen He updated TEZ-1376: - Attachment: (was: differentParallelJob-surefireOut.txt) Investigate independent parallel DAGs execution in

[jira] [Updated] (TEZ-1376) Investigate independent parallel DAGs execution in Local Mode

2014-08-28 Thread Chen He (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-1376?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chen He updated TEZ-1376: - Attachment: independantDAG2.data independantDAG1.data independantDAG.pig a pig

[jira] [Comment Edited] (TEZ-1376) Investigate independent parallel DAGs execution in Local Mode

2014-08-28 Thread Chen He (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-1376?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14114392#comment-14114392 ] Chen He edited comment on TEZ-1376 at 8/28/14 9:37 PM: --- a pig example

[jira] [Issue Comment Deleted] (TEZ-1376) Investigate independent parallel DAGs execution in Local Mode

2014-08-28 Thread Chen He (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-1376?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chen He updated TEZ-1376: - Comment: was deleted (was: The sequential number looks incorrect since LocalClient use appIdNumber++ to create

[jira] [Comment Edited] (TEZ-1376) Support independent parallel DAGs execution in Local Mode

2014-08-27 Thread Chen He (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-1376?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14112380#comment-14112380 ] Chen He edited comment on TEZ-1376 at 8/27/14 4:06 PM: --- The sequential

[jira] [Comment Edited] (TEZ-1376) Support independent parallel DAGs execution in Local Mode

2014-08-27 Thread Chen He (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-1376?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14112380#comment-14112380 ] Chen He edited comment on TEZ-1376 at 8/27/14 4:06 PM: --- The sequential

[jira] [Updated] (TEZ-1376) Support independent parallel DAGs execution in Local Mode

2014-08-26 Thread Chen He (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-1376?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chen He updated TEZ-1376: - Attachment: differentParallelJob-ErrorOnTerminal.txt Support independent parallel DAGs execution in Local Mode

[jira] [Updated] (TEZ-1376) Support independent parallel DAGs execution in Local Mode

2014-08-26 Thread Chen He (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-1376?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chen He updated TEZ-1376: - Attachment: differentParallelJob.patch unit test for two different parallel dags. Support independent parallel

[jira] [Updated] (TEZ-1376) Support independent parallel DAGs execution in Local Mode

2014-08-26 Thread Chen He (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-1376?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chen He updated TEZ-1376: - Attachment: differentParallelJob-surefireOut.txt Another interesting issue is the first Job is named as

[jira] [Created] (TEZ-1482) Fix memory issues for Local Mode running concurrent tasks

2014-08-22 Thread Chen He (JIRA)
Chen He created TEZ-1482: Summary: Fix memory issues for Local Mode running concurrent tasks Key: TEZ-1482 URL: https://issues.apache.org/jira/browse/TEZ-1482 Project: Apache Tez Issue Type: Bug

[jira] [Updated] (TEZ-1482) Fix memory issues for Local Mode running concurrent tasks

2014-08-22 Thread Chen He (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-1482?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chen He updated TEZ-1482: - Issue Type: Sub-task (was: Bug) Parent: TEZ-684 Fix memory issues for Local Mode running concurrent

[jira] [Updated] (TEZ-1471) Additional supplement for TEZ local mode document

2014-08-22 Thread Chen He (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-1471?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chen He updated TEZ-1471: - Attachment: TEZ-1471-2.patch Additional supplement for TEZ local mode document

[jira] [Commented] (TEZ-1471) Additional supplement for TEZ local mode document

2014-08-22 Thread Chen He (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-1471?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14107062#comment-14107062 ] Chen He commented on TEZ-1471: -- [~sseth], new JIRA created and document updated as you

[jira] [Updated] (TEZ-1471) Additional supplement for TEZ local mode document

2014-08-22 Thread Chen He (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-1471?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chen He updated TEZ-1471: - Attachment: TEZ-1471-3.patch updated. Additional supplement for TEZ local mode document

[jira] [Updated] (TEZ-1471) Additional supplement for TEZ local mode document

2014-08-22 Thread Chen He (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-1471?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chen He updated TEZ-1471: - Attachment: TEZ-1471-3.patch Additional supplement for TEZ local mode document

[jira] [Updated] (TEZ-1471) Additional supplement for TEZ local mode document

2014-08-21 Thread Chen He (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-1471?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chen He updated TEZ-1471: - Issue Type: Sub-task (was: Improvement) Parent: TEZ-684 Additional supplement for TEZ local mode

[jira] [Commented] (TEZ-1349) Add documentation for LocalMode usage

2014-08-20 Thread Chen He (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-1349?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14104603#comment-14104603 ] Chen He commented on TEZ-1349: -- Sure, TEZ-1471 is created. I will also make the change that

[jira] [Updated] (TEZ-1471) Additional supplement for TEZ local mode document

2014-08-20 Thread Chen He (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-1471?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chen He updated TEZ-1471: - Description: some supplements for Local mode document Additional supplement for TEZ local mode document

[jira] [Commented] (TEZ-1376) Support independent parallel DAGs execution in Local Mode

2014-08-20 Thread Chen He (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-1376?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14104847#comment-14104847 ] Chen He commented on TEZ-1376: -- I think we are worrying about the same thing. Same output

[jira] [Updated] (TEZ-1376) Support independent parallel DAGs execution in Local Mode

2014-08-18 Thread Chen He (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-1376?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chen He updated TEZ-1376: - Attachment: simpleTestCase.patch Support independent parallel DAGs execution in Local Mode

[jira] [Comment Edited] (TEZ-14) Support for speculation of slow tasks

2014-08-18 Thread Chen He (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-14?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14101322#comment-14101322 ] Chen He edited comment on TEZ-14 at 8/18/14 9:18 PM: - Mantri considers the

[jira] [Commented] (TEZ-14) Support for speculation of slow tasks

2014-08-18 Thread Chen He (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-14?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14101322#comment-14101322 ] Chen He commented on TEZ-14: Mantri considers the network traffic when it choose the node which

[jira] [Commented] (TEZ-1338) Support submission of multiple applications with LocalRunner from within the same JVM

2014-08-15 Thread Chen He (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-1338?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14099220#comment-14099220 ] Chen He commented on TEZ-1338: -- This is really helpful. Thanks, [~seth.siddha...@gmail.com].

[jira] [Commented] (TEZ-14) Support for speculation of slow tasks

2014-08-14 Thread Chen He (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-14?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14097174#comment-14097174 ] Chen He commented on TEZ-14: Some ideas about the speculative execution. My understanding is that

[jira] [Commented] (TEZ-1337) Handling of local-dirs for Local Mode

2014-08-13 Thread Chen He (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-1337?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14096517#comment-14096517 ] Chen He commented on TEZ-1337: -- I am confused about some comments in previous discussion: On

[jira] [Commented] (TEZ-1349) Add documentation for LocalMode usage

2014-08-12 Thread Chen He (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-1349?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14094658#comment-14094658 ] Chen He commented on TEZ-1349: -- +1 on this. It is very necessary. Add documentation for

[jira] [Comment Edited] (TEZ-1393) user.dir should not be reset in LocalMode

2014-08-11 Thread Chen He (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-1393?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14093087#comment-14093087 ] Chen He edited comment on TEZ-1393 at 8/11/14 6:11 PM: --- I suggest we

[jira] [Commented] (TEZ-1393) user.dir should not be reset in LocalMode

2014-08-11 Thread Chen He (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-1393?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14093087#comment-14093087 ] Chen He commented on TEZ-1393: -- I suggest we clarify all types of dirs used in not only local

[jira] [Commented] (TEZ-1337) Handling of local-dirs for Local Mode

2014-08-11 Thread Chen He (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-1337?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14093432#comment-14093432 ] Chen He commented on TEZ-1337: -- In progress and nearly done. Handling of local-dirs for Local

[jira] [Updated] (TEZ-934) Tez Configuration changes for TezLocalRunner

2014-08-09 Thread Chen He (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-934?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chen He updated TEZ-934: Affects Version/s: 0.3.0 Tez Configuration changes for TezLocalRunner

[jira] [Commented] (TEZ-1337) Handling of local-dirs for Local Mode

2014-08-08 Thread Chen He (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-1337?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14090674#comment-14090674 ] Chen He commented on TEZ-1337: -- Post my comments in TEZ-1393 Handling of local-dirs for Local

[jira] [Updated] (TEZ-1236) Implement common functionality in base abstract class for EdgeManager

2014-08-05 Thread Chen He (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-1236?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chen He updated TEZ-1236: - Attachment: TEZ-1236.patch In progress patch, remove input parameter of

[jira] [Commented] (TEZ-870) LocalContainerLauncher improvement

2014-08-01 Thread Chen He (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-870?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14082365#comment-14082365 ] Chen He commented on TEZ-870: - I can answer the last question. Local mode does not reuse

[jira] [Comment Edited] (TEZ-870) LocalContainerLauncher improvement

2014-08-01 Thread Chen He (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-870?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14082365#comment-14082365 ] Chen He edited comment on TEZ-870 at 8/1/14 3:43 PM: - I can answer the

[jira] [Commented] (TEZ-1337) Handling of local-dirs for Local Mode

2014-08-01 Thread Chen He (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-1337?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14082788#comment-14082788 ] Chen He commented on TEZ-1337: -- Sounds good to me. I am working on this and will attach patch

[jira] [Commented] (TEZ-870) LocalContainerLauncher improvement

2014-07-31 Thread Chen He (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-870?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14081386#comment-14081386 ] Chen He commented on TEZ-870: - I am testing it with only one vertex DAG. LocalContainerLauncher

[jira] [Commented] (TEZ-870) LocalContainerLauncher improvement

2014-07-31 Thread Chen He (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-870?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14081479#comment-14081479 ] Chen He commented on TEZ-870: - It works for one vertex. I can't test more than one vertex since

  1   2   >