[jira] [Updated] (YARN-10444) use openFile() with sequential IO for localizing files.

2020-09-18 Thread Steve Loughran (Jira)
[ https://issues.apache.org/jira/browse/YARN-10444?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran updated YARN-10444: -- Issue Type: Improvement (was: Bug) > use openFile() with sequential IO for localizing files.

[jira] [Commented] (YARN-10444) use openFile() with sequential IO for localizing files.

2020-09-18 Thread Steve Loughran (Jira)
[ https://issues.apache.org/jira/browse/YARN-10444?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17198494#comment-17198494 ] Steve Loughran commented on YARN-10444: --- linking to work in

[jira] [Commented] (YARN-10444) use openFile() with sequential IO for localizing files.

2020-09-18 Thread Steve Loughran (Jira)
[ https://issues.apache.org/jira/browse/YARN-10444?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17198492#comment-17198492 ] Steve Loughran commented on YARN-10444: --- The openFile() API is in hadoop 3.3.0, but the standard

[jira] [Created] (YARN-10444) use openFile() with sequential IO for localizing files.

2020-09-18 Thread Steve Loughran (Jira)
Steve Loughran created YARN-10444: - Summary: use openFile() with sequential IO for localizing files. Key: YARN-10444 URL: https://issues.apache.org/jira/browse/YARN-10444 Project: Hadoop YARN

[jira] [Updated] (YARN-10444) use openFile() with sequential IO for localizing files.

2020-09-18 Thread Steve Loughran (Jira)
[ https://issues.apache.org/jira/browse/YARN-10444?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran updated YARN-10444: -- Component/s: nodemanager > use openFile() with sequential IO for localizing files. >

[jira] [Updated] (YARN-10444) use openFile() with sequential IO for localizing files.

2020-09-18 Thread Steve Loughran (Jira)
[ https://issues.apache.org/jira/browse/YARN-10444?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran updated YARN-10444: -- Priority: Minor (was: Major) > use openFile() with sequential IO for localizing files. >

[jira] [Updated] (YARN-10444) use openFile() with sequential IO for localizing files.

2020-09-18 Thread Steve Loughran (Jira)
[ https://issues.apache.org/jira/browse/YARN-10444?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran updated YARN-10444: -- Environment: (was: echo set the office to blue scene) > use openFile() with sequential IO

[jira] [Commented] (YARN-10396) Max applications calculation per queue disregards queue level settings in absolute mode

2020-08-20 Thread Steve Loughran (Jira)
[ https://issues.apache.org/jira/browse/YARN-10396?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17181268#comment-17181268 ] Steve Loughran commented on YARN-10396: --- thanks. If its just a test case, that's easier to fix >

[jira] [Commented] (YARN-10396) Max applications calculation per queue disregards queue level settings in absolute mode

2020-08-20 Thread Steve Loughran (Jira)
[ https://issues.apache.org/jira/browse/YARN-10396?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17181187#comment-17181187 ] Steve Loughran commented on YARN-10396: --- [~sunilg] This stops branch-3.2 (and presumably 3.1) from

[jira] [Commented] (YARN-10382) Non-secure yarn access secure hdfs

2020-08-10 Thread Steve Loughran (Jira)
[ https://issues.apache.org/jira/browse/YARN-10382?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17174253#comment-17174253 ] Steve Loughran commented on YARN-10382: --- Problem there is that the code wants to know who the YARN

[jira] [Resolved] (YARN-10289) spark on yarn execption

2020-06-01 Thread Steve Loughran (Jira)
[ https://issues.apache.org/jira/browse/YARN-10289?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran resolved YARN-10289. --- Resolution: Invalid > spark on yarn execption > > >

[jira] [Commented] (YARN-10289) spark on yarn execption

2020-06-01 Thread Steve Loughran (Jira)
[ https://issues.apache.org/jira/browse/YARN-10289?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17121009#comment-17121009 ] Steve Loughran commented on YARN-10289: --- # looks more like a spark error. # And a config one. So

[jira] [Commented] (YARN-5277) when localizers fail due to resource timestamps being out, provide more diagnostics

2020-04-07 Thread Steve Loughran (Jira)
[ https://issues.apache.org/jira/browse/YARN-5277?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17077232#comment-17077232 ] Steve Loughran commented on YARN-5277: -- can you submit this as a github PR so I can review it there?

[jira] [Updated] (YARN-9696) unused import in Configuration class

2020-02-11 Thread Steve Loughran (Jira)
[ https://issues.apache.org/jira/browse/YARN-9696?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran updated YARN-9696: - Summary: unused import in Configuration class (was: one more import in

[jira] [Commented] (YARN-9552) FairScheduler: NODE_UPDATE can cause NoSuchElementException

2019-10-09 Thread Steve Loughran (Jira)
[ https://issues.apache.org/jira/browse/YARN-9552?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16947857#comment-16947857 ] Steve Loughran commented on YARN-9552: -- trunk and branch-3.2 doesn't build; this looks suspiciously

[jira] [Commented] (YARN-9839) NodeManager java.lang.OutOfMemoryError unable to create new native thread

2019-09-19 Thread Steve Loughran (Jira)
[ https://issues.apache.org/jira/browse/YARN-9839?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16933262#comment-16933262 ] Steve Loughran commented on YARN-9839: -- FYI, I'm adding some tests in HADOOP-16570 which verify that

[jira] [Commented] (YARN-9783) Remove low-level zookeeper test to be able to build Hadoop against zookeeper 3.5.5

2019-08-26 Thread Steve Loughran (Jira)
[ https://issues.apache.org/jira/browse/YARN-9783?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16915812#comment-16915812 ] Steve Loughran commented on YARN-9783: -- cut it > Remove low-level zookeeper test to be able to build

[jira] [Commented] (YARN-9724) ERROR SparkContext: Error initializing SparkContext.

2019-08-06 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9724?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16901360#comment-16901360 ] Steve Loughran commented on YARN-9724: -- looking @ the spark side of things, it's coming from the

[jira] [Commented] (YARN-9646) Yarn miniYarn cluster tests failed to bind to a local host name

2019-07-10 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9646?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16881899#comment-16881899 ] Steve Loughran commented on YARN-9646: -- I don't have any concerns, just am not going to give a vote

[jira] [Commented] (YARN-9646) Yarn miniYarn cluster tests failed to bind to a local host name

2019-06-25 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9646?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16872218#comment-16872218 ] Steve Loughran commented on YARN-9646: -- I'd try that. If you look @ the edit history of the wiki page

[jira] [Commented] (YARN-9646) Yarn miniYarn cluster tests failed to bind to a local host name

2019-06-24 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9646?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16871824#comment-16871824 ] Steve Loughran commented on YARN-9646: -- what happens if you add a 127.0.0.1 entry for that FQDN in

[jira] [Commented] (YARN-9607) Auto-configuring rollover-size of IFile format for non-appendable filesystems

2019-06-19 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9607?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16867857#comment-16867857 ] Steve Loughran commented on YARN-9607: -- HADOOP-15691 proposes adding a new method,

[jira] [Commented] (YARN-9545) Create healthcheck REST endpoint for ATSv2

2019-06-12 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9545?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16862331#comment-16862331 ] Steve Loughran commented on YARN-9545: -- thanks > Create healthcheck REST endpoint for ATSv2 >

[jira] [Commented] (YARN-9545) Create healthcheck REST endpoint for ATSv2

2019-06-07 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9545?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16858826#comment-16858826 ] Steve Loughran commented on YARN-9545: -- I'm seeing ASF license errors on branch-3.2 runs from the

[jira] [Commented] (YARN-9525) IFile format is not working against s3a remote folder

2019-06-07 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9525?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16858565#comment-16858565 ] Steve Loughran commented on YARN-9525: -- thomas, HADOOP-13327 tries to nail down hflush/hsync; just

[jira] [Commented] (YARN-9525) IFile format is not working against s3a remote folder

2019-06-06 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9525?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16858004#comment-16858004 ] Steve Loughran commented on YARN-9525: -- bq. Have we tested the patch when rolling aggregation is

[jira] [Commented] (YARN-9525) IFile format is not working against s3a remote folder

2019-05-31 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9525?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16853254#comment-16853254 ] Steve Loughran commented on YARN-9525: -- I wonder if the -4 thing is due to the logic "if createdNew

[jira] [Commented] (YARN-9568) NPE in MiniYarnCluster during FileSystemNodeAttributeStore.recover

2019-05-21 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9568?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16844711#comment-16844711 ] Steve Loughran commented on YARN-9568: -- bq. For MiniYarnCluster we could configure the node

[jira] [Commented] (YARN-9568) NPE in MiniYarnCluster during FileSystemNodeAttributeStore.recover

2019-05-20 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9568?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16844227#comment-16844227 ] Steve Loughran commented on YARN-9568: -- Looking more at this looks like a bad assumption in the whole

[jira] [Commented] (YARN-7988) Refactor FSNodeLabelStore code for Node Attributes store support

2019-05-20 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7988?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16844226#comment-16844226 ] Steve Loughran commented on YARN-7988: -- Just traced down the cause of YARN-9568 to be ~this patch.

[jira] [Commented] (YARN-9568) NPE in MiniYarnCluster during FileSystemNodeAttributeStore.recover

2019-05-20 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9568?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16844223#comment-16844223 ] Steve Loughran commented on YARN-9568: -- I can make this "go away" by rm'ing everything in

[jira] [Updated] (YARN-9568) NPE in MiniYarnCluster during FileSystemNodeAttributeStore.recover

2019-05-20 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9568?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran updated YARN-9568: - Priority: Minor (was: Major) > NPE in MiniYarnCluster during

[jira] [Commented] (YARN-9568) NPE in MiniYarnCluster during FileSystemNodeAttributeStore.recover

2019-05-20 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9568?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16844201#comment-16844201 ] Steve Loughran commented on YARN-9568: -- attached full log > NPE in MiniYarnCluster during

[jira] [Updated] (YARN-9568) NPE in MiniYarnCluster during FileSystemNodeAttributeStore.recover

2019-05-20 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9568?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran updated YARN-9568: - Attachment: npe.log > NPE in MiniYarnCluster during FileSystemNodeAttributeStore.recover >

[jira] [Commented] (YARN-9568) NPE in MiniYarnCluster during FileSystemNodeAttributeStore.recover

2019-05-20 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9568?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16844138#comment-16844138 ] Steve Loughran commented on YARN-9568: -- {code}

[jira] [Created] (YARN-9568) NPE in MiniYarnCluster during FileSystemNodeAttributeStore.recover

2019-05-20 Thread Steve Loughran (JIRA)
Steve Loughran created YARN-9568: Summary: NPE in MiniYarnCluster during FileSystemNodeAttributeStore.recover Key: YARN-9568 URL: https://issues.apache.org/jira/browse/YARN-9568 Project: Hadoop YARN

[jira] [Resolved] (YARN-9534) TimelineV2ClientImpl.pollTimelineServiceAddress() throws a YarnException when it is interrupted

2019-05-07 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9534?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran resolved YARN-9534. -- Resolution: Won't Fix YarnException is an RTE and not declared on the entire hierarchy,

[jira] [Commented] (YARN-9525) TFile format is not working against s3a remote folder

2019-05-06 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9525?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16833749#comment-16833749 ] Steve Loughran commented on YARN-9525: -- this isn't eventual consistency: it is that the file doesn't

[jira] [Commented] (YARN-9470) Fix order of actual and expected expression in assert statements

2019-04-14 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9470?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16817542#comment-16817542 ] Steve Loughran commented on YARN-9470: -- AssertJ is already on the classpath for hdfs-test; no reason

[jira] [Commented] (YARN-999) In case of long running tasks, reduce node resource should balloon out resource quickly by calling preemption API and suspending running task.

2019-04-09 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/YARN-999?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16813745#comment-16813745 ] Steve Loughran commented on YARN-999: - no worries, gone back one commit locally > In case of long

[jira] [Reopened] (YARN-999) In case of long running tasks, reduce node resource should balloon out resource quickly by calling preemption API and suspending running task.

2019-04-09 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/YARN-999?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran reopened YARN-999: - > In case of long running tasks, reduce node resource should balloon out > resource quickly by

[jira] [Commented] (YARN-999) In case of long running tasks, reduce node resource should balloon out resource quickly by calling preemption API and suspending running task.

2019-04-09 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/YARN-999?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16813733#comment-16813733 ] Steve Loughran commented on YARN-999: - I think this has broken the build {code} [INFO]

[jira] [Deleted] (YARN-9422) Simon poortman

2019-03-28 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9422?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran deleted YARN-9422: - > Simon poortman > -- > > Key: YARN-9422 > URL:

[jira] [Commented] (YARN-7129) Application Catalog for YARN applications

2019-03-25 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7129?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16800851#comment-16800851 ] Steve Loughran commented on YARN-7129: -- if the font has been moved to an artifact download, I'm

[jira] [Commented] (YARN-7129) Application Catalog for YARN applications

2019-03-21 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7129?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16798582#comment-16798582 ] Steve Loughran commented on YARN-7129: -- * versions of artifacts in the webapp pom should be taken

[jira] [Updated] (YARN-4435) Add RM Delegation Token DtFetcher Implementation for DtUtil

2019-03-20 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4435?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran updated YARN-4435: - Attachment: YARN-4435-003.patch > Add RM Delegation Token DtFetcher Implementation for DtUtil >

[jira] [Moved] (YARN-9377) docker builds having problems with main/native/container-executor/test/

2019-03-11 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9377?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran moved HADOOP-16123 to YARN-9377: --- Affects Version/s: (was: 3.3.0) 3.3.0

[jira] [Commented] (YARN-9348) Build issues on hadoop-yarn-application-catalog-webapp

2019-03-06 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9348?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16786042#comment-16786042 ] Steve Loughran commented on YARN-9348: -- bq. Building on mac will trigger access to osx keychain to

[jira] [Commented] (YARN-7129) Application Catalog for YARN applications

2019-03-06 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7129?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16785470#comment-16785470 ] Steve Loughran commented on YARN-7129: -- this is doing odd things to builds. e.g the latest

[jira] [Moved] (YARN-9241) Remove if else block from RmController.java

2019-01-27 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9241?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran moved HADOOP-16070 to YARN-9241: --- Affects Version/s: (was: 3.1.1) (was:

[jira] [Commented] (YARN-9241) Remove if else block from RmController.java

2019-01-27 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9241?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16753481#comment-16753481 ] Steve Loughran commented on YARN-9241: -- Moved to YARN project; recommend changing title to be more

[jira] [Commented] (YARN-9148) AggregatedLogDeletion doesnt work with S3

2019-01-14 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9148?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16742057#comment-16742057 ] Steve Loughran commented on YARN-9148: -- If there's an existing one for real filesystems, stick with

[jira] [Commented] (YARN-9148) AggregatedLogDeletion doesnt work with S3

2019-01-14 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9148?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16741951#comment-16741951 ] Steve Loughran commented on YARN-9148: -- General * newline betwee import java. and org.apache.

[jira] [Commented] (YARN-9148) AggregatedLogDeletion doesnt work with S3

2019-01-11 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9148?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16740617#comment-16740617 ] Steve Loughran commented on YARN-9148: -- Will this dir ever have subdirectories? Probably better to

[jira] [Commented] (YARN-9148) AggregatedLogDeletion doesnt work with S3

2019-01-02 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9148?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16732362#comment-16732362 ] Steve Loughran commented on YARN-9148: -- that's because directories don't actually exist: something

[jira] [Created] (YARN-9109) DelegationTokenRenewer not resilient to token classload problems

2018-12-11 Thread Steve Loughran (JIRA)
Steve Loughran created YARN-9109: Summary: DelegationTokenRenewer not resilient to token classload problems Key: YARN-9109 URL: https://issues.apache.org/jira/browse/YARN-9109 Project: Hadoop YARN

[jira] [Commented] (YARN-9109) DelegationTokenRenewer not resilient to token classload problems

2018-12-11 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9109?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16718016#comment-16718016 ] Steve Loughran commented on YARN-9109: -- Server {code} 2018-12-11 16:32:17,429 [main] ERROR

[jira] [Commented] (YARN-9057) CSI jar file should not bundle third party dependencies

2018-12-04 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9057?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16708496#comment-16708496 ] Steve Loughran commented on YARN-9057: -- bq. it it seems to create more problems than the ones it

[jira] [Updated] (YARN-9057) CSI jar file should not bundle third party dependencies

2018-12-03 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9057?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran updated YARN-9057: - Priority: Blocker (was: Major) > CSI jar file should not bundle third party dependencies >

[jira] [Commented] (YARN-9057) CSI jar file should not bundle third party dependencies

2018-12-03 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9057?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16707513#comment-16707513 ] Steve Loughran commented on YARN-9057: -- FWIW I'm not rebasing any of my ongoing work onto trunk until

[jira] [Updated] (YARN-9057) CSI jar file should not bundle third party dependencies

2018-12-03 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9057?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran updated YARN-9057: - Affects Version/s: 3.3.0 > CSI jar file should not bundle third party dependencies >

[jira] [Updated] (YARN-9057) CSI jar file should not bundle third party dependencies

2018-12-03 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9057?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran updated YARN-9057: - Component/s: build > CSI jar file should not bundle third party dependencies >

[jira] [Commented] (YARN-9057) CSI jar file should not bundle third party dependencies

2018-12-03 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9057?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16707508#comment-16707508 ] Steve Loughran commented on YARN-9057: -- I agree. The shaded JAR must be a secondary -shaded artifact

[jira] [Commented] (YARN-8953) [CSI] CSI driver adaptor module support in NodeManager

2018-12-03 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8953?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16707506#comment-16707506 ] Steve Loughran commented on YARN-8953: -- This is killing my latest trunk builds because the

[jira] [Commented] (YARN-4435) Add RM Delegation Token DtFetcher Implementation for DtUtil

2018-11-27 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4435?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16700670#comment-16700670 ] Steve Loughran commented on YARN-4435: -- Now I'm working with DTs more I'm in a better place to review

[jira] [Resolved] (YARN-4721) RM to try to auth with HDFS on startup, retry with max diagnostics on failure

2018-11-27 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4721?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran resolved YARN-4721. -- Resolution: Won't Fix Given up on this for now. If someone wants to take over -go for it > RM

[jira] [Resolved] (YARN-2657) MiniYARNCluster to (optionally) add MicroZookeeper service

2018-11-27 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2657?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran resolved YARN-2657. -- Resolution: Won't Fix been so long since I submitted this patch I'd forgotten I'd done it.

[jira] [Assigned] (YARN-2646) distributed shell & tests to use registry

2018-11-27 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2646?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran reassigned YARN-2646: Assignee: (was: Steve Loughran) > distributed shell & tests to use registry >

[jira] [Commented] (YARN-7747) YARN UI is broken in the minicluster

2018-10-08 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7747?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16641818#comment-16641818 ] Steve Loughran commented on YARN-7747: -- bq. Steve Loughran we definitely need tests to prevent this

[jira] [Commented] (YARN-7747) YARN UI is broken in the minicluster

2018-10-03 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7747?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16637567#comment-16637567 ] Steve Loughran commented on YARN-7747: -- * is there a way to get that UI URL back? If it's not there

[jira] [Commented] (YARN-8338) TimelineService V1.5 doesn't come up after HADOOP-15406

2018-06-15 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8338?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16514105#comment-16514105 ] Steve Loughran commented on YARN-8338: -- BTW, maven shading on the hadoop minicluster is now

[jira] [Commented] (YARN-8338) TimelineService V1.5 doesn't come up after HADOOP-15406

2018-05-26 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8338?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16491657#comment-16491657 ] Steve Loughran commented on YARN-8338: -- no, let's declare the use of the one in use up until now, and

[jira] [Commented] (YARN-8338) TimelineService V1.5 doesn't come up after HADOOP-15406

2018-05-24 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8338?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16488742#comment-16488742 ] Steve Loughran commented on YARN-8338: -- {code} +-org.apache.hadoop:hadoop-aws:3.1.1-SNAPSHOT

[jira] [Assigned] (YARN-5306) Yarn should detect and fail fast on duplicate resources in container request

2018-04-16 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5306?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran reassigned YARN-5306: Assignee: (was: Junping Du) > Yarn should detect and fail fast on duplicate resources

[jira] [Commented] (YARN-8053) Add hadoop-distcp in exclusion in hbase-server dependencies for timelineservice-hbase packages.

2018-03-23 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8053?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16412001#comment-16412001 ] Steve Loughran commented on YARN-8053: -- we have a loop. Hadoop depends on HBase, HBase depends on

[jira] [Commented] (YARN-8053) Add hadoop-distcp in exclusion in hbase-server dependencies for timelineservice-hbase packages.

2018-03-23 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8053?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16411374#comment-16411374 ] Steve Loughran commented on YARN-8053: -- we seem to be suffering a losing battle by attempting to pull

[jira] [Commented] (YARN-6136) YARN registry service should avoid scanning whole ZK tree for every container/application finish

2018-03-07 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6136?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16389632#comment-16389632 ] Steve Loughran commented on YARN-6136: -- It's just trying to do a cleanup at the end, no matter how

[jira] [Commented] (YARN-7346) Add a profile to compile ATSv2 with HBase-2.0

2018-03-01 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7346?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16381885#comment-16381885 ] Steve Loughran commented on YARN-7346: -- I am really excited about this if it lets us move off Guava 11

[jira] [Commented] (YARN-2127) Move YarnUncaughtExceptionHandler into Hadoop common

2017-08-17 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2127?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16130221#comment-16130221 ] Steve Loughran commented on YARN-2127: -- This is an old patch. Yes, the Yarn one has been effectively

[jira] [Updated] (YARN-2571) RM to support YARN registry

2017-07-12 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2571?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran updated YARN-2571: - Attachment: YARN-2571-017.patch Patch 017, sync up with trunk Can I observe that this patch is

[jira] [Commented] (YARN-679) add an entry point that can start any Yarn service

2017-04-24 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/YARN-679?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15981332#comment-15981332 ] Steve Loughran commented on YARN-679: - [~templedf] bq. Signalled" is misspelled several times. Should

[jira] [Commented] (YARN-679) add an entry point that can start any Yarn service

2017-04-22 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/YARN-679?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15979867#comment-15979867 ] Steve Loughran commented on YARN-679: - You know, if people want to see this @ work, I could back this up

[jira] [Commented] (YARN-679) add an entry point that can start any Yarn service

2017-04-22 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/YARN-679?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15979865#comment-15979865 ] Steve Loughran commented on YARN-679: - javac warnings are all about use of Signal in IrqHandler. This is

[jira] [Updated] (YARN-679) add an entry point that can start any Yarn service

2017-04-21 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/YARN-679?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran updated YARN-679: Attachment: YARN-679-013.patch Finally had time to sit down & go through all the review. Thanks dan!

[jira] [Commented] (YARN-6414) ATSv2 tests fail due to guava version upgrade

2017-04-01 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6414?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15952196#comment-15952196 ] Steve Loughran commented on YARN-6414: -- * test wise, it shows that actually the JAR update process

[jira] [Updated] (YARN-6330) DefaultContainerExecutor container launch fails if script dest dir has a space in the path

2017-03-13 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6330?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran updated YARN-6330: - Environment: osx; no setsid command > DefaultContainerExecutor container launch fails if script

[jira] [Updated] (YARN-6330) DefaultContainerExecutor container launch fails if script dest dir has a space in the path

2017-03-13 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6330?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran updated YARN-6330: - Attachment: YARN-6330-001.patch patch 001. Doesn't fix it completely; stops the two patched

[jira] [Created] (YARN-6330) DefaultContainerExecutor container launch fails if script dest dir has a space in the path

2017-03-13 Thread Steve Loughran (JIRA)
Steve Loughran created YARN-6330: Summary: DefaultContainerExecutor container launch fails if script dest dir has a space in the path Key: YARN-6330 URL: https://issues.apache.org/jira/browse/YARN-6330

[jira] [Updated] (YARN-2031) YARN Proxy model doesn't support REST APIs in AMs

2017-03-10 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2031?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran updated YARN-2031: - Attachment: YARN-2031-005.patch Patch 005; patch 004 in sync with trunk, some minor review of

[jira] [Commented] (YARN-2031) YARN Proxy model doesn't support REST APIs in AMs

2017-03-10 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2031?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15904974#comment-15904974 ] Steve Loughran commented on YARN-2031: -- well, yes, it's still an issue. YARN doesn't proxy anything

[jira] [Commented] (YARN-4330) MiniYARNCluster is showing multiple Failed to instantiate default resource calculator warning messages.

2016-12-13 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4330?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15746043#comment-15746043 ] Steve Loughran commented on YARN-4330: -- lets just go for 2.9; its an irritant in 2.8, but not much

[jira] [Updated] (YARN-5989) hadoop build to allow hadoop version property to be explicitly set (YARN test)

2016-12-09 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5989?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran updated YARN-5989: - Attachment: HADOOP-13582-003.patch > hadoop build to allow hadoop version property to be

[jira] [Updated] (YARN-5989) hadoop build to allow hadoop version property to be explicitly set (YARN test)

2016-12-09 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5989?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran updated YARN-5989: - Priority: Minor (was: Major) > hadoop build to allow hadoop version property to be explicitly set

[jira] [Created] (YARN-5989) hadoop build to allow hadoop version property to be explicitly set (YARN test)

2016-12-09 Thread Steve Loughran (JIRA)
Steve Loughran created YARN-5989: Summary: hadoop build to allow hadoop version property to be explicitly set (YARN test) Key: YARN-5989 URL: https://issues.apache.org/jira/browse/YARN-5989 Project:

[jira] [Commented] (YARN-5934) Fix TestTimelineWebServices.testPrimaryFilterNumericString

2016-12-03 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5934?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15717993#comment-15717993 ] Steve Loughran commented on YARN-5934: -- is this just the test changing, or the actual behaviour of the

[jira] [Commented] (YARN-3477) TimelineClientImpl swallows exceptions

2016-12-02 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3477?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15714879#comment-15714879 ] Steve Loughran commented on YARN-3477: -- sorry, missed this. I've closed the PR, and have resubmitted

[jira] [Updated] (YARN-3477) TimelineClientImpl swallows exceptions

2016-12-02 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3477?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran updated YARN-3477: - Attachment: YARN-3477-trunk.004.patch repost patch 4 for YARN to kick off (maybe) >

[jira] [Updated] (YARN-4435) Add RM Delegation Token DtFetcher Implementation for DtUtil

2016-11-24 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4435?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran updated YARN-4435: - Attachment: YARN-4435-003.patch patch 003; finishing up this patch with my suggested changes *

[jira] [Commented] (YARN-5926) clean up registry code for java 7/8

2016-11-22 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5926?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15687370#comment-15687370 ] Steve Loughran commented on YARN-5926: -- [~ajisakaa] this is part of the registry cleanup; javadoc

[jira] [Updated] (YARN-5926) clean up registry code for java 7/8

2016-11-22 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5926?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran updated YARN-5926: - Attachment: YARN-5926-001.patch Patch 001; cleanup. This is the yarn-registry code from patch 016

  1   2   3   4   5   6   7   8   9   10   >