[jira] [Commented] (YARN-3812) TestRollingLevelDBTimelineStore fails in trunk due to HADOOP-11347
[
https://issues.apache.org/jira/browse/YARN-3812?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14590893#comment-14590893
]
Colin Patrick McCabe commented on YARN-3812:
bq. Yes, ImmutableFsPermission should not be overriding applyUMask since the
method does not actually mutate the object. readFields does mutate and
therefore is appropriate for preventing invocation for constant objects.
I agree. It seems that {{FsPermission#ImmutablePermission}} is incorrectly
overriding {{FsPermission#applyUMask}}. There is no reason to override this
method since it doesn't modify the {{FsPermission}}. The right fix should be
to simply stop overriding that method. Do you want to move the JIRA over to
Hadoop-common and post a patch for that?
TestRollingLevelDBTimelineStore fails in trunk due to HADOOP-11347
--
Key: YARN-3812
URL: https://issues.apache.org/jira/browse/YARN-3812
Project: Hadoop YARN
Issue Type: Bug
Components: test
Affects Versions: 3.0.0
Reporter: Robert Kanter
Assignee: Bibin A Chundatt
Attachments: 0001-YARN-3812.patch
{{TestRollingLevelDBTimelineStore}} is failing with the below errors in
trunk. I did a git bisect and found that it was due to HADOOP-11347, which
changed something with umasks in {{FsPermission}}.
{noformat}
Running org.apache.hadoop.yarn.server.timeline.TestRollingLevelDBTimelineStore
Tests run: 16, Failures: 0, Errors: 16, Skipped: 0, Time elapsed: 2.65 sec
FAILURE! - in
org.apache.hadoop.yarn.server.timeline.TestRollingLevelDBTimelineStore
testGetDomains(org.apache.hadoop.yarn.server.timeline.TestRollingLevelDBTimelineStore)
Time elapsed: 1.533 sec ERROR!
java.lang.UnsupportedOperationException: null
at
org.apache.hadoop.fs.permission.FsPermission$ImmutableFsPermission.applyUMask(FsPermission.java:380)
at
org.apache.hadoop.fs.RawLocalFileSystem.mkOneDirWithMode(RawLocalFileSystem.java:496)
at
org.apache.hadoop.fs.RawLocalFileSystem.mkdirsWithOptionalPermission(RawLocalFileSystem.java:551)
at
org.apache.hadoop.fs.RawLocalFileSystem.mkdirs(RawLocalFileSystem.java:529)
at
org.apache.hadoop.fs.FilterFileSystem.mkdirs(FilterFileSystem.java:314)
at
org.apache.hadoop.yarn.server.timeline.RollingLevelDB.initFileSystem(RollingLevelDB.java:207)
at
org.apache.hadoop.yarn.server.timeline.RollingLevelDB.init(RollingLevelDB.java:200)
at
org.apache.hadoop.yarn.server.timeline.RollingLevelDBTimelineStore.serviceInit(RollingLevelDBTimelineStore.java:321)
at
org.apache.hadoop.service.AbstractService.init(AbstractService.java:163)
at
org.apache.hadoop.yarn.server.timeline.TestRollingLevelDBTimelineStore.setup(TestRollingLevelDBTimelineStore.java:65)
testRelatingToNonExistingEntity(org.apache.hadoop.yarn.server.timeline.TestRollingLevelDBTimelineStore)
Time elapsed: 0.085 sec ERROR!
java.lang.UnsupportedOperationException: null
at
org.apache.hadoop.fs.permission.FsPermission$ImmutableFsPermission.applyUMask(FsPermission.java:380)
at
org.apache.hadoop.fs.RawLocalFileSystem.mkOneDirWithMode(RawLocalFileSystem.java:496)
at
org.apache.hadoop.fs.RawLocalFileSystem.mkdirsWithOptionalPermission(RawLocalFileSystem.java:551)
at
org.apache.hadoop.fs.RawLocalFileSystem.mkdirs(RawLocalFileSystem.java:529)
at
org.apache.hadoop.fs.FilterFileSystem.mkdirs(FilterFileSystem.java:314)
at
org.apache.hadoop.yarn.server.timeline.RollingLevelDB.initFileSystem(RollingLevelDB.java:207)
at
org.apache.hadoop.yarn.server.timeline.RollingLevelDB.init(RollingLevelDB.java:200)
at
org.apache.hadoop.yarn.server.timeline.RollingLevelDBTimelineStore.serviceInit(RollingLevelDBTimelineStore.java:321)
at
org.apache.hadoop.service.AbstractService.init(AbstractService.java:163)
at
org.apache.hadoop.yarn.server.timeline.TestRollingLevelDBTimelineStore.setup(TestRollingLevelDBTimelineStore.java:65)
testValidateConfig(org.apache.hadoop.yarn.server.timeline.TestRollingLevelDBTimelineStore)
Time elapsed: 0.07 sec ERROR!
java.lang.UnsupportedOperationException: null
at
org.apache.hadoop.fs.permission.FsPermission$ImmutableFsPermission.applyUMask(FsPermission.java:380)
at
org.apache.hadoop.fs.RawLocalFileSystem.mkOneDirWithMode(RawLocalFileSystem.java:496)
at
org.apache.hadoop.fs.RawLocalFileSystem.mkdirsWithOptionalPermission(RawLocalFileSystem.java:551)
at
org.apache.hadoop.fs.RawLocalFileSystem.mkdirs(RawLocalFileSystem.java:529)
at
org.apache.hadoop.fs.FilterFileSystem.mkdirs(FilterFileSystem.java:314)
at
org.apache.hadoop.yarn.server.timeline.RollingLevelDB.initFileSystem(RollingLevelDB.java:207)
at
[jira] [Commented] (YARN-3812) TestRollingLevelDBTimelineStore fails in trunk due to HADOOP-11347
[
https://issues.apache.org/jira/browse/YARN-3812?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14589878#comment-14589878
]
Jason Lowe commented on YARN-3812:
--
I don't think this is the correct fix. RollingLevelDBTimelineStore is using an
immutable permission to specify the umask. If the proposed fix is to make it
mutable, then that implies we're allowing a constant to be modified by the
filesystem. If this permission were passed to multiple subsystems, having it
magically mutate by one subsystem using it is probably not the correct approach.
Instead it appears to be a problem with ImmutableFsPermission. It prevents
applyUmask from being invoked, but in reality applyUmask does not modify the
permission object -- it returns a new permission object instead. Therefore I
think the real bug is that ImmutableFsPermission is preventing applyUmask from
being invoked.
TestRollingLevelDBTimelineStore fails in trunk due to HADOOP-11347
--
Key: YARN-3812
URL: https://issues.apache.org/jira/browse/YARN-3812
Project: Hadoop YARN
Issue Type: Bug
Components: test
Affects Versions: 3.0.0
Reporter: Robert Kanter
Assignee: Bibin A Chundatt
Attachments: 0001-YARN-3812.patch
{{TestRollingLevelDBTimelineStore}} is failing with the below errors in
trunk. I did a git bisect and found that it was due to HADOOP-11347, which
changed something with umasks in {{FsPermission}}.
{noformat}
Running org.apache.hadoop.yarn.server.timeline.TestRollingLevelDBTimelineStore
Tests run: 16, Failures: 0, Errors: 16, Skipped: 0, Time elapsed: 2.65 sec
FAILURE! - in
org.apache.hadoop.yarn.server.timeline.TestRollingLevelDBTimelineStore
testGetDomains(org.apache.hadoop.yarn.server.timeline.TestRollingLevelDBTimelineStore)
Time elapsed: 1.533 sec ERROR!
java.lang.UnsupportedOperationException: null
at
org.apache.hadoop.fs.permission.FsPermission$ImmutableFsPermission.applyUMask(FsPermission.java:380)
at
org.apache.hadoop.fs.RawLocalFileSystem.mkOneDirWithMode(RawLocalFileSystem.java:496)
at
org.apache.hadoop.fs.RawLocalFileSystem.mkdirsWithOptionalPermission(RawLocalFileSystem.java:551)
at
org.apache.hadoop.fs.RawLocalFileSystem.mkdirs(RawLocalFileSystem.java:529)
at
org.apache.hadoop.fs.FilterFileSystem.mkdirs(FilterFileSystem.java:314)
at
org.apache.hadoop.yarn.server.timeline.RollingLevelDB.initFileSystem(RollingLevelDB.java:207)
at
org.apache.hadoop.yarn.server.timeline.RollingLevelDB.init(RollingLevelDB.java:200)
at
org.apache.hadoop.yarn.server.timeline.RollingLevelDBTimelineStore.serviceInit(RollingLevelDBTimelineStore.java:321)
at
org.apache.hadoop.service.AbstractService.init(AbstractService.java:163)
at
org.apache.hadoop.yarn.server.timeline.TestRollingLevelDBTimelineStore.setup(TestRollingLevelDBTimelineStore.java:65)
testRelatingToNonExistingEntity(org.apache.hadoop.yarn.server.timeline.TestRollingLevelDBTimelineStore)
Time elapsed: 0.085 sec ERROR!
java.lang.UnsupportedOperationException: null
at
org.apache.hadoop.fs.permission.FsPermission$ImmutableFsPermission.applyUMask(FsPermission.java:380)
at
org.apache.hadoop.fs.RawLocalFileSystem.mkOneDirWithMode(RawLocalFileSystem.java:496)
at
org.apache.hadoop.fs.RawLocalFileSystem.mkdirsWithOptionalPermission(RawLocalFileSystem.java:551)
at
org.apache.hadoop.fs.RawLocalFileSystem.mkdirs(RawLocalFileSystem.java:529)
at
org.apache.hadoop.fs.FilterFileSystem.mkdirs(FilterFileSystem.java:314)
at
org.apache.hadoop.yarn.server.timeline.RollingLevelDB.initFileSystem(RollingLevelDB.java:207)
at
org.apache.hadoop.yarn.server.timeline.RollingLevelDB.init(RollingLevelDB.java:200)
at
org.apache.hadoop.yarn.server.timeline.RollingLevelDBTimelineStore.serviceInit(RollingLevelDBTimelineStore.java:321)
at
org.apache.hadoop.service.AbstractService.init(AbstractService.java:163)
at
org.apache.hadoop.yarn.server.timeline.TestRollingLevelDBTimelineStore.setup(TestRollingLevelDBTimelineStore.java:65)
testValidateConfig(org.apache.hadoop.yarn.server.timeline.TestRollingLevelDBTimelineStore)
Time elapsed: 0.07 sec ERROR!
java.lang.UnsupportedOperationException: null
at
org.apache.hadoop.fs.permission.FsPermission$ImmutableFsPermission.applyUMask(FsPermission.java:380)
at
org.apache.hadoop.fs.RawLocalFileSystem.mkOneDirWithMode(RawLocalFileSystem.java:496)
at
org.apache.hadoop.fs.RawLocalFileSystem.mkdirsWithOptionalPermission(RawLocalFileSystem.java:551)
at
org.apache.hadoop.fs.RawLocalFileSystem.mkdirs(RawLocalFileSystem.java:529)
at
[jira] [Commented] (YARN-3812) TestRollingLevelDBTimelineStore fails in trunk due to HADOOP-11347
[
https://issues.apache.org/jira/browse/YARN-3812?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14589948#comment-14589948
]
Bibin A Chundatt commented on YARN-3812:
[~jlowe] Thnks for the review. Currently the
{{ImmutableFsPermission#applyUMask}} is unsupported and was causing the
failure. So as i understand the you would like the have implementation change
for {{applyUmask}} in {{ImmutableFsPermission}}
{code}
private static class ImmutableFsPermission extends FsPermission {
public ImmutableFsPermission(short permission) {
super(permission);
}
@Override
public FsPermission applyUMask(FsPermission umask) {
throw new UnsupportedOperationException();
}
@Override
public void readFields(DataInput in) throws IOException {
throw new UnsupportedOperationException();
}
}
}
{code}
removed the overriding of the same ? Any suggestion ?
Also [~varun_saxena] any comments one the same?
TestRollingLevelDBTimelineStore fails in trunk due to HADOOP-11347
--
Key: YARN-3812
URL: https://issues.apache.org/jira/browse/YARN-3812
Project: Hadoop YARN
Issue Type: Bug
Components: test
Affects Versions: 3.0.0
Reporter: Robert Kanter
Assignee: Bibin A Chundatt
Attachments: 0001-YARN-3812.patch
{{TestRollingLevelDBTimelineStore}} is failing with the below errors in
trunk. I did a git bisect and found that it was due to HADOOP-11347, which
changed something with umasks in {{FsPermission}}.
{noformat}
Running org.apache.hadoop.yarn.server.timeline.TestRollingLevelDBTimelineStore
Tests run: 16, Failures: 0, Errors: 16, Skipped: 0, Time elapsed: 2.65 sec
FAILURE! - in
org.apache.hadoop.yarn.server.timeline.TestRollingLevelDBTimelineStore
testGetDomains(org.apache.hadoop.yarn.server.timeline.TestRollingLevelDBTimelineStore)
Time elapsed: 1.533 sec ERROR!
java.lang.UnsupportedOperationException: null
at
org.apache.hadoop.fs.permission.FsPermission$ImmutableFsPermission.applyUMask(FsPermission.java:380)
at
org.apache.hadoop.fs.RawLocalFileSystem.mkOneDirWithMode(RawLocalFileSystem.java:496)
at
org.apache.hadoop.fs.RawLocalFileSystem.mkdirsWithOptionalPermission(RawLocalFileSystem.java:551)
at
org.apache.hadoop.fs.RawLocalFileSystem.mkdirs(RawLocalFileSystem.java:529)
at
org.apache.hadoop.fs.FilterFileSystem.mkdirs(FilterFileSystem.java:314)
at
org.apache.hadoop.yarn.server.timeline.RollingLevelDB.initFileSystem(RollingLevelDB.java:207)
at
org.apache.hadoop.yarn.server.timeline.RollingLevelDB.init(RollingLevelDB.java:200)
at
org.apache.hadoop.yarn.server.timeline.RollingLevelDBTimelineStore.serviceInit(RollingLevelDBTimelineStore.java:321)
at
org.apache.hadoop.service.AbstractService.init(AbstractService.java:163)
at
org.apache.hadoop.yarn.server.timeline.TestRollingLevelDBTimelineStore.setup(TestRollingLevelDBTimelineStore.java:65)
testRelatingToNonExistingEntity(org.apache.hadoop.yarn.server.timeline.TestRollingLevelDBTimelineStore)
Time elapsed: 0.085 sec ERROR!
java.lang.UnsupportedOperationException: null
at
org.apache.hadoop.fs.permission.FsPermission$ImmutableFsPermission.applyUMask(FsPermission.java:380)
at
org.apache.hadoop.fs.RawLocalFileSystem.mkOneDirWithMode(RawLocalFileSystem.java:496)
at
org.apache.hadoop.fs.RawLocalFileSystem.mkdirsWithOptionalPermission(RawLocalFileSystem.java:551)
at
org.apache.hadoop.fs.RawLocalFileSystem.mkdirs(RawLocalFileSystem.java:529)
at
org.apache.hadoop.fs.FilterFileSystem.mkdirs(FilterFileSystem.java:314)
at
org.apache.hadoop.yarn.server.timeline.RollingLevelDB.initFileSystem(RollingLevelDB.java:207)
at
org.apache.hadoop.yarn.server.timeline.RollingLevelDB.init(RollingLevelDB.java:200)
at
org.apache.hadoop.yarn.server.timeline.RollingLevelDBTimelineStore.serviceInit(RollingLevelDBTimelineStore.java:321)
at
org.apache.hadoop.service.AbstractService.init(AbstractService.java:163)
at
org.apache.hadoop.yarn.server.timeline.TestRollingLevelDBTimelineStore.setup(TestRollingLevelDBTimelineStore.java:65)
testValidateConfig(org.apache.hadoop.yarn.server.timeline.TestRollingLevelDBTimelineStore)
Time elapsed: 0.07 sec ERROR!
java.lang.UnsupportedOperationException: null
at
org.apache.hadoop.fs.permission.FsPermission$ImmutableFsPermission.applyUMask(FsPermission.java:380)
at
org.apache.hadoop.fs.RawLocalFileSystem.mkOneDirWithMode(RawLocalFileSystem.java:496)
at
org.apache.hadoop.fs.RawLocalFileSystem.mkdirsWithOptionalPermission(RawLocalFileSystem.java:551)
at
org.apache.hadoop.fs.RawLocalFileSystem.mkdirs(RawLocalFileSystem.java:529)
[jira] [Commented] (YARN-3812) TestRollingLevelDBTimelineStore fails in trunk due to HADOOP-11347
[
https://issues.apache.org/jira/browse/YARN-3812?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14589963#comment-14589963
]
Jason Lowe commented on YARN-3812:
--
Yes, ImmutableFsPermission should not be overriding applyUMask since the method
does not actually mutate the object. readFields does mutate and therefore is
appropriate for preventing invocation for constant objects.
The main point is that we shouldn't be blaming the client code and say it was
wrong to pass a constant permission object. If the filesystem can't handle
constant permissions being passed to it then it's a bug in the framework not
the client code.
TestRollingLevelDBTimelineStore fails in trunk due to HADOOP-11347
--
Key: YARN-3812
URL: https://issues.apache.org/jira/browse/YARN-3812
Project: Hadoop YARN
Issue Type: Bug
Components: test
Affects Versions: 3.0.0
Reporter: Robert Kanter
Assignee: Bibin A Chundatt
Attachments: 0001-YARN-3812.patch
{{TestRollingLevelDBTimelineStore}} is failing with the below errors in
trunk. I did a git bisect and found that it was due to HADOOP-11347, which
changed something with umasks in {{FsPermission}}.
{noformat}
Running org.apache.hadoop.yarn.server.timeline.TestRollingLevelDBTimelineStore
Tests run: 16, Failures: 0, Errors: 16, Skipped: 0, Time elapsed: 2.65 sec
FAILURE! - in
org.apache.hadoop.yarn.server.timeline.TestRollingLevelDBTimelineStore
testGetDomains(org.apache.hadoop.yarn.server.timeline.TestRollingLevelDBTimelineStore)
Time elapsed: 1.533 sec ERROR!
java.lang.UnsupportedOperationException: null
at
org.apache.hadoop.fs.permission.FsPermission$ImmutableFsPermission.applyUMask(FsPermission.java:380)
at
org.apache.hadoop.fs.RawLocalFileSystem.mkOneDirWithMode(RawLocalFileSystem.java:496)
at
org.apache.hadoop.fs.RawLocalFileSystem.mkdirsWithOptionalPermission(RawLocalFileSystem.java:551)
at
org.apache.hadoop.fs.RawLocalFileSystem.mkdirs(RawLocalFileSystem.java:529)
at
org.apache.hadoop.fs.FilterFileSystem.mkdirs(FilterFileSystem.java:314)
at
org.apache.hadoop.yarn.server.timeline.RollingLevelDB.initFileSystem(RollingLevelDB.java:207)
at
org.apache.hadoop.yarn.server.timeline.RollingLevelDB.init(RollingLevelDB.java:200)
at
org.apache.hadoop.yarn.server.timeline.RollingLevelDBTimelineStore.serviceInit(RollingLevelDBTimelineStore.java:321)
at
org.apache.hadoop.service.AbstractService.init(AbstractService.java:163)
at
org.apache.hadoop.yarn.server.timeline.TestRollingLevelDBTimelineStore.setup(TestRollingLevelDBTimelineStore.java:65)
testRelatingToNonExistingEntity(org.apache.hadoop.yarn.server.timeline.TestRollingLevelDBTimelineStore)
Time elapsed: 0.085 sec ERROR!
java.lang.UnsupportedOperationException: null
at
org.apache.hadoop.fs.permission.FsPermission$ImmutableFsPermission.applyUMask(FsPermission.java:380)
at
org.apache.hadoop.fs.RawLocalFileSystem.mkOneDirWithMode(RawLocalFileSystem.java:496)
at
org.apache.hadoop.fs.RawLocalFileSystem.mkdirsWithOptionalPermission(RawLocalFileSystem.java:551)
at
org.apache.hadoop.fs.RawLocalFileSystem.mkdirs(RawLocalFileSystem.java:529)
at
org.apache.hadoop.fs.FilterFileSystem.mkdirs(FilterFileSystem.java:314)
at
org.apache.hadoop.yarn.server.timeline.RollingLevelDB.initFileSystem(RollingLevelDB.java:207)
at
org.apache.hadoop.yarn.server.timeline.RollingLevelDB.init(RollingLevelDB.java:200)
at
org.apache.hadoop.yarn.server.timeline.RollingLevelDBTimelineStore.serviceInit(RollingLevelDBTimelineStore.java:321)
at
org.apache.hadoop.service.AbstractService.init(AbstractService.java:163)
at
org.apache.hadoop.yarn.server.timeline.TestRollingLevelDBTimelineStore.setup(TestRollingLevelDBTimelineStore.java:65)
testValidateConfig(org.apache.hadoop.yarn.server.timeline.TestRollingLevelDBTimelineStore)
Time elapsed: 0.07 sec ERROR!
java.lang.UnsupportedOperationException: null
at
org.apache.hadoop.fs.permission.FsPermission$ImmutableFsPermission.applyUMask(FsPermission.java:380)
at
org.apache.hadoop.fs.RawLocalFileSystem.mkOneDirWithMode(RawLocalFileSystem.java:496)
at
org.apache.hadoop.fs.RawLocalFileSystem.mkdirsWithOptionalPermission(RawLocalFileSystem.java:551)
at
org.apache.hadoop.fs.RawLocalFileSystem.mkdirs(RawLocalFileSystem.java:529)
at
org.apache.hadoop.fs.FilterFileSystem.mkdirs(FilterFileSystem.java:314)
at
org.apache.hadoop.yarn.server.timeline.RollingLevelDB.initFileSystem(RollingLevelDB.java:207)
at
org.apache.hadoop.yarn.server.timeline.RollingLevelDB.init(RollingLevelDB.java:200)
at
[jira] [Commented] (YARN-3812) TestRollingLevelDBTimelineStore fails in trunk due to HADOOP-11347
[
https://issues.apache.org/jira/browse/YARN-3812?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14589117#comment-14589117
]
Bibin A Chundatt commented on YARN-3812:
{{RawLocalFileSystem#mkOneDirWithMode}} applyUMask is failing. In
{{RollingLevelDBTimelineStore}}
{code}
static final FsPermission LEVELDB_DIR_UMASK = FsPermission
.createImmutable((short) 0700);
{code}
change to
{code}static final FsPermission LEVELDB_DIR_UMASK = new
FsPermission((short)0700);
{code}
will work. [~rkanter] can we change as above?? any comments ?
TestRollingLevelDBTimelineStore fails in trunk due to HADOOP-11347
--
Key: YARN-3812
URL: https://issues.apache.org/jira/browse/YARN-3812
Project: Hadoop YARN
Issue Type: Bug
Components: test
Affects Versions: 3.0.0
Reporter: Robert Kanter
{{TestRollingLevelDBTimelineStore}} is failing with the below errors in
trunk. I did a git bisect and found that it was due to HADOOP-11347, which
changed something with umasks in {{FsPermission}}.
{noformat}
Running org.apache.hadoop.yarn.server.timeline.TestRollingLevelDBTimelineStore
Tests run: 16, Failures: 0, Errors: 16, Skipped: 0, Time elapsed: 2.65 sec
FAILURE! - in
org.apache.hadoop.yarn.server.timeline.TestRollingLevelDBTimelineStore
testGetDomains(org.apache.hadoop.yarn.server.timeline.TestRollingLevelDBTimelineStore)
Time elapsed: 1.533 sec ERROR!
java.lang.UnsupportedOperationException: null
at
org.apache.hadoop.fs.permission.FsPermission$ImmutableFsPermission.applyUMask(FsPermission.java:380)
at
org.apache.hadoop.fs.RawLocalFileSystem.mkOneDirWithMode(RawLocalFileSystem.java:496)
at
org.apache.hadoop.fs.RawLocalFileSystem.mkdirsWithOptionalPermission(RawLocalFileSystem.java:551)
at
org.apache.hadoop.fs.RawLocalFileSystem.mkdirs(RawLocalFileSystem.java:529)
at
org.apache.hadoop.fs.FilterFileSystem.mkdirs(FilterFileSystem.java:314)
at
org.apache.hadoop.yarn.server.timeline.RollingLevelDB.initFileSystem(RollingLevelDB.java:207)
at
org.apache.hadoop.yarn.server.timeline.RollingLevelDB.init(RollingLevelDB.java:200)
at
org.apache.hadoop.yarn.server.timeline.RollingLevelDBTimelineStore.serviceInit(RollingLevelDBTimelineStore.java:321)
at
org.apache.hadoop.service.AbstractService.init(AbstractService.java:163)
at
org.apache.hadoop.yarn.server.timeline.TestRollingLevelDBTimelineStore.setup(TestRollingLevelDBTimelineStore.java:65)
testRelatingToNonExistingEntity(org.apache.hadoop.yarn.server.timeline.TestRollingLevelDBTimelineStore)
Time elapsed: 0.085 sec ERROR!
java.lang.UnsupportedOperationException: null
at
org.apache.hadoop.fs.permission.FsPermission$ImmutableFsPermission.applyUMask(FsPermission.java:380)
at
org.apache.hadoop.fs.RawLocalFileSystem.mkOneDirWithMode(RawLocalFileSystem.java:496)
at
org.apache.hadoop.fs.RawLocalFileSystem.mkdirsWithOptionalPermission(RawLocalFileSystem.java:551)
at
org.apache.hadoop.fs.RawLocalFileSystem.mkdirs(RawLocalFileSystem.java:529)
at
org.apache.hadoop.fs.FilterFileSystem.mkdirs(FilterFileSystem.java:314)
at
org.apache.hadoop.yarn.server.timeline.RollingLevelDB.initFileSystem(RollingLevelDB.java:207)
at
org.apache.hadoop.yarn.server.timeline.RollingLevelDB.init(RollingLevelDB.java:200)
at
org.apache.hadoop.yarn.server.timeline.RollingLevelDBTimelineStore.serviceInit(RollingLevelDBTimelineStore.java:321)
at
org.apache.hadoop.service.AbstractService.init(AbstractService.java:163)
at
org.apache.hadoop.yarn.server.timeline.TestRollingLevelDBTimelineStore.setup(TestRollingLevelDBTimelineStore.java:65)
testValidateConfig(org.apache.hadoop.yarn.server.timeline.TestRollingLevelDBTimelineStore)
Time elapsed: 0.07 sec ERROR!
java.lang.UnsupportedOperationException: null
at
org.apache.hadoop.fs.permission.FsPermission$ImmutableFsPermission.applyUMask(FsPermission.java:380)
at
org.apache.hadoop.fs.RawLocalFileSystem.mkOneDirWithMode(RawLocalFileSystem.java:496)
at
org.apache.hadoop.fs.RawLocalFileSystem.mkdirsWithOptionalPermission(RawLocalFileSystem.java:551)
at
org.apache.hadoop.fs.RawLocalFileSystem.mkdirs(RawLocalFileSystem.java:529)
at
org.apache.hadoop.fs.FilterFileSystem.mkdirs(FilterFileSystem.java:314)
at
org.apache.hadoop.yarn.server.timeline.RollingLevelDB.initFileSystem(RollingLevelDB.java:207)
at
org.apache.hadoop.yarn.server.timeline.RollingLevelDB.init(RollingLevelDB.java:200)
at
org.apache.hadoop.yarn.server.timeline.RollingLevelDBTimelineStore.serviceInit(RollingLevelDBTimelineStore.java:321)
at
[jira] [Commented] (YARN-3812) TestRollingLevelDBTimelineStore fails in trunk due to HADOOP-11347
[
https://issues.apache.org/jira/browse/YARN-3812?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14589121#comment-14589121
]
Robert Kanter commented on YARN-3812:
-
[~bibinchundatt], good find! That fixes the test. Would you like to assign
this JIRA to yourself and post a patch with the change?
TestRollingLevelDBTimelineStore fails in trunk due to HADOOP-11347
--
Key: YARN-3812
URL: https://issues.apache.org/jira/browse/YARN-3812
Project: Hadoop YARN
Issue Type: Bug
Components: test
Affects Versions: 3.0.0
Reporter: Robert Kanter
{{TestRollingLevelDBTimelineStore}} is failing with the below errors in
trunk. I did a git bisect and found that it was due to HADOOP-11347, which
changed something with umasks in {{FsPermission}}.
{noformat}
Running org.apache.hadoop.yarn.server.timeline.TestRollingLevelDBTimelineStore
Tests run: 16, Failures: 0, Errors: 16, Skipped: 0, Time elapsed: 2.65 sec
FAILURE! - in
org.apache.hadoop.yarn.server.timeline.TestRollingLevelDBTimelineStore
testGetDomains(org.apache.hadoop.yarn.server.timeline.TestRollingLevelDBTimelineStore)
Time elapsed: 1.533 sec ERROR!
java.lang.UnsupportedOperationException: null
at
org.apache.hadoop.fs.permission.FsPermission$ImmutableFsPermission.applyUMask(FsPermission.java:380)
at
org.apache.hadoop.fs.RawLocalFileSystem.mkOneDirWithMode(RawLocalFileSystem.java:496)
at
org.apache.hadoop.fs.RawLocalFileSystem.mkdirsWithOptionalPermission(RawLocalFileSystem.java:551)
at
org.apache.hadoop.fs.RawLocalFileSystem.mkdirs(RawLocalFileSystem.java:529)
at
org.apache.hadoop.fs.FilterFileSystem.mkdirs(FilterFileSystem.java:314)
at
org.apache.hadoop.yarn.server.timeline.RollingLevelDB.initFileSystem(RollingLevelDB.java:207)
at
org.apache.hadoop.yarn.server.timeline.RollingLevelDB.init(RollingLevelDB.java:200)
at
org.apache.hadoop.yarn.server.timeline.RollingLevelDBTimelineStore.serviceInit(RollingLevelDBTimelineStore.java:321)
at
org.apache.hadoop.service.AbstractService.init(AbstractService.java:163)
at
org.apache.hadoop.yarn.server.timeline.TestRollingLevelDBTimelineStore.setup(TestRollingLevelDBTimelineStore.java:65)
testRelatingToNonExistingEntity(org.apache.hadoop.yarn.server.timeline.TestRollingLevelDBTimelineStore)
Time elapsed: 0.085 sec ERROR!
java.lang.UnsupportedOperationException: null
at
org.apache.hadoop.fs.permission.FsPermission$ImmutableFsPermission.applyUMask(FsPermission.java:380)
at
org.apache.hadoop.fs.RawLocalFileSystem.mkOneDirWithMode(RawLocalFileSystem.java:496)
at
org.apache.hadoop.fs.RawLocalFileSystem.mkdirsWithOptionalPermission(RawLocalFileSystem.java:551)
at
org.apache.hadoop.fs.RawLocalFileSystem.mkdirs(RawLocalFileSystem.java:529)
at
org.apache.hadoop.fs.FilterFileSystem.mkdirs(FilterFileSystem.java:314)
at
org.apache.hadoop.yarn.server.timeline.RollingLevelDB.initFileSystem(RollingLevelDB.java:207)
at
org.apache.hadoop.yarn.server.timeline.RollingLevelDB.init(RollingLevelDB.java:200)
at
org.apache.hadoop.yarn.server.timeline.RollingLevelDBTimelineStore.serviceInit(RollingLevelDBTimelineStore.java:321)
at
org.apache.hadoop.service.AbstractService.init(AbstractService.java:163)
at
org.apache.hadoop.yarn.server.timeline.TestRollingLevelDBTimelineStore.setup(TestRollingLevelDBTimelineStore.java:65)
testValidateConfig(org.apache.hadoop.yarn.server.timeline.TestRollingLevelDBTimelineStore)
Time elapsed: 0.07 sec ERROR!
java.lang.UnsupportedOperationException: null
at
org.apache.hadoop.fs.permission.FsPermission$ImmutableFsPermission.applyUMask(FsPermission.java:380)
at
org.apache.hadoop.fs.RawLocalFileSystem.mkOneDirWithMode(RawLocalFileSystem.java:496)
at
org.apache.hadoop.fs.RawLocalFileSystem.mkdirsWithOptionalPermission(RawLocalFileSystem.java:551)
at
org.apache.hadoop.fs.RawLocalFileSystem.mkdirs(RawLocalFileSystem.java:529)
at
org.apache.hadoop.fs.FilterFileSystem.mkdirs(FilterFileSystem.java:314)
at
org.apache.hadoop.yarn.server.timeline.RollingLevelDB.initFileSystem(RollingLevelDB.java:207)
at
org.apache.hadoop.yarn.server.timeline.RollingLevelDB.init(RollingLevelDB.java:200)
at
org.apache.hadoop.yarn.server.timeline.RollingLevelDBTimelineStore.serviceInit(RollingLevelDBTimelineStore.java:321)
at
org.apache.hadoop.service.AbstractService.init(AbstractService.java:163)
at
org.apache.hadoop.yarn.server.timeline.TestRollingLevelDBTimelineStore.setup(TestRollingLevelDBTimelineStore.java:65)
testGetEntitiesWithPrimaryFilters(org.apache.hadoop.yarn.server.timeline.TestRollingLevelDBTimelineStore)
[jira] [Commented] (YARN-3812) TestRollingLevelDBTimelineStore fails in trunk due to HADOOP-11347
[
https://issues.apache.org/jira/browse/YARN-3812?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14589154#comment-14589154
]
Bibin A Chundatt commented on YARN-3812:
Please review patch uploaded
TestRollingLevelDBTimelineStore fails in trunk due to HADOOP-11347
--
Key: YARN-3812
URL: https://issues.apache.org/jira/browse/YARN-3812
Project: Hadoop YARN
Issue Type: Bug
Components: test
Affects Versions: 3.0.0
Reporter: Robert Kanter
Assignee: Bibin A Chundatt
Attachments: 0001-YARN-3812.patch
{{TestRollingLevelDBTimelineStore}} is failing with the below errors in
trunk. I did a git bisect and found that it was due to HADOOP-11347, which
changed something with umasks in {{FsPermission}}.
{noformat}
Running org.apache.hadoop.yarn.server.timeline.TestRollingLevelDBTimelineStore
Tests run: 16, Failures: 0, Errors: 16, Skipped: 0, Time elapsed: 2.65 sec
FAILURE! - in
org.apache.hadoop.yarn.server.timeline.TestRollingLevelDBTimelineStore
testGetDomains(org.apache.hadoop.yarn.server.timeline.TestRollingLevelDBTimelineStore)
Time elapsed: 1.533 sec ERROR!
java.lang.UnsupportedOperationException: null
at
org.apache.hadoop.fs.permission.FsPermission$ImmutableFsPermission.applyUMask(FsPermission.java:380)
at
org.apache.hadoop.fs.RawLocalFileSystem.mkOneDirWithMode(RawLocalFileSystem.java:496)
at
org.apache.hadoop.fs.RawLocalFileSystem.mkdirsWithOptionalPermission(RawLocalFileSystem.java:551)
at
org.apache.hadoop.fs.RawLocalFileSystem.mkdirs(RawLocalFileSystem.java:529)
at
org.apache.hadoop.fs.FilterFileSystem.mkdirs(FilterFileSystem.java:314)
at
org.apache.hadoop.yarn.server.timeline.RollingLevelDB.initFileSystem(RollingLevelDB.java:207)
at
org.apache.hadoop.yarn.server.timeline.RollingLevelDB.init(RollingLevelDB.java:200)
at
org.apache.hadoop.yarn.server.timeline.RollingLevelDBTimelineStore.serviceInit(RollingLevelDBTimelineStore.java:321)
at
org.apache.hadoop.service.AbstractService.init(AbstractService.java:163)
at
org.apache.hadoop.yarn.server.timeline.TestRollingLevelDBTimelineStore.setup(TestRollingLevelDBTimelineStore.java:65)
testRelatingToNonExistingEntity(org.apache.hadoop.yarn.server.timeline.TestRollingLevelDBTimelineStore)
Time elapsed: 0.085 sec ERROR!
java.lang.UnsupportedOperationException: null
at
org.apache.hadoop.fs.permission.FsPermission$ImmutableFsPermission.applyUMask(FsPermission.java:380)
at
org.apache.hadoop.fs.RawLocalFileSystem.mkOneDirWithMode(RawLocalFileSystem.java:496)
at
org.apache.hadoop.fs.RawLocalFileSystem.mkdirsWithOptionalPermission(RawLocalFileSystem.java:551)
at
org.apache.hadoop.fs.RawLocalFileSystem.mkdirs(RawLocalFileSystem.java:529)
at
org.apache.hadoop.fs.FilterFileSystem.mkdirs(FilterFileSystem.java:314)
at
org.apache.hadoop.yarn.server.timeline.RollingLevelDB.initFileSystem(RollingLevelDB.java:207)
at
org.apache.hadoop.yarn.server.timeline.RollingLevelDB.init(RollingLevelDB.java:200)
at
org.apache.hadoop.yarn.server.timeline.RollingLevelDBTimelineStore.serviceInit(RollingLevelDBTimelineStore.java:321)
at
org.apache.hadoop.service.AbstractService.init(AbstractService.java:163)
at
org.apache.hadoop.yarn.server.timeline.TestRollingLevelDBTimelineStore.setup(TestRollingLevelDBTimelineStore.java:65)
testValidateConfig(org.apache.hadoop.yarn.server.timeline.TestRollingLevelDBTimelineStore)
Time elapsed: 0.07 sec ERROR!
java.lang.UnsupportedOperationException: null
at
org.apache.hadoop.fs.permission.FsPermission$ImmutableFsPermission.applyUMask(FsPermission.java:380)
at
org.apache.hadoop.fs.RawLocalFileSystem.mkOneDirWithMode(RawLocalFileSystem.java:496)
at
org.apache.hadoop.fs.RawLocalFileSystem.mkdirsWithOptionalPermission(RawLocalFileSystem.java:551)
at
org.apache.hadoop.fs.RawLocalFileSystem.mkdirs(RawLocalFileSystem.java:529)
at
org.apache.hadoop.fs.FilterFileSystem.mkdirs(FilterFileSystem.java:314)
at
org.apache.hadoop.yarn.server.timeline.RollingLevelDB.initFileSystem(RollingLevelDB.java:207)
at
org.apache.hadoop.yarn.server.timeline.RollingLevelDB.init(RollingLevelDB.java:200)
at
org.apache.hadoop.yarn.server.timeline.RollingLevelDBTimelineStore.serviceInit(RollingLevelDBTimelineStore.java:321)
at
org.apache.hadoop.service.AbstractService.init(AbstractService.java:163)
at
org.apache.hadoop.yarn.server.timeline.TestRollingLevelDBTimelineStore.setup(TestRollingLevelDBTimelineStore.java:65)
testGetEntitiesWithPrimaryFilters(org.apache.hadoop.yarn.server.timeline.TestRollingLevelDBTimelineStore)
Time elapsed:
[jira] [Commented] (YARN-3812) TestRollingLevelDBTimelineStore fails in trunk due to HADOOP-11347
[
https://issues.apache.org/jira/browse/YARN-3812?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14589174#comment-14589174
]
Robert Kanter commented on YARN-3812:
-
+1 pending Jenkins
TestRollingLevelDBTimelineStore fails in trunk due to HADOOP-11347
--
Key: YARN-3812
URL: https://issues.apache.org/jira/browse/YARN-3812
Project: Hadoop YARN
Issue Type: Bug
Components: test
Affects Versions: 3.0.0
Reporter: Robert Kanter
Assignee: Bibin A Chundatt
Attachments: 0001-YARN-3812.patch
{{TestRollingLevelDBTimelineStore}} is failing with the below errors in
trunk. I did a git bisect and found that it was due to HADOOP-11347, which
changed something with umasks in {{FsPermission}}.
{noformat}
Running org.apache.hadoop.yarn.server.timeline.TestRollingLevelDBTimelineStore
Tests run: 16, Failures: 0, Errors: 16, Skipped: 0, Time elapsed: 2.65 sec
FAILURE! - in
org.apache.hadoop.yarn.server.timeline.TestRollingLevelDBTimelineStore
testGetDomains(org.apache.hadoop.yarn.server.timeline.TestRollingLevelDBTimelineStore)
Time elapsed: 1.533 sec ERROR!
java.lang.UnsupportedOperationException: null
at
org.apache.hadoop.fs.permission.FsPermission$ImmutableFsPermission.applyUMask(FsPermission.java:380)
at
org.apache.hadoop.fs.RawLocalFileSystem.mkOneDirWithMode(RawLocalFileSystem.java:496)
at
org.apache.hadoop.fs.RawLocalFileSystem.mkdirsWithOptionalPermission(RawLocalFileSystem.java:551)
at
org.apache.hadoop.fs.RawLocalFileSystem.mkdirs(RawLocalFileSystem.java:529)
at
org.apache.hadoop.fs.FilterFileSystem.mkdirs(FilterFileSystem.java:314)
at
org.apache.hadoop.yarn.server.timeline.RollingLevelDB.initFileSystem(RollingLevelDB.java:207)
at
org.apache.hadoop.yarn.server.timeline.RollingLevelDB.init(RollingLevelDB.java:200)
at
org.apache.hadoop.yarn.server.timeline.RollingLevelDBTimelineStore.serviceInit(RollingLevelDBTimelineStore.java:321)
at
org.apache.hadoop.service.AbstractService.init(AbstractService.java:163)
at
org.apache.hadoop.yarn.server.timeline.TestRollingLevelDBTimelineStore.setup(TestRollingLevelDBTimelineStore.java:65)
testRelatingToNonExistingEntity(org.apache.hadoop.yarn.server.timeline.TestRollingLevelDBTimelineStore)
Time elapsed: 0.085 sec ERROR!
java.lang.UnsupportedOperationException: null
at
org.apache.hadoop.fs.permission.FsPermission$ImmutableFsPermission.applyUMask(FsPermission.java:380)
at
org.apache.hadoop.fs.RawLocalFileSystem.mkOneDirWithMode(RawLocalFileSystem.java:496)
at
org.apache.hadoop.fs.RawLocalFileSystem.mkdirsWithOptionalPermission(RawLocalFileSystem.java:551)
at
org.apache.hadoop.fs.RawLocalFileSystem.mkdirs(RawLocalFileSystem.java:529)
at
org.apache.hadoop.fs.FilterFileSystem.mkdirs(FilterFileSystem.java:314)
at
org.apache.hadoop.yarn.server.timeline.RollingLevelDB.initFileSystem(RollingLevelDB.java:207)
at
org.apache.hadoop.yarn.server.timeline.RollingLevelDB.init(RollingLevelDB.java:200)
at
org.apache.hadoop.yarn.server.timeline.RollingLevelDBTimelineStore.serviceInit(RollingLevelDBTimelineStore.java:321)
at
org.apache.hadoop.service.AbstractService.init(AbstractService.java:163)
at
org.apache.hadoop.yarn.server.timeline.TestRollingLevelDBTimelineStore.setup(TestRollingLevelDBTimelineStore.java:65)
testValidateConfig(org.apache.hadoop.yarn.server.timeline.TestRollingLevelDBTimelineStore)
Time elapsed: 0.07 sec ERROR!
java.lang.UnsupportedOperationException: null
at
org.apache.hadoop.fs.permission.FsPermission$ImmutableFsPermission.applyUMask(FsPermission.java:380)
at
org.apache.hadoop.fs.RawLocalFileSystem.mkOneDirWithMode(RawLocalFileSystem.java:496)
at
org.apache.hadoop.fs.RawLocalFileSystem.mkdirsWithOptionalPermission(RawLocalFileSystem.java:551)
at
org.apache.hadoop.fs.RawLocalFileSystem.mkdirs(RawLocalFileSystem.java:529)
at
org.apache.hadoop.fs.FilterFileSystem.mkdirs(FilterFileSystem.java:314)
at
org.apache.hadoop.yarn.server.timeline.RollingLevelDB.initFileSystem(RollingLevelDB.java:207)
at
org.apache.hadoop.yarn.server.timeline.RollingLevelDB.init(RollingLevelDB.java:200)
at
org.apache.hadoop.yarn.server.timeline.RollingLevelDBTimelineStore.serviceInit(RollingLevelDBTimelineStore.java:321)
at
org.apache.hadoop.service.AbstractService.init(AbstractService.java:163)
at
org.apache.hadoop.yarn.server.timeline.TestRollingLevelDBTimelineStore.setup(TestRollingLevelDBTimelineStore.java:65)
testGetEntitiesWithPrimaryFilters(org.apache.hadoop.yarn.server.timeline.TestRollingLevelDBTimelineStore)
Time elapsed: 0.061 sec ERROR!
