[jira] [Commented] (IMPALA-12819) InaccessibleObjectException found during LocalCatalogTest
[
https://issues.apache.org/jira/browse/IMPALA-12819?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17829657#comment-17829657
]
Michael Smith commented on IMPALA-12819:
Impala and the FE test config weren't in-sync. Updated the test config.
> InaccessibleObjectException found during LocalCatalogTest
> -
>
> Key: IMPALA-12819
> URL: https://issues.apache.org/jira/browse/IMPALA-12819
> Project: IMPALA
> Issue Type: Task
> Components: fe
>Affects Versions: Impala 4.4.0
>Reporter: Fang-Yu Rao
>Assignee: Michael Smith
>Priority: Major
> Labels: broken-build
> Fix For: Impala 4.4.0
>
>
> We found in an internal build that during LocalCatalogTest we could encounter
> InaccessibleObjectException. This was found by the test
> [test_no_inaccessible_objects|https://github.com/apache/impala/blob/master/tests/verifiers/test_banned_log_messages.py#L40C7-L40C35]
> {code:java}
> W0217 01:31:14.108255 18119 ObjectGraphWalker.java:251] The JVM is preventing
> Ehcache from accessing the subgraph beneath 'private final
> jdk.internal.platform.CgroupV1Metrics
> jdk.internal.platform.CgroupV1MetricsImpl.metrics' - cache sizes may be
> underestimated as a result
> Java exception follows:
> java.lang.reflect.InaccessibleObjectException: Unable to make field private
> final jdk.internal.platform.CgroupV1Metrics
> jdk.internal.platform.CgroupV1MetricsImpl.metrics accessible: module
> java.base does not "opens jdk.internal.platform" to unnamed module @2c89cd7f
> at
> java.base/java.lang.reflect.AccessibleObject.checkCanSetAccessible(AccessibleObject.java:340)
> at
> java.base/java.lang.reflect.AccessibleObject.checkCanSetAccessible(AccessibleObject.java:280)
> at
> java.base/java.lang.reflect.Field.checkCanSetAccessible(Field.java:176)
> at java.base/java.lang.reflect.Field.setAccessible(Field.java:170)
> at
> org.ehcache.sizeof.ObjectGraphWalker.getAllFields(ObjectGraphWalker.java:245)
> at
> org.ehcache.sizeof.ObjectGraphWalker.getFilteredFields(ObjectGraphWalker.java:204)
> at
> org.ehcache.sizeof.ObjectGraphWalker.walk(ObjectGraphWalker.java:159)
> at org.ehcache.sizeof.SizeOf.deepSizeOf(SizeOf.java:74)
> at
> org.apache.impala.catalog.local.CatalogdMetaProvider$SizeOfWeigher.weigh(CatalogdMetaProvider.java:2234)
> at
> com.google.common.cache.LocalCache$Segment.setValue(LocalCache.java:2043)
> at
> com.google.common.cache.LocalCache$Segment.replace(LocalCache.java:2990)
> at com.google.common.cache.LocalCache.replace(LocalCache.java:4324)
> at
> org.apache.impala.catalog.local.CatalogdMetaProvider.loadWithCaching(CatalogdMetaProvider.java:569)
> at
> org.apache.impala.catalog.local.CatalogdMetaProvider.loadIcebergApiTable(CatalogdMetaProvider.java:1160)
> at
> org.apache.impala.catalog.local.LocalIcebergTable.loadIcebergTableViaMetaProvider(LocalIcebergTable.java:96)
> at
> org.apache.impala.catalog.local.LocalTable.load(LocalTable.java:131)
> at
> org.apache.impala.catalog.local.LocalTable.load(LocalTable.java:114)
> at org.apache.impala.catalog.local.LocalDb.getTable(LocalDb.java:148)
> at
> org.apache.impala.catalog.local.LocalCatalog.getTable(LocalCatalog.java:139)
> at
> org.apache.impala.catalog.local.LocalCatalogTest.testLoadIcebergFileDescriptors(LocalCatalogTest.java:280)
> at
> java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
> at
> java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
> at
> java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
> at java.base/java.lang.reflect.Method.invoke(Method.java:566)
> at
> org.junit.runners.model.FrameworkMethod$1.runReflectiveCall(FrameworkMethod.java:50)
> at
> org.junit.internal.runners.model.ReflectiveCallable.run(ReflectiveCallable.java:12)
> at
> org.junit.runners.model.FrameworkMethod.invokeExplosively(FrameworkMethod.java:47)
> at
> org.junit.internal.runners.statements.InvokeMethod.evaluate(InvokeMethod.java:17)
> at
> org.junit.internal.runners.statements.RunBefores.evaluate(RunBefores.java:26)
> at org.junit.runners.ParentRunner.runLeaf(ParentRunner.java:325)
> at
> org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:78)
> at
> org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:57)
> at org.junit.runners.ParentRunner$3.run(ParentRunner.java:290)
> at org.junit.runners.ParentRunner$1.schedule(ParentRunner.java:71)
> at
[jira] [Commented] (IMPALA-12819) InaccessibleObjectException found during LocalCatalogTest
[
https://issues.apache.org/jira/browse/IMPALA-12819?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17821443#comment-17821443
]
Michael Smith commented on IMPALA-12819:
Interestingly it was already added to init.cc. I'll put up a patch.
> InaccessibleObjectException found during LocalCatalogTest
> -
>
> Key: IMPALA-12819
> URL: https://issues.apache.org/jira/browse/IMPALA-12819
> Project: IMPALA
> Issue Type: Bug
> Components: fe
>Affects Versions: Impala 4.4.0
>Reporter: Fang-Yu Rao
>Assignee: Michael Smith
>Priority: Major
> Labels: broken-build
>
> We found in an internal build that during LocalCatalogTest we could encounter
> InaccessibleObjectException. This was found by the test
> [test_no_inaccessible_objects|https://github.com/apache/impala/blob/master/tests/verifiers/test_banned_log_messages.py#L40C7-L40C35]
> {code:java}
> W0217 01:31:14.108255 18119 ObjectGraphWalker.java:251] The JVM is preventing
> Ehcache from accessing the subgraph beneath 'private final
> jdk.internal.platform.CgroupV1Metrics
> jdk.internal.platform.CgroupV1MetricsImpl.metrics' - cache sizes may be
> underestimated as a result
> Java exception follows:
> java.lang.reflect.InaccessibleObjectException: Unable to make field private
> final jdk.internal.platform.CgroupV1Metrics
> jdk.internal.platform.CgroupV1MetricsImpl.metrics accessible: module
> java.base does not "opens jdk.internal.platform" to unnamed module @2c89cd7f
> at
> java.base/java.lang.reflect.AccessibleObject.checkCanSetAccessible(AccessibleObject.java:340)
> at
> java.base/java.lang.reflect.AccessibleObject.checkCanSetAccessible(AccessibleObject.java:280)
> at
> java.base/java.lang.reflect.Field.checkCanSetAccessible(Field.java:176)
> at java.base/java.lang.reflect.Field.setAccessible(Field.java:170)
> at
> org.ehcache.sizeof.ObjectGraphWalker.getAllFields(ObjectGraphWalker.java:245)
> at
> org.ehcache.sizeof.ObjectGraphWalker.getFilteredFields(ObjectGraphWalker.java:204)
> at
> org.ehcache.sizeof.ObjectGraphWalker.walk(ObjectGraphWalker.java:159)
> at org.ehcache.sizeof.SizeOf.deepSizeOf(SizeOf.java:74)
> at
> org.apache.impala.catalog.local.CatalogdMetaProvider$SizeOfWeigher.weigh(CatalogdMetaProvider.java:2234)
> at
> com.google.common.cache.LocalCache$Segment.setValue(LocalCache.java:2043)
> at
> com.google.common.cache.LocalCache$Segment.replace(LocalCache.java:2990)
> at com.google.common.cache.LocalCache.replace(LocalCache.java:4324)
> at
> org.apache.impala.catalog.local.CatalogdMetaProvider.loadWithCaching(CatalogdMetaProvider.java:569)
> at
> org.apache.impala.catalog.local.CatalogdMetaProvider.loadIcebergApiTable(CatalogdMetaProvider.java:1160)
> at
> org.apache.impala.catalog.local.LocalIcebergTable.loadIcebergTableViaMetaProvider(LocalIcebergTable.java:96)
> at
> org.apache.impala.catalog.local.LocalTable.load(LocalTable.java:131)
> at
> org.apache.impala.catalog.local.LocalTable.load(LocalTable.java:114)
> at org.apache.impala.catalog.local.LocalDb.getTable(LocalDb.java:148)
> at
> org.apache.impala.catalog.local.LocalCatalog.getTable(LocalCatalog.java:139)
> at
> org.apache.impala.catalog.local.LocalCatalogTest.testLoadIcebergFileDescriptors(LocalCatalogTest.java:280)
> at
> java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
> at
> java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
> at
> java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
> at java.base/java.lang.reflect.Method.invoke(Method.java:566)
> at
> org.junit.runners.model.FrameworkMethod$1.runReflectiveCall(FrameworkMethod.java:50)
> at
> org.junit.internal.runners.model.ReflectiveCallable.run(ReflectiveCallable.java:12)
> at
> org.junit.runners.model.FrameworkMethod.invokeExplosively(FrameworkMethod.java:47)
> at
> org.junit.internal.runners.statements.InvokeMethod.evaluate(InvokeMethod.java:17)
> at
> org.junit.internal.runners.statements.RunBefores.evaluate(RunBefores.java:26)
> at org.junit.runners.ParentRunner.runLeaf(ParentRunner.java:325)
> at
> org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:78)
> at
> org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:57)
> at org.junit.runners.ParentRunner$3.run(ParentRunner.java:290)
> at org.junit.runners.ParentRunner$1.schedule(ParentRunner.java:71)
> at
[jira] [Commented] (IMPALA-12819) InaccessibleObjectException found during LocalCatalogTest
[
https://issues.apache.org/jira/browse/IMPALA-12819?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17821442#comment-17821442
]
Michael Smith commented on IMPALA-12819:
CGroupV1Metrics is an interesting thing to wind up in the catalog cache.
However adding that line to run-all-tests.sh wouldn't do any harm.
> InaccessibleObjectException found during LocalCatalogTest
> -
>
> Key: IMPALA-12819
> URL: https://issues.apache.org/jira/browse/IMPALA-12819
> Project: IMPALA
> Issue Type: Bug
> Components: fe
>Affects Versions: Impala 4.4.0
>Reporter: Fang-Yu Rao
>Assignee: Michael Smith
>Priority: Major
> Labels: broken-build
>
> We found in an internal build that during LocalCatalogTest we could encounter
> InaccessibleObjectException. This was found by the test
> [test_no_inaccessible_objects|https://github.com/apache/impala/blob/master/tests/verifiers/test_banned_log_messages.py#L40C7-L40C35]
> {code:java}
> W0217 01:31:14.108255 18119 ObjectGraphWalker.java:251] The JVM is preventing
> Ehcache from accessing the subgraph beneath 'private final
> jdk.internal.platform.CgroupV1Metrics
> jdk.internal.platform.CgroupV1MetricsImpl.metrics' - cache sizes may be
> underestimated as a result
> Java exception follows:
> java.lang.reflect.InaccessibleObjectException: Unable to make field private
> final jdk.internal.platform.CgroupV1Metrics
> jdk.internal.platform.CgroupV1MetricsImpl.metrics accessible: module
> java.base does not "opens jdk.internal.platform" to unnamed module @2c89cd7f
> at
> java.base/java.lang.reflect.AccessibleObject.checkCanSetAccessible(AccessibleObject.java:340)
> at
> java.base/java.lang.reflect.AccessibleObject.checkCanSetAccessible(AccessibleObject.java:280)
> at
> java.base/java.lang.reflect.Field.checkCanSetAccessible(Field.java:176)
> at java.base/java.lang.reflect.Field.setAccessible(Field.java:170)
> at
> org.ehcache.sizeof.ObjectGraphWalker.getAllFields(ObjectGraphWalker.java:245)
> at
> org.ehcache.sizeof.ObjectGraphWalker.getFilteredFields(ObjectGraphWalker.java:204)
> at
> org.ehcache.sizeof.ObjectGraphWalker.walk(ObjectGraphWalker.java:159)
> at org.ehcache.sizeof.SizeOf.deepSizeOf(SizeOf.java:74)
> at
> org.apache.impala.catalog.local.CatalogdMetaProvider$SizeOfWeigher.weigh(CatalogdMetaProvider.java:2234)
> at
> com.google.common.cache.LocalCache$Segment.setValue(LocalCache.java:2043)
> at
> com.google.common.cache.LocalCache$Segment.replace(LocalCache.java:2990)
> at com.google.common.cache.LocalCache.replace(LocalCache.java:4324)
> at
> org.apache.impala.catalog.local.CatalogdMetaProvider.loadWithCaching(CatalogdMetaProvider.java:569)
> at
> org.apache.impala.catalog.local.CatalogdMetaProvider.loadIcebergApiTable(CatalogdMetaProvider.java:1160)
> at
> org.apache.impala.catalog.local.LocalIcebergTable.loadIcebergTableViaMetaProvider(LocalIcebergTable.java:96)
> at
> org.apache.impala.catalog.local.LocalTable.load(LocalTable.java:131)
> at
> org.apache.impala.catalog.local.LocalTable.load(LocalTable.java:114)
> at org.apache.impala.catalog.local.LocalDb.getTable(LocalDb.java:148)
> at
> org.apache.impala.catalog.local.LocalCatalog.getTable(LocalCatalog.java:139)
> at
> org.apache.impala.catalog.local.LocalCatalogTest.testLoadIcebergFileDescriptors(LocalCatalogTest.java:280)
> at
> java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
> at
> java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
> at
> java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
> at java.base/java.lang.reflect.Method.invoke(Method.java:566)
> at
> org.junit.runners.model.FrameworkMethod$1.runReflectiveCall(FrameworkMethod.java:50)
> at
> org.junit.internal.runners.model.ReflectiveCallable.run(ReflectiveCallable.java:12)
> at
> org.junit.runners.model.FrameworkMethod.invokeExplosively(FrameworkMethod.java:47)
> at
> org.junit.internal.runners.statements.InvokeMethod.evaluate(InvokeMethod.java:17)
> at
> org.junit.internal.runners.statements.RunBefores.evaluate(RunBefores.java:26)
> at org.junit.runners.ParentRunner.runLeaf(ParentRunner.java:325)
> at
> org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:78)
> at
> org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:57)
> at org.junit.runners.ParentRunner$3.run(ParentRunner.java:290)
> at
[jira] [Commented] (IMPALA-12819) InaccessibleObjectException found during LocalCatalogTest
[
https://issues.apache.org/jira/browse/IMPALA-12819?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17818215#comment-17818215
]
Fang-Yu Rao commented on IMPALA-12819:
--
Hi [~MikaelSmith], assigned the JIRA to you since you helped with IMPALA-11260
earlier and may be more familiar with the context. Please re-assign the ticket
as you see appropriate. Thanks!
> InaccessibleObjectException found during LocalCatalogTest
> -
>
> Key: IMPALA-12819
> URL: https://issues.apache.org/jira/browse/IMPALA-12819
> Project: IMPALA
> Issue Type: Bug
> Components: fe
>Affects Versions: Impala 4.4.0
>Reporter: Fang-Yu Rao
>Assignee: Michael Smith
>Priority: Major
> Labels: broken-build
>
> We found in an internal build that during LocalCatalogTest we could encounter
> InaccessibleObjectException. This was found by the test
> [test_no_inaccessible_objects|https://github.com/apache/impala/blob/master/tests/verifiers/test_banned_log_messages.py#L40C7-L40C35]
> {code:java}
> W0217 01:31:14.108255 18119 ObjectGraphWalker.java:251] The JVM is preventing
> Ehcache from accessing the subgraph beneath 'private final
> jdk.internal.platform.CgroupV1Metrics
> jdk.internal.platform.CgroupV1MetricsImpl.metrics' - cache sizes may be
> underestimated as a result
> Java exception follows:
> java.lang.reflect.InaccessibleObjectException: Unable to make field private
> final jdk.internal.platform.CgroupV1Metrics
> jdk.internal.platform.CgroupV1MetricsImpl.metrics accessible: module
> java.base does not "opens jdk.internal.platform" to unnamed module @2c89cd7f
> at
> java.base/java.lang.reflect.AccessibleObject.checkCanSetAccessible(AccessibleObject.java:340)
> at
> java.base/java.lang.reflect.AccessibleObject.checkCanSetAccessible(AccessibleObject.java:280)
> at
> java.base/java.lang.reflect.Field.checkCanSetAccessible(Field.java:176)
> at java.base/java.lang.reflect.Field.setAccessible(Field.java:170)
> at
> org.ehcache.sizeof.ObjectGraphWalker.getAllFields(ObjectGraphWalker.java:245)
> at
> org.ehcache.sizeof.ObjectGraphWalker.getFilteredFields(ObjectGraphWalker.java:204)
> at
> org.ehcache.sizeof.ObjectGraphWalker.walk(ObjectGraphWalker.java:159)
> at org.ehcache.sizeof.SizeOf.deepSizeOf(SizeOf.java:74)
> at
> org.apache.impala.catalog.local.CatalogdMetaProvider$SizeOfWeigher.weigh(CatalogdMetaProvider.java:2234)
> at
> com.google.common.cache.LocalCache$Segment.setValue(LocalCache.java:2043)
> at
> com.google.common.cache.LocalCache$Segment.replace(LocalCache.java:2990)
> at com.google.common.cache.LocalCache.replace(LocalCache.java:4324)
> at
> org.apache.impala.catalog.local.CatalogdMetaProvider.loadWithCaching(CatalogdMetaProvider.java:569)
> at
> org.apache.impala.catalog.local.CatalogdMetaProvider.loadIcebergApiTable(CatalogdMetaProvider.java:1160)
> at
> org.apache.impala.catalog.local.LocalIcebergTable.loadIcebergTableViaMetaProvider(LocalIcebergTable.java:96)
> at
> org.apache.impala.catalog.local.LocalTable.load(LocalTable.java:131)
> at
> org.apache.impala.catalog.local.LocalTable.load(LocalTable.java:114)
> at org.apache.impala.catalog.local.LocalDb.getTable(LocalDb.java:148)
> at
> org.apache.impala.catalog.local.LocalCatalog.getTable(LocalCatalog.java:139)
> at
> org.apache.impala.catalog.local.LocalCatalogTest.testLoadIcebergFileDescriptors(LocalCatalogTest.java:280)
> at
> java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
> at
> java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
> at
> java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
> at java.base/java.lang.reflect.Method.invoke(Method.java:566)
> at
> org.junit.runners.model.FrameworkMethod$1.runReflectiveCall(FrameworkMethod.java:50)
> at
> org.junit.internal.runners.model.ReflectiveCallable.run(ReflectiveCallable.java:12)
> at
> org.junit.runners.model.FrameworkMethod.invokeExplosively(FrameworkMethod.java:47)
> at
> org.junit.internal.runners.statements.InvokeMethod.evaluate(InvokeMethod.java:17)
> at
> org.junit.internal.runners.statements.RunBefores.evaluate(RunBefores.java:26)
> at org.junit.runners.ParentRunner.runLeaf(ParentRunner.java:325)
> at
> org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:78)
> at
> org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:57)
> at org.junit.runners.ParentRunner$3.run(ParentRunner.java:290)
> at
