[
https://issues.apache.org/jira/browse/PARQUET-1923?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17213070#comment-17213070
]
ASF GitHub Bot commented on PARQUET-1923:
-----------------------------------------
gszadovszky commented on pull request #826:
URL: https://github.com/apache/parquet-mr/pull/826#issuecomment-707679173
Is there any reason why we upgrading to the next maintenance version instead
of the newest 2.7.7?
To be honest I would prefer to upgrade to the latest hadoop 2 release
2.10.1. Based on the semantic versioning it should not cause any issues.
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
[email protected]
> parquet-tools 1.11.0: TestSimpleRecordConverter fails with
> ExceptionInInitializerError on openjdk 15
> ----------------------------------------------------------------------------------------------------
>
> Key: PARQUET-1923
> URL: https://issues.apache.org/jira/browse/PARQUET-1923
> Project: Parquet
> Issue Type: Bug
> Affects Versions: 1.11.0
> Environment: {code}
> $ mvn --version
> Apache Maven 3.6.3 (cecedd343002696d0abb50b32b541b8a6ba2883f)
> Maven home: /usr/local/Cellar/maven/3.6.3_1/libexec
> Java version: 15, vendor: N/A, runtime:
> /usr/local/Cellar/openjdk/15/libexec/openjdk.jdk/Contents/Home
> Default locale: en_GB, platform encoding: UTF-8
> OS name: "mac os x", version: "10.15.7", arch: "x86_64", family: "mac"
> $ java -version
> openjdk version "15" 2020-09-15
> OpenJDK Runtime Environment (build 15+36)
> OpenJDK 64-Bit Server VM (build 15+36, mixed mode, sharing)
> $ sw_vers
> ProductName: Mac OS X
> ProductVersion: 10.15.7
> BuildVersion: 19H2
> {code}
>
> Reporter: Alexander Bayandin
> Priority: Major
>
> {{mvn clean package -Plocal}} for parquet-tools 1.11.0 fails with a failing
> test
> {{testConverter(org.apache.parquet.tools.read.TestSimpleRecordConverter)}}.
> {{mvn clean -Dtest=TestSimpleRecordConverter "-Plocal" test}}:
> {code}
> --------------------------------------------------------------------------------------------------------------------------------------------------------------Test
> set:
> org.apache.parquet.tools.read.TestSimpleRecordConverter-------------------------------------------------------------------------------Tests
> run: 1, Failures: 0, Errors: 1, Skipped: 0, Time elapsed: 0.338 sec <<<
> FAILURE!testConverter(org.apache.parquet.tools.read.TestSimpleRecordConverter)
> Time elapsed: 0.268 sec <<< ERROR!java.lang.ExceptionInInitializerError at
> org.apache.hadoop.util.StringUtils.<clinit>(StringUtils.java:80) at
> org.apache.hadoop.fs.FileSystem$Cache$Key.<init>(FileSystem.java:2823) at
> org.apache.hadoop.fs.FileSystem$Cache$Key.<init>(FileSystem.java:2818) at
> org.apache.hadoop.fs.FileSystem$Cache.get(FileSystem.java:2684) at
> org.apache.hadoop.fs.FileSystem.get(FileSystem.java:373) at
> org.apache.hadoop.fs.FileSystem.get(FileSystem.java:172) at
> org.apache.hadoop.fs.FileSystem.get(FileSystem.java:357) at
> org.apache.hadoop.fs.Path.getFileSystem(Path.java:295) at
> org.apache.parquet.hadoop.util.HadoopOutputFile.fromPath(HadoopOutputFile.java:58)
> at org.apache.parquet.hadoop.ParquetWriter.<init>(ParquetWriter.java:227) at
> org.apache.parquet.hadoop.ParquetWriter.<init>(ParquetWriter.java:192) at
> org.apache.parquet.tools.read.TestSimpleRecordConverter.createTestParquetFile(TestSimpleRecordConverter.java:114)
> at
> org.apache.parquet.tools.read.TestSimpleRecordConverter.setUp(TestSimpleRecordConverter.java:90)
> at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke0(Native
> Method) at
> java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:64)
> at
> java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
> at java.base/java.lang.reflect.Method.invoke(Method.java:564) at
> org.junit.runners.model.FrameworkMethod$1.runReflectiveCall(FrameworkMethod.java:50)
> at
> org.junit.internal.runners.model.ReflectiveCallable.run(ReflectiveCallable.java:12)
> at
> org.junit.runners.model.FrameworkMethod.invokeExplosively(FrameworkMethod.java:47)
> at
> org.junit.internal.runners.statements.RunBefores.evaluate(RunBefores.java:24)
> at org.junit.rules.ExternalResource$1.evaluate(ExternalResource.java:48) at
> org.junit.rules.RunRules.evaluate(RunRules.java:20) at
> org.junit.runners.ParentRunner.runLeaf(ParentRunner.java:325) at
> org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:78)
> at
> org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:57)
> at org.junit.runners.ParentRunner$3.run(ParentRunner.java:290) at
> org.junit.runners.ParentRunner$1.schedule(ParentRunner.java:71) at
> org.junit.runners.ParentRunner.runChildren(ParentRunner.java:288) at
> org.junit.runners.ParentRunner.access$000(ParentRunner.java:58) at
> org.junit.runners.ParentRunner$2.evaluate(ParentRunner.java:268) at
> org.junit.runners.ParentRunner.run(ParentRunner.java:363) at
> org.apache.maven.surefire.junit4.JUnit4TestSet.execute(JUnit4TestSet.java:53)
> at
> org.apache.maven.surefire.junit4.JUnit4Provider.executeTestSet(JUnit4Provider.java:123)
> at
> org.apache.maven.surefire.junit4.JUnit4Provider.invoke(JUnit4Provider.java:104)
> at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke0(Native
> Method) at
> java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:64)
> at
> java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
> at java.base/java.lang.reflect.Method.invoke(Method.java:564) at
> org.apache.maven.surefire.util.ReflectionUtils.invokeMethodWithArray(ReflectionUtils.java:164)
> at
> org.apache.maven.surefire.booter.ProviderFactory$ProviderProxy.invoke(ProviderFactory.java:110)
> at
> org.apache.maven.surefire.booter.SurefireStarter.invokeProvider(SurefireStarter.java:175)
> at
> org.apache.maven.surefire.booter.SurefireStarter.runSuitesInProcessWhenForked(SurefireStarter.java:107)
> at
> org.apache.maven.surefire.booter.ForkedBooter.main(ForkedBooter.java:68)Caused
> by: java.lang.StringIndexOutOfBoundsException: begin 0, end 3, length 2 at
> java.base/java.lang.String.checkBoundsBeginEnd(String.java:3734) at
> java.base/java.lang.String.substring(String.java:1903) at
> org.apache.hadoop.util.Shell.<clinit>(Shell.java:52) ... 44 more{code}
> The error looks similar to SPARK-26134, so I suppose a fix should be the same.
> Notes:
> - I use parquet-tools 1.11.0 with
> https://github.com/apache/parquet-mr/commit/b6d07ae0744ba47aa9a8868ef2d7cbb232a60b22
> patch
> - I can't build current master at all:
> https://issues.apache.org/jira/browse/PARQUET-1896?focusedCommentId=17203146&page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel#comment-17203146
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
