[
https://issues.apache.org/jira/browse/PARQUET-1923?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17213075#comment-17213075
]
ASF GitHub Bot commented on PARQUET-1923:
-----------------------------------------
gszadovszky commented on pull request #826:
URL: https://github.com/apache/parquet-mr/pull/826#issuecomment-707684831
I would prefer 2.10.1, thanks.
openjdk is clearly a separate topic. I would not upgrade to a non-LTS java
release but this topic has to be discussed with the community on the dev list
first.
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
[email protected]
> parquet-tools 1.11.0: TestSimpleRecordConverter fails with
> ExceptionInInitializerError on openjdk 15
> ----------------------------------------------------------------------------------------------------
>
> Key: PARQUET-1923
> URL: https://issues.apache.org/jira/browse/PARQUET-1923
> Project: Parquet
> Issue Type: Bug
> Affects Versions: 1.11.0
> Environment: {code}
> $ mvn --version
> Apache Maven 3.6.3 (cecedd343002696d0abb50b32b541b8a6ba2883f)
> Maven home: /usr/local/Cellar/maven/3.6.3_1/libexec
> Java version: 15, vendor: N/A, runtime:
> /usr/local/Cellar/openjdk/15/libexec/openjdk.jdk/Contents/Home
> Default locale: en_GB, platform encoding: UTF-8
> OS name: "mac os x", version: "10.15.7", arch: "x86_64", family: "mac"
> $ java -version
> openjdk version "15" 2020-09-15
> OpenJDK Runtime Environment (build 15+36)
> OpenJDK 64-Bit Server VM (build 15+36, mixed mode, sharing)
> $ sw_vers
> ProductName: Mac OS X
> ProductVersion: 10.15.7
> BuildVersion: 19H2
> {code}
>
> Reporter: Alexander Bayandin
> Priority: Major
>
> {{mvn clean package -Plocal}} for parquet-tools 1.11.0 fails with a failing
> test
> {{testConverter(org.apache.parquet.tools.read.TestSimpleRecordConverter)}}.
> {{mvn clean -Dtest=TestSimpleRecordConverter "-Plocal" test}}:
> {code}
> --------------------------------------------------------------------------------------------------------------------------------------------------------------Test
> set:
> org.apache.parquet.tools.read.TestSimpleRecordConverter-------------------------------------------------------------------------------Tests
> run: 1, Failures: 0, Errors: 1, Skipped: 0, Time elapsed: 0.338 sec <<<
> FAILURE!testConverter(org.apache.parquet.tools.read.TestSimpleRecordConverter)
> Time elapsed: 0.268 sec <<< ERROR!java.lang.ExceptionInInitializerError at
> org.apache.hadoop.util.StringUtils.<clinit>(StringUtils.java:80) at
> org.apache.hadoop.fs.FileSystem$Cache$Key.<init>(FileSystem.java:2823) at
> org.apache.hadoop.fs.FileSystem$Cache$Key.<init>(FileSystem.java:2818) at
> org.apache.hadoop.fs.FileSystem$Cache.get(FileSystem.java:2684) at
> org.apache.hadoop.fs.FileSystem.get(FileSystem.java:373) at
> org.apache.hadoop.fs.FileSystem.get(FileSystem.java:172) at
> org.apache.hadoop.fs.FileSystem.get(FileSystem.java:357) at
> org.apache.hadoop.fs.Path.getFileSystem(Path.java:295) at
> org.apache.parquet.hadoop.util.HadoopOutputFile.fromPath(HadoopOutputFile.java:58)
> at org.apache.parquet.hadoop.ParquetWriter.<init>(ParquetWriter.java:227) at
> org.apache.parquet.hadoop.ParquetWriter.<init>(ParquetWriter.java:192) at
> org.apache.parquet.tools.read.TestSimpleRecordConverter.createTestParquetFile(TestSimpleRecordConverter.java:114)
> at
> org.apache.parquet.tools.read.TestSimpleRecordConverter.setUp(TestSimpleRecordConverter.java:90)
> at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke0(Native
> Method) at
> java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:64)
> at
> java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
> at java.base/java.lang.reflect.Method.invoke(Method.java:564) at
> org.junit.runners.model.FrameworkMethod$1.runReflectiveCall(FrameworkMethod.java:50)
> at
> org.junit.internal.runners.model.ReflectiveCallable.run(ReflectiveCallable.java:12)
> at
> org.junit.runners.model.FrameworkMethod.invokeExplosively(FrameworkMethod.java:47)
> at
> org.junit.internal.runners.statements.RunBefores.evaluate(RunBefores.java:24)
> at org.junit.rules.ExternalResource$1.evaluate(ExternalResource.java:48) at
> org.junit.rules.RunRules.evaluate(RunRules.java:20) at
> org.junit.runners.ParentRunner.runLeaf(ParentRunner.java:325) at
> org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:78)
> at
> org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:57)
> at org.junit.runners.ParentRunner$3.run(ParentRunner.java:290) at
> org.junit.runners.ParentRunner$1.schedule(ParentRunner.java:71) at
> org.junit.runners.ParentRunner.runChildren(ParentRunner.java:288) at
> org.junit.runners.ParentRunner.access$000(ParentRunner.java:58) at
> org.junit.runners.ParentRunner$2.evaluate(ParentRunner.java:268) at
> org.junit.runners.ParentRunner.run(ParentRunner.java:363) at
> org.apache.maven.surefire.junit4.JUnit4TestSet.execute(JUnit4TestSet.java:53)
> at
> org.apache.maven.surefire.junit4.JUnit4Provider.executeTestSet(JUnit4Provider.java:123)
> at
> org.apache.maven.surefire.junit4.JUnit4Provider.invoke(JUnit4Provider.java:104)
> at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke0(Native
> Method) at
> java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:64)
> at
> java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
> at java.base/java.lang.reflect.Method.invoke(Method.java:564) at
> org.apache.maven.surefire.util.ReflectionUtils.invokeMethodWithArray(ReflectionUtils.java:164)
> at
> org.apache.maven.surefire.booter.ProviderFactory$ProviderProxy.invoke(ProviderFactory.java:110)
> at
> org.apache.maven.surefire.booter.SurefireStarter.invokeProvider(SurefireStarter.java:175)
> at
> org.apache.maven.surefire.booter.SurefireStarter.runSuitesInProcessWhenForked(SurefireStarter.java:107)
> at
> org.apache.maven.surefire.booter.ForkedBooter.main(ForkedBooter.java:68)Caused
> by: java.lang.StringIndexOutOfBoundsException: begin 0, end 3, length 2 at
> java.base/java.lang.String.checkBoundsBeginEnd(String.java:3734) at
> java.base/java.lang.String.substring(String.java:1903) at
> org.apache.hadoop.util.Shell.<clinit>(Shell.java:52) ... 44 more{code}
> The error looks similar to SPARK-26134, so I suppose a fix should be the same.
> Notes:
> - I use parquet-tools 1.11.0 with
> https://github.com/apache/parquet-mr/commit/b6d07ae0744ba47aa9a8868ef2d7cbb232a60b22
> patch
> - I can't build current master at all:
> https://issues.apache.org/jira/browse/PARQUET-1896?focusedCommentId=17203146&page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel#comment-17203146
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
