[ 
https://issues.apache.org/jira/browse/PARQUET-2035?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17333144#comment-17333144
 ] 

Maxim Kolesnikov commented on PARQUET-2035:
-------------------------------------------

Sure, I'll try it.

option 1, even if works today, may bring issues in future, if fastutil types 
will cross boundaries of libraries.

For example, {{parquet-avro}} depends on {{parquet-column}}. If at any point 
{{parquet-avro}} will cast or check {{instanceof}} of type received from 
{{parquet-column}} or vice versa, the logic will get broken, as two libraries 
operate the same classes, but located in different directories.

If there is a strict policy on avoiding leakage of fastutil classes through 
boundaries of parquet libraries, than option 1 will work now and in future.

> Java module import error due to shaded package 
> shaded.parquet.it.unimi.dsi.fastutil
> -----------------------------------------------------------------------------------
>
>                 Key: PARQUET-2035
>                 URL: https://issues.apache.org/jira/browse/PARQUET-2035
>             Project: Parquet
>          Issue Type: Bug
>          Components: parquet-avro
>    Affects Versions: 1.12.0, 1.11.1
>            Reporter: Maxim Kolesnikov
>            Priority: Major
>         Attachments: parquet-example.zip
>
>
> *Description:*
> Due to collision of shaded packages 
> {code:java}
> shaded.parquet.it.unimi.dsi.fastutil{code}
> in 
> {code:java}
> org.apache.parquet:parquet-avro{code}
> and 
> {code:java}
> org.apache.parquet:parquet-column{code}
> it is not possible to use both these dependencies within a modularized java 
> project at the same time.
>  
>  
> *How to reproduce:*
>  * create a maven project with dependency 
> org.apache.parquet:parquet-avro:1.11.1
>  * declare java module that requires both parquet.avro and parquet.column
>  * run
> {code:java}
> mvn compile{code}
>  
> *Expected behaviour:*
> Project should compile without errors.
>  
> *Actual behaviour:*
> Project fails with compilation errors:
>  
> {code:java}
> [ERROR] the unnamed module reads package shaded.parquet.it.unimi.dsi.fastutil 
> from both parquet.column and parquet.avro
> ...{code}
>  
>  
> *Reproducible example* (same code as in the attached zip file): 
> https://github.com/xCASx/parquet-example



--
This message was sent by Atlassian Jira
(v8.3.4#803005)

Reply via email to