caican00 commented on PR #4547:
URL: https://github.com/apache/gravitino/pull/4547#issuecomment-2378331488

   > > > > Why the paimon format jar is so big, is it correct?
   > > > 
   > > > 
   > > > Paimon format jar packages the dependences in the jar, @caican00 do 
you know any other alternative jars?
   > > 
   > > 
   > > @caican00 any thoughts on this?
   > 
   > let me check it.
   
   The paimon catalog explicitly calls the code in the paimon-format module, so 
it cannot be replaced with other jars.
   
   I exclude more dependencies and ran through the integration tests.  And 
deployed it on physical machines for testing.
   
   **ITS:**
   
![image](https://github.com/user-attachments/assets/4065eab7-b1f1-4a0b-8852-f0e9a11802e4)
   
   
![image](https://github.com/user-attachments/assets/d2f985cf-e1cc-498d-b178-765e529bc9e8)
   
   
   **physical enviroment:**
   
   
![image](https://github.com/user-attachments/assets/5368bd8a-4080-4e83-bf41-515adbf297e4)
   
   
   I have no permission to push code to the repo, please help update the pr.
   ```
     implementation(libs.bundles.paimon) {
       exclude("com.sun.jersey")
       exclude("javax.servlet")
       exclude("org.apache.curator")
       exclude("org.apache.hive")
       exclude("org.apache.hbase")
       exclude("org.apache.zookeeper")
       exclude("org.eclipse.jetty.aggregate:jetty-all")
       exclude("org.mortbay.jetty")
       exclude("org.mortbay.jetty:jetty")
       exclude("org.mortbay.jetty:jetty-util")
       exclude("org.mortbay.jetty:jetty-sslengine")
       exclude("it.unimi.dsi")
       exclude("com.ververica")
       exclude("org.apache.hadoop")
       exclude("org.apache.commons")
       exclude("org.xerial.snappy")
       exclude("com.github.luben")
       exclude("com.google.protobuf")
       exclude("joda-time")
       exclude("org.apache.parquet:parquet-jackson")
       exclude("org.apache.parquet:parquet-format-structures")
       exclude("org.apache.parquet:parquet-encoding")
       exclude("org.apache.parquet:parquet-common")
       exclude("org.apache.parquet:parquet-hadoop")
     }
   ```


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: [email protected]

For queries about this service, please contact Infrastructure at:
[email protected]

Reply via email to