chl-wxp opened a new pull request, #10402:
URL: https://github.com/apache/seatunnel/pull/10402

    ### What this PR does                                                       
                                                                                
                                                                     
                                                                                
                                                                                
                                                                      
     Integrates Apache Gravitino as an external metadata service for 
non-relational connectors (Elasticsearch, vector databases, data lakes, etc.). 
Users can now query table schemas via Gravitino REST API instead of manually    
  
     defining complex schema mappings.                                          
                                                                                
                                                                      
                                                                                
                                                                                
                                                                      
     ### Key Changes                                                            
                                                                                
                                                                      
                                                                                
                                                                                
                                                                      
     - Added `MetaLakeFactory` for creating metadata service clients            
                                                                                
                                                                      
     - Added `TableSchemaDiscoverer` interface for schema discovery             
                                                                                
                                                                      
     - Implemented `GravitinoClient` and `GravitinoTableSchemaConvertor`        
                                                                                
                                                                      
     - Supports all Gravitino column types: boolean, integer, long, float, 
double, string, decimal, date, time, timestamp, binary, list, map, etc.         
                                                                           
     - Schema validation is performed on the client side before job submission  
                                                                                
                                                                      
                                                                                
                                                                                
                                                                      
     ### Benefits                                                               
                                                                                
                                                                      
                                                                                
                                                                                
                                                                      
     - No manual schema configuration required                                  
                                                                                
                                                                      
     - Single source of truth for table schemas                                 
                                                                                
                                                                      
     - Better consistency between metadata and actual storage                   
                                                                                
                                                                      
                                                                                
                                                                                
                                                                      
     ### Related Issue                                                          
                                                                                
                                                                      
                                                                                
                                                                                
                                                                      
     Fixes #10339                                                               
                                                                                
                                                                      
                                                                                
                                                                                
                                                                      


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: [email protected]

For queries about this service, please contact Infrastructure at:
[email protected]

Reply via email to