iam11shan opened a new pull request, #283:
URL: https://github.com/apache/seatunnel-web/pull/283
**Description**
This PR adds comprehensive support for Iceberg data sources to SeaTunnel
Web, along with a minor cleanup of redundant log statements. The key changes
include:
**Main Feature: Iceberg Data Source Support**
- **New Files**:
- `IcebergDataSourceChannel.java`: Handles Iceberg data source connections
and operations.
- `IcebergDataSourceConfigSwitcher.java`: Manages configuration switching
for Iceberg data sources.
- `IcebergDataSourceFactory.java`: Factory class for creating Iceberg data
source instances.
- `IcebergOptionRule.java`: Defines option rules specific to Iceberg data
sources.
- `IcebergRequestParamsUtils.java`: Utility class for processing Iceberg
request parameters.
- **Modified Files**:
- `DatasourceLoadConfig.java`: Added configuration to load Iceberg data
source factory.
- `EngineDataType.java`: Added support for Iceberg-specific data types.
- **Configuration Updates**:
- Updated `pom.xml` to include Iceberg-related dependencies and modules.
**Minor Cleanup**
- Removed redundant log statements to improve code readability and
maintainability.
**Why this is needed**
Adding Iceberg data source support expands SeaTunnel's capabilities,
allowing users to connect to Iceberg tables and perform data operations
efficiently. This enhancement is important for users working with Iceberg data
lakes. The log cleanup ensures the codebase remains clean and free of
unnecessary verbosity.
**Benefits**
- **Enhanced Functionality**: Users can now seamlessly integrate Iceberg
data sources into their workflows.
- **Improved Readability**: The code is cleaner and easier to understand.
- **Better Debugging**: Logs now contain only relevant information, making
it easier to identify and debug issues.
**Testing**
- Unit tests have been added to cover the new Iceberg data source
functionality.
- Manual testing was performed to ensure no critical information is missing
from the logs.
- All existing tests pass with the new changes.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: [email protected]
For queries about this service, please contact Infrastructure at:
[email protected]
