shangeyao opened a new pull request, #4432:
URL: https://github.com/apache/streampark/pull/4432

   ## Summary
   
   Remove the StreamPark development framework ([framework 
docs](https://streampark.apache.org/docs/framework/)) and all connector wrapper 
modules. Console platform runtime (submit/cancel, SQL mode, validation, K8s, 
packaging) is preserved.
   
   Closes #4431.
   
   ## Changes
   
   - Remove `streampark-flink-core` (`FlinkStreaming`, `FlinkTable`, 
`FlinkStreamTable`, `DataStreamExt`)
   - Remove entire `streampark-flink-connector` tree (Kafka, JDBC, ClickHouse, 
Redis, ES, HBase, HTTP, etc.)
   - Remove Spark dev traits (`Spark`, `SparkBatch`, `SparkStreaming`) and 
`streampark-spark-connector`
   - Remove Maven `-Pconnector` profile
   - Refactor `Flink SqlClient` to use `FlinkTableInitializer` + `TableContext` 
/ `StreamTableContext` from shims
   - Add `SparkSqlExecutor` and refactor `Spark SqlClient` accordingly
   
   ## Breaking changes
   
   - User jobs extending StreamPark dev traits must migrate to native 
Flink/Spark APIs
   - User code using `org.apache.streampark.flink.connector.*` or 
`org.apache.streampark.spark.connector.*` must migrate to official connectors
   
   ## Preserved (non-breaking for Console)
   
   - Flink/Spark SQL job submission via `SqlClient`
   - SQL validation (`FlinkSqlValidator`, `SparkSqlValidator`)
   - Flink client, packer, kubernetes, shims
   
   ## Test plan
   
   - [x] `./mvnw -Pfast clean compile -pl 
streampark-flink/streampark-flink-sqlclient,streampark-spark/streampark-spark-sqlclient,streampark-spark/streampark-spark-core
 -am -DskipTests` (JDK 8)
   - [x] `./mvnw -Pfast clean compile -pl 
streampark-console/streampark-console-service -am -DskipTests` (JDK 8)
   - [ ] Full CI
   - [ ] Manual: Console Flink SQL / Spark SQL submit on YARN or K8s
   
   
   Made with [Cursor](https://cursor.com)


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: [email protected]

For queries about this service, please contact Infrastructure at:
[email protected]

Reply via email to