goutamadwant opened a new pull request, #13093:
URL: https://github.com/apache/seatunnel/pull/13093

   ### Purpose of this pull request
   
   Related to #10753.
   
   This contribution to Apache SeaTunnel adds a bounded Mixpanel source using 
the Raw Event Export API, reusing the existing HTTP and JSON infrastructure.
   
   - Stream JSONL events for a configured inclusive date range without 
buffering the complete export.
   - Support service-account authentication, regional endpoints and schema 
field mapping.
   - Bound individual event sizes, timeouts and retry budgets; handle HTTP 429 
and server errors before consuming the export.
   - Keep network operations and completion callbacks outside checkpoint locks, 
with cancellation and incomplete-response cleanup.
   - Add plugin registration, distribution configuration, English and Chinese 
documentation, and Zeta E2E coverage.
   
   ### Does this PR introduce _any_ user-facing change?
   
   Yes. Users can configure `Mixpanel` as a bounded batch source with 
`username`, `password`, `project_id`, `from_date`, `to_date` and a schema.
   
   The first implementation uses one reader. Recovery replays the configured 
export window; it does not provide incremental CDC or exactly-once delivery. 
Partial or malformed exports fail rather than silently dropping events. 
Existing connectors are unchanged.
   
   ### How was this patch tested?
   
   - Reproduced missing factory discovery before implementation; the unchanged 
probe discovers the new factory afterward.
   - Passed 24 focused tests on JDK 11 and 24 on JDK 17, covering 
configuration, mapping, large exports, malformed/oversized events, retries, 
cancellation, cleanup and checkpoint/completion locking.
   - Passed Zeta Docker E2E with engine retries disabled: empty HTTP 429 and 
503 responses followed by three events, terminal FINISHED status and exact 
row/request assertions. A checkpoint must complete while the response remains 
open.
   - Passed adjacent HTTP-base tests on JDK 11 and 17, plus focused Asana and 
PostHog tests on JDK 11.
   - Passed scoped builds, verification and `spotless:apply`. Self-review and 
independent correctness/security reviews completed.
   
   Reproduction commands:
   - With each JDK selected through `JAVA_HOME`: `mvn -pl 
:connector-http-mixpanel test`
   - Build E2E dependencies: `mvn -Pci -pl :connector-mixpanel-e2e -am 
-DskipUT=true -DskipIT=true -Dskip.ui=true install`
   - Run integration test: `RUN_ENGINES=zeta mvn -Pci -pl 
:connector-mixpanel-e2e -DskipUT=true -DskipIT=false -Dit.test=MixpanelIT 
verify`
   
   The E2E uses a deterministic HTTP fixture, not a live Mixpanel account. 
Live-service acceptance, Flink/Spark E2E, crash/restart recovery and 
full-repository verification were not run. Hosted CI is queued at submission.
   
   ### Check list
   
   * [x] No new third-party binary dependencies; existing HTTP/JSON 
dependencies are reused.
   * [x] Updated English and Chinese documentation and connector changelogs.
   * [x] No incompatible changes to existing behavior; no 
`incompatible-changes.md` update required.
   * [x] Updated connector integration files:
     1. `plugin-mapping.properties`
     2. `seatunnel-dist/pom.xml`
     3. `.github/workflows/labeler/label-scope-conf.yml`
     4. Connector E2E module and tests
     5. `config/plugin_config`
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: [email protected]

For queries about this service, please contact Infrastructure at:
[email protected]

Reply via email to