imbajin opened a new pull request, #785: URL: https://github.com/apache/hugegraph-toolchain/pull/785
## Purpose of the PR Spark Loader previously captured non-serializable partition state and mixed Loader and Spark submit options. It now uses partition-owned writers and explicit Java 17 application/runtime classpaths. Original preparation and ongoing review: https://github.com/hugegraph/hugegraph-toolchain/pull/38. This PR uses the exact same organization branch, so subsequent branch fixes update both PRs. Required predecessors: https://github.com/apache/hugegraph-toolchain/pull/783. This PR targets ASF master and currently includes unmerged prerequisites. Review the module delta in the linked organization PR; merge predecessors first, then verify the upstream diff, required checks and reviews before merging. The prerequisite-union branch is an integration aid, not another merge unit. ## Main Changes - Serialize only partition inputs and restore the supported structured CSV/TEXT parsing path. - Preserve dry-run without graph mutations and propagate invalid option failures as unsuccessful process exits. - Forward extra drivers through explicit --jars and reject unsupported standalone cluster deploy mode. - Run the packaged API loading job with a separate executor and verify IDs, Unicode values and failure status. ## Verifying these changes Native Java 17 Spark unit, launcher and process-exit checks passed and the actionable organization review threads were resolved. Current-head runtime/CI outcomes remain authoritative. The permissive CSV input contract is retained: extra-field truncation and physical-header limitations are documented. Spark-HBase is excluded; no HBase backend acceptance is required. ## Documentation Status Migration and runtime limitations are documented in the module guides. Review and fixes continue in the organization repository; independent upstream review suggestions will also be read and adopted. No merge, deployment or release is performed by creating this PR. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected] --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
