keksmd opened a new issue, #973: URL: https://github.com/apache/incubator-graphar/issues/973
### Describe the enhancement requested Add the GraphAr write facade that turns a stream of edges into a published GraphAr dataset: vertex and edge chunk files, ordered adjacency, offset chunks, and the metadata that describes them. This is the layer directly above `graphar-core` (#967) and the physical write contract in `graphar-io-api` (#959), and it is what makes a Java-produced dataset readable by the C++ and Spark implementations. Component(s): Java ## Scope - Add `graphar-writer` with a `GraphWriter` facade that accepts edge records and emits a complete GraphAr dataset through the existing `PhysicalWriter` contract. - Cover edge write options (chunk size, ordering, adjacency list type) and reported write statistics. - Keep the writer format-neutral: it must talk to `graphar-io-api` only, never to a concrete format module. - Add unit tests for chunk boundary emission, offset chunk correctness, and rejected option combinations. ## Non-goals No new format backend, no Arrow dependency, no reader facade, no query semantics, and no changes to the physical write contract itself. ## Compatibility and acceptance Output must be byte-compatible with the canonical GraphAr layout: a dataset written by this module loads in the existing implementations without conversion. Java 11 compatible. ## Dependency order This slice depends on `graphar-core` (#967, PR #968) and on a merged physical format backend (#964) to have anything to write through. It should land after both. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected] --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
