keksmd opened a new issue, #959:
URL: https://github.com/apache/incubator-graphar/issues/959
Part of #947.
The layering agreed in #947 puts a physical IO boundary between the GraphAr
reader/writer and any concrete file format. Before either vertical can be
built, the project needs one description of a row group that names no format:
a column type, a schema, a row, a batch, and a cursor over batches.
Scope:
- `ColumnType`, `Field`, `Schema` — neutral, recursive type description.
- `Row`, `RecordBatch`, `BatchCursor` — row access with one documented Java
value mapping per column kind.
- `WriteRequest`, `WriteMode`, `PhysicalWriter` — the write half of the
boundary, which shares every one of the types above.
Non-goals for this issue:
- The read request (projection, filter, row range, capability reporting) and
`PhysicalReader`, which follow as their own issue against this base.
- Arrow as the public batch representation.
- Any GraphAr layout, chunking, or query semantics.
The module must not depend on any other GraphAr module.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: [email protected]
For queries about this service, please contact Infrastructure at:
[email protected]
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
