This is an automated email from the ASF dual-hosted git repository.
quinnj pushed a change to branch core-rewrite
in repository https://gitbox.apache.org/repos/asf/arrow-julia.git
from 0d6a3bf Read fixed-shape tensors as arrays
add cfe0d2d Write nested columns in typed passes; Pair and Dict rows as
maps
add aec851a Compile the writer's column dispatch once, not per column type
add df8b62a Keep retained construction for storage values and labelled
children
add 06acf47 Rewrite Arrow union columns from typed union rows
add 4fe41fd Pack utf8 from string payloads in branch-free passes
add ee573da Write with ntasks tasks: columns of a batch and compressed
buffers
add 211286a Write dictionaries that grow in layouts every reader accepts
add 6b6ba89 Copy short-string batches while measuring them
add e9866f1 Write API: append to nothing, DataAPI metadata, clearer errors
add 008a2a7 Rewrite union columns through each child's own construction
add eca4625 Refuse strings that are not valid UTF-8, naming the column
and row
add 1d19451 Give a Union only the extension label its members share
add 5522cca Name the column when its values have no Arrow type
add bdfc246 Add a Writing manual page
add 50a9563 Build the writer's task map on the reader's _foreach
add 338f550 Write read nested columns from their stored children
No new revisions were added by this update.
Summary of changes:
docs/make.jl | 1 +
docs/src/index.md | 2 +-
docs/src/manual.md | 220 +-------
docs/src/migration.md | 32 +-
docs/src/writing.md | 300 +++++++++++
src/columnconstruction.jl | 1041 ++++++++++++++++++++++++++++++++++----
src/ipc_write.jl | 220 ++++++--
src/write.jl | 361 +++++++++----
test/arrowtypes_compat_tests.jl | 2 +-
test/compat_tests.jl | 2 +-
test/facade_tests.jl | 149 ++++++
test/incremental_writer_tests.jl | 76 ++-
test/ipc_dictionary_tests.jl | 11 +-
test/nested_writes_tests.jl | 335 ++++++++++++
test/nestedvalues_tests.jl | 6 +-
test/rewrite_regressions.jl | 12 +-
test/runtests.jl | 1 +
test/writer_sink_tests.jl | 2 +-
18 files changed, 2248 insertions(+), 525 deletions(-)
create mode 100644 docs/src/writing.md
create mode 100644 test/nested_writes_tests.jl