leaves12138 opened a new pull request, #7837:
URL: https://github.com/apache/paimon/pull/7837

   ## Summary
   
   - Sync Python BLOB support with the BlobView work reviewed in #7602, #7786, 
and #7827.
   - Add Python BlobViewStruct / BlobView wire-format support and the 
blob-view-field option.
   - Store descriptor/view BLOB fields inline, validate bad inline field 
configuration and payloads, and avoid writing new .blob files for view fields.
   - Resolve blob-view fields during reads through catalog-aware lookup, 
returning bytes by default or upstream BlobDescriptor bytes when 
blob-as-descriptor=true.
   
   ## Codex
   
   This PR was prepared and submitted by Codex.
   
   ## Validation
   
   - PYTHONPATH=paimon-python pytest -q 
paimon-python/pypaimon/tests/blob_test.py::BlobTest::test_blob_view_struct_roundtrip
   - PYTHONPATH=paimon-python pytest -q 
paimon-python/pypaimon/tests/blob_table_test.py::DataBlobWriterTest::test_blob_view_fields_resolve_upstream_blob
 
paimon-python/pypaimon/tests/blob_table_test.py::DataBlobWriterTest::test_blob_view_fields_rejects_non_view_input
 
paimon-python/pypaimon/tests/blob_table_test.py::DataBlobWriterTest::test_blob_inline_fields_reject_overlap_and_unknown_fields
 
paimon-python/pypaimon/tests/blob_table_test.py::DataBlobWriterTest::test_blob_descriptor_fields_mixed_mode
 
paimon-python/pypaimon/tests/blob_table_test.py::DataBlobWriterTest::test_to_arrow_batch_reader
 
paimon-python/pypaimon/tests/blob_table_test.py::DataBlobWriterTest::test_blob_descriptor_fields_rejects_non_descriptor_input
   - PYTHONPATH=paimon-python python3 -m flake8 
--config=paimon-python/dev/cfg.ini paimon-python/pypaimon/table/row/blob.py 
paimon-python/pypaimon/common/options/core_options.py 
paimon-python/pypaimon/schema/schema.py 
paimon-python/pypaimon/write/writer/data_blob_writer.py 
paimon-python/pypaimon/read/reader/data_file_batch_reader.py 
paimon-python/pypaimon/read/reader/blob_descriptor_convert_reader.py 
paimon-python/pypaimon/utils/blob_view_lookup.py 
paimon-python/pypaimon/tests/blob_test.py 
paimon-python/pypaimon/tests/blob_table_test.py
   - python3 -m compileall -q paimon-python/pypaimon/table/row/blob.py 
paimon-python/pypaimon/common/options/core_options.py 
paimon-python/pypaimon/schema/schema.py 
paimon-python/pypaimon/write/writer/data_blob_writer.py 
paimon-python/pypaimon/read/reader/data_file_batch_reader.py 
paimon-python/pypaimon/read/reader/blob_descriptor_convert_reader.py 
paimon-python/pypaimon/utils/blob_view_lookup.py
   - git diff --check
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: [email protected]

For queries about this service, please contact Infrastructure at:
[email protected]

Reply via email to