JingsongLi opened a new pull request, #9470:
URL: https://github.com/apache/paimon/pull/9470

   ### Purpose
   
   Improve the readability, maintainability, performance, and cross-language 
compatibility of the recently added video storage implementation.
   
   - Reuse the common Java rolling-writer lifecycle and keep only video 
group-boundary policy in VideoRollingFileWriter.
   - Centralize descriptor dispatch and physical-video identity in Java and 
PyPaimon.
   - Model video-frame-field as a scalar setting and pass BlobFileContext as 
one coherent writer configuration.
   - Preserve Arrow batching across contiguous physical-video runs instead of 
processing every frame as a one-row batch.
   - Expose positional BLOB reads through FormatBlobReader and split video 
index/iterator code into a dedicated module.
   - Make VideoFrameCollator release every cached resource even if one decoder 
close fails.
   - Add Java/Python shared golden fixtures for VideoFrameDescriptor and .video 
v1 wire compatibility.
   
   ### Tests
   
   - mvn targeted tests: VideoFrameDescriptorTest, VideoFileFormatTest, 
CoreOptionsTest, SchemaValidationTest, and BlobTableTest video 
rolling/compaction cases
   - mvn -pl paimon-common,paimon-format,paimon-core -am -DskipTests compile
   - mvn -N -DskipTests apache-rat:check
   - PyPaimon video/blob/data-evolution tests: 66 passed, 10 subtests passed
   - PyPaimon multimodal table tests: 74 passed, 2 skipped
   - flake8 on all changed Python files


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: [email protected]

For queries about this service, please contact Infrastructure at:
[email protected]

Reply via email to