Davis-Zhang-Onehouse opened a new pull request, #20727:
URL: https://github.com/apache/hudi/pull/20727

   ### Describe the issue this Pull Request addresses
   
   issue: #20726
   Part of #20683, RFC-118 (#20684).
   Stacked on #20725: review only the last commit. Until the PRs below it 
merge, this PR also shows their commits.
   
   Transcript chunks from a video's audio track: the video frame preprocessor 
also emits speech rows, timed against the video timeline (including delayed and 
trimmed tracks), plus the video frame heap check, the speech round and opt-in 
memory cells of the speech round.
   
   ### Summary and Changelog
   
   - The video frame preprocessor also emits speech rows from the video's audio 
track, timed against the video timeline, including delayed and trimmed audio 
tracks.
   - Video frame heap check, truncated-video handling for speech, and an audio 
codec matrix.
   - The speech embedding round and opt-in memory cells of the speech round 
(`-Dspeech.memory.cells`, not run by default CI).
   - 14 test classes (12 new). The remaining speech test clips are regenerated 
by `video/generate-av-fixtures.sh`.
   
   No code was copied from other projects.
   
   Known limitation, fixed by the next PR: at this position the opt-in memory 
cells speech-long, speech-many and speech-length-light fail their task-spread 
assertions (videos land on fewer prep tasks than the cells expect); 
speech-light passes. The next PR's size/type-aware prep balancing spreads them 
evenly and all of them pass there.
   
   ### Impact
   
   Videos yield speech chunks as well as frames. No change outside the new 
source.
   
   ### Risk Level
   
   low: new code paths of the new source. Verified on JDK 11 / Spark 3.5 / 
Scala 2.12 with 87 tests (5 skipped: external model input or opt-in cells), 
module compilation, checkstyle and RAT.
   
   ### Documentation Update
   
   New settings carry their config documentation; a website page follows once 
the chain lands.
   
   ### Contributor's checklist
   
   - [x] Read through [contributor's 
guide](https://hudi.apache.org/contribute/how-to-contribute)
   - [x] Enough context is provided in the sections above
   - [x] Adequate tests were added if applicable
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: [email protected]

For queries about this service, please contact Infrastructure at:
[email protected]

  • [PR] feat(ingest): RFC-118: ... Davis-Zhang-Onehouse (via GitHub) via commits

Reply via email to