How should video files with audio be handled by parsers?

[Nick Burch]

Hi All

Does anyone know if we have a recommended way / plan of a way to handle 
video files with possibly multiple audio streams?

Most of the multimedia container formats support video and zero or one 
audio streams, and a fair number support video and multiple audio streams. 
A few can actually hold multiple video and multiple audio. Some can tell 
you the relationship between the streams (eg video 0 = main video, video 1 
= subtitle overlay, audio 0 = english, audio 1 = french, audio 2 = english 
commentary). Some you just find what's there, and have to guess how it 
fits together.

So, now I'm looking at adding some basic video parsing support into the 
Ogg stuff, how should I be having the parser report the metadata and 
content for streams with both video and audio?

(Currently, MP4Parser looks to have "TODO Decide how to handle multiple 
tracks", and just dumps the audio information into the metadata along 
with the video)

Nick