Re: [Sursound] ambisonics audio for 360 film (VR)
On 22/07/2015 11:38, Henk | Spook.fm wrote: Dear Surround Sound Discussion Group, ... My question is: Who can help us find the best libraries for ambisonics audio to use in the 360 Video player. So far we have come up with the following: you can seem to play ambisonics files with these: https://github.com/ComposersDesktop/CDP7/tree/b085aa141fa93c98ae137feae5e7c58d656ddfdd/dev/externals/mctools and http://www.mega-nerd.com/libsndfile/ Are these the same? which one would be best for this project? As the author of MCTools I should probably offer an answer. They are basically utilities for assembling, disassembling, recording and playing multichannel files, including but not only AMB; and there they include very vanilla encoding and decoding (regular layouts, no filtering, no binaural). A simple circular (rotating, up to 2nd-order horizontal) pan is available, but no tumble/rotate etc processes. Whereas libsndfile is a comprehensive C library for reading and writing soundfiles in umpteen formats. AMB support (in terms of recognising the file format; no processing) was added some while ago - which is why AMB is now somewhat supported in Adobe Audition. MCTools mostly uses my own minimalist soundfile library "portsf", limited to PCM WAVE and AIFF files (of course including AMB). The link above is for the sources, as included with the Open-Source CDP distribution. Binaries (OS X, Windows) for MCTools can be got here: http://people.bath.ac.uk/masrwd/mctools.html Richard Dobson ___ Sursound mailing list Sursound@music.vt.edu https://mail.music.vt.edu/mailman/listinfo/sursound - unsubscribe here, edit account or options, view archives and so on.
Re: [Sursound] ambisonics audio for 360 film (VR)
Hi there - you may be interested in this. Just did a test of converting the soundtrack of an Ambisonic full-dome show to binaural using the Ambi-X plugins (that has a rotate in the suite that we are checking out for a VR version). 1st Order > Binaural using 5.1 preset. Be great to know what people think! https://soundcloud.com/jakeone/soundtrack-to-fragments-binaural-test-listen-on-headphones <https://soundcloud.com/jakeone/soundtrack-to-fragments-binaural-test-listen-on-headphones> Ambi-X: http://www.matthiaskronlachner.com/?p=2015 <http://www.matthiaskronlachner.com/?p=2015> Cheers J/ Jake Williams +44 7932 645145 http://www.jakeone.co.uk http://www.fliesandflies.com > On 22 Jul 2015, at 15:52, Ben Bloomberg wrote: > > It's also worth checking out Richard Furse's libraries. There are quite a > lot of interesting manipulators, along with various renderers for many > different platforms. We have been very happy. > > http://www.blueripplesound.com/ > > Ben > > On Wed, Jul 22, 2015 at 10:50 AM, David McGriffy wrote: > >> Henk, >> >> Sounds like a fun project. I have run into some other folks using the >> Kolor Eyes player as well. >> >> I may have just the thing for your new player. I have been working for a >> while on a new ambisonic library I'm calling VVSDK. It does all the things >> you need, rotate, decode, binaural, and can include my latest A to B-Format >> conversion code. >> >> Early versions are already in use in the VR and acoustic measurement >> communities and I use the same library as the back end for my own new >> plugins. All this and more should be generally available as soon as I can >> do the tedious bits like choosing license types, upgrading websites, etc., >> but I am ready to talk about individual projects such as yours immediately. >> >> David McGriffy >> vvaudio.com >> >> On Wed, Jul 22, 2015 at 9:30 AM, Marc Lavallée wrote: >> >>> Hello Henk. >>> >>> On Wed, 22 Jul 2015 12:38:53 +0200, "Henk | Spook.fm" wrote : >>>> My question is: Who can help us find the best libraries for >>>> ambisonics audio to use in the 360 Video player. >>> >>> I started a similar project, for the web: http://ambisonic.xyz/ >>> A new version (working, but not yet published) will be "full sphere". >>> >>>> So far we have come up with the following: >>>> >>>> you can seem to play ambisonics files with these: >>>> >>> >> https://github.com/ComposersDesktop/CDP7/tree/b085aa141fa93c98ae137feae5e7c58d656ddfdd/dev/externals/mctools >>>> and >>>> http://www.mega-nerd.com/libsndfile/ >>>> >>>> Are these the same? >>> >>> Short answer: no. >>> >>>> which one would be best for this project? >>> >>> I created a batch processor to convert and compress ambisonic files, >>> using a combination of command-line utilities from the mctools and >>> libsndfile, and others. To be published, eventually... >>> >>>> Are there other options for rotation? People have experience with >>>> these libraries? Which one would be best for this project? >>> >>> I use the h1b_rotate.dsp Faust processor from ADT (by Aaron Heller): >>> https://bitbucket.org/ambidecodertoolbox/adt/ >>> It provides a rotation transformation for each axis (yaw, pitch, roll). >>> >>>> Where can I find the best HRTFs? >>> >>> Try the ones from the ATK "kernels". >>> >>>> Which one is a good starting point for the “average” head? >>> >>> From the ATK kernels, there's the HRIRs based on the "spherical" model >>> by Richard O. Duda (number 4 is the average, other variations >>> correspond to smaller and bigger spheres). >>> >>> Try my player on ambisonic.xyz... >>> >>> There's also the hb1_to_binaural.dsp Faust processor from ADT, also >>> based on the spherical model. The spherical model is is for "horizontal >>> only" decoding, but for interactive media it's not a serious problem. >>> >>>> If anyone has some suggestions or tips for this project it is very >>>> much appreciated. >>> >>> I hope it helps. >>> >>>> I will keep this group informed about future progress. >>> >>> Please do! >>> >>> Marc >>> >>>> >>>> thank you,
Re: [Sursound] ambisonics audio for 360 film (VR)
It's also worth checking out Richard Furse's libraries. There are quite a lot of interesting manipulators, along with various renderers for many different platforms. We have been very happy. http://www.blueripplesound.com/ Ben On Wed, Jul 22, 2015 at 10:50 AM, David McGriffy wrote: > Henk, > > Sounds like a fun project. I have run into some other folks using the > Kolor Eyes player as well. > > I may have just the thing for your new player. I have been working for a > while on a new ambisonic library I'm calling VVSDK. It does all the things > you need, rotate, decode, binaural, and can include my latest A to B-Format > conversion code. > > Early versions are already in use in the VR and acoustic measurement > communities and I use the same library as the back end for my own new > plugins. All this and more should be generally available as soon as I can > do the tedious bits like choosing license types, upgrading websites, etc., > but I am ready to talk about individual projects such as yours immediately. > > David McGriffy > vvaudio.com > > On Wed, Jul 22, 2015 at 9:30 AM, Marc Lavallée wrote: > > > Hello Henk. > > > > On Wed, 22 Jul 2015 12:38:53 +0200, "Henk | Spook.fm" wrote : > > > My question is: Who can help us find the best libraries for > > > ambisonics audio to use in the 360 Video player. > > > > I started a similar project, for the web: http://ambisonic.xyz/ > > A new version (working, but not yet published) will be "full sphere". > > > > > So far we have come up with the following: > > > > > > you can seem to play ambisonics files with these: > > > > > > https://github.com/ComposersDesktop/CDP7/tree/b085aa141fa93c98ae137feae5e7c58d656ddfdd/dev/externals/mctools > > > and > > > http://www.mega-nerd.com/libsndfile/ > > > > > > Are these the same? > > > > Short answer: no. > > > > > which one would be best for this project? > > > > I created a batch processor to convert and compress ambisonic files, > > using a combination of command-line utilities from the mctools and > > libsndfile, and others. To be published, eventually... > > > > > Are there other options for rotation? People have experience with > > > these libraries? Which one would be best for this project? > > > > I use the h1b_rotate.dsp Faust processor from ADT (by Aaron Heller): > > https://bitbucket.org/ambidecodertoolbox/adt/ > > It provides a rotation transformation for each axis (yaw, pitch, roll). > > > > > Where can I find the best HRTFs? > > > > Try the ones from the ATK "kernels". > > > > > Which one is a good starting point for the “average” head? > > > > From the ATK kernels, there's the HRIRs based on the "spherical" model > > by Richard O. Duda (number 4 is the average, other variations > > correspond to smaller and bigger spheres). > > > > Try my player on ambisonic.xyz... > > > > There's also the hb1_to_binaural.dsp Faust processor from ADT, also > > based on the spherical model. The spherical model is is for "horizontal > > only" decoding, but for interactive media it's not a serious problem. > > > > > If anyone has some suggestions or tips for this project it is very > > > much appreciated. > > > > I hope it helps. > > > > > I will keep this group informed about future progress. > > > > Please do! > > > > Marc > > > > > > > > thank you, > > > > > > Henk van Engelen > > > > > > Rapenburgerstraat 109 > > > 1011 VL Amsterdam > > > > > > T: +3161694 > > > M: h...@spook.fm > > > > > > Spook.fm | Facebook > > > > > > -- next part -- > > > An HTML attachment was scrubbed... > > > URL: > > > < > > > https://mail.music.vt.edu/mailman/private/sursound/attachments/20150722/429aad75/attachment.html > > > > > > -- next part -- A non-text attachment was > > > scrubbed... Name: spookfm-logo-email handtekening.gif > > > Type: image/gif > > > Size: 2129 bytes > > > Desc: not available > > > URL: > > > < > > > https://mail.music.vt.edu/mailman/private/sursound/attachments/20150722/429aad75/attachment.gif > > > > > > ___ Sursound mailing list > > > Sursound@music.vt.edu > > > https://mail.m
Re: [Sursound] ambisonics audio for 360 film (VR)
Henk, Sounds like a fun project. I have run into some other folks using the Kolor Eyes player as well. I may have just the thing for your new player. I have been working for a while on a new ambisonic library I'm calling VVSDK. It does all the things you need, rotate, decode, binaural, and can include my latest A to B-Format conversion code. Early versions are already in use in the VR and acoustic measurement communities and I use the same library as the back end for my own new plugins. All this and more should be generally available as soon as I can do the tedious bits like choosing license types, upgrading websites, etc., but I am ready to talk about individual projects such as yours immediately. David McGriffy vvaudio.com On Wed, Jul 22, 2015 at 9:30 AM, Marc Lavallée wrote: > Hello Henk. > > On Wed, 22 Jul 2015 12:38:53 +0200, "Henk | Spook.fm" wrote : > > My question is: Who can help us find the best libraries for > > ambisonics audio to use in the 360 Video player. > > I started a similar project, for the web: http://ambisonic.xyz/ > A new version (working, but not yet published) will be "full sphere". > > > So far we have come up with the following: > > > > you can seem to play ambisonics files with these: > > > https://github.com/ComposersDesktop/CDP7/tree/b085aa141fa93c98ae137feae5e7c58d656ddfdd/dev/externals/mctools > > and > > http://www.mega-nerd.com/libsndfile/ > > > > Are these the same? > > Short answer: no. > > > which one would be best for this project? > > I created a batch processor to convert and compress ambisonic files, > using a combination of command-line utilities from the mctools and > libsndfile, and others. To be published, eventually... > > > Are there other options for rotation? People have experience with > > these libraries? Which one would be best for this project? > > I use the h1b_rotate.dsp Faust processor from ADT (by Aaron Heller): > https://bitbucket.org/ambidecodertoolbox/adt/ > It provides a rotation transformation for each axis (yaw, pitch, roll). > > > Where can I find the best HRTFs? > > Try the ones from the ATK "kernels". > > > Which one is a good starting point for the “average” head? > > From the ATK kernels, there's the HRIRs based on the "spherical" model > by Richard O. Duda (number 4 is the average, other variations > correspond to smaller and bigger spheres). > > Try my player on ambisonic.xyz... > > There's also the hb1_to_binaural.dsp Faust processor from ADT, also > based on the spherical model. The spherical model is is for "horizontal > only" decoding, but for interactive media it's not a serious problem. > > > If anyone has some suggestions or tips for this project it is very > > much appreciated. > > I hope it helps. > > > I will keep this group informed about future progress. > > Please do! > > Marc > > > > > thank you, > > > > Henk van Engelen > > > > Rapenburgerstraat 109 > > 1011 VL Amsterdam > > > > T: +3161694 > > M: h...@spook.fm > > > > Spook.fm | Facebook > > > > -- next part -- > > An HTML attachment was scrubbed... > > URL: > > < > https://mail.music.vt.edu/mailman/private/sursound/attachments/20150722/429aad75/attachment.html > > > > -- next part -- A non-text attachment was > > scrubbed... Name: spookfm-logo-email handtekening.gif > > Type: image/gif > > Size: 2129 bytes > > Desc: not available > > URL: > > < > https://mail.music.vt.edu/mailman/private/sursound/attachments/20150722/429aad75/attachment.gif > > > > ___ Sursound mailing list > > Sursound@music.vt.edu > > https://mail.music.vt.edu/mailman/listinfo/sursound - unsubscribe > > here, edit account or options, view archives and so on. > > ___ > Sursound mailing list > Sursound@music.vt.edu > https://mail.music.vt.edu/mailman/listinfo/sursound - unsubscribe here, > edit account or options, view archives and so on. > -- next part -- An HTML attachment was scrubbed... URL: <https://mail.music.vt.edu/mailman/private/sursound/attachments/20150722/5947f0e9/attachment.html> ___ Sursound mailing list Sursound@music.vt.edu https://mail.music.vt.edu/mailman/listinfo/sursound - unsubscribe here, edit account or options, view archives and so on.
Re: [Sursound] ambisonics audio for 360 film (VR)
Hello Henk. On Wed, 22 Jul 2015 12:38:53 +0200, "Henk | Spook.fm" wrote : > My question is: Who can help us find the best libraries for > ambisonics audio to use in the 360 Video player. I started a similar project, for the web: http://ambisonic.xyz/ A new version (working, but not yet published) will be "full sphere". > So far we have come up with the following: > > you can seem to play ambisonics files with these: > https://github.com/ComposersDesktop/CDP7/tree/b085aa141fa93c98ae137feae5e7c58d656ddfdd/dev/externals/mctools > and > http://www.mega-nerd.com/libsndfile/ > > Are these the same? Short answer: no. > which one would be best for this project? I created a batch processor to convert and compress ambisonic files, using a combination of command-line utilities from the mctools and libsndfile, and others. To be published, eventually... > Are there other options for rotation? People have experience with > these libraries? Which one would be best for this project? I use the h1b_rotate.dsp Faust processor from ADT (by Aaron Heller): https://bitbucket.org/ambidecodertoolbox/adt/ It provides a rotation transformation for each axis (yaw, pitch, roll). > Where can I find the best HRTFs? Try the ones from the ATK "kernels". > Which one is a good starting point for the “average” head? From the ATK kernels, there's the HRIRs based on the "spherical" model by Richard O. Duda (number 4 is the average, other variations correspond to smaller and bigger spheres). Try my player on ambisonic.xyz... There's also the hb1_to_binaural.dsp Faust processor from ADT, also based on the spherical model. The spherical model is is for "horizontal only" decoding, but for interactive media it's not a serious problem. > If anyone has some suggestions or tips for this project it is very > much appreciated. I hope it helps. > I will keep this group informed about future progress. Please do! Marc > > thank you, > > Henk van Engelen > > Rapenburgerstraat 109 > 1011 VL Amsterdam > > T: +3161694 > M: h...@spook.fm > > Spook.fm | Facebook > > -- next part -- > An HTML attachment was scrubbed... > URL: > <https://mail.music.vt.edu/mailman/private/sursound/attachments/20150722/429aad75/attachment.html> > -- next part -- A non-text attachment was > scrubbed... Name: spookfm-logo-email handtekening.gif > Type: image/gif > Size: 2129 bytes > Desc: not available > URL: > <https://mail.music.vt.edu/mailman/private/sursound/attachments/20150722/429aad75/attachment.gif> > ___ Sursound mailing list > Sursound@music.vt.edu > https://mail.music.vt.edu/mailman/listinfo/sursound - unsubscribe > here, edit account or options, view archives and so on. ___ Sursound mailing list Sursound@music.vt.edu https://mail.music.vt.edu/mailman/listinfo/sursound - unsubscribe here, edit account or options, view archives and so on.
[Sursound] ambisonics audio for 360 film (VR)
Dear Surround Sound Discussion Group, I have been following the emails here for a few months now. Thank you all very much for sharing and discussion. My name is Henk van Engelen and I work for the music and audio production company spook.fm in Amsterdam. We have been working on sound design and audio production for 360 film (cinematic VR). Along the way we have developed some tools and a workflow to watch and rotate a 360 video on your desktop (in Kolor Eyes) and sync play state & pitch/yaw of the corresponding ambisonics sound field in Reaper (with ATK rotate plugin). We will share some tools and templates for this in the next week or two: we are working on some tutorial vids. The idea is that we can deliver our clients a b-format mix (for spatial/positional audio) together with a stereo mix (for music, non spatial audio). We are involved in a project to make a VR video player. In this player we very much want to add direct support for ambisonics audio with binaural decoding (and maybe stereo decoding for desktop use), and a synced stereo track for the non positional audio (like music). With this project we hope to open up the possibilities of using ’native’ b-format for the VR market and all the great (vst) software for your DAW that is already available. My question is: Who can help us find the best libraries for ambisonics audio to use in the 360 Video player. So far we have come up with the following: you can seem to play ambisonics files with these: https://github.com/ComposersDesktop/CDP7/tree/b085aa141fa93c98ae137feae5e7c58d656ddfdd/dev/externals/mctools and http://www.mega-nerd.com/libsndfile/ Are these the same? which one would be best for this project? Then we need to be able to rotate the sound field. I found the rotate class of this one: http://www.mshparisnord.fr/hoalibrary/telechargements/code-source/ but it seems to be only rotating around one axis (Yaw). I really would like to rotate around all three. I also found this one: https://github.com/greekgoddj/ambisonic-lib unfortunately this library does not seem to be very well kept and supports only mac Are there other options for rotation? People have experience with these libraries? Which one would be best for this project? Step three is the binaural (and maybe stereo) decoding. We are thinking of using the HOAlibrary for this. Where can I find the best HRTFs? Which one is a good starting point for the “average” head? If anyone has some suggestions or tips for this project it is very much appreciated. I will keep this group informed about future progress. thank you, Henk van Engelen Rapenburgerstraat 109 1011 VL Amsterdam T: +3161694 M: h...@spook.fm Spook.fm | Facebook -- next part -- An HTML attachment was scrubbed... URL: <https://mail.music.vt.edu/mailman/private/sursound/attachments/20150722/429aad75/attachment.html> -- next part -- A non-text attachment was scrubbed... Name: spookfm-logo-email handtekening.gif Type: image/gif Size: 2129 bytes Desc: not available URL: <https://mail.music.vt.edu/mailman/private/sursound/attachments/20150722/429aad75/attachment.gif> ___ Sursound mailing list Sursound@music.vt.edu https://mail.music.vt.edu/mailman/listinfo/sursound - unsubscribe here, edit account or options, view archives and so on.
