Jump to content

Anyone have any experience/encounters with Binaural (3D Stereo) Audio?


Nabeel Ansari
 Share

Recommended Posts

Hey guys,

I'm working for a company and we're developing an open source C++ API for game devs. One of the big features we're going to implement is Binaural Audio (3D HRTF-transformed to stereo) and I was wondering what kind of impression Binaural Audio has in the general community.

I'm talking about stuff like the

. Think combining it with Oculus Rift; very immersive. We're also targeting mobile games. Think GPS, large-scale social audio games (travelling to and from sound sources, for example)

Have you ever tried it, heard of it, worked with it, tried to create it, etc. Tell me anything even if it's just "This is a cool idea!" or "This is a terrible idea!", because I'd like to know about the awareness level (that this is something games can be doing and are starting to try).

Link to comment
Share on other sites

Horror game use is indeed very obvious and attractive.

How about subtly mixing in binaural beats, hehe. Then see if a percentage of gamers trip out while playing the game.

Got a question regarding this that sort of fits in here...anyone tried out some binaural beat mixes on headphones and got a noteworthy effect of any kind? Beyond it just sounding weird?

Link to comment
Share on other sites

There is a ton of research in this field in academia:

http://mtg.upf.edu/system/files/publications/Schmele-Timothy-Master-thesis-2011.pdf

Some of the people listed in thank you section of this have extensive research in this subject. Better break out Google Scholar and do some reading.

Before you go down this road, keep in mind speaker placement and frequency reproduction of the speakers will have a drastic affect on head related transfer functions. (HRTF) While in grad school I have listened to pieces/textural compositions that were able to do this, and some that failed miserably.

A good thing to study is also some of the magic frequencies that have a great perception on our perception of sound. Strong content at 8kHz will make a sound feel like it is sitting on top of your head. Try boosting that on a lead synth sound in track sometime, works wonders.

Link to comment
Share on other sites

We have a few DSP grad students on the team and yeah, we've been scrounging Google for HRTF implementation stuff. There's decades/tons of research, experiments, math analysis, but as far as code/computational examples, the only ones we can find are commercial game/sound libraries. We're creating our API under LGPL/MIT type license and we want developers to be able to commercially use it without restriction or fees, so we can't make use of anything that isn't free and completely open.

This may end up being a case of us writing our own implementation. We have the team for it, we just need to evaluate what's the best option.

One thing I can say is that we're not at all going to plan on speaker support; as you said, HRTF stuff just gets way way messed up. We're targeting mobile games (people with ear buds) and PC games (PC gamers usually have headsets or phones)

Link to comment
Share on other sites

Join the conversation

You can post now and register later. If you have an account, sign in now to post with your account.

Guest
Reply

×   Pasted as rich text.   Paste as plain text instead

  Only 75 emoji are allowed.

×   Your link has been automatically embedded.   Display as a link instead

×   Your previous content has been restored.   Clear editor

×   You cannot paste images directly. Upload or insert images from URL.

 Share

×
×
  • Create New...