shockwave-sound.com
View Cart | License | Blog | Contact
[ Home ][ Testimonials ][ Help/FAQ ][ Affiliate program ][ CD collections ][ My tags ][ My orders ]

Considering the Aesthetics of Surround Music in Games

By Rob Bridgett


Surround Music: The Emperor's New Clothes?

There has been much talk recently, predominantly among composers, dedicated to the virtues and benefits of surround music in video games. Certainly with the increased memory capacity of next-generation platforms, and a greatly increased install-base of surround sound systems, the prospect of surround score and licensed music seems more feasible than it was on previous generation consoles. While this exciting expansion in the dimensions of the video-games medium offers some fantastic opportunities and new horizons for music in video games, there are also pitfalls which should be carefully considered when designing a game's soundtrack with surround music in mind. Leaving aside any technical aspects of surround music for games (these have been discussed in depth and frequently elsewhere), there are some pertinent questions that need to be asked of when surround music is useful and when it is a needless distraction.


Surround sound systems are getting more and more common in video gaming setups

Diegetic and Non-Diegetic Boundaries

For certain types of games, the notion of surround sound music offers some very particular spatial and aesthetic challenges. In 3D first or third person perspective games (mostly those games which aim to imitate a 'cinematic' sound model), spatialization of music can break the 'non-diegetic contract' between the space occupied by score and sound effects. Non-diegetic music, or score, is not a part of the game world (diegesis). The score is not expected, for example, to get effected by environmental reverbs and it's volume or position is not attenuated according to where the player/listener is positioned. So the spatialization of various instruments or textures within a piece of score, particularly to the rear of the surround-field, can be mistakenly read as a sound effect that is positional in the game-world by the listener. This is due in part to the tonal similarity of much ambient sound design to certain elements of an orchestral score. The same would be the case if the game were set on board a space-ship and the score employed positional ambient electronic bleeps in the rears, there would be a high likelihood that the listener would be unable to determine what was a diegetic sound effect and what was a non-diegetic positional part of the score. If the style of the music and the style of sound effects are too similar, then this spatial confusion can easily arise.

Distraction From Action and Immersion.

Surround sound has a unique function in 3D games as it allows for navigation and essential off-screen action and space to be communicated to the player. Sound effects such as gunshots, dialogue and footsteps coming from positional points actually play a huge role in helping the gamer to play the game and navigate the 3D space effectively. In cinema a very different set of rules apply, anything too prominent in the surrounds is considered a distraction from the screen, essentially having your audience looking behind them towards the exit signs in the theatre to figure out what that sound was. The use of surrounds in film, often tends towards ambience to softly envelop the listener within the diegesis, essentially using sounds that are non distracting. This is a clear, tried-and-tested formula of maintaining immersion in cinema. Similarly, within these specific types of games, anything in the musical score that can be misread by the listener as a sound effect that is physically located behind them, can distract the player and draw their attention to the music.
Not only would music that is making prominent use of surround channels be confusing to the player who is attempting to use the surrounds for navigation and for knowledge of enemy positions etc, it also has great implications for the final mix of all the elements of the game's soundtrack, particularly sound effects and dialogue. With music potentially taking up a wide band of frequency in the rear-field as well as the front, this introduces more clutter into the overall mix of sound effects, dialogue and music and places further demands upon interactive mixing (an area that still needs to make huge leaps technically and artistically in order to catch up with the quality of cinema sound) to compensate and allow the listener to clearly hear dialogue and sound effects at key moments without being overwhelmed by the score.

Where Surround Music Will Work Well...

This is by no means a definitive list, but there are of course many exciting areas where surround music can be exploited in ways that are unique to interactive games and that look away from the cinematic 'film-sound' model. In 3D games, a score that remains as 'underscore', and remains in the 'ambient realm' could work well in a 3D environment. Provided there is nothing to draw the player's attention to the rear field, nothing sudden and unexpected in the score that reads as a sound effect. It is therefore essential that communication between the composer and the sound director occurs to figure out exactly how much activity is required in the rear-field in terms of the score. Again, anything too prominent, and unexpected, runs a high risk of being read as a positional sound effect by the player.

 

Positional sound effects are useful to the player, a cowbell positioned in the rear field of the score is not. Having said this, there are also occasions where the diegetic and non-diegetic 'contract' can be exploited. Having surround elements in the music deliberately 'read' as positional could be used in particularly scary or quiet moments in a game, such as a survival horror, to create some very tangible aspects of tension and confusion. "Was that a sound behind me? Ah no it was just the music! phew... oh damn" etc. It all depends upon the requirements of the game that are placed upon the sound, music and dialogue.

Racing games in particular also offer significant opportunities for use of surround music in games as so much of the action in a racing title is focused on what is directly in front of the player. There is also a direct real-life example and sonic analogy that can be drawn between the player and the listener as though they were sitting in a real car and listening to a surround sound piece of music (from speakers actually placed in the front and in the rear of the vehicle). The only sound effects that the player is also likely to be interested in coming from the rears are the sounds of other cars, not in themselves entirely subtle or hard to mistake for elements of the surround music. Not only this, but the style of music expected in a racing game, that of high-octane, electronic adrenalin-pumping beats, is completely different to a 'score' and can be read and understood more clearly by a listener as 'positional electronic music' as opposed to 'positional sound effects'. It again comes down to a clear difference between style of music (electronic) and style of sound effects (engines).


Racing games offer a real-life analogy of surround music, with speakers often situated in the rear of the car as well as the front.

Another good example is in 2D environments where there is no suggested diegetic rear space for sounds to occupy. One such example is in front-end menus, there is a good opportunity to use surround music there to fill the rear field space. In 2D games there is also a great opportunity to explore the space created with surround music, because, again, there are no implications for confusing 3D sounds with any spatialized music that may be heard.

A third example is diegetic, positional music, i.e. music that is emanating directly from the game world, for example a live band playing in a nightclub. The sounds of the separate instruments could be positioned in 3D at their exact points of origin on the stage, thereby when the player walks around, the balance of the music will change accordingly. The player could even get up on stage and among the musicians to hear the vocalist in front, the drummer coming from the rears, guitar and bass from left and right respectively. There could even be specific audience reactions at a particular moments in the performance positionally coming from the audience space. An 8-channel interleaved stream, with each individual channel mapped to a particular position would cater well for this implementation.


Guitar Hero offer real potential for convincing surround music in games, as it represents an actual on-stage performance, with potential for audience and band spatialization.

Planning Ahead for Surround Music

Deciding on exactly where each element of the soundtrack is to be placed and what belongs to the scene (source sounds / music) and what comes from 'beyond the scene (non-diegetic) is a critical decision to be made up-front by the audio director in conjunction with the game designers before the composer begins their work. Also determining the 'style' and timbre of sound effects and music will help to separate any confusion as to what is music and what is a sound effect. Having a composer write a surround score with specific uses in mind from the beginning will have a great many benefits from suddenly deciding that the music should be up-mixed into surround format when it is all complete. Finally, the type of game will greatly inform many of these decisions, but also thinking about the specifically designed functions of the music within a particular type of game will help to define further creative strategies for the use of surround music in games, and eventually make games a more immersive and interactive experience for gamers. Any decision whether or not to commission a surround score, or surround licensed music content , must first consider all the elements of the finished games' soundtrack together as a single final entity and the effects that this will have on the player.

About the author: Rob Bridgett (of www.sounddesign.org.uk) was one of the first to complete the Master's degree in Sound Design for the Moving Image at Bournemouth University and is currently Senior Sound Director at Radical Entertainment in Vancouver. Work for games includes... 50 Cent: Blood on the Sand (2009) (sound director) , Prototype (2009) (sound mixer & cut-scene sound designer) , Crash: Mind Over Mutant (2008) (sound mixer) , TimeShift (2007) (cut-scene sound designer) , Crash of the Titans (2007) (additional sound design) , World in Conflict (2007) (additional sound design) , Scarface: The World Is Yours (2006) (sound director) , Sudeki (2004) (VG) (additional sound designer) , Serious Sam: Next Encounter (2004) (sound designer & composer) , Vanishing Point (2000) (sound designer).
Other articles you may find useful:
Asset Management: How to keep track of sound clips using metadata and cataloguing. Three ways to build a sound library: Record sounds yourself, or find another way. Timeline of classical composers: Get an overview of the lives and times of classical music maestros. Depth and space in the mix, part 1: How to use reverb, pre-delay, EQ and delay to make your mix better. Depth and space in the mix, part 2: Further tips on improving the sound of your productions. Maximizing composer agreements: How you as a composer for games and other media can get the best out of the contract.
YouTube and music use: How "fingerprinted music" is causing advertisements on your YouTube video. Using Reverb to enhance your production: John Radford on the use and abuse of Reverb in music. Do the work: Music composers' tips and strategies for overcoming procrastination and getting the job done. Sound effects in music composition: How you can use sound FX in music production for games, film, media. Mixing as part of the composing process - part 1: Planning your instrumentation and approach. Mixing as part of the composing process - part 2: Making your sounds and instruments work with your composition to best effect.
Sound for picture - Faking it: Some great tips on making your audience feel they are there. Royalty Free music in 24-bit: Why we are upgrading to High Definition music downloads. Choosing music for a short film project: We look at some options for obtaining your musical score. Choosing music for a Documentary: Help and tips for obtaining your film soundtrack. Tips and Curiosities from Computer Game Music, pt 1: Piotr Koczewski discusses video game music. Tips and Curiosities from Computer Game Music, pt 2: More talk about composing music for video games.
Copyrights in Classical music and Public Domain music: We try to explain why "public domain music" still has rights attached to it. 1 year Shockwave-Sound.com exclusive: Some of our best music can be found only at Shockwave-Sound.com first year. Browse royalty-free music super quick: With our free Demo DVD-ROM you can skim through tracks quickly on your own PC. Getting started with voiceover: Things you need to know if you would like to make a living as a professional voice talent. Sennheiser PXC 450 noise canceling headphones: Video review of these classy noise reducing headphones Surviving your first composing gig: How to handle your client when composing music for video games or film/TV.
Creating radio ads with music and voice: We discuss some good practices and neat tricks for a great sounding ad spot. Recording sound for perspective: Good sound recording practice for a realistic result. Making a long-playing sound or Audio-CD starting out from a short, looping sound file. Creative workflow in Sonar, part 1: Save time and frustration while working in Sonar music production. Surround music in video games: Rob Bridgett discusses the viability and aesthetics of 5.1 sound heaven Shockwave-Sound's sister site for sound-fx
We introduce our new site for listening to and buying sound effects.
Cue the Music, Part 1: Using copyrighted music in your project or presentation Cue the Music, Part 2: We look at Five ways to get music for your project without breaking copyrights. Cue the Music, Part 3: How to use Royalty Free Music to the best effect for your project. Working with audio in Sony Vegas, Part 1: Importing & Timestretching audio files Working with audio in Sony Vegas, Part 2: Adding FX, Mixing & Rendering Audio Files Samson Zoom H4 portable recorder: An in-depth product review of this handy sound recording unit.
How to get music on your web site: We explain how to Embed music on a web page and how to make a Flash that plays music. Music rights terms and expressions: Podcast safe music, Sync License, Royalty Free Music, Performance Rights... Confused yet? Royalty free music explained: What really lies behind this term? We talk a little music licensing history and look at this expression. How to build a music track from loops: Do this to get the "set of music loops" to play as a longer music track YouTube Safe Music: How to find music for your YouTube video and properly credit the composer and publisher. Common myths and misunderstandings about music rights: We try to clear up some of these.
Orchestral MIDI arrangement: A beginner's guide to the Orchestral MIDI Mockup. A guide to virtual pianos: We take a look (and a very close listen) to virtual piano plug-ins. Strengthen your 3D animation with audio: How to use royalty-free music and sound-fx with 3D animation Ideas for Effectively Using Sibelius and Pro Tools 8: We look at ways to streamline and optimize your composing work. Cleaning up noisy dialogue: Get rid of background noise and improve sound quality of voice recordings Interactive Music in Games: We look at ways to make videogame music react and respond to the players actions.
Writing music for games, part 1: Video games composer Kole on some issues to keep in mind. Writing music for games, part 2: Kole dissects another video game music project. Writing music for games, part 3: Finding a way to compose music for Facebook games and stay within the boundaries. Writing music for games, part 4: How to make the most of what little resources you have available. The Cost of Music: Options for filmmakers to source music for their film. Music Production hardware and software tips, part 1: Important issues you need to consider when selecting your tools, computer, CPU, RAM, software etc.
Music Production hardware and software tips, part 2: Useful tips for choosing your hardware for music production. Composing music for cellphones / mobile phones - Part 1: Tips and tricks of the trade. Composing music for mobile phones / cellphones - Part 2: More useful info for producers. Observations of Memorable Themes: We discuss music composition and how to make your melodies memorable. Developing musical ideas in video games - Part 1. Ways of making the music work for the game. Developing musical ideas in video games - Part 2. More thoughts on scoring music for video games.
Ideas for creating unique musical colours: Tips to try to make it sound and feel 'different' Choosing the right classical music, part 1: We recommend 10 pieces of bombastic, powerful, awe inspiring classical music. Choosing the right classical music, part 2: In this part we recommend 10 beautiful, soft, heavenly and emotional classical music tracks      

Would you like to contribute an article to Shockwave-Sound.com? We will pay you $150.00, and we will include your bio, a link to your web site, and if you wish, a quick plug of your product or service. Shockwave-Sound.com is used by almost 4,000 unique visitors every day. Contact us if you have an article idea/pitch for us that you feel is useful, relevant and well written. First, though, you may want to read this blog post about article requirements.

Copyright notice: This article and all other text on this web site is under Copyright to Shockwave-Sound.com. This text may not be copied, re-printed, re-published, in print or electronically, in whole or in part, without written permission from Shockwave-Sound.com.

[Switch to Classic Navigation]