Level 3 Games Design
Unit 73: Sound for Computer Games
P2/Aims: Understand the methods and principles of sound design and production
Exercise 1:
Sound file formats:
Uncompressed - They are a perfect portrayal of the original recording, they also use up more space than lossy compression. This method of format is best used on games that are stored on disk because of the memory used up.
Examples include:
WAV (Waveform/WAVE) - Audio file format created by Microsoft. It has become a standard audio file format for PCs, from system sounds and game sounds to CD quality audio. It also stores information about the file, this includes its number of tracks, sample rate, bit depth and whether its mono or stereo.
AIFF (Audio Interchange File Format) - One of the most used audio file formats used in Apple Macintosh operating systems. If used on a PC the file extension is '.aif,' but when used on a Mac it does not even need one. The file contains the raw audio data, channel information, bit depth, sample rate and application-specific data areas. Application-specific data area let different applications add information into the file header that will remain there.
AU (Audio) - A simple sound file format belonging to Sun, NeXT, DEC and used in UNIX. It is also known as Spac-audio or u-law formats. They contain three parts, these are the audio data, text for a header and an annotation block.
SMP (Smart Music Performance) - Used by SmartMusic which is an application for band orchestra and voice; it saves an accompaniment that can be used for practising solos and other musical parts. It also includes the sheet music information and can be used for assessment.
VOC (Creative Labs Audio File) - Used by Creative Labs hardware like SoundBlaster sound cards; may be audio clips, sound effects or instrument sounds which may be referred to as voices.
Lossy compression - Compressed data that loses quality as it discards information, this therefore means it uses less space and is a lot more suitable to be used on devices like ipods and phones.
Examples include:
MP3 (MPEG Audio Layer 3 (AC3) file) - Is a standard technology and format for compressing a sound sequence into a very small file. It provides near CD quality audio and is one of the most common file types for music.
RA (RealMedia streaming audio file) - A streaming audio file used by RealNetworks RealPlayer. It contains audio data encoded in the proprietary RealAudio codec.
VOX (Dialogic audio file coded using ADPCM) - It is used with Voxware software and they contain Metavoice audio data that stimulates human speech that is based on the Dialogic ADPCM codec.
Audio Sampling:
How can resolution and bit-depth constrain file size? - The higher the bit-depth means the higher the quality, this is because the bit-depth is the number of bits of information in each sample. The resolution is how many values the sample can take on. The higher the resolution the more accurate the representation of the level of each sample. The higher the bit-depth and resolution the more memory used and needed. This applies vice versa.
Explain what the following words mean:
Sample rate - Number of sample of audio carried per second, it is measured in Hz or kHz.
Mono - Intended to be heard as if it were a single channel of sound coming from one position.
Stereo - Uses two channels to transport the felling of sound coming from the left, right and middle in different places.
Surround - Perceives sound to surround the listener by 360 degrees. They use three or more channels and speakers in front and behind to create an envelope of sound surrounding and directional audio sources.
Exercise 2:
Audio Limitations of Games Platforms
How can the following information limit the recording of sound? -
DSP (Digital Signal Processor - Can process data in real time, this makes it idea for applications that can't tolerate any delays. They take a digital and handle it so as to improve it into a clearer sound.
RAM (Random Access Memory) - it allows information to be stored and retrieved in a system, because of it being randomly accessed the data is quicker to get at and used. The higher the amount of RAM the better performance you can obtain when recording sound. This includes the quality and speed of saving the audio has.
PCM (Pulse Code Modulation) - It's the form of sound that digital sound is decoded into that is then able to be outputted into the speakers. It allows the recording of audio performances which can then be fit into a small space while still being close to the original performance quality.
File format - The format in which a sound file has can change the quality and readability of a file. WAV and AIFF files are much higher quality than that of a MP3 file because they are uncompressed but also, use more memory up. WAV is mainly used on PCs and AIFF on Macintosh. MP3 is more likely used on ipods, phones and tablets.
Audio output - Mono and Stereo sound would be a lot less immersive than that of Surround sound when playing back. The quality of the three can differ entirely and can make audio sound more or less like the original and in person experience.
Audio Recording Systems
In what types of scenario may you use the following audio recording equipment? -
Multi-track recording - Allows for separate recording of more than one sound source. They can be used and put together to create a single track. Most popular music is made using this method.
MIDI (Multi Instrument Digital Interface) - Allows a single person to have control over multiple instruments at the same time. It enables electronic musical instruments, computers and other electronic equipment to communicate and be in sync with each other. It is used by professionals and amateurs to record and edit multiple tracks of electronic music.
DAT (Digital Audio Tape) - A single recording and playback medium on tape. It is still used regularly in film and television.
Analogue - Used to record analog signals which allow playback later. An example of an analog medium is vinyl.
Software Plug-ins - Adds a specific feature to an existing program with a software component. They can be used to generate,m process or analyse sound. As an example this could add sound synthesis (synthesizer).
Software Sequencer - Class of application software giving a functionality of music sequencer. It can be controlled by either the GUI or a specialised input device like a MIDI controller.
References:
http://whatis.techtarget.com/fileformat/WAV-Waveform-sound-Microsoft-Windows
http://whatis.techtarget.com/definition/AIFF-Audio-Interchange-File-Format
http://whatis.techtarget.com/fileformat/AU-Sun-NeXT-DEC-UNIX-sound-file
https://fileinfo.com/extension/smp
http://whatis.techtarget.com/fileformat/VOX-Dialogic-audio-file-coded-using-ADPCM
http://whatis.techtarget.com/fileformat/MP3-MPEG-Audio-Layer-3-AC3-file
http://whatis.techtarget.com/fileformat/RA-RealMedia-streaming-audio-file
https://fileinfo.com/extension/voc
http://www.pcguide.com/art/soundSampleResolution-c.html
https://en.wikipedia.org/wiki/Audio_bit_depth
http://wiki.audacityteam.org/wiki/Sample_Rates
https://en.wikipedia.org/wiki/Monaural
http://www.webopedia.com/TERM/S/surround_sound.html
http://www.futureelectronics.com/en/Microprocessors/digital-signal-processors.aspx
http://sarahsgamesdesign.blogspot.co.uk/2016/12/memory-understanding-hardware.html
https://www.lifewire.com/what-is-pcm-1846928
http://www.liverpoolmuseums.org.uk/wml/exhibitions/thebeatgoeson/thebeatgoesonline/technology/studios/multitrack.aspx
https://www.midischool.com/what-is-midi/
http://entertainment.howstuffworks.com/midi.htm
https://en.wikipedia.org/wiki/Digital_Audio_Tape
https://en.wikipedia.org/wiki/Analog_recording
https://en.wikipedia.org/wiki/Plug-in_(computing)
https://en.wikipedia.org/wiki/Music_sequencer#Software_sequencers
Examples include:
MP3 (MPEG Audio Layer 3 (AC3) file) - Is a standard technology and format for compressing a sound sequence into a very small file. It provides near CD quality audio and is one of the most common file types for music.
RA (RealMedia streaming audio file) - A streaming audio file used by RealNetworks RealPlayer. It contains audio data encoded in the proprietary RealAudio codec.
VOX (Dialogic audio file coded using ADPCM) - It is used with Voxware software and they contain Metavoice audio data that stimulates human speech that is based on the Dialogic ADPCM codec.
Audio Sampling:
How can resolution and bit-depth constrain file size? - The higher the bit-depth means the higher the quality, this is because the bit-depth is the number of bits of information in each sample. The resolution is how many values the sample can take on. The higher the resolution the more accurate the representation of the level of each sample. The higher the bit-depth and resolution the more memory used and needed. This applies vice versa.
Explain what the following words mean:
Sample rate - Number of sample of audio carried per second, it is measured in Hz or kHz.
Mono - Intended to be heard as if it were a single channel of sound coming from one position.
Stereo - Uses two channels to transport the felling of sound coming from the left, right and middle in different places.
Surround - Perceives sound to surround the listener by 360 degrees. They use three or more channels and speakers in front and behind to create an envelope of sound surrounding and directional audio sources.
Exercise 2:
Audio Limitations of Games Platforms
How can the following information limit the recording of sound? -
DSP (Digital Signal Processor - Can process data in real time, this makes it idea for applications that can't tolerate any delays. They take a digital and handle it so as to improve it into a clearer sound.
RAM (Random Access Memory) - it allows information to be stored and retrieved in a system, because of it being randomly accessed the data is quicker to get at and used. The higher the amount of RAM the better performance you can obtain when recording sound. This includes the quality and speed of saving the audio has.
PCM (Pulse Code Modulation) - It's the form of sound that digital sound is decoded into that is then able to be outputted into the speakers. It allows the recording of audio performances which can then be fit into a small space while still being close to the original performance quality.
File format - The format in which a sound file has can change the quality and readability of a file. WAV and AIFF files are much higher quality than that of a MP3 file because they are uncompressed but also, use more memory up. WAV is mainly used on PCs and AIFF on Macintosh. MP3 is more likely used on ipods, phones and tablets.
Audio output - Mono and Stereo sound would be a lot less immersive than that of Surround sound when playing back. The quality of the three can differ entirely and can make audio sound more or less like the original and in person experience.
Audio Recording Systems
In what types of scenario may you use the following audio recording equipment? -
Multi-track recording - Allows for separate recording of more than one sound source. They can be used and put together to create a single track. Most popular music is made using this method.
MIDI (Multi Instrument Digital Interface) - Allows a single person to have control over multiple instruments at the same time. It enables electronic musical instruments, computers and other electronic equipment to communicate and be in sync with each other. It is used by professionals and amateurs to record and edit multiple tracks of electronic music.
DAT (Digital Audio Tape) - A single recording and playback medium on tape. It is still used regularly in film and television.
Analogue - Used to record analog signals which allow playback later. An example of an analog medium is vinyl.
Software Plug-ins - Adds a specific feature to an existing program with a software component. They can be used to generate,m process or analyse sound. As an example this could add sound synthesis (synthesizer).
Software Sequencer - Class of application software giving a functionality of music sequencer. It can be controlled by either the GUI or a specialised input device like a MIDI controller.
References:
http://whatis.techtarget.com/fileformat/WAV-Waveform-sound-Microsoft-Windows
http://whatis.techtarget.com/definition/AIFF-Audio-Interchange-File-Format
http://whatis.techtarget.com/fileformat/AU-Sun-NeXT-DEC-UNIX-sound-file
https://fileinfo.com/extension/smp
http://whatis.techtarget.com/fileformat/VOX-Dialogic-audio-file-coded-using-ADPCM
http://whatis.techtarget.com/fileformat/MP3-MPEG-Audio-Layer-3-AC3-file
http://whatis.techtarget.com/fileformat/RA-RealMedia-streaming-audio-file
https://fileinfo.com/extension/voc
http://www.pcguide.com/art/soundSampleResolution-c.html
https://en.wikipedia.org/wiki/Audio_bit_depth
http://wiki.audacityteam.org/wiki/Sample_Rates
https://en.wikipedia.org/wiki/Monaural
http://www.webopedia.com/TERM/S/surround_sound.html
http://www.futureelectronics.com/en/Microprocessors/digital-signal-processors.aspx
http://sarahsgamesdesign.blogspot.co.uk/2016/12/memory-understanding-hardware.html
https://www.lifewire.com/what-is-pcm-1846928
http://www.liverpoolmuseums.org.uk/wml/exhibitions/thebeatgoeson/thebeatgoesonline/technology/studios/multitrack.aspx
https://www.midischool.com/what-is-midi/
http://entertainment.howstuffworks.com/midi.htm
https://en.wikipedia.org/wiki/Digital_Audio_Tape
https://en.wikipedia.org/wiki/Analog_recording
https://en.wikipedia.org/wiki/Plug-in_(computing)
https://en.wikipedia.org/wiki/Music_sequencer#Software_sequencers
No comments:
Post a Comment