Blog

AES

Viewing posts tagged AES

Immersive Audio Podcast Episode 40 – Bruce Wiggins & Duncan Werner (University of Derby & GASP)

Summary

In this episode of the Immersive Audio Podcast, Oliver Kadel is joined by senior academics of University of Derby Dr Bruce Wiggins and Duncan Werner via Zoom from Derbyshire, UK.

Dr Bruce Wiggins graduated with a 1st class honours in Music Technology and Audio System Design from the University of Derby in 1999.  His interest in audio signal processing spurred him to continue at Derby completing his PhD entitled “An Investigation into the Real-time Manipulation and Control of 3D Sound Fields” in 2004 where he solved the problem of generating Ambisonic decoders for irregular speaker arrays and looked at the optimisation of binaural/transaural systems.  Bruce’s research into Ambisonics has been featured as an impact case study in the national Research Excellence Framework in 2014 and will be again in 2021.  His latest work is based around the auralisation of rooms to very high order Ambisonics with head-tracking.

Duncan Werner graduated from Aston University in Electrical/Electronic Engineering in the late seventies, but as a keen musician moved towards the music industry gaining work as a recording and touring musician in the UK and Europe, subsequently being employed by the London-based Chrysalis Music Group as studio sound engineer. This was followed by postgraduate Music Technology studies at City University London. Research interests include immersive music production, in particular the GASP system (Guitars with Ambisonic Spatial Performance) based at the University of Derby. He has been programme leader for BSc Music Technology since its inception in 1995 and is currently Programme Leader for MA Music Production.

In this episode, we dive into the collaborative project GASP (Guitars with Ambisonic Spatial Performance), discuss the Sound in Space Symposium, and current research projects for immersive audio.

Listen to Podcast

Show Notes

University of Derby – https://www.derby.ac.uk/

Sound in Space – http://soundsinspace.co.uk/

Bruce Wiggins Academic Profile – http://www.derby.ac.uk/staff/bruce-wiggins

Bruce Wiggins Website – http://www.brucewiggins.co.uk/

GASP Website – Guitars with Ambisonic Spatial Performance – http://gaspproject.xyz/

GASP Paper – http://gaspproject.xyz/wp-content/uploads/2020/07/GASP-paper-for-Innovation-in-Music.pdf

VLC Player – https://www.videolan.org/vlc/index.en-GB.html

AmbiFreeverb 2 – https://www.researchgate.net/publication/289958469_AmbiFreeverb_2_WigWare_-_Sounds_in_Space_2015

https://derby.openrepository.com/handle/10545/618606

Measured Reverbs for Ambisonics and VR – https://www.brucewiggins.co.uk/?page_id=881

Webcam Head-tracked Ambisonics (WHAM) – https://brucewiggins.co.uk/WHAM

Cat Fantastic Mix 1 (comparison mix)

CatFantasticAmbiX3rdOrder: http://gaspproject.xyz/gaspaudio/CatFantasticAmbiX3rdOrder.wav

Facebook: https://www.facebook.com/111035420660669/videos/904591106728398/

HOAST: https://hoast.iem.at/play/cat_fantastic_o3

Cat Fantastic Mix 1: applies post-production timbral morphing and dynamic spatialisation. This is the first GASP binaural demo track in the podcast; the original ‘raw’ guitar is at the beginning which then morphs through timbral and spatial variations up to around 1.10 when the raw guitar returns. Performed by Jack Hooley, production by Duncan Werner and Emma Fitzmaurice. The recording has no overdubs, that is, the final production is derived from one single guitar performance. Post-production included experimenting with ‘timbral morphing’, where multiple versions of each string, each with different timbres were printed on time-synchronized parallel tracks, thus allowing crossfading between individual string timbres, then mixing together the respective tracks. The timbral morphing works well and we have now developed templates for real-time timbral morphing for live performance applications.

————————————————————————————————————–

Pale Aura (comparison mix)

PaleAuraAmbiX2ndOrderComparisonMix.wav: http://gaspproject.xyz/gaspaudio/PaleAuraAmbiX2ndOrderComparisonMix.wav

Facebook: https://www.facebook.com/GASP-Guitars-with-Ambisonic-Spatial-Performance-111035420660669/

HOAST: https://hoast.iem.at/play/pale_aura_comparison_o2

Pale Aura: performed by Dominic Dallali, production by Jack Hooley and Dominic Dallali. This is the first GASP binaural demo track in the podcast; the original ‘raw’ guitar is at the beginning which then morphs through timbral and spatial variations up to around 1.10 when the raw guitar returns. The recording has no overdubs, that is, the final production is derived from one single guitar performance. This track is the guitar part of the song Pale Aura by the band Periphery; it is in the genre of progressive metal. It turned out to be quite a dramatic production, with rapid changes in location for close temporal events. The guitar part consists of some highly syncopated timing elements, which have been mapped to rapid location switching. There is a good range of amp distortion timbres employed for different parts of the performance. A low kick drum was included to provide the listener with a sense of meter as the guitar performance which includes several syncopated elements.

————————————————————————————————————–

Prelude to Life (comparison mix)

PreludeToLifeAmbiX2ndOrderComparisonMix.wav

http://gaspproject.xyz/gaspaudio/PreludeToLifeAmbiX2ndOrderComparisonMix.wav

Facebook: https://www.facebook.com/111035420660669/videos/637100453564316/

HOAST: https://hoast.iem.at/play/prelude_to_life_comparison_o2

Prelude to Life: composed and performed by Fred T Baker, production by Charlie Box and Duncan Werner. This is the first GASP binaural demo track in the podcast; the original ‘raw’ guitar is at the beginning which then morphs through timbral and spatial variations up to around 1.10 when the raw guitar returns. The recording has no overdubs, that is, the final production is derived from one single guitar performance. Post-production timbralisation is a mix of both NI Guitar Rig and instrument samples. Melodyne’s pitch to MIDI conversion was applied, the MIDI note events were then arranged to trigger various instrument samples e.g. orchestral strings with other sampled and synthetic sounds. Upon reflection, the timing of pitch to MIDI conversion worked very well, such that the nuances of the guitar performance are precisely captured.

————————————————————————————————————–

GASP is ‘Guitars with Ambisonic Spatial Performance’. The project is the design, realisation, and application of a spatial-audio guitar production system; it is aimed towards guitarists, music producers and spatial-audio sound designers. GASP is an ongoing University of Derby research project, where our interest in Ambisonic algorithmic research and guitar sound production is combined with off-the-shelf hardware and bespoke software to create an Ambisonic based immersive guitar sound system. Applications include:

Live performance as an immersive spatial sound instrument, either as a solo instrument or as part of an ensemble, for both small or large format theatre or concert systems

Audio post-production immersive sound for on-line spatial audio applications such as YouTube and Facebook 360, including Virtual Reality applications

Guitar performance analysis and tuition tool, where on-screen displays enable identification of notation and performance artefacts which provide feedback to the player

A research tool for performative applications, with significant potential for use in the Sound Arts world

We’ve recently set up a GASP page: www.gaspproject.xyz which includes links to some of our example demo GASP productions, as well as the project timeline, posters and includes our paper ‘Development of an Ambisonic Guitar System’ which was presented to ‘Innovation in Music’  conference at the University of West London in December 2019, it’s due for publication by Routledge as a book chapter sometime in 2021. https://www.routledge.com/Innovation-in-Music-Future-Opportunities/Hepworth-Sawyer-Paterson-Toulson/p/book/9780367363352

Dring, M., Wiggins, B. (2019)  The Transparency of Binaural Auralisation Using Very High Order Circular Harmonics.  Reproduced Sound 2019 – Proceedings of the Institute of Acoustics, p165-173, Vol. 41. Pt. 3 2019, Bristol, UK

Wiggins, B., Dring, M., (2016) AmbiFreeVerb 2—Development of a 3D Ambisonic Reverb with Spatial Warping and Variable Scattering.  2016 AES International Conference on Sound Field Control.  University of Surrey, Guildford, UK.

Wiggins, B. (2017) Measured Reverbs for Ambisonics and VR.  Sounds in Space Research Symposium 2017, Derby, UK. (Video)

Survey

We want to hear from you! We really value our community and would appreciate it if you would take our very quick survey and help us make the Immersive Audio Podcast even better: surveymonkey.co.uk/r/3Y9B2MJ Thank you!

Credits

This episode was produced by Oliver Kadel and Michelle Chan with the help of Emma Rees and included music by Knobs Bergamo.

Oliver Kadel to Present at AES Conference

We are thrilled about presenting our work at the upcoming Audio Engineering Society Conference on Immersive and Interactive Audio.

Oliver Kadel and Professor Justin Paterson co-wrote a paper on the subject of Immersive Audio Post-production for VR & 360º content.

For more information follow the links below

International Conference on Immersive & Interactive Audio – http://www.aes.org/conferences/2019/immersive/

White Paper – http://www.aes.org/e-lib/browse.cfm?elib=20433

1.618 Digital Team

Immersive Audio Podcast – Episode 15 Gavin Kearney

Summary

Today, Oliver was joined in studio by Dr. Gavin Kearney, Senior Lecturer in Audio and Music Technology at the University of York. Gavin received an honours degree in electronic engineering from Dublin Institute of Technology, in 2002 and M.Sc. and Ph.D. degrees in audio signal processing from Trinity College Dublin in 2006 and 2010 respectively. He subsequently worked as a Postdoctoral Research Fellow on game audio, while lecturing on the Interactive Digital Systems and Music and Media Technology masters courses at Trinity College Dublin.

He was appointed Lecturer in sound design at the Department of Theatre, Film, and Television at the University of York in January 2011 where he currently teaches both bachelors and masters level courses on spatial audio and surround sound, audio engineering and sound production and postproduction methods. Gavin also continues to work in the audio industry as a sound engineer and designer.

In this episode, Gavin focuses on ongoing research, industry practice standards and enhancing audio description.

Audio extracts are taken from the first-person drama Pearl, a film produced at the University of York with Binaural enhanced audio, and a music recording session from Abbey Road Studios featuring Nova Neon.

Listen to Podcast

Shownotes

Dublin Institute of Technology: http://www.dit.ie/

Trinity College Dublin: https://www.tcd.ie/

University of York: https://www.york.ac.uk/

University of York – MA Postproduction with Sound Design: https://www.york.ac.uk/study/postgraduate-taught/courses/ma-postproduction-sound-design/

MSc Audio & Music Technology: https://www.york.ac.uk/electronic-engineering/postgraduate/taught_masters_degrees/msc_audio/

Pro Tools: http://www.avid.com/pro-tools

SADIE Project: www.sadie-project.co.uk

Dolby Atmos: https://www.dolby.com/us/en/brands/dolby-atmos.html

Oculus: www.oculus.com/

Enhancing Audio Description: http://enhancingaudiodescription.com/

AES: Audio for New Realities: http://www.aes.org/press/?ID=390

AES: Audio for Games technical committee: http://www.aes.org/technical/ag/

Unity: https://unity3d.com/

2018 AES International Conference on Spatial Reproduction — Aesthetics and Science (Japan): http://www.aes.org/conferences/2018/spatial/

2018 AES International Conference on Audio for Virtual and Augmented Reality (Seattle): http://www.aes.org/conferences/2018/avar/

2019 AES International Conference on Immersive and Interactive Audio (York): http://www.aes-uk.org/forthcoming-meetings/2019-aes-international-conference-on-immersive-and-interactive-audio/

The Knife that Killed Me: https://www.imdb.com/title/tt2087982/

Abbey Road Recording Studios: https://www.abbeyroad.com/