Blog

Research

Viewing posts tagged Research

We’ve just published a paper on Audio for Extended Realities for the Convergence in The International Journal of Research Into New Media Technologies, SAGE Publication.

Creative and technical development of immersive audio is often a function of evolving toolsets and distribution platforms, and the associated workflow is far from standardised. This paper forms the context for such audio workflow – one that draws from precursor technologies such as audio for games and virtual reality and develops this into an outline taxonomy that is representative of the state of the art, and forward facing towards the evolution of the technology.

The paper features a series of case studies based on multiple documentary series as the virtual reality and mixed reality experiences by Sir David Attenborough: Museum Alive, Micro Monsters, First Life VR, Museum Alive AR and Kingdom of Plants produced by Alchemy Immersive, Atlantic Productions and Zoo VFX – the body of works I’ve been proudly involved with as a supervising 3D Sound Designer and Mixer over the past several years as part of 1.618 DIGITAL.

We want to say a big thanks to my co-author and principal editor Professor Justin Paterson for his immense contribution to this publication. Special mention to an incredible team at Alchemy: Elliot Graves, Richard Lester, Lou Doye, Iona McEwan, Bhaumik Patel, Ceri Passmore and many more…

Audio for extended realities: A case study informed exposition -> https://shorturl.at/bovw8

All of the mentioned VR content is available to watch on Meta Quest -> https://www.meta.com/en-gb/experiences/?utm_source=lnkd.in&utm_medium=oculusredirect

Immersive Audio Podcast Episode 59 – Hyunkook Lee (A Conceptual Model of Immersive Experience in Extended Reality)

Summary

In this episode of the Immersive Audio Podcast, Oliver Kadel and Monica Bolles are joined by the director of the Applied Psychoacoustics Laboratory at the University of Huddersfield – Hyunkook Lee.

Dr Hyunkook Lee is a Reader (i.e., Associate Professor) in Music Technology and the Director of the Applied Psychoacoustics Laboratory, University of Huddersfield, U.K. His research over the last 10 years contributed to advancing the understanding of three-dimensional (3D) audio perception and developing new 3D capture and reproduction techniques. He has invented various psychoacoustics-based 3D microphone arrays including PCMA-3D and ESMA-3D, whose principle for height microphone configuration has been adopted for Schoep’s award-winning ORTF-3D array. Recently, he has been focusing on researching and developing perceptually optimised techniques of 6DoF audio rendering for extended reality applications. He is also currently leading a multidisciplinary project that connects immersive arts and technologies. From 2006 to 2010, he was a Senior Research Engineer in audio R&D with LG Electronics, South Korea, where he participated in the standardisations of MPEG audio codecs and developed spatial audio algorithms for mobile devices. He is an Associate Technical Editor of the Journal of the Audio Engineering Society (AES). He co-edited a recently published book “3D Audio” (Routledge). Hyunkook is a Fellow of the AES, Vice-Chair of the AES High-Resolution Audio Technical Committee, and has recently been elected as a Governor of the AES for 2022-2023.   Dr Lee received a B. Mus (Hons) degree in music and sound recording (Tonmeister) from the University of Surrey, U.K., in 2002 and a PhD in spatial audio psychoacoustics from the Institute of Sound Recording (IoSR), the University of Surrey in 2006.

In this episode, we discuss Hyunkook’s recent research on “A Conceptual Model of Immersive Experience in Extended Reality” and its influence on spatial audio.

Listen to Podcast

Show Notes

Hyunkook Lee – https://pure.hud.ac.uk/en/persons/hyunkook-lee

360 Reality Audio Creative Suite – https://360ra.com/

IMERSA – https://www.imersa.org/item/immersive-audio

University of Surrey, Music & Sound Recording (Tonmeister) – https://www.surrey.ac.uk/undergraduate/music-and-sound-recording-tonmeister

University of Huddersfield, Music Technology – https://www.hud.ac.uk/inspire/musictechnology/

University of Huddersfield, Applied Psychoacoustics Lab – www.hud.ac.uk/apl

Applied Psychoacoustics Lab on Facebook – https://www.facebook.com/applied.psychoacoustics.lab/

A Conceptual Model of Immersive Experience in Extended Reality Paper – https://psyarxiv.com/sefkh/

Conceptual Model of Immersive Experience in Extended Reality Online Lecture – https://www.youtube.com/watch?v=ZoSTV-WVeeI

Our Patreon

If you enjoy the podcast and would like to show your support please consider becoming a Patreon. Not only are you supporting us, but you will also get special access to bonus content and much more.

Find out more on our official Patreon page – https://www.patreon.com/immersiveaudiopodcast

We thank you kindly in advance!

Survey

We want to hear from you! We really value our community and would appreciate it if you would take our very quick survey and help us make the Immersive Audio Podcast even better: surveymonkey.co.uk/r/3Y9B2MJ Thank you!

Credits

This episode was produced by Oliver Kadel and Emma Rees and included music by Rhythm Scott.