Blog

VR

Viewing posts tagged VR

Immersive Audio Podcast – Episode 9 James Edward Marks

Summary

In today’s episode we’re joined by James E. Marks, an experimental new media provocateur. He is a creator of award-winning social video edutainment, and maker of immersive mixed and virtual reality experiences. With over 20 years of hands-on collaborations with alternative, pop culture branded and unbranded entertainment, James is Co-Founder & Chief Marketing Officer for DoubleMe, a Silicon Valley transformative tech start-up that’s pushing the boundaries of holographic mixed reality. He is also the founder of PsychFi Lab & Hackstock Festival. At PsychFi, he collaborates with the biggest social video & moving image artists, exploring immersive tech, psychology, psychedelia, sci-fi and pop culture.

In this episode we discuss the importance of sound and all senses in an immersive experience, new technology and how it has changed the approach to composing.

Listen to Podcast

Shownotes

MWC18 & BBC Click – Mixed Reality For Social Good: https://youtu.be/N97MHHO4XHM

#HackThePlanet & ComiCon VR World Record Setters: https://youtu.be/FRupTnhW3UM

Harry Shotta, DJ Phantasy, 24SevenTV & PsychFi Labs: https://youtu.be/ZJfD71bMl_Y

Hackstock 4.0 & LoopSpace World Premiere: https://youtu.be/Z7X1ejKmXU0

PZYK & PsychFi Top Alt Reality Experience: https://blog.oup.com/2018/03/virtual-reality-games-simulate-altered-states

PsychFi & Webby Awards: https://www.webbyawards.com/winners/2016/online-film-video/general-film/vr-gaming-interactive-or-real-time/hacktheplanet-vr

Summer in the City: http://www.sitc-event.co.uk

GoPro: https://gopro.com/

Subpac: http://subpac.com/

HoloLens: https://www.microsoft.com/en-gb/hololens

Holoportal: http://www.doubleme.me/#holoportal

Third Mind Productions: http://www.thirdmindcreates.com/

DoubleMe: http://www.doubleme.me/

Hackstock: https://sci-fi-london.com/hackstock-stuff-we-are-doing

 

Immersive Audio Podcast – Episode 8 Damian Murphy

Summary

Today Oliver is joined in the studio by Professor Damian Murphy. Damian is a Professor of Sound and Music Computing at the Department of Electronic Engineering, University of York, where he has been a member of academic staff since 2000, and is the University Research Champion for Creativity. He started his career in the Performing Arts Department at Harrogate College and has previously held positions at Leeds Metropolitan University and Bretton Hall College.

His research focuses on virtual acoustics, spatial audio, physical modelling, and audio signal processing. This research formed the basis of the Surrounded by Sound project that was selected for inclusion in the Royal Society’s Summer Science Exhibition in July 2001, and he was also co-author of SoundFX – Making Music with Technology, the 2004 IEE touring Faraday Lecture.

He has been principal investigator on a number of AHRC and EPSRC funded projects relating to room acoustics simulation and auralisation, and published over 130 journal articles, conference papers and books in the area. He is a member of the Audio Engineering Society, a Fellow of the Higher Education Academy, and a visiting lecturer to the Department of Speech, Music and Hearing at KTH, Stockholm, where he specialises in spatial audio and acoustics. He has held visiting researcher status at a number of universities internationally.

Prof. Murphy is also an active sound artist and in 2004 was appointed as one of the UK’s first AHRC/ACE Arts and Science Research Fellows, investigating the compositional and aesthetic aspects of sound spatialisation, acoustic modelling techniques and the acoustics of heritage spaces. His work has been presented in galleries nationally and at festivals and venues internationally and included varied collaborations with writers, photographers and interactive digital artists. He is a founding member of Geodesic Arts through which most of his more recent work has been produced.

In this episode, Damian discusses entering into academia and recreating the acoustics of environments.

Listen to Podcast

Shownotes

University of York: https://www.york.ac.uk/

University of York: Masters in Audio & Music Technology: https://www.york.ac.uk/electronic-engineering/postgraduate/taught_masters_degrees/msc_audio/

Dave Malham: https://www.york.ac.uk/music/staff/honorary/dave-malham/

Computer Music Journal: http://www.computermusicjournal.org/

Professor David Howard: https://pure.york.ac.uk/portal/en/researchers/david-martin-howard(ecfa9e9e-1290-464f-981a-0c70a534609e).html

University of York: Department of Music: https://www.york.ac.uk/music/

University of York: MA/MSc in Postproduction with Sound Design: https://www.york.ac.uk/tftv/postgraduate/taught/postproduction-sound//

AECOM: http://www.aecom.com/

Alex Southern: https://uk.linkedin.com/in/asouthern

Geodesic Arts: http://geodesicarts.org.uk/

Me, Myself and MRI: http://memyselfandmri.org/

York Minster: https://yorkminster.org/home.html

Louise K. Wilson: http://www.lkwilson.org/

David Chapman: http://davidchapman.info/

Music excerpt by AudioLab, Department of Electronic Engineering, University of York and Ebor Singers.

Immersive Audio Podcast – Episode 7 Aaron McLeran

Summary

In today’s episode Oliver was joined via Skype by Aaron McLeran, Lead Audio Programmer at Epic Games. Aaron’s first taste of audio programming was writing computer music in CSound while in graduate school at University of Notre Dame (when he was supposed to be doing astrophysics research). Realising his true calling, he left physics to study procedural and interactive computer music, audio synthesis, and audio analysis with Dr. Curtis Roads at the University of Santa Barbara. His first game audio experience was writing procedural music on Spore where he got to collaborate with Brian Eno and Maxis’ audio director Kent Jolly on writing much of the game’s truly procedural music. His next game audio gig was a sound designer on Dead Space 2 where he wrote much of the games interactive audio systems in Lua along with accomplished audio director Don Veca. He made the leap from technical sound designer to audio programmer at Sledgehammer Games where he worked on Call of Duty: Modern Warfare 3 and Call of Duty: Advanced Warfare. His next audio programming gig was at ArenaNet where he got to wrangle with the unpredictability and scale of game audio in the context of an MMO and developed some pretty cool tech around for player-created music and musical interaction. He’s currently working on a new multi-platform audio mixer backend for UE4 and developing new tech and approaches to game audio for VR.

Aaron speaks to Oliver about all things Game Audio and Procedural Audio and his unusual entry into the industry.

Listen to Podcast

Shownotes

Super Collider: https://supercollider.github.io/

UC Berkeley: Centre for New Music and Audio Technologies: http://cnmat.berkeley.edu/

Maxis: https://www.ea.com/studios/maxis

Spore: http://www.spore.com/

Brian Eno: http://www.brian-eno.net/

Andrew Lackey: https://www.linkedin.com/in/andrewlackey

Wabi Sabi Sound: http://www.wabisabisound.com/

Kent Jolly: http://www.imdb.com/name/nm0427204/

EA Games: https://www.ea.com/en-gb

UC Santa Barbara: https://www.ucsb.edu/

Curtis Roads: http://www.music.ucsb.edu/people/curtis-roads

Sledgehammer Games: https://www.sledgehammergames.com/

Travis Naas: https://www.linkedin.com/in/tnaas

Activision: https://www.activision.com/

Call of Duty: Infinite Warfare: https://www.callofduty.com/uk/en/infinitewarfare

Dave Swenson: https://www.linkedin.com/in/dave-swenson-3b5b376

Epic Games: https://www.epicgames.com/

Unreal Engine 4: https://www.unrealengine.com/en-US/blog

Ethan Geller: https://www.linkedin.com/in/ethan-geller-7684133a

Game Developers Conference: http://www.gdconf.com/

FMOD: https://www.fmod.com/

Dan Reynolds: http://www.musicianeer.com/

Steam Audio: https://valvesoftware.github.io/steam-audio/

Oculus: https://www.oculus.com

Valve: http://www.valvesoftware.com/

Fortnite: https://www.epicgames.com/fortnite

 

Immersive Audio Podcast – Episode 6 Catherine Robinson

Summary

In today’s episode we are joined in studio by Catherine Robinson, Audio Supervisor at BBC Wales. Catherine has worked in radio sound for the BBC since 2001. Her specialism is sound design for radio drama, binaural audio and 3D sound for 360 video and VR. Catherine created the sound design and binaural mix for Ring, a horror radio drama for Radio 4. Following the success of that, Catherine has set up the first operational 3D sound studio in the BBC outside Research and Development, using their tools.

Some of the binaural productions that have been created in the 3D studio are: The Russell T Davies adaptation of A Midsummer Night’s Dream, which was the first ever binaural feature film; six 360 films for Planet Earth 2 using dynamic binaural sound design; and an episode of Doctor Who called ‘Knock Knock’ which is the first binaural TV drama to be made available on BBC iPlayer.

Catherine discusses her role at the BBC, the first binaural episode of a TV program available on the BBC iPlayer – Doctor Who, how content will drive immersive audio consumption and bringing immersive audio to the masses.

Listen to Podcast

Show notes

Middlesex University London: http://www.mdx.ac.uk/

BBC: https://www.bbc.co.uk/

BBC Wales: https://www.bbc.com/wales

BBC Radio Wales: https://www.bbc.co.uk/radiowales

BBC Radio 4: https://www.bbc.co.uk/radio4

BBC Research and Development: https://www.bbc.co.uk/rd

Ring – By Koji Suzuki. Adapted by Anita Sullivan: http://www.bbc.co.uk/programmes/b06g63fk

The Stone Tapes – Peter Strickland re-imagines a classic seventies horror for Radio 4’s Fright Night: http://www.bbc.co.uk/programmes/b06g63fh

Fright Night : http://www.bbc.co.uk/programmes/p03328l0

Binaural Audio at the BBC Proms: http://www.bbc.co.uk/rd/blog/2016-09-binaural-proms

Tom Parnell: http://www.bbc.co.uk/rd/people/tom-parnell

Doctor Who: Binaural Episode: https://www.bbc.co.uk/programmes/p051x29z

Darran Clement: https://www.linkedin.com/in/darran-clement-00313b55

A midsummer night’s Dream – Classic Shakespeare play adapted for television by Russell T. Davies:

http://www.bbc.co.uk/programmes/b07dx7lt

Brian Minchin: http://www.imdb.com/name/nm1848198/

BBC Binaural Sound: https://www.bbc.co.uk/rd/projects/binaural-broadcasting

BBC Radio 4 – Pod Plays: https://www.bbc.co.uk/programmes/p05b8wfv

Damming the Nile: Explore with 360 video: http://www.bbc.co.uk/news/world-africa-43117710

Becky Lipscombe – BBC Africa Producer – Twitter: https://twitter.com/Beckstatic

BBC Radio Wales: The Sounds of Wales: http://www.bbc.co.uk/programmes/p05zrd8y

Hugh Huddy: https://www.linkedin.com/in/hugh-huddy-0b23562/Royal National Institute of Blind People: http://www.rnib.org.uk/

Immersive Audio Podcast – Episode 5 Samuel Huber

Summary

Today we are joined in the studio by Samuel Huber, the founder of Admix.in, the first adtech platform for mixed reality, giving VR, AR and MR developers the best tools to monetize their content. He frequently speaks at VR, AR and adtech conferences  and is obsessed with the convergence of frontier technology, adtech, and consumer behaviour. Sam has previously disrupted the e-commerce market with Kout.io, a gamified e-commerce platform where users play free games to win their shopping basket, live with 20 of the largest retailers. He is a social gambling pioneer with Betify, a gamified video sharing app. He built and sold Rogue Trader, the first binary trading game on the App Store. In a previous life, Sam was responsible for Mercedes Formula 1 engine strategy (season 2011/2012). He has a MSc Engineering from Cranfield

Uni (UK), BSc Physics from EPFL (Switzerland) and Uppsala Uni (Sweden).

Sam discusses Admix and advertising in a non-intrusive way, monetisation solutions and the importance of audio in VR advertising.

Listen to Podcast

Shownotes

Admix: http://admix.in/

Oculus Rift: https://www.oculus.com/rift/

Samsung Gear VR: http://www.samsung.com/global/galaxy/gear-vr/

Face Your Fears: https://www.oculus.com/experiences/gear-vr/1168200286607832/

Unity: https://unity3d.com/

Unreal Engine: https://www.unrealengine.com/en-US/what-is-unreal-engine-4

HTC Vive: https://www.vive.com/uk/product/

Oculus Go: https://www.oculus.com/go/

Immersive Audio Podcast – Episode 4 Sally-Anne Kellaway

Summary

In today’s episode we are joined by Sally-Anne Kellaway via Skype. Sally is the Senior Audio Designer on the Microsoft Mixed Reality – Audio and AI team, and an industry leading VR Audio Evangelist.

She has extensive experience in sound recording, editing, implementation and testing for interactive media in standard and VR/AR and has an interest in implementing true 3D spatial hearing and binaural sound in video games and other interactive experiences. She is the founder of the Virtual Reality Content Creators Network of Australia (VRCC)  which is a not for profit community for virtual reality and associated industries. The VRCC advocates for innovation and connection for all professionals working in virtual, augmented and mixed reality industries in Australia.

Previously the Creative Director at OSSIC, the leading audio technology providers active in the VR space, she has a Masters in Acoustics with a focus on psychoacoustics and spatial audio from the University of Sydney. Sally-Anne is sought after by VR and AR developers, Software and Middleware developers, Conferences, Meetup Groups and Panels to develop and consult on sound design, implementation, tutorials and presentations. She is the Founder of the Women/NB in VR Group for Australia and co-organiser of the San Diego VR community group and is on the AES Technical Committee for Game Audio (Spatial Audio) and on the Diversity and Inclusion Working group.

Sally is a vocal advocate for VR, AR and MR as the future of audio, entertainment and industry and uses her education in Sound Design, Acoustics and Psychoacoustics to rise the tide for all audio professionals passionate about the future.

In this episode, Sally-anne speaks about head-tracking, the future of Audio AR, and diversity in the industry.

Listen To Podcast

Shownotes

Sally-anne Kellaway: http://soundsbysal.weebly.com

University of Sydney: https://sydney.edu.au/

The Virtual Barbershop: https://www.youtube.com/watch?v=IUDTlvagjJA

OSSIC: https://www.ossic.com/

Audio Engineering Society: http://www.aes.org/

Virtual Reality Content Creators of Australia: http://www.vrcc-aus.rocks/

The Wave VR: http://thewavevr.com/

Zero Latency VR: https://www.zerolatencyvr.com/

1.618 To Join The Panel at The BVE 2018 Excel London

1.618 Digital will be taking part in a panel at The Storyteller Theatre at the BVE 2018 Expo Excel London. Oliver Kadel will be discussing the use of immersive audio in modern storytelling, covering everything from future technologies to next generation audio. We’d love to see you there!

The panel discussion takes place on the 1st of Match at 12.30. You can get your free ticket here: Ticket Registration

Check out what else is taking place at BVE 2018.

 

See you soon!

1.618 Team

What YouTube’s Heatmap Is Really Saying About 360 Video

YouTube recently announced a new analytics tool for 360-degree and virtual reality content creators: heatmaps that illustrate where viewers are actually looking. The new tool allows creators to see exactly what parts of their video are holding a viewer’s attention, and for how long.

YouTube has also released some enlightening early statistics on how – and this is important – viewers currently engage with immersive content.

“Surprisingly” (says YouTube), viewers spend 75% of their time focused on the front 90 degrees of an immersive video. Understandably, this figure has a lot of people questioning the point of VR content if the audience is only willing to engage with a quarter of it.

It’s an easy argument to make, but perhaps what these numbers are really saying is that VR content creators need to learn new ways to grab viewers attention in a 360º world?

Ever since moving pictures became something we watched for entertainment purposes, our eyes have been guided by camera angles to tell us where to look. For over a century that’s what the viewing audience has come to expect.

Virtual reality reminds us very much of the 2D world of film and television, but it’s an entirely different medium with its own set of rules that are still being written. Nothing is set in stone.

And camera angles? Well, those are up to the viewer to choose.

Content creators in the virtual reality space have the difficult task of catching the attention of an audience with over 100 years of collective viewing experience of looking straight ahead.

Does this make virtual reality a fad? A gimmick? No, of course not. It simply means that VR can’t rely on the same tools that have been used for film and television to engage an audience in a fully-immersive format.

That’s a lot of unlearning to do for content creators, and a lot of new learning to do as the format develops. It’s an exciting new frontier.

Back to YouTube’s statistics: the most popular VR videos had the audience looking behind them almost 20% of the time. Markers and animation are what the company suggests will help draw attention to other parts of the surrounding space. In our day to day lives our attention is constantly guided by signs, so it’s a helpful suggestion. But think about this: what’s the one sure thing that will make you stop whatever you’re looking at and focus your attention elsewhere?

Sound…

We are programmed to react to sound. In a split second we must figure out where that sound is coming from and what it means. It is as true in the virtual world as it is in the real world, which is why 1.618 Digital is passionate about high-quality spatialised sound.

Spatial audio can be an effective tool to lead or surprise your audience.  By being in the habit of looking in one direction at any given time, the viewer can easily miss out on what is happening behind or beside them. Through the creative implementation of sonic cues within an immersive environment content creators can control or suggest a narrative. Ultimately, this encourages the audience to engage with specific elements – or viewing angles – within the experience.

Virtual reality is an effective form of visual storytelling. What YouTube’s early heatmap data points to isn’t VR’s failure to engage its viewers. It’s the bigger picture of where audience attention currently is, and the gaps content creators need to fill to direct it elsewhere.

1.618 Digital Team

1.618 Digital to join the panel at the Immerse UK event

Welcome to the Real World – Immersive Audio for Augmented and Virtual Reality

1.618 will be taking part in a panel discussion with the UK’s leading Immersive Audio experts. Join us as we talk about the latest cutting-edge work in immersive audio research, development and content design.

The event will cover everything from audio AR/VR creative process, application workflows and the potential for product development. This guarantees to be a truly interactive event, with teams demonstrating some of the most exciting immersive audio technology and experiences in the field.

Other speakers include:

  • Jelle van Mourik (Sony) – Immersive Audio in Games
  • Gavin Kearney (University of York) – Immersive Audio Research
  • Gareth Llewellyn (Mixed Immersion) – Immersive Audio Production for VR
  • Chris Pike (BBC) – Immersive Audio in Broadcast

The panel discussion will take place at 5.45pm-6.45pm on Wednesday 24th May 2017. Click here to register and get your free ticket: Ticket Registration

For more upcoming events hosted by Innovate UK click here

See you there!
1.618 Digital Team

1.618 to join the panel at The BVE 2017 Excel London

1.618 will be taking part in a panel of 3D audio experts at the BVE 2017 Expo Excel London on 2nd March. Join us as we discuss the next generation of immersive audio, covering everything from future technologies to next generation audio. We’d love to see you there!

Discussion topics will include:

Insights into the current and future technologies that will be taking the industry by storm

The role of object-based audio – how this will improve the customer experience.

Binaural audio – creating a really immersive sound for your audience

Will next generation audio take off – how far away are we?

The panel discussion takes place at 12.30-13.30 on Thursday 2nd March. You can get your free ticket here: Ticket Registration 

Check out what else is taking place at BVE on Thursday 2nd March here

See you soon!

1.618 Team