{"id":116029,"date":"2019-07-02T07:00:52","date_gmt":"2019-07-02T12:00:52","guid":{"rendered":"https:\/\/www.premiumbeat.com\/blog\/?p=116029"},"modified":"2019-07-02T08:59:48","modified_gmt":"2019-07-02T13:59:48","slug":"interview-michael-conelly-ar-vr-technology","status":"publish","type":"post","link":"https:\/\/www.premiumbeat.com\/blog\/interview-michael-conelly-ar-vr-technology\/","title":{"rendered":"VFX Master Michael Conelly Talks AR and VR Technology"},"content":{"rendered":"

VFX world influencer Michael Conelly<\/a> gave PremiumBeat an in-depth interview on the unlimited possibilities of AR and VR technology.<\/h2>\n

PremiumBeat: <\/strong>You\u2019ve worked in the VFX world for a long time as a supervisor on projects such as\u00a0Snow White and the Huntsman<\/a>\u00a0<\/i>and\u00a0Charlotte\u2019s Web<\/i><\/a>. What is your process? Are you normally involved with the producers and director during pre-production regarding what can be live action and what should be an effect?<\/p>\n

Michael Conelly:<\/strong> It varied quite a lot per show. Generally speaking, I was involved very broadly across the whole production spectrum \u2014 often on set, often involved in the design phase \u2014 but the bulk of my work came in the form of steering very large teams of artists, making sure they were all working in sync with the best tools for each phase of work, and that the kinds of assets they built fit the director\u2019s vision and the producer\u2019s time and budget constraints. It was a very complex job, but very rewarding for the enormous range of work I did from show to show.<\/p>\n

One might invent a new workflow or piece of software one day, then hand it off to a team and teach them how to use it. Deep in production, it\u2019s more about making sure predictions are smoothly turning into actuals \u2014 that characters perform the way they need to, that render times are manageable, that shot complexity doesn\u2019t overwhelm production, that change orders are folded smoothly into a complex flow of work. There\u2019s a lot we could go into more detail on, but that\u2019s the gist.<\/p>\n

\"VFX<\/a>

Image via Snow White and the Huntsman<\/em> (Universal Pictures).<\/p><\/div>\n

PB: <\/strong>What is AR\/VR technology, and how is it transforming storytelling?<\/p>\n

MC:<\/strong> Broadly speaking, I\u2019m far more interested in VR than AR, particularly as a storyteller. There are very few stories that are best told in my kitchen, or wherever I happen to be. There\u2019s a very good reason that movie theaters go black before the movie starts. We want full access to your senses, we don\u2019t want you distracted, and we don\u2019t want you expecting that a story must somehow integrate with the physical world \u2014 where you find yourself \u2014 when the “play” button is pressed.<\/p>\n

As far as the technology, we could speak for a long time about what all is required for VR and AR to work seamlessly, but broadly speaking, VR technology is based on a computer knowing exactly where your eyes and hands are (the more of you the computer knows about the better). Once the computer knows where your eyes are, we can draw pictures for each eye that mimic the kind of perspective and parallax that you experience in the real world. So, we can make it seem to you (visually) that you\u2019re seeing a whole other world that maps perfectly to how you\u2019re moving your head and eyes and body. This is complex stuff. We need to update the image ninety times a second in order to trick your brain into thinking it\u2019s really somewhere else. And if the images we draw don\u2019t conform exactly to how you\u2019re moving, it starts to feel really weird, really quickly. There are incredible issues with optics that need solving; there are issues with how to track your motions within a large room; there are issues with wanting to make sure you don\u2019t walk into things in the real world, once you have the headset on. It\u2019s all delightful when it syncs up. It\u2019s engrossing and captivating in ways no other form of media can approach. From a storytelling standpoint, it\u2019s an absolutely remarkable medium. I can think of no better way to transmit imagination from my head into yours.<\/p>\n

https:\/\/www.premiumbeat.com\/blog\/wp-content\/uploads\/2019\/06\/Caliban-Below-trailer-B.mp4<\/a><\/video><\/div>\n

PB: <\/strong>Your Blackthorn Media has created a 360-virtual reality, interactive origin story called Caliban Below<\/i>. What is the user experience and what are the new special effects \u2014 and how do they yield the emotional result you want with the story?<\/p>\n

MC:<\/strong> Caliban Below<\/em> is a short story, which is part of a much larger project called The Abbot\u2019s Book<\/em>. So there\u2019s some lineage to the piece, but it\u2019s carefully constructed to work as a stand-alone experience, too.<\/p>\n

With each of the pieces we\u2019ve made, we\u2019re targeting a broad audience. We want to appeal to gamers (since they\u2019re currently the most likely to have VR gear), but even more, we want to appeal to people who just like movies and TV. This is why we\u2019ve been so pleased to present our work at film festivals. People have heard of VR, but most people still haven\u2019t experienced it. So, the stories we make first and foremost are built for people who have never done VR before. We have an “on ramp” for the piece that orients our visitor \u2014 gives them a framework for the experience \u2014 it\u2019s 1680AD, Northern Italy. And then, we teach them just the bare minimum necessary to have the story experience. We teach them how to move around with little teleports we call “blinking,” we demonstrate that their hands can interact with the world, and then we tell them that they will play the part of Caliban: “The scion of a broken lineage, struggling to understand his dark inheritance.” It\u2019s a mystery. It\u2019s a world to explore. A story is there to be found, and your place in it yields some wonderful moments of empathy and, I think, a very new and organic way of experiencing a story. People who go into this world don\u2019t know what to expect, and they come out having a pretty sophisticated understanding of a much larger world, and a sense of generations that have preceded their visit to the place.<\/p>\n

In terms of “special effects,” I think that\u2019s the most special. There are all kinds of technical things going on under the hood, but the real magic of the thing is that this “recipe” for storytelling is purely experiential in a way that no other medium has previously achieved. You become<\/i>\u00a0this character, you\u00a0live<\/i> in this world that moves and changes as you go through it. And there\u2019s a bit at the end, in particular, which engrosses and captures the visitor in a very unique way. I don\u2019t want to give away the ending \u2014 it\u2019s quite an effective and wonderful moment of living a narrative.<\/p>\n

\"VFX<\/a>

Michael Conelly<\/p><\/div>\n

PB:<\/strong> With\u00a0Caliban Below<\/i>, the technology is engaging the viewer in a very immersive, unconventional way. You\u2019ve collaborated with Game of Thrones<\/em><\/a> sound designer Paula Fairfield<\/a> \u2013 how does the use of movement and locations connect to music and sound?<\/p>\n

MC:<\/strong> I\u2019m such a big fan of Paula. We\u2019re great friends now, after years of collaboration, and I can\u2019t say enough great things about her. She\u2019s like a magician. So creative, so interested, so able to produce a tapestry of aural experience that is absolutely crucial to the end result. She really fell in love with the power of VR and audio as a medium along the way. I think she\u2019s pretty hooked now, making her own stuff. I\u2019m hoping to collaborate with her on a whole new project she\u2019s dreamed up \u2014 we\u2019ll see how that percolates in the coming months.<\/p>\n

Back to your question though, the sound is so massively important to Caliban Below<\/em>. There are so many tiny details that you feel subconsciously, rather than in the front of your mind. A bird roosting in a ruin, for instance, can be a passing detail, but it instantly fires a host of associations, and helps you understand the world better: “Ah, this place is old; no one cares to clear the birds out. I wonder how long it\u2019s been this way?” Somewhere else, there might be the sound of a trickle of water, and while we may not see it, that too can speak to important backstory. There are thousands of these moments that fly by, and they form a richness that helps sustain a complete illusion.<\/p>\n

\"VFX<\/a>

Image via Caliban Below<\/a>.<\/em><\/p><\/div>\n

PB:<\/strong> Where do you see the future of VR?<\/p>\n

MC:<\/strong> Oh, great question. We\u2019ve been hoping that VR would take off as a mass medium sooner than it has. I continue to love it, but when you compare the audience size for VR versus TV or movies, the economics of it have been pretty janky.<\/p>\n

What I\u2019ve continued to watch for is the “big boys” of the technology continuing to invest in it: Valve, Oculus, HTC, Apple, Google. Their interest in AR and VR evolves over time, but in general, the technology continues to improve. If the tech stagnates, then I think it would be hard to justify sticking with it. As it is, it\u2019s moving slower than I\u2019d like to see. But \u2014 and this is a big but \u2014 one of these days, it\u2019ll be good enough and cheap enough that I think it finally will break through. That\u2019ll be great to see.<\/p>\n

When used right, there really is no medium more potent for transmission of ideas and feelings. And so the future continues to be promising. I think it\u2019ll get here someday, it\u2019s just a question of when. It would be spectacular to see the budget of a Marvel movie funneled into a VR experience. The things you could do with a “proper” budget would be mind-bending and electrifying. With any luck, someday the market economics will support that evolution. Until then, we\u2019ll have to make do. I think the love of the work shines through just fine today. With any luck, more is in store in the not too distant future. Til that fine day!<\/p>\n

\n

Looking for more industry interviews? Check these out.<\/p>\n