Skip to main content

Oculus “Quill” Turns VR Painting Into Performance Art


Art doesn’t have to be an end product. Thanks to Oculus’ new internal creation tool, Quill, illustrators can draw in virtual reality and let audiences see their creations come to life stroke by stroke around them.
Quill works much like Tilt Brush, the VR painting app Google acquired. Using Oculus’ Touch controllers and motion cameras, Quill users can select different brushes and colors, swing their hands through the air, and each flourish appears instantly within the 3D canvas. Oculus has no plans to make Quill available to the public like Tilt Brush or its own sculpting tool Medium, at least not yet, and is reserving it for its own illustrators.
Dear AngelicaOculus Story Studio built Quill to make its new VR short film Dear Angelica, where hazy watercolor drawings let a daughter explore the fantastical memories of her movie star mother. Oculus announced the film’s production at Sundance 2015 and it will be released later this year, but it’s now showing off a few scenes. Dear Angelica lets you watch flying fish, dragons, and a child’s bedroom be birthed into being one line at a time, reacting to where you look.
Even if Oculus doesn’t publicly release Quill, it could inspire a whole new medium of VR performance art by showing how to add dimensions of time and 3D space to live illustration. The order and cadence of Quill brushstrokes could let artists infuse suspense, humor, or crescendo into the journey of creation.
I sat down with the Oculus Story Studio team, including Wesley Allsbrook, the illustrator for Dear Angelica. She told me why Quill is such a leap forward for VR, and even gave me a crash course so I could paint a derpy little shark onto her 3D masterpiece.

Drawing Through Space And Time

“He made this tool for me to paint in space and time — something I’ve dreamt about all of my life” Allsbrook tells me. She’s referring to Inigo Quilez, a VFX supervisor for Oculus.
Allsbrook was tasked with drawing up the memories explored in Dear Angelica, but was frustrated trying to translate her 2D illustrations into VR. Over barbecue chicken wings one night, Quilez decided to build what Allsbrook needed as a hackathon project, and she named the tool after him. Here’s a video of her using it:

Oculus Story Studio’s technical founder Maxwell Planck explains Quill could assist with storyboarding, concepts, production design, and more. “Coming from computer animation at Pixar, we’d use a lot of illustrations to inform what we’d eventually build in 3D, but there were as a lot lost in translation.” He hints that after illustration, Oculus is trying to figure out the best way to handle cinematography elements like lighting and camera angles in VR. It might end up building an in-VR editing tool like Visionary VR.

Unfolding Around You

The experience of watching the Dear Angelica teaser and then drawing with Quill is overwhelming. The moment I stepped out of it, this was the stream of consciousness I typed out.
On Dear Angelica:
The genesis of image. Taking a journey to the output rather than simply arriving there. It feels participatory, responding to fill your gaze with motion. You choose whether to marvel at what’s already appeared or follow the brush strokes. You become spaceless and bodiless, as images spawn underneath and looking up at you while simultaneously inhabiting the more common planes. 
On Quill:
Creation becomes performance. It’s VR watercolor. There’s suddenly a relevance to what order I draw. jokes and feelings can emerge from the order, and you can build suspense through quickening the pace of visualization.
They’re both jaw-dropping. Imagine the infinite white construct of The Matrix. But in Dear Angelica, rather than filling with racks of guns, dainty streaks of color materialize around you. You can walk around and through the art as it emerges. If you want to inspect the tiny riders upon the dreamy dragon, you simply lean in close. Otherwise, you can spin in circles to see the latest brushstrokes emerge. While not overtly interactive like a video game, Dear Angelica adapts to your field of vision, dynamically moving the brushstroke action in front of you.
Director Saschka Unseld says Quill “makes sense with Dear Angelica on a story level because the main character is recalling memories. When I remember things, it usually starts with small, fuzzy details and then it grows.” That’s exactly how a few wisps of color evolve into drawings like this:
Dear Angelica
A drawing within Dear Angelica
In the second scene, the strokes start slow, filling in the desk and dresser around the bedroom, creating suspense. But as the music builds to a glorious crescendo, the strokes appear faster. The whole rooms springs to life as the bed and the main character Jessica are drawn into being in the center.
This is how Quill enables performance art. The artist’s choices of what to draw first impact the emotion that’s conveyed. Quill could produce humor by showing one figure character’s reaction to something you don’t see yet, then slowly drawing it in as a punchline. Or an artist could create tension or release by speeding up or slowing down the pace of their strokes.
touchcontrollers1
Quill relies on Oculus’ Touch controllers

Creating In VR For VR

When it’s my turn to paint, I quickly discover the pallete, a cube that spawns from your left hand. Turning your wrist reveals the different sides, that include a color selector, brush sizes, opacity controls and more. It’s simple to select them with your right hand on the fly as you draw, giving a distinct feeling of dexterity. You can also grab whole portions of your drawing to re-angle or move them.
Wesley
Dear Angelica illustrator Wesley Allsbrook
I draw the gray outline of my shark with a ribbon-esque brush with little depth. Then I switch to a sphere and enlarge it to fill in between the lines like a kid in a VR coloring book. Holding the cursor on any color on the canvas lets me instantly sample it. Drawing an exterior on the 3D figure is a bit tricky, as it’s easy to press too far and end up painting on the inside rather than the outside. It takes a few tries to get sharky’s toothy grin right.
I’m no artist, yet Quill was instantly intuitive. Making something worthy of a VR film will take skill and practice, but blunt sketches were easy just minutes after strapping in.
That’s why I see the rapid-prototyping potential of Quill as even more important that Dear Angelica. VR producers are constantly plagued with trying to develop scenes, characters, or action in 2D and then port them into 3D where everything works different. But with Quill, they could simply draw rough concepts of what they want, when and where. Finally, artists will be able to create in VR for VR.
Allsbrook has certainly become attached to the idea. She says she’s already asked Inigo, “If they fire me, do you think that I could have a build?”

Comments

Popular posts from this blog

Shatterproof screens to protect smartphones

Polymer scientists at the University of Akron in Ohio have developed a transparent electrode that could change the face of smartphones, literally, by making their displays shatterproof. In a recently published paper, researchers show how a transparent layer of nanowire-based electrodes on a polymer surface could be extraordinarily tough and flexible, withstanding repeated scotch tape peeling and bending tests. This could revolutionise and replace conventional touchscreens, according to Yu Zhu, UA assistant professor of polymer science. Currently used coatings made of indium tin oxide (ITO) are more brittle, most likely to shatter, and increasingly costly to manufacture. “These two pronounced factors drive the need to substitute ITO with a cost-effective and flexible conductive transparent film,” Zhu says, adding that the new film provides the same degree of transparency as ITO, yet offers greater conductivity. The novel film retains its shape and functionality after tests i...

Get 56GB of free cloud storage in one folder!

Bring Your Box, Dropbox, Google Drive, & OneDrive All Together In One Folder With odrive! Dropbox gives you up to 16GB free.  Google Drive & Gmail give you 15GB. OneDrive gives you 15GB. Box gives you 10GB. odrive brings all your cloud storage apps together in one folder right on your desktop. Just link your Dropbox, Google Drive, Gmail, Box, and OneDrive accounts to odrive and instantly get all your files scattered everywhere in one place! You can even link multiple accounts from each app to get even more! 1. Install odrive. DOWNLOAD It's free! And available for Windows & Mac :) 3.Get all your stuff! 2. Link all your cloud storage accounts. Note:  This gives odrive permission to download your files for you. odrive doesn't store anything, we promise! OXYGEN CLOUD, INC., 1600 SEAPORT BLVD, REDWOOD CITY, CA, 94063, UNITED  ...

So, when will your device actually get Android Oreo?

Google officially just took the wraps off of Android Oreo, but there are still some questions left to be answered — most notably, precisely when each device will be getting the latest version of the mobile operating system. Due to Android’s openness and a variety of different factors on the manufacturing side, it’s not an easy question to answer, but we’ll break it down best we can. First the good news: If your device was enrolled in the Android Beta Program, you’ll be getting your hands on the final version of the software “soon,” according to Google. Exactly what that means remains to be seen, but rest assured that you’ll be one of of the first people outside of Google to take advantage of picture-in-picture, notification dots and the like. No big surprise, Google handsets will be the first non-beta phones to get the update. The Pixel, Nexus 5X and 6P are at the top of the list, alongside Pixel C tablet and ASUS’s Nexus Player set-top box, which will be receiving the upgrade i...

The Withings Go Is A Cheap Little Activity Tracker

Withings  has one more thing up its sleeve, a new activity tracker. This isn’t a new version of the  Pulse  or Activité. This is a brand new activity tracker. And the best part is that it only costs $69. The Withings Go uses an always-on E Ink display like the one on your Kindle or original Pebble. It’s very power efficient but it’s also a black and white display. But the good thing about this kind of display is that the Withings Go uses a button cell battery and the battery lasts 8 months. This new device tracks your steps, distance, running activity and swimming activity. You can also use it to track your sleep cycles. Compared to other entry-level activity trackers, you can do quite a lot. You don’t have to switch between activities — the device switches automatically. And of course, you can get your data in the Withings Health Mate app on iOS and Android. The Withings Go will be available in Q1 2016. Now the question is whether people want ...

Where does Blue Apron go after Amazon wraps up its Whole Foods deal?

Last week, Amazon said that its massive $13.7 billion deal to acquire Whole Foods is wrapping up on Monday — giving it access to one of the strongest food brands in the United States, as well as hundreds of grocery stores in metropolitan areas. That means it’s going to be easier and easier for people to get access to great ingredients, and there’s been a continued trickle of suggestions that Amazon will be gunning for a massive business that helped Blue Apron go public — a trickle that has since tempered Wall Street’s appetite for that business. All this raises a ton of questions as to what the future of Blue Apron is as Amazon looks primed to bulldoze into its territory in a very Amazon move. But as the specter of Amazon getting into meal-kit delivery looms, let’s review really quickly what Blue Apron has going for it: It has a strong brand in meal-kit delivery. The company wouldn’t have been able to go public, much less sustain unicorn status even as its stock continues to plumme...