Skip to main content

Oculus “Quill” Turns VR Painting Into Performance Art


Art doesn’t have to be an end product. Thanks to Oculus’ new internal creation tool, Quill, illustrators can draw in virtual reality and let audiences see their creations come to life stroke by stroke around them.
Quill works much like Tilt Brush, the VR painting app Google acquired. Using Oculus’ Touch controllers and motion cameras, Quill users can select different brushes and colors, swing their hands through the air, and each flourish appears instantly within the 3D canvas. Oculus has no plans to make Quill available to the public like Tilt Brush or its own sculpting tool Medium, at least not yet, and is reserving it for its own illustrators.
Dear AngelicaOculus Story Studio built Quill to make its new VR short film Dear Angelica, where hazy watercolor drawings let a daughter explore the fantastical memories of her movie star mother. Oculus announced the film’s production at Sundance 2015 and it will be released later this year, but it’s now showing off a few scenes. Dear Angelica lets you watch flying fish, dragons, and a child’s bedroom be birthed into being one line at a time, reacting to where you look.
Even if Oculus doesn’t publicly release Quill, it could inspire a whole new medium of VR performance art by showing how to add dimensions of time and 3D space to live illustration. The order and cadence of Quill brushstrokes could let artists infuse suspense, humor, or crescendo into the journey of creation.
I sat down with the Oculus Story Studio team, including Wesley Allsbrook, the illustrator for Dear Angelica. She told me why Quill is such a leap forward for VR, and even gave me a crash course so I could paint a derpy little shark onto her 3D masterpiece.

Drawing Through Space And Time

“He made this tool for me to paint in space and time — something I’ve dreamt about all of my life” Allsbrook tells me. She’s referring to Inigo Quilez, a VFX supervisor for Oculus.
Allsbrook was tasked with drawing up the memories explored in Dear Angelica, but was frustrated trying to translate her 2D illustrations into VR. Over barbecue chicken wings one night, Quilez decided to build what Allsbrook needed as a hackathon project, and she named the tool after him. Here’s a video of her using it:

Oculus Story Studio’s technical founder Maxwell Planck explains Quill could assist with storyboarding, concepts, production design, and more. “Coming from computer animation at Pixar, we’d use a lot of illustrations to inform what we’d eventually build in 3D, but there were as a lot lost in translation.” He hints that after illustration, Oculus is trying to figure out the best way to handle cinematography elements like lighting and camera angles in VR. It might end up building an in-VR editing tool like Visionary VR.

Unfolding Around You

The experience of watching the Dear Angelica teaser and then drawing with Quill is overwhelming. The moment I stepped out of it, this was the stream of consciousness I typed out.
On Dear Angelica:
The genesis of image. Taking a journey to the output rather than simply arriving there. It feels participatory, responding to fill your gaze with motion. You choose whether to marvel at what’s already appeared or follow the brush strokes. You become spaceless and bodiless, as images spawn underneath and looking up at you while simultaneously inhabiting the more common planes. 
On Quill:
Creation becomes performance. It’s VR watercolor. There’s suddenly a relevance to what order I draw. jokes and feelings can emerge from the order, and you can build suspense through quickening the pace of visualization.
They’re both jaw-dropping. Imagine the infinite white construct of The Matrix. But in Dear Angelica, rather than filling with racks of guns, dainty streaks of color materialize around you. You can walk around and through the art as it emerges. If you want to inspect the tiny riders upon the dreamy dragon, you simply lean in close. Otherwise, you can spin in circles to see the latest brushstrokes emerge. While not overtly interactive like a video game, Dear Angelica adapts to your field of vision, dynamically moving the brushstroke action in front of you.
Director Saschka Unseld says Quill “makes sense with Dear Angelica on a story level because the main character is recalling memories. When I remember things, it usually starts with small, fuzzy details and then it grows.” That’s exactly how a few wisps of color evolve into drawings like this:
Dear Angelica
A drawing within Dear Angelica
In the second scene, the strokes start slow, filling in the desk and dresser around the bedroom, creating suspense. But as the music builds to a glorious crescendo, the strokes appear faster. The whole rooms springs to life as the bed and the main character Jessica are drawn into being in the center.
This is how Quill enables performance art. The artist’s choices of what to draw first impact the emotion that’s conveyed. Quill could produce humor by showing one figure character’s reaction to something you don’t see yet, then slowly drawing it in as a punchline. Or an artist could create tension or release by speeding up or slowing down the pace of their strokes.
touchcontrollers1
Quill relies on Oculus’ Touch controllers

Creating In VR For VR

When it’s my turn to paint, I quickly discover the pallete, a cube that spawns from your left hand. Turning your wrist reveals the different sides, that include a color selector, brush sizes, opacity controls and more. It’s simple to select them with your right hand on the fly as you draw, giving a distinct feeling of dexterity. You can also grab whole portions of your drawing to re-angle or move them.
Wesley
Dear Angelica illustrator Wesley Allsbrook
I draw the gray outline of my shark with a ribbon-esque brush with little depth. Then I switch to a sphere and enlarge it to fill in between the lines like a kid in a VR coloring book. Holding the cursor on any color on the canvas lets me instantly sample it. Drawing an exterior on the 3D figure is a bit tricky, as it’s easy to press too far and end up painting on the inside rather than the outside. It takes a few tries to get sharky’s toothy grin right.
I’m no artist, yet Quill was instantly intuitive. Making something worthy of a VR film will take skill and practice, but blunt sketches were easy just minutes after strapping in.
That’s why I see the rapid-prototyping potential of Quill as even more important that Dear Angelica. VR producers are constantly plagued with trying to develop scenes, characters, or action in 2D and then port them into 3D where everything works different. But with Quill, they could simply draw rough concepts of what they want, when and where. Finally, artists will be able to create in VR for VR.
Allsbrook has certainly become attached to the idea. She says she’s already asked Inigo, “If they fire me, do you think that I could have a build?”

Comments

Popular posts from this blog

How ad-free subscriptions could solve Facebook

At the core of Facebook’s “well-being” problem is that its business is directly coupled with total time spent on its apps. The more hours you pass on the social network, the more ads you see and click, the more money it earns. That puts its plan to make using Facebook healthier at odds with its finances, restricting how far it’s willing to go to protect us from the harms of over use. The advertising-supported model comes with some big benefits, though. Facebook CEO Mark Zuckerberg has repeatedly said that “We will always keep Facebook a free service for everyone.” Ads lets Facebook remain free for those who don’t want to pay, and more importantly, for those around the world who couldn’t afford to. Ads pay for Facebook to keep the lights on, research and develop new technologies, and profit handsomely in a way that attracts top talent and further investment. More affluent users with more buying power in markets like the US, UK, and Canada command higher ad prices, effectively...

South Korea aims for startup gold

Back in 2011, when South Korea won its longshot bid to host the 2018 Winter Olympics, the country wasn’t widely recognized as a destination for ski and snow lovers. It wasn’t considered much of a tech startup hub either. Fast forward seven years and a lot has changed. For the next 10 days, the eyes of the world will be on the snowy slopes of PyeongChang. Meanwhile, a couple of hours away in Seoul, a burgeoning startup scene is seeing investments multiply, generating exits and even creating a unicorn or two. While South Korea doesn’t get a perfect score as a startup innovation hub, it has established itself as a serious contender. More than half a billion dollars annually has gone to seed through late-stage funding rounds for the past few years. During that time, at least two companies, e-commerce company Coupang and mobile-focused content and commerce company Yello Mobile, have established multi-billion-dollar valuations. To provide a broader picture of how South Korea stacks ...

Trump cites Facebook exec’s comments downplaying Russian ad influence on election

You’d be forgiven for missing Donald Trump’s multiple retweets of Facebook executive Rob Goldman over the weekend. Perhaps you were spending time with family, watching Black Panther or just attempting to forget politics for a moment by ignoring the manic flurry of social media updates from the leader of the free world. But in amongst a deluge of tweets that blamed Democrats for failing to preserve DACA, called out the FBI over the recent school shooting in Florida on the FBI and affectionately referred to a member of congress as “Liddle’ Adam Schiff, the leakin’ monster of no control,” the President cited Facebook’s VP of Ads as evidence against claims that his campaign colluded with Russia. “The Fake News Media never fails,” Trump tweeted over the weekend. “Hard to ignore this fact from the Vice President of Facebook Ads, Rob Goldman!” Trump was citing Goldman’s own Twitter dump over the past week, responding to Special Counsel Robert Mueller’s recent indictment of 13 Russian...

3D printing company New Matter is shutting down this month

Perhaps 2014 wasn’t the ideal time to get into the 3D printing game. After years of hype, the even the biggest names have been struggling to stay afloat. Pasadena startup New Matter is joining the growing list of companies who’ve unsuccessfully made a go at it, announcing that it will be closing up shop by the end of the month. It’s not for lacking of trying — and the company’s MOD-t printer was met with decent reviews when it launched in 2016. In his writeup, John praised the pricing ($300 or $400, depending on where you picked one up) and ease of use, though added cautiously, “you get what you pay for.” Initially funded on Indiegogo, the company went back to the crowdfunding well last year, this time taking to Kickstarter to pay for a Model 2. The project managed to exceed its goal in five days, but New Matter still pulled the plug. The company says it ultimately wanted to go back to the drawing board. “We have always strived to listen closely to our customers’ feedback, and...

Here’s how to keep track of Elon Musk’s Roadster and Starman in space

Elon Musk’s Starman, the mannequin driver of the Tesla Roadster SpaceX launched aboard its Falcon Heavy rocket, is taking a trip around our solar system, in a large elliptical orbit that will bring him relatively close to Mars, the Sun and other heavenly bodies. But how to track the trip, now that the Roadster’s onboard batteries are out of juice and no longer transmitting live footage? Thanks to the work of Ben Pearson, a SpaceX fan and electrical engineer working in the aerospace industry, who created ‘Where is Roadster,’ a website that makes use of JPL Horizons data to track the progress of the Roadster and Starman through space, and to predict its path and let you know when it’ll come close to meeting up with various planets and the Sun. The website tells you the Roadster’s current position, too, as well as its speed and whether it’s moving towards or away from Earth and Mars at any given moment. It’s not officially affiliated with SpaceX or Tesla, but it is something Elon...