Facebook Can Make VR Avatars Look–and Move–Exactly Like You

“There’s this big, ugly sucker at the door, ” the young woman says, her eyes twinkling, “and he said,’ Who do you think you are, Lena Horne ?’ I said no but that I knew Miss Horne like a sister.”

It’s the beginning of a short soliloquy from Walton Jones’ play The 1940′ s Radio Hour, and as she continues with the monologue it’s easy to see that the young woman knows what she’s doing. Her smile grows while she goes on to recount the doorman’s change of tune–like she’s letting you in on the joke. Her lips curl as she confiscates on simply the right terms, playing with their cadence. Her expressions are so finely calibrated, her reading so assured, that with the dark background behind her, you’d think you were watching a black-box revival of the late-’7 0s Broadway play.

There’s only one problem: Her body disappears below the neck.

Yaser Sheikh reaches out and stops the video. The female is a stunningly lifelike virtual-reality avatar, her performance generated by data gathered beforehand. But Sheikh, who heads up Facebook Reality Labs’ Pittsburgh location, has another video he considers more impressive. In it, the same woman appears wearing a VR headset, as does a young man. Their headsetted real-life egoes chat on the left of the screen; on the right side, simultaneously, their avatars carry on in perfect concert. As mundane as the conversation is–they talk about hot yoga–it’s also an unprecedented glimpse at the future.

For years now, people have been interacting in virtual reality via avatars, computer-generated characters that represent us. Because VR headsets and hand controllers are trackable, our real-life head and hand motions carry into those virtual dialogues, the unconscious idiosyncrasies adding crucial texture. Yet even as our virtual interactions have become more naturalistic, technical constraints have forced them to remain visually simple. Social VR apps like Rec room and Altspace abstract us into caricatures, with expressions that rarely( if ever) map to what we’re really doing with our faces. Facebook’s Spaces is able to generate a reasonable cartoon approximation of you from your social media photos but depends on buttons and thumb-sticks to trigger certain express. Even a more technically demanding platform like High Fidelity, which allows you to import a scanned 3D model of yourself, is a long way from being able to make an avatar feel like you.

Leave a Comment

Your email address will not be published. Required fields are marked *